Motion segmentation in biological images

The goal of this research is to extract instances of C. elegans (roundworm) in microscopic video, characterize their motion patterns, and classify them into normal and abnormal classes. The student researcher will develop Python code for video segmentation using current-generation neural network methods (e.g., SAM, DINO). Segments corresponding to isolated instances of C. elegans will be tracked, and their patterns of movement and articulation ("squirming") characterized by features such as Fourier moments. These features will be provided to a classifier that learns to distinguish worms with a normal diet from worms with an adulterated diet (narcotics, etc.). Characterization of segmenter and classifier performance will be performed. An early component of this work will be the assembly of a corpus of video from online sources to use in training.

Name of research group, project, or lab
Computer Vision Research Laboratory
Why join this research group or lab?

The Computer Vision Research Laboratory is home to three faculty and about tweny graduate students, undergraduate researchers, and postdoctoral scholars. Research teams meet frequently and conduct research in a variety of topic areas relating to the analysis and interpretation of imagery. 

Logistics Information:
Project categories
Computer Science & Engineering
Student ranks applicable
First Year
Sophomore
Junior
Senior
Student qualifications

Familiarity with Python is essential (we do not require mastery, but basic ability is needed). Exposure to AI model use in Python (e.g., Pytorch for training and/or inference) is a plus, but not necessary. 

Hours per week
1 credit / 3-6 hours
2 credits / 6-12 hours
3 credits / 12+ hours
Compensation
Research for Credit
Paid - General
Number of openings
2
Techniques learned

Advanced programming (including AI programming) in Python.

Exposure to experimental methods in computer vision research.

Development of literature searching skills in computer vision.

Contact Information:
Mentor
flynn@nd.edu
Professor
Name of project director or principal investigator
Patrick Flynn
Email address of project director or principal investigator
flynn@nd.edu
2 sp. | 0 appl.
Hours per week
1 credit / 3-6 hours (+2)
1 credit / 3-6 hours2 credits / 6-12 hours3 credits / 12+ hours
Project categories
Computer Science & Engineering