CSE - Drone Response: Engineering multi-UAV Autonomous Systems

The DroneResponse Lab focuses on developing advanced multi-vehicle autonomous UAV systems to support critical emergency response missions, such as search and rescue, disaster assessment, and recovery operations. Our research integrates cutting-edge technologies including computer vision, real-time anomaly detection, autonomous decision-making, and situational awareness for humans.  For a quick overview of our Drone Response project please see: https://youtu.be/DyKqxkesgg0?si=OnNHl0Y6dSzn_Ap-

We have opportunities for several different projects for undergraduate students - some focusing more on development and others more on experimental research.  Most of our projects (except the HCI one listed below) include a significant amount of Python programming (at varying levels of difficulty), therefore you must have proficient Python programming skills to apply for these positions.  You may also apply for a project with a partner if you wish to (both of you must name the other person).  

  1. Computer Vision: You will be helping to train new aerial Computer Visions models for use by the drones.  The project will include some annotation (10%), programming (60%), running experiments (15%), writing up results (10%), and meetings (5%). [Credit or paid position is possible.  Paid position would focus more on annotation and experimentation, with some programming.  Paid position can be 5-8 hours to week and no experience is needed]
     
  2. Enhancing our LLM-based Natural Language Interface: You will be enhancing our NL interface for supporting emergency responders in providing mission inputs based on voice and text.  The inputs need to be mapped to system capabilities.  The project will include some programming (70%), running experiments (15%), writing up results (10%), and meetings (5%). [Credit only]
     
  3. RAG (Retrieval Augmented Generation): You will be doing research in how to dynamically retrieve and analyze documents describing best-practices for diverse emergency response scenarios.  You will also use LangChain to coordinate these tasks, and you will experiment with ways to map best practices into a structured format.  This project is more research oriented, so you should be willing to think of ideas, experiment with them, and report your ideas.  The project will include reading research papers (20%), programming (50%), running experiments (15%), writing up results (10%), and meetings (5%). [Credit only]
     
  4. Human Computer Interaction: Situational Awareness:  This project will involve organizing and conducting user studies focused around situational awareness in multi-vehicle drone systems.  The studies will all be conducted in our simulation environment, with possible outdoor field tests in the Spring.  The project will include reading research papers (10%), programming (20%), running experiments (50%), writing up results (15%), and meetings (5%). [Credit or paid position is possible]
     
  5. Mobile Apps:  We have the need to develop several tablet-based and mobile apps for supporting human operators of drones.  Please ONLY apply for this project if you are proficient at mobile app development, and looking for the opportunity to engage in a realistic real-world project. The project will include eliciting requirements (10%), design (15%), programming (60%), testing (10%), and meetings (5%). [Credit or paid position is possible]

If you are interested in any of these positions, you can apply through this system and/or make an appointments to meet with me.  You are far more likely to be offered a position if you come and talk to me (Prof. Jane Cleland-Huang).


 

Name of research group, project, or lab
Drone Response
Why join this research group or lab?

The DroneResponse Lab is a dynamic and exciting place to work because it sits at the intersection of cutting-edge technology and real-world impact. Our research focuses on developing autonomous UAV systems that can support emergency response efforts, which is both technically challenging and societally crucial. The lab works on integrating autonomous decision-making, multi-vehicle coordination, real-time data analysis, and regulatory compliance to create systems that can operate effectively in complex, high-stakes environments like disaster zones and search-and-rescue missions

Logistics Information:
Project categories
Computer Science & Engineering
Student ranks applicable
Sophomore
Junior
Senior
Student qualifications
  • Please see the project list for specific qualifications. 
  • Most projects require Python proficiency.  One project requires Human Computer Interaction coursework or experience.  
  • Our group is collaborative -- we are in this together, so we are looking for team players who want to contribute to our shared system.
  • Occasional trysts to outdoor flying fields for tests

What I'm looking for in your application: (Note: These are things that future employees will also want to know when you interview for a job)

  1. Why are you interested in this particular project?  What are your passions and/or career goals -- and how does this project contribute towards those?
  2. What can you bring to our lab? (Don't be shy -- I want to know!) What skills do you have that make you a good match for the project?
     
Hours per week
3 credits / 12+ hours
Compensation
Research for Credit
Paid - General
Number of openings
4
Techniques learned

In general our projects will give you the opportunity to engage in a much  larger programming (engineering) project than you will be able to do in coursework alone. Specific skills you will develop are dependent upon the project you are selected for. 

Project start
Start of Spring Semester (If desired, I will give selected applicants a reading packet to start informally prepping for the project over the break))
Contact Information:
Mentor
jhuang13@nd.edu
Professor
Name of project director or principal investigator
Jane Cleland-Huang
Email address of project director or principal investigator
JaneHuang@nd.edu
4 sp. | 7 appl.
Hours per week
3 credits / 12+ hours
Project categories
Computer Science & Engineering