EE - Trustworthy Physical AI: Learning Controllers You Can Prove, Not Just Tune

This project develops safe, trustworthy Physical AI by combining reinforcement learning with structure-preserving optimal control for robotic systems modeled as port-Hamiltonian (PH) systems, including robotic arms, mobile robots, and quadrotors. Instead of relying on opaque black-box policies, controllers are explicitly grounded in physics—using energy shaping and passivity to guarantee stability, while safety filters enforce hard constraints so the robot cannot violate actuator limits or enter unsafe regions during learning or deployment. Physics-informed neural networks capture the remaining unknown components, embedding known dynamics and stability conditions directly into training so the system learns efficiently without breaking physical laws. Students will build this trustworthy-AI pipeline end-to-end: modeling robot dynamics, coding nonlinear controllers and trajectory optimizers in Python, training safety-certified neural controllers, and validating them on real hardware against standard RL and linearized baselines. This offers a hands-on path to publishable research on Physical AI systems that are provably stable, verifiably safe, and optimal by design.

Name of research group, project, or lab
Physical AI
Why join this research group or lab?

This lab is a fast-moving place to work at the intersection of Physical AI, nonlinear control, and robotics, where theory and hardware meet every week. The project on safe, trustworthy Physical AI is important because future robots must be not only intelligent, but provably stable and reliably safe when operating around people in the real world. In parallel with this project, the group is exploring physics-informed neural networks for complex dynamical systems, structure-preserving reinforcement learning for port-Hamiltonian robots, and safety-critical control with formal guarantees, creating a tightly connected set of efforts that feed into each other. Students join an environment where they can write code, run robots, and contribute to publishable research on how to make real-world AI systems we can actually trust.

Logistics Information:
Project categories
Aerospace and Mechanical Engineering
Computer Science & Engineering
Electrical Engineering
Mathematics
Student ranks applicable
Junior
Senior
Graduate Student
Student qualifications

Students best suited for this project are highly motivated, love mathematics, and enjoy tackling challenging problems rather than quick fixes. They should have a strong background in calculus, linear algebra, and differential equations, plus solid programming experience in Python or MATLAB and genuine interest in control, robotics, and machine learning. Prior exposure to dynamical systems, optimization, or reinforcement learning is a strong plus, as is comfort reading technical papers and translating theory into code. No special physical qualifications are required beyond standard lab work with computers and benchtop robots in normal indoor environments.

Hours per week
2 credits / 6-12 hours
3 credits / 12+ hours
Compensation
Research for Credit
Number of openings
2
Techniques learned

Students in this project will learn a spectrum of modern techniques at the intersection of control, robotics, and machine learning. They can expect to learn nonlinear modeling of robotic systems (including port-Hamiltonian formulations), trajectory optimization and energy-based control design with explicit stability and safety guarantees, and the use of physics-informed neural networks to embed dynamical structure into learning-based controllers. They will gain hands-on experience with reinforcement learning for continuous control, safety filters and control barrier functions for enforcing constraints, and end-to-end implementation of these methods in Python or MATLAB for both simulation and real robotic hardware.

Project start
Fall 2026, Spring 2027
Contact Information:
Mentor
hlin1@nd.edu
Professor
Name of project director or principal investigator
Hai Lin
Email address of project director or principal investigator
hlin1@nd.edu
2 sp. | 0 appl.
Hours per week
2 credits / 6-12 hours (+1)
2 credits / 6-12 hours3 credits / 12+ hours
Project categories
Aerospace and Mechanical Engineering (+3)
Aerospace and Mechanical EngineeringComputer Science & EngineeringElectrical EngineeringMathematics