Model Predictive Control (MPC) is a very powerful control scheme that computes the current control input at each time instant by optimizing the state-action trajectory over a receding time horizon. The optimization problem can include any type of constraint relevant to the specific application, e.g. maintaining visibility over a target view in the case of a visual servoing task. However, traditional constrained optimization would fail when the initial guess is far from the convergence basin. On the contrary, diffusion models, which are AI generative models, have been proven effective in generating trajectories that can steer the robot to the desired target view even if the target is initially not visible. Solely relying on diffusion is not viable yet, because they lack the robustness of traditional methods and require a high computational effort.
This thesis investigates the development of a control scheme for visual servoing, that integrates the sampling capabilities of diffusion models and the performance guarantees of an MPC-based control approach. The former allows exploiting training to embed useful knowledge about the environment, e.g. the relative position of the target given the current image, while the latter allows imposing constraints for dynamical feasibility. The control scheme will be tested on a UAV, equipped with an on-board camera. This thesis falls within the scope of the European AutoASSESS project aimed at developing UAVs that can autonomously perform contact aerial inspection in ballast water tanks of cargo ships.
Expected outcomes:
- A control scheme fusing the advantages of traditional MPC and latent diffusion approaches
- Simulation-based results showing the resilience of the proposed approach
- If feasible within the project timeframe, deployment and testing of the developed framework in real-world experiments
Prerequisites:
The student working on the project should have
- good programming skills in python and pytorch,
- be familiar with ROS, and
- hold the fundamentals in optimal control and machine learning.
- Knowledge in control for UAVs is encouraged but not required.
If you are interested and would like to apply for this thesis subject please contact Barbara Bazzana b.bazzana@utwente.nl and Antonio Franchi a.franchi@utwente.nl to arrange for an interview. Please send your CV, transcript of exams, and a motivation letter in the email in order for your application to be considered.