Background
Human-robot Interaction (HRI) is increasingly important in industrial, medical, and assistive applications, requiring intuitive and efficient interaction between humans and robots. Augmented Reality (AR) can enhance this interaction by providing real-time visualization and feedback on human and robot movements. A vision-based motion tracking system integrated with AR could improve coordination, safety, and task efficiency in shared workspaces.
Objective
The goal of this thesis is to develop an Augmented Reality Motion Tracking System that enables seamless and intuitive human-robot collaboration. The system will track human motion in real-time and overlay relevant data through AR, allowing both the human and the robot to adapt dynamically to each other’s actions.
Key Tasks
Literature Review
Study existing motion tracking techniques, AR applications, and human-robot interaction (HRI) frameworks.
Vision-Based Motion Tracking
Implement a real-time vision-based motion tracking system using depth cameras, optical tracking, or markerless tracking (e.g., OpenPose, MediaPipe).
Augmented Reality Integration
Develop an AR interface (e.g., using HoloLens, ARKit, or ARCore) to overlay human motion data, robot status, and guidance information in the real world.
Human-Robot Interaction Design
Define interaction strategies where AR feedback enhances task coordination, safety, and efficiency.
System Implementation & Control
Integrate the AR motion tracking system with a robotic platform, enabling real-time adaptation to human actions.
Experimental Validation
Conduct user studies or simulations to evaluate system accuracy, usability, and effectiveness in improving HRI.
Expected Outcomes
- A functional AR-based motion tracking system for real-time human-robot collaboration and interaction.
- Experimental validation of the system’s impact on task efficiency and user experience.
- Insights into the potential of AR-enhanced robotics for collaborative environments.
Requirements
- Background in computer vision, robotics, or AR.
- Experience with programming (e.g., Python, C#, ROS, Unity, OpenCV).
- Interest in human-robot interaction and real-time systems.
This thesis presents an opportunity to contribute to next-generation human-robot collaboration, improving safety and efficiency in shared workspaces.