Wearable Motion Capture

We present WearMoCap, a system for pose estimation from the data of a single smartwatch or from a watch and a phone together.

Videos

At the Interactive Robotics Laboratory, we turn smartwatch pose tracking into versatile robot control interfaces. Imagine flying drones with arm motions or teleoperating robots through a video stream on your phone.

Code and Data

The WearMoCap System is open source and extensively documented. All related repositories are publicly available on GitHub. Model training and test data is available on Hugging Face:

Code and Tutorials
Data

Publications

Please click the titles of the publications below for more information.