Wearable Motion Capture

We present WearMoCap, a system for pose estimation from the data of a single smartwatch or from a watch and a phone together.

At the Interactive Robotics Laboratory, we turn smartwatch pose tracking into versatile robot control interfaces.

Videos

Our work facilitates real-time motion capture from smartwatch and smartphone data. Imagine flying drones with arm motions or teleoperating robots through a video stream on your phone. We made it possible thanks to the power of Differentiable Ensemble Kalman Filters.

Next to these summaries, we also have a 3-min summary and further material available.

Code On GitHub

The WearMoCap System is open source and extensively documented. All related repositories are wrapped into a GitHub organization:

WearMoCap

Publications

Please click the titles of the publications below for more information.