Real-time skeleton detection

To locate the different joints of the human body in 3D space when walking on a treadmill, a state-of-the-art 2D skeleton algorithm will be combined with depth imaging. During this project we will investigate different combinations of RGB and time-of-flight cameras to achieve the most accurate joint positions.

Validation of skeletonization procedure

In the first part of this validation phase, we will use virtual scenes with a known ground truth. In the virtual scenes we will simulate both the 2D and 3D imaging devices on different human bodies.
When all validation results based on virtual images are satisfying, we will benchmark the entire skeleton tracking system against a commercially available marker-based Vicon system.

Treadmill implementation

During this stage of the research project, we will write software to control the treadmill and to link its data to a virtual environment. Also the skeleton tracking system developed earlier, will be combined with the treadmill.

Development of virtual environments

To make the rehabilitation exercise more patient specific, some virtual environments will be created in Unity in combination with the HTC VIVE Pro virtual reality glasses. The physiotherapist now has the ability to change the surroundings (beach, north pole, city, ...), but also to add specific features such as birds, people, signs, etc. This makes it possible to trigger the patient to move certain body parts (head, arms, ...).

Physiological gait analysis

Finally, the gait of the patient walking on a treadmill, will be analysed and compared to situations where no virtual reality environment is used. Also we will gather some information on how patients perceive this new approach.



Faculty of Applied Engineering



Project coordination, computer vision research and engineering research

  • 3D vision
  • Thermal imaging
  • Robotics



Faculty of Medicine and Health Sciences



Interpretation and validation of the detected skeletons and physiological analysis.

  • ...
  • ...
  • ...

Product development


Faculty of Design Sciences


3D Scanning of a test person and implementation of statistical shape models.

  • ...
  • ...
  • ...

Multimedia Technology


Department of Multimedia and Communication Technology

Creation of several virtual environments in Unity and support of triggerable objects.

  • AR/VR/MR
  • Internet of Things
  • Usability