Human Motion Analysis for Healthcare Applications


Using skeletal data for human motion analysis has several advantages over the other visual data such as video and images since the features extracted from skeletal data tend to be more compact and more robust to the variation between different subjects as the visual appearance is not included. In [Rueangsirarak et al. IEEE TNSRE2018], we propose an automatic framework for classifying musculoskeletal and neurological disorders among older people based on 3D motion data. We also propose two new features to capture the relationship between joints across frames, known as 3D Relative Joint Displacement (3DRJDP) and 6D Symmetric Relative Joint Displacement (6DSymRJDP), such that the relative movement between joints can be analyzed. To handle noisy skeletal data captured using depth sensors such as Microsoft Kinect, we propose a framework that accurately classifies the nature of the 3D postures obtained by Kinect using a max-margin classifier in [Ho et al. CVIU2016]. Different from previous work in the area, we integrate the information about the reliability of the tracked joints in order to enhance the accuracy and robustness of our framework.

Readers are also referred to a closely related project on pose-based early prediction on cerebral palsy on video.

  1. Worasak Rueangsirarak, Jingtian Zhang, Nauman Aslam, Edmond S. L. Ho, Hubert P. H. Shum, "Automatic Musculoskeletal and Neurological Disorder Diagnosis with Relative Joint Displacement from Human Gait" journal , IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol 26(12), pp. 2387-2396, Dec 2018. PDF bibtex
  2. Edmond S. L. Ho, Jacky C. P. Chan, Donald C. K. Chan, Hubert P. H. Shum, Yiu-ming Cheung, Pong C. Yuen, "Improving Posture Classification Accuracy for Depth Sensor-based Human Activity Monitoring in Smart Environments" journal, Computer Vision and Image Understanding, vol 148, pp. 97-110, July 2016. PDF bibtex

The Team

Dr. Worasak Rueangsirarak

Assistant Dean / Lecturer, Mae Fah Luang University

Dr. Edmond S. L. Ho

Senior Lecturer, Northumbria University

Dr. Jacky C. P. Chan

Lecturer, Hong Kong Baptist University

Dr. Jingtian Zhang

Research Fellow, University of Nottingham

Dr. Hubert P. H. Shum

Associate Professor, Durham University

Prof. Nauman Aslam

Professor, Northumbria University