Human Motion Analysis for Healthcare Applications


Introduction

Using skeletal data for human motion analysis has several advantages over the other visual data such as video and images since the features extracted from skeletal data tend to be more compact and more robust to the variation between different subjects as the visual appearance is not included. In [Rueangsirarak et al. IEEE TNSRE2018], we propose an automatic framework for classifying musculoskeletal and neurological disorders among older people based on 3D motion data. We also propose two new features to capture the relationship between joints across frames, known as 3D Relative Joint Displacement (3DRJDP) and 6D Symmetric Relative Joint Displacement (6DSymRJDP), such that the relative movement between joints can be analyzed. To handle noisy skeletal data captured using depth sensors such as Microsoft Kinect, we propose a framework that accurately classifies the nature of the 3D postures obtained by Kinect using a max-margin classifier in [Ho et al. CVIU2016]. Different from previous work in the area, we integrate the information about the reliability of the tracked joints in order to enhance the accuracy and robustness of our framework.

Readers are also referred to a closely related project on pose-based early prediction on cerebral palsy on video.
Publications

  1. Worasak Rueangsirarak, Jingtian Zhang, Nauman Aslam, Edmond S. L. Ho, Hubert P. H. Shum, "Automatic Musculoskeletal and Neurological Disorder Diagnosis with Relative Joint Displacement from Human Gait" journal , IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol 26(12), pp. 2387-2396, Dec 2018. PDF bibtex
  2. Edmond S. L. Ho, Jacky C. P. Chan, Donald C. K. Chan, Hubert P. H. Shum, Yiu-ming Cheung, Pong C. Yuen, "Improving Posture Classification Accuracy for Depth Sensor-based Human Activity Monitoring in Smart Environments" journal, Computer Vision and Image Understanding, vol 148, pp. 97-110, July 2016. PDF bibtex

The Team

Dr. Worasak Rueangsirarak

Assistant Dean / Lecturer, Mae Fah Luang University
worasak.rue@mfu.ac.th

Dr. Edmond S. L. Ho

Senior Lecturer, Northumbria University
e.ho@northumbria.ac.uk

Dr. Jacky C. P. Chan

Lecturer, Hong Kong Baptist University
cpchan@comp.hkbu.edu.hk

Dr. Jingtian Zhang

Research Fellow, University of Nottingham
Jingtian.Zhang@nottingham.ac.uk

Dr. Hubert P. H. Shum

Associate Professor, Durham University
hubert.shum@durham.ac.uk

Prof. Nauman Aslam

Professor, Northumbria University
nauman.aslam@northumbria.ac.uk