Using Data from the Microsoft Kinect 2 to Quantify Upper Limb Behavior: A Feasibility Study

The objective of this study was to assess whether the novel application of a machine learning approach to data collected from the Microsoft Kinect 2 (MK2) could be used to classify differing levels of upper limb impairment. Twenty-four healthy subjects completed items of the Wolf Motor Function Test (WMFT), which is a clinically validated metric of upper limb function for stroke survivors. Subjects completed the WMFT three times: 1) as a healthy individual; 2) emulating mild impairment; and 3) emulating moderate impairment. A MK2 was positioned in front of participants, and collected kinematic data as they completed the WMFT. A classification framework, based on Riemannian geometry and the use of covariance matrices as feature representation of the MK2 data, was developed for these data, and its ability to successfully classify subjects as either 'healthy,' 'mildly impaired,' or 'moderately impaired' was assessed. Mean accuracy for our classifier was 91.7%, with a specific accuracy breakdown of 100%, 83.3%, and 91.7% for the 'healthy,' 'mildly impaired,' and 'moderately impaired' conditions, respectively. We conclude that data from the MK2 is of sufficient quality to perform objective motor behavior classification in individuals with upper limb impairment. The data collection and analysis framework that we have developed has the potential to disrupt the field of clinical assessment. Future studies will focus on validating this protocol on large populations of individuals with actual upper limb impairments in order to create a toolkit that is clinically validated and available to the clinical community.