Journal DOI 10.68956/journal.human-performance-futures

Creative Commons source reading · Data quality and algorithm evaluation

Independent AI pipelines for rehabilitation exercise assessment and cognitive status classification: a retrospective proof of concept study

Guoyu Wang; Guoliang Ren; Jiaju Zhu

Originally published in Front Public Health · 2026-10-14

From the article

Selected source text. JournalOS removes markup and shortens excerpts where indicated. The full article provides the complete context.

Abstract

BackgroundDigital rehabilitation can extend remote exercise monitoring and cognitive health support, but available public datasets often capture these functions separately. This study evaluates two independent machine learning pipelines within a conceptual telerehabilitation architecture rather than a clinically validated integrated system.MethodsThe physical pipeline used the WLU Rehabilitation Posture dataset. After quality control and removal of exact duplicates, we retained 315 unique videos of arm raise, knee extension, and sit-to-stand with dataset-defined correct or incorrect labels. We converted 24 video frames into 182 privacy-preserving features: appearance, shape, gradient, optical flow, temporal, and metadata. We compared candidate algorithms using stratified five-fold cross-validation within the training data, reserving a…

Dataset audit and descriptive findings

Physical Check found 339 videos and 0 unreadable files. They then merged exact duplicates; 315 videos remained across 6 classes. The class distribution was moderately non-normal, with Knee Extension Incorrect as the largest class (n = 62) and Knee Extension Correct as the smallest (n = 42). The mean duration of sit-to-stand correct videos was 6.30 s, whereas the arm raise incorrect videos had the shortest duration at 3.84 s. Descriptive statistics of the physical rehabilitation video dataset are shown in Figure 2. Figure 2a depicts the results for correct versus incorrect recordings for the three exercises. The highest number of incorrect videos was recorded with knees extended, while the highest number of correct videos was recorded during sit-to-stand. The distributions of the video duration for each study are shown in Figure 2b;…

Discussion

The main objective of this study is to assess two independent, explainable machine learning pipelines that perform complementary technical tasks relevant to telerehabilitation: classifying rehabilitation exercises from video and classifying cognitive status from tabular records. Under random video-level holdout evaluation, the physical pipeline achieved 85.7% accuracy and an 84.9% macro F1 score for the six-class exercise-by-correctness task; participant-independent performance could not be established because participant and session identifiers were unavailable. The cognitive pipeline achieved 93.6% accuracy, a macro F1 of 92.3%, and an AUC of 0.978. These values are only technically separable within the datasets and do not represent a clinically tested integrated rehabilitation system. The key contribution is a transparent modular…

Editorial reading guide

  • What data created and tested the model, and was evaluation independent?
  • What is the cost of a false positive, false negative or out-of-distribution decision?