Ηand dexterities assessment in stroke patients based on augmented reality and machine learning through a box and block test.

A popular and widely suggested measure for assessing unilateral hand motor skills in stroke patients is the box and block test (BBT). Our study aimed to create an augmented reality enhanced version of the BBT (AR-BBT) and evaluate its correlation to the original BBT for stroke patients. Following G-power analysis, clinical examination, and inclusion-exclusion criteria, 31 stroke patients were included in this study. AR-BBT was developed using the Open Source Computer Vision Library (OpenCV). The MediaPipe's hand tracking library uses a palm and a hand landmark machine learning model to detect and track hands. A computer and a depth camera were employed in the clinical evaluation of AR-BBT following the principles of traditional BBT. A strong correlation was achieved between the number of blocks moved in the BBT and the AR-BBT on the hemiplegic side (Pearson correlation = 0.918) and a positive statistically significant correlation (p = 0.000008). The conventional BBT is currently the preferred assessment method. However, our approach offers an advantage, as it suggests that an AR-BBT solution could remotely monitor the assessment of a home-based rehabilitation program and provide additional hand kinematic information for hand dexterities in AR environment conditions. Furthermore, it employs minimal hardware equipment.

A Holistic Approach for Enhancing Museum Performance and Visitor Experience.

Managing modern museum content and visitor data analytics to achieve higher levels of visitor experience and overall museum performance is a complex and multidimensional issue involving several scientific aspects, such as exhibits' metadata management, visitor movement tracking and modelling, location/context-aware content provision, etc. In related prior research, most of the efforts have focused individually on some of these aspects and do not provide holistic approaches enhancing both museum performance and visitor experience. This paper proposes an integrated conceptualisation for improving these two aspects, involving four technological components. First, the adoption and parameterisation of four ontologies for the digital documentation and presentation of exhibits and their conservation methods, spatial management, and evaluation. Second, a tool for capturing visitor movement in near real-time, both anonymously (default) and eponymously (upon visitor consent). Third, a mobile application delivers personalised content to eponymous visitors based on static (e.g., demographic) and dynamic (e.g., visitor movement) data. Lastly, a platform assists museum administrators in managing visitor statistics and evaluating exhibits, collections, and routes based on visitors' behaviour and interactions. Preliminary results from a pilot implementation of this holistic approach in a multi-space high-traffic museum (MELTOPENLAB project) indicate that a cost-efficient, fully functional solution is feasible, and achieving an optimal trade-off between technical performance and cost efficiency is possible for museum administrators seeking unfragmented approaches that add value to their cultural heritage organisations.

An integrated rehabilitation system for the upper limb spasticity assessment and treatment: the Rehabotics passive exoskeletal system.

Limb spasticity is caused by stroke, multiple sclerosis, traumatic brain injury and various central nervous system pathologies such as brain tumors resulting in joint stiffness, loss of hand function and severe pain. This paper presents with the Rehabotics integrated rehabilitation system aiming to provide highly individualized assessment and treatment of the function of the upper limbs for patients with spasticity after stroke, focusing on the developed passive exoskeletal system. The proposed system can: (i) measure various motor and kinematic parameters of the upper limb in order to evaluate the patient's condition and progress, as well as (ii) offer a specialized rehabilitation program (therapeutic exercises, retraining of functional movements and support of daily activities) through an interactive virtual environment. The outmost aim of this multidisciplinary research work is to create new tools for providing high-level treatment and support services to patients with spasticity after stroke.Clinical Relevance- This paper presents a new passive exoskeletal system aiming to provide enhanced treatment and assessment of patients with upper limb spasticity after stroke.

Sollerman Hand Function Sub-Test "Write with a Pen": A Computer-Vision-Based Approach in Rehabilitation Assessment.

Impaired hand function is one of the most frequently persistent consequences of stroke. Throughout the rehabilitation process, physicians consistently monitor patients and perform kinematic evaluations in order to assess their overall progress in motor recovery. The Sollerman Hand Function Test (SHT) is a valuable assessment tool used to evaluate a patient's capacity to engage in daily activities. It holds great importance in the field of medicine as it aids in the assessment of treatment effectiveness. Nevertheless, the requirement for a therapist's physical presence and the use of specialized materials make the test time-consuming and reliant on clinic availability. In this paper, we propose a computer-vision-based approach to the "Write with a pen" sub-test, originally included in the SHT. Our implementation does not require extra hardware equipment and is able to run on lower-end hardware specifications, using a single RGB camera. We have incorporated all the original test's guidelines and scoring methods into our application, additionally providing an accurate hand spasticity evaluator. After briefly presenting the current research approaches, we analyze and demonstrate our application, as well as discuss some issues and limitations. Lastly, we share some preliminary findings from real-world application usage conducted at the University campus and outline our future plans.