Clinical Gait Analysis: Characterizing Normal Gait and Pathological Deviations Due to Neurological Diseases.

This study addresses the characterization of normal gait and pathological deviations induced by neurological diseases, considering knee angular kinematics in the sagittal plane. We propose an unsupervised approach based on Dynamic Time Warping (DTW) to identify different normal gait profiles (NGPs) corresponding to real cycles representing the overall behavior of healthy subjects, instead of considering an average reference, as done in the literature. The obtained NGPs are then used to measure the deviations of pathological gait cycles from normal gait with DTW. Hierarchical Clustering is applied to stratify deviations into clusters. Results show that three NGPs are necessary to finely characterize the heterogeneity of normal gait and accurately quantify pathological deviations. In particular, we automatically identify which lower limb is affected for Hemiplegic patients and characterize the severity of motor impairment for Paraplegic patients. Concerning Tetraplegic patients, different profiles appear in terms of impairment severity. These promising results are obtained by considering the raw description of gait signals. Indeed, we have shown that normalizing signals removes the temporal properties of signals, inducing a loss of dynamic information that is crucial for accurately measuring pathological deviations. Our methodology could be exploited to quantify the impact of therapies on gait rehabilitation.

Treatment Outcome Prediction Using Multi-Task Learning: Application to Botulinum Toxin in Gait Rehabilitation.

We propose a framework for optimizing personalized treatment outcomes for patients with neurological diseases. A typical consequence of such diseases is gait disorders, partially explained by command and muscle tone problems associated with spasticity. Intramuscular injection of botulinum toxin type A is a common treatment for spasticity. According to the patient's profile, offering the optimal treatment combined with the highest possible benefit-risk ratio is important. For the prediction of knee and ankle kinematics after botulinum toxin type A (BTX-A) treatment, we propose: (1) a regression strategy based on a multi-task architecture composed of LSTM models; (2) to introduce medical treatment data (MTD) for context modeling; and (3) a gating mechanism to model treatment interaction more efficiently. The proposed models were compared with and without metadata describing treatments and with serial models. Multi-task learning (MTL) achieved the lowest root-mean-squared error (RMSE) (5.60°) for traumatic brain injury (TBI) patients on knee trajectories and the lowest RMSE (3.77°) for cerebral palsy (CP) patients on ankle trajectories, with only a difference of 5.60° between actual and predicted. Overall, the best RMSE ranged from 5.24° to 6.24° for the MTL models. To the best of our knowledge, this is the first time that MTL has been used for post-treatment gait trajectory prediction. The MTL models outperformed the serial models, particularly when introducing treatment metadata. The gating mechanism is efficient in modeling treatment interaction and improving trajectory prediction.

On Extracting Digitized Spiral Dynamics' Representations: A Study on Transfer Learning for Early Alzheimer's Detection.

This work proposes a decision-aid tool for detecting Alzheimer's disease (AD) at an early stage, based on the Archimedes spiral, executed on a Wacom digitizer. Our work assesses the potential of the task as a dynamic gesture and defines the most pertinent methodology for exploiting transfer learning to compensate for sparse data. We embed directly in spiral trajectory images, kinematic time functions. With transfer learning, we perform automatic feature extraction on such images. Experiments on 30 AD patients and 45 healthy controls (HC) show that the extracted features allow a significant improvement in sensitivity and accuracy, compared to raw images. We study at which level of the deep network features have the highest discriminant capabilities. Results show that intermediate-level features are the best for our specific task. Decision fusion of experts trained on such descriptors outperforms low-level fusion of hybrid images. When fusing decisions of classifiers trained on the best features, from pressure, altitude, and velocity images, we obtain 84% of sensitivity and 81.5% of accuracy, achieving an absolute improvement of 22% in sensitivity and 7% in accuracy. We demonstrate the potential of the spiral task for AD detection and give a complete methodology based on off-the-shelf features.

Enhancing Security on Touch-Screen Sensors with Augmented Handwritten Signatures.

We aim at enhancing personal identity security on mobile touch-screen sensors by augmenting handwritten signatures with specific additional information at the enrollment phase. Our former works on several available and private data sets acquired on different sensors demonstrated that there are different categories of signatures that emerge automatically with clustering techniques, based on an entropy-based data quality measure. The behavior of such categories is totally different when confronted to automatic verification systems in terms of vulnerability to attacks. In this paper, we propose a novel and original strategy to reinforce identity security by enhancing signature resistance to attacks, assessed per signature category, both in terms of data quality and verification performance. This strategy operates upstream from the verification system, at the sensor level, by enriching the information content of signatures with personal handwritten inputs of different types. We study this strategy on different signature types of 74 users, acquired in uncontrolled mobile conditions on a largely deployed mobile touch-screen sensor. Our analysis per writer category revealed that adding alphanumeric (date) and handwriting (place) information to the usual signature is the most powerful augmented signature type in terms of verification performance. The relative improvement for all user categories is of at least 93% compared to the usual signature.

Age-Related Evolution Patterns in Online Handwriting.

Characterizing age from handwriting (HW) has important applications, as it is key to distinguishing normal HW evolution with age from abnormal HW change, potentially triggered by neurodegenerative decline. We propose, in this work, an original approach for online HW style characterization based on a two-level clustering scheme. The first level generates writer-independent word clusters from raw spatial-dynamic HW information. At the second level, each writer's words are converted into a Bag of Prototype Words that is augmented by an interword stability measure. This two-level HW style representation is input to an unsupervised learning technique, aiming at uncovering HW style categories and their correlation with age. To assess the effectiveness of our approach, we propose information theoretic measures to quantify the gain on age information from each clustering layer. We have carried out extensive experiments on a large public online HW database, augmented by HW samples acquired at Broca Hospital in Paris from people mostly between 60 and 85 years old. Unlike previous works claiming that there is only one pattern of HW change with age, our study reveals three major aging HW styles, one specific to aged people and the two others shared by other age groups.

On Hunting Animals of the Biometric Menagerie for Online Signature.

Individuals behave differently regarding to biometric authentication systems. This fact was formalized in the literature by the concept of Biometric Menagerie, defining and labeling user groups with animal names in order to reflect their characteristics with respect to biometric systems. This concept was illustrated for face, fingerprint, iris, and speech modalities. The present study extends the Biometric Menagerie to online signatures, by proposing a novel methodology that ties specific quality measures for signatures to categories of the Biometric Menagerie. Such measures are combined for retrieving automatically writer categories of the extended version of the Biometric Menagerie. Performance analysis with different types of classifiers shows the pertinence of our approach on the well-known MCYT-100 database.

The multiscenario multienvironment BioSecure Multimodal Database (BMDB).

A new multimodal biometric database designed and acquired within the framework of the European BioSecure Network of Excellence is presented. It is comprised of more than 600 individuals acquired simultaneously in three scenarios: 1) over the Internet, 2) in an office environment with desktop PC, and 3) in indoor/outdoor environments with mobile portable hardware. The three scenarios include a common part of audio/video data. Also, signature and fingerprint data have been acquired both with desktop PC and mobile portable hardware. Additionally, hand and iris data were acquired in the second scenario using desktop PC. Acquisition has been conducted by 11 European institutions. Additional features of the BioSecure Multimodal Database (BMDB) are: two acquisition sessions, several sensors in certain modalities, balanced gender and age distributions, multimodal realistic scenarios with simple and quick tasks per modality, cross-European diversity, availability of demographic data, and compatibility with other multimodal databases. The novel acquisition conditions of the BMDB allow us to perform new challenging research and evaluation of either monomodal or multimodal biometric systems, as in the recent BioSecure Multimodal Evaluation campaign. A description of this campaign including baseline results of individual modalities from the new database is also given. The database is expected to be available for research purposes through the BioSecure Association during 2008.

A new phase-correlation-based iris matching for degraded images.

In this paper, we present a new phase-correlation-based iris matching approach in order to deal with degradations in iris images due to unconstrained acquisition procedures. Our matching system is a fusion of global and local Gabor phase-correlation schemes. The main originality of our local approach is that we do not only consider the correlation peak amplitudes but also their locations in different regions of the images. Results on several degraded databases, namely, the CASIA-BIOSECURE and Iris Challenge Evaluation 2005 databases, show the improvement of our method compared to two available reference systems, Masek and Open Source for Iris (OSRIS), in verification mode.

On using the Viterbi path along with HMM likelihood information for online signature verification.

This paper describes a system using two complementary sorts of information issuing from a hidden Markov model (HMM) for online signature verification. At each point of the signature, 25 features are extracted. These features are normalized before training and testing in order to improve the performance of the system. This normalization is writer-dependent; it exploits only five genuine signatures used to train the writer HMM. A claimed identity is confirmed when the arithmetic mean of two similarity scores, obtained on an input signature, is higher than a threshold. The first score is related to the likelihood given by the HMM of the claimed identity; the second score is related to the segmentation given by such an HMM on the input signature. A personalized score normalization is also proposed before fusion. Our approach is evaluated on several online signature databases, such as BIOMET, PHILIPS, MCYT, and SVC2004, which were captured under different acquisition conditions. For the first time in signature verification, we show that the fusion of segmentation-based information generated by the HMM with likelihood-based information considerably improves the quality of the verification system. Finally, owing to our two-stage normalization (at the feature and score levels), we show that our system results in more stable client-score distributions across databases and in a better separation between the distributions of client and impostor scores.