Development of a low-resource wearable continuous gesture-to-speech conversion system.

PURPOSE: Mild to profound hearing impairment places limits on effective communication and day-to-day interaction. Sign language, being the primary mode of communication for people with hearing loss, lacks communicative efficacy. A wearable assistive device that aims to convert sign language into speech is proposed to facilitate communication between the unimpaired population (untrained in sign language) and the hearing impaired population. However, the wide use of geo-centric sign languages in India has resulted in the lack of standardised sign-language datasets. In the proposed work, a compact, low-resource, motion sensor-based, wireless, single and double hand-gesture recognition module is designed to address this issue. MATERIAL AND METHODS: The proposed module is designed to perform a two-step process with a Hidden Markov Model (HMM) based gesture-to-text conversion and a bilingual text-to-speech synthesis. Multi-threading based parallel processing is implemented to enable simultaneous working of the two systems to reduce the delay. In the proposed continuous-gesture recognition system, non-gesture hand motions are modelled using ergodic HMMs that are trained by concatenating all the states of gesture models, allowing equiprobable transitions. The proposed system is modelled and tested for American Sign Language (ASL) and user-defined gestures. RESULTS: The maximum performance of the proposed system in recognising single-handed and double-handed gestures in terms of F1-score is 98.17% and 84.85%, respectively. Further, the proposed system achieves a maximum F1-score of 98% and 83% in recognising isolated and continuous gestures, respectively. CONCLUSION: The gesture-to-speech conversion system is ported on Raspberry Pi making the proposed system wireless, and highly mobile.Implications for rehabilitationThe research work proposes to develop a gesture-to-speech conversion system to enable the deaf-mute population in communication. The major implications of the proposed work are:•A light-weight raspberry pi 3B + module hosts the entire hardware andsoftware, and is sufficient to train and test the gesture-to-speech conversion system, thereby ensuring greater mobility.•The proposed system can be customised to recognise user-defined gestures with just 5 examples of the new gesture.•The proposed system can be expanded to control home appliances (IoT applications) by combining the output of the proposed gesture recognition system with appropriate control interfaces.

Dietary fat intake and its association with risk of selected components of the metabolic syndrome among rural South Indians.

CONTEXT: There is limited literature on the dietary fat intake of rural Indian populations, particularly in relation to the risk of metabolic syndrome (MS). AIM: This study aims to assess the dietary fat intake and analyze its association with the risk of selected components of the MS among rural population in the state of Tamil Nadu. SETTINGS AND DESIGN: Adults (n = 27012) ≥20 years of age were recruited from the rural component of the Chennai Urban Rural Epidemiological Study, a cross-sectional study conducted in 42 villages in Kanchipuram District of Tamil Nadu. SUBJECTS AND METHODS: Using a validated food frequency questionnaire, data were obtained on the fat intake among 6907 adults. Anthropometric and clinical measures were collected using standard methods. The components of the MS assessed were abdominal obesity, hypertension, and impaired fasting glucose. All analyses were performed using SPSS software (version 20). RESULTS: Prevalence of abdominal obesity, hypertension, and impaired fasting glucose were significantly higher in the highest quintile of fat intake (33%, P < 0.001; 39%, P = 0.04, and 23.3%, P = 0.003, respectively). Highest intake of fat was also significantly associated with risk of abdominal obesity (P < 0.001), hypertension (P = 0.04), and impaired fasting glucose (P = 0.01). Sunflower oil as the main cooking oil was significantly associated with a higher risk of these components of the MS (P for trend <0.001) compared to traditional oils and palmolein. CONCLUSIONS: Higher dietary fat was significantly associated with risk of components of the MS and use of sunflower oil as main cooking oil increased metabolic risk in rural South Indians.