The validity of LENA technology for assessing the linguistic environment and interactions of infants learning Hebrew and Arabic.

The present study assessed LENA's suitability as a tool for monitoring future language interventions by evaluating its reliability, construct validity, and criterion validity in infants learning Hebrew and Arabic, across low and high levels of maternal education. Participants were 32 infants aged 3 to 11 months (16 in each language) and their mothers, whose socioeconomic status (SES) was determined based on their years of education (H-high or L-low ME-maternal education). The results showed (1) good reliability for the LENA's automatic count on adult word count (AWC), conversational turns (CTC), and infant vocalizations (CVC), based on the positive associations and fair to excellent agreement between the manual and automatic counts; (2) good construct validity based on significantly higher counts for HME vs. LME and positive associations between LENA's automatic vocal assessment (AVA) and developmental questionnaire (DA) and age; and (3) good concurrent criterion validity based on the positive associations between the LENA counts for CTC, CVC, AVA, and DA and the scores on the preverbal parent questionnaire (PRISE). The present study supports the use of LENA in early intervention programs for infants whose families speak Hebrew or Arabic. The LENA could be used to monitor the efficacy of these programs as well as to provide feedback to parents on the amount of language experience their infants are getting and their progress in vocal production. The results also indicate a potential utility of LENA in assessing linguistic environments and interactions in Hebrew- and Arabic-speaking infants with developmental disorders, such as hearing impairment and cerebral palsy.

Home language environment in relation to language outcome in Brazilian toddlers who are hard of hearing and controls with typical hearing - a pilot study including reliability analyses of the LENA recording system / Ambiente doméstico de linguagem em relação ao resultado de linguagem em crianças brasileiras com deficiência auditiva e controles com crianças com audição típica - um estudo piloto incluindo análises de confiabilidade do sistema de gravação LENA

ABSTRACT Purpose The purpose of this pilot study was to explore the home language environment and language outcome of Brazilian toddlers who were hard of hearing, (HH) and controls with typical hearing (TH), and investigate the reliability of using the LENA recording system within a Brazilian Portuguese context. Methods Fourteen families participated in the study (seven children who were HH and seven controls with TH. Each family contributed with one all-day recording. A smaller portion of the recordings of the typically hearing toddlers were manually transcribed by two transcribers. An interrater agreement was conducted, and then the human transcript results were compared against the LENA-generated data for three measures: Adult Words (AW), Child Vocalizations (CV) and Conversational Turns (CT). Results Data analyses revealed a moderate to strong interrater agreement for CV and AW. Weak to moderate agreement was found between the LENA estimates and the means of the human counts for CV and AW. Seemingly, LENA overestimated human counts for AW and underestimated numbers of CV. Comparative analysis suggested similarities in the language and listening environment of the two groups (TH vs. HoH). Children's language development was supported by higher numbers of parent-child interactions (CT). Conclusion The findings imply that LENA may contribute as an ecologically valid tool in preventive family-centered intervention programs for Brazilian toddlers who are hard of hearing and their families, although further validation studies are needed.

RESUMO Objetivo O objetivo deste estudo piloto foi explorar o ambiente da língua doméstica e os resultados linguísticos de crianças brasileiras com deficiência auditiva comparando com crianças ouvintes e investigar a confiabilidade do uso do sistema de registro LENA no contexto do português brasileiro. Método Quatorze famílias participaram do estudo (sete com deficiência auditiva e sete controles com audição típica). Cada família contribuiu com uma gravação durante o tempo de vigilia. Uma parte menor das gravações das crianças com audição normal foi transcrita manualmente por dois transcritores. Um acordo entre avaliadores foi realizado e, em seguida, os resultados da transcrição humana foram comparados com os dados gerados pelo LENA para três medidas: Palavras de Adultos (PA), Vocalizações Infantis (VI) e Turnos de Conversação (TC). Resultados As análises de dados revelaram uma concordância entre avaliadores moderada a forte para VI e PA. Foi encontrada concordância de fraca a moderada entre as estimativas de LENA e as médias das contagens humanas para VI e AW. Aparentemente LENA superestimou contagens humanas para PA e subestimou números de VI. A análise comparativa sugeriu semelhanças na linguagem e no ambiente auditivo dos dois grupos. O desenvolvimento da linguagem das crianças foi apoiado por um maior número de interações pais-filhos (TC). Conclusão Os achados sugerem que o LENA pode contribuir como uma ferramenta ecologicamente válida em programas de intervenção preventiva centrada na família para crianças brasileiras com deficiência auditiva e suas famílias, embora mais estudos de validação sejam necessários.

Look who's talking: A comparison of automated and human-generated speaker tags in naturalistic day-long recordings.

The LENA system has revolutionized research on language acquisition, providing both a wearable device to collect day-long recordings of children's environments, and a set of automated outputs that process, identify, and classify speech using proprietary algorithms. This output includes information about input sources (e.g., adult male, electronics). While this system has been tested across a variety of settings, here we delve deeper into validating the accuracy and reliability of LENA's automated diarization, i.e., tags of who is talking. Specifically, we compare LENA's output with a gold standard set of manually generated talker tags from a dataset of 88 day-long recordings, taken from 44 infants at 6 and 7 months, which includes 57,983 utterances. We compare accuracy across a range of classifications from the original Lena Technical Report, alongside a set of analyses examining classification accuracy by utterance type (e.g., declarative, singing). Consistent with previous validations, we find overall high agreement between the human and LENA-generated speaker tags for adult speech in particular, with poorer performance identifying child, overlap, noise, and electronic speech (accuracy range across all measures: 0-92%). We discuss several clear benefits of using this automated system alongside potential caveats based on the error patterns we observe, concluding with implications for research using LENA-generated speaker tags.

Language ENvironment analysis (LENA) system investigation of day long recordings in children: A literature review.

The Language ENvironment Analysis (LENA) System is a relatively new recording technology that can be used to investigate typical child language acquisition and populations with language disorders. The purpose of this paper is to familiarize language acquisition researchers and speech-language pathologists with how the LENA System is currently being used in research. The authors outline issues in peer-reviewed research based on the device. Considerations when using the LENA System are discussed.

Using the Language Environment Analysis (LENA) system in preschool classrooms with children with autism spectrum disorders.

This study describes the language environment of preschool programs serving children with autism spectrum disorders (ASDs) and examines relationships between child characteristics and an automated measure of adult and child language in the classroom. The Language Environment Analysis (LENA) system was used with 40 children with ASD to collect data on adult and child language. Standardized assessments were administered to obtain language, cognitive, and autism severity scores for participants. With a mean of over 5 hours of recording across two days several months apart, there was a mean of 3.6 child vocalizations per minute, 1.0 conversational turns (in which either the adult or child respond to the other within 5 seconds) per minute, and 29.2 adult words per minute. Two of the three LENA variables were significantly correlated with language age-equivalents. Cognitive age-equivalents were also significantly correlated with two LENA variables. Autism Diagnostic Observation Schedule severity scores and LENA variables were not significantly correlated. Implications for using the LENA system with children with ASD in the school environment are discussed.