Clinical Assessment of Communication-Related Speech Parameters in Dysarthria: The Impact of Perceptual Adaptation.

PURPOSE: In current clinical practice, intelligibility of dysarthric speech is commonly assessed by speech-language therapists (SLTs), in most cases by the therapist caring for the patient being diagnosed. Since SLTs are familiar with dysarthria in general and with the speech of the individual patient to be assessed in particular, they have an adaptation advantage in understanding the patient's utterances. We examined whether and how listeners' assessments of communication-related speech parameters vary as a function of their familiarity with dysarthria in general and with the diagnosed patients in particular. METHOD: Intelligibility, speech naturalness, and perceived listener effort were assessed in 20 persons with dysarthria (PWD). Patients' speech samples were judged by the individual treating therapists, five dysarthria experts who were unfamiliar with the patients, and crowdsourced naïve listeners. Adaptation effects were analyzed using (a) linear mixed models of overall scoring levels, (b) regression models of severity dependence, (c) network analyses of between-listener and between-parameter relationships, and (d) measures of intra- and interobserver consistency. RESULTS: Significant advantages of dysarthria experts over laypeople were found in all parameters. An overall advantage of the treating therapists over nonfamiliar experts was only seen in listening effort. Severity-dependent adaptation effects occurred in all parameters. The therapists' responses were heterogeneous and inconsistent with those of the unfamiliar experts and the naïve listeners. CONCLUSIONS: The way SLTs evaluate communication-relevant speech parameters of the PWD whom they care for is influenced not only by adaptation benefits but also by therapeutic biases. This finding weakens the validity of assessments of communication-relevant speech parameters by the treating therapists themselves and encourages the development and use of alternative methods.

Web-based assessment of communication-related parameters in dysarthria: development and implementation of the KommPaS web app.

This article describes the design of KommPaS, a web-based tool for the clinical assessment of communication impairment in persons with dysarthria. KommPaS (the German acronym for Communication-related Parameters in Speech Disorders) allows clinicians to recruit laypersons via crowdsourcing for the evaluation of samples of dysarthric speech with regard to communication relevant parameters, that is, intelligibility, naturalness, perceived listener effort, and efficiency (intelligible speech units per unit time). Moreover, a communication total score describing the KommPaS profile elevation, i.e., the arithmetic mean of the normalized KommPaS scores, is provided. Based on considerations regarding the theoretical underpinnings and methodological constraints of a clinical tool for the assessment of these parameters, the article describes how each theoretically and methodologically motivated feature is translated into design principles and how these principles are implemented in a web application. The paper reports efficiency data and details the data privacy and data security provisions that are essential in such an approach.

Clinical measures of communication limitations in dysarthria assessed through crowdsourcing: specificity, sensitivity, and retest-reliability.

Assessing the impact of dysarthria on a patient's ability to communicate should be an integral part of patient management. However, due to the high demands on reliable quantification of communication limitations, hardly any formal clinical tests with approved psychometric properties have been developed so far. This study investigates a web-based assessment of communication impairment in dysarthria, named KommPaS. The test comprises measures of intelligibility, naturalness, perceived listener effort and communication efficiency, as well as a total score that integrates these parameters. The approach is characterized by a quasi-random access to a large inventory of test materials and to a large group of naïve listeners, recruited via crowdsourcing. As part of a larger research program to establish the clinical applicability of this new approach, the present paper focuses on two psychometric issues, namely specificity and sensitivity (study 1) and retest-reliability (study 2). Study 1: KommPaS was administered to 54 healthy adults and 100 adult persons with dysarthria (PWD). Non-parametric criterion-based norms (specificity: 0.95) were used to derive a standard metric for each of the four component variables, and corresponding sensitivity values for the presence of dysarthria were identified. Overall classification accuracy of the total score was determined using a ROC analysis. The resulting cutscores showed a high accuracy in the separation of PWD from healthy speakers for the naturalness and the total score. Study 2: A sub-group of 20 PWD enrolled in study 1 were administered a second KommPaS examination. ICC analyses revealed good to excellent retest reliabilities for all parameters.

Indicators of Communication Limitation in Dysarthria and Their Relation to Auditory-Perceptual Speech Symptoms: Construct Validity of the KommPaS Web App.

PURPOSE: Despite extensive research into communication-related parameters in dysarthria, such as intelligibility, naturalness, and perceived listener effort, the existing evidence has not been translated into a clinically applicable, comprehensive, and valid diagnostic tool so far. This study addresses Communication-Related Parameters in Speech Disorders (KommPaS), a new web-based diagnostic instrument for measuring indices of communication limitation in individuals with dysarthria through online crowdsourcing. More specifically, it answers questions about the construct validity of KommPaS. In the first part, the interrelationship of the KommPaS variables intelligibility, naturalness, perceived listener effort, and speech rate were explored in order to draw a comprehensive picture of a patient's limitations and avoid the collection of redundant information. Second, the influences of motor speech symptoms on the KommPaS variables were studied in order to delineate the structural relationships between two complementary diagnostic perspectives. METHOD: One hundred persons with dysarthria of different etiologies and varying degrees of severity were examined with KommPaS to obtain layperson-based data on communication-level parameters, and with the Bogenhausen Dysarthria Scale (BoDyS) to obtain expert-based, function-level data on dysarthria symptoms. The internal structure of the KommPaS variables and their dependence on the BoDyS variables were analyzed using structural equation modeling. RESULTS: Despite a high multicollinearity, all KommPaS variables were shown to provide complementary diagnostic information and their mutual interconnections were delineated in a path graph model. Regarding the influence of the BoDyS scales on the KommPaS variables, separate linear regression models revealed plausible predictor sets. A complete path model of KommPaS and BoDyS variables was developed to map the complex interplay between variables at the functional and the communication levels of dysarthria assessment. CONCLUSION: In validating a new clinical tool for the diagnostics of communication limitations in dysarthria, this study is the first to draw a comprehensive picture of how auditory-perceptual characteristics of dysarthria interact at the levels of expert-based functional and layperson-based communicative assessments.

In Time with the Beat: Entrainment in Patients with Phonological Impairment, Apraxia of Speech, and Parkinson's Disease.

In the present study, we investigated if individuals with neurogenic speech sound impairments of three types, Parkinson's dysarthria, apraxia of speech, and aphasic phonological impairment, accommodate their speech to the natural speech rhythm of an auditory model, and if so, whether the effect is more significant after hearing metrically regular sentences as compared to those with an irregular pattern. This question builds on theories of rhythmic entrainment, assuming that sensorimotor predictions of upcoming events allow humans to synchronize their actions with an external rhythm. To investigate entrainment effects, we conducted a sentence completion task relating participants' response latencies to the spoken rhythm of the prime heard immediately before. A further research question was if the perceived rhythm interacts with the rhythm of the participants' own productions, i.e., the trochaic or iambic stress pattern of disyllabic target words. For a control group of healthy speakers, our study revealed evidence for entrainment when trochaic target words were preceded by regularly stressed prime sentences. Persons with Parkinson's dysarthria showed a pattern similar to that of the healthy individuals. For the patient groups with apraxia of speech and with phonological impairment, considerably longer response latencies with differing patterns were observed. Trochaic target words were initiated with significantly shorter latencies, whereas the metrical regularity of prime sentences had no consistent impact on response latencies and did not interact with the stress pattern of the target words to be produced. The absence of an entrainment in these patients may be explained by the more severe difficulties in initiating speech at all. We discuss the results in terms of clinical implications for diagnostics and therapy in neurogenic speech disorders.

Crowdsourcing as a tool in the clinical assessment of intelligibility in dysarthria: How to deal with excessive variation.

PURPOSE: Independent laypersons are essential in the assessment of intelligibility in persons with dysarthria (PWD), as they reflect intelligibility limitations in the most ecologically valid way, without being influenced by familiarity with the speaker. The present work investigated online crowdsourcing as a convenient method to involve lay people as listeners, with the objective of exploring how to constrain the expected variability of crowd-based judgements to make them applicable in clinical diagnostics. METHOD: Intelligibility was assessed using a word transcription task administered via crowdsourcing. In study 1, speech samples of 23 PWD were transcribed by 18 crowdworkers each. Four methods of aggregating the intelligibility scores of randomly sampled panels of 4 to 14 listeners were compared for accuracy, i.e. the stability of the resulting intelligibility estimates across different panels, and their validity, i.e. the degree to which they matched data obtained under controlled laboratory conditions ("gold standard"). In addition, we determined an economically acceptable number of crowdworkers per speaker which is needed to obtain accurate and valid intelligibility estimates. Study 2 examined the robustness of the chosen aggregation method against downward outliers due to spamming in a larger sample of 100 PWD. RESULTS: In study 1, an interworker aggregation method based on negative exponential weightings of the scores as a function of their distance from the "best" listener's score (exponentially weighted mean) outperformed three other methods (median value, arithmetic mean, maximum). Under cost-benefit considerations, an optimum panel size of 9 crowd listeners per examination was determined. Study 2 demonstrated the robustness of this aggregation method against spamming crowd listeners. CONCLUSION: Though intelligibility data collected through online crowdsourcing are noisy, accurate and valid intelligibility estimates can be obtained by appropriate aggregation of the raw data. This makes crowdsourcing a suitable method for incorporating real-world perspectives into clinical dysarthria assessment.

The Impact of Lexical and Articulatory Factors in the Automatic Selection of Test Materials for a Web-Based Assessment of Intelligibility in Dysarthria.

Purpose The clinical assessment of intelligibility must be based on a large repository and extensive variation of test materials, to render test stimuli unpredictable and thereby avoid expectancies and familiarity effects in the listeners. At the same time, it is essential that test materials are systematically controlled for factors influencing intelligibility. This study investigated the impact of lexical and articulatory characteristics of quasirandomly selected target words on intelligibility in a large sample of dysarthric speakers under clinical examination conditions. Method Using the clinical assessment tool KommPaS, a total of 2,700 sentence-embedded target words, quasirandomly drawn from a large corpus, were spoken by a group of 100 dysarthric patients and later transcribed by listeners recruited via online crowdsourcing. Transcription accuracy was analyzed for influences of lexical frequency, phonological neighborhood structure, articulatory complexity, lexical familiarity, word class, stimulus length, and embedding position. Classification and regression analyses were performed using random forests and generalized linear mixed models. Results Across all degrees of severity, target words with higher frequency, fewer and less frequent phonological neighbors, higher articulatory complexity, and higher lexical familiarity received significantly higher intelligibility scores. In addition, target words were more challenging sentence-initially than in medial or final position. Stimulus length had mixed effects; word length and word class had no effect. Conclusions In a large-scale clinical examination of intelligibility in speakers with dysarthria, several well-established influences of lexical and articulatory parameters could be replicated, and the roles of new factors were discussed. This study provides clues about how experimental rigor can be combined with clinical requirements in the diagnostics of communication impairment in patients with dysarthria.

Follow-Up in Aphasia Caused by Acute Stroke in a Prospective, Randomized, Clinical, and Experimental Controlled Noninvasive Study With an iPad-Based App (Neolexon®): Study Protocol of the Lexi Study.

Rationale: Treatment of aphasia is still challenging for clinicians and patients. So far, there is proven evidence for "face-to-face" speech therapy. However, the digital age potentially offers new and complementary strategies that may add to treatment outcome in a cost-effective way. Neolexon® is a commercial tablet-based software for treatment of aphasia, which can be applied with the help of a therapist or as self-training by the patient. Aims and hypothesis: In the Lexi study, we aim to determine whether treatment with Neolexon® is superior to standard therapy in acute post-stroke aphasia. Sample size estimates: A sample size of 180 patients, 90 for each group, will be included with an assumed dropout rate of ~20%. Methods and design: Prospective, randomized, parallel group, open-label, blinded-endpoint clinical, and experimental controlled non-invasive trial (PROBE). Adult German native speakers with acute aphasia after stroke are included. Computer-generated, blocked, and stratified randomization by aphasia severity will assign patients to one of two groups: 4 weeks of either standard logopedic speech therapy or logopedic speech therapy with the app version of Neolexon®. Both groups will be instructed in self-training: the frequency and duration of self-training will be documented. Screening for aphasia will be performed using the Language Screening Test (LAST). The severity of aphasia in general and in subitems will be assessed using the Bielefelder Aphasie Screening (BIAS) and the Aphasia Check List (ACL). Follow-up will be assessed after 3 months. Study outcomes: Based on the consensus in our study team, we considered a 10% mean difference in the change of percentile rank (PR) of BIAS to be a minimal and clinically important difference. The primary endpoint is defined as a significant difference in BIAS comparing the two groups. Differences in quality of life, Beck Depression Inventory (BDI), and modified Ranking Scale (mRS) will be evaluated as secondary outcome parameters. Discussion: This trial will determine whether speech therapy with the use of Neolexon® is superior to standard logopedic therapy. Subgroups with the greatest response to Neolexon® will be described. The trial was prospectively registered on the "EU Clinical Trials Register" (NCT04080817).

Do Patients With Neurogenic Speech Sound Impairments Benefit From Auditory Priming With a Regular Metrical Pattern?

Purpose Earlier investigations based on word and sentence repetition tasks had revealed that the most prevalent metrical pattern in German (the trochee)-unlike the iambic pattern-facilitates articulation in patients with apraxia of speech (AOS; e.g., Aichert, Späth, & Ziegler, 2016), confirming that segmental and prosodic aspects of speech production interact. In this study, we investigated if articulation in apraxic speakers also benefits from auditory priming by speech with a regular rhythm. Furthermore, we asked if the advantage of regular speech rhythm, if present, is confined to impairments at the motor planning stage of speech production (i.e., AOS) or if it also applies to phonological encoding impairments. Method Twelve patients with AOS, 12 aphasic patients with postlexical phonological impairment (PI), and 36 neurologically healthy speakers were examined. A sequential synchronization paradigm based on a sentence completion task was conducted in conditions where we independently varied the metrical regularity of the prime sentence (regular vs. irregular prime sentence) and the metrical regularity of the target word (trochaic vs. iambic). Results Our data confirmed the facilitating effect of regular (trochaic) word stress on speech accuracy in patients with AOS (target effect). This effect could, for the first time, also be demonstrated in individuals with PI. Moreover, the study also revealed an influence of the metrical regularity of speech input in both patient groups (prime effect). Conclusions Patients with AOS and patients with PI exploited rhythmic cues in the speech of a model speaker for the initiation and the segmental realization of words. There seems to be a robust metrical influence on speech at both the phonological and the phonetic planning stages of speech production.