How to Use the Index of Productive Syntax to Select Goals and Monitor Progress in Preschool Children.

PURPOSE: Syntax assessment and treatment is a major focus of speech-language pathologists who work with young children with language needs. The Index of Productive Syntax (IPSyn) provides an efficient method for the assessment of syntax of preschool-age children. The purpose of this tutorial is to illustrate how to hand-score an IPSyn from language sample transcripts and use this information to formulate appropriate syntactic goals. METHOD: We describe general methods and tips for facilitating hand-scoring. Two case study transcripts of a late talker at 36 and 48 months are provided. One case study transcript is fully scored in IPSyn with detailed explanations; the second case study is provided as a practice example with an IPSyn answer key. Relevant sample probes are provided to assist in the goal of obtaining a representative set of language structures. RESULTS: We show how the IPSyn can be scored, subscale by subscale, and can highlight developmental stages of syntax following Brown's stages of grammatical development. We illustrate how the visual snapshot developmental nature of the instrument makes it ideal for deriving goals. CONCLUSION: The IPSyn is a practical and valuable tool for the assessment of syntax of preschool-age children.

Reliability of judgments of stuttering-related variables: The effect of language familiarity.

Previous studies demonstrate mixed results and some methodological limitations regarding judges' ability to reliably assess stuttering-related variables in an unfamiliar language. The present study examined intra- and inter-rater reliability for percent syllables stuttered (%SS), stuttering severity (SEV), syllables per minute (SPM), and speech naturalness (NAT) when English-speaking judges viewed speech samples in English and in a language with which they had no or minimal familiarity (Spanish). Over two time periods, 21 judges viewed eight videos of four bilingual persons who stutter. Data were analyzed for relative and absolute intra- and inter-rater reliability as well as for an effect of language on time period differences. Intra- and inter-rater relative reliability were good or excellent for all measures in both languages, with the exception of inter-rater relative reliability for NAT in both languages and %SS in Spanish. Intra-rater absolute reliability was acceptable in both languages for NAT and SEV and unacceptable in both for SPM and %SS. Inter-rater absolute reliability in both languages was unacceptable for all measures, even with judges with the same training. There was a clinically significant effect of language on %SS scores, but, despite a statistically significant effect of language for SPM and SEV, the differences were not clinically significant. Results indicate that reliability across and within languages varies by measure and is impacted by intra- vs. inter-rater reliability, relative vs. absolute reliability, and language familiarity. Modifications in training may be able to address some of the limitations found, particularly with regard to SPM and NAT.

Improving Automatic IPSyn Coding.

Purpose The Computerized Language ANalysis-Index of Productive Syntax (CLAN-IPSyn) system is designed to facilitate automatic computation of the IPSyn measure of productive child syntax. Roberts et al. (2020) conducted a thorough comparison of hand-generated and automatic scores on the Index of Productive Syntax (IPSyn) measure (Scarborough, 1990) and found a high level of error for CLAN-IPSyn. We report on the use of the Roberts et al. analysis to reduce and eliminate errors in CLAN-IPSyn, to improve its accuracy. Method Scores provided by manual and machine scoring of the 20 transcripts used in Roberts et al. (2020) were compared. Divergences in point assignment were examined and significant modifications made to the CLAN-IPSyn program to increase its accuracy. Conclusion The currently available, free version of CLAN at https://talkbank.org is now significantly more correct in terms of exemplars produced, and should assist clinicians and researchers in using the revised IPSyn (Altenberg et al. 2018).

Machine-Scored Syntax: Comparison of the CLAN Automatic Scoring Program to Manual Scoring.

Purpose The results of automatic machine scoring of the Index of Productive Syntax from the Computerized Language ANalysis (CLAN) tools of the Child Language Data Exchange System of TalkBank (MacWhinney, 2000) were compared to manual scoring to determine the accuracy of the machine-scored method. Method Twenty transcripts of 10 children from archival data of the Weismer Corpus from the Child Language Data Exchange System at 30 and 42 months were examined. Measures of absolute point difference and point-to-point accuracy were compared, as well as points erroneously given and missed. Two new measures for evaluating automatic scoring of the Index of Productive Syntax were introduced: Machine Item Accuracy (MIA) and Cascade Failure Rate- these measures further analyze points erroneously given and missed. Differences in total scores, subscale scores, and individual structures were also reported. Results Mean absolute point difference between machine and hand scoring was 3.65, point-to-point agreement was 72.6%, and MIA was 74.9%. There were large differences in subscales, with Noun Phrase and Verb Phrase subscales generally providing greater accuracy and agreement than Question/Negation and Sentence Structures subscales. There were significantly more erroneous than missed items in machine scoring, attributed to problems of mistagging of elements, imprecise search patterns, and other errors. Cascade failure resulted in an average of 4.65 points lost per transcript. Conclusions The CLAN program showed relatively inaccurate outcomes in comparison to manual scoring on both traditional and new measures of accuracy. Recommendations for improvement of the program include accounting for second exemplar violations and applying cascaded credit, among other suggestions. It was proposed that research on machine-scored syntax routinely report accuracy measures detailing erroneous and missed scores, including MIA, so that researchers and clinicians are aware of the limitations of a machine-scoring program. Supplemental Material https://doi.org/10.23641/asha.11984364.

Young Children's Structure Production: A Revision of the Index of Productive Syntax.

Purpose: The Index of Productive Syntax (IPSyn; Scarborough, 1990) is widely used to measure syntax production in young children. The goal of this article is to promote greater clarity and consistency in machine and hand scoring by presenting a revised version of the IPSyn (IPSyn-R) and comparing it with the original IPSyn (IPSyn-O). Method: Longitudinal syntax production in 10 30- and 42-month-old typically developing children drawn from the Child Language Data Exchange System (MacWhinney, 2000) Weismer corpus was examined, using both the IPSyn-O and the IPSyn-R. Results: The IPSyn-R provided nearly identical scores to the IPSyn-O with the exception of scores affected primarily by 1 modified noun phrase structure. Structures ranked as more advanced were produced less frequently. The results also reveal which of the IPSyn-R's 59 structures were most and least likely to be produced by this sample at these ages. Conclusions: The qualitative and quantitative differences between the IPSyn-O and the IPSyn-R are relatively minor. The IPSyn-R can make it easier to score the IPSyn, both by clinicians and researchers, and facilitate the IPSyn's move to machine scoring of language samples.

Promises and pitfalls of machine scoring of the Index of Productive Syntax.

The AC-IPSyn computerised system for scoring the Index of Productive Syntax (IPSyn) was evaluated. Twenty language samples, ten taken at 30 months and ten of the same children at 42 months, were each scored for the IPSyn by hand and by AC-IPSyn. Point differences and point-to-point reliability were examined at the levels of the total, subscale, and individual structure scores. Points missed and erroneously given at each level were also analysed. The difference in total scores between manual and AC-IPSyn scoring was relatively small; point-to-point agreement was lower than reported elsewhere. Age differences were also found. AC-IPSyn accuracy varied by subscale and structure, with results suggesting that AC-IPSyn be used at this point in conjunction with hand scoring of more error-prone and low frequency structures. The relatively small total point difference masked the lower reliability revealed by other measures, demonstrating the importance of detailed comparisons of manual and machine scoring.

Perception of individuals with voice disorders by monolingual English, bilingual Cantonese-English, and bilingual Russian-English women.

PURPOSE: The purpose of this study was to examine the attitudes of monolingual English, bilingual Cantonese-English, and bilingual Russian-English speakers toward individuals with voice disorders. METHOD: In a mixed experimental design, a total of 30 older and 29 younger female listeners from the 3 language groups rated the voices of 10 females, each with a mild, moderate, or severe voice disorder or with no voice disorder. A semantic differential scale was used to rate the speakers on 21 attributes. RESULTS: Results indicate that the perception of individuals became increasingly negative as the severity of the disorder increased. Results also indicate that Cantonese-English bilinguals rated the individuals with severe voice disorders more negatively than did English monolinguals and that the language groups differed in their ratings for the attributes of beautiful, lovable, clean, and young. There was no overall effect of age of listener. CONCLUSION: The study demonstrates that although the language groups were uniform in ascribing more negative attributes to individuals as severity of the disorder increased, there were also significant differences between the groups. Exploration of these issues provides information useful to clinicians in setting priorities for intervention that take into account individuals' backgrounds as well as clinical factors.

Fundamental frequency in monolingual English, bilingual English/Russian, and bilingual English/Cantonese young adult women.

Mean F0 of nine young adult English/Russian female bilinguals and nine young adult English/Cantonese female bilinguals were examined from samples of connected speech in each language. Mean F0 were compared in each language and in English with those of a monolingual English control group of ten young adult female speakers. Acoustic measurements were analyzed with the Kay Elemetrics Multispeech program (Kay Elemetrics, Lincoln Park, NJ). The results indicate that the English/Russian bilinguals consistently had a higher mean F0 in Russian than in English. Mean F0 did not change with language switch for the English/Cantonese speakers. There were no significant differences between the groups in their English production. Clinical implications regarding norms for both monolingual and bilingual persons, as well as implications for understanding the nature of bilingualism, in particular code-switching, are discussed.