Predicting recovery following stroke: Deep learning, multimodal data and feature selection using explainable AI.

Machine learning offers great potential for automated prediction of post-stroke symptoms and their response to rehabilitation. Major challenges for this endeavour include the very high dimensionality of neuroimaging data, the relatively small size of the datasets available for learning and interpreting the predictive features, as well as, how to effectively combine neuroimaging and tabular data (e.g. demographic information and clinical characteristics). This paper evaluates several solutions based on two strategies. The first is to use 2D images that summarise MRI scans. The second is to select key features that improve classification accuracy. Additionally, we introduce the novel approach of training a convolutional neural network (CNN) on images that combine regions-of-interests (ROIs) extracted from MRIs, with symbolic representations of tabular data. We evaluate a series of CNN architectures (both 2D and a 3D) that are trained on different representations of MRI and tabular data, to predict whether a composite measure of post-stroke spoken picture description ability is in the aphasic or non-aphasic range. MRI and tabular data were acquired from 758 English speaking stroke survivors who participated in the PLORAS study. Each participant was assigned to one of five different groups that were matched for initial severity of symptoms, recovery time, left lesion size and the months or years post-stroke that spoken description scores were collected. Training and validation were carried out on the first four groups. The fifth (lock-box/test set) group was used to test how well model accuracy generalises to new (unseen) data. The classification accuracy for a baseline logistic regression was 0.678 based on lesion size alone, rising to 0.757 and 0.813 when initial symptom severity and recovery time were successively added. The highest classification accuracy (0.854), area under the curve (0.899) and F1 score (0.901) were observed when 8 regions of interest were extracted from each MRI scan and combined with lesion size, initial severity and recovery time in a 2D Residual Neural Network (ResNet). This was also the best model when data were limited to the 286 participants with moderate or severe initial aphasia (with area under curve = 0.865), a group that would be considered more difficult to classify. Our findings demonstrate how imaging and tabular data can be combined to achieve high post-stroke classification accuracy, even when the dataset is small in machine learning terms. We conclude by proposing how the current models could be improved to achieve even higher levels of accuracy using images from hospital scanners.

Predicting Online Behavioural Responses to Transcranial Direct Current Stimulation in Stroke Patients with Anomia.

Anomia, or difficulty naming common objects, is the most common, acquired impairment of language. Effective therapeutic interventions for anomia typically involve massed practice at high doses. This requires significant investment from patients and therapists. Aphasia researchers have increasingly looked to neurostimulation to accelerate these treatment effects, but the evidence behind this intervention is sparse and inconsistent. Here, we hypothesised that group-level neurostimulation effects might belie a more systematic structure at the individual level. We sought to test the hypothesis by attempting to predict the immediate (online), individual-level behavioural effects of anodal and sham neurostimulation in 36 chronic patients with anomia, performing naming and size judgement tasks. Using clinical, (pre-stimulation) behavioural and MRI data, as well as Partial Least Squares regression, we attempted to predict neurostimulation effects on accuracies and reaction times of both tasks. Model performance was assessed via cross-validation. Predictive performances were compared to that of a null model, which predicted the mean neurostimulation effects for all patients. Models derived from pre-stimulation data consistently outperformed the null model when predicting neurostimulation effects on both tasks' performance. Notably, we could predict behavioural declines just as well as improvements. In conclusion, inter-patient variation in online responses to neurostimulation is, to some extent, systematic and predictable. Since declines in performance were just as predictable as improvements, the behavioural effects of neurostimulation in patients with anomia are unlikely to be driven by placebo effects. However, the online effect of the intervention appears to be as likely to interfere with task performance as to improve it.

Degeneracy in the neurological model of auditory speech repetition.

Both classic and contemporary models of auditory word repetition involve at least four left hemisphere regions: primary auditory cortex for processing sounds; pSTS (within Wernicke's area) for processing auditory images of speech; pOp (within Broca's area) for processing motor images of speech; and primary motor cortex for overt speech articulation. Previous functional-MRI (fMRI) studies confirm that auditory repetition activates these regions, in addition to many others. Crucially, however, contemporary models do not specify how regions interact and drive each other during auditory repetition. Here, we used dynamic causal modelling, to test the functional interplay among the four core brain regions during single auditory word and pseudoword repetition. Our analysis is grounded in the principle of degeneracy-i.e., many-to-one structure-function relationships-where multiple neural pathways can execute the same function. Contrary to expectation, we found that, for both word and pseudoword repetition, (i) the effective connectivity between pSTS and pOp was predominantly bidirectional and inhibitory; (ii) activity in the motor cortex could be driven by either pSTS or pOp; and (iii) the latter varied both within and between individuals. These results suggest that different neural pathways can support auditory speech repetition. This degeneracy may explain resilience to functional loss after brain damage.

Mapping spoken language and cognitive deficits in post-stroke aphasia.

Aphasia is an acquired disorder caused by damage, most commonly due to stroke, to brain regions involved in speech and language. While language impairment is the defining symptom of aphasia, the co-occurrence of non-language cognitive deficits and their importance in predicting rehabilitation and recovery outcomes is well documented. However, people with aphasia (PWA) are rarely tested on higher-order cognitive functions, making it difficult for studies to associate these functions with a consistent lesion correlate. Broca's area is a particular brain region of interest that has long been implicated in speech and language production. Contrary to classic models of speech and language, cumulative evidence shows that Broca's area and surrounding regions in the left inferior frontal cortex (LIFC) are involved in, but not specific to, speech production. In this study we aimed to explore the brain-behaviour relationships between tests of cognitive skill and language abilities in thirty-six adults with long-term speech production deficits caused by post-stroke aphasia. Our findings suggest that non-linguistic cognitive functions, namely executive functions and verbal working memory, explain more of the behavioural variance in PWA than classical language models imply. Additionally, lesions to the LIFC, including Broca's area, were associated with non-linguistic executive (dys)function, suggesting that lesions to this area are associated with non-language-specific higher-order cognitive deficits in aphasia. Whether executive (dys)function - and its neural correlate in Broca's area - contributes directly to PWA's language production deficits or simply co-occurs with it, adding to communication difficulties, remains unclear. These findings support contemporary models of speech production that place language processing within the context of domain-general perception, action and conceptual knowledge. An understanding of the covariance between language and non-language deficits and their underlying neural correlates will inform better targeted aphasia treatment and outcomes.

Enhanced left superior parietal activation during successful speech production in patients with left dorsal striatal damage and error-prone neurotypical participants.

Functional imaging studies of neurotypical adults report activation in the left putamen during speech production. The current study asked how stroke survivors with left putamen damage are able to produce correct spoken responses during a range of speech production tasks. Using functional magnetic resonance imaging, activation during correct speech production responses was assessed in 5 stroke patients with circumscribed left dorsal striatal lesions, 66 stroke patient controls who did not have focal left dorsal striatal lesions, and 54 neurotypical adults. As a group, patients with left dorsal striatal damage (our patients of interest) showed higher activation than neurotypical controls in the left superior parietal cortex during successful speech production. This effect was not specific to patients with left dorsal striatal lesions as we observed enhanced activation in the same region in some patient controls and also in more error-prone neurotypical participants. Our results strongly suggest that enhanced left superior parietal activation supports speech production in diverse challenging circumstances, including those caused by stroke damage. They add to a growing body of literature indicating how upregulation within undamaged parts of the neural systems already recruited by neurotypical adults contributes to recovery after stroke.

The Effect of Right Temporal Lobe Gliomas on Left and Right Hemisphere Neural Processing During Speech Perception and Production Tasks.

Using fMRI, we investigated how right temporal lobe gliomas affecting the posterior superior temporal sulcus alter neural processing observed during speech perception and production tasks. Behavioural language testing showed that three pre-operative neurosurgical patients with grade 2, grade 3 or grade 4 tumours had the same pattern of mild language impairment in the domains of object naming and written word comprehension. When matching heard words for semantic relatedness (a speech perception task), these patients showed under-activation in the tumour infiltrated right superior temporal lobe compared to 61 neurotypical participants and 16 patients with tumours that preserved the right postero-superior temporal lobe, with enhanced activation within the (tumour-free) contralateral left superior temporal lobe. In contrast, when correctly naming objects (a speech production task), the patients with right postero-superior temporal lobe tumours showed higher activation than both control groups in the same right postero-superior temporal lobe region that was under-activated during auditory semantic matching. The task dependent pattern of under-activation during the auditory speech task and over-activation during object naming was also observed in eight stroke patients with right hemisphere infarcts that affected the right postero-superior temporal lobe compared to eight stroke patients with right hemisphere infarcts that spared it. These task-specific and site-specific cross-pathology effects highlight the importance of the right temporal lobe for language processing and motivate further study of how right temporal lobe tumours affect language performance and neural reorganisation. These findings may have important implications for surgical management of these patients, as knowledge of the regions showing functional reorganisation may help to avoid their inadvertent damage during neurosurgery.

Better long-term speech outcomes in stroke survivors who received early clinical speech and language therapy: What's driving recovery?

Establishing whether speech and language therapy after stroke has beneficial effects on speaking ability is challenging because of the need to control for multiple non-therapy factors known to influence recovery. We investigated how speaking ability at three time points post-stroke differed in patients who received varying amounts of clinical therapy in the first month post-stroke. In contrast to prior studies, we factored out variance from: initial severity of speaking impairment, amount of later therapy, and left and right hemisphere lesion size and site. We found that speaking ability at one month post-stroke was significantly better in patients who received early therapy (n = 79), versus those who did not (n = 64), and the number of hours of early therapy was positively related to recovery at one year post-stroke. We offer two non-mutually exclusive interpretations of these data: (1) patients may benefit from the early provision of self-management strategies; (2) therapy is more likely to be provided to patients who have a better chance of recovery (e.g., poor physical and/or mental health may impact suitability for therapy and chance of recovery). Both interpretations have implications for future studies aiming to predict individual patients' speech outcomes after stroke, and their response to therapy.

Dissociating the functions of three left posterior superior temporal regions that contribute to speech perception and production.

Prior studies have shown that the left posterior superior temporal sulcus (pSTS) and left temporo-parietal junction (TPJ) both contribute to phonological short-term memory, speech perception and speech production. Here, by conducting a within-subjects multi-factorial fMRI study, we dissociate the response profiles of these regions and a third region - the anterior ascending terminal branch of the left superior temporal sulcus (atSTS), which lies dorsal to pSTS and ventral to TPJ. First, we show that each region was more activated by (i) 1-back matching on visually presented verbal stimuli (words or pseudowords) compared to 1-back matching on visually presented non-verbal stimuli (pictures of objects or non-objects), and (ii) overt speech production than 1-back matching, across 8 types of stimuli (visually presented words, pseudowords, objects and non-objects and aurally presented words, pseudowords, object sounds and meaningless hums). The response properties of the three regions dissociated within the auditory modality. In left TPJ, activation was higher for auditory stimuli that were non-verbal (sounds of objects or meaningless hums) compared to verbal (words and pseudowords), irrespective of task (speech production or 1-back matching). In left pSTS, activation was higher for non-semantic stimuli (pseudowords and hums) than semantic stimuli (words and object sounds) on the dorsal pSTS surface (dpSTS), irrespective of task. In left atSTS, activation was not sensitive to either semantic or verbal content. The contrasting response properties of left TPJ, dpSTS and atSTS was cross-validated in an independent sample of 59 participants, using region-by-condition interactions. We also show that each region participates in non-overlapping networks of frontal, parietal and cerebellar regions. Our results challenge previous claims about functional specialisation in the left posterior superior temporal lobe and motivate future studies to determine the timing and directionality of information flow in the brain networks involved in speech perception and production.

A functional dissociation of the left frontal regions that contribute to single word production tasks.

Controversy surrounds the interpretation of higher activation for pseudoword compared to word reading in the left precentral gyrus and pars opercularis. Specifically, does activation in these regions reflect: (1) the demands on sublexical assembly of articulatory codes, or (2) retrieval effort because the combinations of articulatory codes are unfamiliar? Using fMRI, in 84 neurologically intact participants, we addressed this issue by comparing reading and repetition of words (W) and pseudowords (P) to naming objects (O) from pictures or sounds. As objects do not provide sublexical articulatory cues, we hypothesis that retrieval effort will be greater for object naming than word repetition/reading (which benefits from both lexical and sublexical cues); while the demands on sublexical assembly will be higher for pseudoword production than object naming. We found that activation was: (i) highest for pseudoword reading [P>O&W in the visual modality] in the anterior part of the ventral precentral gyrus bordering the precentral sulcus (vPCg/vPCs), consistent with the sublexical assembly of articulatory codes; but (ii) as high for object naming as pseudoword production [P&O>W] in dorsal precentral gyrus (dPCg) and the left inferior frontal junction (IFJ), consistent with retrieval demands and cognitive control. In addition, we dissociate the response properties of vPCg/vPCs, dPCg and IFJ from other left frontal lobe regions that are activated during single word speech production. Specifically, in both auditory and visual modalities: a central part of vPCg (head and face area) was more activated for verbal than nonverbal stimuli [P&W>O]; and the pars orbitalis and inferior frontal sulcus were most activated during object naming [O>W&P]. Our findings help to resolve a previous discrepancy in the literature, dissociate three functionally distinct parts of the precentral gyrus, and refine our knowledge of the functional anatomy of speech production in the left frontal lobe.

Brain regions that support accurate speech production after damage to Broca's area.

Broca's area in the posterior half of the left inferior frontal gyrus has traditionally been considered an important node in the speech production network. Nevertheless, recovery of speech production has been reported, to different degrees, within a few months of damage to Broca's area. Importantly, contemporary evidence suggests that, within Broca's area, its posterior part (i.e. pars opercularis) plays a more prominent role in speech production than its anterior part (i.e. pars triangularis). In this study, we therefore investigated the brain activation patterns that underlie accurate speech production following stroke damage to the opercular part of Broca's area. By combining functional MRI and 13 tasks that place varying demands on speech production, brain activation was compared in (i) seven patients of interest with damage to the opercular part of Broca's area; (ii) 55 neurologically intact controls; and (iii) 28 patient controls with left-hemisphere damage that spared Broca's area. When producing accurate overt speech responses, the patients with damage to the left pars opercularis activated a substantial portion of the normal bilaterally distributed system. Within this system, there was a lesion-site-dependent effect in a specific part of the right cerebellar Crus I where activation was significantly higher in the patients with damage to the left pars opercularis compared to both neurologically intact and patient controls. In addition, activation in the right pars opercularis was significantly higher in the patients with damage to the left pars opercularis relative to neurologically intact controls but not patient controls (after adjusting for differences in lesion size). By further examining how right Crus I and right pars opercularis responded across a range of conditions in the neurologically intact controls, we suggest that these regions play distinct roles in domain-general cognitive control. Finally, we show that enhanced activation in the right pars opercularis cannot be explained by release from an inhibitory relationship with the left pars opercularis (i.e. dis-inhibition) because right pars opercularis activation was positively related to left pars opercularis activation in neurologically intact controls. Our findings motivate and guide future studies to investigate (i) how exactly right Crus I and right pars opercularis support accurate speech production after damage to the opercular part of Broca's area and (ii) whether non-invasive neurostimulation to one or both of these regions boosts speech production recovery after damage to the opercular part of Broca's area.

Right cerebral motor areas that support accurate speech production following damage to cerebellar speech areas.

Specific regions of the cerebellum are activated when neurologically intact adults speak, and cerebellar damage can impair speech production early after stroke, but how the brain supports accurate speech production years after cerebellar damage remains unknown. We investigated this in patients with cerebellar lesions affecting regions that are normally recruited during speech production. Functional MRI activation in these patients, measured during various single word production tasks, was compared to that of neurologically intact controls, and patient controls with lesions that spared the cerebellar speech production regions. Our analyses revealed that, during a range of speech production tasks, patients with damage to cerebellar speech production regions had greater activation in the right dorsal premotor cortex (r-PMd) and right supplementary motor area (r-SMA) compared to neurologically intact controls. The loci of increased activation in cerebral motor speech areas motivate future studies to delineate the functional contributions of different parts of the speech production network, and test whether non-invasive stimulation to r-PMd and r-SMA facilitates speech recovery after cerebellar stroke.

Lesion site and therapy time predict responses to a therapy for anomia after stroke: a prognostic model development study.

Stroke is a leading cause of disability, and language impairments (aphasia) after stroke are both common and particularly feared. Most stroke survivors with aphasia exhibit anomia (difficulties with naming common objects), but while many therapeutic interventions for anomia have been proposed, treatment effects are typically much larger in some patients than others. Here, we asked whether that variation might be more systematic, and even predictable, than previously thought. 18 patients, each at least 6 months after left hemisphere stroke, engaged in a computerised treatment for their anomia over a 6-week period. Using only: (a) the patients' initial accuracy when naming (to-be) trained items; (b) the hours of therapy that they devoted to the therapy; and (c) whole-brain lesion location data, derived from structural MRI; we developed Partial Least Squares regression models to predict the patients' improvements on treated items, and tested them in cross-validation. Somewhat surprisingly, the best model included only lesion location data and the hours of therapy undertaken. In cross-validation, this model significantly out-performed the null model, in which the prediction for each patient was simply the mean treatment effect of the group. This model also made promisingly accurate predictions in absolute terms: the correlation between empirical and predicted treatment response was 0.62 (95% CI 0.27, 0.95). Our results indicate that individuals' variation in response to anomia treatment are, at least somewhat, systematic and predictable, from the interaction between where and how much lesion damage they have suffered, and the time they devoted to the therapy.

Lesions that do or do not impair digit span: a study of 816 stroke survivors.

Prior studies have reported inconsistency in the lesion sites associated with verbal short-term memory impairments. Here we asked: How many different lesion sites can account for selective impairments in verbal short-term memory that persist over time, and how consistently do these lesion sites impair verbal short-term memory? We assessed verbal short-term memory impairments using a forward digit span task from the Comprehensive Aphasia Test. First, we identified the incidence of digit span impairments in a sample of 816 stroke survivors (541 males/275 females; age at stroke onset 56 ± 13 years; time post-stroke 4.4 ± 5.2 years). Second, we studied the lesion sites in a subgroup of these patients (n = 39) with left hemisphere damage and selective digit span impairment-defined as impaired digit span with unimpaired spoken picture naming and spoken word comprehension (tests of speech production and speech perception, respectively). Third, we examined how often these lesion sites were observed in patients who either had no digit span impairments or digit span impairments that co-occurred with difficulties in speech perception and/or production tasks. Digit span impairments were observed in 222/816 patients. Almost all (199/222 = 90%) had left hemisphere damage to five small regions in basal ganglia and/or temporo-parietal areas. Even complete damage to one or more of these five regions was not consistently associated with persistent digit span impairment. However, when the same regions were spared, only 5% (23/455) presented with digit span impairments. These data suggest that verbal short-term memory impairments are most consistently associated with damage to left temporo-parietal and basal ganglia structures. Sparing of these regions very rarely results in persistently poor verbal short-term memory. These findings have clinical implications for predicting recovery of verbal short-term memory after stroke.

Damage to Broca's area does not contribute to long-term speech production outcome after stroke.

Broca's area in the posterior half of the left inferior frontal gyrus has long been thought to be critical for speech production. The current view is that long-term speech production outcome in patients with Broca's area damage is best explained by the combination of damage to Broca's area and neighbouring regions including the underlying white matter, which was also damaged in Paul Broca's two historic cases. Here, we dissociate the effect of damage to Broca's area from the effect of damage to surrounding areas by studying long-term speech production outcome in 134 stroke survivors with relatively circumscribed left frontal lobe lesions that spared posterior speech production areas in lateral inferior parietal and superior temporal association cortices. Collectively, these patients had varying degrees of damage to one or more of nine atlas-based grey or white matter regions: Brodmann areas 44 and 45 (together known as Broca's area), ventral premotor cortex, primary motor cortex, insula, putamen, the anterior segment of the arcuate fasciculus, uncinate fasciculus and frontal aslant tract. Spoken picture description scores from the Comprehensive Aphasia Test were used as the outcome measure. Multiple regression analyses allowed us to tease apart the contribution of other variables influencing speech production abilities such as total lesion volume and time post-stroke. We found that, in our sample of patients with left frontal damage, long-term speech production impairments (lasting beyond 3 months post-stroke) were solely predicted by the degree of damage to white matter, directly above the insula, in the vicinity of the anterior part of the arcuate fasciculus, with no contribution from the degree of damage to Broca's area (as confirmed with Bayesian statistics). The effect of white matter damage cannot be explained by a disconnection of Broca's area, because speech production scores were worse after damage to the anterior arcuate fasciculus with relative sparing of Broca's area than after damage to Broca's area with relative sparing of the anterior arcuate fasciculus. Our findings provide evidence for three novel conclusions: (i) Broca's area damage does not contribute to long-term speech production outcome after left frontal lobe strokes; (ii) persistent speech production impairments after damage to the anterior arcuate fasciculus cannot be explained by a disconnection of Broca's area; and (iii) the prior association between persistent speech production impairments and Broca's area damage can be explained by co-occurring white matter damage, above the insula, in the vicinity of the anterior part of the arcuate fasciculus.

Generalizing post-stroke prognoses from research data to clinical data.

Around a third of stroke survivors suffer from acquired language disorders (aphasia), but current medicine cannot predict whether or when they might recover. Prognostic research in this area increasingly draws on datasets associating structural brain imaging data with outcome scores for ever-larger samples of stroke patients. The aim is to learn brain-behaviour trends from these data, and generalize those trends to predict outcomes for new patients. The practical significance of this work depends on the expected breadth of that generalization. Here, we show that these models can generalize across countries and native languages (from British patients tested in English to Chilean patients tested in Spanish), across neuroimaging technology (from MRI to CT), and from scans collected months or years after stroke for research purposes, to scans collected days or weeks after stroke for clinical purposes. Our results suggest one important confound, in attempting to generalize from research data to clinical data, is the delay between scan acquisition and language assessment. This delay is typically small for research data, where scans and assessments are often acquired contemporaneously. But the most natural, clinical application of these predictions will employ acute prognostic factors to predict much longer-term outcomes. We mitigated this confound by projecting the clinical patients' lesions from the time when their scans were acquired, to the time when their language abilities were assessed; with this projection in place, there was strong evidence that prognoses derived from research data generalized equally well to research and clinical data. These results encourage attention to the confounding role that lesion growth may play in other types of lesion-symptom analysis.

A special role for the right posterior superior temporal sulcus during speech production.

This fMRI study of 24 healthy human participants investigated whether any part of the auditory cortex was more responsive to self-generated speech sounds compared to hearing another person speak. The results demonstrate a double dissociation in two different parts of the auditory cortex. In the right posterior superior temporal sulcus (RpSTS), activation was higher during speech production than listening to auditory stimuli, whereas in bilateral superior temporal gyri (STG), activation was higher for listening to auditory stimuli than during speech production. In the second part of the study, we investigated the function of the identified regions, by examining how activation changed across a range of listening and speech production tasks that systematically varied the demands on acoustic, semantic, phonological and orthographic processing. In RpSTS, activation during auditory conditions was higher in the absence of semantic cues, plausibly indicating increased attention to the spectral-temporal features of auditory inputs. In addition, RpSTS responded in the absence of any auditory inputs when participants were making one-back matching decisions on visually presented pseudowords. After analysing the influence of visual, phonological, semantic and orthographic processing, we propose that RpSTS (i) contributes to short term memory of speech sounds as well as (ii) spectral-temporal processing of auditory input and (iii) may play a role in integrating auditory expectations with auditory input. In contrast, activation in bilateral STG was sensitive to acoustic input and did not respond in the absence of auditory input. The special role of RpSTS during speech production therefore merits further investigation if we are to fully understand the neural mechanisms supporting speech production during speech acquisition, adult life, hearing loss and after brain injury.

Recovery after stroke: not so proportional after all?

The proportional recovery rule asserts that most stroke survivors recover a fixed proportion of lost function. To the extent that this is true, recovery from stroke can be predicted accurately from baseline measures of acute post-stroke impairment alone. Reports that baseline scores explain more than 80%, and sometimes more than 90%, of the variance in the patients' recoveries, are rapidly accumulating. Here, we show that these headline effect sizes are likely inflated. The key effects in this literature are typically expressed as, or reducible to, correlation coefficients between baseline scores and recovery (outcome scores minus baseline scores). Using formal analyses and simulations, we show that these correlations will be extreme when outcomes are significantly less variable than baselines, which they often will be in practice regardless of the real relationship between outcomes and baselines. We show that these effect sizes are likely to be over-optimistic in every empirical study that we found that reported enough information for us to make the judgement, and argue that the same is likely to be true in other studies as well. The implication is that recovery after stroke may not be as proportional as recent studies suggest.