Observer Agreement on Computed Tomography Perfusion Imaging in Acute Ischemic Stroke.

Background and Purpose- Computed tomography (CT) perfusion (CTP) provides potentially valuable information to guide treatment decisions in acute stroke. Assessment of interobserver reliability of CTP has, however, been limited to small, mostly single center studies. We performed a large, internet-based study to assess observer reliability of CTP interpretation in acute stroke. Methods- We selected 24 cases from the IST-3 (Third International Stroke Trial), ATTEST (Alteplase Versus Tenecteplase for Thrombolysis After Ischaemic Stroke), and POSH (Post Stroke Hyperglycaemia) studies to illustrate various perfusion abnormalities. For each case, observers were presented with noncontrast CT, maps of cerebral blood volume, cerebral blood flow, mean transit time, delay time, and thresholded penumbra maps (dichotomized into penumbra and core), together with a short clinical vignette. Observers used a structured questionnaire to record presence of perfusion deficit, its extent compared with ischemic changes on noncontrast CT, and an Alberta Stroke Program Early CT Score for noncontrast CT and CTP. All images were viewed, and responses were collected online. We assessed observer agreement with Krippendorff-α. Intraobserver agreement was assessed by inviting observers who reviewed all scans for a repeat review of 6 scans. Results- Fifty seven observers contributed to the study, with 27 observers reviewing all 24 scans and 17 observers contributing repeat readings. Interobserver agreement was good to excellent for all CTP. Agreement was higher for perfusion maps compared with noncontrast CT and was higher for mean transit time, delay time, and penumbra map (Krippendorff-α =0.77, 0.79, and 0.81, respectively) compared with cerebral blood volume and cerebral blood flow (Krippendorff-α =0.69 and 0.62, respectively). Intraobserver agreement was fair to substantial in the majority of readers (Krippendorff-α ranged from 0.29 to 0.80). Conclusions- There are high levels of interobserver and intraobserver agreement for the interpretation of CTP in acute stroke, particularly of mean transit time, delay time, and penumbra maps.

Arterial Obstruction on Computed Tomographic or Magnetic Resonance Angiography and Response to Intravenous Thrombolytics in Ischemic Stroke.

BACKGROUND AND PURPOSE: Computed tomographic angiography and magnetic resonance angiography are used increasingly to assess arterial patency in patients with ischemic stroke. We determined which baseline angiography features predict response to intravenous thrombolytics in ischemic stroke using randomized controlled trial data. METHODS: We analyzed angiograms from the IST-3 (Third International Stroke Trial), an international, multicenter, prospective, randomized controlled trial of intravenous alteplase. Readers, masked to clinical, treatment, and outcome data, assessed prerandomization computed tomographic angiography and magnetic resonance angiography for presence, extent, location, and completeness of obstruction and collaterals. We compared angiography findings to 6-month functional outcome (Oxford Handicap Scale) and tested for interactions with alteplase, using ordinal regression in adjusted analyses. We also meta-analyzed all available angiography data from other randomized controlled trials of intravenous thrombolytics. RESULTS: In IST-3, 300 patients had prerandomization angiography (computed tomographic angiography=271 and magnetic resonance angiography=29). On multivariable analysis, more extensive angiographic obstruction and poor collaterals independently predicted poor outcome (P<0.01). We identified no significant interaction between angiography findings and alteplase effect on Oxford Handicap Scale (P≥0.075) in IST-3. In meta-analysis (5 trials of alteplase or desmoteplase, including IST-3, n=591), there was a significantly increased benefit of thrombolytics on outcome (odds ratio>1 indicates benefit) in patients with (odds ratio, 2.07; 95% confidence interval, 1.18-3.64; P=0.011) versus without (odds ratio, 0.88; 95% confidence interval, 0.58-1.35; P=0.566) arterial obstruction (P for interaction 0.017). CONCLUSIONS: Intravenous thrombolytics provide benefit to stroke patients with computed tomographic angiography or magnetic resonance angiography evidence of arterial obstruction, but the sample was underpowered to demonstrate significant treatment benefit or harm among patients with apparently patent arteries. CLINICAL TRIAL REGISTRATION: URL: http://www.isrctn.com. Unique identifier: ISRCTN25765518.

Observer reliability of CT angiography in the assessment of acute ischaemic stroke: data from the Third International Stroke Trial.

INTRODUCTION: CT angiography (CTA) is often used for assessing patients with acute ischaemic stroke. Only limited observer reliability data exist. We tested inter- and intra-observer reliability for the assessment of CTA in acute ischaemic stroke. METHODS: We selected 15 cases from the Third International Stroke Trial (IST-3, ISRCTN25765518) with various degrees of arterial obstruction in different intracranial locations on CTA. To assess inter-observer reliability, seven members of the IST-3 expert image reading panel (>5 years experience reading CTA) and seven radiology trainees (<2 years experience) rated all 15 scans independently and blind to clinical data for: presence (versus absence) of any intracranial arterial abnormality (stenosis or occlusion), severity of arterial abnormality using relevant scales (IST-3 angiography score, Thrombolysis in Cerebral Infarction (TICI) score, Clot Burden Score), collateral supply and visibility of a perfusion defect on CTA source images (CTA-SI). Intra-observer reliability was assessed using independently repeated expert panel scan ratings. We assessed observer agreement with Krippendorff's-alpha (K-alpha). RESULTS: Among experienced observers, inter-observer agreement was substantial for the identification of any angiographic abnormality (K-alpha = 0.70) and with an angiography assessment scale (K-alpha = 0.60-0.66). There was less agreement for grades of collateral supply (K-alpha = 0.56) or for identification of a perfusion defect on CTA-SI (K-alpha = 0.32). Radiology trainees performed as well as expert readers when additional training was undertaken (neuroradiology specialist trainees). Intra-observer agreement among experts provided similar results (K-alpha = 0.33-0.72). CONCLUSION: For most imaging characteristics assessed, CTA has moderate to substantial observer agreement in acute ischaemic stroke. Experienced readers and those with specialist training perform best.

The NeuroGrid stroke exemplar clinical trial protocol.

RATIONALE: Trials of new treatments for neurological disorders like stroke require imaging as part of the patient assessment, but need to be large enough to obtain reliable results if treatment effects are likely to be modest. However, multicentre trials use many different scanners in different hospitals and present complex problems for image data collection, interpretation and analysis and long-term secure archiving. AIMS: NeuroGrid aims to develop and test grid technologies for collecting, analysing and interpreting, and secure archiving of neuroimaging data for large multicentre trials in common neurological and psychiatric disorders. DESIGN: A 3-year multicentre consortium of clinicians, neuroimaging centres and e-scientists are designing a Grid storage network, mechanisms for uploading, curating and retrieving image and metadata, combining image data from different scanners and an analysis tool box. Three clinical exemplars--stroke, dementia and psychosis--provide the data and 'real-world' clinical trial applications, and a set of specific and typical problems encountered with image data in multicentre trials for NeuroGrid to address. The stroke exemplar is using image data from two multicentre stroke trials: Third International Stroke Trial and Efficacy of Nitric Oxide in Stroke. OUTCOMES: The final product is intended to appear as an integrated capability consisting of services, both database and analyses, accessed through simple portals. These will include image submission, automated scan quality control, appropriate metadata linkage, streamlined image review and coding tools and long-term secure storage for future multicentre stroke trials.

Designing for e-Health: recurring scenarios in developing grid-based medical imaging systems.

The paper draws on a number of Grid projects, particularly on the experience of NeuroGrid, a UK project in the Neurosciences tasked with developing a Grid-based collaborative research environment to support the sharing of digital images and patient data across multiple distributed sites. It outlines recurrent socio-technical issues, highlighting the challenges of scaling up technological networks in advance of the regulatory networks which normally regulate their use in practice.