Inter-rater agreement in the assessment of response to motor and cognitive rehabilitation of children and adolescents with epilepsy.

INTRODUCTION: To assess inter-rater agreement among child neurologists and psychiatrists on evaluation of response to physical and cognitive rehabilitation of children and adolescents with epilepsy. MATERIALS AND METHODS: Five child neurologists/psychiatrists ("raters") were invited to draw 2-3 short case reports among those most commonly seen. 14 case histories were presented and raters used a structured questionnaire to report changes after selected rehabilitation programs. Response was coded as "Yes", "No", or "Uncertain" in different functional domains (Motor, Social, Alimentary, Communication, Personal Autonomy). Inter-rater agreement was measured using the kappa statistic. Raters where then asked to discuss any reason for disagreement. The test was repeated with different cases (16 case histories) adding a sixth rater, who had participated to the discussion. RESULTS: Even with this small number of cases, the agreement mostly ranged from poor to good in the first test (worse for Social, Personal Autonomy and Communication). Training improved agreement in almost all domains. There were no frank outliers. The agreement was lower with a specific approach (i.e. grouping "Uncertain" to "No") than with sensitive approach (i.e. grouping "Uncertain" to "Yes"). DISCUSSION: The interpretation of patients' response to physical and cognitive rehabilitation tends to vary among Italian child neurologists/psychiatrists depending on measures and training procedures. Discussion and training improves agreement, although this is only a pilot study conducted using a non standardized questionnaire.

Response to rehabilitation of children and adolescents with epilepsy.

One hundred fifty-six children and adolescents with epilepsy from six Italian rehabilitation units were retrospectively enrolled to define the proportion of patients with epileptogenic developmental disorders who benefit from comprehensive rehabilitation programs and to identify factors predicting treatment response. The rehabilitation programs were classified as neuromotor, psychomotor, and speech and language. For each program, the response was coded as present or absent according to the caring physician's judgment. Selected demographic and clinical variables were correlated to treatment response. Neuromotor rehabilitation was performed in 86 cases (55%), psychomotor rehabilitation in 54 cases (34%), and speech and language rehabilitation in 40 cases (26%). Response rates were 58, 74, and 90%, respectively. Independent negative predictors of treatment response included severity of functional impairment (odds ratio=0.02, 95% confidence interval=0.01-0.14) and daily seizures (odds ratio=0.22, 95% confidence interval=0.08-0.58).