A Reliability Generalization Meta-Analysis of the Padua Inventory-Revised (PI-R) / Meta-análisis de generalización de la fiabilidad del Padua Inventory-Revised (PI-R)

Background/Objective: The Padua Inventory-Revised (PI-R) is a widely applied instrument to measure obsessive-compulsive symptoms in clinical and nonclinical samples. We conducted a reliability generalization meta-analysis on the PI-R. Method: An exhaustive literature search yielded 118 empirical studies that had applied the PI-R, from which 30 studies (33 samples) reported an original reliability estimate. Results: Assuming a random-effects model, the average internal consistency reliability (Cronbach's alpha) was .92 (95% CI [.91, .93]) for the total scores, and ranged from .74 to .89 for the subscales. Assuming mixed-effects models, moderator analyses showed a positive statistically significant association between the standard deviation of the total scores and the reliability coefficients (p = .002; R2 = .38). Conclusions: In terms of reliability, the PI-R scale was found to be adequate for both research and clinical purposes, although exhibiting large heterogeneity across studies. Future empirical studies using the PI-R should be required to provide at least one reliability estimate based on their own data

Antecedentes/Objetivo: El Padua Inventory-Revised (PI-R) es un instrumento ampliamente utilizado para medir los síntomas obsesivo-compulsivos en muestras clínicas y no clínicas. Llevamos a cabo un meta-análisis de generalización de la fiabilidad del PI-R. Método: Una búsqueda exhaustiva de la literatura arrojó 118 estudios empíricos que habían aplicado el PI-R, de los cuales 30 estudios (33 muestras) reportaron una estimación propia de la fiabilidad. Resultados: Asumiendo un modelo de efectos aleatorios, la fiabilidad en términos de consistencia interna promedio (alfa de Cronbach) fue de 0,92 (IC del 95% [0,91, 0,93]) para las puntuaciones totales, y osciló entre 0,74 y 0,89 para las subescalas. Asumiendo modelos de efectos mixtos, los análisis de moderadores mostraron una relación positiva estadísticamente significativa entre la desviación típica de las puntuaciones totales y los coeficientes de fiabilidad (p = 0,002; R2 = 0,38). Conclusiones: En términos de fiabilidad, se encontró que el PI-R es adecuado tanto para fines clínicos como de investigación, aunque con una alta heterogeneidad entre los estudios. Es necesario que los estudios empíricos futuros que apliquen el PI-R proporcionen al menos una estimación de la fiabilidad basada en sus propios datos.

A Reliability Generalization Meta-analysis of the Padua Inventory-Revised (PI-R).

Background/Objective: The Padua Inventory-Revised (PI-R) is a widely applied instrument to measure obsessive-compulsive symptoms in clinical and nonclinical samples. We conducted a reliability generalization meta-analysis on the PI-R. Method: An exhaustive literature search yielded 118 empirical studies that had applied the PI-R, from which 30 studies (33 samples) reported an original reliability estimate. Results: Assuming a random-effects model, the average internal consistency reliability (Cronbach's alpha) was .92 (95% CI [.91, .93]) for the total scores, and ranged from .74 to .89 for the subscales. Assuming mixed-effects models, moderator analyses showed a positive statistically significant association between the standard deviation of the total scores and the reliability coefficients (p = .002; R2  = .38). Conclusions: In terms of reliability, the PI-R scale was found to be adequate for both research and clinical purposes, although exhibiting large heterogeneity across studies. Future empirical studies using the PI-R should be required to provide at least one reliability estimate based on their own data.

Antecedentes/Objetivo: El Padua Inventory-Revised (PI-R) es un instrumento ampliamente utilizado para medir los síntomas obsesivo-compulsivos en muestras clínicas y no clínicas. Llevamos a cabo un meta-análisis de generalización de la fiabilidad del PI-R. Método: Una búsqueda exhaustiva de la literatura arrojó 118 estudios empíricos que habían aplicado el PI-R, de los cuales 30 estudios (33 muestras) reportaron una estimación propia de la fiabilidad. Resultados: Asumiendo un modelo de efectos aleatorios, la fiabilidad en términos de consistencia interna promedio (alfa de Cronbach) fue de 0,92 (IC del 95% [0,91, 0,93]) para las puntuaciones totales, y osciló entre 0,74 y 0,89 para las subescalas. Asumiendo modelos de efectos mixtos, los análisis de moderadores mostraron una relación positiva estadísticamente significativa entre la desviación típica de las puntuaciones totales y los coeficientes de fiabilidad (p = 0,002; R2  = 0,38). Conclusiones: En términos de fiabilidad, se encontró que el PI-R es adecuado tanto para fines clínicos como de investigación, aunque con una alta heterogeneidad entre los estudios. Es necesario que los estudios empíricos futuros que apliquen el PI-R proporcionen al menos una estimación de la fiabilidad basada en sus propios datos.

Improving the reporting quality of reliability generalization meta-analyses: The REGEMA checklist.

Reliability generalization (RG) is a meta-analytic approach that aims to characterize how reliability estimates from the same test vary across different applications of the instrument. With this purpose RG meta-analyses typically focus on a particular test and intend to obtain an overall reliability of test scores and to investigate how the composition and variability of the samples affect reliability. Although several guidelines have been proposed in the meta-analytic literature to help authors improve the reporting quality of meta-analyses, none of them were devised for RG meta-analyses. The purpose of this investigation was to develop REGEMA (REliability GEneralization Meta-Analysis), a 30-item checklist (plus a flow chart) adapted to the specific issues that the reporting of an RG meta-analysis must take into account. Based on previous checklists and guidelines proposed in the meta-analytic arena, a first version was elaborated by applying the nominal group methodology. The resulting instrument was submitted to a list of independent meta-analysis experts and, after discussion, the final version of the REGEMA checklist was reached. In a pilot study, four pairs of coders applied REGEMA to a random sample of 40 RG meta-analyses in Psychology, and results showed satisfactory inter-coder reliability. REGEMA can be used by: (a) meta-analysts conducting or reporting an RG meta-analysis and aiming to improve its reporting quality; (b) consumers of RG meta-analyses who want to make informed critical appraisals of their reporting quality, and (c) reviewers and editors of journals who are considering submissions where an RG meta-analysis was reported for potential publication.

The Padua Inventory-Washington State University Revision of Obsessions and Compulsions: A Reliability Generalization Meta-Analysis.

The Padua Inventory-Washington State University Revision (PI-WSUR) is a frequently used test to assess obsessive-compulsive symptoms in screening and clinical contexts. A reliability generalization meta-analysis was carried out to estimate the average reliability of the PI-WSUR scores and its subscales and to search for characteristics of the studies that can explain the heterogeneity among reliability coefficients. A total of 124 independent samples reported some coefficient alpha or test-retest correlation with the data at hand for the PI-WSUR scores. The average internal consistency reliability of the PI-WSUR total scores was .929 (95% CI [.922, .936]), and for the subscales, the means ranged from .792 to .900. The test-retest reliability for PI-WSUR total scores was .767 (95% CI [.700, .820]), with the subscales ranging from .540 to .790. Moderator analyses revealed a positive relationship between the standard deviation of PI-WSUR total scores and alpha coefficients, as well as higher reliability estimates for the original version of the test and for studies from North America. The reliability induction rate for the PI-WSUR was 53.7%. Regarding reliability, the PI-WSUR ranks among the best scales for assessing obsessive-compulsive symptoms. Internal consistency reliability was excellent for the PI-WSUR total score and good for the subscales.

A Reliability Generalization Meta-Analysis of the Padua Inventory of Obsessions and Compulsions.

The Padua Inventory (PI) of obsessions and compulsions is one of the most usually applied tests to assess obsessive-compulsive symptomatology in research contexts as well as for clinical and screening purposes. A reliability generalization meta-analysis was accomplished to estimate the average reliability of the PI scores and to search for characteristics of the samples and studies that can explain the variability among reliability estimates. An exhaustive literature search enabled us to select 39 studies (53 independent samples) that reported alpha and/or test-retest coefficients with the data at hand for the PI total score and subscales. An excellent average coefficient alpha was found for the PI total score (M = .935; 95%CI = .922-.949) and for Impaired Mental Control subscale (M = .911; 95%CI = .897-.924), being good for Contamination (M = .861; 95%CI = .841-.882) and Checking (M = .880; 95%CI = .856-.903), and fair for Urges and Worries (M = .783; 95%CI = .745-.822). The average test-retest reliability for PI total score was also satisfactory (M = .835; 95%CI = .782-.877). Moderator analyses showed larger coefficients alpha for larger standard deviation of the PI total scores (p = .0005; R 2 = .46), for adapted versions of the test (p = .002; R 2 = .32), and for samples composed of clinical participants (p = .066; R 2 = .10). The practical implications of these results are discussed as well as the need for researchers to report reliability estimates with the data at hand.

A reliability generalization meta-analysis of the padua inventory of obsessions and compulsions

The Padua Inventory (PI) of obsessions and compulsions is one of the most usually applied tests to assess obsessive-compulsive symptomatology in research contexts as well as for clinical and screening purposes. A reliability generalization meta-analysis was accomplished to estimate the average reliability of the PI scores and to search for characteristics of the samples and studies that can explain the variability among reliability estimates. An exhaustive literature search enabled us to select 39 studies (53 independent samples) that reported alpha and/or test-retest coefficients with the data at hand for the PI total score and subscales. An excellent average coefficient alpha was found for the PI total score (M = .935; 95%CI = .922-.949) and for Impaired Mental Control subscale (M = .911; 95%CI = .897-.924), being good for Contamination (M = .861; 95%CI = .841-.882) and Checking (M = .880; 95%CI = .856-.903), and fair for Urges and Worries (M = .783; 95%CI = .745-.822). The average test-retest reliability for PI total score was also satisfactory (M = .835; 95%CI = .782-.877). Moderator analyses showed larger coefficients alpha for larger standard deviation of the PI total scores (p = .0005; R2 = .46), for adapted versions of the test (p = .002; R2 = .32), and for samples composed of clinical participants (p = .066; R2 = .10). The practical implications of these results are discussed as well as the need for researchers to report reliability estimates with the data at hand

No disponible

The Yale-Brown Obsessive Compulsive Scale: A Reliability Generalization Meta-Analysis.

The Yale-Brown Obsessive Compulsive Scale (Y-BOCS) is the most frequently applied test to assess obsessive compulsive symptoms. We conducted a reliability generalization meta-analysis on the Y-BOCS to estimate the average reliability, examine the variability among the reliability estimates, search for moderators, and propose a predictive model that researchers and clinicians can use to estimate the expected reliability of the Y-BOCS. We included studies where the Y-BOCS was applied to a sample of adults and reliability estimate was reported. Out of the 11,490 references located, 144 studies met the selection criteria. For the total scale, the mean reliability was 0.866 for coefficients alpha, 0.848 for test-retest correlations, and 0.922 for intraclass correlations. The moderator analyses led to a predictive model where the standard deviation of the total test and the target population (clinical vs. nonclinical) explained 38.6% of the total variability among coefficients alpha. Finally, clinical implications of the results are discussed.

Reliability generalization study of the Yale-Brown Obsessive-Compulsive Scale for children and adolescents.

The Yale-Brown Obsessive-Compulsive Scale for children and adolescents (CY-BOCS) is a frequently applied test to assess obsessive-compulsive symptoms. We conducted a reliability generalization meta-analysis on the CY-BOCS to estimate the average reliability, search for reliability moderators, and propose a predictive model that researchers and clinicians can use to estimate the expected reliability of the CY-BOCS scores. A total of 47 studies reporting a reliability coefficient with the data at hand were included in the meta-analysis. The results showed good reliability and a large variability associated to the standard deviation of total scores and sample size.

Adaptation and validation of the Spanish version of the Dieting Peer Competitiveness Scale to adolescents of both genders.

This study examined the Dieting Peer Competitiveness Scale; it is an instrument for evaluating this social comparison in young people. This instrumental study has two aims: The objective of the first aim was to present preliminary psychometric data from the Spanish version of the Dieting Peer Competitiveness Scale, including statistical item analysis, research about this instrument's internal structure, and a reliability analysis, from a sample of 1067 secondary school adolescents. The second objective of the study corresponds to confirmatory factor analysis of the scale's internal structure, as well as analysis for evidence of validity from a sample of 1075 adolescents.

Elaboración de un cuestionario para la evaluación de competencias genéricas en estudiantes universitarios / No disponible

Las orientaciones educativas promovidas por el Espacio Europeo de Educación Superior (EEES) requieren la planificación didáctica de materias o asignaturas orientadas hacia la adquisición de competencias por parte del alumno. En este proceso se hacen necesarias también las herramientas que permitan la evaluación de dichas competencias. Nuestro objetivo es la elaboración de un instrumento para evaluar las competencias adquiridas y el grado potencial de inserción en el mercado laboral de los estudiantes universitarios. Para ello, elaboramos un cuestionario inicial con 52 ítems de respuesta graduada que contestaron 94 estudiantes de cuarto curso de la Licenciatura de Psicología de una universidad española. Obtuvimos un cuestionario final de 45 ítems, con una consistencia interna de 0,92, distribuidos en seis factores, y que explican el 53,15% de la varianza total. El cuestionario desarrollado podría aplicarse tanto en organizacionales como académicos (AU)

The educational orientations promoted by the European Space of High Education (EEES) they require the didactic planning of matters or subjects guided toward the acquisition of competences on the part of the student. In this process they become necessary the tools that allow the evaluation of this competences. Our aim is the elaboration of an instrument to evaluate the acquired competences and the potential grade of insert in the labour market of the university students. For it, we elaborate an initial questionnaire with 52 items of graduate answer that 94 students of fourth course of the Degree of Psychology of a Spanish university answered. We obtained a final questionnaire of 45 items, with an internal consistency of 0, 92, distributed in six factors, explaining 53,15% of the total variance. The developed questionnaire could be applied so much in organizational as academic settings (AU)

Elaboración de un cuestionario para la evalúación de competencias genéricas en estudiantes universitarios / A questionnaire for evaluating generic competences in university students

Las orientaciones educativas promovidas por el Espacio Europeo de Educación Superior (EEES) requieren la planificación didáctica de materias o asignaturas orientadas hacia la adquisición de competencias por parte del alumno. En este proceso se hacen necesarias también las herramientas que permitan la evaluación de dichas competencias. Nuestro objetivo es la elaboración de un instrumento para evaluar las competencias adquiridas y el grado potencial de inserción en el mercado laboral de los estudiantes universitarios. Para ello, elaboramos un cuestionario inicial con 52 ítems de respuesta graduada que contestaron 94 estudiantes de cuarto curso de la Licenciatura de Psicología de una universidad española. Obtuvimos un cuestionario final de 45 ítems, con una consistencia interna de 0,92, distribuidos en seis factores, y que explican el 53,15% de la varianza total. El cuestionario desarrollado podría aplicarse tanto en organizacionales como académicos

The educational orientations promoted by the European Space of High Education (EEES) they require the didactic of matters or subjects guided towards the acquisition of competences on the part of the students. In this process they become necessary the tools that allow the evaluation of this competences. Our aim is the elaboration of an instrument to evaluate the acquired competences and the potential grade of insert in the labour market of the university students. For it, we elaborate an initial questionnaire with 52 items of graduate answer that 94 students of fourth course of the Degree of Psychology of a Spanish university answered. We obtained a final questionnaire of 45 items, with an internal consistency of 0,92, distributed in six factors, explaining 53,15% of the total variance. The developed questionnaire could be applied so much in organizational as academic setting

Técnicas para detectar patrones de respuesta atípicos / Aberrant patterns detection methods

La identificación de patrones de respuesta atípicos es de gran utilidad para la construcción de tests y de bancos de ítems con propiedades psicométricas así como para el análisis de validez de los mismos. En este trabajo de revisión se han recogido los más relevantes y novedosos métodos de ajuste de personas que se han elaborado dentro de cada uno de los principales ámbitos de trabajo de la Psicometría: el escalograma de Guttman, la Teoría Clásica de Tests (TCT), la Teoría de la Generalizabilidad (TG), la Teoría de Respuesta al Ítem (TRI), los Modelos de Respuesta al Ítem No Paramétricos (MRINP), los Modelos de Clase Latente de Orden Restringido (MCL-OR) y el Análisis de Estructura de Covarianzas (AEC)

Aberrant patterns detection has a great usefulness in order to make tests and item banks with psychometric characteristics and validity analysis of tests and items. The most relevant and newest person-fit methods have been reviewed. All of them have been made in each one of main areas of Psychometry: Guttman’s scalogram, Classical Test Theory (CTT), Generalizability Theory (GT), Item Response Theory (IRT), Non-parametric Response Models (NPRM), Order-Restricted Latent Class Models (OR-LCM) and Covariance Structure Analysis (CSA)

Influencia del sesgo de la distribución de habilidad en la distribución del estadístico lz / Influence of the ability distribution skewness on the distribution of statistic lz

El estadístico de medición apropiada lz de Drasgow, Levine y Williams (1985) es un índice adecuado para detectar patrones atípicos de respuesta por su alta tasa de identificaciones correctas. Sin embargo, algunos estudios han comprobado que la distribución normal de este índice está afectada, entre otros factores, por la longitud del test, el modelo de respuesta a los ítems o por la distribución de habilidad. En este trabajo se ha estudiado el efecto que tiene la simetría de la distribución de habilidad al tiempo de estimación de los parámetros de habilidad y de los ítems. Los resultados constatan que el índice lz sigue una distribución aproximadamente normal aunque sesgada y moderadamente leptocúrtica; las tasas de falsos positivos atestiguan que es una prueba conservadora y consistente en el nivel nominal de .05 (AU)

The appropriateness measurement statistic lz of Drasgow, Levine & Williams (1985) is a suitable index for detecting aberrant patterns because of its high hit rates. However, the normal distribution of this index is affected, for instance, by the test length, the item response model or the ability distribution. This research analyses the effect of the ability distribution skewness on the distribution of lz, and the test length, the extent of the discrimination parameter and the estimation process of the ability and items are also manipulated. The results show that the distribution of the index lz is aproximately a normal distribution but skewed and sightly leptokurtic; the false positive rates point out that the index lz is a conservative and consistent test in the significance level of .05 (AU)

Influencia de la igualación iterativa en la detección del funcionamiento diferencial del item mediante las medidas de área de Raju y el estadístico de Lord / Influence of iterative linking on differential item functioning detection using Raju' s area measures and Lord´s statistic

Con objeto de mejorar la identificación correcta de los ítems de un test que presentan funcionamiento diferencial (DIF), se han propuesto diversos procesos de purificación del test. El presente estudio emplea un procedimiento de purificación bietápico (Hidalgo y López, 1997b) para mejorar la detección del DIF con el estadístico de Lord y las medidas de área de Raju. Las condiciones manipuladas fueron: tamaño muestral (250, 500 y 1000 sujetos), cantidad de DIF (0.4 y 0.6), tipo de DIF (uniforme, no uniforme y mixto) y porcentaje de ítems con DIF en el test (10 por ciento y 30 por ciento). Los resultados indican que el procedimiento bietápico reduce las tasas de falsos positivos de dichas medidas (AU)

In order to improve the correct identification of test items which show differential functioning (DIF), several test purification procedures have been proposed. The present study uses a bietapic purification procedure (Hidalgo & López, 1997b) to improve DIF detection with Lord’s χ2 statistic and Raju’s area measures. Sample size (250, 500 and 1.000 subjects), amount of DIF (0.4 and 0.6), types of DIF - uniform, non-uniform and mixed - and percent of DIF test items (10% and 30%) were manipulated. The results show that the bietapic procedure reduces the false positive rates (AU)