RESUMO
Este estudio presenta distintos tipos de evidencias de validez y confiabilidad de la Escala de Autenticidad (AS) en una muestra de Brasil y Portugal. El estudioconsiste en una encuesta con 1.077 brasileños y 622 portugueses. Se testó el modelo con tres factores correlacionados (autoalienación, vivir auténtico y aceptación de la influencia externa), el modelo unidimensional y el modelo bifactorial. Se retuvo el modelo con tres factores correlacionados, con las tres subescalas alcanzando confiabilidad moderada a buena. Análisis factorial confirmatorio multigrupo sugirió invariancia escalar para cultura, género, edad, educación, ocupación y preocupación e impacto relacionados con Covid. Los ítems fueron evaluados por graded response model(GRM), sugiriendo que las tres subescalas no discriminan las personas con altos rasgos de autenticidad. GRM y estadísticas descriptivas indican que la escala de puntuación es inapropiada, particularmente para la subescala vivir auténtico, que es afectada por efecto techo. Las asociaciones con presencia de sentido mostraron evidencia adicional de validez. A pesar de las limitaciones, la AS es una medida adecuada para evaluar la autenticidad en diferentes grupos. Se discuten posibles modificaciones para el aprimoramiento de la AS.(AU)
This study introduces distinct types of validity and reliability evidence of the Authenticity Scale (AS) in a sample from Brazil and Portugal. It consists of an online survey with 1,077 Brazilian citizens and 622 Portuguese citizens. The study tested the model with three correlated factors (self-alienation, authentic living, and accepting external influence), the unidimensional model, and the bifactor model. The model with three correlated factors was retained, with the three subscales demonstrating moderate to good reliability. Multigroup confirmatory factor analysis suggested scalar invariance across culture, gender, age, education, occupation, and Covid-related concern and impact. The items were assessed by graded response model (GRM), which suggested that the three subscales are not able to distinguish respondents with high authenticity traits. GRM and descriptive statistics indicated that the rating-scale is inappropriate, particularly for authentic living subscale, which is affected by ceiling effect. Associations with presence of meaning showed additional validity evidence. Despite the limitations, the AS is an effective measure to assess authenticity across different groups. Potential modifications for the improvement of the AS are discussed.(AU)
Assuntos
Humanos , Masculino , Feminino , Autoimagem , 35111 , Qualidade de Vida/psicologia , Valor da Vida , Reprodutibilidade dos Testes , Psicologia , Psicologia Social , Inquéritos e Questionários , Brasil , Portugal , Análise FatorialRESUMO
Resumen Se presenta el proceso de construcción de una escala para medir la faceta De-presión según el Modelo de los Cinco Factores. Se realizó una revisión de las definiciones teóricas y operacionales de autores relevantes de este modelo. Luego se elaboraron 15 ítems iniciales, 3 de los cuales fueron eliminados por jueces expertos. Los ítems conservados se administraron a 1222 adultos de población general residentes en el área metropolitana de Buenos Aires, Argentina (50.8 % mujeres, edad media = 33.2 años y DE = 11.8 años). Se seleccionó aleatoriamente un 35% de casos para depurar el instrumento con un análisis factorial exploratorio. El 65% restante se utilizó para corroborar la estructura interna con un análisis factorial confirmatorio y para ajustar el Modelo de Respuesta Graduada de la Teoria de Respuesta al Ítem. Los resultados muestran que los 10 ítems de la versión definitiva conforman una estructura unidimensional con adecuada consistencia interna. Se aportan evidencias de validez concurrente con EPQ-RA y SCL-90-R. La Función de Información revela que la escala mide con precisión elevada y constante en un rango extenso del rasgo. Se concluye que la escala permite valorar de manera satisfactoria las diferencias individuales en la tendencia a experimentar afectos depresivos.
Abstract The process of constructing a scale to measure the Depression facet, according to the Five Factors Model, is presented. A review of the theoretical and operational definitions of relevant authors of this model was carried out. Then, 15 initial items were elaborated, 3 of which were eliminated by expert judges. The retained items were administered to 1222 adults of the general population residing in the Buenos Aires Metropolitan Area, Argentina (50.8% women, mean age = 33.2 years and SD = 11.8 years). A random selection of 35% of cases was made to reduce the instrument with an Exploratory Factor Analysis. The remaining 65% was used to corroborate the internal structure with a Confirmatory Factor Analysis, and to fit the Graded Response Model of the Item Response Theory. The results show that the 10 items of the final version form a one-dimensional structure with adequate internal consistency. Evidence of concurrent validity is provided with EPQ-RA and SCL-90-R. The Test Information Function reveals that the scale measures with constant high reliability over a wide range of the trait. It is concluded that the scale allows a satisfactory assessment of individual differences in the tendency to experience depressive effects.
RESUMO
La evaluación de las actitudes en el ámbito educativo ha sido utilizada como herramienta para prevenir la pérdida de asignaturas y la deserción académica. El objetivo del estudio es realizar el análisis psicométrico del instrumento Actitudes hacia las Matemáticas con el Modelo de Respuesta Graduada de Samejima (MRG). Se contó con una muestra total de 944 estudiantes de primeros semestres de diferentes carreras universitarias. Se realizó el análisis a partir de la TCT y se ajustó el modelo MRG. Se estimaron y analizaron los parámetros de los ítems y se encontró que la mayoría se ajustan al modelo. En conclusión, se encuentra que la escala cuenta con adecuadas propiedades psicométricas. Finalmente, se presentan las bondades del uso del MRG para la evaluación de actitudes.
The assessment of attitudes in education has been used as a tool for preventing the loss of subjects and the desertion. The aim of the study is to perform a psychometric analysis of the "Attitudes towards Mathematics" scale with Samejima´s graded response model (MRG). The sample was of 944 students from different university careers. To analyze the TCT and the MRG model was used. In conclusion, the scale has good psychometric quality. Finally, the benefits of using the MRG for assessing attitudes are presented.
RESUMO
Se aplicó el Modelo de Respuesta Graduada (MRG) de la Teoría de Respuesta al ítem (TRI) y la Teoría Clásica de Test (TCT) al análisis de ítems de una escala de Confianza para la Matemática (Abal, 2013). La prueba mide la capacidad percibida por un estudiante universitario para operar eficazmente con símbolos y fórmulas, aprender y aprobar la asignatura matemática u otras afines. La prueba consta de 8 ítems con formato de respuesta Likert de 6 opciones. Participaron 1875 estudiantes de Psicología de la Universidad de Buenos Aires, Argentina. Se verificó la condición de unidimensionalidad requerida por el MRG. El ajuste del MRG fue satisfactorio para todos los ítems. El análisis clásico incluyó el estudio de las frecuencias de respuesta, estadísticos descriptivos del ítem y correlación ítem-test corregida. El coeficiente de confiabilidad marginal de la TRI fue de .91 y el alfa de Cronbach fue .90. Se encontraron correlaciones elevadas entre: a) la media del ítem y los parámetros de localización centrales del MRG, b) la correlación ítem-test corregida y los parámetros de discriminación y c) entre los escalamientos de los individuos realizados desde la TRI y la TCT. Estos resultados aportan evidencias de validez basadas en la estructura interna del instrumento...
The Graded Response Model (GRM) of Item Response Theory (IRT) and Classical Test Theory (CTT) were applied to the analysis of items from a scale of Confidence in Mathematics (Abal, 2013). This scale measures the ability perceived by university student to operate effectively with symbols and formulas, to solve problematic situations, to learn and pass mathematics or related subjects. The scale comprises 8 items in polytomous response format (6-point Likert-type). The sample was made up by 1875 students of the Psychology school of Buenos Aires University, Argentina. The unidimensionality assumption required by the GRM was confirmed. The GRM fitted to data satisfactorily for all items. Location and discrimination parameters showed predictable values. Classical item analysis involved the examination of response frequencies, item descriptive statistics and corrected item-test correlations. The marginal reliability coefficient obtained from IRT was .91 and Cronbachs alpha was .90. High correlations were found between: a) item means and central location parameters of GRM, b) corrected item-test correlations and discrimination parameters, and c) IRT and CTT individual scores. The finding provides validity evidences based on the internal structure of scale...
Assuntos
Humanos , Masculino , Adolescente , Adulto , Feminino , Adulto Jovem , Pessoa de Meia-Idade , Autoeficácia , Confiança , Estudantes/psicologia , Matemática/educação , Testes Psicológicos , Argentina , Modelos Psicológicos , Reprodutibilidade dos TestesRESUMO
Se presentan los resultados obtenidos con la aplicación de un modelo de la Teoría de Respuesta al Ítem (TRI) a los reactivos de una prueba que mide la Voluntad de Trabajo (VT). La VT es un rasgo de la personalidad que describe la tendencia de un individuo a asumir sus obligaciones con responsabilidad, automotivación y sin dilaciones, aun cuando estas pudieran no ser de su agrado. La escala que mide la VT se compone de 9 ítemes con formato de respuesta ordenada de 4 valores. Se aplicó el Modelo de Respuesta Graduada (MRG) de Samejima a datos provenientes de la administración de la escala de VT a una muestra de 1.141 universitarios. Previamente se verificó la condición de unidimensionalidad de los ítemes, requerida por el MRG. El análisis de los datos se realizó operando el programa MULTILOG. La estimación de los parámetros de este modelo se efectuó por máxima verosimilitud marginal. Sólo uno de los ítemes mostró un comportamiento inadecuado. La mayoría de los parámetros de localización tendieron a ubicarse en niveles medios bajos de la escala. Los parámetros de discriminación adoptaron valores entre moderados y altos. La Función de Información del Test evidenció que la escala es más precisa para discriminar individuos con niveles medios-bajos del rasgo evaluado. Los resultados revelaron los problemas que presenta la escala de VT y permitieron obtener información útil para orientar la construcción de nuevos reactivos.
This study aims to present the findings obtained from the application of an Item ResponseTheory model (IRT) to the reactive of a Will-to-Work Measuring Test (WW). WW is defined as the individuals' tendency to generate efficient volatile processes that allow them to commit themselves to starting a task and to persisting in its execution by overcoming obstacles until they achieve its materialization with precision and without procrastination. WW is a personality trait that describes the predisposition of an individual to assume duties in a responsible, self-motivated and prompt manner even when such duties may be unappealing. The scale measuring the WW comprises 9 items in polychromous response format (four-point rating scale), with the response options graded. Accordingly, one of the IRT most widely used models was applied for the monetization of ordered polychromous responses: Samejima's Graded Response Model (GRM). The GRM is a generalization of the Two Parameter Logistic Model of Birnbaum. In GRM, a person's probability of responding in category j to a specific item i, Pij(θ), is obtained by subtracting the probability of responding in or below category j-1 from the probability of responding in or below category j.Through the Item Response Category Curves, the GRM allows for the representation of an individual's likelihood to choose each of the item categories based on the level of the latent trait measured. The data from this psychometric test was obtained from a sample of 1,141 university students. The one-dimensional assumption required by the GRM was corroborated through an exploratory analysis of the data factor structure. The local independence assumption was considered to be satisfied after proving the scale one-dimensionality. All analyses based on the IRT were performed by operating the MULTILOG software program. The GRM parameters estimation was carried out through marginal maximum likelihood procedures. A discrimination parameter (a) and three location parameters (b1, b2 and b3) corresponding to thresholds separating the 4 response categories were estimated for each item. The model's goodness-of-fit was studied on an item basis by examining the residue of observed and expected proportions for each of the ordered response categories. The residue obtained was the same as or lower than .01, which led to the conclusion that the model adjustment to the data was satisfactory for all reactive. Despite this, one of the items showed inappropriate behavior. The value of its location parameters turned out to be very different from the expected one and showed high estimation errors when compared against the values obtained for the rest of the items. Most of the location parameters showed midlow WW values and discrimination parameters showed mid-high values (0.73 - 1.73). The instrument's reliability was acceptable if we consider the.75 marginal reliability coefficient obtained from IRT. However, local accuracy measures showed that the test is less reliable when measuring the WW highest levels. In other words, the measure error increases as we attempt to discriminate strongly willful individuals. This means that the WW scale is useful to measure mid-low levels of WW, but less accurate when it comes to individuals whose trait level is higher. It is therefore concluded that it is necessary to raise the number of WW scale items to optimize the instrument quality. It is particularly important to identify construct indicators allowing for a more accurate detection of the highest trait levels. The shortage of the application of IRT models to personality tests as well as the difficulty that the achievement of their exigent assumptions were discussed. The findings showed the problems posed by the WW scale and allowed us to obtain useful information to guide the building of new items.