Your browser doesn't support javascript.
loading
Show: 20 | 50 | 100
Results 1 - 20 de 24
Filter
1.
J Clin Psychol ; 74(3): 398-406, 2018 03.
Article in English | MEDLINE | ID: mdl-28685823

ABSTRACT

OBJECTIVE: Training in broad-based objective and projective personality assessments has been a mainstay of applied psychology. Stedman (2007) and Piotrowski (2015) have documented a decline in projective training during internship. This study investigated internship directors' current expectations regarding graduate school training with objective and projective instruments, their ratings of the importance of that training, and current training patterns with objective and projective instruments during internship. METHOD: Participants were 355 psychology internship programs, representing 46.1% of the Association of Psychology Postdoctoral and Internship Centers. RESULTS: Results indicated the following current internship training patterns: Minnesota Multiphasic Personality Inventory (68% to 51%), Personality Assessment Inventory (59% to 25%), Millon Clinical Multiaxial Inventory (51% to 34%), Rorschach (35 to 26%), story telling (41% to 19%), sentence completion (41% to 18%), and drawings (36% to 9%). Adult program directors reported higher percentages for objective tests; child program directors reported higher percentages for projective tests. CONCLUSION: A decreased valuation of projective techniques is now typical of current internship training programs.


Subject(s)
Education, Graduate/statistics & numerical data , Internship and Residency/statistics & numerical data , Personality Assessment/statistics & numerical data , Personality Inventory/statistics & numerical data , Projective Techniques/statistics & numerical data , Psychology, Applied/education , Psychology, Applied/statistics & numerical data , Adult , Humans , MMPI/statistics & numerical data , Millon Clinical Multiaxial Inventory/statistics & numerical data , Rorschach Test/statistics & numerical data
2.
J Appl Psychol ; 102(3): 564-568, 2017 Mar.
Article in English | MEDLINE | ID: mdl-28182461

ABSTRACT

Informal observations concerning journal content indicates that research investigating organizational behavior topics, including work on the structure of groups and determinants and consequences of group process along with the role of leadership in groups, has increased. Some topics have disappeared (e.g., job analysis, human factors, union-related work, consumer behavior) and others are declining (e.g., research methods, psychometrics). Perhaps the biggest change is in the length of articles, which is mostly a function of the inclusion of greater numbers of references and appendix material. Publishing some of this material in supplementary online materials is now current practice in the Journal of Applied Psychology. Concerns about use of journal space may also be entirely moot, if electronic publishing as opposed to print publishing becomes the norm. (PsycINFO Database Record


Subject(s)
Periodicals as Topic , Psychology, Applied , Research , History, 20th Century , Humans , Periodicals as Topic/history , Periodicals as Topic/statistics & numerical data , Periodicals as Topic/trends , Psychology, Applied/history , Psychology, Applied/statistics & numerical data , Psychology, Applied/trends , Research/history , Research/statistics & numerical data , Research/trends
3.
J Appl Psychol ; 102(3): 574-579, 2017 Mar.
Article in English | MEDLINE | ID: mdl-28182462

ABSTRACT

The topic and theme content of the articles published during my term as editor of the Journal of Applied Psychology (2003-2008) are presented and discussed. The analysis of the content and trends is discussed in the context of attempts by my editorial team to influence what content was to be considered for publication as well as to engage in special efforts to generate more "theory" as well as alternative methodological approaches (e.g., qualitative data, content analysis, and the like) into the journal. The bigger issue for the perspective is whether the editorial team can influence what is published (yes) as opposed to what is researched (unlikely). The bottom line of the analysis is a call for future research that takes an interdisciplinary or multidisciplinary approach to the study of applied problems in a work setting. (PsycINFO Database Record


Subject(s)
Periodicals as Topic , Psychology, Applied , History, 21st Century , Humans , Periodicals as Topic/history , Periodicals as Topic/supply & distribution , Periodicals as Topic/trends , Psychology, Applied/history , Psychology, Applied/statistics & numerical data , Psychology, Applied/trends
4.
J Appl Psychol ; 102(3): 580-588, 2017 Mar.
Article in English | MEDLINE | ID: mdl-28182463

ABSTRACT

In this reflection on my experiences as editor of the Journal of Applied Psychology, I consider 6 foci including (a) information on the background, infrastructure, and mechanics of running this top-tier journal; (b) statistics on journal operations across the 7 years of editorial activity (i.e., incoming plus 6 years on the masthead); (c) innovations that my senior editorial team introduced (i.e., transparency via supplemental materials, revival of monographs, initiation of integrative conceptual reviews); (d) impact and influence with respect to articles, authors, and institutions; (e) latent sematic analysis findings to illustrate the evolution and change of journal content over a 33-year comparison period (i.e., it has evolved substantially); and desirable directions for future evolution of the journal (i.e., strengthen our scientific foundation, increase multidisciplinary linkages, focus on multilevel system dynamics as core capabilities, and improve the translation of industrial and organizational science to evidence-based practice and vice versa). (PsycINFO Database Record


Subject(s)
Periodicals as Topic , Psychology, Applied , History, 21st Century , Humans , Periodicals as Topic/history , Periodicals as Topic/statistics & numerical data , Periodicals as Topic/trends , Psychology, Applied/history , Psychology, Applied/statistics & numerical data , Psychology, Applied/trends
5.
J Appl Psychol ; 102(3): 569-573, 2017 Mar.
Article in English | MEDLINE | ID: mdl-28182464

ABSTRACT

Major trends in articles published during my term as Editor (1997-2000) are reviewed, including the number of articles received (approximately 500-600 per year) and the types of articles published. More than half of the articles published during this period fell into six broad categories: job attitudes and affect (82 articles); individual differences and measurement (52 articles); forensic psychology (50 articles); diversity and discrimination (46 articles); research methods, design, and analysis (41 articles); and performance appraisal and performance management (41 articles). Notable articles and advances within each of these areas are described. (PsycINFO Database Record


Subject(s)
Periodicals as Topic/statistics & numerical data , Psychology, Applied/statistics & numerical data , History, 20th Century , History, 21st Century , Humans , Periodicals as Topic/history , Psychology, Applied/history
6.
J Appl Psychol ; 102(3): 483-499, 2017 Mar.
Article in English | MEDLINE | ID: mdl-28125255

ABSTRACT

This article examines the evolution of diversity in the Journal of Applied Psychology. To begin, we explore foundations of the concept of diversity, including its appearance in both applied contexts and the scholarly literature. We then review the literature on diversity, including the development of its conceptualization and operationalizations over time, in the Journal and in the field of applied psychological science at large. We also examine the processes underlying the effects of diversity, and specific outcomes of diversity in organizations. To conclude, we offer a future research agenda that highlights diversity-related topics and issues important for advancing an understanding of diversity and moving the field forward, especially within the Journal. This work makes several contributions to research on diversity in organizations. First, we provide a lens for examining change in the study of diversity over time as well as a critical examination of the benefits and challenges associated with these changes. Second, we review the underlying mechanisms and key contextual influences on diversity effects in organizations. Third, our review examines the explanatory power of current diversity research and then uses this to develop a research agenda. By organizing the broad body of literature that exists on diversity, our article offers a sharp picture of what gaps in knowledge exist and where future research should focus. (PsycINFO Database Record


Subject(s)
Cultural Diversity , Organizational Culture , Periodicals as Topic , Psychology, Applied , Humans , Periodicals as Topic/statistics & numerical data , Psychology, Applied/statistics & numerical data
7.
J Appl Psychol ; 102(3): 500-513, 2017 Mar.
Article in English | MEDLINE | ID: mdl-28125266

ABSTRACT

Employment discrimination-a legal, social, moral, and practical problem-has been a persistent focus of narrow scholarship in the Journal of Applied Psychology since its inception. Indeed, this article identifies the environmental characteristics, conceptual underpinnings, dominant methodologies, research questions and findings across 508 articles published on discrimination in the journal over the last 100 years. Emergent themes document signs of stability and change in 3 eras: an era wherein discrimination research was itself discriminatory (1917-1969), the heyday of discrimination research (1970-1989), and an era of unsteady progress (1990-2014). This synthesis suggests that, although increasingly sophisticated methodological approaches have been applied to this topic, the targets of focus and theories driving research have largely been static. Additionally, research published on discrimination in the Journal of Applied Psychology has often trailed too far behind the times. Specific recommendations for advancing the psychological study of employment discrimination in applied contexts are provided. (PsycINFO Database Record


Subject(s)
Employment/statistics & numerical data , Prejudice , Psychology, Applied/statistics & numerical data , Research/statistics & numerical data , Employment/history , History, 20th Century , Humans , Psychology, Applied/history , Research/history
8.
Rev. psicol. deport ; 22(2): 509-516, jul.-dic. 2013.
Article in Portuguese | IBECS | ID: ibc-114022

ABSTRACT

En este estudio se analiza el contenido de la investigación publicada en el área de la psicología del ejercicio físico durante la última década. Se analizaron las comunicaciones presentadas en los principales congresos internacionales y nacionales del área de la psicología del deporte y del ejercicio físico, así como los artículos publicados en las principales revistas de referencia de la especialidad, en la última década. Con esta finalidad se usaron descriptores asociados al contexto del ejercicio físico (e.g., ejercicio, actividad física, adherencia, salud, bienestar, calidad de vida), excluyéndose los trabajos con descriptores de aplicación en el campo del deporte y de la educación física escolar. Tomando como base el número de comunicaciones presentadas y de artículos publicados, se ha comprobado que la psicología del ejercicio físico es un área de investigación que representa un tercio del total de trabajos presentados en este campo de la psicología. Así, y a pesar del creciente interés que existe por parte de los investigadores al largo de la última década, se ha podido comprobar que existe una cierta tendencia a la estabilización en el número de comunicaciones presentadas en los congresos nacionales e internacionales. Ha sido posible comprobar también que el nivel de atención prestado a esta área de conocimiento varía en función de la revista científica considerada (AU)


This study aims to analyze the contents of published research in the field of the psychology of physical exercise during the last decade. For this purpose, papers presented at major national and international conferences on the subject of the psychology of sport and exercise were analysed, together with articles published in major journals in this field during the last decade. To this end, associated descriptors were used associated with physical activity (e.g. exercise, physical activity, health, wellbeing, quality of life), excluding papers with descriptors applied to the fields of sport and physical education in schools. Based on the number of papers presented at events and specialist articles published in scientific journals, we found that the psychology of exercise represents about one third of all papers presented in this field of psychology. Despite the growing interest that has been identified during the last decade, there has been a certain levelling out in the number of papers presented at national and international congresses. It was also possible to verify that the level of attention given to this branch of knowledge varies depending (AU)


Subject(s)
Humans , Male , Female , Psychology, Applied/methods , Psychology, Applied/organization & administration , Psychology, Applied/standards , Exercise/psychology , Motor Activity/physiology , Athletic Performance/psychology , Psychology, Applied/instrumentation , Psychology, Applied/statistics & numerical data , Exercise Therapy/psychology , Research/methods , Research/statistics & numerical data , Research/trends , Psychomotor Performance/physiology
9.
J Couns Psychol ; 60(1): 154-61, 2013 Jan.
Article in English | MEDLINE | ID: mdl-23356470

ABSTRACT

Articles including multicultural content published in the Journal of Counseling Psychology (JCP), from 1954 to 2009, were examined for themes. Multicultural content in this study was broadly defined to include the following identities: race/ethnicity, gender/sex, religion/spirituality, sexual orientation, social status, disability, age, and intersections. Inclusion of articles focused on each of these identity domains was reported by decade. Gender/sex was the most prevalent multicultural identity found in the JCP, followed by race/ethnicity. The most common themes for multicultural articles, in order, were counseling process, vocation/career, and psychological processes/interventions. Academic achievement, discrimination/minority stress, and research methodology were the other common themes that were found across multicultural research. Implications of these findings are discussed.


Subject(s)
Cultural Diversity , Periodicals as Topic/statistics & numerical data , Psychology, Applied/statistics & numerical data , Adult , Age Factors , Disabled Persons/statistics & numerical data , Ethnicity/statistics & numerical data , Female , Gender Identity , Humans , Male , Minority Groups/statistics & numerical data , Periodicals as Topic/trends , Psychology, Applied/trends , Racial Groups/statistics & numerical data , Social Class , Spirituality , United States , Young Adult
10.
An. psicol ; 28(1): 240-265, ene.-abr. 2012. tab, ilus
Article in Spanish | IBECS | ID: ibc-96429

ABSTRACT

En este artículo se revisan treinta trabajos experimentales cuyo denominador común es que tratan sobre la percepción de peligros en tráfico ("hazard perception"), siempre en laboratorio. Se exponen los resultados de la revisión acerca de la forma de presentación de los estímulos o situaciones de tráfico en las que puede haber un cierto peligro (vídeo y simulación de conducción), el grado de fidelidad o realismo de los estímulos presentados (a través del uso de sonido o el tamaño de la proyección de los estímulos), la definición de peligro dada a los participantes y las variables de detección del peligro empleadas, así como otros aspectos metodológicos (por ejemplo, la separación entre edad y experiencia en conducción y las variables de control empleadas). En cuanto a las conclusiones más relevantes, la mayoría de trabajos emplea la presentación de escenas de tráfico real mediante vídeo. Resulta sorprendente la ausencia de la presentación de sonido en los clips, aspecto aún no estudiado sistemáticamente. Además, la ampliación del campo de visión consigue reducir el tiempo de latencia de la respuesta al peligro. Esta última variable ha mostrado ser capaz de discriminar entre conductores noveles y expertos. Finalmente, es posible entrenar la habilidad de percepción de peligros en conductores de diferente edad y experiencia (AU)


This paper analyzes thirty experimental studies on hazard perception in traffic, all of them made in the laboratory. We present the results of this review about the way of showing the stimuli -traffic situations in which a hazard is involved-, that is, video and driving simulation, the degree of realism -through the use of sound in the video clips and the size of the screen, the definition of hazard given to the participants and the variables of hazard detection used. Moreover, other methodological aspects are discussed: the concern about separating age and driving experience, and the use of control variables. In the discussion of the main results we point that most of the studies use video presentation of real traffic scenes but almost all of them have no sound, which supposed effect has not been systematically studied yet. Besides, enlarging the field of view yield the speeding of latency or response time to hazard. This variable is capable of discriminate among novice and experienced drivers. Finally, it is possible to train this ability in drivers with different age and driving experience (AU)


Subject(s)
Humans , Male , Female , Perception/ethics , Psychology, Applied/education , Psychology, Applied/ethics , Security Measures/legislation & jurisprudence , Sensation/physiology , Perception/physiology , Accidents, Traffic/psychology , Safety/standards , Security Measures/standards , Security Measures , Psychology, Applied/methods , Psychology, Applied/statistics & numerical data , Psychology, Applied/trends , Hazards/prevention & control , Disaster Vulnerability/prevention & control
11.
J Psychol ; 145(5): 391-417, 2011.
Article in English | MEDLINE | ID: mdl-21902009

ABSTRACT

The aim of this article is to propose the formative measurement approach that can be used in various constructs of applied psychology. To illustrate this approach, the authors will (a) discuss the distinction between commonly used principal-factor (reflective) measures in comparison to the composite (formative) latent variable model, which is often applied in other disciplines such as marketing or engineering, and (b) point out the advantages and limitations of formative specifications using the example of the work-family balance (WFB) construct. Data collected from 2 large cross-sectional field studies confirm the reliability and validity of formative WFB measures as well as its predictive value regarding criteria of WFB (i.e., job satisfaction, family satisfaction, and life satisfaction). Last, the specific informational value of each formative indicator will be demonstrated and discussed in terms of practical implications for the assessment in different psychological fields.


Subject(s)
Conflict, Psychological , Family/psychology , Psychology, Applied/statistics & numerical data , Psychometrics/statistics & numerical data , Workload/psychology , Adaptation, Psychological , Adult , Female , Humans , Job Satisfaction , Male , Middle Aged , Models, Psychological , Models, Statistical , Personal Satisfaction , Personality Tests/statistics & numerical data , Quality of Life/psychology , Reproducibility of Results
13.
Int J Psychol ; 45(2): 155-62, 2010 Apr 01.
Article in English | MEDLINE | ID: mdl-22043896

ABSTRACT

A published database of presentations from the seven most recent International Congresses of Applied Psychology (ICAPs) was compared to a similar but unpublished database (Adair, Anguas-Plata, Unik, & Radons, 2009) on the International Congresses of Psychology (ICPs) for the years 1996-2004. Analyses revealed phenomena characteristic of attendance at both international congresses: Participation rates spike dramatically for host countries; less dramatic regional surges in participation occur when the congress is held in a neighbouring country. Psychologists from 117 different countries participated in the seven recent congresses (ICAP and ICP) from 1994 to 2006. Overall ICP was double the size of ICAP, and represented a larger set of countries at each of its congresses. Regardless of location, most participants at both congresses came from the same 11 economically advantaged and seven majority-world countries. Congress presentations are dispersed across a much larger number of countries than are journal publications. The USA, for example, had modest 14.4% (ICAP) and 11.6% (ICP) presentation rates, much smaller than its majority share of publications (Adair, 2009 ). By contrast, the USA had the greater share of invited addresses at both ICAP (33.7%) and ICP (28.9%) congresses. Nonetheless, the majority-world countries contributing to both ICAP and ICP are clearly indicative of where the discipline is gaining strength and importance to international psychology. The emergence of Iran as a new leading national contributor to the two most recent international congresses, and the rise in the proportion of presentations by majority-world psychologists at ICAPs from only about one in five to more than one of every three presentations in recent congresses are findings consistent with Zakaria's (2008) analysis of changes taking place in the world. Within international congresses, certainly, the "rise of the rest" is changing the face of international psychology.


Subject(s)
Congresses as Topic/statistics & numerical data , Cross-Cultural Comparison , Internationality , Humans , Psychology, Applied/statistics & numerical data , Publishing/statistics & numerical data , Socioeconomic Factors
14.
Br J Math Stat Psychol ; 62(Pt 3): 641-62, 2009 Nov.
Article in English | MEDLINE | ID: mdl-19159504

ABSTRACT

This paper extends Lumsden's fluctuation model to the graded response case and, from the resulting basic scaling model, develops a one-dimensional item response theory graded response model (GRM). Under some additional assumptions, it follows that the item category response functions (ICRFs) can be closely approximated by the ICRFs of the standard GRM with equal item discrimination. For fixed item locations, the item responses depend on two individual differences parameters: the person central location and the person reliability. Procedures for estimating the person parameters and for addressing the goodness of fit of the proposed model as compared to the standard GRM are discussed. The accuracy of the person estimates is assessed by means of simulation studies. Finally, all the developments are illustrated using three empirical examples in personality measurement.


Subject(s)
Models, Statistical , Personality Tests/statistics & numerical data , Psychology, Applied/statistics & numerical data , Extraversion, Psychological , Humans , Individuality , Mathematical Computing , Models, Psychological , Normal Distribution , Psychometrics/statistics & numerical data , Reproducibility of Results , Software
15.
Psychol Methods ; 12(1): 1-22, 2007 Mar.
Article in English | MEDLINE | ID: mdl-17402809

ABSTRACT

Studies that combine moderation and mediation are prevalent in basic and applied psychology research. Typically, these studies are framed in terms of moderated mediation or mediated moderation, both of which involve similar analytical approaches. Unfortunately, these approaches have important shortcomings that conceal the nature of the moderated and the mediated effects under investigation. This article presents a general analytical framework for combining moderation and mediation that integrates moderated regression analysis and path analysis. This framework clarifies how moderator variables influence the paths that constitute the direct, indirect, and total effects of mediated models. The authors empirically illustrate this framework and give step-by-step instructions for estimation and interpretation. They summarize the advantages of their framework over current approaches, explain how it subsumes moderated mediation and mediated moderation, and describe how it can accommodate additional moderator and mediator variables, curvilinear relationships, and structural equation models with latent variables.


Subject(s)
Models, Psychological , Psychology, Applied/methods , Female , Humans , Male , Negotiating , Psychology, Applied/statistics & numerical data
16.
Psychol Methods ; 12(1): 23-44, 2007 Mar.
Article in English | MEDLINE | ID: mdl-17402810

ABSTRACT

Most empirical tests of mediation utilize cross-sectional data despite the fact that mediation consists of causal processes that unfold over time. The authors considered the possibility that longitudinal mediation might occur under either of two different models of change: (a) an autoregressive model or (b) a random effects model. For both models, the authors demonstrated that cross-sectional approaches to mediation typically generate substantially biased estimates of longitudinal parameters even under the ideal conditions when mediation is complete. In longitudinal models where variable M completely mediates the effect of X on Y, cross-sectional estimates of the direct effect of X on Y, the indirect effect of X on Y through M, and the proportion of the total effect mediated by M are often highly misleading.


Subject(s)
Models, Psychological , Psychology, Applied/methods , Psychology, Applied/statistics & numerical data , Bias , Cross-Sectional Studies , Humans , Longitudinal Studies , Negotiating
17.
Psychol Rep ; 98(3): 821-35, 2006 Jun.
Article in English | MEDLINE | ID: mdl-16933680

ABSTRACT

As some authors have noticed in fields other than psychology, level of measurement and distributional characteristics of count data are commonly not taken into account, so that they are analysed as normally distributed continuous variables, and therefore some general linear model is applied. In this work, we review a random sample of 457 articles published in the last four years in journals with the highest impact factor in the Journal Citation Reports (JCR Social Sciences Edition) of the Institute for Scientific Information. The goals are to know how often count variables appear in psychological applied research and which data analyses are used when dealing with count response variables. Examination showed that there is a notable presence of count variables, especially in some topics in psychology and a remarkable misapplication of the general linear model. One deals with causes and consequences of this approach to data analysis and suggests the use of specific models to analyse count data.


Subject(s)
Psychology, Applied/methods , Psychology, Applied/statistics & numerical data , Humans
18.
Psychol Assess ; 15(4): 446-55, 2003 Dec.
Article in English | MEDLINE | ID: mdl-14692841

ABSTRACT

There has been insufficient effort in most areas of applied psychology to evaluate incremental validity. To further this kind of validity research, the authors examined applicable research designs, including those to assess the incremental validity of test instruments, of test-informed clinical inferences, and of newly developed measures. The authors also considered key statistical and measurement issues that can influence incremental validity findings, including the entry order of predictor variables, how to interpret the size of a validity increment, and possible artifactual effects in the criteria selected for incremental validity research. The authors concluded by suggesting steps for building a cumulative research base concerning incremental validity and by describing challenges associated with applying nomothetic research findings to individual clinical cases.


Subject(s)
Psychological Tests/statistics & numerical data , Psychology, Applied/statistics & numerical data , Psychology, Clinical/statistics & numerical data , Humans , Psychometrics/statistics & numerical data , Reproducibility of Results
19.
Psicothema (Oviedo) ; 15(4): 507-516, nov. 2003. ilus, tab
Article in Es | IBECS | ID: ibc-27932

ABSTRACT

Se realiza un análisis bibliométrico de las revistas de Psicología Clínica editadas en castellano en los años 2001 y 2002. Se analizan el número de artículos publicados, la nacionalidad de los autores, el índice de autoría y los contenidos de los trabajos. Los resultados muestran diferencias en la diversidad y número de países colaboradores, así, son la Revista Internacional de Psicología Clínica y de la Salud / International Journal of Clinical and Health Psychology y la Revista Argentina de Clínica Psicológica las que tienen mayor representación de autores de un país diferente al de origen de la revista. Predominan los artículos compartidos por varios autores, frente a los individuales; la mayoría de los artículos se clasifican dentro de las áreas de Personalidad, Evaluación y Tratamiento Psicológico, Psicología de la Salud e "Inter-área". Se realizan algunas reflexiones finales sobre las implicaciones y utilidades de los resultados encontrados (AU)


This work is a bibliometric analysis of the reviews of Clinical Psychology published in Spanish in 2001 and 2002. The reviews are analyzed according to the number of articles that have been published, the nationalities of the signer authors, the index of authorship and the contents. There are differences in terms of their diversity and the number of countries that had collaborated. As, both the Revista Internacional de Psicología Clínica y de la Salud / International Journal of Clinical and Health Psychology and the Revista Argentina de Clínica Psicológica are the ones that have the greatest amount of authors whose nationalities are different from those of the original country of the review; there are a predominance of the articles shared by several authors; the contents of papers are especially of the areas Personality, Assessment and Psychological Treatment, Health Psychology and «Inter-área». Some final reflections are achieved about found results (AU)


Subject(s)
Bibliometrics , Psychology, Clinical/statistics & numerical data , Psychology/statistics & numerical data , Psychology, Applied/statistics & numerical data , Periodicals as Topic , Periodicals as Topic/statistics & numerical data , Personality/classification , /statistics & numerical data , /methods , Periodicals as Topic/statistics & numerical data , Periodicals as Topic/classification
20.
J Appl Psychol ; 88(2): 356-62, 2003 Apr.
Article in English | MEDLINE | ID: mdl-12731720

ABSTRACT

The authors demonstrated that the most common statistical significance test used with r(WG)-type interrater agreement indexes in applied psychology, based on the chi-square distribution, is flawed and inaccurate. The chi-square test is shown to be extremely conservative even for modest, standard significance levels (e.g., .05). The authors present an alternative statistical significance test, based on Monte Carlo procedures, that produces the equivalent of an approximate randomization test for the null hypothesis that the actual distribution of responding is rectangular and demonstrate its superiority to the chi-square test. Finally, the authors provide tables of critical values and offer downloadable software to implement the approximate randomization test for r(WG)-type and for average deviation (AD)-type interrater agreement indexes. The implications of these results for studying a broad range of interrater agreement problems in applied psychology are discussed.


Subject(s)
Models, Psychological , Psychology, Applied/methods , Psychology, Applied/statistics & numerical data , Humans , Observer Variation , Random Allocation
SELECTION OF CITATIONS
SEARCH DETAIL
...