Impact of Cognitive Abilities and Prior Knowledge on Complex Problem Solving Performance - Empirical Results and a Plea for Ecologically Valid Microworlds.

The original aim of complex problem solving (CPS) research was to bring the cognitive demands of complex real-life problems into the lab in order to investigate problem solving behavior and performance under controlled conditions. Up until now, the validity of psychometric intelligence constructs has been scrutinized with regard to its importance for CPS performance. At the same time, different CPS measurement approaches competing for the title of the best way to assess CPS have been developed. In the first part of the paper, we investigate the predictability of CPS performance on the basis of the Berlin Intelligence Structure Model and Cattell's investment theory as well as an elaborated knowledge taxonomy. In the first study, 137 students managed a simulated shirt factory (Tailorshop; i.e., a complex real life-oriented system) twice, while in the second study, 152 students completed a forestry scenario (FSYS; i.e., a complex artificial world system). The results indicate that reasoning - specifically numerical reasoning (Studies 1 and 2) and figural reasoning (Study 2) - are the only relevant predictors among the intelligence constructs. We discuss the results with reference to the Brunswik symmetry principle. Path models suggest that reasoning and prior knowledge influence problem solving performance in the Tailorshop scenario mainly indirectly. In addition, different types of system-specific knowledge independently contribute to predicting CPS performance. The results of Study 2 indicate that working memory capacity, assessed as an additional predictor, has no incremental validity beyond reasoning. We conclude that (1) cognitive abilities and prior knowledge are substantial predictors of CPS performance, and (2) in contrast to former and recent interpretations, there is insufficient evidence to consider CPS a unique ability construct. In the second part of the paper, we discuss our results in light of recent CPS research, which predominantly utilizes the minimally complex systems (MCS) measurement approach. We suggest ecologically valid microworlds as an indispensable tool for future CPS research and applications.

Modeling the construct validity of the Berlin Intelligence Structure Model / O modelo da validade do construto do Modelo Estrutural da Inteligência de Berlim

The Berlin Intelligence Structure Model is a hierarchical and faceted model which is originally based on an almost representative sample of tasks found in the literature. Therefore, the Berlin Intelligence Structure Model is an integrative model with a high degree of generality. The present paper investigates the construct validity of this model by using different confirmatory factor analysis models. The results show that the model assumptions are supported only in part by the data. Moreover, it is demonstrated that there are different possibilities to incorporate the Berlin Intelligence Structure Model assumptions into confirmatory factor analysis models. The results are discussed with regard to the validity of the Berlin Intelligence Structure Model test, and the validity of the model.

O Modelo Estrutural da Inteligência de Berlim é um modelo hierárquico e facetado que foi originalmente baseado em uma amostra quase representativa de tarefas encontradas na literatura. Portanto, o modelo estrutural da inteligência de Berlim é um modelo integrador com um elevado grau de generalidade. O presente trabalho investiga a validade do construto deste modelo usando diferentes modelos de análise fatorial confirmatória. Os resultados mostram que os pressupostos do modelo suportam apenas em parte pelos dados. Além disso, demonstra-se que há diferentes possibilidades de incorporar os pressupostos do Modelo Estrutural da Inteligência de Berlim em modelos de análise fatorial confirmatória. Os resultados discutidos mostram a validade do teste do Modelo Estrutural da Inteligência de Berlim, bem como a validade do modelo.

Modeling the construct validity of the Berlin Intelligence Structure Model / O modelo da validade do construto do Modelo Estrutural da Inteligência de Berlim

The Berlin Intelligence Structure Model is a hierarchical and faceted model which is originally based on an almost representative sample of tasks found in the literature. Therefore, the Berlin Intelligence Structure Model is an integrative model with a high degree of generality. The present paper investigates the construct validity of this model by using different confirmatory factor analysis models. The results show that the model assumptions are supported only in part by the data. Moreover, it is demonstrated that there are different possibilities to incorporate the Berlin Intelligence Structure Model assumptions into confirmatory factor analysis models. The results are discussed with regard to the validity of the Berlin Intelligence Structure Model test, and the validity of the model.(AU)

O Modelo Estrutural da Inteligência de Berlim é um modelo hierárquico e facetado que foi originalmente baseado em uma amostra quase representativa de tarefas encontradas na literatura. Portanto, o modelo estrutural da inteligência de Berlim é um modelo integrador com um elevado grau de generalidade. O presente trabalho investiga a validade do construto deste modelo usando diferentes modelos de análise fatorial confirmatória. Os resultados mostram que os pressupostos do modelo suportam apenas em parte pelos dados. Além disso, demonstra-se que há diferentes possibilidades de incorporar os pressupostos do Modelo Estrutural da Inteligência de Berlim em modelos de análise fatorial confirmatória. Os resultados discutidos mostram a validade do teste do Modelo Estrutural da Inteligência de Berlim, bem como a validade do modelo.(AU)

Measuring slips and lapses when they occur - ambulatory assessment in application to cognitive failures.

Cognitive failures are lapses in attention, cognition, and actions that everybody experiences in everyday life. Self-reports are mainly used for assessment but those instruments are memory-biased and more related to personality aspects than to actual behavior. Ambulatory assessment is already used for capturing emotions or addictive behavior, but not yet for cognitive failures. The newly developed Questionnaire for Cognitive Failures in Everyday Life (KFA) was applied via mobile phones (electronic KFA) wherein an acoustic signal asked participants (N=91, 60-76 years) 4 times daily to answer 13 questions for 1 week. The new instrument showed satisfying reliability and was compared with a self-report method (Cognitive Failures Questionnaire; Broadbent, Cooper, Fitzgerald, and Parkes, 1982) in terms of correlations with cognitive abilities (working memory capacity, short-term memory, switching ability, and reasoning), personality traits, and demographical aspects. Although further validation is needed, first results are promising and eKFA enriches cognitive failures research.

Adult age differences in inhibitory processes and their predictive validity for fluid intelligence.

According to the inhibition-deficit hypothesis age differences in working memory capacity and fluid intelligence have been attributed to a decline in inhibitory efficiency. Conceptualizing inhibition as multifaceted, 88 participants (49 younger and 39 elderly) completed two versions of the negative priming paradigm (identification and localization), and two variants of the directed forgetting paradigm (listwise and itemwise). Two tasks of the Wechsler Intelligence Test with high loadings on general fluid intelligence (Gf) served as validation criteria. Results revealed task-specific and speed-independent inhibitory deficits in the elderly (lower negative priming in both paradigms; more intrusions in the directed forgetting tasks), as well as higher levels of repetition priming. Significant correlations between measures of inhibition and the Wechsler scores were found in both age groups. Results support the view of multiple inhibitory-like capabilities that play a central role in the decline of higher-order cognitive functions in old age.

Individual differences in components of reaction time distributions and their relations to working memory and intelligence.

The authors bring together approaches from cognitive and individual differences psychology to model characteristics of reaction time distributions beyond measures of central tendency. Ex-Gaussian distributions and a diffusion model approach are used to describe individuals' reaction time data. The authors identified common latent factors for each of the 3 ex-Gaussian parameters and for 3 parameters central to the diffusion model using structural equation modeling for a battery of choice reaction tasks. These factors had differential relations to criterion constructs. Parameters reflecting the tail of the distribution (i.e., tau in the ex-Gaussian and drift rate in the diffusion model) were the strongest unique predictors of working memory, reasoning, and psychometric speed. Theories of controlled attention and binding are discussed as potential theoretical explanations.

Working memory and intelligence--their correlation and their relation: comment on Ackerman, Beier, and Boyle (2005).

On the basis of a meta-analysis of pairwise correlations between working memory tasks and cognitive ability measures, P. L. Ackerman, M. E. Beier, and M. O. Boyle (2005; see record 2004-22408-002) claimed that working memory capacity (WMC) shares less than 25% of its variance with general intelligence (g) and with reasoning ability. In this comment, the authors argue that this is an underestimation because of several methodological shortcomings and biases. A reanalysis of the data reported in Ackerman et al. using the correct statistical procedures demonstrates that g and WMC are very highly correlated. On a conceptual level, the authors point out that WMC should be regarded as an explanatory construct for intellectual abilities. Theories of working memory do not claim that WMC is isomorphic with intelligence factors but that it is a very strong predictor of reasoning ability and also predicts general fluid intelligence and g.