A dual RNA-seq analyses revealed dynamic arms race during the invasion of walnut by Colletotrichum gloeosporioides.

BACKGROUND: Walnut anthracnose caused by Colletotrichum gloeosporioides seriously endangers the yield and quality of walnut, and has now become a catastrophic disease in the walnut industry. Therefore, understanding both pathogen invasion mechanisms and host response processes is crucial to defense against C. gloeosporioides infection. RESULTS: Here, we investigated the mechanisms of interaction between walnut fruits (anthracnose-resistant F26 fruit bracts and anthracnose-susceptible F423 fruit bracts) and C. gloeosporioides at three infection time points (24hpi, 48hpi, and 72hpi) using a high-resolution time series dual transcriptomic analysis, characterizing the arms race between walnut and C. gloeosporioides. A total of 20,780 and 6670 differentially expressed genes (DEGs) were identified in walnut and C. gloeosporioides against 24hpi, respectively. Generous DEGs in walnut exhibited opposite expression patterns between F26 and F423, which indicated that different resistant materials exhibited different transcriptional responses to C. gloeosporioides during the infection process. KEGG functional enrichment analysis indicated that F26 displayed a broader response to C. gloeosporioides than F423. Meanwhile, the functional analysis of the C. gloeosporioides transcriptome was conducted and found that PHI, SignalP, CAZy, TCDB genes, the Fungal Zn (2)-Cys (6) binuclear cluster domain (PF00172.19) and the Cytochrome P450 (PF00067.23) were largely prominent in F26 fruit. These results suggested that C. gloeosporioides secreted some type of effector proteins in walnut fruit and appeared a different behavior based on the developmental stage of the walnut. CONCLUSIONS: Our present results shed light on the arms race process by which C. gloeosporioides attacked host and walnut against pathogen infection, laying the foundation for the green prevention of walnut anthracnose.

Testing Replicability and Generalizability of the Time on Task Effect.

The time on task (ToT) effect describes the relationship of the time spent on a cognitive task and the probability of successful task completion. The effect has been shown to vary in size and direction across tests and even within tests, depending on the test taker and item characteristics. Specifically, investing more time has a positive effect on response accuracy for difficult items and low ability test-takers, but a negative effect for easy items and high ability test-takers. The present study sought to test the replicability of this result pattern of the ToT effect across samples independently drawn from the same populations of persons and items. Furthermore, its generalizability was tested in terms of differential correlations across ability tests. To this end, ToT effects were estimated for three different reasoning tests and one test measuring natural sciences knowledge in 10 comparable subsamples with a total N = 2640. Results for the subsamples were highly similar, demonstrating that ToT effects are estimated with sufficient reliability. Generally, faster answers tended to be more accurate, suggesting a relatively effortless processing style. However, with increasing item difficulty and decreasing person ability, the effect flipped to the opposite direction, i.e., higher accuracy with longer processing times. The within-task moderation of the ToT effect can be reconciled with an account on effortful processing or cognitive load. By contrast, the generalizability of the ToT effect across different tests was only moderate. Cross-test relations were stronger in relative terms if performance in the respective tasks was more strongly related. This suggests that individual differences in the ToT effect depend on test characteristics such as their reliabilities but also similarities and differences of their processing requirements.

A Framework for Dynamic Composition and Management of Emergency Response Processes.

An emergency response process outlines the workflow of different activities that need to be performed in response to an emergency. Effective emergency response requires communication and coordination with the operational systems belonging to different collaborating organizations. Therefore, it is necessary to establish information sharing and system-level interoperability among the diverse operational systems. Unlike typical e-government processes that are well structured and have a well-defined outcome, emergency response processes are knowledge-centric and their workflow structure and execution may evolve as the incident unfolds. It is impractical to define static plans and response process workflows for every possible situation. Instead, a dynamic response should be adaptable to the changing situation. We present an integrated approach that facilitates the dynamic composition of an executable response process. The proposed approach employs ontology-based reasoning to determine the default actions and resource requirements for the given incident and to identify relevant response organizations based on their jurisdictional and mutual aid agreement rules. The Web service APIs of the identified response organizations are then used to generate an executable response process that evolves dynamically. The proposed approach is implemented and experimentally validated using an example scenario derived from the FEMA Hazardous Materials Tabletop Exercises Manual.

Evaluation of Response Processes to the Danish Version of the Dutch Multifactor Fatigue Scale in Stroke Using the Three-Step Test-Interview.

Validated self-report measures of post-stroke fatigue are lacking. The Dutch Multifactor Fatigue Scale (DMFS) was translated into Danish, and response process evidence of validity was evaluated. DMFS consists of 38 Likert-rated items distributed on five subscales: Impact of fatigue (11 items), Signs and direct consequences of fatigue (9), Mental fatigue (7), Physical fatigue (6), and Coping with fatigue (5). Response processes to DMFS were investigated using a Three-Step Test-Interview (TSTI) protocol, and data were analyzed using Framework Analysis. Response processes were indexed on the following categories: (i) "congruent," response processes were related to the subscale construct; (ii) "incongruent," response processes were not related to the subscale construct; (iii) "ambiguous," response processes were both congruent and incongruent or insufficient to evaluate congruency; and (iv) "confused," participants did not understand the item. Nine adults were recruited consecutively 10-34 months post-stroke (median = 26.5) at an outpatient brain injury rehabilitation center in 2019 [five females, mean age = 55 years (SD = 6.3)]. Problematic items were defined as <50% of response processes being congruent with the intended construct. Of the 38 items, five problematic items were identified, including four items of Physical fatigue and one of Mental fatigue. In addition, seven items posed various response difficulties to some participants due to syntactic complexity, vague terms, a presupposition, and a double-barrelled statement. In conclusion, findings elucidate the interpretative processes involved in responding to DMFS post-stroke, strengthen the evidence base of validity, and guide revisions to mitigate potential problems in item performance.

Measuring quality of life in life-threatening illness - content validity and response processes of MQOL-E and QOLLTI-F in Swedish patients and family carers.

BACKGROUND: The McGill Quality of Life Questionnaire - Expanded (MQOL-E) and the Quality of Life in Life-Threatening Illness-Family Carer/Caregiver version (QOLLTI-F) are developed for use with patients facing the end of life and their family carers, respectively. They are also developed for possible use as companion instruments. Contemporary measurement validity theory places emphasis on response processes, i.e. what people feel and think when responding to items. Response processes may be affected when measurement instruments are translated and adapted for use in different cultures. The aim of this study was to translate and examine content validity and response processes during completion of MQOL-E and QOLLTI-F version 2 (v2) among Swedish patients with life-threatening illness and their family carers. METHODS: The study was conducted in two stages (I) translation and adaptation (II) examination of content validity and response processes using cognitive interviews with 15 patients and 9 family carers. Participants were recruited from the hemodialysis unit, heart clinic, lung clinic and specialized palliative care of a Swedish county hospital. Patients had life-threatening illness such as advanced heart failure, advanced chronic obstructive pulmonary disease, end-stage kidney disease or advanced cancer. Patients were outpatients, inpatients or receiving home care. RESULTS: Patients and family carers respectively believed that the items of the MQOL-E and QOLLTI-F v2 reflect relevant and important areas of their quality of life. Although some items needed more time for reflection, both instruments were considered easy to understand. Some changes were made to resolve issues of translation. Participants expressed that reflecting on their situation while answering questions was valuable and meaningful to them, and that responding was an opportunity to express feelings. CONCLUSIONS: The results of response processes pertaining to the Swedish translations of both MQOL-E and QOLLTI-F v2 contribute evidence regarding content validity, linguistic equivalence and cultural appropriateness of the translated instruments. In addition, results show that the instruments may support conversations on matters of importance for quality of life between patients and/or family carers and health care professionals. Further research is needed to study the psychometric properties of Swedish translations.

Validating Test Score Interpretations Using Time Information.

A validity approach is proposed that uses processing times to collect validity evidence for the construct interpretation of test scores. The rationale of the approach is based on current research of processing times and on classical validity approaches, providing validity evidence based on relationships with other variables. Within the new approach, convergent validity evidence is obtained if a component skill, that is expected to underlie the task solution process in the target construct, positively moderates the relationship between effective speed and effective ability in the corresponding target construct. Discriminant validity evidence is provided if a component skill, that is not expected to underlie the task solution process in the target construct, does indeed not moderate the speed-ability relation in this target construct. Using data from a study that follows up the German PIAAC sample, this approach was applied to reading competence, assessed with PIAAC literacy items, and to quantitative reasoning, assessed with Number Series. As expected from theory, the effect of speed on ability in the target construct was only moderated by the respective underlying component skill, that is, word meaning activation skill as an underlying component skill of reading competence, and perceptual speed as an underlying component skill of reasoning. Accordingly, no positive interactions were found for the component skill that should not underlie the task solution process, that is, word meaning activation for reasoning and perceptual speed for reading. Furthermore, the study shows the suitability of the proposed validation approach. The use of time information in association with task results brings construct validation closer to the actual response process than widely used correlations of test scores.

Measuring Trust in Medical Researchers: Adding Insights from Cognitive Interviews to Examine Agree-Disagree and Construct-Specific Survey Questions.

While scales measuring subjective constructs historically rely on agree-disagree (AD) questions, recent research demonstrates that construct-specific (CS) questions clarify underlying response dimensions that AD questions leave implicit and CS questions often yield higher measures of data quality. Given acknowledged issues with AD questions and certain established advantages of CS items, the evidence for the superiority of CS questions is more mixed than one might expect. We build on previous investigations by using cognitive interviewing to deepen understanding of AD and CS response processing and potential sources of measurement error. We randomized 64 participants to receive an AD or CS version of a scale measuring trust in medical researchers. We examine several indicators of data quality and cognitive response processing including: reliability, concurrent validity, recency, response latencies, and indicators of response processing difficulties (e.g., uncodable answers). Overall, results indicate reliability is higher for the AD scale, neither scale is more valid, and the CS scale is more susceptible to recency effects for certain questions. Results for response latencies and behavioral indicators provide evidence that the CS questions promote deeper processing. Qualitative analysis reveals five sources of difficulties with response processing that shed light on under-examined reasons why AD and CS questions can produce different results, with CS not always yielding higher measures of data quality than AD.

Modeling Nonlinear Conditional Dependence Between Response Time and Accuracy.

The most common process variable available for analysis due to tests presented in a computerized form is response time. Psychometric models have been developed for joint modeling of response accuracy and response time in which response time is an additional source of information about ability and about the underlying response processes. While traditional models assume conditional independence between response time and accuracy given ability and speed latent variables (van der Linden, 2007), recently multiple studies (De Boeck and Partchev, 2012; Meng et al., 2015; Bolsinova et al., 2017a,b) have shown that violations of conditional independence are not rare and that there is more to learn from the conditional dependence between response time and accuracy. When it comes to conditional dependence between time and accuracy, authors typically focus on positive conditional dependence (i.e., relatively slow responses are more often correct) and negative conditional dependence (i.e., relatively fast responses are more often correct), which implies monotone conditional dependence. Moreover, most existing models specify the relationship to be linear. However, this assumption of monotone and linear conditional dependence does not necessarily hold in practice, and assuming linearity might distort the conclusions about the relationship between time and accuracy. In this paper we develop methods for exploring nonlinear conditional dependence between response time and accuracy. Three different approaches are proposed: (1) A joint model for quadratic conditional dependence is developed as an extension of the response moderation models for time and accuracy (Bolsinova et al., 2017b); (2) A joint model for multiple-category conditional dependence is developed as an extension of the fast-slow model of Partchev and De Boeck (2012); (3) An indicator-level nonparametric moderation method (Bolsinova and Molenaar, in press) is used with residual log-response time as a predictor for the item intercept and item slope. Furthermore, we propose using nonparametric moderation to evaluate the viability of the assumption of linearity of conditional dependence by performing posterior predictive checks for the linear conditional dependence model. The developed methods are illustrated using data from an educational test in which, for the majority of the items, conditional dependence is shown to be nonlinear.

Validación de un modelo de cuatro estrategias de resolución de ítems de razonamiento en una prueba estandarizada de selección / Validation of a Four-Strategies Model for Solving Reasoning Items in a Standardized Selection Test

Resumen La premisa de este estudio consiste en que un modelo cognitivo permite a las personas mejorar el desempeño en la resolución de preguntas de una prueba estandarizada donde el uso de estrategias tiene un papel crucial. El propósito de la investigación fue validar un modelo cognitivo con cuatro estrategias definidas por jueces expertos con base en los procesos de respuesta que subyacen a ítems de la Prueba de Aptitud Académica de la Universidad de Costa Rica (UCR). Se realizaron ocho en trevistas semiestructuradas a estudiantes de la UCR, quienes estaban cursando el primer año en esta institución y se aplicaron las técnicas de reporte verbal para obtener evidencias de los procesos de respuesta de los ítems. Se analizaron los reportes para comprobar la correspondencia entre el marco de las estrategias definidas previamente por jueces expertos y las respuestas dadas por los participan tes. Los resultados indicaron que los participantes siguieron las estrategias propuestas para la solu ción de las situaciones planteadas por los jueces; por tanto, los ítems son indicadores de los procesos subyacentes a estas estrategias. Estos hallazgos abren la posibilidad de implementar investigaciones con atributos presentes en cada estrategia propuesta de este estudio, que posibiliten predecir las pun tuaciones de la prueba en el rendimiento académico en la UCR

Abstract The premise of this study is that a cognitive model can increase students' performance for solving items on a stan dardized test, where strategies play a crucial role. The purpose of the study is to validate a cognitive model with four strategies defined by expert judges based on the response processes that underlie the items of the University of Costa Rica (UCR) Academic Aptitude Test. Eight semi-structured interviews were conducted with first-year students at UCR and the techniques of verbal reporting were applied to gather evidence of the items' response processes. The reports were analyzed to verify the correspondence between the framework of the strategies pre viously defined by expert judges and the answers given by the participants. In light of the results, it was concluded that the participants followed the proposed strategies for solving the situations posed, and, therefore, the items are indicators of the processes underlying these strategies. The results open the possibility of implementing research with attributes present in each strategy proposed in this study, which will allow predicting test scores in academic performance at the UCR.

Conditional Dependence between Response Time and Accuracy: An Overview of its Possible Sources and Directions for Distinguishing between Them.

With the widespread use of computerized tests in educational measurement and cognitive psychology, registration of response times has become feasible in many applications. Considering these response times helps provide a more complete picture of the performance and characteristics of persons beyond what is available based on response accuracy alone. Statistical models such as the hierarchical model (van der Linden, 2007) have been proposed that jointly model response time and accuracy. However, these models make restrictive assumptions about the response processes (RPs) that may not be realistic in practice, such as the assumption that the association between response time and accuracy is fully explained by taking speed and ability into account (conditional independence). Assuming conditional independence forces one to ignore that many relevant individual differences may play a role in the RPs beyond overall speed and ability. In this paper, we critically consider the assumption of conditional independence and the important ways in which it may be violated in practice from a substantive perspective. We consider both conditional dependences that may arise when all persons attempt to solve the items in similar ways (homogeneous RPs) and those that may be due to persons differing in fundamental ways in how they deal with the items (heterogeneous processes). The paper provides an overview of what we can learn from observed conditional dependences. We argue that explaining and modeling these differences in the RPs is crucial to increase both the validity of measurement and our understanding of the relevant RPs.

Autorreportes verbales en voz alta para la identificación de procesos de razonamiento en pruebas estandarizadas / Verbal Self-reporting to Identify Reasoning Processes in Standardized Tests

Resumen: Los estándares actuales, para la evaluación de la calidad psicométrica de las pruebas psicológicas y educativas, estipulan que una de las evidencias requeridas que justifican las inferencias derivadas de la aplicación de un test se refiere a las estrategias para contestar a los ítems que lo componen. Por lo tanto, el objetivo del presente artículo se propone presentar los resultados de una investigación, que consistió en la ejecución de entrevistas semiestructuradas a un conjunto de 15 estudiantes universi tarios de primer ingreso, cuyos reportes orales fueron analizados con el objetivo de fundamentar un conjunto de estrategias para contestar los ítems verbales de la Prueba de Aptitud Académica de la Universidad de Costa Rica, que habían sido identificadas previamente. Los resultados indican que efectivamente los participantes emplearon las estrategias propuestas, lo cual constituye una eviden cia de gran importancia sobre las habilidades de razonamiento que se miden con los ítems verbales de la Prueba de Aptitud Académica. Finalmente, se concluye con una discusión sobre los resultados acerca de la utilidad de los autorreportes verbales que recaban evidencias de validez para un test y sobre futuras investigaciones en esta línea.

Abstract: Current standards for assessing the psychometric quality of psychological and educational tests stip ulate that one indication required to justify the inferences derived from the application of a test are those related to answering strategies for the test items. Thus, this article presents the results of a study that involved the execution of semi-structured interviews with a group of 15 college freshmen, whose oral reports were analyzed to provide support for a set of strategies to answer previously identified verbal items from the "Academic Aptitude Test" (Prueba de Aptitud Académica) at the Universidad de Costa Rica. The results indicate that participants actually used the proposed strategies, which is important evidence about the reasoning skills measured by the Prueba de Aptitud Académica verbal items. Finally, we conclude with a discussion of the results, the usefulness of verbal self-reports to gather evidence for test validity and future research along these lines.

Perceptual and response interference in Alzheimer's disease and mild cognitive impairment.

OBJECTIVES: The ability to resolve conflicts is indispensable to the function of daily life and decreases with cognitive decline. We hypothesized that subjects with different levels of cognitive impairment exhibit different conflict resolution performances and may be susceptible to interference effects at different stages. METHODS: Sixteen normal controls (NC), 15 mild cognitive impairment (MCI) and seven Alzheimer's disease (AD) patients were recruited to perform in a modified Eriksen flanker task. RESULTS: We observed that the AD and MCI patients exhibited smaller accuracy rate and longer response time compared to NC subjects. Longer N2 and P300 latencies were observed in the AD group. Furthermore, the MCI group showed a longer latency than the NC group in the P300 latency. The magnitude of the perceptual and response interference effects was larger in the AD group than the other groups, and the MCI group significantly differed from the NC group at the perceptual level. CONCLUSION: The ability to resolve conflict decreased with impaired cognition and the perceptual and response interference effects may be useful in distinguishing MCI and AD. SIGNIFICANCE: The perceptual or response interference effect may potentially be employed as a useful non-invasive probe for the clinical diagnosis of MCI and AD.