Predicting student outcomes using digital logs of learning behaviors: Review, current standards, and suggestions for future work.

Using traces of behaviors to predict outcomes is useful in varied contexts ranging from buyer behaviors to behaviors collected from smart-home devices. Increasingly, higher education systems have been using Learning Management System (LMS) digital data to capture and understand students' learning and well-being. Researchers in the social sciences are increasingly interested in the potential of using digital log data to predict outcomes and design interventions. Using LMS data for predicting the likelihood of students' success in for-credit college courses provides a useful example of how social scientists can use these techniques on a variety of data types. Here, we provide a primer on how LMS data can be feature-mapped and analyzed to accomplish these goals. We begin with a literature review summarizing current approaches to analyzing LMS data, then discuss ethical issues of privacy when using demographic data and equitable model building. In the second part of the paper, we provide an overview of popular machine learning algorithms and review analytic considerations such as feature generation, assessment of model performance, and sampling techniques. Finally, we conclude with an empirical example demonstrating the ability of LMS data to predict student success, summarizing important features and assessing model performance across different model specifications.

"Looking at Myself in the Future": how mentoring shapes scientific identity for STEM students from underrepresented groups.

BACKGROUND: Mentorship has been well-established in the literature as fostering scientific identity and career pathways for underrepresented minority students in science, technology, engineering, and mathematics (STEM) fields. Mentorship is prioritized by programs that aim to increase diversity and support future leadership in STEM fields, but in-depth understanding of mentorship in these contexts remains limited. Drawing on qualitative interview data, we sought to understand the relationship between mentoring and scientific identity among a diverse sample of 24 students in one such program, in order to inform program development. RESULTS: Qualitative analysis of the data revealed that mentorship, especially research mentorship, was common and played a role in formation of scientific identity. Students with research mentors tended to say they strongly identified as scientists, whereas those who lacked research mentorship varied in their level of scientific identity. In interviews, research-mentored students described mentors as colleagues who gave them opportunities to grow and as examples to look up to. Students valued mentors with whom they identified on the basis of demographic similarity or shared values, as well as those who challenged them in their academic and research endeavors. CONCLUSIONS: Our analysis highlights how different mentoring experiences can contribute to development of future STEM leadership. We discuss implications for practice, including the need for tailored mentoring approaches and research-focused mentoring, and offer several recommendations for research and programming.

When people estimate their personal intelligence who is overconfident? Who is accurate?

OBJECTIVE: We explore accurate self-knowledge versus overconfidence in personal intelligence-a "broad" intelligence about personality. The theory of personal intelligence proposes that people vary in their ability to understand the traits, goals, plans, and actions of themselves and others. We wondered who accurately knew that they were higher in personal intelligence and who did not, and whether individuals with more accurate estimates were distinguishable from others in their psychological characteristics. METHOD: Three archival data sets were identified that included both self-estimates and objective measures of personal intelligence: The measures were the Self-Estimated Personal Intelligence scale and the Test of Personal Intelligence. RESULTS: People who were over-confident-overestimating their ability-level of personal intelligence-were positive in their outlook and more sociable. People who provided the most accurate self-estimates were higher in verbal and personal intelligences, more open, and more conscientious than others. CONCLUSIONS: People who were accurate about themselves have not been studied before in this context but may, for example, serve as the monitors and thinkers who help keep themselves and others reasonable and on track.

Advancing the Measurement of Personal Intelligence with the Test of Personal Intelligence, Version 5 (TOPI 5).

People use their personal intelligence (PI) to understand personality in themselves and others. In Studies 1 and 2 (Ns = 961 and 548), individuals completed the Test of Personal Intelligence, Version 5 (TOPI 5), which is introduced here. The TOPI 5 is an ability assessment with a broader range of content and more challenging items than earlier test versions. In past research, factor analyses indicated that people employ two distinct but highly correlated abilities to problem-solve in this area. These two-factor models, however, exhibited instabilities and limited applicability between the TOPI 4 and 5 in this research (and as reported in the Supplementary Materials). In Study 3, we successfully test the one-factor models of the TOPI with the present data and archival data sets (Narchival = 19,627). We then use the one-factor models to develop a pair of new test forms: one that is compatible with all the TOPI test versions and another, TOPI 5E, that is better at distinguishing among people scoring in the higher range of performance relative to previous measures.

Examining first-generation college student lived experiences with microaggressions and microaffirmations at a predominately White public research university.

OBJECTIVES: Studies have described the experiences of racial microaggressions in everyday life and on college campuses, yet prior research has not explored how microaggressions and microaffirmations are experienced by students who are first in their family to attend college. METHOD: This qualitative investigation of 296 open-ended survey responses described the lived experiences of first-generation college students at a large, public, predominately White institution. RESULTS: Students experienced microaggressions in the form microinsults, microassaults, and microinvalidations, and microaffirmations in the form of microsupports, microcompliments, and microvalidations on campus. CONCLUSIONS: Study implications include the development and implementation of regular positive and intentional communications by faculty, staff, and peers on college campuses. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Employees High in Personal Intelligence Differ From Their Colleagues in Workplace Perceptions and Behavior.

Personal intelligence (PI) involves the ability to recognize, reason, and use information about personality to understand oneself and other people. Employees in two studies (Ns = 394, 482) completed the Test of Personal Intelligence (TOPI; e.g., Mayer, Panter, & Caruso, 2017a) and assessments of workplace perception and behavior. Higher PI was associated with higher perceived workplace support and lower counterproductive work behavior. These relationships continued to hold after controlling for other key variables. The results indicate the TOPI, although still in research trials, shows promise as a screening device for selecting employees and targeting individuals for training.

Estimating HIV Medication Adherence and Persistence: Two Instruments for Clinical and Research Use.

Antiretroviral therapy (ART) requires lifelong daily oral therapy. While patient characteristics associated with suboptimal ART adherence and persistence have been described in cohorts of HIV-infected persons, these factors are poor predictors of individual medication taking behaviors. We aimed to create and test instruments for the estimation of future ART adherence and persistence for clinical and research applications. Following formative work, a battery of 148 items broadly related to HIV infection and treatment was developed and administered to 181 HIV-infected patients. ART adherence and persistence were assessed using electronic monitoring for 3 months. Perceived confidence in medication taking and self-reported barriers to adherence were strongest in predicting non-adherence over time. Barriers to adherence (e.g., affordability, scheduling) were the strongest predictors of non-adherence, as well as 3- and 7-day non-persistence. A ten-item battery for prediction of these outcomes ( www.med.unc.edu/ncaidstraining/adherence/for-providers ) and a 30-item battery reflective of underlying psychological constructs can help identify and study individuals at risk for suboptimal ART adherence and persistence.

Moral character in the workplace.

Using two 3-month diary studies and a large cross-sectional survey, we identified distinguishing features of adults with low versus high levels of moral character. Adults with high levels of moral character tend to: consider the needs and interests of others and how their actions affect other people (e.g., they have high levels of Honesty-Humility, empathic concern, guilt proneness); regulate their behavior effectively, specifically with reference to behaviors that have positive short-term consequences but negative long-term consequences (e.g., they have high levels of Conscientiousness, self-control, consideration of future consequences); and value being moral (e.g., they have high levels of moral identity-internalization). Cognitive moral development, Emotionality, and social value orientation were found to be relatively undiagnostic of moral character. Studies 1 and 2 revealed that employees with low moral character committed harmful work behaviors more frequently and helpful work behaviors less frequently than did employees with high moral character, according to their own admissions and coworkers' observations. Study 3 revealed that adults with low moral character committed more delinquent behavior and had more lenient attitudes toward unethical negotiation tactics than did adults with high moral character. By showing that individual differences have consistent, meaningful effects on employees' behaviors, after controlling for demographic variables (e.g., gender, age, income) and basic attributes of the work setting (e.g., enforcement of an ethics code), our results contest situationist perspectives that deemphasize the importance of personality. Moral people can be identified by self-reports in surveys, and these self-reports predict consequential behaviors months after the initial assessment.

Mental models at work: cognitive causes and consequences of conflict in organizations.

This research investigated the reciprocal relationship between mental models of conflict and various forms of dysfunctional social relations in organizations, including experiences of task and relationship conflicts, interpersonal hostility, workplace ostracism, and abusive supervision. We conceptualize individual differences in conflict construals as reflecting variation in people's belief structures about conflict and explore how different elements in people's associative networks-in particular, their beliefs about their best and worst strategy in conflict-relate to their personality, shape their experiences of workplace conflict, and influence others' behavioral intentions toward them. Five studies using a variety of methods (including cross-sectional surveys, a 12-week longitudinal diary study, and an experiment) show that the best strategy beliefs relate in theoretically meaningful ways to individuals' personality, shape social interactions and relationships significantly more than the worst strategy beliefs, and are updated over time as a result of individuals' ongoing experiences of conflict.

The growing significance of hot intelligences.

Comments on the original article, "Intelligence: New findings and theoretical developments," by R. E. Nisbett, J. Aronson, C. Blair, W. Dickens, J. Flynn, D. F. Halpern, and E. Turkheimer (see record 2011-30298-001). The present authors note that Nisbett et al's review focuses on intelligences that have been topics of research through the 20th century. Since then, however, attention to a new group of intelligences that the present authors refer to as "hot intelligences" has been growing (Mayer, Salovey, & Caruso, 2004). Although Nisbett et al (2012) mentioned potential newcomers to the group of intelligences, such as practical intelligence, the present authors feel that future reviews should consider the burgeoning research in new conceptions of intelligence. Here the authors express a rationale for including a consideration of these newly described intelligences.

Does personal intelligence exist? Evidence from a new ability-based measure.

Personal intelligence has been defined as the ability to reason about personality and personality-relevant information and to use that information to guide one's actions and more generally, one's life. We constructed an initial version of an ability-based measure to test whether personal intelligence can be measured and whether it exists as a unitary intelligence. In 3 studies (N = 241, 308, and 385), we administered this Test of Personal Intelligence (TOPI), composed of 4 sections, to undergraduates along with criterion measures. Results suggested that a personal intelligence can be measured, that it might exist as a unified area of mental abilities, and that it represents psychological qualities that have intriguing predictive aspects.

An item factor analysis and item response theory-based revision of the Everyday Discrimination Scale.

The Everyday Discrimination Scale (EDS), a widely used measure of daily perceived discrimination, is purported to be unidimensional, to function well among African Americans, and to have adequate construct validity. Two separate studies and data sources were used to examine and cross-validate the psychometric properties of the EDS. In Study 1, an exploratory factor analysis was conducted on a sample of African American law students (N = 589), providing strong evidence of local dependence, or nuisance multidimensionality within the EDS. In Study 2, a separate nationally representative community sample (N = 3,527) was used to model the identified local dependence in an item factor analysis (i.e., bifactor model). Next, item response theory (IRT) calibrations were conducted to obtain item parameters. A five-item, revised-EDS was then tested for gender differential item functioning (in an IRT framework). Based on these analyses, a summed score to IRT-scaled score translation table is provided for the revised-EDS. Our results indicate that the revised-EDS is unidimensional, with minimal differential item functioning, and retains predictive validity consistent with the original scale.

The culture of time in neuropsychological assessment: exploring the effects of culture-specific time attitudes on timed test performance in Russian and American samples.

Cultural differences in time attitudes and their effect on timed neuropsychological test performance were examined in matched non-clinical samples of 100 Russian and American adult volunteers using 8 tests that were previously reported to be relatively free of cultural bias: Color Trails Test (CTT); Ruff Figural Fluency Test (RFFT); Symbol Digit Modalities Test (SDMT); and Tower of London-Drexel Edition (ToL(Dx)). A measure of time attitudes, the Culture of Time Inventory (COTI-33) was used to assess time attitudes potentially affecting time-limited testing. Americans significantly outscored Russians on CTT, SDMT, and ToL(Dx) (p,.05) while differences in RFFT scores only approached statistical significance. Group differences also emerged in COTI-33 factor scores, which partially mediated differences in performance on CTT-1, SDMT, and ToL(Dx) initiation time, but did not account for the effect of culture on CTT-2. Significant effect of culture was revealed in ratings of familiarity with testing procedures that was negatively related to CTT, ToL(Dx), and SDMT scores. Current findings indicated that attitudes toward time may influence results of time limited testing and suggested that individuals who lack familiarity with timed testing procedures tend to obtain lower scores on timed tests.

Introducing the GASP scale: a new measure of guilt and shame proneness.

Although scholars agree that moral emotions are critical for deterring unethical and antisocial behavior, there is disagreement about how 2 prototypical moral emotions--guilt and shame--should be defined, differentiated, and measured. We addressed these issues by developing a new assessment--the Guilt and Shame Proneness scale (GASP)--that measures individual differences in the propensity to experience guilt and shame across a range of personal transgressions. The GASP contains 2 guilt subscales that assess negative behavior-evaluations and repair action tendencies following private transgressions and 2 shame subscales that assess negative self-evaluations (NSEs) and withdrawal action tendencies following publically exposed transgressions. Both guilt subscales were highly correlated with one another and negatively correlated with unethical decision making. Although both shame subscales were associated with relatively poor psychological functioning (e.g., neuroticism, personal distress, low self-esteem), they were only weakly correlated with one another, and their relationships with unethical decision making diverged. Whereas shame-NSE constrained unethical decision making, shame-withdraw did not. Our findings suggest that differentiating the tendency to make NSEs following publically exposed transgressions from the tendency to hide or withdraw from public view is critically important for understanding and measuring dispositional shame proneness. The GASP's ability to distinguish these 2 classes of responses represents an important advantage of the scale over existing assessments. Although further validation research is required, the present studies are promising in that they suggest the GASP has the potential to be an important measurement tool for detecting individuals susceptible to corruption and unethical behavior.

Corticosteroids' effect on the height of atopic dermatitis patients: a controlled questionnaire study.

To investigate if children treated with topical corticosteroids have a significantly shorter height than the height of children not treated with corticosteroids and to see if corticosteroids affect the ability for treated children to meet growth potential defined as midparental height. Parents of patients attending the UNC's Dermatology clinic completed the survey. The patient's height and siblings' heights were measured by staff. Parents' heights were self reported as were the child's diagnosis of atopic dermatitis, and duration of use of corticosteroids. The patient's height was standardized using CDC charts. Additionally, the midparental height was calculated and standardized. The difference between present and predicted standardized heights was calculated; 151 surveys yielded data on 83 girls and 63 boys (ages 2-21 yrs). The standing height and the difference in standing height and midparental scores were not significantly different among: (i) children with and without atopic dermatitis; and (ii) children treated and not treated with corticosteroids. The overall height of children examined in this survey who were treated with topical corticosteroids appears to be unaffected.

It matters how and when you ask: self-reported race/ethnicity of incoming law students.

The high-stakes nature of law school testing and admissions puts a premium on the student data presented to admissions committees, such as essays, academic and work history, and student background characteristics including race/ethnicity. 4,472 law school-bound students self-identified their race/ethnicity using (a) a mutually exclusive "choose one" format during registration for the law school admissions test, and (b) an elaborated "check-all-that-apply" format as part of a national survey administered during the first weeks at their chosen law school. Student multiraciality that was masked by the first assessment was associated with self-reported ethnic identity, discrimination experience, intergroup contact, race-related attitudes, academic performance, and trait ratings, as compared to monoracial majority students. A different profile of findings was observed across these constructs when multiracial students were compared to monoracial majority students, to monoracial minority students, and within group. These correlates also predicted the likelihood of changing identification across the two assessment contexts. These findings support the continued study of specific combinations of multiracial groups, fluidity of multiracial identities, and context effects that influence race/ethnicity self-categorizations.

The Effects of Educational Diversity in a National Sample of Law Students: Fitting Multilevel Latent Variable Models in Data With Categorical Indicators.

Controversy surrounding the use of race-conscious admissions can be partially resolved with improved empirical knowledge of the effects of racial diversity in educational settings. We use a national sample of law students nested in 64 law schools to test the complex and largely untested theory regarding the effects of educational diversity on student outcomes. Social scientists who study these outcomes frequently encounter both latent variables and nested data within a single analysis. Yet, until recently, an appropriate modeling technique has been computationally infeasible, and consequently few applied researchers have estimated appropriate models to test their theories, sometimes limiting the scope of their research question. Our results, based on disaggregated multilevel structural equation models, show that racial diversity is related to a reduction in prejudiced attitudes and increased perceived exposure to diverse ideas and that these effects are mediated by more frequent interpersonal contact with diverse peers. These findings provide support for the idea that administrative manipulation of educational diversity may lead to improved student outcomes. Admitting a racially/ethnically diverse student body provides an educational experience that encourages increased exposure to diverse ideas and belief systems.

The relationship between spirituality and depressive symptoms: testing psychosocial mechanisms.

Although many studies suggest lower rates of depressive symptoms in those who report greater spirituality, few have investigated the mechanisms by which spirituality might relate to depressive symptoms. The current study aimed to elucidate potential psychosocial mechanisms that link these 2 variables. Data were drawn from a community-dwelling stratified sample of 630 racially diverse adults in rural North Carolina. Spirituality was assessed by 6 items of the Daily Spiritual Experiences Scale. Depressive symptoms were measured using 4 subscales from the Center for Epidemiological Studies-Depression. Hypothesized mediators were optimism, volunteering, and perceived social support. Structural equation modeling was used to test whether proposed mediators explain a link between spirituality and depressive symptoms. The model demonstrated a satisfactory fit. Spirituality was indirectly related to depressive symptoms. More specifically, spirituality was significantly associated with optimism and volunteering but not with social support, and optimism, volunteering and perceived social support were significantly associated with depressive symptoms. The link between spirituality and depressive symptoms is indirect. The relationship is mediated by optimism, volunteering, and social support. Findings present research and practice implications.

Spirituality and depressive symptoms in a racially diverse US sample of community-dwelling adults.

The role of spirituality in depression is understudied. We examined the relationship between one dimension of spirituality, spiritual experiences, and depressive symptoms, and evaluated whether differences in gender, race, age, and stress moderated the relationship. The study was conducted with a community-based sample of 630 racially diverse middle-aged and older adults. Structural equation modeling was used to estimate a model linking spiritual experiences to depressive symptoms while controlling for demographic and health variables. Spiritual experiences were operationalized using six items of the Daily Spiritual Experiences Scale. Sample items included, "I feel God's presence," and, "I feel comfort in my religion or spirituality." The model achieved satisfactory goodness of fit. Spiritual experiences were significantly associated with fewer depressive symptoms, and age as well as stress moderated the association, but not gender and race. Spirituality appears to be a psychosocial resource against depressive symptoms, although the results must be confirmed in longitudinal investigations.

Factors associated with potentially inappropriate drug utilization in a sample of rural community-dwelling older adults.

BACKGROUND: Many medications present special risks when used by older adults (ie, those aged > or = 65 years) and are considered potentially inappropriate for this population. The Beers criteria are often used to identify such medications. Past research has documented that use of Beers drugs is common among older adults. OBJECTIVE: The aim of this work was to examine factors associated with potentially inappropriate drug use among rural community-dwelling older adults using a conceptual framework adapted from the Andersen-Newman behavioral model of health service use. METHODS: This was a population-based, cross-sectional survey. Data were collected via face-to-face home interviews between 2002 and 2004. Rural community-dwelling older adults residing in a single county in North Carolina were eligible. Potentially inappropriate drug use was operationalized using the Beers criteria. Data concerning predisposing (ie, age, sex, race, education, and marital status), enabling (ie, social support and insurance status), need (ie, disability and history of major depression, hypertension, osteoarthritis, back problems, or other comorbidities), and utilization factors (ie, number of medications used) were collected. RESULTS: Data were gathered from 892 people, with information on medication use available for 800. Two hundred thirteen of these 800 participants (26.6%) used > or = 1 Beers drug. Compared with individuals who used no Beers drugs, those who used > or = 1 Beers drug reported lower levels of social support (odds ratio [OR], 0.94; 95% CI, 0.90-0.99) and higher levels of disability (OR, 1.48; 95% CI, 1.11-1.97), used more medications (OR, 1.07; 95% CI, 1.01-1.13), and were more likely to have a history of major depression (OR, 1.67; 95% CI, 1.05-2.66), hypertension (OR, 1.58; 95% CI, 1.07-2.33), osteoarthritis (OR, 1.58; 95% CI, 1.09-2.29), and back problems (OR, 1.72; 95% CI, 1.19-2.47). CONCLUSION: As suggested by the Andersen-Newman model, the risk of potentially inappropriate drug use is highest among those with the greatest medication needs, as evidenced by poorer health status in this sample of rural community-dwelling older patients.