Psychometric property and measurement invariance of perceived benefits and barriers of physical activity in Chinese adolescents.

Background: The perceived benefits and barriers to physical activity play crucial roles in determining daily physical activity levels. However, previous studies have employed tools lacking adequate validation, leading to inconsistent conclusions about the impact of these two factors. Therefore, this national, population-based study was conducted to assess the psychometric properties, measurement invariance, and predictive validity of the Chinese versions of the perceived benefits (C-PBEPA) and barriers to physical activity (C-PBAPA) scales. Methods: The final sample (N = 2942, 49.3 % for boys) was randomly split into two subsamples. The first subsample was used for exploratory factor analysis and the second subsample was used for confirmatory factor analysis. Measurement invariance across gender and age groups were examined. Structural equation models were developed to examine the predictive validity of the revised C-PBEPA and C-PBAPA on moderate to vigorous PA. Results: The results showed that both scales were unidimensional, had excellent model fit (e.g., X 2/df < 3, CFI >0.9, RMSEA <0.06) and demonstrated convergent validity. Findings also revealed lack of scalar invariance for C-PBAPA between preadolescents and adolescents' groups (ΔCFI >0.01) and supported the predictive validity of both scales (p < 0.001). Conclusion: The study demonstrated that the revised C-PBEPA and C-PBAPA are valid scales for measuring Chinese adolescents' perceived benefits and barriers to PA.

Chlordiazepoxide reduces anxiety-like behavior in the adolescent mouse elevated plus maze: A pharmacological validation study.

This report evaluates the effects of chlordiazepoxide, a benzodiazepine commonly prescribed to manage anxiety-related disorders in adolescent/pediatric populations, on elevated plus maze (EPM) performance in juvenile mice. This approach was taken because chlordiazepoxide produces anxiolytic-like effects in multiple models in adult rodents, however, less is known about the behavioral effects of this benzodiazepine in juveniles. Thus, we administered a single intraperitoneal injection of chlordiazepoxide (0, 5, or 10 mg/kg) to postnatal day 35 male C57BL/6 mice. Thirty minutes later, mice were allowed to explore the EPM for 5-min. We found that chlordiazepoxide-treated mice (5 and 10 mg/kg) spent more time exploring the open arms of the EPM. No differences in velocity (cm/s) or distance traveled (cm) were observed between the groups. These results indicate that chlordiazepoxide induces anxiolytic-related behavior in adolescent male mice.

Identifying vulnerable mother-infant dyads: a psychometric evaluation of two observational coding systems using varying interaction periods.

Introduction: Clinical services require feasible assessments of parent-infant interaction in order to identify dyads requiring parenting intervention. We assessed the reliability and predictive validity of two observational tools and tested whether briefer forms could be identified which retain acceptable psychometric properties over short observation periods. Methods: A stratified high-risk community sample of 250 mother-infant dyads from The Wirral Child Health and Development Study completed 7-min play-based interaction at 6-8 months. Film-footage was independently coded by two trained raters using PIIOS and NICHD-SECCYD systems. Incremental predictive validity was assessed from 3, 5 and 7 min observation to attachment outcomes (Strange Situation; 14 months) and infant mental health (BITSEA; 14 and 30 months). Results: Excellent inter-rater reliability was evident at code and subscale level for each tool and observation period. Stability of within-rater agreement was optimal after 5 min observation. ROC analysis confirmed predictive (discriminant) validity (AUCs >0.70) to top decile age 2 mental health outcomes for PIIOS total score and a brief 3-item composite from NICHD-SECCYD (sensitivity, intrusiveness, positive regard; NICHD-3), but not to attachment outcomes. Logistic regression showed dyads rated at-risk for externalizing problems using NICHD-3 were also at significantly higher risk for insecurity at 14 months (OR = 2.7, p = 0.004). Conclusion: PIIOS total and NICHD-3 ratings from 5 min observation are both reliable and valid tools for use in clinical practice. Findings suggest NICHD-3 may have greater utility due to its comparative brevity to train and code, with suitability for use over a broader developmental time frame (3-24 months).

Predictive validity of Lupus Patient-Reported Outcome for damage accrual in patients with systemic lupus erythematosus: the LUNA Registry.

OBJECTIVES: The predictive validity of disease-specific quality of life (QOL) remains unknown in patients with systemic lupus erythematosus (SLE), although disease-specific measures are equally or more responsive to changes than generic QOL. We aimed to examine the predictive validity of the Lupus patient-reported outcome (PRO) for damage accrual. METHODS: Patients with SLE and ≥2 measurements over time were included in Japanese nationwide multicentre registry (LUNA). The Lupus PRO questionnaire contains both health-related (HR) and non-HR-QOL measures. Damage accrual was evaluated using the Systemic Lupus International Collaborating Clinics/American College of Rheumatology Damage Index (SDI). We examined the association between the Lupus-PRO score at baseline and longitudinal SDI scores using mixed-effects models adjusted for prognostic factors. RESULTS: Among 1295 patients, those with higher HR-QOL of Lupus PRO at baseline demonstrated a significantly lower increase in SDI (-0.005/year, 95% confidence interval [CI]: -0.007 to - 0.004, p < 0.001). According to the categorisation of HR-QOL based on tertile, a similar dose-dependent effect of HR-QOL on longitudinal SDI was identified (second vs first tertile category: -0.101/year, 95% CI: -0.172 to - 0.030; third tertile category: -0.211/year, 95% CI: -0.281 to - 0.142). Non-HR-QOL was not significantly associated with the SDI scores. Among the HR-QOL domains, cognition, procreation, and physical health were significantly associated with the total SDI scores over time. HR-QOL was associated with corticosteroid-dependent and -independent SDI scores. CONCLUSION: A higher HR-QOL of Lupus PRO was associated with a lower increase in SDI scores. Our findings imply the importance of disease-specific HR-QOL measurements in assessing prognosis.

Identification of youth at clinical high-risk for psychosis: A community-based study from India.

AIM: A two-stage process, wherein self-report screening precedes the structured interview, is suggested for identifying individuals at clinical high-risk for psychosis (CHR-P) in community samples. Aim of this study was to screen a community youth sample from India for CHR-P using the two-stage method. Specific objectives were to assess concordant validity of the self-report measure and predictive validity of the two-stage method. METHODS: Based on probability sampling, 2025 youth aged 15-24 years were recruited from one rural and one urban area of Telangana, a Telugu-speaking state in India. Telugu version of the PRIME Screen-Revised (PS-R) and structured interview for psychosis-risk syndromes (SIPS) were used. CHR-P positive and negative cohorts were followed-up for transition to psychosis at 3-monthly intervals. RESULTS: One hundred ten individuals screened positive on PS-R. SIPS conducted on 67 out of 110 individuals confirmed 62 (92.54%) to be CHR-P positive. PS-R showed 98.41% sensitivity and 90.74% specificity. Among CHR-P positive, three participants transitioned to psychosis in 15 months. The hazard ratio for psychosis transition was 11.4. CONCLUSIONS: Screening accuracy of PS-R in the community youth sample in Telangana is optimum. The hazard ratio for psychosis transition in the community identified CHR-P indicates good predictive validity for the two-stage method.

ICD-11 and DSM-5-TR prolonged grief symptoms and quality of life: A criterion validity test.

OBJECTIVE: Two similar but distinct versions of prolonged grief disorder (PGD) have recently been included in the International Classification of Diseases eleventh edition (ICD-11) and the Diagnostic and Statistical Manual of Mental Disorders - fifth edition, Text-Revision (DSM-5-TR). This study provides a criterion validity test of both new criteria sets of PGD, by examining concurrent and longitudinal associations of ICD-11 and DSM-5-TR prolonged grief symptoms with quality of life (QOL). METHODS: Bereaved adults completed a survey assessing ICD-11 and DSM-5-TR prolonged grief symptoms, depressive symptoms, insomnia symptoms and QOL at baseline and 6-month follow-up. RESULTS: Both ICD-11 and DSM-5-TR prolonged grief symptoms related negatively to QOL concurrently, while controlling for insomnia and depressive symptoms. ICD-11 prolonged grief symptoms, but not DSM-5-TR prolonged grief symptoms, predicted QOL at 6-month follow-up, while controlling for baseline QOL and insomnia and depression symptoms. CONCLUSIONS: Results provide consistent evidence for the criterion validity of ICD-11 PGD, but mixed evidence for the criterion validity of DSM-5-TR PGD. Study results can help guide attempts to optimize and harmonize future PGD criteria.

Examining Trajectories of Change on the Dynamic Risk Assessment for Offender Re-Entry (DRAOR).

Dynamic risk scales have largely been evaluated using singular assessment scores, including those obtained at the start of supervision. While this approach includes assessment of dynamic factors, it ignores changes with reassessment, failing to examine whether an instrument is truly dynamic in nature. This is problematic, as proximal risk assessments have consistently outperformed baseline assessments in the prediction of recidivism. In the current study, we examined the dynamic properties of the Dynamic Risk Assessment for Offender Reentry (DRAOR) in 4,736 adults on community supervision in Iowa, United States (N = 33,965 assessments). As expected, while clients demonstrated statistically significant changes on the DRAOR domains over time, changes were small in magnitude. We also examined the predictive validity of baseline and proximal DRAOR total and domain scores on criminal recidivism and revocation in a larger sample of 11,421 adults in the same jurisdiction. While DRAOR baseline scores did predict both outcomes, prediction did not improve with proximal scores. This conflicted with expected findings from previous research on the DRAOR in New Zealand. The results of both of these research questions indicate there was an overall lack of change reflected in this sample. Potential issues regarding implementation fidelity are discussed. Additional research is needed to examine the dynamic properties of the DRAOR in Iowa given the importance of reassessment data in community corrections.

No End in Sight; Assessing the Impact of Internet Gaming Disorder on Digital Eye Strain Symptoms and Academic Success.

BACKGROUND: Internet Gaming Disorder (IGD) has been associated with symptoms of Digital Eye Strain (DES) and poor academic performance among adolescent students. The purpose of this study is to assess whether a student's achievement of a specific academic goal within a short period of time can be directly predicted by symptoms of IGD and DES. METHODS: This is a cross-sectional survey of 140 high school graduates who received an examination of visual acuity as a pre-requisite for entering the written admission examinations of law enforcement and military academies. The students completed the Digital Eye Strain Questionnaire (DESQ) and the Ten-Item Internet Gaming Disorder Test (IGDT-10) and stated their own evaluation of their chances for success. They were contacted following their admission examinations, and their success or failure to be admitted was recorded. RESULTS: The students with IGD symptomatology were more likely to present with symptoms of DES. They were also more pessimistic about their chances of success in the subsequent written admission examinations; none succeeded, while the rest of the students recorded an expected rate of success. A combination of IGD and complaints related to the prolonged fixation of the upper body in a specific viewing position was the best predictor variable set for future success in admission examinations. CONCLUSIONS: IGD is associated with a failure to achieve academic success. Combining a factor for physical discomfort during prolonged sessions of gaming with the typical criteria for IGD may expand the predictive validity of the construct of gaming disorder.

The validity of the selection methods for recruitment to UK core psychiatry training: cohort study.

AIMS AND METHOD: Selection into core psychiatry training in the UK uses a computer-delivered Multi-Specialty Recruitment Assessment (MSRA; a situational judgement and clinical problem-solving test) and, previously, a face-to-face Selection Centre. The Selection Centre assessments were suspended during the COVID-19 pandemic. We aimed to evaluate the validity of this selection process using data on 3510 psychiatry applicants. We modelled the ability of the selection scores to predict subsequent performance in the Clinical Assessment of Skills and Competencies (CASC). Sensitivity to demographic characteristics was also estimated. RESULTS: All selection assessment scores demonstrated positive, statistically significant, independent relationships with CASC performance and were sensitive to demographic factors. IMPLICATIONS: All selection components showed independent predictive validity. Re-instituting the Selection Centre assessments could be considered, although the costs, potential advantages and disadvantages should be weighed carefully.

Metabotropic Glutamate Receptor 4 (mGlu4) Positive Allosteric Modulators Lack Efficacy in Rat and Marmoset Models of L-DOPA-Induced Dyskinesia.

Background: Increased activity across corticostriatal glutamatergic synapses may contribute to L-DOPA-induced dyskinesia in Parkinson's disease. Given the weak efficacy and side-effect profile of amantadine, alternative strategies to reduce glutamate transmission are being investigated. Metabotropic glutamate receptor 4 (mGlu4) is a promising target since its activation would reduce glutamate release. Objective: We hypothesized that two mGlu4 positive allosteric modulators, Lu AF21934 ((1 S,2 R)-N1-(3,4-dichlorophenyl)cyclohexane-1,2-dicarboxamide) and ADX88178 (5-Methyl-N-(4-methylpyrimidin-2-yl)-4-(1H-pyrazol-4-yl)thiazol-2-amine), would provide relief in rat and primate models of L-DOPA-induced dyskinesia. Methods: The ability of Lu AF21934 or ADX88178 to reverse pre-established dyskinesia was examined in L-DOPA-primed 6-hydroxydopamine-lesioned rats expressing abnormal involuntary movements (AIMs) or in 1-methyl-4-phenyl,1,2,3,6-tetrahydropyridine (MPTP)-treated common marmosets expressing L-DOPA-induced dyskinesia. Additionally, the ability of Lu AF21934 to prevent the development of de novo L-DOPA-induced AIMs was explored in the 6-hydroxydopamine-lesioned rats. Results: Neither Lu AF21934 (10 or 30 mg/kg p.o.) nor ADX88178 (10 or 30 mg/kg p.o.) reduced pre-established AIMs in 6-hydroxydopamine-lesioned rats. Similarly, in L-DOPA-primed common marmosets, no reduction in established dyskinesia was observed with Lu AF21934 (3 or 10 mg/kg p.o.). Conversely, amantadine significantly reduced (>40%) the expression of dyskinesia in both models. Lu AF21934 also failed to suppress the development of AIMs in 6-hydroxydopamine-lesioned rats. Conclusions: This study found no benefit of mGlu4 positive allosteric modulators in tackling L-DOPA-induced dyskinesia. These findings are concordant with the recent failure of foliglurax in phase II clinical trials supporting the predictive validity of these pre-clinical dyskinesia models, while raising further doubt on the anti-dyskinetic potential of mGlu4 positive allosteric modulators.

Validity across four common street-crossing distraction indicators to predict pedestrian safety.

BACKGROUND: Multiple distraction indicators have been applied to measure street-crossing distraction but their validities in predicting pedestrian safety are poorly understood. METHODS: Based on a video-based observational study, we compared the validity of four commonly used distraction indicators (total duration of distraction while crossing a street, proportion of distracted time over total street-crossing time, duration of the longest distraction time, and total number of distractions) in predicting three pedestrian safety outcomes (near-crash incidence, frequency of looking left and right, and speed crossing the street) across three types of distraction (mobile phone use, talking to other pedestrians, eating/drinking/smoking). Change in Harrell's C statistic was calculated to assess the validity of each distraction indicator based on multivariable regression models including only covariates and including both covariates and the distraction indicator. RESULTS: Heterogeneous capacities in predicting the three safety outcomes across the four distraction indicators were observed: 1) duration of the longest distraction time was most predictive for the occurrence of near-crashes and looks left and right among pedestrians with all three types of distraction combined and talking with other pedestrians (Harrell's C statistic changes ranged from 0.0310 to 0.0335, P < 0.05), and for the occurrence of near-crashes for pedestrians involving mobile phone use (Harrell's C statistic change: 0.0053); 2) total duration of distraction was most predictive for speed crossing the street among pedestrians with the combination and each of the three types of distraction (Harrell's C statistic changes ranged from 0.0037 to 0.0111, P < 0.05), frequency of looking left and right among pedestrians distracted by mobile phone use (Harrell's C statistic change: 0.0115), and the occurrence of near-crash among pedestrians eating, drinking, or smoking (Harrell's C statistic change: 0.0119); and 3) the total number of distractions was the most predictive indicator of frequency of looking left and right among pedestrians eating, drinking, or smoking (Harrell's C statistic change: 0.0013). Sensitivity analyses showed the results were robust to change in grouping criteria of the four distraction indicators. CONCLUSIONS: Future research should consider the pedestrian safety outcomes and type of distractions to select the best distraction indicator.

Predictive validity of a selection instrument measuring resilience: The INSPIRE resilience scale.

Military personnel needs to be resilient to be able to remain effective, motivated, and in good mental and physical health. Military organizations select on resilience to determine whether candidates are psychologically fit for their job. The INSPIRE Resilience Scale (IRS) is such a selection instrument that aims to assess the psychological resilience potential of candidates in high-risk professions. A longitudinal predictive validity study was conducted in five European Defense organizations and in the Dutch National Police. The IRS was submitted in selection (N = 11,404), and criterion data about performance and health were collected in the second half of the first training year (N = 726). The results based on correlational and regression analyses showed that the IRS scores significantly predicted the criterion measures. Emotional stability, part of the IRS, turned out to be the best predictor. Results also showed that candidates who dropped out of training had significantly lower means on the IRS in selection than candidates who were still in training in the second half of the first training year. Overall, the IRS proved to be a valid instrument to assess resilience potential in candidates for high-risk professions. Selecting on resilience may therefore contribute to training success and reduction of health problems.

New evidence on the validity of the selection methods for recruitment to general practice training: a cohort study.

BACKGROUND: Selection into UK-based GP training has used the Multi-Specialty Recruitment Assessment (MSRA) and a face-to-face selection centre (SC). The MSRA comprises of a situational judgement test and clinical problem-solving test. The SC was suspended during the COVID-19 pandemic. Evidence is needed to guide national and international selection policy. AIM: To evaluate the validity of GP training selection. DESIGN & SETTING: A retrospective cohort study using data from UK-based national recruitment to GP training, from 2015-2021. METHOD: Data were available for 32 215 GP training applicants. The ability of scores from the specialty selection process to predict subsequent performance in the Clinical Skills Assessment (CSA) of the Membership of the Royal College of General Practitioners examination was modelled using path analysis. The effect sizes for sex, professional family background, and world region of qualification were estimated. RESULTS: All component scores of the selection process demonstrated statistically significant independent relationships with CSA performance (P<0.001), thus establishing their predictive validity. All were sensitive to demographic factors. The SC scores had the weakest relationship with future CSA performance. However, for candidates with MSRA scores below the lowest quartile, the relative contribution of the SC scores to predicting CSA performance was similar to that observed for MSRA components. CONCLUSION: The MSRA has predictive validity in this context. Re-instituting an SC for those with relatively low MSRA scores should be considered. However, the relative costs and potential advantages and disadvantages should be carefully weighed.

Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action.

OBJECTIVE: "Ecological validity" (EV) is classically defined as test's ability to predict real-world functioning, either alone or together with test's similarity to real-world tasks. In neuropsychological literature on assessment of executive functions (EF), EV is conceptualized inconsistently, leading to misconceptions about the utility of tests. The goal of this systematic review was to examine how EV is conceptualized in studies of EF tests described as ecologically valid. METHOD: MEDLINE and PsychINFO Databases were searched. PRISMA guidelines were observed. After applying inclusion and exclusion criteria, this search yielded 90 articles. Deductive content analysis was employed to determine how the term EV was used. RESULTS: About 1/3 of the studies conceptualized EV as the test's ability to predict functional outcomes, 1/3 as both the ability to predict functional outcome and similarity to real-world tasks, and 1/3 were either unclear about the meaning of the term or relied on notions unrelated to classical definitions (e.g., similarity to real-world tasks alone, association with other tests, or the ability to discriminate between populations). CONCLUSIONS: Conceptualizations of the term EV in literature on EF assessment vary grossly, subsuming the notions of criterion, construct, and face validity, as well as sensitivity/specificity. Such inconsistency makes it difficult to interpret clinical utility of tests that are described as ecologically valid. We call on the field to require that, at minimum, the term EV be clearly defined in all publications, or replaced with more concrete terminology (e.g., criterion validity).

Investigating the factorial structure and measurement invariance of the parent-reported strengths and difficulties questionnaire at 11 years of age from the UK Millennium Cohort Study.

The strengths and difficulties questionnaire (SDQ) consist of five sub-scales that have been used to measure internalising and externalising symptoms in children, typically by combining sum scores of two sub-scales each, and pro-social behaviours. However, the different possible factorial structures that represent these symptoms have not been formally tested in a nationally representative sample of UK children. In addition, it is necessary to assess whether the SDQ is interpreted similarly across subgroups of the population. Exploratory and confirmatory factor analysis were used to test three competing structures for the parent-reported SDQ collected at age 11, the start of adolescence, in the UK Millennium Cohort Study (n = 11,519), and measurement invariance was assessed according to sex and a measure of deprivation of the area in which households lived. Internal consistency using ordinal alpha, internal convergent validity and external discriminant validity using average variance explained (AVE), and predictive validity were assessed. A five-factor model and a model with two second-order factors for internalising and externalising symptoms had better model fit than a three-factor model. For both structures, invariance was demonstrated across sex and area-level deprivation. AVE scores for the five-factor model indicated that peer and emotional problems factors were measuring a similar construct, as were the hyperactivity and conduct factors. In the second-order model, AVE scores indicated internalising and externalising symptoms were distinct constructs. A second-order model with two factors for internalising and externalising symptoms is appropriate for use in a cohort of UK children born in 2001/02, and our finding of invariance across sex and area-level deprivation indicate that the SDQ can be used in analysis investigating differences in symptoms across subgroups of the population.

Machine Learning and Risk Assessment: Random Forest Does Not Outperform Logistic Regression in the Prediction of Sexual Recidivism.

Although many studies supported the use of actuarial risk assessment instruments (ARAIs) because they outperformed unstructured judgments, it remains an ongoing challenge to seek potentials for improvement of their predictive performance. Machine learning (ML) algorithms, like random forests, are able to detect patterns in data useful for prediction purposes without explicitly programming them (e.g., by considering nonlinear effects between risk factors and the criterion). Therefore, the current study aims to compare conventional logistic regression analyses with the random forest algorithm on a sample of N = 511 adult male individuals convicted of sexual offenses. Data were collected at the Federal Evaluation Center for Violent and Sexual Offenders in Austria within a prospective-longitudinal research design and participants were followed-up for an average of M = 8.2 years. The Static-99, containing static risk factors, and the Stable-2007, containing stable dynamic risk factors, were included as predictors. The results demonstrated no superior predictive performance of the random forest compared with logistic regression; furthermore, methods of interpretable ML did not point to any robust nonlinear effects. Altogether, results supported the statistical use of logistic regression for the development and clinical application of ARAIs.

Using the Alcohol, Smoking and Substance Involvement Screening Test to predict substance-related hospitalisation after release from prison: A cohort study.

BACKGROUND AND AIMS: Poor substance use-related health outcomes after release from prison are common. Identifying people at greatest risk of substance use and related harms post-release would help to target support at those most in need. The Alcohol Smoking and Substance Involvement Screening Test (ASSIST) is a validated substance use screener, but its utility in predicting substance-related hospitalisation post-release is unestablished. We measured whether screening for moderate/high-risk substance use on the ASSIST was associated with increased risk of substance-related hospitalisation. DESIGN: A prospective cohort study. SETTING: Prisons in Queensland and Western Australia. PARTICIPANTS: Participants were incarcerated and within 6 weeks of expected release when recruited. A total of 2585 participants were followed up for a median of 873 days. MEASUREMENTS: Baseline survey data were combined with linked unit record administrative hospital data. We used the ASSIST to assess participants for moderate/high-risk cannabis, methamphetamine and heroin use in the 3 months prior to incarceration. We used International Classification of Diseases (ICD) codes to identify substance-related hospitalisations during follow-up. We compared rates of substance-related hospitalisation between those classified as low/no-risk and moderate/high-risk on the ASSIST for each substance. We estimated adjusted hazard ratios (aHR) by ASSIST risk group for each substance using Weibull regression survival analysis allowing for multiple failures. FINDINGS: During follow-up, 158 (6%) participants had cannabis-related, 178 (7%) had opioid-related and 266 (10%) had methamphetamine-related hospitalisation. The hazard rates of substance-related hospitalisation after prison were significantly higher among those who screened moderate/high-risk compared with those screening low risk on the ASSIST for cannabis (aHR 2.38, 95% confidence interval [CI] 1.74, 3.24), methamphetamine (aHR 2.23, 95%CI 1.75, 2.84) and heroin (aHR 5.79, 95%CI 4.41, 7.60). CONCLUSIONS: Incarcerated people with an Alcohol Smoking and Substance Involvement Screening Test (ASSIST) screening of moderate/high-risk substance use appear to have a significantly higher risk of post-release substance-related hospitalisation than those with low risk. Administering the ASSIST during incarceration may inform who has the greatest need for substance use treatment and harm reduction services in prison and after release from prison.

Comparison of the predictive validity of the Braden and Waterlow scales in intensive care unit patients: A multicentre study.

BACKGROUND: The first step in preventing pressure injuries (PIs), which represent a significant burden on intensive care unit (ICU) patients and the health care system, is to assess the risk for developing PIs. A valid risk assessment scale is essential to evaluate the risk and avoid PIs. OBJECTIVES: To compare the predictive validity of the Braden scale and Waterlow scale in ICUs. DESIGN: A multicentre, prospective and cross-sectional study. METHODS: We conducted this study among 6416 patients admitted to ICUs in Gansu province of China from April 2021 to October 2022. The incidence and characteristics of PIs were collected. The risk assessment of PIs was determined using the Braden and Waterlow scale. The sensitivity, specificity, positive and negative predictive values, and the area under the receiver operating characteristic curve of the two scales were compared. RESULTS: Out of 5903 patients, 72 (1.2%) developed PIs. The sensitivity, specificity, positive and negative predictive, and the area under the curve of the Braden scale were 77.8%, 50.9%, 0.014 and 0.996, and 0.689, respectively. These values for the Waterlow scale were 54.2%, 71.1%, 0.017, 0.994 and 0.651. CONCLUSIONS: Both scales could be used for risk assessment of PIs in ICU patients. However, the accuracy of visual inspection for assessment of skin colour, nursing preventive measures for patients and scales inter-rater inconsistency may limited the predictive validity statistics. RELEVANCE TO CLINICAL PRACTICE: Both scales could be used for PIs risk assessment. The low specificity of the Braden scale and low sensitivity of the Waterlow scale remind medical staff to use them in combination with clinical judgement and other objective indicators. PATIENT OR PUBLIC CONTRIBUTION: This study was designed to enhance the management of PIs. Patients and the general public were not involved in the study design, analysis, and interpretation of the data or manuscript preparation.

A validity study of a work sample test of leadership behavior using supervisor and subordinate ratings as criteria.

Work sample tests gather information about behavior that is consistent with the behavior being predicted. This criterion-related validity study examines whether a work sample test can predict behaviors more than 6 months later among managers (N = 127) in a large municipal organization. Ratings from both the subordinates (SOR) and supervisors (SVR) of the managers were used as criteria for the leadership dimensions of Influencing others, Consideration, and Planning. In total, six hypotheses were tested. The results were corrected for range restriction in the predictors and for unreliability in the criteria. The hypothesis that the work sample test score of Consideration predicted subordinates' ratings of Consideration received full support ( ρ ¯ = 0.33; CI [0.06-0.56]). The Consideration work sample test score also showed a positive relationship with supervisor ratings of Consideration ( ρ ¯ = 0.22; CI [-0.01 to 0.43]), although the confidence interval includes zero. No significant criterion-related validity was found for Influencing others or Planning. Given the results, the work sample test can primarily be used to predict Consideration. The results are discussed, and suggestions for further research are provided.

Validation of Longitudinal Progression Examinations for Prediction of APPE Readiness.

OBJECTIVE: To study curricular outcomes for the purpose of holistic improvement of the curriculum. METHODS: A single-institution retrospective cohort study evaluated 3 cohorts of Doctor of Pharmacy students entering the program through performance in Advanced Pharmacy Practice Experience (APPE) rotations. Assessment scores and pass/fail outcomes were collected from the 3 examinations to use as predictors, and the numbers of "needs improvement" (NI) and "unsatisfactory" (U) ratings from preceptors during the APPE rotations served as outcome measures. RESULTS: Pharmacy mathematics competency and Milemarker 1 (MM1) examination first-time scores, but not those from Milemarker 2 (MM2), were significantly associated with NI or U scores on required APPE rotations. Significant correlations for all examinations (pharmacy mathematics competency, MM1, and MM2) were found for the Acute Care/Inpatient APPE rotation for each cohort and the combined cohorts. Significant correlations were also found between all examinations and the APPE rotation courses Advanced Hospital and Ambulatory Care, with the exception of the 2021 cohort. Performance in the Advanced Community rotation was not associated with any of the examinations. MM1 and MM2 are both reliable measures of competence in our didactic curriculum and predictive of scoring an NI or U rating in the APPE Acute Care/Inpatient rotation. CONCLUSION: The longitudinal milestone examinations used in our institution provide a mechanism to identify students likely to struggle in required APPE rotations and target them for remediation activities.