Assessing the Risk of Bias in Randomized Clinical Trials With Large Language Models.

Importance: Large language models (LLMs) may facilitate the labor-intensive process of systematic reviews. However, the exact methods and reliability remain uncertain. Objective: To explore the feasibility and reliability of using LLMs to assess risk of bias (ROB) in randomized clinical trials (RCTs). Design, Setting, and Participants: A survey study was conducted between August 10, 2023, and October 30, 2023. Thirty RCTs were selected from published systematic reviews. Main Outcomes and Measures: A structured prompt was developed to guide ChatGPT (LLM 1) and Claude (LLM 2) in assessing the ROB in these RCTs using a modified version of the Cochrane ROB tool developed by the CLARITY group at McMaster University. Each RCT was assessed twice by both models, and the results were documented. The results were compared with an assessment by 3 experts, which was considered a criterion standard. Correct assessment rates, sensitivity, specificity, and F1 scores were calculated to reflect accuracy, both overall and for each domain of the Cochrane ROB tool; consistent assessment rates and Cohen κ were calculated to gauge consistency; and assessment time was calculated to measure efficiency. Performance between the 2 models was compared using risk differences. Results: Both models demonstrated high correct assessment rates. LLM 1 reached a mean correct assessment rate of 84.5% (95% CI, 81.5%-87.3%), and LLM 2 reached a significantly higher rate of 89.5% (95% CI, 87.0%-91.8%). The risk difference between the 2 models was 0.05 (95% CI, 0.01-0.09). In most domains, domain-specific correct rates were around 80% to 90%; however, sensitivity below 0.80 was observed in domains 1 (random sequence generation), 2 (allocation concealment), and 6 (other concerns). Domains 4 (missing outcome data), 5 (selective outcome reporting), and 6 had F1 scores below 0.50. The consistent rates between the 2 assessments were 84.0% for LLM 1 and 87.3% for LLM 2. LLM 1's κ exceeded 0.80 in 7 and LLM 2's in 8 domains. The mean (SD) time needed for assessment was 77 (16) seconds for LLM 1 and 53 (12) seconds for LLM 2. Conclusions: In this survey study of applying LLMs for ROB assessment, LLM 1 and LLM 2 demonstrated substantial accuracy and consistency in evaluating RCTs, suggesting their potential as supportive tools in systematic review processes.

Evaluation of the psychometrics of the Social Impact Scale and its association with depression among asymptomatic COVID-19 carriers.

BACKGROUND: COVID-19 carriers experience psychological stresses and mental health issues such as varying degrees of stigma. The Social Impact Scale (SIS) can be used to measure the stigmatisation of COVID-19 carriers who experience such problems. AIMS: To evaluate the reliability and validity of the Chinese version of the SIS, and the association between stigma and depression among asymptomatic COVID-19 carriers in Shanghai, China. METHOD: A total of 1283 asymptomatic COVID-19 carriers from Shanghai Ruijin Jiahe Fangcang Shelter Hospital were recruited, with a mean age of 39.64 ± 11.14 years (59.6% male). Participants completed questionnaires, including baseline information and psychological measurements, the SIS and Self-Rating Depression Scale. The psychometrics of the SIS and its association with depression were examined through exploratory factor analysis, confirmatory factor analysis and receiver operating characteristic analysis. RESULTS: The average participant SIS score was 42.66 ± 14.61 (range: 24-96) years. Analyses suggested the model had four factors: social rejection, financial insecurity, internalised shame and social isolation. The model fit statistics of the four-factor SIS were 0.913 for the comparative fit index, 0.902 for the Tucker-Lewis index and 0.088 for root-mean-square error of approximation. Standard estimated factor loadings ranged from 0.509 to 0.836. After controlling for demographic characteristics, the total score of the 23-item SIS predicted depression (odds ratio: 1.087, 95% CI 1.061-1.115; area under the curve: 0.84, 95% CI 0.788-0.892). CONCLUSIONS: The Chinese version of the SIS showed good psychometric properties and can be used to assess the level of perceived stigma experienced by asymptomatic COVID-19 carriers.

Relationships of work stress and interpersonal needs with industrial workers' mental health: a moderated mediation model.

OBJECTIVES: This study explores whether feelings of defeat (i.e., a sense of failed struggle and losing rank; referred to as defeat for simplicity) mediated the effect of work stress on depression/anxiety, the effect of interpersonal needs on depression/anxiety for Chinese industrial workers, and the possible moderating role of social support. METHOD: A cross-sectional study was conducted in Shenzhen, China in 2019, in total, 2023 industrial workers (of 2700 invited; response rate = 75%) completed a self-administered survey consisted of Job Stress Scale, Interpersonal Needs Questionnaire, Defeat Scale, Centre for Epidemiological Studies Depression Scale, Generalized Anxiety Disorder Scale, two face-valid questions for social support, as well as sociodemographic information. Moderated mediation model was tested and loop plots were applied to probe into the conditional effects of work and interpersonal stress on depression and anxiety symptoms. RESULT: Both the direct and indirect effect of work stress on depression and anxiety through defeat were significant (Work stress→ Depression: B = 0.035, p < .001, Work stress→ Defeat→ Depression: B = 0.034, p < .001; Work stress→ Anxiety: B = 0.038, p < .001, Work stress→ Defeat→ Anxiety: B = 0.045, p < .001). Meanwhile, defeat mediated the relationship of interpersonal needs with depression partially and the relationship of interpersonal needs with anxiety totally (Interpersonal needs→ Anxiety: B = 0.133, p < .001, Interpersonal needs→ Defeat→ Anxiety: B = 0.010, p = .537). Social support moderated the indirect path between interpersonal needs and depression/anxiety and buffered the effect. CONCLUSION: The mediating role of defeat and the moderator role of social support in the relationship between stress and depression/anxiety were confirmed in industrial workers. Workers who reported more work and interpersonal stress would report more defeat feelings, and then exhibited more depression and anxiety symptoms; this mediation effect was stronger for those who had lower social support, respectively.

Exploring the long-term sequelae of childhood sexual abuse on risky sexual behavior among Chinese transgender women.

Introduction: Childhood sexual abuse (CSA) is a hidden but serious public health issue that can lead to a series of behavioral consequences and health problems in adulthood. It has been well documented that transgender women (TGW) have a high prevalence of CSA victimization. Moreover, risky sexual behaviors are also widespread among TGW; nevertheless, research investigating the associations between CSA victimization and risky sexual behaviors in TGW represents a gap in the literature. Methods: Our research was carried out mainly in Shenyang of China from November 2018 to January 2019. Sociodemographic characteristics, as well as information on participants' HIV awareness and sexual behaviors, were collected through face-to-face interviews. The impact of CSA was examined through hierarchical logistic regression, adjusted for sociodemographic factors and HIV awareness. Results: In the sample of 247 adult TGW, 14.2% of them had a CSA history. In the previous 6 months, 30.8% of the participants reported condomless anal intercourse (CAI) and 38.5% of them had multiple sexual partners (MSP). The findings demonstrated that TGW with CSA history were more likely to take part in CAI (p = 0.001, OR = 4.252) or have MSP (p = 0.004, OR = 3.260) in adulthood. Furthermore, HIV knowledge was not a predictor of CAI or MSP, but higher HIV risk perception was associated with a greater probability of CAI. Conclusion: Transgender women with a history of CSA were more prone to engage in CAI and have MSP in China.

Reliability and Validity of the Defeat Scale among Internal Migrant Workers in China: Decadence and Low Sense of Achievement.

INTRODUCTION: Internal migrant workers have a great chance to experience defeat due to their low social status and economic situation. It has been reported that defeat might play a prospective role in predicting depression and anxiety; however, defeat is rarely explored among internal migrant workers due to the lack of appropriate measurement scales. The defeat scale (DS) can measure the feeling of defeat, social hierarchy reduction, and loss in social struggle. But its reliability and validity among internal migrant workers have not been reported. This study aimed to verify the content validity and structural validity of the DS among internal migrant workers in China and to explore its correlations with anxiety and depression. METHODS: 1805 internal migrant workers (IMWs) were recruited by stratified multistage sampling from 16 factories in Shenzhen, China. The content validity index (CVI) was used to assess content validity. Cronbach's coefficient alpha of each factor and the total scale were calculated to assess the reliability of DS. The scree test was used to determine the number of factors. Convergent validity and discriminant validity were estimated by calculating the average variance extracted and composite reliability. Logistic regression was performed to explore the effects of DS scores on anxiety and depression. RESULTS: Mean score of DS among IMWs was 18.42 ± 9.40. There were 606 (33.6%) IMWs who were considered to have depression symptoms, and 524 (29.0%) IMWs were considered to have anxiety symptoms. A two-factor model was obtained and fitted well (CFI = 0.956, GFI = 0.932, IFI = 0.956, RMSEA = 0.068, SRMR = 0.052). Cronbach's alpha reliability coefficient for the DS was 0.92. Logistic regression showed that DS scores were positively associated with anxiety and depression among IMWs. CONCLUSIONS: DS performed well among IMWs on content validity and structural validity, and it was suitable as a measurement instrument to assess defeat among this population. Defeat was positively associated with anxiety and depression and might play an important role in the mental health of IMWs.

Psychosocial Problems and Condomless Anal Sex among Transgender Women in Two Cities of China: Study Based on the Syndemic Framework.

Studies examining the association between psychosocial problems and condomless anal sex (CAS) among transgender women (TGW) are rare. In this study, close attention was paid to the effect of co-occurring psychosocial problems on sexual risk behaviors. A cross-sectional study, including 247 TGW, was conducted in Kunming and Shenyang, China. The prevalence of condomless anal sex among TGW in the previous 6 months was 30.8%. Most of the psychosocial factors were associated with one another in bivariate logistic regression models. Low self-esteem (ORm = 2.99, 95% CI = 1.25-7.18), sexual compulsivity (ORm = 2.13, 95% CI = 1.13-4.00), and intimate partner violence (ORm = 2.21, 95% CI = 1.19-4.11) were discovered to be related to condomless anal sex in the multivariate regression model. No significant interactive effects of the syndemic factors on condomless anal sex were detected. More programmatic and effective HIV prevention interventions targeting psychosocial problems are required to reduce HIV infection within the population.

Development and Validation of a Prognostic Model to Predict Overall Survival for Lung Adenocarcinoma: A Population-Based Study From the SEER Database and the Chinese Multicenter Lung Cancer Database.

Background: Lung adenocarcinoma (LUAD) is the most common subtype of non-small-cell lung cancer (NSCLC). The aim of our study was to determine prognostic risk factors and establish a novel nomogram for lung adenocarcinoma patients. Methods: This retrospective cohort study is based on the Surveillance, Epidemiology, and End Results (SEER) database and the Chinese multicenter lung cancer database. We selected 22,368 eligible LUAD patients diagnosed between 2010 and 2015 from the SEER database and screened them based on the inclusion and exclusion criteria. Subsequently, the patients were randomly divided into the training cohort (n = 15,657) and the testing cohort (n = 6711), with a ratio of 7:3. Meanwhile, 736 eligible LUAD patients from the Chinese multicenter lung cancer database diagnosed between 2011 and 2021 were considered as the validation cohort. Results: We established a nomogram based on each independent prognostic factor analysis for 1-, 3-, and 5-year overall survival (OS) . For the training cohort, the area under the curves (AUCs) for predicting the 1-, 3-, and 5-year OS were 0.806, 0.856, and 0.886. For the testing cohort, AUCs for predicting the 1-, 3-, and 5-year OS were 0.804, 0.849, and 0.873. For the validation cohort, AUCs for predicting the 1-, 3-, and 5-year OS were 0.86, 0.874, and 0.861. The calibration curves were observed to be closer to the ideal 45° dotted line with regard to 1-, 3-, and 5-year OS in the training cohort, the testing cohort, and the validation cohort. The decision curve analysis (DCA) plots indicated that the established nomogram had greater net benefits in comparison with the Tumor-Node-Metastasis (TNM) staging system for predicting 1-, 3-, and 5-year OS of lung adenocarcinoma patients. The Kaplan-Meier curves indicated that patients' survival in the low-risk group was better than that in the high-risk group (P < .001). Conclusion: The nomogram performed very well with excellent predictive ability in both the US population and the Chinese population.

Predicting the risk of HIV infection among internal migrant MSM in China: An optimal model based on three variable selection methods.

Introduction: Internal migrant Men who have sex with men (IMMSM), which has the dual identity of MSM and floating population, should be more concerned among the vulnerable groups for HIV in society. Establishing appropriate prediction models to assess the risk of HIV infection among IMMSM is of great significance to against HIV infection and transmission. Methods: HIV and syphilis infection were detected using rapid test kits, and other 30 variables were collected among IMMSM through questionnaire. Taking HIV infection status as the dependent variable, three methods were used to screen predictors and three prediction models were developed respectively. The Hosmer-Lemeshow test was performed to verify the fit of the models, and the net classification improvement and integrated discrimination improvement were used to compare these models to determine the optimal model. Based on the optimal model, a prediction nomogram was developed as an instrument to assess the risk of HIV infection among IMMSM. To quantify the predictive ability of the nomogram, the C-index measurement was performed, and internal validation was performed using bootstrap method. The receiver operating characteristic (ROC) curve, calibration plot and dynamic component analysis (DCA) were respectively performed to assess the efficacy, accuracy and clinical utility of the prediction nomogram. Results: In this study, 12.52% IMMSMs were tested HIV-positive and 8.0% IMMSMs were tested syphilis-positive. Model A, model B, and model C fitted well, and model B was the optimal model. A nomogram was developed based on the model B. The C-index of the nomogram was 0.757 (95% CI: 0.701-0.812), and the C-index of internal verification was 0.705. Conclusions: The model established by stepwise selection methods incorporating 11 risk factors (age, education, marriage, monthly income, verbal violence, syphilis, score of CUSS, score of RSES, score of ULS, score of ES and score of DS) was the optimal model that achieved the best predictive power. The risk nomogram based on the optimal model had relatively good efficacy, accuracy and clinical utility in identifying internal migrant MSM at high-risk for HIV infection, which is helpful for developing targeted intervention for them.

Blood lipid levels and all-cause mortality in older adults: the Chinese Longitudinal Healthy Longevity Survey 2008-2018.

OBJECTIVES: Proper blood lipid levels are essential for survival in older adults, but inconsistent relationships have been reported between blood lipids and all-cause mortality in the elderly. METHODS: This retrospective longitudinal study analyzed data from 1,067 Chinese older adults enrolled in the Chinese Longitudinal Healthy Longevity Survey collected in 2008 and followed up until death or December 31, 2018. The outcome was all-cause mortality. Multivariate Cox regression analyses were used to estimate hazard ratios (HRs) and 95% confidence intervals (CIs) with stratification by age (60-80, 80-100, or ≥100 years) for further analysis. The survival probability according to lipid profile quartiles was calculated using Kaplan-Meier curves and the log-rank test. RESULTS: The participants' mean age was 84.84 years, and 57.0% were female. In total, 578 individuals died, and 277 were lost to follow-up. The mean total cholesterol (TC), high-density lipoprotein cholesterol (HDL-C), and low-density lipoprotein cholesterol (LDL-C) levels were higher among those who died than among those who survived. Participants in the second HDL-C quartile and the highest LDL-C and triglyceride (TG) quartiles had 28% higher, 23% lower, and 49% lower risks of all-cause mortality, respectively. After further adjustment, the associations remained except for HDL-C, and additional associations were observed between all-cause mortality and the third TC and LDL-C quartiles and the second TG quartile (HR, 1.44; 95% CI, 1.01 to 2.06; HR, 0.68; 95% CI, 0.49 to 0.94; HR, 0.79; 95% CI, 0.62 to 0.99, respectively). CONCLUSIONS: Older adults should maintain an LDL-C level of 1.91-2.47 mmol/L and a TG level of no less than 1.66 mmol/L.

Prediction Model for the Risk of HIV Infection among MSM in China: Validation and Stability.

The impact of psychosocial factors on increasing the risk of HIV infection among men who have sex with men (MSM) has attracted increasing attention. We aimed to develop and validate an integrated prediction model, especially incorporating emerging psychosocial variables, for predicting the risk of HIV infection among MSM. We surveyed and collected sociodemographic, psychosocial, and behavioral information from 547 MSM in China. The participants were split into a training set and a testing set in a 3:1 theoretical ratio. The prediction model was constructed by introducing the important variables selected with the least absolute shrinkage and selection operator (LASSO) regression, applying multivariate logistic regression, and visually assessing the risk of HIV infection through the nomogram. Receiver operating characteristic curves (ROC), Kolmogorov-Smirnov test, calibration plots, Hosmer-Lemeshow test and population stability index (PSI) were performed to test validity and stability of the model. Four of the 15 selected variables-unprotected anal intercourse, multiple sexual partners, involuntary subordination and drug use before sex-were included in the prediction model. The results indicated that the comprehensive prediction model we developed had relatively good predictive performance and stability in identifying MSM at high-risk for HIV infection, thus providing targeted interventions for high-risk MSM.

A nomogram of suicidal ideation among men who have sex with men in China: Based on the integrated motivational-volitional model of suicidal behavior.

Introduction: Men who have sex with men (MSM) are a high-risk group for suicide, with a much higher prevalence of suicidal ideation (SI) than the general population and male population. The aim of this study was to explore the risk factors influencing the development of SI and to develop and validate a nomogram among MSM. Methods: A cross-sectional study was conducted in 915 MSM from Shanghai, Shenyang, Shenzhen and Kunming, China using the snowball sampling method. The integrated motivational-volitional (IMV) model of suicidal behavior was used as a theoretical framework to collect different potential influencing factors of SI including diathesis-environment-life events factors and psychosocial factors. The risk factors of SI were screened by logistic regression analysis, and a nomogram for predicting SI were developed. Model properties including discrimination, calibration and decision curves were evaluated to validate the prediction model. Results: 882 MSM were included in the statistical analysis, with a lifetime prevalence of SI of 34.4% (303/882). Logistic regression analysis showed that age group, sexual orientation disclosure, high-risk sexual behavior, entrapment, defeat and interpersonal needs were associated with SI. A nomogram was constructed based on the above six predictors. AUC values of ROC for prediction model were 0.761 (0.641-0.770) and 0.754 (0.565-0.822) in the training set (n = 662) and validation set (n = 220), respectively. And there was no statistical difference of the AUC values between the two sets (P > 0.05). The calibration plots of the prediction model in both sets fit well with the ideal model (P > 0.05). The decision curves demonstrated that the threshold probability of prediction model in training set was 1-85%, whereas in validation set was 1-63%. Conclusions: The lifetime prevalence of SI among Chinese MSM is high. The nomogram can serve as a useful tool to predict the development of SI among MSM. Defeat, entrapment and interpersonal needs, as significant predictors of SI, can be measured to identify SI in advance. Early assessment of SI and the enhancement of psychosocial interventions are important to prevent suicide-related behaviors. Future studies could incorporate more variables of interest to refine the prediction model to better guide behavioral and psychological intervention strategies among MSM.

The prevalence of childhood sexual experiences and intimate partner violence among transgender women in China: Risk factors for lifetime suicidal ideation.

Objective: Several studies highlighted childhood sexual experiences (CSEs) and intimate partner violence (IPV) as risk factors that affected lifetime suicidal ideation. TW had higher rates of CSEs and IPV than cisgender people. The aim of this study was to comprehensively assess the prevalence of CSEs and IPV among TW and their association with lifetime suicidal ideation. Methods: A cross-sectional survey was conducted among 247 TW in Shenyang and Kunming, China, from April to September 2018. CSEs, IPV, and lifetime suicidal ideation were assessed. Logistic regression models were used to examine the association between self-reported CSEs under 18 years of age, IPV in adulthood, and lifetime suicidal ideation. Results: In the study, 14.2% (35/247) of the sample participants reported CSEs under 18 years of age; 44.9% (111/247) reported experiencing IPV in adulthood, including 18.6% (44/247) of physical IPV, 27.1% (67/247) of trans-specific identity IPV, 31.6% (78/247) of verbal IPV, and 19.4% (48/247) of sexual IPV; and 26.3% (65/247) had thought about attempting suicide at least one time. CSEs and any form of IPV were significantly associated with suicidal ideation in this sample population. A final stepwise multivariate logistic regression model found that both physical and verbal IPVs were significantly associated with suicidal ideation when controlling for other factors (ORm1 = 2.58, 95% confidence interval (CI) = 1.163-5.724; ORm2 = 2.72, 95% CI = 1.334-5.547). Conclusions: The findings highlight the effects of CSEs and IPV among TW and suggest the need for research on suicide in the future. Suicide prevention efforts for this invisible and vulnerable population should focus on those with physical and verbal IPV.

Detection of meningoencephalitis caused by Listeria monocytogenes with ischemic stroke-like onset using metagenomics next-generation sequencing: A case report.

RATIONALE: Listeria monocytogenes (L. monocytogenes) is a compatible intracellular bacterial pathogen that can invade different mammalian cells and reach the central nervous system (CNS), leading to meningoencephalitis and brain abscesses. In the diagnosis of L. monocytogenes meningoencephalitis (LMM), conventional tests are often reported as negative due to antibiotic therapy or low bacterial content in cerebrospinal fluid. To date, prompt diagnosis and accurate treatment remain a challenge for patients with Listeria infections. PATIENT CONCERNS: Here, we report a case of a 64-year-old male diagnosed with LMM by using metagenomics next-generation sequencing (mNGS). DIAGNOSIS: LMM was confirmed by mNGS analysis of cerebrospinal fluid. INTERVENTIONS: The patient was treated with piperacillin and sensitive antibiotics. OUTCOMES: The patient could walk independently about 1 month after admission and was discharged from the hospital. LESSONS: This case highlights the value of mNGS in the diagnosis of LMM and emphasizes the inadequate sensitivity of conventional diagnostic methods for Listeria infection.