Comparison of Mental Health Symptom Changes from pre-COVID-19 to COVID-19 by Sex or Gender: A Systematic Review and Meta-analysis

ImportanceWomen and gender-diverse individuals have faced disproportionate socioeconomic burden during COVID-19. There have been reports that this has translated into greater negative changes in mental health, but this has been based on cross-sectional research that has not accounted for pre-COVID-19 differences. ObjectiveTo compare mental health symptom changes since pre-COVID-19 by sex or gender. Data SourcesMEDLINE, PsycINFO, CINAHL, EMBASE, Web of Science, China National Knowledge Infrastructure, Wanfang, medRxiv, and Open Science Framework (December 31, 2019 to August 30, 2021). Study SelectionEligible studies compared mental health symptom changes from pre-COVID-19 to COVID-19 by sex or gender. Data Extraction and SynthesisData was extracted by a single reviewer with validation by a second reviewer. Adequacy of study methods and reporting was assessed using an adapted version of the Joanna Briggs Institute Checklist for Prevalence Studies. A restricted maximum-likelihood random-effects meta-analyses was conducted. Main Outcomes and MeasuresAnxiety symptoms, depression symptoms, general mental health, and stress measured continuously or dichotomously. Results12 studies (10 unique cohorts) were included. All compared females or women to males or men; none included gender-diverse individuals. Continuous symptom change differences were not statistically significant for depression (standardized mean difference [SMD]= 0.12, 95% CI -0.09 to 0.33; 4 studies, 4,475 participants; I2=69.0%) and stress (SMD= - 0.10, 95% CI -0.21 to 0.01; 4 studies, 1,533 participants; I2=0.0%), but anxiety (SMD= 0.15, 95% CI 0.07 to 0.22; 4 studies, 4,344 participants; I2=3.0%) and general mental health (SMD= 0.15, 95% CI 0.12 to 0.18; 3 studies, 15,692 participants; I2=0.0%) worsened more among females or women than males or men during COVID-19. There were no significant differences in changes in proportion above a cut-off: anxiety (difference= -0.05, 95% CI -0.20 to 0.11; 1 study, 217 participants), depression (difference= 0.12, 95% CI -0.03 to 0.28; 1 study, 217 participants), general mental health (difference= -0.03, 95% CI -0.09 to 0.04; 3 studies, 18,985 participants; I2=94.0%), stress (difference= 0.04, 95% CI -0.10 to 0.17; 1 study, 217 participants). Conclusion and RelevanceMental health outcomes did not differ or were worse by amounts below thresholds for clinical significance for women compared to men. RegistrationPROSPERO (CRD42020179703). KEY MESSAGESO_ST_ABSQuestionC_ST_ABSDid mental health symptoms worsen more for females or women than males or men in COVID-19? FindingsWe reviewed almost 65,000 citations and identified 12 studies that provided data to directly compare mental health symptom changes from pre-COVID-19 to during COVID-19 for females or women versus males or men. Statistically significant, but small, sex- or gender-based differences were found in 2 of 8 mental health outcomes. MeaningMental health changes among females or women were not significantly different from males or men for most outcomes, and differences that were identified were small and less than minimally important difference thresholds.

Comparison of Mental Health Symptoms prior to and during COVID-19: Evidence from a Living Systematic Review and Meta-analysis

ObjectivesThe rapid pace, high volume, and limited quality of mental health evidence that has been generated during COVID-19 poses a barrier to understanding mental health outcomes. We sought to summarize results from studies that compared mental health outcomes during COVID-19 to outcomes assessed prior to COVID-19 in the same cohort in the general population and in other groups for which data have been reported. DesignLiving systematic review. Data SourcesMEDLINE (Ovid), PsycINFO (Ovid), CINAHL (EBSCO), EMBASE (Ovid), Web of Science Core Collection: Citation Indexes, China National Knowledge Infrastructure, Wanfang, medRxiv (preprints), and Open Science Framework Preprints (preprint server aggregator). Eligibility criteria for selecting studiesFor this report, we included studies that compared general mental health, anxiety symptoms, or depression symptoms, assessed January 1, 2020 or later, to the same outcomes collected between January 1, 2018 and December 31, 2019. Any population was eligible. We required [≥] 90% of participants pre-COVID-19 and during COVID-19 to be the same or the use of statistical methods to address missing data. For population groups with continuous outcomes for at least two studies in an outcome domain, we conducted restricted maximum-likelihood random-effects meta-analyses. Worse COVID-19 mental health outcomes are reported as positive. Risk of bias of included studies was assessed using an adapted version of the Joanna Briggs Institute Checklist for Prevalence Studies. ResultsAs of April 11, 2022, we had reviewed 94,411 unique titles and abstracts and identified 137 unique eligible studies with data from 134 cohorts. Almost all studies were from high-income (105, 77%) or upper-middle income (28, 20%) countries. Among adult general population studies, we did not find changes in general mental health (standardized mean difference of change [SMDchange = 0.11, 95% CI -0.00 to 0.22) or anxiety symptoms (SMDchange = 0.05, 95% CI -0.04 to 0.13), but depression symptoms worsened minimally (SMDchange = 0.12, 95% CI 0.01 to 0.24). Among women or females, mental health symptoms worsened by minimal to small amounts in general mental health (SMDchange = 0.22, 95% CI 0.08 to 0.35), anxiety symptoms (SMDchange = 0.20, 95% CI 0.12 to 0.29), and depression symptoms (SMDchange = 0.22, 95% CI 0.05 to 0.40). Of 27 other analyses across outcome domains, among subgroups other than women or females, 5 analyses suggested minimal or small amounts of symptom worsening, and 2 suggested minimal or small symptom improvements. No other subgroup experienced statistically significant changes across outcome domains. In the 3 studies with data from March to April 2020 and later in 2020, symptoms either were unchanged from pre-COVID-19 at both time points or increased initially then returned to pre-COVID-19 levels. Heterogeneity measured by the I2 statistic was high (e.g., > 80%) for most analyses, and there was concerning risk of bias in most studies. ConclusionsHigh risk of bias in many studies and substantial heterogeneity suggest that point estimates should be interpreted cautiously. Nonetheless, there was general consistency across analyses in that most symptom change estimates were close to zero and not statistically significant, and changes that were identified were of minimal to small magnitudes. There were, however, small negative changes for women or females in all domains. It is possible that gaps in data have not allowed identification of changes in some vulnerable groups. Continued updating is needed as evidence accrues. Funding: Canadian Institutes of Health Research (CMS-171703; MS1-173070; GA4-177758; WI2-179944); McGill Interdisciplinary Initiative in Infection and Immunity Emergency COVID-19 Research Fund (R2-42). Registration: PROSPERO (CRD42020179703); registered on April 17, 2020.