What's in a Name? Experimental Evidence of Gender Bias in Recommendation Letters Generated by ChatGPT.

BACKGROUND: Artificial intelligence chatbots such as ChatGPT (OpenAI) have garnered excitement about their potential for delegating writing tasks ordinarily performed by humans. Many of these tasks (eg, writing recommendation letters) have social and professional ramifications, making the potential social biases in ChatGPT's underlying language model a serious concern. OBJECTIVE: Three preregistered studies used the text analysis program Linguistic Inquiry and Word Count to investigate gender bias in recommendation letters written by ChatGPT in human-use sessions (N=1400 total letters). METHODS: We conducted analyses using 22 existing Linguistic Inquiry and Word Count dictionaries, as well as 6 newly created dictionaries based on systematic reviews of gender bias in recommendation letters, to compare recommendation letters generated for the 200 most historically popular "male" and "female" names in the United States. Study 1 used 3 different letter-writing prompts intended to accentuate professional accomplishments associated with male stereotypes, female stereotypes, or neither. Study 2 examined whether lengthening each of the 3 prompts while holding the between-prompt word count constant modified the extent of bias. Study 3 examined the variability within letters generated for the same name and prompts. We hypothesized that when prompted with gender-stereotyped professional accomplishments, ChatGPT would evidence gender-based language differences replicating those found in systematic reviews of human-written recommendation letters (eg, more affiliative, social, and communal language for female names; more agentic and skill-based language for male names). RESULTS: Significant differences in language between letters generated for female versus male names were observed across all prompts, including the prompt hypothesized to be neutral, and across nearly all language categories tested. Historically female names received significantly more social referents (5/6, 83% of prompts), communal or doubt-raising language (4/6, 67% of prompts), personal pronouns (4/6, 67% of prompts), and clout language (5/6, 83% of prompts). Contradicting the study hypotheses, some gender differences (eg, achievement language and agentic language) were significant in both the hypothesized and nonhypothesized directions, depending on the prompt. Heteroscedasticity between male and female names was observed in multiple linguistic categories, with greater variance for historically female names than for historically male names. CONCLUSIONS: ChatGPT reproduces many gender-based language biases that have been reliably identified in investigations of human-written reference letters, although these differences vary across prompts and language categories. Caution should be taken when using ChatGPT for tasks that have social consequences, such as reference letter writing. The methods developed in this study may be useful for ongoing bias testing among progressive generations of chatbots across a range of real-world scenarios. TRIAL REGISTRATION: OSF Registries osf.io/ztv96; https://osf.io/ztv96.

Disaster Preparedness in a Resettled Refugee Community: Qualitative Findings.

INTRODUCTION: Under-resourced communities face disaster preparedness challenges. Research is limited for resettled refugee communities, which have unique preparedness needs. STUDY OBJECTIVE: This study aims to assess disaster preparedness among the refugee community in Clarkston, GA. METHODS: Twenty-five semi-structured interviews were completed with community stakeholders. Convenience sampling using the snowball method was utilized until thematic saturation was reached. Thematic analysis of interviews was conducted through an inductive, iterative approach by a multidisciplinary team using manual coding and MAXQDA. RESULTS: Three themes were identified: First, prioritization of routine daily needs took precedence for families over disaster preparedness. Second, communication impacts preparedness. Community members speak different languages and often do not have proficiency in English. Access to resources in native languages and creative communication tactics are important tools. Finally, the study revealed a unique interplay between government, community-based organizations, and the refugee community. A web of formal and informal responses is vital to helping this community in times of need. CONCLUSION: The refugee community in Clarkston, GA faces challenges, and disaster preparedness may not be top of mind for them. However, clear communication, disaster preparedness planning, and collaboration between government, community-based organizations, and the community are possible areas to focus on to bolster readiness.