More than just tracking time: Complex measures of user engagement with an internet-based health promotion intervention.

BACKGROUND: There has been a rise in internet-based health interventions without a concomitant focus on new methods to measure user engagement and its effect on outcomes. We describe current user tracking methods for internet-based health interventions and offer suggestions for improvement based on the design and pilot testing of healthMpowerment.org (HMP). METHODS: HMP is a multi-component online intervention for young Black men and transgender women who have sex with men (YBMSM/TW) to reduce risky sexual behaviors, promote healthy living and build social support. The intervention is non-directive, incorporates interactive features, and utilizes a point-based reward system. Fifteen YBMSM/TW (age 20-30) participated in a one-month pilot study to test the usability and efficacy of HMP. Engagement with the intervention was tracked using a customized data capture system and validated with Google Analytics. Usage was measured in time spent (total and across sections) and points earned. RESULTS: Average total time spent on HMP was five hours per person (range 0-13). Total time spent was correlated with total points earned and overall site satisfaction. CONCLUSION: Measuring engagement in internet-based interventions is crucial to determining efficacy. Multiple methods of tracking helped derive more comprehensive user profiles. Results highlighted the limitations of measures to capture user activity and the elusiveness of the concept of engagement.

HealthMpowerment.org: Building Community Through a Mobile-Optimized, Online Health Promotion Intervention.

BACKGROUND: Both young Black men who have sex with men as well as young Black transgender women (YBMSM/TW) continue to experience a significant increase in HIV incidence. HealthMpowerment.org (HMP) is a mobile phone-optimized, online intervention for both YBMSM/TW to build community and facilitate supportive relationships. METHODS: To assess the feasibility, acceptability, and preliminary outcomes, a 1-month pilot trial of HMP among 15 YBMSM/TW was conducted. RESULTS: Retention was 100%. Mean age was 26 years, 60% were HIV-infected, 87% earned <$21,000, and 67% were uninsured. Despite the small sample size and limited intervention length, statistically significant improvements were seen in social support (p = .012), social isolation (p = .050), and depressive symptoms (p = .045). CONCLUSION: The HMP pilot trial demonstrated feasibility and acceptability. Given the burden of the epidemic among YBMSM/TW, there is an imperative to develop, test, and scale up culturally appropriate interventions to both prevent HIV acquisition and limit onward transmission.

If you build it will they come? Addressing social isolation within a technology-based HIV intervention for young black men who have sex with men.

The rate of HIV infections among young black men who have sex with men (YBMSM) continues to rise at an alarming pace. YBMSM are particularly vulnerable to social isolation and a lack of social support due to experiences with racism and homophobia, which may have implications for sexual risk behaviors. The purpose of this study was to explore perceptions of social isolation and sense of community among YBMSM, the need for and receptivity to social networking features designed to reduce social isolation and build community within an Internet- and mobile phone-based primary and secondary HIV prevention intervention for YBMSM and to identify strategies to develop these features. Focus groups were conducted with 22 YBMSM aged 20-30 years at three sites in North Carolina. Data from the focus groups were thematically analyzed using NVivo. Feelings of social isolation and lack of a sense of community were strongly endorsed by participants with homophobia, lack of opportunities for social engagement, and a focus on sex rather than friendship in interpersonal relationships with other YBMSM cited as contributing factors. Participants were receptive to a social networking intervention designed to reduce social isolation and build community. Recommendations offered by participants to increase acceptability and usability of such features included: availability of information about healthy relationships, the ability to connect with other YBMSM and health care providers, and ensuring the site had ongoing facilitation by the study team as well as monitoring for inappropriate content. The development of a social networking feature of an HIV prevention intervention may present an opportunity to reduce social isolation, build community, and reduce risky sexual behaviors among YBMSM. The findings from this study are being used to inform the development of a social networking feature for an existing Internet- and mobile phone-based primary and secondary HIV prevention intervention for YBMSM.

Achieving HIV risk reduction through HealthMpowerment.org, a user-driven eHealth intervention for young Black men who have sex with men and transgender women who have sex with men.

Young, Black men who have sex with men and transgender women who have sex with men (YBMSM/TW) are at disproportionate risk for HIV and other sexually transmitted infections (HIV/STI). HealthMpowerment.org (HMP) is a mobile phone optimised online intervention that utilises behaviour change and gaming theories to reduce risky sexual behaviours and build community among HIV-positive and negative YBMSM/TW. The intervention is user-driven, provides social support, and utilises a point reward system. A four-week pilot trial was conducted with a diverse group of 15 YBMSM/TW. During exit interviews, participants described how HMP components led to behaviour changes such as asking partners' sexual history, increased condom use, and HIV/STI testing. The user-driven structure, interactivity, and rewards appeared to facilitate sustained user engagement and the mobile platform provided relevant information in real-time. Participants described the reward elements of exceeding their previous scores and earning points toward prizes as highly motivating. HMP showed promise for being able to deliver a sufficient intervention dose and we found a trend toward higher dose received and more advanced stages of behaviour change. In this pilot trial, HMP was well accepted and demonstrates promise for translating virtual intervention engagement into actual behaviour change to reduce HIV risk behaviours.

Putting prevention in their pockets: developing mobile phone-based HIV interventions for black men who have sex with men.

Young black men who have sex with men (MSM) bear a disproportionate burden of HIV. Rapid expansion of mobile technologies, including smartphone applications (apps), provides a unique opportunity for outreach and tailored health messaging. We collected electronic daily journals and conducted surveys and focus groups with 22 black MSM (age 18-30) at three sites in North Carolina to inform the development of a mobile phone-based intervention. Qualitative data was analyzed thematically using NVivo. Half of the sample earned under $11,000 annually. All participants owned smartphones and had unlimited texting and many had unlimited data plans. Phones were integral to participants' lives and were a primary means of Internet access. Communication was primarily through text messaging and Internet (on-line chatting, social networking sites) rather than calls. Apps were used daily for entertainment, information, productivity, and social networking. Half of participants used their phones to find sex partners; over half used phones to find health information. For an HIV-related app, participants requested user-friendly content about test site locators, sexually transmitted diseases, symptom evaluation, drug and alcohol risk, safe sex, sexuality and relationships, gay-friendly health providers, and connection to other gay/HIV-positive men. For young black MSM in this qualitative study, mobile technologies were a widely used, acceptable means for HIV intervention. Future research is needed to measure patterns and preferences of mobile technology use among broader samples.

Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: a review.

BACKGROUND: Mobile phone applications (apps) provide a new platform for delivering tailored human immunodeficiency virus (HIV) and sexually transmitted disease (STD) prevention and care. OBJECTIVE: To identify and evaluate currently available mobile phone apps related to the prevention and care of HIV and other STDs. METHODS: We searched the Apple iTunes and Android Google Play stores for HIV/STD-related apps, excluding apps that exclusively targeted industry, providers, and researchers. Each eligible app was downloaded, tested, and assessed for user ratings and functionality as well as 6 broad content areas of HIV prevention and care: HIV/STD disease knowledge, risk reduction/safer sex, condom promotion, HIV/STD testing information, resources for HIV-positive persons, and focus on key populations. RESULTS: Search queries up to May 2012 identified 1937 apps. Of these, 55 unique apps met the inclusion criteria (12 for Android, 29 for iPhone, and 14 for both platforms). Among these apps, 71% provided disease information about HIV/STDs, 36% provided HIV/STD testing information or resources, 29% included information about condom use or assistance locating condoms, and 24% promoted safer sex. Only 6 apps (11%) covered all 4 of these prevention areas. Eight apps (15%) provided tools or resources specifically for HIV/STD positive persons. Ten apps included information for a range of sexual orientations, 9 apps appeared to be designed for racially/ethnically diverse audiences, and 15 apps featured interactive components. Apps were infrequently downloaded (median 100-500 downloads) and not highly rated (average customer rating 3.7 out of 5 stars). CONCLUSIONS: Most available HIV/STD apps have failed to attract user attention and positive reviews. Public health practitioners should work with app developers to incorporate elements of evidence-based interventions for risk reduction and improve app inclusiveness and interactivity.