Objective monitoring of loneliness levels using smart devices: A multi-device approach for mental health applications.

Loneliness is linked to wide ranging physical and mental health problems, including increased rates of mortality. Understanding how loneliness manifests is important for targeted public health treatment and intervention. With advances in mobile sending and wearable technologies, it is possible to collect data on human phenomena in a continuous and uninterrupted way. In doing so, such approaches can be used to monitor physiological and behavioral aspects relevant to an individual's loneliness. In this study, we proposed a method for continuous detection of loneliness using fully objective data from smart devices and passive mobile sensing. We also investigated whether physiological and behavioral features differed in their importance in predicting loneliness across individuals. Finally, we examined how informative data from each device is for loneliness detection tasks. We assessed subjective feelings of loneliness while monitoring behavioral and physiological patterns in 30 college students over a 2-month period. We used smartphones to monitor behavioral patterns (e.g., location changes, type of notifications, in-coming and out-going calls/text messages) and smart watches and rings to monitor physiology and sleep patterns (e.g., heart-rate, heart-rate variability, sleep duration). Participants reported their loneliness feeling multiple times a day through a questionnaire app on their phone. Using the data collected from their devices, we trained a random forest machine learning based model to detect loneliness levels. We found support for loneliness prediction using a multi-device and fully-objective approach. Furthermore, behavioral data collected by smartphones generally were the most important features across all participants. The study provides promising results for using objective data to monitor mental health indicators, which could provide a continuous and uninterrupted source of information in mental healthcare applications.

ZotCare: a flexible, personalizable, and affordable mhealth service provider.

The proliferation of Internet-connected health devices and the widespread availability of mobile connectivity have resulted in a wealth of reliable digital health data and the potential for delivering just-in-time interventions. However, leveraging these opportunities for health research requires the development and deployment of mobile health (mHealth) applications, which present significant technical challenges for researchers. While existing mHealth solutions have made progress in addressing some of these challenges, they often fall short in terms of time-to-use, affordability, and flexibility for personalization and adaptation. ZotCare aims to address these limitations by offering ready-to-use and flexible services, providing researchers with an accessible, cost-effective, and adaptable solution for their mHealth studies. This article focuses on ZotCare's service orchestration and highlights its capabilities in creating a programmable environment for mHealth research. Additionally, we showcase several successful research use cases that have utilized ZotCare, both in the past and in ongoing projects. Furthermore, we provide resources and information for researchers who are considering ZotCare as their mHealth research solution.

Objective Prediction of Next-Day's Affect Using Multimodal Physiological and Behavioral Data: Algorithm Development and Validation Study.

BACKGROUND: Affective states are important aspects of healthy functioning; as such, monitoring and understanding affect is necessary for the assessment and treatment of mood-based disorders. Recent advancements in wearable technologies have increased the use of such tools in detecting and accurately estimating mental states (eg, affect, mood, and stress), offering comprehensive and continuous monitoring of individuals over time. OBJECTIVE: Previous attempts to model an individual's mental state relied on subjective measurements or the inclusion of only a few objective monitoring modalities (eg, smartphones). This study aims to investigate the capacity of monitoring affect using fully objective measurements. We conducted a comparatively long-term (12-month) study with a holistic sampling of participants' moods, including 20 affective states. METHODS: Longitudinal physiological data (eg, sleep and heart rate), as well as daily assessments of affect, were collected using 3 modalities (ie, smartphone, watch, and ring) from 20 college students over a year. We examined the difference between the distributions of data collected from each modality along with the differences between their rates of missingness. Out of the 20 participants, 7 provided us with 200 or more days' worth of data, and we used this for our predictive modeling setup. Distributions of positive affect (PA) and negative affect (NA) among the 7 selected participants were observed. For predictive modeling, we assessed the performance of different machine learning models, including random forests (RFs), support vector machines (SVMs), multilayer perceptron (MLP), and K-nearest neighbor (KNN). We also investigated the capability of each modality in predicting mood and the most important features of PA and NA RF models. RESULTS: RF was the best-performing model in our analysis and performed mood and stress (nervousness) prediction with ~81% and ~72% accuracy, respectively. PA models resulted in better performance compared to NA. The order of the most important modalities in predicting PA and NA was the smart ring, phone, and watch, respectively. SHAP (Shapley Additive Explanations) analysis showed that sleep and activity-related features were the most impactful in predicting PA and NA. CONCLUSIONS: Generic machine learning-based affect prediction models, trained with population data, outperform existing methods, which use the individual's historical information. Our findings indicated that our mood prediction method outperformed the existing methods. Additionally, we found that sleep and activity level were the most important features for predicting next-day PA and NA, respectively.

Personal mental health navigator: Harnessing the power of data, personal models, and health cybernetics to promote psychological well-being.

Current digital mental healthcare solutions conventionally take on a reactive approach, requiring individuals to self-monitor and document existing symptoms. These solutions are unable to provide comprehensive, wrap-around, customized treatments that capture an individual's holistic mental health model as it unfolds over time. Recognizing that each individual requires personally tailored mental health treatment, we introduce the notion of Personalized Mental Health Navigation (MHN): a cybernetic goal-based system that deploys a continuous loop of monitoring, estimation, and guidance to steer the individual towards mental flourishing. We present the core components of MHN that are premised on the importance of addressing an individual's personal mental health state. Moreover, we provide an overview of the existing physical health navigation systems and highlight the requirements and challenges of deploying the navigational approach to the mental health domain.

Sleep Patterns and Affect Dynamics Among College Students During the COVID-19 Pandemic: Intensive Longitudinal Study.

BACKGROUND: Sleep disturbance is a transdiagnostic risk factor that is so prevalent among young adults that it is considered a public health epidemic, which has been exacerbated by the COVID-19 pandemic. Sleep may contribute to mental health via affect dynamics. Prior literature on the contribution of sleep to affect is largely based on correlational studies or experiments that do not generalize to the daily lives of young adults. Furthermore, the literature examining the associations between sleep variability and affect dynamics remains scant. OBJECTIVE: In an ecologically valid context, using an intensive longitudinal design, we aimed to assess the daily and long-term associations between sleep patterns and affect dynamics among young adults during the COVID-19 pandemic. METHODS: College student participants (N=20; female: 13/20, 65%) wore an Oura ring (Oura Health Ltd) continuously for 3 months to measure sleep patterns, such as average and variability in total sleep time (TST), wake after sleep onset (WASO), sleep efficiency, and sleep onset latency (SOL), resulting in 1173 unique observations. We administered a daily ecological momentary assessment by using a mobile health app to evaluate positive affect (PA), negative affect (NA), and COVID-19 worry once per day. RESULTS: Participants with a higher sleep onset latency (b=-1.09, SE 0.36; P=.006) and TST (b=-0.15, SE 0.05; P=.008) on the prior day had lower PA on the next day. Further, higher average TST across the 3-month period predicted lower average PA (b=-0.36, SE 0.12; P=.009). TST variability predicted higher affect variability across all affect domains. Specifically, higher variability in TST was associated higher PA variability (b=0.09, SE 0.03; P=.007), higher negative affect variability (b=0.12, SE 0.05; P=.03), and higher COVID-19 worry variability (b=0.16, SE 0.07; P=.04). CONCLUSIONS: Fluctuating sleep patterns are associated with affect dynamics at the daily and long-term scales. Low PA and affect variability may be potential pathways through which sleep has implications for mental health.

Personalized Stress Monitoring using Wearable Sensors in Everyday Settings.

Since stress contributes to a broad range of mental and physical health problems, the objective assessment of stress is essential for behavioral and physiological studies. Although several studies have evaluated stress levels in controlled settings, objective stress assessment in everyday settings is still largely under-explored due to challenges arising from confounding contextual factors and limited adherence for self-reports. In this paper, we explore the objective prediction of stress levels in everyday settings based on heart rate (HR) and heart rate variability (HRV) captured via low-cost and easy-to-wear photoplethysmography (PPG) sensors that are widely available on newer smart wearable devices. We present a layered system architecture for personalized stress monitoring that supports a tunable collection of data samples for labeling, and present a method for selecting informative samples from the stream of real-time data for labeling. We captured the stress levels of fourteen volunteers through self-reported questionnaires over periods of between 1-3 months, and explored binary stress detection based on HR and HRV using Machine Learning methods. We observe promising preliminary results given that the dataset is collected in the challenging environments of everyday settings. The binary stress detector is fairly accurate and can detect stressful vs non-stressful samples with a macroF1 score of up to %76. Our study lays the groundwork for more sophisticated labeling strategies that generate context-aware, personalized models that will empower health professionals to provide personalized interventions.

A Technology-Based Pregnancy Health and Wellness Intervention (Two Happy Hearts): Case Study.

BACKGROUND: The physical and emotional well-being of women is critical for healthy pregnancy and birth outcomes. The Two Happy Hearts intervention is a personalized mind-body program coached by community health workers that includes monitoring and reflecting on personal health, as well as practicing stress management strategies such as mindful breathing and movement. OBJECTIVE: The aims of this study are to (1) test the daily use of a wearable device to objectively measure physical and emotional well-being along with subjective assessments during pregnancy, and (2) explore the user's engagement with the Two Happy Hearts intervention prototype, as well as understand their experiences with various intervention components. METHODS: A case study with a mixed design was used. We recruited a 29-year-old woman at 33 weeks of gestation with a singleton pregnancy. She had no medical complications or physical restrictions, and she was enrolled in the Medi-Cal public health insurance plan. The participant engaged in the Two Happy Hearts intervention prototype from her third trimester until delivery. The Oura smart ring was used to continuously monitor objective physical and emotional states, such as resting heart rate, resting heart rate variability, sleep, and physical activity. In addition, the participant self-reported her physical and emotional health using the Two Happy Hearts mobile app-based 24-hour recall surveys (sleep quality and level of physical activity) and ecological momentary assessment (positive and negative emotions), as well as the Perceived Stress Scale, Center for Epidemiologic Studies Depression Scale, and State-Trait Anxiety Inventory. Engagement with the Two Happy Hearts intervention was recorded via both the smart ring and phone app, and user experiences were collected via Research Electronic Data Capture satisfaction surveys. Objective data from the Oura ring and subjective data on physical and emotional health were described. Regression plots and Pearson correlations between the objective and subjective data were presented, and content analysis was performed for the qualitative data. RESULTS: Decreased resting heart rate was significantly correlated with increased heart rate variability (r=-0.92, P<.001). We found significant associations between self-reported responses and Oura ring measures: (1) positive emotions and heart rate variability (r=0.54, P<.001), (2) sleep quality and sleep score (r=0.52, P<.001), and (3) physical activity and step count (r=0.77, P<.001). In addition, deep sleep appeared to increase as light and rapid eye movement sleep decreased. The psychological measures of stress, depression, and anxiety appeared to decrease from baseline to post intervention. Furthermore, the participant had a high completion rate of the components of the Two Happy Hearts intervention prototype and shared several positive experiences, such as an increased self-efficacy and a normal delivery. CONCLUSIONS: The Two Happy Hearts intervention prototype shows promise for potential use by underserved pregnant women.

Using Multimodal Assessments to Capture Personalized Contexts of College Student Well-being in 2020: Case Study.

BACKGROUND: The year 2020 has been challenging for many, particularly for young adults who have been adversely affected by the COVID-19 pandemic. Emerging adulthood is a developmental phase with significant changes in the patterns of daily living; it is a risky phase for the onset of major mental illness. College students during the pandemic face significant risk, potentially losing several protective factors (eg, housing, routine, social support, job, and financial security) that are stabilizing for mental health and physical well-being. Individualized multiple assessments of mental health, referred to as multimodal personal chronicles, present an opportunity to examine indicators of health in an ongoing and personalized way using mobile sensing devices and wearable internet of things. OBJECTIVE: To assess the feasibility and provide an in-depth examination of the impact of the COVID-19 pandemic on college students through multimodal personal chronicles, we present a case study of an individual monitored using a longitudinal subjective and objective assessment approach over a 9-month period throughout 2020, spanning the prepandemic period of January through September. METHODS: The individual, referred to as Lee, completed psychological assessments measuring depression, anxiety, and loneliness across 4 time points in January, April, June, and September. We used the data emerging from the multimodal personal chronicles (ie, heart rate, sleep, physical activity, affect, behaviors) in relation to psychological assessments to understand patterns that help to explicate changes in the individual's psychological well-being across the pandemic. RESULTS: Over the course of the pandemic, Lee's depression severity was highest in April, shortly after shelter-in-place orders were mandated. His depression severity remained mildly severe throughout the rest of the months. Associations in positive and negative affect, physiology, sleep, and physical activity patterns varied across time periods. Lee's positive affect and negative affect were positively correlated in April (r=0.53, P=.04) whereas they were negatively correlated in September (r=-0.57, P=.03). Only in the month of January was sleep negatively associated with negative affect (r=-0.58, P=.03) and diurnal beats per minute (r=-0.54, P=.04), and then positively associated with heart rate variability (resting root mean square of successive differences between normal heartbeats) (r=0.54, P=.04). When looking at his available contextual data, Lee noted certain situations as supportive coping factors and other situations as potential stressors. CONCLUSIONS: We observed more pandemic concerns in April and noticed other contextual events relating to this individual's well-being, reflecting how college students continue to experience life events during the pandemic. The rich monitoring data alongside contextual data may be beneficial for clinicians to understand client experiences and offer personalized treatment plans. We discuss benefits as well as future directions of this system, and the conclusions we can draw regarding the links between the COVID-19 pandemic and college student mental health.

Long-Term IoT-Based Maternal Monitoring: System Design and Evaluation.

Pregnancy is a unique time when many mothers gain awareness of their lifestyle and its impacts on the fetus. High-quality care during pregnancy is needed to identify possible complications early and ensure the mother's and her unborn baby's health and well-being. Different studies have thus far proposed maternal health monitoring systems. However, they are designed for a specific health problem or are limited to questionnaires and short-term data collection methods. Moreover, the requirements and challenges have not been evaluated in long-term studies. Maternal health necessitates a comprehensive framework enabling continuous monitoring of pregnant women. In this paper, we present an Internet-of-Things (IoT)-based system to provide ubiquitous maternal health monitoring during pregnancy and postpartum. The system consists of various data collectors to track the mother's condition, including stress, sleep, and physical activity. We carried out the full system implementation and conducted a real human subject study on pregnant women in Southwestern Finland. We then evaluated the system's feasibility, energy efficiency, and data reliability. Our results show that the implemented system is feasible in terms of system usage during nine months. We also indicate the smartwatch, used in our study, has acceptable energy efficiency in long-term monitoring and is able to collect reliable photoplethysmography data. Finally, we discuss the integration of the presented system with the current healthcare system.

Assessing the Mental Health of Emerging Adults Through a Mental Health App: Protocol for a Prospective Pilot Study.

BACKGROUND: Individuals can experience different manifestations of the same psychological disorder. This underscores the need for a personalized model approach in the study of psychopathology. Emerging adulthood is a developmental phase wherein individuals are especially vulnerable to psychopathology. Given their exposure to repeated stressors and disruptions in routine, the emerging adult population is worthy of investigation. OBJECTIVE: In our prospective study, we aim to conduct multimodal assessments to determine the feasibility of an individualized approach for understanding the contextual factors of changes in daily affect, sleep, physiology, and activity. In other words, we aim to use event mining to predict changes in mental health. METHODS: We expect to have a final sample size of 20 participants. Recruited participants will be monitored for a period of time (ie, between 3 and 12 months). Participants will download the Personicle app on their smartphone to track their activities (eg, home events and cycling). They will also be given wearable sensor devices (ie, devices that monitor sleep, physiology, and physical activity), which are to be worn continuously. Participants will be asked to report on their daily moods and provide open-ended text responses on a weekly basis. Participants will be given a battery of questionnaires every 3 months. RESULTS: Our study has been approved by an institutional review board. The study is currently in the data collection phase. Due to the COVID-19 pandemic, the study was adjusted to allow for remote data collection and COVID-19-related stress assessments. CONCLUSIONS: Our study will help advance research on individualized approaches to understanding health and well-being through multimodal systems. Our study will also demonstrate the benefit of using individualized approaches to study interrelations among stress, social relationships, technology, and mental health. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/25775.

Objective stress monitoring based on wearable sensors in everyday settings.

Monitoring people's stress levels has become an essential part of behavioural studies for physical and mental illnesses conducted within the biopsychosocial framework. There have been several stress assessment studies in laboratory-based controlled settings. However, the results of these studies do not always translate effectively to an everyday context. The current state of wearable sensor technology allows us to develop systems measuring the physiological signals reflecting stress 24/7 while capturing the context. In this paper, we present a stress monitoring system that provides objective daily stress measurements in everyday settings based on three physiological signals: electrocardiogram (ECG), photoplethysmogram (PPG), and galvanic skin response (GSR) using Shimmer3 ECG, Shimmer3 GSR+, and Empatica E4 wearable sensors. We perform controlled stress assessment experiments on 17 participants in which we successfully detect stress with a 94.55% accuracy for 10-fold cross-validation and an 85.71% accuracy for subject-wise cross-validation. In everyday settings, the system assesses stress with an 81.82% accuracy. We also examine whether motion artefacts affect stress assessment and filter the low-confidence readings to minimise false alarms.