Early Warning Scores to Support Continuous Wireless Vital Sign Monitoring for Complication Prediction in Patients on Surgical Wards: Retrospective Observational Study.

BACKGROUND: Wireless vital sign sensors are increasingly being used to monitor patients on surgical wards. Although early warning scores (EWSs) are the current standard for the identification of patient deterioration in a ward setting, their usefulness for continuous monitoring is unknown. OBJECTIVE: This study aimed to explore the usability and predictive value of high-rate EWSs obtained from continuous vital sign recordings for early identification of postoperative complications and compares the performance of a sensor-based EWS alarm system with manual intermittent EWS measurements and threshold alarms applied to individual vital sign recordings (single-parameter alarms). METHODS: Continuous vital sign measurements (heart rate, respiratory rate, blood oxygen saturation, and axillary temperature) collected with wireless sensors in patients on surgical wards were used for retrospective simulation of EWSs (sensor EWSs) for different time windows (1-240 min), adopting criteria similar to EWSs based on manual vital signs measurements (nurse EWSs). Hourly sensor EWS measurements were compared between patients with (event group: 14/46, 30%) and without (control group: 32/46, 70%) postoperative complications. In addition, alarms were simulated for the sensor EWSs using a range of alarm thresholds (1-9) and compared with alarms based on nurse EWSs and single-parameter alarms. Alarm performance was evaluated using the sensitivity to predict complications within 24 hours, daily alarm rate, and false discovery rate (FDR). RESULTS: The hourly sensor EWSs of the event group (median 3.4, IQR 3.1-4.1) was significantly higher (P<.004) compared with the control group (median 2.8, IQR 2.4-3.2). The alarm sensitivity of the hourly sensor EWSs was the highest (80%-67%) for thresholds of 3 to 5, which was associated with alarm rates of 2 (FDR=85%) to 1.2 (FDR=83%) alarms per patient per day respectively. The sensitivity of sensor EWS-based alarms was higher than that of nurse EWS-based alarms (maximum=40%) but lower than that of single-parameter alarms (87%) for all thresholds. In contrast, the (false) alarm rates of sensor EWS-based alarms were higher than that of nurse EWS-based alarms (maximum=0.6 alarm/patient/d; FDR=80%) but lower than that of single-parameter alarms (2 alarms/patient/d; FDR=84%) for most thresholds. Alarm rates for sensor EWSs increased for shorter time windows, reaching 70 alarms per patient per day when calculated every minute. CONCLUSIONS: EWSs obtained using wireless vital sign sensors may contribute to the early recognition of postoperative complications in a ward setting, with higher alarm sensitivity compared with manual EWS measurements. Although hourly sensor EWSs provide fewer alarms compared with single-parameter alarms, high false alarm rates can be expected when calculated over shorter time spans. Further studies are recommended to optimize care escalation criteria for continuous monitoring of vital signs in a ward setting and to evaluate the effects on patient outcomes.

Predicting deterioration of patients with early sepsis at the emergency department using continuous heart rate variability analysis: a model-based approach.

BACKGROUND: Sepsis is a life-threatening disease with an in-hospital mortality rate of approximately 20%. Physicians at the emergency department (ED) have to estimate the risk of deterioration in the coming hours or days and decide whether the patient should be admitted to the general ward, ICU or can be discharged. Current risk stratification tools are based on measurements of vital parameters at a single timepoint. Here, we performed a time, frequency, and trend analysis on continuous electrocardiograms (ECG) at the ED to try and predict deterioration of septic patients. METHODS: Patients were connected to a mobile bedside monitor that continuously recorded ECG waveforms from triage at the ED up to 48 h. Patients were post-hoc stratified into three groups depending on the development of organ dysfunction: no organ dysfunction, stable organ dysfunction or progressive organ dysfunction (i.e., deterioration). Patients with de novo organ dysfunction and those admitted to the ICU or died were also stratified to the group of progressive organ dysfunction. Heart rate variability (HRV) features over time were compared between the three groups. RESULTS: In total 171 unique ED visits with suspected sepsis were included between January 2017 and December 2018. HRV features were calculated over 5-min time windows and summarized into 3-h intervals for analysis. For each interval, the mean and slope of each feature was calculated. Of all analyzed features, the average of the NN-interval, ultra-low frequency, very low frequency, low frequency and total power were different between the groups at multiple points in time. CONCLUSIONS: We showed that continuous ECG recordings can be automatically analyzed and used to extract HRV features associated with clinical deterioration in sepsis. The predictive accuracy of our current model based on HRV features derived from the ECG only shows the potential of HRV measurements at the ED. Unlike other risk stratification tools employing multiple vital parameters this does not require manual calculation of the score and can be used on continuous data over time. Trial registration The protocol of this study is published by Quinten et al., 2017.

Missing data imputation techniques for wireless continuous vital signs monitoring.

Wireless vital signs sensors are increasingly used for remote patient monitoring, but data analysis is often challenged by missing data periods. This study explored the performance of various imputation techniques for continuous vital signs measurements. Wireless vital signs measurements (heart rate, respiratory rate, blood oxygen saturation, axillary temperature) from surgical ward patients were used for repeated random simulation of missing data periods (gaps) of 5-60 min in two-hour windows. Gaps were imputed using linear interpolation, spline interpolation, last observation- and mean carried forwards technique, and cluster-based prognosis. Imputation performance was evaluated using the mean absolute error (MAE) between original and imputed gap samples. Besides, effects on signal features (window's slope, mean) and early warning scores (EWS) were explored. Gaps were simulated in 1743 data windows, obtained from 52 patients. Although MAE ranges overlapped, median MAE was structurally lowest for linear interpolation (heart rate: 0.9-2.6 beats/min, respiratory rate: 0.8-1.8 breaths/min, temperature: 0.04-0.17 °C, oxygen saturation: 0.3-0.7% for 5-60 min gaps) but up to twice as high for other techniques. Three techniques resulted in larger ranges of signal feature bias compared to no imputation. Imputation led to EWS misclassification in 1-8% of all simulations. Imputation error ranges vary between imputation techniques and increase with gap length. Imputation may result in larger signal feature bias compared to performing no imputation, and can affect patient risk assessment as illustrated by the EWS. Accordingly, careful implementation and selection of imputation techniques is warranted.

Surveillance of high-risk early postsurgical patients for real-time detection of complications using wireless monitoring (SHEPHERD study): results of a randomized multicenter stepped wedge cluster trial.

Background: Vital signs measurements on the ward are performed intermittently. This could lead to failure to rapidly detect patients with deteriorating vital signs and worsens long-term outcome. The aim of this study was to test the hypothesis that continuous wireless monitoring of vital signs on the postsurgical ward improves patient outcome. Methods: In this prospective, multicenter, stepped-wedge cluster randomized study, patients in the control group received standard monitoring. The intervention group received continuous wireless monitoring of heart rate, respiratory rate and temperature on top of standard care. Automated alerts indicating vital signs deviation from baseline were sent to ward nurses, triggering the calculation of a full early warning score followed. The primary outcome was the occurrence of new disability three months after surgery. Results: The study was terminated early (at 57% inclusion) due to COVID-19 restrictions. Therefore, only descriptive statistics are presented. A total of 747 patients were enrolled in this study and eligible for statistical analyses, 517 patients in the control group and 230 patients in the intervention group, the latter only from one hospital. New disability at three months after surgery occurred in 43.7% in the control group and in 39.1% in the intervention group (absolute difference 4.6%). Conclusion: This is the largest randomized controlled trial investigating continuous wireless monitoring in postoperative patients. While patients in the intervention group seemed to experience less (new) disability than patients in the control group, results remain inconclusive with regard to postoperative patient outcome due to premature study termination. Clinical trial registration: ClinicalTrials.gov, ID: NCT02957825.

Continuous Monitoring of Vital Signs With Wearable Sensors During Daily Life Activities: Validation Study.

BACKGROUND: Continuous telemonitoring of vital signs in a clinical or home setting may lead to improved knowledge of patients' baseline vital signs and earlier detection of patient deterioration, and it may also facilitate the migration of care toward home. Little is known about the performance of available wearable sensors, especially during daily life activities, although accurate technology is critical for clinical decision-making. OBJECTIVE: The aim of this study is to assess the data availability, accuracy, and concurrent validity of vital sign data measured with wearable sensors in volunteers during various daily life activities in a simulated free-living environment. METHODS: Volunteers were equipped with 4 wearable sensors (Everion placed on the left and right arms, VitalPatch, and Fitbit Charge 3) and 2 reference devices (Oxycon Mobile and iButton) to obtain continuous measurements of heart rate (HR), respiratory rate (RR), oxygen saturation (SpO2), and temperature. Participants performed standardized activities, including resting, walking, metronome breathing, chores, stationary cycling, and recovery afterward. Data availability was measured as the percentage of missing data. Accuracy was evaluated by the median absolute percentage error (MAPE) and concurrent validity using the Bland-Altman plot with mean difference and 95% limits of agreement (LoA). RESULTS: A total of 20 volunteers (median age 64 years, range 20-74 years) were included. Data availability was high for all vital signs measured by VitalPatch and for HR and temperature measured by Everion. Data availability for HR was the lowest for Fitbit (4807/13,680, 35.14% missing data points). For SpO2 measured by Everion, median percentages of missing data of up to 100% were noted. The overall accuracy of HR was high for all wearable sensors, except during walking. For RR, an overall MAPE of 8.6% was noted for VitalPatch and that of 18.9% for Everion, with a higher MAPE noted during physical activity (up to 27.1%) for both sensors. The accuracy of temperature was high for VitalPatch (MAPE up to 1.7%), and it decreased for Everion (MAPE from 6.3% to 9%). Bland-Altman analyses showed small mean differences of VitalPatch for HR (0.1 beats/min [bpm]), RR (-0.1 breaths/min), and temperature (0.5 °C). Everion and Fitbit underestimated HR up to 5.3 (LoA of -39.0 to 28.3) bpm and 11.4 (LoA of -53.8 to 30.9) bpm, respectively. Everion had a small mean difference with large LoA (-10.8 to 10.4 breaths/min) for RR, underestimated SpO2 (>1%), and overestimated temperature up to 2.9 °C. CONCLUSIONS: Data availability, accuracy, and concurrent validity of the studied wearable sensors varied and differed according to activity. In this study, the accuracy of all sensors decreased with physical activity. Of the tested sensors, VitalPatch was found to be the most accurate and valid for vital signs monitoring.

Adaptive threshold-based alarm strategies for continuous vital signs monitoring.

Continuous vital signs monitoring in post-surgical ward patients may support early detection of clinical deterioration, but novel alarm approaches are required to ensure timely notification of abnormalities and prevent alarm-fatigue. The current study explored the performance of classical and various adaptive threshold-based alarm strategies to warn for vital sign abnormalities observed during development of an adverse event. A classical threshold-based alarm strategy used for continuous vital signs monitoring in surgical ward patients was evaluated retrospectively. Next, (combinations of) six methods to adapt alarm thresholds to personal or situational factors were simulated in the same dataset. Alarm performance was assessed using the overall alarm rate and sensitivity to detect adverse events. Using a wireless patch-based monitoring system, 3999 h of vital signs data was obtained in 39 patients. The clinically used classical alarm system produced 0.49 alarms/patient/day, and alarms were generated for 11 out of 18 observed adverse events. Each of the tested adaptive strategies either increased sensitivity to detect adverse events or reduced overall alarm rate. Combining specific strategies improved overall performance most and resulted in earlier presentation of alarms in case of adverse events. Strategies that adapt vital sign alarm thresholds to personal or situational factors may improve early detection of adverse events or reduce alarm rates as compared to classical alarm strategies. Accordingly, further investigation of the potential of adaptive alarms for continuous vital signs monitoring in ward patients is warranted.

Expectations of Continuous Vital Signs Monitoring for Recognizing Complications After Esophagectomy: Interview Study Among Nurses and Surgeons.

BACKGROUND: Patients undergoing esophagectomy are at serious risk of developing postoperative complications. To support early recognition of clinical deterioration, wireless sensor technologies that enable continuous vital signs monitoring in a ward setting are emerging. OBJECTIVE: This study explored nurses' and surgeons' expectations of the potential effectiveness and impact of continuous wireless vital signs monitoring in patients admitted to the ward after esophagectomy. METHODS: Semistructured interviews were conducted at 3 esophageal cancer centers in the Netherlands. In each center, 2 nurses and 2 surgeons were interviewed regarding their expectations of continuous vital signs monitoring for early recognition of complications after esophagectomy. Historical data of patient characteristics and clinical outcomes were collected in each center and presented to the local participants to support estimations on clinical outcome. RESULTS: The majority of nurses and surgeons expected that continuous vital signs monitoring could contribute to the earlier recognition of deterioration and result in earlier treatment for postoperative complications, although the effective time gain would depend on patient and situational factors. Their expectations regarding the impact of potential earlier diagnosis on clinical outcomes varied. Nevertheless, most caregivers would consider implementing continuous monitoring in the surgical ward to support patient monitoring after esophagectomy. CONCLUSIONS: Caregivers expected that wireless vital signs monitoring would provide opportunities for early detection of postoperative complications in patients undergoing esophagectomy admitted to the ward and prevent sequelae under certain circumstances. As the technology matures, clinical outcome studies will be necessary to objectify these expectations and further investigate overall effects on patient outcome.

Wireless Remote Home Monitoring of Vital Signs in Patients Discharged Early After Esophagectomy: Observational Feasibility Study.

BACKGROUND: Hospital stays after major surgery are shorter than ever before. Although enhanced recovery and early discharge have many benefits, some complications will now first manifest themselves in home settings. Remote patient monitoring with wearable sensors in the first days after hospital discharge may capture clinical deterioration earlier but is largely uncharted territory. OBJECTIVE: This study aimed to assess the technical feasibility of patients, discharged after esophagectomy, being remotely monitored at home with a wireless patch sensor and the experiences of these patients. In addition, we determined whether observing vital signs with a wireless patch sensor influences clinical decision making. METHODS: In an observational feasibility study, vital signs of patients were monitored with a wearable patch sensor (VitalPatch, VitalConnect Inc) during the first 7 days at home after esophagectomy and discharge from hospital. Vital signs trends were shared with the surgical team once a day, and they were asked to check the patient's condition by phone each morning. Patient experiences were evaluated with a questionnaire, and technical feasibility was analyzed on a daily basis as the percentage of data loss and gap durations. In addition, the number of patients for whom a change in clinical decision was made based on the results of remote vital signs monitoring at home was assessed. RESULTS: Patients (N=20) completed 7 days each of home monitoring with the wearable patch sensor. Each of the patients had good recovery at home, and remotely observed vital signs trends did not alter clinical decision making. Patients appreciated that surgeons checked their vital signs daily (mean 4.4/5) and were happy to be called by the surgical team each day (mean 4.5/5). Wearability of the patch was high (mean 4.4/5), and no reports of skin irritation were mentioned. Overall data loss of vital signs measurements at home was 25%; both data loss and gap duration varied considerably among patients. CONCLUSIONS: Remote monitoring of vital signs combined with telephone support from the surgical team was feasible and well perceived by all patients. Future studies need to evaluate the impact of home monitoring on patient outcome as well as the cost-effectiveness of this new approach.