Using Both Time Tradeoff and Discrete Choice Experiments in Valuing the EQ-5D: Impact of Model Misspecification on Value Sets.

Introduction. The EQ-5D-5L valuation protocol contains both time tradeoff (TTO) tasks and discrete choice experiments (DCE), raising the question of how to best use these in creating a value set. The hybrid model, which combines TTO and DCE data, has emerged as a commonly used approach. However, this model assumes independence among responses from the same individual, a linear relationship between TTO and DCE utilities, and, in many implementations, homoscedastic residuals. The aims of this study are to examine alternatives to these assumptions and determine the impact of misspecification on value sets. Methods. We performed a simulation study, parameterized using the US EQ-5D-5L valuation study, to assess the impact of model misspecification. We simulated TTO and DCE data with nonlinear relationships between TTO and DCE utilities, heteroscedastic errors, and correlated responses. Simulated data were analyzed using hybrid models with and without heteroscedasticity, Tobit models with and without heteroscedasticity, a latent class model, and a mixed model. Results. Mean absolute errors (MAEs) for correctly specified models were <0.05, whereas models that incorrectly assumed a linear relationship between TTO and DCE utilities or homoscedasticity of TTO responses featured states with an MAE >0.1. When a linear relationship between TTO and DCE utilities held, using both TTO and DCE data under correct specification yielded smaller MAEs compared with using TTO data alone but yielded larger MAEs when a linear relationship did not hold. Mistakenly assuming homoscedasticity led to increased MAEs, whereas ignoring dependence did not. Conclusions. Because heteroscedasticity in TTO utilities and nonlinear associations between DCE and TTO utilities have been noted, we recommend careful assessment of scedasticity and linearity to ascertain the suitability of a hybrid model.

Sentiment in nursing notes as an indicator of out-of-hospital mortality in intensive care patients.

BACKGROUND: Nursing notes have not been widely used in prediction models for clinical outcomes, despite containing rich information. Advances in natural language processing have made it possible to extract information from large scale unstructured data like nursing notes. This study extracted the sentiment-impressions and attitudes-of nurses, and examined how sentiment relates to 30-day mortality and survival. METHODS: This study applied a sentiment analysis algorithm to nursing notes extracted from MIMIC-III, a public intensive care unit (ICU) database. A multiple logistic regression model was fitted to the data to correlate measured sentiment with 30-day mortality while controlling for gender, type of ICU, and SAPS-II score. The association between measured sentiment and 30-day mortality was further examined in assessing the predictive performance of sentiment score as a feature in a classifier, and in a survival analysis for different levels of measured sentiment. RESULTS: Nursing notes from 27,477 ICU patients, with an overall 30-day mortality of 11.02%, were extracted. In the presence of known predictors of 30-day mortality, mean sentiment polarity was a highly significant predictor in a multiple logistic regression model (Adjusted OR = 0.4626, p < 0.001, 95% CI: [0.4244, 0.5041]) and led to improved predictive accuracy (AUROC = 0.8189 versus 0.8092, 95% BCI of difference: [0.0070, 0.0126]). The Kaplan Meier survival curves showed that mean sentiment polarity quartiles are positively correlated with patient survival (log-rank test: p < 0.001). CONCLUSIONS: This study showed that quantitative measures of unstructured clinical notes, such as sentiment of clinicians, correlate with 30-day mortality and survival, thus can also serve as a predictor of patient outcomes in the ICU. Therefore, further research is warranted to study and make use of the wealth of data that clinical notes have to offer.