Willingness to participate in in-the-moment surveys triggered by online behaviors.

Surveys are a fundamental tool of empirical research, but they suffer from errors: in particular, respondents can have difficulties recalling information of interest to researchers. Recent technological developments offer new opportunities to collect data passively (i.e., without participant's intervention), avoiding recall errors. One of these opportunities is registering online behaviors (e.g., visited URLs) through tracking software ("meter") voluntarily installed by a sample of individuals on their browsing devices. Nevertheless, metered data are also affected by errors and only cover part of the objective information, while subjective information is not directly observable. Asking participants about such missing information by means of web surveys conducted in the moment an event of interest is detected by the meter has the potential to fill the gap. However, this method requires participants to be willing to participate. This paper explores the willingness to participate in in-the-moment web surveys triggered by online activities recorded by a participant-installed meter. A conjoint experiment implemented in an opt-in metered panel in Spain reveals overall high levels of willingness to participate among panelists already sharing metered data, ranging from 69% to 95%. The main aspects affecting this willingness are related to the incentive levels offered. Limited differences across participants are observed, except for household size and education. Answers to open questions also confirm that the incentive is the key driver of the decision to participate, whereas other potential problematic aspects such as the limited time to participate, privacy concerns, and discomfort caused by being interrupted play a limited role.

Protocol for a web survey experiment studying the feasibility of asking respondents to capture and submit photos of the books they have at home and the resulting data quality.

This document presents the protocol of a study conducted as a part of the WEB DATA OPP project, which is funded by the H2020 program. The study aimed to investigate different aspects of the collection of images through web surveys. To do this, we implemented a mobile web survey in an opt-in online panel in Spain. The survey had various questions, some of which were about the books that the participants have at their main residence. The questions related to books were asked in three different ways: regular survey questions showing visual examples of how different numbers of books fit in a 74 centimetre wide shelf depending on their thickness, regular survey questions without the visual examples, and questions where participants were asked to send photos of the books at their home. This report explains how the study was designed and conducted. It covers important aspects such as the experimental design, the questionnaire used, the characteristics of the participants, ethical considerations, and plans for disseminating the results.

This document presents the protocol of our study asking respondents for information about the books they have at home. This information was solicited through conventional types of questions ( i.e., typing in answers or choosing one answer category), and/or through asking respondents to take and send photos of the books. This study has methodological and substantive objectives. The former involves investigating respondents' preference, evaluation of the questions, participation levels, compliance, and data quality. The latter focuses on exploring the impact of the number of books on the academic achievement of children and examining other factors that might influence these relations. We conducted a mobile web survey, assigning respondents to four groups:    â€¢   Choice: Respondents could choose their preferred answering method.    â€¢   Text-TextPlus: Respondents answered conventional questions first, and later received illustrations of how different numbers of books looked like to help respondents provide accurate answers.    â€¢   TextPlus-Images: Respondents answered conventional questions with the illustrations and then submitted photos of the books at home.    â€¢   Images-Text: Respondents shared photos of the books and then answered the conventional questions. Respondents were asked to evaluate their respective answering methods. The questionnaire had up to 65 questions covering various dimensions, including respondents' sociodemographic characteristics, children's academic performance, literacy-related activities, and camera usage. Data were collected using the Netquest opt-in online panel in Spain. The tool WebdataVisual was used to capture and share the photos. The target population included parents of children living with them and who attended the first, third, or fifth year of primary school. The sample size was 1,202 cases. We expect this study to provide valuable insights regarding visual data collection through web surveys. Further, we expect to gain a better understanding of the data on the books respondents have at home when such data are collected through different methods.

A new experiment on the use of images to answer web survey questions.

Images might provide richer and more objective information than text answers to open-ended survey questions. Little is known, nonetheless, about the consequences for data quality of asking participants to answer open-ended questions with images. Therefore, this paper addresses three research questions: (1) What is the effect of answering web survey questions with images instead of text on breakoff, noncompliance with the task, completion time and question evaluation? (2) What is the effect of including a motivational message on these four aspects? (3) Does the impact of asking to answer with images instead of text vary across device types? To answer these questions, we implemented a 2 × 3 between-subject web survey experiment (N = 3043) in Germany. Half of the sample was required to answer using PCs and the other half with smartphones. Within each device group, respondents were randomly assigned to (1) a control group answering open-ended questions with text; (2) a treatment group answering open-ended questions with images; and (3) another treatment group answering open-ended questions with images but prompted with a motivational message. Results show that asking participants to answer with images significantly increases participants' likelihood of noncompliance as well as their completion times, while worsening their overall survey experience. Including motivational messages, moreover, moderately reduces the likelihood of noncompliance. Finally, the likelihood of noncompliance is similar across devices.

When survey science met web tracking: Presenting an error framework for metered data.

Metered data, also called web-tracking data, are generally collected from a sample of participants who willingly install or configure, onto their devices, technologies that track digital traces left when people go online (e.g., URLs visited). Since metered data allow for the observation of online behaviours unobtrusively, it has been proposed as a useful tool to understand what people do online and what impacts this might have on online and offline phenomena. It is crucial, nevertheless, to understand its limitations. Although some research have explored the potential errors of metered data, a systematic categorisation and conceptualisation of these errors are missing. Inspired by the Total Survey Error, we present a Total Error framework for digital traces collected with Meters (TEM). The TEM framework (1) describes the data generation and the analysis process for metered data and (2) documents the sources of bias and variance that may arise in each step of this process. Using a case study we also show how the TEM can be applied in real life to identify, quantify and reduce metered data errors. Results suggest that metered data might indeed be affected by the error sources identified in our framework and, to some extent, biased. This framework can help improve the quality of both stand-alone metered data research projects, as well as foster the understanding of how and when survey and metered data can be combined.

Understanding the role of disease knowledge and risk perception in shaping preventive behavior for selected vector-borne diseases in Guyana.

BACKGROUND: Individual behavior, particularly choices about prevention, plays a key role in infection transmission of vector-borne diseases (VBDs). Since the actual risk of infection is often uncertain, individual behavior is influenced by the perceived risk. A low risk perception is likely to diminish the use of preventive measures (behavior). If risk perception is a good indicator of the actual risk, then it has important implications in a context of disease elimination. However, more research is needed to improve our understanding of the role of human behavior in disease transmission. The objective of this study is to explore whether preventive behavior is responsive to risk perception, taking into account the links with disease knowledge and controlling for individuals' socioeconomic and demographic characteristics. More specifically, the study focuses on malaria, dengue fever, Zika and cutaneous leishmaniasis (CL), using primary data collected in Guyana-a key country for the control and/or elimination of VBDs, given its geographic location. METHODS AND FINDINGS: The data were collected between August and December 2017 in four regions of the country. Questions on disease knowledge, risk perception and self-reported use of preventive measures were asked to each participant for the four diseases. A structural equation model was estimated. It focused on data collected from private households only in order to control for individuals' socioeconomic and demographic characteristics, which led to a sample size of 497 participants. The findings showed evidence of a bidirectional association between risk perception and behavior. A one-unit increase in risk perception translated into a 0.53 unit increase in self-reported preventive behavior for all diseases, while a one-unit increase in self-reported preventive behavior (i.e. the use of an additional measure) led to a 0.46 unit decrease in risk perception for all diseases (except CL). This study also showed that higher education significantly improves knowledge and that better knowledge increases the take up of preventive measures for malaria and dengue, without affecting risk perception. CONCLUSIONS: In trying to reach elimination, it appears crucial to promote awareness of the risks and facilitate access to preventive measures, so that lower risk perception does not translate into lower preventive behavior.