What's on your plate? Collecting multimodal data to understand commensal behavior.

Eating is a fundamental part of human life and is, more than anything, a social activity. A new field, known as Computational Commensality has been created to computationally address various social aspects of food and eating. This paper illustrates a study on remote dining we conducted online in May 2021. To better understand this phenomenon, known as Digital Commensality, we recorded 11 pairs of friends sharing a meal online through a videoconferencing app. In the videos, participants consume a plate of pasta while chatting with a friend or a family member. After the remote dinner, participants were asked to fill in the Digital Commensality questionnaire, a validated questionnaire assessing the effects of remote commensal experiences, and provide their opinions on the shortcomings of currently available technologies. Besides presenting the study, the paper introduces the first Digital Commensality Data-set, containing videos, facial landmarks, quantitative and qualitative responses. After surveying multimodal data-sets and corpora that we could exploit to understand commensal behavior, we comment on the feasibility of using remote meals as a source to build data-sets to investigate commensal behavior. Finally, we explore possible future research directions emerging from our results.

An Emotional Agent for Moral Impairment Rehabilitation in TBI Patients.

The ability to identify the emotions of others is a key component of what is known as social cognition. Narratives exploit this mechanism to create an emotional bond with the characters and to maintain the engagement of the audience throughout the story. In this paper, we illustrate a case study in emotion understanding in stories that exploits a computational agent to explore emotion impairment in a group of traumatic brain injured people. The study focuses on moral emotions, aiming to investigate the differences in moral functioning that characterize traumatic brain injured patients. After comparing the understanding of the moral and emotional facets of the agent's behavior in traumatic brain injured patients and in neurologically intact controls, slight-yet meaningful-differences were observed between the two groups. We describe the test methodology and results, highlighting their implications for the design of rehabilitation applications based on virtual agents.

Computational Commensality: From Theories to Computational Models for Social Food Preparation and Consumption in HCI.

Food and eating are inherently social activities taking place, for example, around the dining table at home, in restaurants, or in public spaces. Enjoying eating with others, often referred to as "commensality," positively affects mealtime in terms of, among other factors, food intake, food choice, and food satisfaction. In this paper we discuss the concept of "Computational Commensality," that is, technology which computationally addresses various social aspects of food and eating. In the past few years, Human-Computer Interaction started to address how interactive technologies can improve mealtimes. However, the main focus has been made so far on improving the individual's experience, rather than considering the inherently social nature of food consumption. In this survey, we first present research from the field of social psychology on the social relevance of Food- and Eating-related Activities (F&EA). Then, we review existing computational models and technologies that can contribute, in the near future, to achieving Computational Commensality. We also discuss the related research challenges and indicate future applications of such new technology that can potentially improve F&EA from the commensality perspective.