These Aren't The Droids You Are Looking for: Promises and Challenges for the Intersection of Affective Science and Robotics/AI.

AI research focused on interactions with humans, particularly in the form of robots or virtual agents, has expanded in the last two decades to include concepts related to affective processes. Affective computing is an emerging field that deals with issues such as how the diagnosis of affective states of users can be used to improve such interactions, also with a view to demonstrate affective behavior towards the user. This type of research often is based on two beliefs: (1) artificial emotional intelligence will improve human computer interaction (or more specifically human robot interaction), and (2) we understand the role of affective behavior in human interaction sufficiently to tell artificial systems what to do. However, within affective science the focus of research is often to test a particular assumption, such as "smiles affect liking." Such focus does not provide the information necessary to synthesize affective behavior in long dynamic and real-time interactions. In consequence, theories do not play a large role in the development of artificial affective systems by engineers, but self-learning systems develop their behavior out of large corpora of recorded interactions. The status quo is characterized by measurement issues, theoretical lacunae regarding prevalence and functions of affective behavior in interaction, and underpowered studies that cannot provide the solid empirical foundation for further theoretical developments. This contribution will highlight some of these challenges and point towards next steps to create a rapprochement between engineers and affective scientists with a view to improving theory and solid applications.

More What Duchenne Smiles Do, Less What They Express.

We comment on an article by Sheldon et al. from a previous issue of Perspectives (May 2021). They argued that the presence of positive emotion (Hypothesis 1), the intensity of positive emotion (Hypothesis 2), and chronic positive mood (Hypothesis 3) are reliably signaled by the Duchenne smile (DS). We reexamined the cited literature in support of each hypothesis and show that the study findings were mostly inconclusive, irrelevant, incomplete, and/or misread. In fact, there is no single (empirical) article that would unanimously support the idea that DSs function solely as indicators of felt positive affect. Additional evidence is reviewed, suggesting that DSs can be-and often are-displayed deliberately and in the absence of positive feelings. Although DSs may lead to favorable interpersonal perceptions and positive emotional responses in the observer, we propose a functional view that focuses on what facial actions-here specifically DSs-do rather than what they express.

Social neuroscience is more than the study of the human brain: The legacy of John Cacioppo.

John Cacioppo passed away in 2018, leaving a legacy of profound methodological, theoretical, and inferential contributions to social neuroscience. This paper serves as an introduction to the nine articles that comprise this special issue in honor of John Cacioppo's work in social neuroscience. Although he made many contributions to psychology, here we briefly review four milestones in Cacioppo's career that had important implications specifically for the development of social neuroscience today: (1) an early research focus on cardiovascular and facial EMG measurement, (2) the training of others, (3) the importance of sound inference, and (4) the definition of social neuroscience. In sum, we argue that John Cacioppo envisioned social neuroscience as having multiple levels of explanation and requiring multiple kinds of physiological evidence. It is not all just the brain!

Examining subjective and physiological responses to norm violation using text-based vignettes.

In this article, we describe a paradigm using text-based vignettes for the study of social and cultural norm violation. Towards this aim, a range of scenarios depicting instances of norm violations was generated and tested with respect to their ability in evoking subjective and physiological responses. In Experiment 1, participants evaluated 29 vignettes on how upsetting, excusable and realistic the described behaviour appeared to be. Based on those ratings we selected and extended three norm violation vignettes for Experiment 2 in which participants' physiological responses were obtained in addition to their subjective ratings. In both studies, the vignettes were successful in eliciting negative responses to norm violations and were significantly affected by the perceivers' level of ethnocultural empathy. The trait measure of cultural empathy further predicted facial electromyography (EMG) activity at muscle sites associated with disgust (M. Levator Labii), thereby suggesting a potential moral response to norm-violating scenarios. We discuss the methodological merits and implications of this vignettes paradigm for investigating perceived norm transgressions and make recommendations for future work.

Help or hindrance? Day-level relationships between flextime use, work-nonwork boundaries, and affective well-being.

Flexible working time arrangements are becoming increasingly popular around the globe, but do they actually benefit employees? To address this question, we take a differentiated look at employees' day-specific use of flextime and its effect on the intersection of work and nonwork life. Specifically, we examined whether links between day-specific flextime use and affective well-being at work and at home can be explained by level of goal completion and the subjective boundaries around one's work and private life domains (i.e., the strength of work-nonwork boundaries). During 2 consecutive workweeks, 150 bank employees from various functions (Study 1) and a heterogeneous sample of 608 employees (Study 2) reported their day-specific use of flextime, boundary strength at work and home, and affective well-being in the evening and the next day. Multilevel structural equation modeling of 2,223 (Study 1) and 3,164 (Study 2) observations revealed that flextime use was associated with stronger boundaries at home in both studies and stronger boundaries at work in Study 2. Stronger boundaries were, in turn, positively associated with affective well-being, both in the same evening and the next day. Study 2 further revealed that day-specific nonwork goal completion mediated the positive association between daily flextime use and boundary strength at work. However, whereas occasional flextime use had unequivocal positive consequences, chronic flextime use undermined the completion of work goals. Overall, findings suggest that flextime use benefits employees when used in moderation. (PsycINFO Database Record

The dynamics of emotions in online interaction.

We study the changes in emotional states induced by reading and participating in online discussions, empirically testing a computational model of online emotional interaction. Using principles of dynamical systems, we quantify changes in valence and arousal through subjective reports, as recorded in three independent studies including 207 participants (110 female). In the context of online discussions, the dynamics of valence and arousal is composed of two forces: an internal relaxation towards baseline values independent of the emotional charge of the discussion and a driving force of emotional states that depends on the content of the discussion. The dynamics of valence show the existence of positive and negative tendencies, while arousal increases when reading emotional content regardless of its polarity. The tendency of participants to take part in the discussion increases with positive arousal. When participating in an online discussion, the content of participants' expression depends on their valence, and their arousal significantly decreases afterwards as a regulation mechanism. We illustrate how these results allow the design of agent-based models to reproduce and analyse emotions in online communities. Our work empirically validates the microdynamics of a model of online collective emotions, bridging online data analysis with research in the laboratory.

Facial Skin Smoothness as an Indicator of Perceived Trustworthiness and Related Traits.

Facial texture has typically been studied as an umbrella phenomenon comprising several properties, such as skin tone and smoothness. Furthermore, texture has normally been addressed within complex models including also structural and dynamic properties and focusing on the extraction of perceptual dimensions from large numbers of physical and personality traits. It is yet unclear how individual facial textural properties affect the perception of individual physical and personality traits. We took a step in this direction by showing that the manipulation of a single facial textural property (skin smoothness) affected explicit evaluations of trustworthiness, competence, attractiveness, and health independently and in combination. Within the context of skin smoothness, our data also suggest a direct perceptual route for physical and an indirect perceptual route for personality traits.

Real or Artificial? Intergroup Biases in Mind Perception in a Cross-Cultural Perspective.

Recent research suggests that attributions of aliveness and mental capacities to faces are influenced by social group membership. In this article, we investigated group related biases in mind perception in participants from a Western and Eastern culture, employing faces of varying ethnic groups. In Experiment 1, Caucasian faces that ranged on a continuum from real to artificial were evaluated by participants in the UK (in-group) and in India (out-group) on animacy, abilities to plan and to feel pain, and having a mind. Human features were found to be assigned to a greater extent to faces when these belonged to in-group members, whereas out-group faces had to appear more realistic in order to be perceived as human. When participants in India evaluated South Asian (in-group) and Caucasian (out-group) faces in Experiment 2, the results closely mirrored those of the first experiment. For both studies, ratings of out-group faces were significantly predicted by participants' levels of ethnocultural empathy. The findings highlight the role of intergroup processes (i.e., in-group favoritism, out-group dehumanization) in the perception of human and mental qualities and point to ethnocultural empathy as an important factor in responses to out-groups.

Social regulation of emotion: messy layers.

Emotions are evolved systems of intra- and interpersonal processes that are regulatory in nature, dealing mostly with issues of personal or social concern. They regulate social interaction and in extension, the social sphere. In turn, processes in the social sphere regulate emotions of individuals and groups. In other words, intrapersonal processes project in the interpersonal space, and inversely, interpersonal experiences deeply influence intrapersonal processes. Thus, I argue that the concepts of emotion generation and regulation should not be artificially separated. Similarly, interpersonal emotions should not be reduced to interacting systems of intraindividual processes. Instead, we can consider emotions at different social levels, ranging from dyads to large scale e-communities. The interaction between these levels is complex and does not only involve influences from one level to the next. In this sense the levels of emotion/regulation are messy and a challenge for empirical study. In this article, I discuss the concepts of emotions and regulation at different intra- and interpersonal levels. I extend the concept of auto-regulation of emotions (Kappas, 2008, 2011a,b) to social processes. Furthermore, I argue for the necessity of including mediated communication, particularly in cyberspace in contemporary models of emotion/regulation. Lastly, I suggest the use of concepts from systems dynamics and complex systems to tackle the challenge of the "messy layers."

Collective emotions online and their influence on community life.

BACKGROUND: E-communities, social groups interacting online, have recently become an object of interdisciplinary research. As with face-to-face meetings, Internet exchanges may not only include factual information but also emotional information--how participants feel about the subject discussed or other group members. Emotions in turn are known to be important in affecting interaction partners in offline communication in many ways. Could emotions in Internet exchanges affect others and systematically influence quantitative and qualitative aspects of the trajectory of e-communities? The development of automatic sentiment analysis has made large scale emotion detection and analysis possible using text messages collected from the web. However, it is not clear if emotions in e-communities primarily derive from individual group members' personalities or if they result from intra-group interactions, and whether they influence group activities. METHODOLOGY/PRINCIPAL FINDINGS: Here, for the first time, we show the collective character of affective phenomena on a large scale as observed in four million posts downloaded from Blogs, Digg and BBC forums. To test whether the emotions of a community member may influence the emotions of others, posts were grouped into clusters of messages with similar emotional valences. The frequency of long clusters was much higher than it would be if emotions occurred at random. Distributions for cluster lengths can be explained by preferential processes because conditional probabilities for consecutive messages grow as a power law with cluster length. For BBC forum threads, average discussion lengths were higher for larger values of absolute average emotional valence in the first ten comments and the average amount of emotion in messages fell during discussions. CONCLUSIONS/SIGNIFICANCE: Overall, our results prove that collective emotional states can be created and modulated via Internet communication and that emotional expressiveness is the fuel that sustains some e-communities.

Facial dynamics as indicators of trustworthiness and cooperative behavior.

Detecting cooperative partners in situations that have financial stakes is crucial to successful social exchange. The authors tested whether humans are sensitive to subtle facial dynamics of counterparts when deciding whether to trust and cooperate. Participants played a 2-person trust game before which the facial dynamics of the other player were manipulated using brief (<6 s) but highly realistic facial animations. Results showed that facial dynamics significantly influenced participants' (a) choice of with whom to play the game and (b) decisions to cooperate. It was also found that inferences about the other player's trustworthiness mediated these effects of facial dynamics on cooperative behavior.

Effects of focusing and distraction on cold pressor-induced pain in chronic back pain patients and control subjects.

UNLABELLED: Previous studies showed equivocal findings regarding the efficacy of focused attention and distraction to experimental pain. This study examined the relative efficacy of these strategies on perception of cold pressor pain in 41 chronic back pain patients and 41 healthy control participants. Participants were randomized to the 2 strategies and then completed a 7-minute cold pressor test. Pain intensity and discomfort ratings were obtained during the task. Participants who completed the first task were asked to complete a second cold pressor task without instructions. Pain and discomfort ratings differed by condition across time. In the distraction condition, pain levels started low but continued to rise throughout the cold pressor immersion, whereas in the focused attention condition, pain levels started higher, rose less quickly, and then decreased from the middle of the task. Focused attention was associated with higher pain and lower completion rates in chronic pain patients compared with healthy control subjects. Focused attention might therefore not be an effective intervention strategy for individuals with chronic back pain. Finally, in the second cold pressor test, patients' pain reports rose more rapidly than those of healthy control subjects. The results of this study can be explained in terms of differences in cognitive appraisal between pain patients and healthy control participants. PERSPECTIVE: Marked differences were found between chronic back pain patients and control participants regarding focused attention as compared with distraction as a means of coping with cold pressor-induced pain. These differences underline the importance of taking into account previous experience with pain when recommending strategies to cope with painful procedures.

The science of emotion as a multidisciplinary research paradigm.

I discuss the emergence of a science of emotion and argue that research in this domain requires an appreciation of the organization of emotional processes at different levels as postulated by social neuroscience. Emotions cannot be understood without relying on a program of multidisciplinary research. Local multidisciplinarity cannot be achieved without a programmatic framework that takes three issues into account (1) the relationship of multiple levels of emotions and connected processes, (2) the mutually informative study of humans, animals, and artificial systems, and (3) the dynamic nature of emotions in a dynamic systems approach. Illustrations for my arguments are provided relating to facial expressions of humans.