Your browser doesn't support javascript.
Detecting deception using machine learning with facial expressions and pulse rate.
Tsuchiya, Kento; Hatano, Ryo; Nishiyama, Hiroyuki.
  • Tsuchiya K; 2641 Yamazaki Noda, Chiba Japan Department of Industrial Administration, Graduate School of Science and Technology, Tokyo University of Science.
  • Hatano R; 2641 Yamazaki Noda, Chiba Japan Department of Industrial Administration, Graduate School of Science and Technology, Tokyo University of Science.
  • Nishiyama H; 2641 Yamazaki Noda, Chiba Japan Department of Industrial Administration, Graduate School of Science and Technology, Tokyo University of Science.
Artif Life Robot ; : 1-11, 2023 Apr 28.
Article in English | MEDLINE | ID: covidwho-2319982
ABSTRACT
Given the ongoing COVID-19 pandemic, remote interviews have become an increasingly popular approach in many fields. For example, a survey by the HR Research Institute (PCR Institute in Survey on hiring activities for graduates of 2021 and 2022. https//www.hrpro.co.jp/research_detail.php?r_no=273. Accessed 03 Oct 2021) shows that more than 80% of job interviews are conducted remotely, particularly in large companies. However, for some reason, an interviewee might attempt to deceive an interviewer or feel difficult to tell the truth. Although the ability of interviewers to detect deception among interviewees is significant for their company or organization, it still strongly depends on their individual experience and cannot be automated. To address this issue, in this study, we propose a machine learning approach to aid in detecting whether a person is attempting to deceive the interlocutor by associating the features of their facial expressions with those of their pulse rate. We also constructed a more realistic dataset for the task of deception detection by asking subjects not to respond artificially, but rather to improvise natural responses using a web camera and wearable device (smartwatch). The results of an experimental evaluation of the proposed approach with 10-fold cross-validation using random forests classifier show that the accuracy and the F1 value were in the range between 0.75 and 0.8 for each subject, and the highest values were 0.87 and 0.88, respectively. Through the analysis of the importance of the features the trained models, we revealed the crucial features of each subject during deception, which differed among the subjects.
Keywords

Full text: Available Collection: International databases Database: MEDLINE Language: English Journal: Artif Life Robot Year: 2023 Document Type: Article

Similar

MEDLINE

...
LILACS

LIS


Full text: Available Collection: International databases Database: MEDLINE Language: English Journal: Artif Life Robot Year: 2023 Document Type: Article