Your browser doesn't support javascript.
loading
Assessment of supervised classifiers for the task of detecting messages with suicidal ideation.
Acuña Caicedo, Roberto Wellington; Gómez Soriano, José Manuel; Melgar Sasieta, Héctor Andrés.
Affiliation
  • Acuña Caicedo RW; Carrera de Tecnología de la Información, Universidad Estatal del Sur de Manabí, Ecuador.
  • Gómez Soriano JM; Departamento de Ingeniería, Sección de Ingeniería Informática, Escuela de Posgrado, Pontificia Universidad Católica del Perú, Lima, Peru.
  • Melgar Sasieta HA; iLife Company, Spain.
Heliyon ; 6(8): e04412, 2020 Aug.
Article in En | MEDLINE | ID: mdl-32775739
According to the World Health Organization (WHO) close to 800,000 people worldwide die by suicide each year, and many more attempts to do it. In consequence, the WHO recognizes suicide as a global public health priority, which affects not only rich countries but poor and middle-income countries as well. This study makes a systematic analysis of 28 supervised classifiers using different features of the corpus Life to detect messages with suicidal ideation and depression to know if these can be used in an automatic prevention online system. The Life Corpus, used in this research, is a bilingual text corpus (English and Spanish) oriented to the detection of suicide ideation. This corpus was constructed retrieving texts from several social networks and its quality was measured using mutual annotation agreement. The different experiments determined that the classifier with the best performance was KStar, with the corpus features POS-SYNSETS-NUM, achieving the best results with the ROC Area metrics of 0,81036 and F-measure of 0,7148. The present research fulfilled the objective of discovering which supervised classifiers and which features are the most suitable for the automatic classification of messages with suicidal ideation using the Life Corpus. Also, given the imbalance of the results, a new precision measure was developed called the Two-dimensional Accuracy and Recovery Index (GDP), which can provide better results, in unbalanced systems, than the usual measures to assess the quality of the results (measure F, Area ROC), and thus increase the number of messages at risk of suicidal ideation, detected at the cost of receiving more messages that are not related to suicide or vice versa.
Key words

Full text: 1 Collection: 01-internacional Database: MEDLINE Language: En Journal: Heliyon Year: 2020 Document type: Article Affiliation country: Ecuador Country of publication: United kingdom

Full text: 1 Collection: 01-internacional Database: MEDLINE Language: En Journal: Heliyon Year: 2020 Document type: Article Affiliation country: Ecuador Country of publication: United kingdom