RESUMEN
Data annotation in NLP is a costly and time-consuming task, traditionally handled by human experts who require extensive training to enhance the task-related background knowledge. Besides, labeling social media texts is particularly challenging due to their brevity, informality, creativity, and varying human perceptions regarding the sociocultural context of the world. With the emergence of GPT models and their proficiency in various NLP tasks, this study aims to establish a performance baseline for GPT-4 as a social media text annotator. To achieve this, we employ our own dataset of tweets, expertly labeled for stance detection with full inter-rater agreement among three annotators. We experiment with three techniques: Zero-shot, Few-shot, and Zero-shot with Chain-of-Thoughts to create prompts for the labeling task. We utilize four training sets constructed with different label sets, including human labels, to fine-tune transformer-based large language models and various combinations of traditional machine learning models with embeddings for stance classification. Finally, all fine-tuned models undergo evaluation using a common testing set with human-generated labels. We use the results from models trained on human labels as the benchmark to assess GPT-4's potential as an annotator across the three prompting techniques. Based on the experimental findings, GPT-4 achieves comparable results through the Few-shot and Zero-shot Chain-of-Thoughts prompting methods. However, none of these labeling techniques surpass the top three models fine-tuned on human labels. Moreover, we introduce the Zero-shot Chain-of-Thoughts as an effective strategy for aspect-based social media text labeling, which performs better than the standard Zero-shot and yields results similar to the high-performing yet expensive Few-shot approach.
Asunto(s)
Medios de Comunicación Sociales , Humanos , Procesamiento de Lenguaje Natural , Aprendizaje AutomáticoRESUMEN
Due to the competitive nature of the construction industry, the efficiency of requirement analysis is important in enhancing client satisfaction and a company's reputation. For example, determining the optimal configuration of panels (generally called panelization) that form the structure of a building is one aspect of cost estimation. However, existing methods typically rely on rule-based approaches that may lead to suboptimal material usage, particularly in complex designs featuring angled walls and openings. Such inefficiency can increase costs and environmental impact due to unnecessary material waste. To address these challenges, this research proposes a Panelization Algorithm for Architectural Designs, referred to as PAAD, which utilizes a genetic evolutionary strategy built on the 2D bin packing problem. This method is designed to balance between strict adherence to manufacturing constraints and the objective of optimizing material usage. PAAD starts with multiple potential solutions within the predefined problem space, facilitating dynamic exploration of panel configurations. It approaches structural rules as flexible constraints, making necessary corrections in post-processing, and through iterative developments, the algorithm refines panel sets to minimize material use. The methodology is validated through an analysis against an industry implementation and expert-derived solutions, highlighting PAAD's ability to surpass existing results and reduce the need for manual corrections. Additionally, to motivate future research, a synthetic data generator, the architectural drawing encodings used, and a preliminary interface are also introduced. This not only highlights the algorithm's practical applicability but also encourages its use in real-world scenarios.
Asunto(s)
Algoritmos , Arquitectura , Materiales de Construcción , Industria de la Construcción/métodos , HumanosRESUMEN
BACKGROUND: The use of social media for disseminating health care information has become increasingly prevalent, making the expanding role of artificial intelligence (AI) and machine learning in this process both significant and inevitable. This development raises numerous ethical concerns. This study explored the ethical use of AI and machine learning in the context of health care information on social media platforms (SMPs). It critically examined these technologies from the perspectives of fairness, accountability, transparency, and ethics (FATE), emphasizing computational and methodological approaches that ensure their responsible application. OBJECTIVE: This study aims to identify, compare, and synthesize existing solutions that address the components of FATE in AI applications in health care on SMPs. Through an in-depth exploration of computational methods, approaches, and evaluation metrics used in various initiatives, we sought to elucidate the current state of the art and identify existing gaps. Furthermore, we assessed the strength of the evidence supporting each identified solution and discussed the implications of our findings for future research and practice. In doing so, we made a unique contribution to the field by highlighting areas that require further exploration and innovation. METHODS: Our research methodology involved a comprehensive literature search across PubMed, Web of Science, and Google Scholar. We used strategic searches through specific filters to identify relevant research papers published since 2012 focusing on the intersection and union of different literature sets. The inclusion criteria were centered on studies that primarily addressed FATE in health care discussions on SMPs; those presenting empirical results; and those covering definitions, computational methods, approaches, and evaluation metrics. RESULTS: Our findings present a nuanced breakdown of the FATE principles, aligning them where applicable with the American Medical Informatics Association ethical guidelines. By dividing these principles into dedicated sections, we detailed specific computational methods and conceptual approaches tailored to enforcing FATE in AI-driven health care on SMPs. This segmentation facilitated a deeper understanding of the intricate relationship among the FATE principles and highlighted the practical challenges encountered in their application. It underscored the pioneering contributions of our study to the discourse on ethical AI in health care on SMPs, emphasizing the complex interplay and the limitations faced in implementing these principles effectively. CONCLUSIONS: Despite the existence of diverse approaches and metrics to address FATE issues in AI for health care on SMPs, challenges persist. The application of these approaches often intersects with additional ethical considerations, occasionally leading to conflicts. Our review highlights the lack of a unified, comprehensive solution for fully and effectively integrating FATE principles in this domain. This gap necessitates careful consideration of the ethical trade-offs involved in deploying existing methods and underscores the need for ongoing research.
RESUMEN
BACKGROUND: A hallmark of unregulated drug markets is their unpredictability and constant evolution with newly introduced substances. People who use drugs and the public health workforce are often unaware of the appearance of new drugs on the unregulated market and their type, safe dosage, and potential adverse effects. This increases risks to people who use drugs, including the risk of unknown consumption and unintentional drug poisoning. Early warning systems (EWSs) can help monitor the landscape of emerging drugs in a given community by collecting and tracking up-to-date information and determining trends. However, there are currently few ways to systematically monitor the appearance and harms of new drugs on the unregulated market in Canada. OBJECTIVE: The goal of this work is to examine how artificial intelligence can assist in identifying patterns of drug-related risks and harms, by monitoring the social media activity of public health and law enforcement groups. This information is beneficial in the form of an EWS as it can be used to identify new and emerging drug trends in various communities. METHODS: To collect data for this study, 145 relevant Twitter accounts throughout Quebec (n=33), Ontario (n=78), and British Columbia (n=34) were manually identified. Tweets posted between August 23 and December 21, 2021, were collected via the application programming interface developed by Twitter for a total of 40,393 tweets. Next, subject matter experts (1) developed keyword filters that reduced the data set to 3746 tweets and (2) manually identified relevant tweets for monitoring and early warning efforts for a total of 464 tweets. Using this information, a zero-shot classifier was applied to tweets from step 1 with a set of keep (drug arrest, drug discovery, and drug report) and not-keep (drug addiction support, public safety report, and others) labels to see how accurately it could extract the tweets identified in step 2. RESULTS: When looking at the accuracy in identifying relevant posts, the system extracted a total of 584 tweets and had an overlap of 392 out of 477 (specificity of ~84.5%) with the subject matter experts. Conversely, the system identified a total of 3162 irrelevant tweets and had an overlap of 3090 (sensitivity of ~94.1%) with the subject matter experts. CONCLUSIONS: This study demonstrates the benefits of using artificial intelligence to assist in finding relevant tweets for an EWS. The results showed that it can be quite accurate in filtering out irrelevant information, which greatly reduces the amount of manual work required. Although the accuracy in retaining relevant information was observed to be lower, an analysis showed that the label definitions can impact the results significantly and would therefore be suitable for future work to refine. Nonetheless, the performance is promising and demonstrates the usefulness of artificial intelligence in this domain.
Asunto(s)
Efectos Colaterales y Reacciones Adversas Relacionados con Medicamentos , Medios de Comunicación Sociales , Humanos , Inteligencia Artificial , Aprendizaje Automático , Colombia BritánicaRESUMEN
BACKGROUND: Over the past years, homelessness has become a substantial issue around the globe. The largest social services organization in Thunder Bay, Ontario, Canada, has observed that a majority of the people experiencing homelessness in the city were from outside of the city or province. Thus, to improve programming and resource allocation for people experiencing homelessness in the city, including shelter use, it was important to investigate the trends associated with homelessness and migration. OBJECTIVE: This study aimed to address 3 research questions related to homelessness and migration in Thunder Bay: What factors predict whether a person who migrated to the city and is experiencing homelessness stays or leaves shelters? If an individual stays, how long are they likely to stay? What factors predict stay duration? METHODS: We collected the required data from 2 sources: a survey conducted with people experiencing homelessness at 3 homeless shelters in Thunder Bay and the database of a homeless information management system. The records of 110 migrants were used for the analysis. Two feature selection techniques were used to address the first and third research questions, and 8 machine learning models were used to address the second research question. In addition, data augmentation was performed to improve the size of the data set and to resolve the class imbalance problem. The area under the receiver operating characteristic curve value and cross-validation accuracy were used to measure the models' performances while avoiding possible model overfitting. RESULTS: Factors predicting an individual's stay duration included home or previous district, highest educational qualification, recent receipt of mental health support, migrating to visit family or friends, and finding employment upon arrival. For research question 2, among the classification models developed for predicting the stay duration of migrants, the random forest and gradient boosting tree models presented better results with area under the receiver operating characteristic curve values of 0.91 and 0.93, respectively. Finally, home district, band membership, status card, previous district, and recent support for drug and/or alcohol use were recognized as the factors predicting stay duration. CONCLUSIONS: Applying machine learning enables researchers to make predictions related to migrants' homelessness and investigate how various factors become determinants of the predictions. We hope that the findings of this study will aid future policy making and resource allocation to better serve people experiencing homelessness. However, further improvements in the data set size and interpretation of the identified factors in decision-making are required.
RESUMEN
Introduction: The emergency department (ED) in rural communities is essential for providing care to patients with urgent medical issues and those unable to access primary care. Recent physician staffing shortages have put many EDs at risk of temporary closure. Our goal was to describe the demographics and practices of the rural physicians providing emergency medicine services across Ontario in order to inform health human resource planning. Methods: The ICES Physician database (IPDB) and Ontario Health Insurance Plan (OHIP) billing database from 2017 were used in this retrospective cohort study. Rural physician data were analysed for demographic, practice region and certification information. Sentinel billing codes (i.e., a billing code unique to a particular clinical service) were used to define 18 unique physician services. Results: A total of 1192 physicians from the IPDB met inclusion as rural generalist physicians out of a total of 14,443 family physicians in Ontario. From this physician population, a total of 620 physicians practised emergency medicine which accounted for 33% of their days worked on average. The majority of physicians practising emergency medicine were between the ages of 30 and 49 and in their first decade of practice. The most common services in addition to emergency medicine were clinic, hospital medicine, palliative care and mental health. Conclusion: This study provides insight into the practice patterns of rural physicians and the basis for better targeted physician workforce-forecasting models. A new approach to education and training pathways, recruitment and retention initiatives and rural health service delivery models is needed to ensure better health outcomes for our rural population.
Résumé Introduction: Le service d'urgence des communautés rurales est essentiel pour la prise en charge des patients présentant des problèmes médicaux urgents et de ceux qui ne peuvent accéder aux soins primaires. En raison de la récente pénurie de médecins, de nombreux services d'urgence risquent de fermer temporairement. Notre objectif était de décrire les caractéristiques démographiques et les pratiques des médecins ruraux qui fournissent des services de médecine d'urgence en Ontario afin d'éclairer la planification des ressources humaines en santé. Méthodes: La base de données des médecins de l'ICES (IPDB) et la base de données de facturation de l'assurance-santé de l'Ontario (OHIP) de 2017 ont été utilisées dans cette étude de cohorte rétrospective. Les données sur les médecins ruraux ont été analysées pour obtenir des renseignements sur la démographie, la région de pratique et la certification. Les codes de facturation sentinelle (c'est-à-dire un code de facturation unique pour un service clinique particulier) ont été utilisés pour définir 18 services médicaux uniques. Résultats: Sur un total de 14 443 médecins de famille en Ontario, 1 192 médecins de l'IPDB ont été inclus en tant que médecins généralistes ruraux. Parmi cette population de médecins, 620 pratiquaient la médecine d'urgence, ce qui représentait 33% de leurs jours de travail en moyenne. La majorité des médecins qui pratiquaient la médecine d'urgence étaient âgés de 30 à 49 ans et en étaient à leur première décennie de pratique. Les services les plus courants en plus de la médecine d'urgence étaient la clinique, la médecine hospitalière, les soins palliatifs et la santé mentale. Conclusion: Cette étude permet de mieux comprendre les modes de pratique des médecins ruraux et de jeter les bases de modèles de prévision des effectifs médicaux mieux ciblés. Une nouvelle approche des parcours d'éducation et de formation, des initiatives de recrutement et de rétention et des modèles de prestation de services de santé en milieu rural est nécessaire pour garantir de meilleurs résultats en matière de santé pour notre population rurale. Mots-clés: Médecine d'urgence, médecins ruraux, planification des ressources humaines en santé.
Asunto(s)
Médicos de Familia , Población Rural , Humanos , Adulto , Persona de Mediana Edad , Ontario , Estudios Retrospectivos , Médicos de Familia/educación , Servicio de Urgencia en Hospital , Recursos HumanosRESUMEN
Amid ongoing health crisis, there is a growing necessity to discern possible signs of Wellness Dimensions (WD) manifested in self-narrated text. As the distribution of WD on social media data is intrinsically imbalanced, we experiment the generative NLP models for data augmentation to enable further improvement in the pre-screening task of classifying WD. To this end, we propose a simple yet effective data augmentation approach through prompt-based Generative NLP models, and evaluate the ROUGE scores and syntactic/semantic similarity among existing interpretations and augmented data. Our approach with ChatGPT model surpasses all the other methods and achieves improvement over baselines such as Easy-Data Augmentation and Backtranslation. Introducing data augmentation to generate more training samples and balanced dataset, results in the improved F-score and the Matthew's Correlation Coefficient for upto 13.11% and 15.95%, respectively.
RESUMEN
Overcrowding is a well-known problem in hospitals and emergency departments (ED) that can negatively impact patients and staff. This study aims to present a machine learning model to detect a patient's need for a Computed Tomography (CT) exam in the emergency department at the earliest possible time. The data for this work was collected from ED at Thunder Bay Regional Health Sciences Centre over one year (05/2016-05/2017) and contained administrative triage information. The target outcome was whether or not a patient required a CT exam. Multiple combinations of text embedding methods, machine learning algorithms, and data resampling methods were experimented with to find the optimal model for this task. The final model was trained with 81, 118 visits and tested on a hold-out test set with a size of 9, 013 visits. The best model achieved a ROC AUC score of 0.86 and had a sensitivity of 87.3% and specificity of 70.9%. The most important factors that led to a CT scan order were found to be chief complaint, treatment area, and triage acuity. The proposed model was able to successfully identify patients needing a CT using administrative triage data that is available at the initial stage of a patient's arrival. By determining that a CT scan is needed early in the patient's visit, the ED can allocate resources to ensure these investigations are completed quickly and patient flow is maintained to reduce overcrowding.
Asunto(s)
Servicio de Urgencia en Hospital , Triaje , Humanos , Triaje/métodos , Aprendizaje Automático , Tomografía Computarizada por Rayos X , Algoritmos , Estudios RetrospectivosRESUMEN
BACKGROUND: In most cases, the abstracts of articles in the medical domain are publicly available. Although these are accessible by everyone, they are hard to comprehend for a wider audience due to the complex medical vocabulary. Thus, simplifying these complex abstracts is essential to make medical research accessible to the general public. OBJECTIVE: This study aims to develop a deep learning-based text simplification (TS) approach that converts complex medical text into a simpler version while maintaining the quality of the generated text. METHODS: A TS approach using reinforcement learning and transformer-based language models was developed. Relevance reward, Flesch-Kincaid reward, and lexical simplicity reward were optimized to help simplify jargon-dense complex medical paragraphs to their simpler versions while retaining the quality of the text. The model was trained using 3568 complex-simple medical paragraphs and evaluated on 480 paragraphs via the help of automated metrics and human annotation. RESULTS: The proposed method outperformed previous baselines on Flesch-Kincaid scores (11.84) and achieved comparable performance with other baselines when measured using ROUGE-1 (0.39), ROUGE-2 (0.11), and SARI scores (0.40). Manual evaluation showed that percentage agreement between human annotators was more than 70% when factors such as fluency, coherence, and adequacy were considered. CONCLUSIONS: A unique medical TS approach is successfully developed that leverages reinforcement learning and accurately simplifies complex medical paragraphs, thereby increasing their readability. The proposed TS approach can be applied to automatically generate simplified text for complex medical text data, which would enhance the accessibility of biomedical research to a wider audience.
RESUMEN
This study assesses the online societal association of leaders and healthcare organizations from the top-10 COVID-19 resilient nations through public engagement, sentiment strength, and inclusivity and diversity strength. After analyzing 173,071 Tweets authored by the leaders and health organizations, our findings indicate that United Arab Emirate's Prime Minister had the highest online societal association (normalized online societal association: 1.000) followed by the leaders of Canada and Turkey (normalized online societal association: 0.068 and 0.033, respectively); and among the healthcare organizations, the Public Health Agency of Canada was the most impactful (normalized online societal association: 1.000) followed by the healthcare agencies of Turkey and Spain (normalized online societal association: 0.632 and 0.094 respectively). In comparison to healthcare organizations, the leaders displayed a strong awareness of individual factors and generalized their Tweets to a broader audience. The findings also suggest that users prefer accessing social media platforms for information during health emergencies and that leaders and healthcare institutions should realize the potential to use them effectively.
RESUMEN
This article provides a comprehensive summary of how candidates running in the 2020 US Presidential Elections used Twitter to communicate with the public. More specifically, it aims to uncover elements linked to public engagement and internal cooperation (in terms of content and stance similarity among the candidates from the same political front, and with respect to the official Twitter accounts of their political parties). Our main subjects are the Presidential and Vice-Presidential candidates who contested for the 2020 US Elections from the two major political fronts-Republicans and Democrats. Their tweets were evaluated for social reach, content similarity and stance similarity on 22 topics. According to the findings, Joe Biden had the highest engagement and impact (user impact: 177.08k, normalized to 0.99), followed by Donald Trump (user impact: 164.19k, normalized to 0.92). The Democrats depicted a clearer understanding of their audience, portraying an essential link between public participation, internal cooperation and the electoral campaign. The results also demonstrate that specific topics (like US Elections, and Inauguration Ceremony) were more engaging than others (Trump Healthcare Plan, and The Supreme Court Appointments). This study adds to the existing work on using social media platforms for electoral campaigns and can be effectively utilized by contesting candidates.
RESUMEN
BACKGROUND: Twitter is a popular social networking site where short messages or "tweets" of users have been used extensively for research purposes. However, not much research has been done in mining the medical professions, such as detecting the occupations of users from their biographical contents. Mining such professions can be used to build efficient recommender systems for cost-effective targeted advertisements. Moreover, it is highly important to develop effective methods to identify the occupation of users since conventional classification methods rely on features developed by human intelligence. Although, the result may be favorable for the classification problem. However, it is still extremely challenging for traditional classifiers to predict the medical occupations accurately since it involves predicting multiple occupations. Hence this study emphasizes predicting the medical occupational class of users through their public biographical ("Bio") content. We have conducted our analysis by annotating the bio content of Twitter users. In this paper, we propose a method of combining word embedding with state-of-art neural network models that include: Long Short Term Memory (LSTM), Bidirectional LSTM, Gated Recurrent Unit, Bidirectional Encoder Representations from Transformers, and A lite BERT. Moreover, we have also observed that by composing the word embedding with the neural network models there is no need to construct any particular attribute or feature. By using word embedding, the bio contents are formatted as dense vectors which are fed as input into the neural network models as a sequence of vectors. RESULT: Performance metrics that include accuracy, precision, recall, and F1-score have shown a significant difference between our method of combining word embedding with neural network models than with the traditional methods. The scores have proved that our proposed approach has outperformed the traditional machine learning techniques for detecting medical occupations among users. ALBERT has performed the best among the deep learning networks with an F1 score of 0.90. CONCLUSION: In this study, we have presented a novel method of detecting the occupations of Twitter users engaged in the medical domain by merging word embedding with state-of-art neural networks. The outcomes of our approach have demonstrated that our method can further advance the process of analyzing corpora of social media without going through the trouble of developing computationally expensive features.
Asunto(s)
Medios de Comunicación Sociales , Recolección de Datos , Humanos , Aprendizaje Automático , Redes Neurales de la Computación , OcupacionesRESUMEN
BACKGROUND: Social media platforms (SMPs) are frequently used by various pharmaceutical companies, public health agencies, and nongovernment organizations (NGOs) for communicating health concerns, new advancements, and potential outbreaks. Although the benefits of using them as a tool have been extensively discussed, the online activity of various health care organizations on SMPs during COVID-19 in terms of engagement and sentiment forecasting has not been thoroughly investigated. OBJECTIVE: The purpose of this research is to analyze the nature of information shared on Twitter, understand the public engagement generated on it, and forecast the sentiment score for various organizations. METHODS: Data were collected from the Twitter handles of 5 pharmaceutical companies, 10 US and Canadian public health agencies, and the World Health Organization (WHO) from January 1, 2017, to December 31, 2021. A total of 181,469 tweets were divided into 2 phases for the analysis, before COVID-19 and during COVID-19, based on the confirmation of the first COVID-19 community transmission case in North America on February 26, 2020. We conducted content analysis to generate health-related topics using natural language processing (NLP)-based topic-modeling techniques, analyzed public engagement on Twitter, and performed sentiment forecasting using 16 univariate moving-average and machine learning (ML) models to understand the correlation between public opinion and tweet contents. RESULTS: We utilized the topics modeled from the tweets authored by the health care organizations chosen for our analysis using nonnegative matrix factorization (NMF): cumass=-3.6530 and -3.7944 before and during COVID-19, respectively. The topics were chronic diseases, health research, community health care, medical trials, COVID-19, vaccination, nutrition and well-being, and mental health. In terms of user impact, WHO (user impact=4171.24) had the highest impact overall, followed by public health agencies, the Centers for Disease Control and Prevention (CDC; user impact=2895.87), and the National Institutes of Health (NIH; user impact=891.06). Among pharmaceutical companies, Pfizer's user impact was the highest at 97.79. Furthermore, for sentiment forecasting, autoregressive integrated moving average (ARIMA) and seasonal autoregressive integrated moving average with exogenous factors (SARIMAX) models performed best on the majority of the subsets of data (divided as per the health care organization and period), with the mean absolute error (MAE) between 0.027 and 0.084, the mean square error (MSE) between 0.001 and 0.011, and the root-mean-square error (RMSE) between 0.031 and 0.105. CONCLUSIONS: Our findings indicate that people engage more on topics such as COVID-19 than medical trials and customer experience. In addition, there are notable differences in the user engagement levels across organizations. Global organizations, such as WHO, show wide variations in engagement levels over time. The sentiment forecasting method discussed presents a way for organizations to structure their future content to ensure maximum user engagement.
RESUMEN
BACKGROUND: In a sudden cardiac arrest, starting CPR and applying an AED immediately are the two highest resuscitation priorities. Many existing mobile applications have been developed to assist users in locating a nearby AED. However, these applications do not provide indoor navigation to the AED location. The time required to locate an AED inside a building due to a lack of indoor navigation systems will reduce the patient's chance of survival. The existing indoor navigation solutions either require special hardware, a large dataset or a significant amount of initial work. These requirements make these systems not viable for implementation on a large-scale. METHODS: The proposed system collects Wi-Fi information from the existing devices and the path's magnetic information using a smartphone to guide the user from a starting point to an AED. The information collected is processed using four techniques: turn detection method, Magnetic data pattern matching method, Wi-Fi fingerprinting method and Closest Wi-Fi location method to estimate user location. The user location estimations from all four techniques are further processed to determine the user's location on the path, which is then used to guide the user to the AED location. RESULTS: The four techniques used in the proposed system Turn detection, Magnetic data pattern matching, Closest Wi-Fi location and Wi-Fi fingerprinting can individually achieve the accuracy of 80% with the error distance ± 9.4 m, ± 2.4 m, ± 4.6 m, and ± 4.6 m respectively. These four techniques, applied individually, may not always provide stable results. Combining these techniques results in a robust system with an overall accuracy of 80% with an error distance of ± 2.74 m. In comparison, the proposed system's accuracy is higher than the existing systems that use Wi-Fi and magnetic data. CONCLUSION: This research proposes a novel approach that requires no special hardware, large scale data or significant initial work to provide indoor navigation. The proposed system AEDNav can achieve an accuracy similar to the existing indoor navigation systems. Implementing this indoor navigation system could reduce the time to locate an AED and ultimately increase patient survival during sudden cardiac arrest.
Asunto(s)
Paro Cardíaco , Aplicaciones Móviles , Muerte Súbita Cardíaca , Desfibriladores , Humanos , Teléfono InteligenteRESUMEN
Influencing and framing debates on Twitter provides power to shape public opinion. Bots have become essential tools of 'computational propaganda' on social media such as Twitter, often contributing to a large fraction of the tweets regarding political events such as elections. Although analyses have been conducted regarding the first impeachment of former president Donald Trump, they have been focused on either a manual examination of relatively few tweets to emphasize rhetoric, or the use of Natural Language Processing (NLP) of a much larger corpus with respect to common metrics such as sentiment. In this paper, we complement existing analyses by examining the role of bots in the first impeachment with respect to three questions as follows. (Q1) Are bots actively involved in the debate? (Q2) Do bots target one political affiliation more than another? (Q3) Which sources are used by bots to support their arguments? Our methods start with collecting over 13M tweets on six key dates, from October 6th 2019 to January 21st 2020. We used machine learning to evaluate the sentiment of the tweets (via BERT) and whether it originates from a bot. We then examined these sentiments with respect to a balanced sample of Democrats and Republicans directly relevant to the impeachment, such as House Speaker Nancy Pelosi, senator Mitch McConnell, and (then former Vice President) Joe Biden. The content of posts from bots was further analyzed with respect to the sources used (with bias ratings from AllSides and Ad Fontes) and themes. Our first finding is that bots have played a significant role in contributing to the overall negative tone of the debate (Q1). Bots were targeting Democrats more than Republicans (Q2), as evidenced both by a difference in ratio (bots had more negative-to-positive tweets on Democrats than Republicans) and in composition (use of derogatory nicknames). Finally, the sources provided by bots were almost twice as likely to be from the right than the left, with a noticeable use of hyper-partisan right and most extreme right sources (Q3). Bots were thus purposely used to promote a misleading version of events. Overall, this suggests an intentional use of bots as part of a strategy, thus providing further confirmation that computational propaganda is involved in defining political events in the United States. As any empirical analysis, our work has several limitations. For example, Trump's rhetoric on Twitter has previously been characterized by an overly negative tone, thus tweets detected as negative may be echoing his message rather than acting against him. Previous works show that this possibility is limited, and its existence would only strengthen our conclusions. As our analysis is based on NLP, we focus on processing a large volume of tweets rather than manually reading all of them, thus future studies may complement our approach by using qualitative methods to assess the specific arguments used by bots.
RESUMEN
When modelling epidemics, the outputs and techniques used may be hard for the general public to understand. This can cause fear mongering and confusion on how to interpret the predictions provided by these models. This article proposes a solution for such a model that was created by a Canadian institute for COVID-19 in their region; namely, the NorthCOVID-19 model. In taking these ethical concerns into consideration, first the web interface of this model is analyzed to see how it may be difficult for a user without a strong mathematical background to understand how to use it. Second, a system is developed that takes this model's outputs as an input and produces a video summarization with an auto-generated audio to address the complexity of the interface, while ensuring that the end user is able to understand the important information produced by this model. A survey conducted on this proposed output asked participants, on a scale of 1 to 5, whether they strongly disagreed (1) or strongly agreed (5) with statements regarding the output of the proposed method. The results showed that the audio in the output was helpful in understanding the results (80% responded with 4 or 5) and that it helped improve overallcomprehension of the model (85% responded with 4 or 5). For the analysis of the NorthCOVID-19 interface, a System Usability Scale (SUS) survey was performed where itreceived a scoring of 70.94 which is slightly above the average of 68.
RESUMEN
Emotion recognition in conversations is an important step in various virtual chatbots which require opinion-based feedback, like in social media threads, online support, and many more applications. Current emotion recognition in conversations models face issues like: (a) loss of contextual information in between two dialogues of a conversation, (b) failure to give appropriate importance to significant tokens in each utterance, (c) inability to pass on the emotional information from previous utterances. The proposed model of Advanced Contextual Feature Extraction (AdCOFE) addresses these issues by performing unique feature extraction using knowledge graphs, sentiment lexicons and phrases of natural language at all levels (word and position embedding) of the utterances. Experiments on emotion recognition in conversations datasets show that AdCOFE is beneficial in capturing emotions in conversations.
RESUMEN
BACKGROUND: The collection and examination of social media has become a useful mechanism for studying the mental activity and behavior tendencies of users. Through the analysis of a collected set of Twitter data, a model will be developed for predicting positively referenced, drug-related tweets. From this, trends and correlations can be determined. METHODS: Social media data (tweets and attributes) were collected and processed using topic pertaining keywords, such as drug slang and use-conditions (methods of drug consumption). Potential candidates were preprocessed resulting in a dataset of 3,696,150 rows. The predictive classification power of multiple methods was compared including SVM, XGBoost, BERT and CNN-based classifiers. For the latter, a deep learning approach was implemented to screen and analyze the semantic meaning of the tweets. RESULTS: To test the predictive capability of the model, SVM and XGBoost were first employed. The results calculated from the models respectively displayed an accuracy of 59.33% and 54.90%, with AUC's of 0.87 and 0.71. The values show a low predictive capability with little discrimination. Conversely, the CNN-based classifiers presented a significant improvement, between the two models tested. The first was trained with 2661 manually labeled samples, while the other included synthetically generated tweets culminating in 12,142 samples. The accuracy scores were 76.35% and 82.31%, with an AUC of 0.90 and 0.91. Using association rule mining in conjunction with the CNN-based classifier showed a high likelihood for keywords such as "smoke", "cocaine", and "marijuana" triggering a drug-positive classification. CONCLUSION: Predictive analysis with a CNN is promising, whereas attribute-based models presented little predictive capability and were not suitable for analyzing text of data. This research found that the commonly mentioned drugs had a level of correspondence with frequently used illicit substances, proving the practical usefulness of this system. Lastly, the synthetically generated set provided increased accuracy scores and improves the predictive capability.
Asunto(s)
Aprendizaje Profundo , Preparaciones Farmacéuticas , Medios de Comunicación Sociales , HumanosRESUMEN
BACKGROUND: When an Out-of-Hospital Cardiac Arrest (OHCA) incident is reported to emergency services, the 911 agent dispatches Emergency Medical Services to the location and activates responder network system (RNS), if the option is available. The RNS notifies all the registered users in the vicinity of the cardiac arrest patient by sending alerts to their mobile devices, which contains the location of the emergency. The main objective of this research is to find the best match between the user who could support the OHCA patient. METHODS: For performing matching among the user and the AEDs, we used Bipartite Matching and Integer Linear Programming. However, these approaches take a longer processing time; therefore, a new method Preprocessed Integer Linear Programming is proposed that solves the problem faster than the other two techniques. RESULTS: The average processing time for the experimentation data was 1850 s using Bipartite matching, 32 s using the Integer Linear Programming and 2 s when using the Preprocessed Integer Linear Programming method. The proposed algorithm performs matching among users and AEDs faster than the existing matching algorithm and thus allowing it to be used in the real world. CONCLUSION: This research proposes an efficient algorithm that will allow matching of users with AED in real-time during cardiac emergency. Implementation of this system can help in reducing the time to resuscitate the patient.
Asunto(s)
Servicios Médicos de Urgencia , Paro Cardíaco Extrahospitalario , Desfibriladores , Humanos , Paro Cardíaco Extrahospitalario/diagnóstico , Paro Cardíaco Extrahospitalario/terapiaRESUMEN
When conducting data analysis in the twenty-first century, social media is crucial to the analysis due to the ability to provide information on a variety of topics such as health, food, feedback on products, and many others. Presently, users utilize social media to share their daily lifestyles. For example, travel locations, exercises, and food are common subjects of social media posts. By analyzing such information collected from users, health of the general population can be gauged. This analysis can become an integral part of federal efforts to study the health of a nation's people on a large scale. In this paper, we focus on such efforts from a Canadian lens. Public health is becoming a primary concern for many governments around the world. It is believed that it is necessary to analyze the current scenario within a given population before creating any new policies. Traditionally, governments use a variety of ways to gauge the flavor for any new policy including door to door surveys, a national level census, or hospital information to decide health policies. This information is limited and sometimes takes a long time to collect and analyze sufficiently enough to aid in decision making. In this paper, our approach is to solve such problems through the advancement of natural language processing algorithms and large scale data analysis. Our in-depth results show that the proposed method provides a viable solution in less time with the same accuracy when compared to traditional methods.