Enhanced Arabic disaster data classification using domain adaptation.

Natural disasters, like pandemics and earthquakes, are some of the main causes of distress and casualties. Governmental crisis management processes are crucial when dealing with these types of problems. Social media platforms are among the main sources of information regarding current events and public opinion. So, they have been used extensively to aid disaster detection and prevention efforts. Therefore, there is always a need for better automatic systems that can detect and classify disaster data of social media. In this work, we propose enhanced Arabic disaster data classification models. The suggested models utilize domain adaptation to provide state-of-the-art accuracy. We used a standard dataset of Arabic disaster data collected from Twitter for testing the proposed models. Experimental results show that the provided models significantly outperform the previous state-of-the-art results.

Semantic textual similarity for modern standard and dialectal Arabic using transfer learning.

Semantic Textual Similarity (STS) is the task of identifying the semantic correlation between two sentences of the same or different languages. STS is an important task in natural language processing because it has many applications in different domains such as information retrieval, machine translation, plagiarism detection, document categorization, semantic search, and conversational systems. The availability of STS training and evaluation data resources for some languages such as English has led to good performance systems that achieve above 80% correlation with human judgment. Unfortunately, such required STS data resources are not available for many languages like Arabic. To overcome this challenge, this paper proposes three different approaches to generate effective STS Arabic models. The first one is based on evaluating the use of automatic machine translation for English STS data to Arabic to be used in fine-tuning. The second approach is based on the interleaving of Arabic models with English data resources. The third approach is based on fine-tuning the knowledge distillation-based models to boost their performance in Arabic using a proposed translated dataset. With very limited resources consisting of just a few hundred Arabic STS sentence pairs, we managed to achieve a score of 81% correlation, evaluated using the standard STS 2017 Arabic evaluation set. Also, we managed to extend the Arabic models to process two local dialects, Egyptian (EG) and Saudi Arabian (SA), with a correlation score of 77.5% for EG dialect and 76% for the SA dialect evaluated using dialectal conversion from the same standard STS 2017 Arabic set.