ExpertosLF: dynamic late fusion of CBIR systems using online learning with relevance feedback.

One of the main challenges in CBIR systems is to choose discriminative and compact features, among dozens, to represent the images under comparison. Over the years, a great effort has been made to combine multiple features, mainly using early, late, and hierarchical fusion techniques. Unveiling the perfect combination of features is highly domain-specific and dependent on the type of image. Thus, the process of designing a CBIR system for new datasets or domains involves a huge experimentation overhead, leading to multiple fine-tuned CBIR systems. It would be desirable to dynamically find the best combination of CBIR systems without needing to go through such extensive experimentation and without requiring previous domain knowledge. In this paper, we propose ExpertosLF, a model-agnostic interpretable late fusion technique based on online learning with expert advice, which dynamically combines CBIR systems without knowing a priori which ones are the best for a given domain. At each query, ExpertosLF takes advantage of user's feedback to determine each CBIR contribution in the ensemble for the following queries. ExpertosLF produces an interpretable ensemble that is independent of the dataset and domain. Moreover, ExpertosLF is designed to be modular, and scalable. Experiments on 13 benchmark datasets from the Biomedical, Real, and Sketch domains revealed that: (i) ExpertosLF surpasses the performance of state of the art late-fusion techniques; (ii) it successfully and quickly converges to the performance of the best CBIR sets across domains without any previous domain knowledge (in most cases, fewer than 25 queries need to receive human feedback).

Predicting Exact Valence and Arousal Values from EEG.

Recognition of emotions from physiological signals, and in particular from electroencephalography (EEG), is a field within affective computing gaining increasing relevance. Although researchers have used these signals to recognize emotions, most of them only identify a limited set of emotional states (e.g., happiness, sadness, anger, etc.) and have not attempted to predict exact values for valence and arousal, which would provide a wider range of emotional states. This paper describes our proposed model for predicting the exact values of valence and arousal in a subject-independent scenario. To create it, we studied the best features, brain waves, and machine learning models that are currently in use for emotion classification. This systematic analysis revealed that the best prediction model uses a KNN regressor (K = 1) with Manhattan distance, features from the alpha, beta and gamma bands, and the differential asymmetry from the alpha band. Results, using the DEAP, AMIGOS and DREAMER datasets, show that our model can predict valence and arousal values with a low error (MAE < 0.06, RMSE < 0.16) and a strong correlation between predicted and expected values (PCC > 0.80), and can identify four emotional classes with an accuracy of 84.4%. The findings of this work show that the features, brain waves and machine learning models, typically used in emotion classification tasks, can be used in more challenging situations, such as the prediction of exact values for valence and arousal.

Why Do We Watch? The Role of Emotion Gratifications and Individual Differences in Predicting Rewatchability and Movie Recommendation.

BACKGROUND: The present study's main aim was to determine the predictors of movie rewatchability and recommendations. METHODS: Using a sample of 318 participants, we first tested the structure of a gratification scale from watching a movie. Then, we examined the role of age, need for cognition, need for affect, extraversion, and emotional gratifications, in predicting individuals' interest in rewatching the movie and in making recommendations. RESULTS: As in the original proposal of the emotional gratification scale, the following dimensions were identified: fun, thrill, empathic sadness, release of emotions, social sharing, contemplative experiences, and character engagement, with acceptable model fit and reliability, convergent and divergent validity. Social sharing, contemplate experiences, need for affect and age were significant predictors of movie recommendation; whereas social sharing, thrill, extraversion, and age contributed most to explaining rewatching interest. CONCLUSION: This study highlights the importance of considering distinct gratifications and individual differences in predicting rewatching and movie recommendation.