RESUMO
In recent years, with the development of the internet, video has become more and more widely used in life. Adding harmonious music to a video is gradually becoming an artistic task. However, artificially adding music takes a lot of time and effort, so we propose a method to recommend background music for videos. The emotional message of music is rarely taken into account in current work, but it is crucial for video music retrieval. To achieve this, we design two paths to process content information and emotional information between modals. Based on the characteristics of video and music, we design various feature extraction schemes and common representation spaces. In the content path, the pre-trained network is used as the feature extraction network. As these features contain some redundant information, we use an encoder-decoder structure for dimensionality reduction. Where encoder weights are shared to obtain content sharing features for video and music. In the emotion path, an emotion key frames scheme was used for video and a channel attention mechanism was used for music in order to obtain the emotion information effectively. We also added emotion distinguish loss to guarantee that the network acquires the emotion information effectively. More importantly, we propose a way to combine content information with emotional information. That is, content features are first stitched together with sentiment features and then passed through a fused shared space structured as an MLP to obtain more effective fused shared features. In addition, a polarity penalty factor has been added to the classical metric loss function to make it more suitable for this task. Experiments show that this dual path video music retrieval network can effectively merge information. Compared with existing methods, the retrieval task evaluation index increases Recall@1 by 3.94.
Assuntos
Música , Emoções , Internet , RegistrosRESUMO
A pesar de la puesta en práctica de la Ley de Educación Intercultural Bilingüe para los Pueblos indígenas en América Latina, son pocos los países en los que se consideraron elementos de sus costumbres para construir una verdadera educación intercultural. Reconocer las características propias de cada Pueblo, admite abordar las culturas bajo una educación que incida de manera certera en cada individuo. Las culturas se identifican a través de códigos estructurados en años de historia, dando identidad a cada Pueblo. Construir la educación a través de esos códigos, permitirá bajo el espacio que los representa, diseñarlos en términos que identifican su etnicidad. Las poblaciones indígenas se encuentran esparcidas a través del territorio nacional, dificultando en gran medida el alcance de la educación para todos. La Universidad Indígena de Venezuela no escapa a esa realidad. Por tanto, se pretende con este trabajo realizar un modelo de educación a distancia utilizando los códigos que le dan identidad, diseñando el espacio que los representa, a través del aula virtual bajo el programa de formación de licenciados en salud intercultural(AU)
Despite the implementation of the Law on Intercultural Bilingual Education for Indigenous Peoples in Latin America, few countries have considered elements of their customs to build a true education in terms of interculturality. Recognizing the characteristics of each People, admits to approach the cultures under an education that affects in an accurate way in each individual. Each culture is identified through codes structured in years of history, giving identity to each People. Building education through these codes will allow under the space that represents them, to design it in terms that identify their ethnicity. Rural and indigenous populations in particular are scattered throughout the national territory, which greatly hinders the scope of education for all, and the Indigenous University of Venezuela does not escape that reality. Therefore, it is intended with this work to make a model of distance education using the codes that give it identity, designing the space that represents them, through the virtual classroom under the training program for graduates in intercultural health(AU)
