End-to-End Pre-Training With Hierarchical Matching and Momentum Contrast for Text-Video Retrieval.

Lately, video-language pre-training and text-video retrieval have attracted significant attention with the explosion of multimedia data on the Internet. However, existing approaches for video-language pre-training typically limit the exploitation of the hierarchical semantic information in videos, such as frame semantic information and global video semantic information. In this work, we present an end-to-end pre-training network with Hierarchical Matching and Momentum Contrast named HMMC. The key idea is to explore the hierarchical semantic information in videos via multilevel semantic matching between videos and texts. This design is motivated by the observation that if a video semantically matches a text (can be a title, tag or caption), the frames in this video usually have semantic connections with the text and show higher similarity than frames in other videos. Hierarchical matching is mainly realized by two proxy tasks: Video-Text Matching (VTM) and Frame-Text Matching (FTM). Another proxy task: Frame Adjacency Matching (FAM) is proposed to enhance the single visual modality representations while training from scratch. Furthermore, momentum contrast framework was introduced into HMMC to form a multimodal momentum contrast framework, enabling HMMC to incorporate more negative samples for contrastive learning which contributes to the generalization of representations. We also collected a large-scale Chinese video-language dataset (over 763k unique videos) named CHVTT to explore the multilevel semantic connections between videos and texts. Experimental results on two major Text-video retrieval benchmark datasets demonstrate the advantages of our methods. We release our code at https://github.com/cheetah003/HMMC.

Behaviors of self-delivery lidocaine nano systems affected by intermolecular interaction.

Lidocaine salts self-assembled into different nano systems in water at a clinical dosage (2%, 0.2 mL) without excipient addition, and led to different sensory block durations and acute systemic toxicities, which were affected by the self-delivery and self-release behaviors of the salts in vivo. These differences were mainly caused by intermolecular π-π stacking under different conditions, which was proved by the unique supramolecular arrangement of gourd-shaped Janus particles. π-π stacking in lidocaine nano systems can be enhanced by carbon dioxide addition or the exchange of counter ions from Br- to Cl-. Without π-π stacking, nano systems self-assembled by lidocaine hydrobromide achieved 7.8 h sensory block by intradermal administration on rats, which is much longer than the efficacy of classical local anesthetics and more suitable for postoperative treatment.