cross-modal learning

4 papers

• Beyond Modality Collapse: Representation Blending for Multimodal Dataset Distillation
• MS-BART: Unified Modeling of Mass Spectra and Molecules for Structure Elucidation
• Prot2Text-V2: Protein Function Prediction with Multimodal Contrastive Alignment
• The Curse of Multi-Modalities: Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio