multimodal dataset
A dataset that includes multiple types of data modalities (e.g., text, images, audio) that can be used to train models capable of understanding and generating insights across domains.
- CogPhys: Assessing Cognitive Load via Multimodal Remote and Contact-based Physiological Sensing
- CrypticBio: A Large Multimodal Dataset for Visually Confusing Species
- From Pose to Muscle: Multimodal Learning for Piano Hand Muscle Electromyography
- IRRISIGHT: A Large-Scale Multimodal Dataset and Scalable Pipeline to Address Irrigation and Water Management in Agriculture
- IndEgo: A Dataset of Industrial Scenarios and Collaborative Work for Egocentric Assistants
- Intend to Move: A Multimodal Dataset for Intention-Aware Human Motion Understanding
- MONITRS: Multimodal Observations of Natural Incidents Through Remote Sensing
- Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search
- PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring
- Reading Recognition in the Wild
- ShotBench: Expert-Level Cinematic Understanding in Vision-Language Models
- Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Models