cross-attention

A mechanism that allows one sequence of data (like visual features) to attend to another sequence (like text features) in generating outputs, widely used in multimodal models.

16 papers