attention modules

3 papers

• From Condensation to Rank Collapse: A Two-Stage Analysis of Transformer Training Dynamics
• From Condensation to Rank Collapse: A Two-Stage Analysis of Transformer Training Dynamics
• Learning Multi-Source and Robust Representations for Continual Learning