linear transformers

4 papers

• Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers
• Linear Attention for Efficient Bidirectional Sequence Modeling
• On the Robustness of Transformers against Context Hijacking for Linear Classification
• Short-length Adversarial Training Helps LLMs Defend Long-length Jailbreak Attacks: Theoretical and Empirical Evidence