length generalization

6 papers

• Beyond Single-Task: Robust Multi-Task Length Generalization for LLMs
• Born a Transformer -- Always a Transformer? On the Effect of Pretraining on Architectural Abilities
• Extrapolation by Association: Length Generalization Transfer In Transformers
• Flow Equivariant Recurrent Neural Networks
• Hardware-aligned Hierarchical Sparse Attention for Efficient Long-term Memory Access
• Length Generalization via Auxiliary Tasks