sequence processing

3 papers

• Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers
• From Bytes to Ideas: Language Modeling with Autoregressive U-Nets
• SkyLadder: Better and Faster Pretraining via Context Window Scheduling