Zeyu Huang

3 papers University of Edinburgh

• A Controllable Examination for Long-Context Language Models
• Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
• Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free