long-context scenarios

3 papers

• HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models
• SmallKV: Small Model Assisted Compensation of KV Cache Compression for Efficient LLM Inference
• Twilight: Adaptive Attention Sparsity with Hierarchical Top-$p$ Pruning