attention computation

3 papers

• Improving Formal Reasoning of Transformer with State Stack
• MPCache: MPC-Friendly KV Cache Eviction for Efficient Private LLM Inference
• RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval