kv-cache

3 papers

• Graph-KV: Breaking Sequence via Injecting Structural Biases into Large Language Models
• Speculate Deep and Accurate: Lossless and Training-Free Acceleration for Offloaded LLMs via Substitute Speculative Decoding
• dKV-Cache: The Cache for Diffusion Language Models