information-theoretic perspective

3 papers

• Breaking AR’s Sampling Bottleneck: Provable Acceleration via Diffusion Language Models
• Demystifying Reasoning Dynamics with Mutual Information: Thinking Tokens are Information Peaks in LLM Reasoning
• EVODiff: Entropy-aware Variance Optimized Diffusion Inference