information-theoretic framework

5 papers

• Bits Leaked per Query: Information-Theoretic Bounds for Adversarial Attacks on LLMs
• Data Mixing Can Induce Phase Transitions in Knowledge Acquisition
• Information-Theoretic Discrete Diffusion
• Learning to Generalize: An Information Perspective on Neural Processes
• Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributions