autoregressive language models
A type of model, such as GPT, that generates text by predicting the next word in a sequence based on preceding words, effectively learning language patterns from large datasets.
- Compressed and Smooth Latent Space for Text Diffusion Modeling
- Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scale
- STEAD: Robust Provably Secure Linguistic Steganography with Diffusion Language Model
- Value-Guided KV Compression for LLMs via Approximated CUR Decomposition
- When Does Closeness in Distribution Imply Representational Similarity? An Identifiability Perspective
- dKV-Cache: The Cache for Diffusion Language Models