token prediction
Token prediction is a common task in natural language processing where the model predicts the next token (word or character) in a sequence based on the preceding context. This is fundamental to tasks like text generation and language modeling.
- DINGO: Constrained Inference for Diffusion LLMs
- EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test
- Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation
- PrefixKV: Adaptive Prefix KV Cache is What Vision Instruction-Following Models Need for Efficient Generation