decoder-only transformers
Decoder-only transformers are a subset of transformer models that generate output sequences from a given input embedding, focusing on the decoding process without the encoder. They are effective in tasks such as text generation and language modeling.
- Flatten Graphs as Sequences: Transformers are Scalable Graph Generators
- LeVo: High-Quality Song Generation with Multi-Preference Alignment
- On the Bias of Next-Token Predictors Toward Systematically Inefficient Reasoning: A Shortest-Path Case Study
- Why and How LLMs Hallucinate: Connecting the Dots with Subsequence Associations