byte pair encoding

3 papers

• A Partition Cover Approach to Tokenization
• BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learning
• From Bytes to Ideas: Language Modeling with Autoregressive U-Nets