tokenization

4 papers

• A Partition Cover Approach to Tokenization
• From Bytes to Ideas: Language Modeling with Autoregressive U-Nets
• GPSToken: Gaussian Parameterized Spatially-adaptive Tokenization for Image Representation and Generation
• Memory Mosaics at scale