token representations

4 papers

• Brain Harmony: A Multimodal Foundation Model Unifying Morphology and Function into 1D Tokens
• How Many Tokens Do 3D Point Cloud Transformer Architectures Really Need?
• Normalization in Attention Dynamics
• Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers