parameter models

3 papers

• RAT: Bridging RNN Efficiency and Attention Accuracy via Chunk-based Sequence Modeling
• SkyLadder: Better and Faster Pretraining via Context Window Scheduling
• Unveiling the Uncertainty in Embodied and Operational Carbon of Large AI Models through a Probabilistic Carbon Accounting Model