online gradient descent

3 papers

• DeltaProduct: Improving State-Tracking in Linear RNNs via Householder Products
• Optimistic Online-to-Batch Conversions for Accelerated Convergence and Universality
• Trained Mamba Emulates Online Gradient Descent in In-Context Linear Regression