feedforward networks

3 papers

• Curl Descent : Non-Gradient Learning Dynamics with Sign-Diverse Plasticity
• Spark Transformer: Reactivating Sparsity in Transformer FFN and Attention
• When Do Transformers Outperform Feedforward and Recurrent Networks? A Statistical Perspective