stochastic gradient noise

3 papers

• Error Feedback under $(L_0,L_1)$-Smoothness: Normalization and Momentum
• Understanding outer learning rates in Local SGD
• Unveiling m-Sharpness Through the Structure of Stochastic Gradient Noise