relu activation

3 papers

• Better NTK Conditioning: A Free Lunch from (ReLU) Nonlinear Activation in Wide Neural Networks
• Block Coordinate Descent for Neural Networks Provably Finds Global Minima
• RePO: Understanding Preference Learning Through ReLU-Based Optimization