gradients
In the context of neural networks, gradients are the partial derivatives of the loss function with respect to the model parameters. They indicate the direction and magnitude to adjust model parameters to minimize the loss and are fundamental to gradient-based optimization methods.
- Dataset Distillation for Pre-Trained Self-Supervised Vision Models
- Detecting Generated Images by Fitting Natural Image Distributions
- GradMetaNet: An Equivariant Architecture for Learning on Gradients
- Pay Attention to Small Weights
- Stochastic Regret Guarantees for Online Zeroth- and First-Order Bilevel Optimization
- Towards a Geometric Understanding of Tensor Learning via the t-Product