zeroth-order optimization
An optimization technique that utilizes only function evaluations (without needing gradients), making it particularly useful for optimizing black-box functions where derivative information is not accessible. These methods can address challenges in high-dimensional spaces.
- ComPO: Preference Alignment via Comparison Oracles
- Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning
- On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization
- PaZO: Preconditioned Accelerated Zeroth-Order Optimization for Fine-Tuning LLMs
- PseuZO: Pseudo-Zeroth-Order Algorithm for Training Deep Neural Networks
- SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes