embedding models

3 papers

• Analyzing Similarity Metrics for Data Selection for Language Model Pretraining
• Breaking the Batch Barrier (B3) of Contrastive Learning via Smart Batch Mining
• Learning Task-Agnostic Representations through Multi-Teacher Distillation