Sanjiv Kumar

4 papers Google DeepMind

• Analyzing Similarity Metrics for Data Selection for Language Model Pretraining
• Hierarchical Retrieval: The Geometry and a Pretrain-Finetune Recipe
• Scalable In-context Ranking with Generative Models
• Spark Transformer: Reactivating Sparsity in Transformer FFN and Attention