T5

entities · 1 notes linked

Related: Google · Palm · Knowledge Distillation · Chain Of Thought · Large Language Models

Notes

• Distilling step-by-step: Outperforming larger language models with less training — Rationale-based distillation trains small models to outperform 540B LLMs with far less data