Retro

entities · 1 notes linked

Related: Deepmind · Retrieval Augmented Generation · Large Language Models

Notes

• Improving language models by retrieving from trillions of tokens — RETRO retrieval-augmented LM outperforms models 25x larger on language modeling