Memorization

concepts · 2 notes linked

Related: Arxiv · Deep Learning · Generalization · Gary Marcus · Geoffrey Hinton · Yann LeCun · Large Language Models · AI Hallucination

Notes

• Deconstructing Geoffrey Hinton's weakest argument — Gary Marcus rebuttal of Hinton's defense of LLM understanding and hallucinations
• Deep Learning Through the Lens of Example Difficulty — Prediction depth as per-example measure of deep learning difficulty