GPT-3

entities · 3 notes linked

Related: Openai · Transformers · Large Language Models · Google · Self Attention · Computer Vision · Emily Bender · AI Hype

Notes

• Look behind the curtain: Don't be dazzled by claims of 'artificial intelligence' | Op-Ed — Emily Bender op-ed demystifying AI as probabilistic pattern matching
• The Singular Value Decompositions of Transformer Weight Matrices — SVD of GPT-2 weight matrices reveals interpretable semantic directions
• Will Transformers Take Over Artificial Intelligence? | Quanta Magazine — Transformers expanding from NLP to vision, generative, and multimodal AI tasks