NotebookLM's automatically generated podcasts are surprisingly effective
notebooklmaudio-generationraggoogle-ai
Abstraction: Google NotebookLM generates convincing AI podcast episodes from user documents
Key points:
- NotebookLM's Audio Overview generates ~10-minute custom podcasts from user-supplied sources; powered by Gemini 1.5 Pro under the hood as an end-user RAG product
- Audio quality relies on SoundStorm, a Google Research model that converts an annotated script and brief voice examples into natural dialogue in ~0.5 seconds on TPU-v4
- Script generation pipeline: outline → revision → detailed script → critique phase → revision → adding "disfluencies" (banter, pauses, filler words) to avoid robotic speech
- System prompt instructs hosts to always act as human podcast hosts; a Reddit user bypassed this by embedding a "producer note" in source material, triggering an AI existential crisis
- Hidden prompt encodes listener persona, topic overview framing, and neutral stance on controversial topics
- Feature was demonstrated at Google I/O before the widely-cited PDF-to-Podcast demo by Stephan Fitzpatrick
Connections: Google · Notebooklm · Simon Willison · Retrieval Augmented Generation · Large Language Models
Source: https://simonwillison.net/2024/Sep/29/notebooklm-audio-overview/