OmniThink: A Cognitive Framework for Enhanced Long-Form Article Generation Through Iterative Reflection and Expansion
long-form-generationmachine-writingragiterative-reflectionknowledge-density
Abstraction: Iterative reflection framework improving knowledge density in LLM long-form writing
Key points:
- OmniThink from Zhejiang University and Tongyi Lab (Alibaba) mimics human iterative learning by dynamically adjusting retrieval strategies during article generation
- Builds an "information tree" and "conceptual pool" to structure diverse, relevant data across three steps: information acquisition, outline structuring, and article composition
- Introduces a "knowledge density" metric evaluated on the WildSeek dataset; outperforms baselines like Co-STORM on breadth and depth
- Performs best with GPT-4o backend; model-agnostic design allows integration with existing frameworks
- Addresses core RAG weakness: fixed retrieval strategies that produce shallow, redundant, unoriginal content
- Paper: arxiv 2501.09751; code on GitHub at zjunlp/OmniThink
Connections: Retrieval Augmented Generation · Large Language Models · Alibaba