Synthetic Data

concepts · 5 notes linked

Related: Google · Openai · Chatgpt · Large Language Models · Tabfm · Hugging Face · Xgboost · Foundation Models

Notes

• 'If journalism is going up in smoke, I might as well get high off the fumes': confessions of a chatbot helper — Human annotators writing gold-standard training data for LLMs
• CAMEL-AI | Finding the Scaling Laws of Agents — CAMEL-AI open-source multi-agent framework for research on agent scaling laws
• Fine-tuning ChatGPT: Surpassing GPT-4 Summarization Performance — 63% Cost Reduction and 11x Speed Enhancement using Synthetic Data and LangSmith — Fine-tuned ChatGPT beats GPT-4 summarization at 63% lower cost and 11x faster using chain-of-density synthetic data
• Google AI Introduces GraphWorld: A Methodology For Analyzing The Performance Of GNN Architectures On Millions Of Synthetic Benchmark Datasets — GraphWorld uses synthetic graphs to benchmark GNNs beyond standard academic datasets
• Introducing TabFM — a zero-shot foundation model for tabular data — Google foundation model does zero-shot tabular prediction