Benchmarking

concepts · 2 notes linked

Related: Google · Graph Neural Networks · Synthetic Data · Rliable · Reinforcement Learning · Statistical Evaluation

Notes

• Deep Reinforcement Learning at the Edge of the Statistical Precipice — Critique of deep RL evaluation using point estimates; proposes robust statistical methodology
• Google AI Introduces GraphWorld: A Methodology For Analyzing The Performance Of GNN Architectures On Millions Of Synthetic Benchmark Datasets — GraphWorld uses synthetic graphs to benchmark GNNs beyond standard academic datasets