Rigor in AI: Doing Rigorous AI Work Requires a Broader, Responsible AI-Informed Conception of Rigor

Solon Barocas (Microsoft Research; Cornell University) · Flavio Calmon (Harvard University) · Alexandra Olteanu (Microsoft Research) · Su Lin Blodgett (Microsoft Research) · Agathe Balayn (Microsoft Research) · Angelina Wang (Stanford University) · Fernando Diaz (Google) · Margaret Mitchell (Hugging Face) · Michael Ekstrand (Drexel University) · Reuben Binns

ai capabilitiescommunity standardsconceptual rigordialogue frameworkdisciplinary normsepistemic rigorevidence inferenceinterpretative rigormethodological rigornormative rigorpersonal beliefsreporting rigorresponsible airigorous research practicesstakeholder engagementtheoretical constructs

In AI research and practice, rigor remains largely understood in terms of methodological rigor