DPA: A one-stop metric to measure bias amplification in classification datasets

Bhanu Tokas (Arizona State University) · Rahul Nair (Arizona State University) · Hannah Kerner (Arizona State University)
attacker functionbalanced datasetsbias amplificationclassification problemsco-occurrence-based metricsdataset biasdirectional predictability amplificationfine-grained bias analysisleakage amplificationnegative bias amplificationpositive bias amplificationpredictability-based metricprotected attributerelative changes in predictabilityunbalanced datasets

Most ML datasets today contain biases. When we train models on these datasets, they often not only learn these biases but can worsen them