BridgePure: Limited Protection Leakage Can Break Black-Box Data Protection

Gautam Kamath (University of Waterloo) · Yihan Wang (Institute of Computing Technology, Chinese Academy of Sciences) · Yiwei Lu (University of Waterloo) · Xiao-Shan Gao (Academy of Mathematics and Systems Science, Chinese Academy of Sciences) · Yaoliang Yu (University of Waterloo)
adversarial queryingavailability attacksblack-box toolsbridgepureclassification tasksdata protectiondefensive techniquesdiffusion bridge modelmappingmulti-level countermeasuresprotection leakagepurification performancestyle mimicryunauthorized machine learning modelsunlearnable examplesvulnerabilities

Availability attacks, or unlearnable examples, are defensive techniques that allow data owners to modify their datasets in ways that prevent unauthorized machine learning models from learning effectively while maintaining the data's intended functionality. It has led to the release of popular black-box tools (e.g., APIs) for users to upload personal data and receive protected counterparts. In this work, we show that such black-box protections can be substantially compromised if a small set of unprotected in-distribution data is available. Specifically, we propose a novel threat model of protection leakage, where an adversary can (1) easily acquire (unprotected, protected) pairs by querying the black-box protections with a small unprotected dataset; and (2) train a diffusion bridge model to build a mapping between unprotected and protected data. This mapping, termed BridgePure, can effectively remove the protection from any previously unseen data within the same distribution. BridgePure demonstrates superior purification performance on classification and style mimicry tasks, exposing critical vulnerabilities in black-box data protection. We suggest that practitioners implement multi-level countermeasures to mitigate such risks.