Generating and Checking DNN Verification Proofs

Matthew Dwyer (Department of Computer Science, University of Virginia, Charlottesville) · Hai Duong (George Mason University) · ThanhVu Nguyen (George Mason University)
activation pattern tree proofsalgorithm designalgorithmic approachesbenchmark evaluationconformancedeep neural networksneural network verificationperformance optimizationproof checkingproof formatscalable checkingsoftware verificationsystem safetyunsound resultsverification tools

Deep Neural Networks (DNN) have emerged as an effective approach to implementing challenging subproblems. They are increasingly being used as components in critical transportation, medical, and military systems. However, like human-written software, DNNs may have flaws that can lead to unsafe system performance. To confidently deploy DNNs in such systems, strong evidence is needed that they do not contain such flaws. This has led researchers to explore the adaptation and customization of software verification approaches to the problem of neural network verification (NNV). Many dozens of NNV tools have been developed in recent years and as a field these techniques have matured to the point where realistic networks can be analyzed to detect flaws and to prove conformance with specifications. NNV tools are highly-engineered and complex may harbor flaws that cause them to produce unsound results. We identify commonalities in algorithmic approaches taken by NNV tools to define a verifier independent proof format