Zero-Shot Blind-Spot Image Denoising via Cross-Scale Non-Local Pixel Refilling

Qilong Guo (National University of Singapore) · Tianjing Zhang (National University of Singapore) · Zhiyuan Ma (Huazhong University of Science and Technology) · Hui Ji (National University of Singapore)
blind-spot denoisingcomputational schemedenoising performancedistant pixel replacementestimation trade-offlocal noise correlationsmasked target pixelsnoise correlation reductionnoise suppressionpixel-value dependenciesprediction improvementstatistical riskstructural consistencytheoretical analysiszero-shot image denoising

Blind-spot denoising (BSD) method is a powerful paradigm for zero-shot image denoising by training models to predict masked target pixels from their neighbors. However, they struggle with real-world noise exhibiting strong local correlations, where efforts to suppress noise correlation often weaken pixel-value dependencies, adversely affecting denoising performance. This paper presents a theoretical analysis quantifying the impact of replacing masked pixels with observations exhibiting weaker noise correlation but potentially reduced similarity, revealing a trade-off that impacts the statistical risk of the estimation. Guided by this insight, we propose a computational scheme that replaces masked pixels with distant ones of similar appearance and lower noise correlation. This strategy improves the prediction by balancing noise suppression and structural consistency. Experiments confirm the effectiveness of our method, outperforming existing zero-shot BSD methods.