Enhancement of damaged-image prediction through Cahn-Hilliard image inpainting
Abstract
We assess the benefit of including an image inpainting filter before passing damaged images into a classification neural network. We employ an appropriately modified Cahn-Hilliard equation as an image inpainting filter which is solved numerically with a finite-volume scheme exhibiting reduced computational cost and the properties of energy stability and boundedness. The benchmark dataset employed is Modified National Institute of Standards and Technology (MNIST) dataset, which consists of binary images of handwritten digits and is a standard dataset to validate image-processing methodologies. We train a neural network based on dense layers with MNIST, and subsequently we contaminate the test set with damages of different types and intensities. We then compare the prediction accuracy of the neural network with and without applying the Cahn-Hilliard filter to the damaged images test. Our results quantify the significant improvement of damaged-image prediction by applying the Cahn-Hilliard filter, which for specific damages can increase up to 50% and is advantageous for low to moderate damage.
- Publication:
-
Royal Society Open Science
- Pub Date:
- May 2021
- DOI:
- 10.1098/rsos.201294
- arXiv:
- arXiv:2007.10753
- Bibcode:
- 2021RSOS....801294C
- Keywords:
-
- Computer Science - Computer Vision and Pattern Recognition;
- Electrical Engineering and Systems Science - Image and Video Processing;
- Mathematics - Numerical Analysis;
- 68U10;
- 94A08;
- 65M22;
- 76M25;
- 76M12
- E-Print:
- An interactive jupyter notebook with the code of this work is available at https://github.com/sergiopperez/Image_Inpainting. The MNIST dataset employed in this work can be downloaded from http://yann.lecun.com/exdb/mnist/