Author(s):Wang, N., Wang, W., Hu, W.
Published In:IEEE Transactions on Image Processing, vol. 30, pp. 3720-3733, 2021
Keywords:Convolution , Feature extraction , Image restoration , Training , Kernel , Image reconstruction , Cultural differences , Image inpainting , Thanka restoration , multi-scale , partial convolution , mask generation
Thanka murals are important cultural heritages of Tibet, but many precious murals were damaged during history. Thanka mural restoration is very important for the protection of Tibetan cultural heritage. Partial convolution has great potential for Thanka mural restoration due to its outstanding performance for inpainting irregular holes. However, three challenges prevent the existing partial convolution-based methods from solving Thanka restoration problems:
To resolve these problems, we propose a Thanka mural inpainting method based on multi-scale adaptive partial convolution and stroke-like masks. The proposed method consists of three parts:
Experiments on both simulated and real damages of Thanka murals demonstrated that our approach works well on a small dataset (N=2780), generates realistic mural content, and restores the damaged Thanka murals with high speed (600 ms for multiple holes in 512×512 images). The proposed end-to-end method can be applied to other small datasets-based inpainting tasks.