mmediting/configs/inpainting/global_local

• Global&Local (ToG'2017)
• • Abstract
  • Results and models
  • Citation

Global&Local (ToG'2017)

Globally and Locally Consistent Image Completion

Abstract

We present a novel approach for image completion that results in images that are both locally and globally consistent. With a fully-convolutional neural network, we can complete images of arbitrary resolutions by flling in missing regions of any shape. To train this image completion network to be consistent, we use global and local context discriminators that are trained to distinguish real images from completed ones. The global discriminator looks at the entire image to assess if it is coherent as a whole, while the local discriminator looks only at a small area centered at the completed region to ensure the local consistency of the generated patches. The image completion network is then trained to fool the both context discriminator networks, which requires it to generate images that are indistinguishable from real ones with regard to overall consistency as well as in details. We show that our approach can be used to complete a wide variety of scenes. Furthermore, in contrast with the patch-based approaches such as PatchMatch, our approach can generate fragments that do not appear elsewhere in the image, which allows us to naturally complete the image.

Results and models

Note that we do not apply the post-processing module in Global&Local for a fair comparison with current deep inpainting methods.

Places365-Challenge

Method	Mask Type	Resolution	Train Iters	Test Set	l1 error	PSNR	SSIM	Download
Global&Local	square bbox	256x256	500k	Places365-val	11.164	23.152	0.862	model | log

CelebA-HQ

Method	Mask Type	Resolution	Train Iters	Test Set	l1 error	PSNR	SSIM	Download
Global&Local	square bbox	256x256	500k	CelebA-val	6.678	26.780	0.904	model | log

Citation

@article{iizuka2017globally,
  title={Globally and locally consistent image completion},
  author={Iizuka, Satoshi and Simo-Serra, Edgar and Ishikawa, Hiroshi},
  journal={ACM Transactions on Graphics (ToG)},
  volume={36},
  number={4},
  pages={1--14},
  year={2017},
  publisher={ACM New York, NY, USA}
}