Guided Image-to-Image Translation with Bi-Directional Feature Transformation
Abstract
We address the problem of guided image-to-image translation where we translate an input image into another while respecting the constraints provided by an external, user-provided guidance image. Various conditioning methods for leveraging the given guidance image have been explored, including input concatenation , feature concatenation, and conditional affine transformation of feature activations. All these conditioning mechanisms, however, are uni-directional, i.e., no information flow from the input image back to the guidance. To better utilize the constraints of the guidance image, we present a bi-directional feature transformation (bFT) scheme. We show that our bFT scheme outperforms other conditioning schemes and has comparable results to state-of-the-art methods on different tasks.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2019
- DOI:
- 10.48550/arXiv.1910.11328
- arXiv:
- arXiv:1910.11328
- Bibcode:
- 2019arXiv191011328A
- Keywords:
-
- Computer Science - Computer Vision and Pattern Recognition
- E-Print:
- ICCV 2019 Code: https://github.com/vt-vl-lab/Guided-pix2pix Project page: https://filebox.ece.vt.edu/~Badour/guided_pix2pix.html