Original paper Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation (Junho Kim, Minjae Kim, Hyeonwoo Kang, Kwanghee Lee). UGATIT is originally used for image to image translation. In this project, we want to apply UGATIT to video.
Face to Anime Video Translation Results: https://www.youtube.com/watch?v=NZepV-hC_ZY
Histogram Matching
- Promote consistency between frames, eliminate flickering.
Training Progress
Link to pretrain model: https://rutgers.box.com/shared/static/d2xr2jpn8gfyxkhre6ob0agegjbkb8cu.pt
- pytorch == 1.7
- torchvision == 0.8.2
- pytorch-lightning == 1.0