Awesome-GANS-and-Deepfakes

A curated list of GAN & Deepfake papers and repositories. :heavy_check_mark: means implementation is available.

GANs

Tl;dr GANs containg two competing neural networks which iteratively generate new data with the same statistics as the training set.

Unconditional GANs

• :heavy_check_mark: Vanilla GAN: Generative Adversarial Networks, [paper], [github]
• :heavy_check_mark: DCGAN: Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks, [paper], [github]
• :heavy_check_mark: WGAN: Wasserstein GAN, [paper], [github]
• :heavy_check_mark: WGAN-GP: Improved Training of Wasserstein GANs, [paper], [github]
• :heavy_check_mark: RGAN: The relativistic discriminator: a key element missing from standard GAN, [paper], [github]
• :heavy_check_mark: BGAN: Boundary-Seeking Generative Adversarial Networks, [paper], [github]
• :heavy_check_mark: ClusterGAN: Latent Space Clustering in Generative Adversarial Networks, [paper], [github]

Conditional GANs

• :heavy_check_mark: CGAN: Conditional Generative Adversarial Nets, [paper], [github]
• :heavy_check_mark: ACGAN: Conditional Image Synthesis With Auxiliary Classifier GANs, [paper], [github]
• :heavy_check_mark: CCGAN: Semi-Supervised Learning with Context-Conditional Generative Adversarial Networks, [paper], [github]

Image-to-Image Translation

• :heavy_check_mark: CycleGAN: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks, [paper], [github]
• :heavy_check_mark: StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation, [paper], [github]
• :heavy_check_mark: Pix2Pix: Image-to-Image Translation with Conditional Adversarial Nets, [paper], [github]
• :heavy_check_mark: DualGAN: Unsupervised Dual Learning for Image-to-Image Translation, [paper], [github]
• :heavy_check_mark: BicycleGAN: Toward Multimodal Image-to-Image Translation, [paper], [github]

Volumetric (3D) Generation

• :heavy_check_mark: 3DGAN: Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling, [paper], [github]
• :heavy_check_mark: Inverse Graphics GAN: Inverse Graphics GAN - Learning to Generate 3D Shapes from Unstructured 2D Data, [paper], [github]

Applications using GANs

Anime generator

• Towards the Automatic Anime Characters Creation with Generative Adversarial Networks, [paper]
• :heavy_check_mark: [Project] Keras-GAN-Animeface-Character, [github]

Interactive Image generation

• :heavy_check_mark: Generative Visual Manipulation on the Natural Image Manifold, [paper], [github]
• :heavy_check_mark: Neural Photo Editing with Introspective Adversarial Networks, [paper], [github]

3D Object generation

• 3D Shape Induction from 2D Views of Multiple Objects, [paper]
• :heavy_check_mark: Parametric 3D Exploration with Stacked Adversarial Networks, [github], [youtube]
• :heavy_check_mark: Fully Convolutional Refined Auto-Encoding Generative Adversarial Networks for 3D Multi Object Scenes, [github], [blog]

Super-resolution

• :heavy_check_mark: Image super-resolution through deep learning, [github]
• :heavy_check_mark: Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, [paper], [github]
• High-Quality Face Image Super-Resolution Using Conditional Generative Adversarial Networks, [paper]
• :heavy_check_mark: Analyzing Perception-Distortion Tradeoff using Enhanced Perceptual Super-resolution Network, [paper], [github]
• :heavy_check_mark: ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks, [paper], [github]
• :heavy_check_mark: MUNIT: Multimodal Unsupervised Image-to-Image Translation, [paper], [github]
• :heavy_check_mark: SRGAN: Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, [paper], [github]

Image Inpainting (hole filling)

• :heavy_check_mark: Context Encoders: Feature Learning by Inpainting, [paper], [github]
• :heavy_check_mark: Semantic Image Inpainting with Perceptual and Contextual Losses, [paper], [github]
• :heavy_check_mark: Generative Face Completion, [paper], [github]

Medical Image Segmentation

• :heavy_check_mark: Vox2Vox: 3D-GAN for Brain Tumor Segmentation, [paper], [github]
• SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation, [paper]
• Generative Adversarial Neural Networks for Pigmented and Non-Pigmented Skin Lesions Detection in Clinical Images, [paper]

Deepfakes

Tl;dr Deepfakes are fake videos or audio recordings that look and sound just like the real thing. Watch this video of Obama speaking... or was that really him?

CNN-based Face-swapping

• :heavy_check_mark: Fast Face-swap Using Convolutional Neural Networks, [paper], [github]
• :heavy_check_mark: DeepFaceLab: A simple, flexible and extensible face swapping framework, [paper], [github]

GAN-based Face-swapping

• :heavy_check_mark: Fewshot Face Translation GAN, [github]
• Faceswap-GAN, [github]
• :heavy_check_mark: AttGAN: Facial Attribute Editing by Only Changing What You Want, [paper], [github]
• MulGAN: Facial Attribute Editing by Exemplar, [paper]
• :heavy_check_mark: MaskGAN: Towards Diverse and Interactive Facial Image Manipulation, [paper], [github]
• :heavy_check_mark: StarGAN v2: Diverse Image Synthesis for Multiple Domains, [paper], [github]
• :heavy_check_mark: FSGAN: Subject Agnostic Face Swapping and Reenactment, [paper], [github]

Deepfake Detection

CNN-based methods

• :heavy_check_mark: MesoNet [paper], [github]
• Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches, [paper]
• Deep Fake Image Detection Based on Pairwise Learning, [paper]

RCN-based methods

• Recurrent Convolutional Strategies for Face Manipulation Detection in Videos, [paper]

Other ML methods

• SVM: Exposing Deep Fakes Using Inconsistent Head Poses, [paper]

Datasets

• Google Deepfake Detection Dataset
• FaceForensics++ Dataset
• Facebook Deepfake Detection Challenge (DFDC) Dataset
• "SwapMe and Faceswap" dataset
• "Fake Faces in the Wild (FFW) dataset
• Tampered Face (TAMFA) Dataset
• Celeb-DF(v2) Celebrity Deepfake Dataset
• DeeperForensics-1.0
• Diverse Fake Face Dataset (DFFD)