Awesome-DeepFake-Learning

The approach I work on DeepFake.

Awesome-DeepFake-Learning 1. Intuitive Learning2. Survey Paper3. Curated lists4. Deepfakes Datasets5. Generation of synthetic content 5.1 Generation Text ⚒️ Tools ⚒️📃 Papers 📃🌐 Webs 🌐😎 Awesome 😎 5.2 Generation Audio ⚒️ Tools ⚒️📃 Papers 📃 5.3 Generation Images ⚒️ Tools ⚒️📃 Papers 📃🌐 Webs 🌐😎 Awesome 😎 5.4 Generation Videos ⚒️ Tools ⚒️📃 Papers 📃🌐 Webs 🌐📺 Videos 📺 6. Detection of synthetic content 6.1 Detection Text ⚒️ Tools ⚒️📃 Papers 📃 6.2 Detection Audio ⚒️ Tools ⚒️📃 Papers 📃 6.3 Detection Images ⚒️ Tools ⚒️📃 Papers 📃 6.4 Detection Videos ⚒️ Tools ⚒️📃 Papers 📃📺 Videos 📺😎 Awesome 😎 7. Misc ArticlesTalksChallengesForums

1. Intuitive Learning

News From CNN10 DeepFake ExamplesAn Introduction to DeepFakes荷兰初创公司Deeptrace发布两个年度（2018年和2019年）Deepfakes发展状况调研报告

2. Survey Paper

The Creation and Detection of Deepfakes: A SurveyMedia Forensics and DeepFakes: an overviewDeepFakes and Beyond: A Survey of Face Manipulation and Fake DetectionDeep Learning for Deepfakes Creation and Detection: A Survey

3. Curated lists

Deep-Learning-for-Tracking-and-Detection: Collection of papers, datasets, code and other resources for object tracking and detection using deep learning

4. Deepfakes Datasets

DatasetsYearRatiotampered:originalTotal videosSourceParticipants ConsentToolsUADFV20181 : 1.0098YouTubeNFakeAPPFaceForensics20181 : 1.002008YouTubeNFace2FaceDeepfake-TIMIT20191 : 1.00620Vid-TIMITNfaceswap-GANFaceForensics++20191 : 0.255000YouTubeNfaceswap DeepFake Face2Face NeuralTexturesDeepFakeDetection(part of FaceForensics++)20191 : 0.123363ActorsYCeleb-DF20191 : 0.511203YouTubeNa refined version of the DeepFakeDFDC Preview Dataset20191 : 0.285214ActorsYUnkonwn

5. Generation of synthetic content

5.1 Generation Text

⚒️ Tools ⚒️

NameDescriptionDemoPopularityGroverGrover is a model for Neural Fake News – both generation and detection. However, it probably can also be used for other generation tasks.https://grover.allenai.org/gpt-2xyGPT-2 User Interface based on HuggingFace’s Pytorch Implementationhttps://gpt2.ai-demo.xyz/CTRLConditional Transformer Language Model for Controllable GenerationN/ATalk to TransformerSee how a modern neural network completes your text. Type a custom snippet or try one of the exampleshttps://talktotransformer.comN/ALEOFirst intelligent system for creating news in SpanishN/AN/ABig BirdBird Bird uses State of the Art (SOTA) Natural Language Processing to aid your fact-checked and substantive content.BigBirdDemoN/AaitextgenA robust Python tool for text-based AI training and generation using GPT-2.DemoGPT-3GPT-3: Language Models are Few-Shot LearnersN/A

📃 Papers 📃

Language Models are Unsupervised Multitask LearnersSaliency Maps Generation for Automatic Text SummarizationAutomatic Conditional Generation of Personalized Social Media Short TextsNeural Text Generation in Stories Using Entity Representations as ContextDeepTingleGPT-3: Language Models are Few-Shot LearnersEvaluation of Text Generation: A Survey

🌐 Webs 🌐

NotRealNewsBotPoetTheseLyricsDoNotExistThisResumeDoesNotExistNotRealNewsThisArtWorkDoesnotExistBoredHumansGPT-2 Neural Network PoetryA.ttent.ioThisEpisodeDoesNotExist

😎 Awesome 😎

awesome-text-generationAwesome GPT-3

5.2 Generation Audio

⚒️ Tools ⚒️

NameDescriptionDemoPopularityReal-Time-Voice-CloningClone a voice in 5 seconds to generate arbitrary speech in real-timehttps://www.youtube.com/watch?v=-O_hYhToKoALyrebirdCreate your own vocal avatar!N/AN/ADescryptRecord. Transcribe. Edit. Mix. As easy as typing.N/AN/ACommon VoiceCommon Voice is Mozilla’s initiative to help teach machines how real people speak.N/AN/AResemble.aiResemble can clone any voice so it sounds like a real human.N/AN/ATacoTronTacotron (/täkōˌträn/): An end-to-end speech synthesis system by Google.DemoSonanticCreate a captivating performance using emotionally expressive text-to-speech.DemoN/A15.aiNatural text-to-speech synthesis with minimal data.DemoN/A

📃 Papers 📃

Neural Voice Cloning with a Few SamplesData Efficient Voice Cloning for Neural Singing SynthesisEfficient Neural Audio SynthesisScore and Lyrics-free Singing Voice GenerationGenerating diverse and natural Text-to-Speech samples using a quantized fine-grained vae and autoregressive prosody priorRave.dj

5.3 Generation Images

⚒️ Tools ⚒️

NameDescriptionDemoPopularityStyleGANAn alternative generator architecture for generative adversarial networks, borrowing from style transfer literature. The new architecture leads to an automatically learned, unsupervised separation of high-level attributes (e.g., pose and identity when trained on human faces) and stochastic variation in the generated images (e.g., freckles, hair), and it enables intuitive, scale-specific control of the synthesis. The new generator improves the state-of-the-art in terms of traditional distribution quality metrics, leads to demonstrably better interpolation properties, and also better disentangles the latent factors of variation.https://www.youtube.com/watch?v=kSLJriaOumAStyleGAN2Improved version for StyleGAN.https://www.youtube.com/watch?v=c-NJtV9Jvp0DG-NetJoint Discriminative and Generative Learning for Person Re-identificationhttps://www.youtube.com/watch?v=ubCrEAIpQs4GANSpaceDiscovering Interpretable GAN Controlshttp://www.exploreganspace.com/StarGAN v2StarGAN v2 - Official PyTorch Implementation (CVPR 2020)https://youtu.be/0EVh5Ki4dIYImage GPTImage GPTN/AFQ-GANOfficial implementation of FQ-GANhttp://40.71.23.172:8888EHM_FacesEHM_Faces is a machine learning project that can generate high-quality, realistic ice hockey player portraits. Primarily meant for the game Eastside Hockey Manager (EHM), this project can generate portraits either one-at-a-time or in batches (the resulting batches are called facepacks).N/ARewriting a Deep Generative ModelEdits the weights of a deep generative network by rewriting associative memory directly, without training dataDemo

📃 Papers 📃

A Style-Based Generator Architecture for Generative Adversarial NetworksAnalyzing and Improving the Image Quality of StyleGANHigh-Resolution Image Synthesis and Semantic Manipulation with Conditional GANsComplement Face Forensic Detection and Localization with Facial LandmarksJoint Discriminative and Generative Learning for Person Re-identificationImage2StyleGAN++: How to Edit the Embedded Images?StyleGAN2 Distillation for Feed-forward Image ManipulationGenerative Pretraining from PixelsIntrinsic Autoencoders for Joint Neural Rendering and Intrinsic Image DecompositionStarGAN v2: Diverse Image Synthesis for Multiple DomainsFeature Quantization Improves GAN TrainingHigh-Resolution Neural Face Swapping for Visual EffectsImproving Style-Content Disentanglement in Image-to-Image TranslationRewriting a Deep Generative Model

🌐 Webs 🌐

ThisPersonDoesNotExistWhichFaceIsRealThisRentalDoesNotExistThisCatDoesNotExistThisWaifuDoesNotExistthispersondoesnotexist

😎 Awesome 😎

Awesome Pretrained StyleGAN2

5.4 Generation Videos

⚒️ Tools ⚒️

NameDescriptionDemoPopularityFaceSwapGrover is a model for Neural Fake News – both generation and detection. However, it probably can also be used for other generation tasks.https://www.youtube.com/watch?v=r1jng79a5xcFace2FaceFaceSwap is a tool that utilizes deep learning to recognize and swap faces in pictures and videos.N/AFaceswapFaceSwap is an app that I have originally created as an exercise for my students in “Mathematics in Multimedia” on the Warsaw University of Technology.N/AFaceswap-GANAdding Adversarial loss and perceptual loss (VGGface) to deepfakes’(reddit user) auto-encoder architecture.https://github.com/shaoanlu/faceswap-GAN/blob/master/colab_demo/faceswap-GAN_colab_demo.ipynbDeepFaceLabDeepFaceLab is a tool that utilizes machine learning to replace faces in videos.https://www.youtube.com/watch?v=um7q–QEkg4Vid2VidPytorch implementation for high-resolution (e.g., 2048x1024) photorealistic video-to-video translation.https://www.youtube.com/watch?v=5zlcXTCpQqMDFakerPytorch implementation for high-resolution (e.g., 2048x1024) photorealistic video-to-video translation.N/AImage AnimationThe videos on the left show the driving videos. The first row on the right for each dataset shows the source videos.https://www.youtube.com/watch?v=mUfJOQKdtAkAvatarifyPhotorealistic avatars for Skype and Zoom. Democratized. Based on First Order Motion Model…https://www.youtube.com/watch?v=lONuXGNqLO0Speech driven animationThis library implements the end-to-end facial synthesis model.N/A

📃 Papers 📃

HeadOn: Real-time Reenactment of Human Portrait VideosFace2Face: Real-time Face Capture and Reenactment of RGB VideosSynthesizing Obama: Learning Lip Sync from AudioThe Creation and Detection of Deepfakes: A Survey

🌐 Webs 🌐

DeepFake中文网 🇨🇳Website for creating deepfake videos with learningDeep Fakes Net - Deepfakes NetworkFaceswap is the leading free and Open Source multi-platform Deepfakes softwareFakeningDeepFakesWeb

📺 Videos 📺

How to Animate Image with a Video

6. Detection of synthetic content

6.1 Detection Text

⚒️ Tools ⚒️

NameDescriptionDemoPopularityGroverGrover is a model for Neural Fake News – both generation and detection. However, it probably can also be used for other generation tasks.https://grover.allenai.org/GLTRDetecting text that was generated from large language models (e.g. GPT-2).http://gltr.io/dist/index.htmlfake news detectionIn this project, we aim to build state-of-the-art deep learning models to detect fake news based on the content of article itself.DemoGPTrue or FalseDisplay the likelihood that a sample of text was generated by OpenAI’s GPT-2 model.N/AN/A

📃 Papers 📃

GLTR: Statistical Detection and Visualization of Generated TextHuman and Automatic Detection of Generated TextCTRL: A Conditional Transformer Language Model for Controllable GenerationThe Limitations of Stylometry for Detecting Machine-Generated Fake News

6.2 Detection Audio

⚒️ Tools ⚒️

NameDescriptionDemoPopularitySpooded speech detectionThis work is part of the “DDoS Resilient Emergency Dispatch Center” project at the University of Houston, funded by the Department of Homeland Security (DHS).N/AFake voice detectionThis repository provides the code for a fake audio detection model built using Foundations Atlas. It also includes a pre-trained model and inference code, which you can test on any of your own audio files.N/AFake Voice DetectorFor “Deep Learning class” at ETHZ. Evaluate how well the fake voice of Barack Obama 1. confuses the voice verification system, 2. can be detected.N/ACycleGAN Voice ConverterAn implementation of CycleGAN on human speech conversionshttps://leimao.github.io/project/Voice-Converter-CycleGAN/

📃 Papers 📃

Can We Detect Fake Voice Generated by GANs?CycleGAN Voice ConverterThe Rise of Synthetic Audio Deepfakes

6.3 Detection Images

⚒️ Tools ⚒️

NameDescriptionDemoPopularityFALdetectorDetecting Photoshopped Faces by Scripting Photoshop.https://www.youtube.com/watch?v=TUootD36Xm0

📃 Papers 📃

Detecting Photoshopped Faces by Scripting Photoshop

6.4 Detection Videos

⚒️ Tools ⚒️

NameDescriptionDemoPopularityFaceForensics++FaceForensics++ is a forensics dataset consisting of 1000 original video sequences that have been manipulated with four automated face manipulation methods: Deepfakes, Face2Face, FaceSwap and NeuralTextures.https://www.youtube.com/watch?v=x2g48Q2I2ZQFace ArtifactsOur method is based on the observations that current DeepFake algorithm can only generate images of limited resolutions, which need to be further warped to match the original faces in the source video.N/ADeepFake-DetectionOur Pytorch implementation, conducts extensive experiments to demonstrate that the datasets produced by Google and detailed in the FaceForensics++ paper are not sufficient for making neural networks generalize to detect real-life face manipulation techniques.http://deepfake-detection.dessa.com/projectsCapsule-Forensics-v2Implementation of the paper: Use of a Capsule Network to Detect Fake Images and Videos.N/AClassNSegImplementation of the paper: Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos (BTAS 2019).N/AfakeVideoForensicsFake video detectorhttps://www.youtube.com/watch?v=8YYRT4lzQgY[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-Ka08jQIx-1599098979903)(https://badgen.net/github/stars/next-security-lab/fakeVideoForensics)]

📃 Papers 📃

Exposing DeepFake Videos By Detecting Face Warping ArtifactsDeepFakes: a New Threat to Face Recognition? Assessment and DetectionFaceForensics++: Learning to Detect Manipulated Facial ImagesDeepfake Video Detection Using Recurrent Neural NetworksDeep Learning for Deepfakes Creation and Detection: A SurveyProtecting World Leaders Against Deep FakesCapsule-Forensics: Using Capsule Networks to Detect Forged Images and VideosDeepFakes and Beyond: A Survey of Face Manipulation and Fake DetectionMedia Forensics and DeepFakes: an overviewEverybody’s Talkin’: Let Me Talk as You WantFSGAN: Subject Agnostic Face Swapping and ReenactmentCeleb-DF (v2): A New Dataset for DeepFake ForensicsDeepfake Video Detection through Optical Flow based CNNMesoNet: a Compact Facial Video Forgery Detection NetworkAdversarial DeepfakesOne-Shot GAN Generated Fake Face DetectionEvading Deepfake-Image Detectors with White- and Black-Box AttacksDeepfakes Detection with Automatic Face WeightingUnmasking DeepFakes with simple FeaturesVideoForensicsHQ: Detecting High-quality Manipulated Face VideosDisrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation SystemsDetecting Deepfake Videos: An Analysis of Three TechniquesOC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder

📺 Videos 📺

Deepfake Detection using LSTM and ResNext CNNEnd-To-End AI Video Generation To Bring Fake Humans To LifeDeepFake Cyber Security Threats And Opportunities - Matt Lewis

😎 Awesome 😎

Awesome-Deepfakes-Materials

7. Misc

Articles

2020 Guide to Synthetic MediaMachine Learning ExperimentsBuilding rules in public: Our approach to synthetic & manipulated mediaContenido Sintético (parte I): generación y detección de audio y texto 🇪🇸Contenido Sintético (parte II): generación y detección de imagenes 🇪🇸Contenido Sintético (parte III): generación y detección de vídeo 🇪🇸Fake CandidateUnraveling the mystery around deepfakesCyber-Security implications of deepfakesDeepfake Detection Challenge Results: An open initiative to advance AIThe Synthetic Media LandscapeDo (Microtargeted) Deepfakes Have Real Effects on Political Attitudes?

Talks

ICML 2019 Synthetic RealitiesCCN-CERT: Automatizando la detección de contenido Deep Fake 🇪🇸TED Talk: Fake videos of real peopleHacking with SkynetRSA: Deep Fakes Are Getting Terrifyingly RealCVPR 2020 Workshop on media forensics

Challenges

NIST: Media Forensics Challenge 2019ASVspoof: Automatic Speaker VerificationKaggle: DeepFake Detection ChallengeFake News ChallengeXente: Fraud detection challengeChalearn Multi-modal Cross-ethnicity Face anti-spoofing Recognition Challenge

Forums

Reddit: MediaSynthesisReddit: Digital ManipulationMrDeepFake Forums 🔞AIVillage

More avaliable: Link