SimSwap++: Towards Faster and High-Quality Identity Swapping

Xuanhong Chen, Bingbing Ni \dagger, Yutian Liu, Naiyuan Liu, Linzhi Zeng, Hang Wang

\dagger Corresponding author

Project page of SimSwap++

Please note that the current respository is a supplementary material for the SimSwap++ paper, NO issues will be replied at this stage. Once everything is ready we will release training and testing codes like our SimSwap.

VGGFace2-HQ Dataset

VGGFace2-HQ contains more than 1.36M 512 \times 512 aligned face images and up to 9, 630 distinct identities. In addition, this dataset consists of two parts:

• (1) a natural image sub-collection, which collects up to 200, 000 images covering 1, 000 different identities;
• (2) a synthetic image sub-collection, containing 8, 630 cleaned and re-annotated identities (i.e., clean up the images with mismatching identities and low-quality faces in the cropped VGGFace2).

Download the dataset:

Via Google Drive:

[Google Drive] VGGFace2-HQ

We are especially grateful to Kairui Feng PhD student from Princeton University.

Via Baidu Drive:

[Baidu Drive] VGGFace2-HQ Password: sjtu

Samples from VGGFace2-HQ

Natural Part:

Synthetic Part:

Methodology of SimSwap++

Additional Results:

Will be avaliable 2022/12/25

Video in-the-wild Results (under construction):

Videos are generated frame by frame without any temporal smoothing (e.g., Kalman Filter), which may cause some subtle flickering.

Group1 [SimSwap++ (S)]:

Source ID: Scarlett Johansson Target ID: Shakira (1080p on Google Drive)

Source ID: Dilireba Target ID: Shakira (1080p on Google Drive)

Source ID: Tom Cruise Target ID: Shakira (1080p on Google Drive)

Source ID: Elon Musk Target ID: Shakira (1080p on Google Drive)

Musk's face is always so recognizable!

Source ID: Keira Knightley Target ID: Shakira (1080p on Google Drive)

Source ID: Brad Pitt Target ID: Shakira (1080p on Google Drive)

Group2 [SimSwap++ (S)]:

Source ID: Kelly Clarkson Target ID: Taylor Swift (1080p on YouTube)

Source ID: Geoffrey Hinton Target ID: Taylor Swift (1080p on YouTube)

Source ID: Gal Gadot Target ID: Taylor Swift (1080p on YouTube)

Source ID: Leonardo DiCaprio Target ID: Taylor Swift (1080p on YouTube)

Source ID: Elon Musk Target ID: Taylor Swift (1080p on YouTube)

Source ID: Robert Downey Target ID: Taylor Swift (1080p on YouTube)

Source ID: Aamir Khan Target ID: Taylor Swift (1080p on YouTube)

Group3 [SimSwap++ (S)]:

I am Iron Man

Source ID: Elon Musk Target ID: Iron Man (1080p on Google Drive)

Will be avaliable 2022/12/25

Acknowledgements

• GFPGAN
• Insightface
• VGGFace2 Dataset for Face Recognition