chenxuanhong
8.8 KiB
SimSwap++: Towards Faster and High-Quality Identity Swapping
Xuanhong Chen, Bingbing Ni \dagger, Yutian Liu, Naiyuan Liu, Linzhi Zeng, Hang Wang
\dagger Corresponding author
Project page of SimSwap++
Please note that the current respository is a supplementary material for the SimSwap++ paper, NO issues will be replied at this stage. Once everything is ready we will release training and testing codes like our SimSwap.
VGGFace2-HQ Dataset
VGGFace2-HQ contains more than 1.36M 512 \times 512 aligned
face images and up to 9, 630 distinct identities. In addition, this dataset
consists of two parts:
- (1) a natural image sub-collection, which collects up to
200, 000images covering1, 000different identities; - (2) a synthetic image sub-collection, containing
8, 630cleaned and re-annotated identities (i.e., clean up the images with mismatching identities and low-quality faces in the cropped VGGFace2).
Download the dataset:
Via Google Drive:
We are especially grateful to Kairui Feng PhD student from Princeton University.
Via Baidu Drive:
[Baidu Drive] VGGFace2-HQ Password: sjtu
Samples from VGGFace2-HQ
Natural Part:
Synthetic Part:
Methodology of SimSwap++
Additional Results:
[Source ID: Angelina Jolie Target ID: Gamora]
[Source ID: Tom Cruise Target ID: Gamora]
[Source ID: Brad Pitt Target ID: Gamora]
[Source ID: Will Smith Target ID: Gamora]
[Source ID: Geoffrey Hinton Target ID: Gamora]
[Source ID: Captain America Chris Evans Target ID: Gamora]
[Source ID: Jim Carrey Target ID: Gamora]
[Source ID: Matthew McConaughey Target ID: Gamora]
[Source ID: Jackie Chan Target ID: Gamora]
[Source ID: Messi Target ID: Gamora]
[Source ID: Kylian Mbappé Target ID: Gamora]
[Source ID: Cristiano Ronaldo Target ID: Gamora]
Video in-the-wild Results (under construction):
Videos are generated frame by frame without any temporal smoothing (e.g., Kalman Filter), which may cause some subtle flickering.
Group1 [SimSwap++ (S)]:
Source ID: Scarlett Johansson Target ID: Shakira (1080p on YouTube)
Source ID: Dilireba Target ID: Shakira (1080p on Google Drive)
Source ID: Tom Cruise Target ID: Shakira (1080p on Google Drive)
Source ID: Elon Musk Target ID: Shakira (1080p on Google Drive)
Musk's face is always so recognizable!
Source ID: Keira Knightley Target ID: Shakira (1080p on Google Drive)
Source ID: Brad Pitt Target ID: Shakira (1080p on Google Drive)
Source ID: Nicole Kidman Target ID: Shakira (1080p on Google Drive)
Group2 [SimSwap++ (S)]:
Source ID: Kelly Clarkson Target ID: Taylor Swift (1080p on YouTube)
Source ID: Geoffrey Hinton Target ID: Taylor Swift (1080p on YouTube)
Source ID: Gal Gadot Target ID: Taylor Swift (1080p on YouTube)
Source ID: Leonardo DiCaprio Target ID: Taylor Swift (1080p on YouTube)
Source ID: Elon Musk Target ID: Taylor Swift (1080p on YouTube)
Source ID: Robert Downey Target ID: Taylor Swift (1080p on YouTube)
Source ID: Aamir Khan Target ID: Taylor Swift (1080p on YouTube)
Group3 [SimSwap++ (S)] Complex Movie Scene:
I am Iron Man
Few previous face-swapping papers have published such complex movie scenes
The subtle flickering can be resolved by introducing temporal smoothing, which is not our concern
Source ID: Captain America Chris Evans Target ID: Iron Man (1080p on YouTube)
Source ID: Scarlett Johansson Target ID: Iron Man (1080p on YouTube)
Source ID: Elon Musk Target ID: Iron Man (1080p on Google Drive)
Source ID: Leonardo Target ID: Iron Man (1080p on YouTube)
Source ID: Gal Gadot Target ID: Iron Man (1080p on YouTube)
Will be avaliable 2022/12/25