Deepfake Analysis - Facial Structure: Donald Trump to George Bush Jr. (7 sec, 168 img) [tweaked]

INTRODUCTION

We are going to determine the requirements of image material to create a successful deepfake. Two videos will be shown for each of these test cases. The first case shows the results of merging the faces using the standard parameters (default). In the second case, each of the parameters for merging the faces is manually tweaked until they produce the best possible results. The YouTube video Bush's Best Speech was used as the output video for all tests.

TEST CASE

The main question here is whether you can achieve good results when the subjects have completely different facial structures. To test this, videos of Donald Trump and Hillary Clinton were used for face-swapping. Care was taken to select image material containing a good mix of images with frontal and side angles to ensure this would not be a factor in the test results.

OBSERVATION

The goal was to use two faces with very different facial structures. Donald Trump has a much rounder face than George Bush. Care was taken to ensure that the lighting and angle of the shots was as similar as possible in both cases to allow a close comparison of structural differences. The evaluation of this particular deepfake showed it to be a total failure. Trump’s and Bush’s contrasting skin tones emphasized their very different facial structures in the manual test case. In the default case, the problem is with the heavy flickering, as the most recent article pointed out. What’s more, the artificially rendered nose does not look anything like Donald Trump’s nose.

SOURCE VIDEOS

Setting (Destination George Bush Jr.):
* https://www.youtube.com/watch?v=tjarV_mN3QY

Faces (Source: George Clooney):
* https://www.youtube.com/watch?v=1vx5a28E22Q
* https://www.youtube.com/watch?v=gzruaxtLmnQ
* https://www.youtube.com/watch?v=uucY6D5jXkg
* https://www.youtube.com/watch?v=0qplKMU2VT0

LINK

Read more about Deepfake optimizations in the articles https://www.scip.ch/en/?labs.20181122 (part 1) and https://www.scip.ch/en/?labs.20190307 (part 2)

#Deepfake #ArtificialIntelligence #FakeNews #AI

Видео Deepfake Analysis - Facial Structure: Donald Trump to George Bush Jr. (7 sec, 168 img) [tweaked] канала scip AG