Deepfake Analysis - Obstruction: Special Case Glasses (Jimmy Fallon to John Oliver)

INTRODUCTION

We are going to determine the requirements of image material to create a successful deepfake. Two videos will be shown for each of these test cases. The first case shows the results of merging the faces using the standard parameters (default). In the second case, each of the parameters for merging the faces is manually tweaked until they produce the best possible results. The YouTube video Bush's Best Speech was used as the output video for all tests.

TEST CASE

The aim of these tests is to determine how to deal with hands in front of the face. In this category, we also performed a test in which we swapped a face with a beard for a face without a beard.

OBSERVATION

While researching the production of deepfakes, we came across an article featuring a transformation of Jimmy Fallon into John Oliver. The resulting deepfake is a compelling indication that glasses are still a problem. The faces pass muster, but the frames of the glasses look glued on, much like the beard before. Upon closer inspection, the viewer will notice that the temple of the glasses is missing.

SOURCE VIDEOS

Setting (Destination George Bush Jr.):
* https://www.youtube.com/watch?v=tjarV_mN3QY

Faces (Source: George Clooney):
* https://www.youtube.com/watch?v=1vx5a28E22Q
* https://www.youtube.com/watch?v=gzruaxtLmnQ
* https://www.youtube.com/watch?v=uucY6D5jXkg
* https://www.youtube.com/watch?v=0qplKMU2VT0

LINK

Read more about Deepfake optimizations in the articles https://www.scip.ch/en/?labs.20181122 (part 1) and https://www.scip.ch/en/?labs.20190307 (part 2)

#Deepfake #ArtificialIntelligence #FakeNews #AI

Видео Deepfake Analysis - Obstruction: Special Case Glasses (Jimmy Fallon to John Oliver) канала scip AG