Deepfakes are coming. Is Big Tech ready?

Mark Zuckerberg insisted at Facebook's annual developer ...

Posted: Aug 8, 2018 3:09 PM
Updated: Aug 8, 2018 3:09 PM

Mark Zuckerberg insisted at Facebook's annual developer conference earlier this year that his company "will never be unprepared ... again" for meddling and disinformation efforts like those run by Russian trolls on its platform during the run-up to the 2016 election.

Yet the social media behemoth and its competitors may still be ill-equipped for their next great challenge: Fake videos that look so real you'd believe former President Obama really did call President Trump a "dipsh*t."

Platforms like Facebook, Twitter and YouTube have been moving recently to deal with the threats posed by misinformation and meddling that they didn't see coming, but now they face an emerging form of disinformation they know is on the horizon: Deepfakes -- doctored videos that will eventually fool even the sharpest eyes. As the technology to create deepfakes advances, experts say, it won't be long before it's used to foment discord or even affect an election.

"The opportunity for malicious liars is going to grow by leaps and bounds," said Bobby Chesney, professor and associate dean of the University of Texas School of Law who has been closely researching deepfakes.

Twitter, YouTube, and Reddit also are natural targets for deepfakes, and you can expect to see fringe platforms and porn websites flooded with them. Yet asked by CNNMoney just what they're doing to prepare for this looming problem, none of the major social media platforms would discuss it in detail. The companies wouldn't name the researchers they're working with, how much money they'll pour into detection, or even say how many people they've assigned to figure it out.

None of them offered much more than vague explanations along the lines of Facebook's promise to "protect the community from real-world harm."

That's not to say they aren't working on it at all. Facebook, for example, said it is collaborating with academics to see how their research might be applied to the platform. One researcher told CNNMoney that Google has reached out to him. But in the meantime, developers are continuing to work to perfect the technology and make the videos it produces more convincing.

Related: Mark Zuckerberg clarifies his Holocaust comments

The word "deepfakes" refers to using deep learning, a type of machine learning, to add anyone's face and voice to video. It has been mostly found on the internet's dark corners, where some people have used it to insert ex-girlfriends and celebrities into pornography. But BuzzFeed provided a glimpse of a possible future in April when it created a video that supposedly showed Obama mocking Trump, but in reality, Obama's face was superimposed onto footage of Hollywood filmmaker Jordan Peele using deepfake technology.

Deepfakes could pose a greater threat than the fake news and Photoshopped memes that littered the 2016 presidential election because they can be hard to spot and because people are -- for now -- inclined to believe that video is real. But it's not just about individual videos that will spread misinformation: it's also the possibility that videos like these will convince people that they simply can't trust anything they read, hear or see unless it supports the opinions they already hold.

Experts say fake videos that will be all but impossible to identify as such are as little as 12 months away.

Jonathon Morgan, the CEO of New Knowledge, which helps companies fight misinformation campaigns and has done some analysis for CNN, sees troll farms using AI to create and deliver fake videos tailored to social media users' specific biases. That's exactly what the Russian-backed trolls at the Internet Research Agency did during the last presidential election, but without the added punch of faked video.

Related: Whatsapp is adding new restrictions as killings continue in India

Aviva Ovadya, chief technologist at the Center for Social Media Responsibility, said social media companies are "still at the early stages of addressing 2016-era misinformation," and "it's very likely there won't be any real infrastructure in place" to combat deepfakes any time soon.

Many platforms already enforce rules around nudity that could apply to any faked porn they may find. But none of them have guidelines governing deepfakes in general, said Sam Woolley of the Digital Intelligence Lab at Institute for the Future. This goes beyond silly GIFs or satirical videos to more troubling content like, say, a faked video of a politician or businessman in a compromising situation, or hoax footage supposedly showing soldiers committing war crimes. "These have potentially larger implications for society and democracy," Woolley said.

Companies like Facebook and Twitter often argue that they are platforms, not publishers, and note that Section 230 of the 1996 Communications Decency Act absolves them of responsibility for content posted by users.

The recent uproar over the hate speech, fake news and disinformation polluting tech platforms has led companies to take more action -- even if the CEOs leading the effort have been inconsistent, even downright baffling, in explaining themselves. Still, the companies haven't addressed doctored videos specifically.

"It's not a question of if they take action on deepfakes, or if they begin to moderate this content," Woolley said. "It's a question of when. At the moment, the movement is pretty slim."

Infrastructure to combat faked videos may come from the Pentagon: The Defense Advanced Research Projects Agency is midway through a four-year effort to develop tools to identify deepfake videos and other doctored images. Experts in the field said using algorithms to analyze biometric data is one promising tool.

Satya Venneti of Carnegie Mellon University has seen some success identifying fakes by analyzing the pulses of people in deepfake demonstration videos. People typically exhibit similar blood flow in their forehead, cheeks, and neck. But she found "widely varying heart rate signals" in spoofed videos, something that happened when a video was layered with images.

Related: Google is hiring 10,000 people to clean up

In some cases, she saw heart rates of 57 to 60 beats per minute in the cheeks and 108 in the forehead. "We don't expect to see such wide differences," she said.

Siwei Lyu, director of Computer Vision and Machine Learning Lab at University at Albany SUNY, outlined another trick in a paper he co-wrote in June: Look for regular blinks. "If a video is 30 seconds and you never see the person blink, that is suspicious," he told CNNMoney.

After his paper was released, Lyu said deepfake developers used his research to successfully improve their own work to get around his detection system. Now, his team is exploring other ways of identifying fakes, but he declined to elaborate because he doesn't want to give away anything that might help people create more convincing fakes. "We're on the front lines," he said, adding that Google has expressed interest in collaborating with him.

GIF-hosting platform Gfycat uses an algorithm to examine faces frame-by-frame to ensure nothing's been doctored. Still, tech news site Motherboard found that some deepfakes eluded detection by Gfycat's algorithms.

Gfycat told CNNMoney that removing content flagged by its algorithm can take as long as a few days.

Related: YouTube will start displaying Wikipedia articles

Woolley and other experts said Facebook, Twitter, and other platforms can begin getting ahead of the problem by forging a broad partnership to tackle it together. For an example of that, the industry can look to how it has dealt with child pornography through a universal hashing system that is implemented across platforms to identify and block such material.

Blockchain and other secure public verification systems have also been pointed to as possible tools for marking the origins of videos and photos.

But it's important that the issue of deepfakes is approached broadly and across industries.

"Platforms are definitely part of the solution -- but it's not just the platforms. Platforms only control distribution in some domain," Ovadya said.

Terre Haute
Clear
87° wxIcon
Hi: 92° Lo: 72°
Feels Like: 96°
Robinson
Clear
86° wxIcon
Hi: 90° Lo: 70°
Feels Like: 95°
Indianapolis
Few Clouds
86° wxIcon
Hi: 91° Lo: 73°
Feels Like: 93°
Rockville
Clear
84° wxIcon
Hi: 91° Lo: 71°
Feels Like: 90°
Casey
Clear
86° wxIcon
Hi: 91° Lo: 71°
Feels Like: 97°
Brazil
Clear
87° wxIcon
Hi: 91° Lo: 71°
Feels Like: 96°
Marshall
Clear
87° wxIcon
Hi: 92° Lo: 71°
Feels Like: 96°
Hot and humid!
WTHI Planner
WTHI Temps
WTHI Radar

WTHI Events

 

Illinois Coronavirus Cases

(Widget updates once daily at 7 p.m. CT)

Confirmed Cases: 147865

Reported Deaths: 7026
CountyConfirmedDeaths
Cook927814630
Lake10007423
DuPage9364475
Kane7877275
Will6957320
Winnebago310996
McHenry212097
St. Clair2037137
Kankakee131165
Rock Island106129
Madison104269
Kendall100021
Champaign96015
Boone61021
DeKalb58220
Peoria56728
Sangamon45532
Jackson34019
Randolph2887
McLean28513
Stephenson2785
Ogle2754
Clinton24217
Macon23622
LaSalle22817
Union19619
Whiteside19615
Coles17817
Grundy1775
Iroquois1645
Tazewell1528
Knox1470
Warren1450
Monroe13713
Cass1367
Williamson1334
Adams1311
Morgan1303
Jefferson10717
Lee1032
McDonough10215
Henry981
Pulaski790
Vermilion792
Marion700
Macoupin583
Perry581
Douglas540
Unassigned530
Livingston522
Montgomery491
Christian474
Jasper477
Jo Daviess471
Ford401
Woodford362
Jersey351
Franklin310
Bureau302
Menard250
Mercer250
Fayette233
Mason230
Wabash230
Alexander220
Carroll212
Washington210
Johnson200
Piatt200
Effingham191
Hancock191
Moultrie190
Shelby191
Crawford180
Logan180
Cumberland170
Bond161
Clark150
Fulton150
Massac150
Wayne141
Schuyler130
De Witt120
Marshall110
Brown100
Edgar100
Greene90
Saline90
Henderson80
White80
Lawrence70
Hamilton60
Richland40
Stark40
Gallatin30
Out of IL30
Pike30
Clay20
Edwards20
Calhoun10
Hardin10
Pope10
Putnam10
Scott10

Indiana Coronavirus Cases

(Widget updates once daily at 8 p.m. ET)

Confirmed Cases: 48524

Reported Deaths: 2698
CountyConfirmedDeaths
Marion11682684
Lake5180242
Elkhart330146
Allen2798132
St. Joseph196466
Cass16389
Hamilton1563101
Hendricks1410100
Johnson1288118
Porter73237
Tippecanoe7268
Madison65964
Clark65544
Bartholomew58644
LaPorte58026
Howard57757
Kosciusko5494
Vanderburgh5486
Marshall4904
Noble48228
Jackson4723
LaGrange4709
Hancock45035
Boone44543
Delaware44550
Shelby42625
Floyd38144
Morgan32931
Monroe30028
Grant29526
Montgomery29420
Clinton2892
Henry27415
Dubois2736
White26510
Decatur25032
Lawrence24625
Dearborn23823
Vigo2358
Harrison21822
Warrick21829
Unassigned193193
Greene18932
Miami1832
Jennings17611
Putnam1698
DeKalb1624
Scott1627
Daviess14317
Wayne1406
Orange13623
Perry1299
Steuben1292
Franklin1248
Jasper1212
Ripley1177
Wabash1122
Carroll1102
Fayette997
Newton9810
Starke933
Whitley925
Gibson812
Huntington812
Randolph794
Wells731
Fulton721
Jefferson722
Jay680
Washington671
Pulaski661
Knox640
Clay604
Rush583
Adams501
Owen491
Benton480
Sullivan451
Posey420
Brown391
Spencer381
Blackford372
Crawford320
Fountain322
Tipton321
Switzerland270
Parke230
Martin220
Ohio170
Vermillion140
Warren141
Union130
Pike110