BREAKING NEWS LIVE STREAM 9 p.m.: High stakes for Trump, Biden heading into final debate Full Story

Deepfakes are coming. Is Big Tech ready?

Mark Zuckerberg insisted at Facebook's annual developer ...

Posted: Aug 8, 2018 3:09 PM
Updated: Aug 8, 2018 3:09 PM

Mark Zuckerberg insisted at Facebook's annual developer conference earlier this year that his company "will never be unprepared ... again" for meddling and disinformation efforts like those run by Russian trolls on its platform during the run-up to the 2016 election.

Yet the social media behemoth and its competitors may still be ill-equipped for their next great challenge: Fake videos that look so real you'd believe former President Obama really did call President Trump a "dipsh*t."

Platforms like Facebook, Twitter and YouTube have been moving recently to deal with the threats posed by misinformation and meddling that they didn't see coming, but now they face an emerging form of disinformation they know is on the horizon: Deepfakes -- doctored videos that will eventually fool even the sharpest eyes. As the technology to create deepfakes advances, experts say, it won't be long before it's used to foment discord or even affect an election.

"The opportunity for malicious liars is going to grow by leaps and bounds," said Bobby Chesney, professor and associate dean of the University of Texas School of Law who has been closely researching deepfakes.

Twitter, YouTube, and Reddit also are natural targets for deepfakes, and you can expect to see fringe platforms and porn websites flooded with them. Yet asked by CNNMoney just what they're doing to prepare for this looming problem, none of the major social media platforms would discuss it in detail. The companies wouldn't name the researchers they're working with, how much money they'll pour into detection, or even say how many people they've assigned to figure it out.

None of them offered much more than vague explanations along the lines of Facebook's promise to "protect the community from real-world harm."

That's not to say they aren't working on it at all. Facebook, for example, said it is collaborating with academics to see how their research might be applied to the platform. One researcher told CNNMoney that Google has reached out to him. But in the meantime, developers are continuing to work to perfect the technology and make the videos it produces more convincing.

Related: Mark Zuckerberg clarifies his Holocaust comments

The word "deepfakes" refers to using deep learning, a type of machine learning, to add anyone's face and voice to video. It has been mostly found on the internet's dark corners, where some people have used it to insert ex-girlfriends and celebrities into pornography. But BuzzFeed provided a glimpse of a possible future in April when it created a video that supposedly showed Obama mocking Trump, but in reality, Obama's face was superimposed onto footage of Hollywood filmmaker Jordan Peele using deepfake technology.

Deepfakes could pose a greater threat than the fake news and Photoshopped memes that littered the 2016 presidential election because they can be hard to spot and because people are -- for now -- inclined to believe that video is real. But it's not just about individual videos that will spread misinformation: it's also the possibility that videos like these will convince people that they simply can't trust anything they read, hear or see unless it supports the opinions they already hold.

Experts say fake videos that will be all but impossible to identify as such are as little as 12 months away.

Jonathon Morgan, the CEO of New Knowledge, which helps companies fight misinformation campaigns and has done some analysis for CNN, sees troll farms using AI to create and deliver fake videos tailored to social media users' specific biases. That's exactly what the Russian-backed trolls at the Internet Research Agency did during the last presidential election, but without the added punch of faked video.

Related: Whatsapp is adding new restrictions as killings continue in India

Aviva Ovadya, chief technologist at the Center for Social Media Responsibility, said social media companies are "still at the early stages of addressing 2016-era misinformation," and "it's very likely there won't be any real infrastructure in place" to combat deepfakes any time soon.

Many platforms already enforce rules around nudity that could apply to any faked porn they may find. But none of them have guidelines governing deepfakes in general, said Sam Woolley of the Digital Intelligence Lab at Institute for the Future. This goes beyond silly GIFs or satirical videos to more troubling content like, say, a faked video of a politician or businessman in a compromising situation, or hoax footage supposedly showing soldiers committing war crimes. "These have potentially larger implications for society and democracy," Woolley said.

Companies like Facebook and Twitter often argue that they are platforms, not publishers, and note that Section 230 of the 1996 Communications Decency Act absolves them of responsibility for content posted by users.

The recent uproar over the hate speech, fake news and disinformation polluting tech platforms has led companies to take more action -- even if the CEOs leading the effort have been inconsistent, even downright baffling, in explaining themselves. Still, the companies haven't addressed doctored videos specifically.

"It's not a question of if they take action on deepfakes, or if they begin to moderate this content," Woolley said. "It's a question of when. At the moment, the movement is pretty slim."

Infrastructure to combat faked videos may come from the Pentagon: The Defense Advanced Research Projects Agency is midway through a four-year effort to develop tools to identify deepfake videos and other doctored images. Experts in the field said using algorithms to analyze biometric data is one promising tool.

Satya Venneti of Carnegie Mellon University has seen some success identifying fakes by analyzing the pulses of people in deepfake demonstration videos. People typically exhibit similar blood flow in their forehead, cheeks, and neck. But she found "widely varying heart rate signals" in spoofed videos, something that happened when a video was layered with images.

Related: Google is hiring 10,000 people to clean up

In some cases, she saw heart rates of 57 to 60 beats per minute in the cheeks and 108 in the forehead. "We don't expect to see such wide differences," she said.

Siwei Lyu, director of Computer Vision and Machine Learning Lab at University at Albany SUNY, outlined another trick in a paper he co-wrote in June: Look for regular blinks. "If a video is 30 seconds and you never see the person blink, that is suspicious," he told CNNMoney.

After his paper was released, Lyu said deepfake developers used his research to successfully improve their own work to get around his detection system. Now, his team is exploring other ways of identifying fakes, but he declined to elaborate because he doesn't want to give away anything that might help people create more convincing fakes. "We're on the front lines," he said, adding that Google has expressed interest in collaborating with him.

GIF-hosting platform Gfycat uses an algorithm to examine faces frame-by-frame to ensure nothing's been doctored. Still, tech news site Motherboard found that some deepfakes eluded detection by Gfycat's algorithms.

Gfycat told CNNMoney that removing content flagged by its algorithm can take as long as a few days.

Related: YouTube will start displaying Wikipedia articles

Woolley and other experts said Facebook, Twitter, and other platforms can begin getting ahead of the problem by forging a broad partnership to tackle it together. For an example of that, the industry can look to how it has dealt with child pornography through a universal hashing system that is implemented across platforms to identify and block such material.

Blockchain and other secure public verification systems have also been pointed to as possible tools for marking the origins of videos and photos.

But it's important that the issue of deepfakes is approached broadly and across industries.

"Platforms are definitely part of the solution -- but it's not just the platforms. Platforms only control distribution in some domain," Ovadya said.

Terre Haute
Clear
70° wxIcon
Hi: 82° Lo: 64°
Feels Like: 70°
Robinson
Clear
63° wxIcon
Hi: 82° Lo: 62°
Feels Like: 63°
Indianapolis
Clear
70° wxIcon
Hi: 79° Lo: 64°
Feels Like: 70°
Rockville
Clear
64° wxIcon
Hi: 80° Lo: 64°
Feels Like: 64°
Casey
Clear
69° wxIcon
Hi: 81° Lo: 64°
Feels Like: 69°
Brazil
Clear
70° wxIcon
Hi: 81° Lo: 64°
Feels Like: 70°
Marshall
Clear
70° wxIcon
Hi: 82° Lo: 64°
Feels Like: 70°
Cold Front Friday
WTHI Planner
WTHI Temps
WTHI Radar

WTHI Events

 

Illinois Coronavirus Cases

(Widget updates once daily at 7 p.m. CT)

Confirmed Cases: 358799

Reported Deaths: 9605
CountyConfirmedDeaths
Cook1681395382
DuPage21470603
Lake19856507
Will17354424
Kane15802344
Winnebago9464172
St. Clair7674215
Madison6893153
Champaign581928
McHenry5803120
Peoria433667
McLean396731
Rock Island376689
Unassigned3632260
Sangamon362661
Kankakee322478
Macon273349
Kendall252129
Tazewell247549
LaSalle223560
DeKalb216842
Coles182238
Williamson176159
Boone170925
Adams170115
Clinton166325
Vermilion15928
Jackson146226
Whiteside124125
Randolph119514
Knox118112
Ogle11217
Effingham11033
Grundy9037
Marion89116
Franklin8888
Jefferson88644
Monroe87328
Bureau86617
Morgan85424
Stephenson8517
Henry8107
Christian79426
Macoupin75110
Union74625
McDonough68716
Fayette65222
Lee6411
Crawford6366
Shelby61110
Livingston58610
Douglas5848
Montgomery57015
Woodford55814
Logan5534
Saline5119
Bond4809
Warren4677
Iroquois46419
Jersey46221
Wayne46111
Cass45311
Fulton4461
Jo Daviess4467
Perry41216
Moultrie3805
Carroll3728
Johnson3270
Richland32215
Lawrence3178
Clay29112
Clark28810
Hancock2884
Washington2861
Pike2814
Greene27615
Cumberland2606
Jasper25710
De Witt2463
White2421
Mason2391
Mercer2296
Pulaski2281
Piatt2200
Wabash2155
Ford18611
Menard1651
Edgar1468
Marshall1413
Massac1412
Henderson1150
Hamilton1132
Alexander1101
Gallatin1062
Brown1030
Edwards1010
Scott980
Putnam880
Schuyler831
Stark822
Calhoun670
Hardin500
Pope371
Out of IL20

Indiana Coronavirus Cases

(Widget updates once daily at 8 p.m. ET)

Confirmed Cases: 152396

Reported Deaths: 4023
CountyConfirmedDeaths
Marion24905785
Lake13380352
St. Joseph8985161
Elkhart8530132
Allen7978222
Hamilton6000113
Vanderburgh567560
Tippecanoe358714
Monroe322238
Hendricks3221130
Johnson3051128
Porter303648
Clark289161
Delaware284574
Vigo256038
Madison232493
Cass222822
LaPorte220958
Warrick190065
Kosciusko179224
Floyd177367
Howard160066
Bartholomew139758
Dubois136726
Marshall134226
Henry123429
Grant122639
Wayne122127
Boone119548
Hancock115645
Noble114633
Jackson109413
Morgan93040
Dearborn92828
Daviess85333
Gibson84911
Clinton82916
Lawrence82634
Shelby80330
LaGrange77715
Harrison74824
Knox72110
Putnam71616
DeKalb69911
Posey6896
Fayette61417
Steuben6118
Miami5875
Montgomery57822
Jasper5744
White57215
Greene52137
Scott51013
Decatur49939
Adams4815
Whitley4426
Clay4396
Sullivan42913
Ripley4278
Wells4205
Wabash4029
Starke3977
Orange38825
Huntington3805
Spencer3746
Franklin36625
Washington3632
Jennings36013
Fulton3472
Randolph3439
Jefferson3305
Pike32915
Carroll31713
Perry29714
Jay2946
Fountain2883
Tipton27023
Vermillion2251
Newton22211
Parke2223
Rush2084
Owen2031
Blackford1983
Martin1960
Crawford1531
Pulaski1481
Brown1303
Ohio1247
Benton1080
Union1060
Switzerland900
Warren761
Unassigned0233