• The National Internet Information Office in China has outlined regulations for deepfakes or synthetic technology as it dubs it.
• The regulations place the onus on deepfake technology creators to ensure the technology isn’t used maliciously.
• This is not a ban, but rather, a bid to bring the technology under control in China under the rule of law.

While deepfakes can be a fun way to make Keanu Reeves stop a robbery, the technology can also be used for more nefarious purposes.

For years now, big tech firms have been trying to develop ways to detect deepfakes. The latest of these is from Intel called FakeCatcher and it measures blood flow by detecting the minute change in a pixel’s colour.

It’s not just the West that is concerned about this technology, however, as China has now introduced legislation to regulate it.

The National Internet Information Office in China, together with three other departments, have introduced the so-called Internet Information Service Deep Synthesis Management Regulations.

“In recent years, in-depth synthetic technology has developed rapidly. While serving user needs and improving user experience, it has also been used by some criminals to produce, copy, publish, and disseminate illegal and bad information, defame, detract from the reputation and honor of others, and counterfeit others. Identity fraud, etc., affects the spread of order and social order, and harms the legitimate rights and interests of the people,” the Information Office wrote (translated using Google Translate).

The regulations put strict rules in place for creators of deepfake services. These include authenticating users with real identity information and establishing ways for users to file complaints with the service.

Furthermore, deepfakes need to carry some sort of identifying mark so as to not confuse viewers or listeners.

“Those who provide services such as smart conversations, synthetic voices, human face generation, immersive simulation scenes, or significantly change the function of information content should be marked to avoid public confusion or misunderstanding. It is required that no organization or individual use technical means to delete, tamper with, or hide relevant signs,” reads the regulations.

However, China isn’t banning the technology outright rather, it’s trying to make sure that when deepfakes are used to say, make President Xi Jinping look like he’s morphing into Winnie The Pooh, those individuals can be found more easily.

This is apparent later in the regulations where the National Internet Information Office says that companies that do use deepfake technology, do so in-line with the relevant regulations.

Of course, we are not blind to the fact that the Chinese government heavily regulates the internet and this is potentially another tool for it to use to oppress dissidents.

These new rules for deepfakes in China come into effect from 10th January according to the regulations.

[Image – Alejandro Luengo on Unsplash]