WeChat, the popular social media platform owned by Tencent,is intensifying its efforts to combat the misuse of generative artificial intelligence (GenAI), particularly targeting deepfake scams that use AI to impersonate celebrities. In a recent crackdown, WeChat took down over 500 instances of AI-generated deepfake content and shut down 209 accounts involved in misleading marketing efforts.

‍

This move comes in response to a growing concern over the use of deepfakes to exploit public figures, such as Chinese doctor Zhang Wenhong and Hong Kong actor Raymond Wong Pak-ming, to promote products. These deepfakes have been used in fraudulent advertising campaigns that mislead consumers and damage trust in both the platform and the celebrities involved.

‍

Addressing Fraudulent Marketing with AI

WeChat’s announcement highlights a crackdown on the misuse of AI technology for impersonating celebrities to boost traffic or promote products inappropriately. The platform has removed 532 deepfake videos and taken action against accounts that were using these AI-generated clips in marketing. With this decisive step, WeChat is reinforcing its commitment to maintaining a healthy online environment, emphasizing the importance of regulatory compliance and responsible content creation.

‍

In one of the high-profile cases, Dr. Zhang Wenhong, a well-known infectious disease expert in China, found that a deepfake video featuring him promoting protein bars had gone viral. The doctor quickly denied any involvement and voiced concerns that these videos were misleading consumers. He had already reported the fraudulent content to WeChat, stressing that the videos could harm consumer rights. Similarly, actor Raymond WongPak-ming also debunked a deepfake video that falsely depicted him promoting a questionable ointment brand.

‍

‍

Stricter Regulations Around AI Content

This crackdown is part of a broader regulatory trend inChina, where deepfake content is coming under increased scrutiny. In 2023, China introduced the Administrative Provisions on Deep Synthesis for Internet Information Service, which mandates that all altered content, including deepfakes, must be clearly labeled and traceable to its source. These regulations aim to curb the spread of misleading content and ensure that consumers can trust the content they engage with online.

Further tightening took place in 2024, when Chinese regulators proposed new guidelines that call for explicit labeling of AI-generated content. These guidelines are pushing platforms like WeChat to adopt stronger measures to prevent the spread of deepfakes and hold content creators accountable.

‍

The Growing Challenge of Deepfakes

The rise of AI tools capable of generating convincing fakevideos has created new challenges for both regulators and platforms like WeChat. While deepfake technology has legitimate uses in entertainment and media, its misuse in fraudulent marketing has led to significant concerns overc onsumer trust. This has prompted not only WeChat but also other platforms suchas Douyin (the Chinese version of TikTok) and Kuaishou to take action against manipulated content.

For businesses, this shift highlights the growing importance of ensuring transparency and authenticity in marketing. The ability to quickly detect and address AI-generated deepfake content will become increasingly crucial for maintaining brand credibility and consumer trust. Platforms and content creators will need to stay vigilant and adhere to evolving regulationsto avoid being part of the deepfake problem.

‍

‍

‍Looking Ahead: The Future of Generative AI Governance

As generative AI continues to evolve, the need for robust content governance becomes ever more pressing. WeChat’s recent actions reflect the growing recognition of this challenge, with platforms taking a more proactive role in curbing misuse and ensuring compliance with emerging regulations.

‍

For businesses and tech entrepreneurs, staying ahead of these regulatory changes is essential. Generative AI can offer powerful tools for innovation, but it also comes with risks. If you are thinking about implementing A.I. into your custom software solution, click on the link to book a free consultation. We have helped dozens of Startups and SME’s to safely navigate A.I.-deployment.

‍