In a groundbreaking case involving artificial intelligence (AI), a man in China has been arrested for allegedly using ChatGPT to fabricate a fake news article about a train crash that claimed nine lives.
This marks the first enforcement action taken in China under an unprecedented law related to AI, highlighting the nation’s efforts to regulate and control the use of advanced technology.
The ChatGPT fake news incident
A man identified only as Hong has been detained by police in Gansu province, northwest China, for reportedly crafting a phony news story about a train accident using ChatGPT.
The fake article was posted on a blogging platform owned by Chinese search giant Baidu by more than 20 accounts and amassed over 15,000 views.
To bypass duplication checks on the platform, Hong is accused of using ChatGPT to generate slightly different versions of the false news article.
Developed by US-based OpenAI, ChatGPT is a chatbot that utilizes generative AI technology. This technology enables software to generate responses based on user prompts and questions, such as crafting a story from specific instructions.
Although ChatGPT is blocked in China, it can still be accessed through a virtual private network (VPN), which can circumvent the country’s internet restrictions.
In response to the growing popularity and potential risks of AI like ChatGPT, Chinese authorities introduced a first-of-its-kind law this year governing “deep synthesis technologies.”
The law encompasses the use of AI to generate text, images, videos, or other media, and prohibits the dissemination of fake news through deep synthesis services.
Chinese tech giants’ cautious approach
While ChatGPT has been gaining traction and going viral, China’s heavily censored and controlled internet landscape has prompted the government to create laws addressing new technologies that may pose challenges to central authorities.
Consequently, Chinese technology giants have been cautious in their approach to AI applications, avoiding the widespread availability of chatbots like ChatGPT and instead focusing on specific use cases.
Alibaba, for instance, is working on its Tongyi Qianwen AI product, which will eventually be implemented in its DingTalk workplace communication software and Tmall Genie, a provider of smart home appliances.
This strategic approach is thought to be a response to the concerns of regulators and the government.
The arrest of Hong under the new law regulating deep synthesis technologies serves as a stark reminder of the potential consequences of misusing AI in China.
As technology continues to advance, it is critical for nations like China to establish guidelines and regulations that address potential threats posed by AI, especially in the realm of fake news and misinformation.
The ongoing development of AI-powered chatbots and applications by Chinese tech giants will likely continue under careful supervision, with a focus on specific use cases to avoid alarming regulators and the government.
As AI technology evolves and becomes more sophisticated, striking a balance between innovation and regulation will be crucial to ensuring a secure and reliable digital landscape.
