4 days ago
OpenAI says significant number of recent ChatGPT misuses likely came from China
OpenAI said it disrupted several attempts from users in China to leverage its artificial-intelligence models for cyber threats and covert influence operations, underscoring the security challenges AI poses as the technology becomes more powerful.
The Microsoft-backed company on Thursday published its latest report on disrupting malicious uses of AI, saying its investigative teams continued to uncover and prevent such activities in the three months since Feb. 21.
While misuse occurred in several countries, OpenAI said it believes a 'significant number" of violations came from China, noting that four of 10 sample cases included in its latest report likely had a Chinese origin. The Chinese embassy in Washington didn't respond to a request for comment.
In one such case, the company said it banned ChatGPT accounts it claimed were using OpenAI's models to generate social media posts for a covert influence operation. The company said a user stated in a prompt that they worked for China's propaganda department, though it cautioned it didn't have independent proof to verify its claim.
OpenAI's policies prohibit use of its popular AI chatbot and models to assist with fraud, scams or cyberattacks. The company regularly suspends ChatGPT accounts it says are in breach of its rules.
The release of ChatGPT to the public in late 2022 ushered in a wave of investments from companies willing to bet on a technology that is changing the way people do research, learn and work, though its growing capabilities also raise concerns about their weaponization for fraud, influence operations and other illicit activities.
OpenAI said in a letter to the U.S. Office of Science and Technology Policy in March that AI needs common-sense rules to shield users and that it was committed to preventing authoritarian regimes from using its models to amass power, threaten or coerce other states, carry out covert influence operations or malicious cyber activity.
News Corp, owner of Dow Jones Newswires and The Wall Street Journal, has a content-licensing partnership with OpenAI.
Write to Mauro Orru at
