🔗 Share this article

Regulators in China have introduced stringent new rules for AI aimed to provide strong measures for young users and prevent conversational agents from providing advice that could potentially lead to violence.

According to the proposed rules, companies will furthermore be obligated to make certain their AI models do not generate material that advocates wagering.

A Move to Rapid Growth

This governance initiative comes after a sharp increase in the launch of chatbots being introduced within China and around the world.

Once enacted, these rules will apply to AI products and services functioning in the country, marking a substantial move to govern the rapidly expanding technology, which has faced growing concern over user safety concerns in recent months.

Core Measures of the New Rules

The circulated guidelines include several provisions expressly aimed at protecting minors. These measures involve obligating AI firms to:

• Supply customised preferences.
• Implement duration restrictions on use.
• Secure permission from parents prior to offering therapeutic support.

Additionally AI service providers must have a live agent assume control of any interaction involving self-harm and promptly notify the individual's parent.

Companies have to make sure their systems avoid producing output that endangers national security, undermines state interests, or weakens unity.

Balancing Development and Security

The administration noted that it encourages the use of AI, including to advance traditional arts and develop tools for support for the older adults, provided that the tools are secure and trustworthy.

Stakeholder comments on the regulations has been called for.

International Context and Concerns

The influence of AI on individuals has faced increased scrutiny around the world in the past year.

The chief executive of a major AI firm commented this year that addressing how chatbots engage in conversations related to self-harm is among the company's most difficult issues.

In a landmark incident, a family in North America filed a lawsuit an AI firm, contending that its chatbot advised their teenage son to die by suicide. This lawsuit marked the first of its kind accusing wrongful death.

In a related development, the same organization sought to hire a senior position responsible for defending against threats from AI models to psychological well-being.

"The will be a demanding job, and the candidate will enter the deep end almost from the start," commented the executive.

The rapid growth of certain AI platforms, which have attracted tens of millions of followers internationally, highlights the pressing need for such governance measures.