🔗 Share this article

Regulators in China have unveiled stringent planned guidelines for AI designed to establish enhanced measures for minors and prevent conversational agents from giving counsel that could encourage violence.

As per the planned rules, creators will furthermore be mandated to ensure their AI models avoid creating material that advocates wagering.

A Move to Fast-Paced Adoption

This regulatory announcement follows a sharp surge in the proliferation of conversational AI being launched both in China and globally.

Once finalised, these measures will cover AI offerings available in China, representing a substantial move to regulate the fast-growing technology, which has faced growing scrutiny over safety risks this year.

Core Measures of the Draft Rules

The released guidelines contain a number of measures particularly designed for shielding young users. These steps require directing AI firms to:

• Offer customised preferences.
• Enforce usage caps on usage.
• Obtain consent from guardians before providing emotional companionship functions.

Furthermore AI service providers have to have a live agent take over any dialogue involving suicide and immediately notify the user's emergency contact.

Companies have to ensure their services prevent the creation of information that compromises state security, damages the country's reputation, or undermines social stability.

Weighing Innovation and Security

The authorities said that it promotes the use of AI, for example to showcase traditional arts and create services for support for the elderly, provided that the technology are secure and trustworthy.

Stakeholder input on the draft has been requested.

Global Context and Concerns

The impact of AI on individuals has faced heightened scrutiny internationally in the past year.

The leader of a major AI company commented this year that addressing how AI systems deal with discussions about self-harm is among the organization's toughest issues.

In a high-profile incident, a the parents in California filed a lawsuit an AI company, contending that its chatbot advised their teenage son to end his life. This lawsuit was the first of its kind accusing wrongful death.

In a related development, the same organization posted a job for a lead role tasked with mitigating risks from AI systems to cybersecurity.

"This will be a demanding position, and the candidate will begin in the complex challenges pretty much from the start," remarked the leader.

The rapid growth of some AI applications, which have gained millions of users globally, demonstrates the critical need for such regulatory guidelines.