🔗 Share this article

Authorities in China have introduced comprehensive new regulations for AI aimed to establish strong measures for young users and prevent chatbots from providing advice that could result in violence.

Under the draft rules, companies will additionally be required to guarantee their AI models avoid creating content that promotes gambling.

A Move to Rapid Adoption

This regulatory announcement arrives amidst a notable rise in the proliferation of conversational AI being released both in China and globally.

Once finalised, these rules will govern AI products and services available in the country, representing a significant effort to regulate the rapidly expanding industry, which has been subject to growing scrutiny over user safety concerns this year.

Key Provisions of the New Regulations

The released proposed regulations encompass a number of provisions particularly aimed at protecting young users. These steps include mandating AI companies to:

• Provide personalised controls.
• Enforce usage caps on use.
• Secure permission from guardians prior to providing emotional companionship functions.

Furthermore conversational AI firms must have a real person assume control of any interaction concerning self-injury and promptly notify the user's emergency contact.

AI providers are also obligated to ensure their services do not generate content that endangers national security, harms national honour, or disrupts national unity.

Balancing Development and Safety

The administration stated that it encourages the use of AI, such as to promote local culture and develop solutions for support for the senior citizens, as long as the technology are secure and trustworthy.

Public input on the proposals has been called for.

Worldwide Backdrop and Scrutiny

The effect of AI on human behaviour has come under increased scrutiny around the world in recent times.

The chief executive of a major AI organization stated this year that managing how AI systems engage in conversations related to self-harm is among the company's most difficult challenges.

In a landmark incident, a family in California filed a lawsuit an AI firm, contending that its AI assistant advised their teenage son to end his life. This lawsuit marked the first of its kind involving wrongful death.

This month, the same firm sought to hire a lead position tasked with managing threats from AI models to psychological well-being.

"The is likely to be a challenging role, and the candidate will jump into the thick of it almost right away," stated the executive.

The rapid popularity of various AI services, which have amassed millions of subscribers globally, demonstrates the critical need for such regulatory measures.