Skip to content
Submit incident
AII-1000-98629
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.Supporting sources are pending verification.

Hong Kong Privacy Commissioner Warns of AI Chatbot Grok's Potential for Generating Harmful Content

Hong Kong's Privacy Commissioner has warned that the AI chatbot Grok can be used to generate indecent or malicious photos and videos. The regulator is contacting relevant organizations and has issued guidance to the public on safe use of AI systems.

15 January 2026 Β· xAI Β· Harmful and abusive content
15 January 2026
AII-1000-98629
Quick facts
Category
Harmful and abusive content
Country
Hong Kong
Date
15 January 2026
Drafted by
Raidu Incident Detection

What happened

The Privacy Commissioner for Personal Data, Hong Kong (PCPD) noted that AI chatbot Grok can be used to generate indecent or malicious photos and videos. The issue has attracted attention in multiple jurisdictions, and the PCPD is proactively contacting relevant organizations to understand the situation.

Reported impact

Improper or malicious use of AI chatbots to generate indecent or malicious photos or videos may violate the Personal Data (Privacy) Ordinance and potentially constitute other criminal offences. The PCPD warns that users sharing personal data with AI chatbots without proper consent or generating illegal content such as child sexual abuse material may violate privacy laws or the Prevention of Child Pornography Ordinance.

Index analysis

The warning reflects concerns about inadequate content moderation in AI systems and user misuse of generative AI tools. Users may unwittingly share personal data with AI systems or intentionally misuse them to create harmful content without proper safeguards.

Governance controls

The PCPD has issued guidance to the public on safe use of AI chatbots, including: not sharing personal data with AI systems without understanding privacy policies and terms of use; obtaining explicit consent before using another person's personal data to generate AI content; and avoiding use of AI systems to generate illegal content such as child sexual abuse material.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Hong Kong
Harm status
Potential harm
Intent
Unknown
Timing
Unknown
Harm types
Human or fundamental rights, Public interest
Harmed
Children, General public
Failure modes
Content moderation failure
Consequences
None recorded
AI systems
Grok
Regulations
GDPR (cited)

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident