Skip to content
Submit incident
AII-1000-98029
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Korean regulator requests child safety protections for Grok chatbot

Korea's telecommunications regulator requested that xAI add child safety protections to its Grok chatbot after reports that the system was being used to generate child sexual exploitation material. The ministry asked for safeguards including age restrictions and a detailed protection plan.

14 January 2026 · xAI · Harmful and abusive content
14 January 2026
AII-1000-980292 sources ↓
Quick facts
Category
Harmful and abusive content
Country
South Korea
Source
기술로 세상을 바꾸는 사람들의 놀이터
Date
14 January 2026
Drafted by
Raidu Incident Detection

What happened

The Korean Ministry of Broadcasting, Media and Communications on January 14, 2026, requested that xAI implement child safety protections for its Grok chatbot service. The request followed reports that Grok had been used to generate and distribute child sexual exploitation images.

Reported impact

Child sexual exploitation material and non-consensual sexual images have been spreading via social media, raising public concerns. The material reportedly involves child and youth victims.

Index analysis

The regulator requested that xAI establish safeguards to prevent illegal activity through Grok, implement age restrictions, and submit concrete child protection plans. The ministry noted that in South Korea, creating, distributing, possessing or viewing non-consensual sexual imagery is a criminal offense.

Governance controls

xAI already designates a youth protection officer and submits annual operational reports to the Korean regulator under national telecommunications law. The ministry requested additional documentation specifically regarding the Grok service.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
South Korea
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Public interest, Human or fundamental rights
Harmed
Children
Failure modes
Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

기술로 세상을 바꾸는 사람들의 놀이터
정부, '아동 성착취 이미지 생성' 그록에 보호장치 마련 요구
14 January 2026
디지털투데이 (DigitalToday)
정부, AI 챗봇 '그록'에 청소년 보호장치 마련 요청
14 January 2026
Aug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Survivor sues xAI alleging Grok generated CSAM from existing abuse imagesAllegedHarmful and abusive contentNEWS 24/7news247.grJul 2026xAI sues Minnesota over nudification law; Grok generated millions of sexualized imagesUnder investigationHarmful and abusive contentBegeek.frGénération-NT