AI harmful and abusive content incidents
Definition
Harmful and abusive content incidents document toxic, sexual, abusive or exploitative material produced or spread by an AI system, including non-consensual imagery and harms to children.
Included
- Sexual imagery of real people generated without consent
- Child sexual abuse material produced or distributed with AI tools
- Harassment, threats or hate speech generated or amplified by an AI system
- Moderation systems that failed to act on abusive material at scale
Excluded
- Offensive output with no identifiable person or group harmed
- Satire or fiction clearly labelled as such
Incident records927
Oct 2026Mexico's Women's Ministry Condemns Grok for Generating Non-Consensual Sexual ImagesHora Cero WebEl UniversalOct 2026AI deepfakes and harassment campaigns target Nigerian women, report warnsPremium Times NigeriaLeadershipSep 2026AI-Generated Intimate Images of Paraguayan University Students Shared OnlineABC DigitalÚltima HoraSep 2026Dutch man prosecuted for creating deepfake sex videos of public figuresNOSADSep 2026AI-Generated Sexualized Images of Minors Circulate in German School ChatsN-tvT-online.deSep 2026Libra Internet Bank's AI Chatbot Insults ClientBusiness24Jurnalul NaţionalStirile ProTV+4Sep 2026AI-generated images used in gender-based political attacks during Brazilian Senate campaignCorreio BrazilienseTerraSep 2026UK ASA bans AI app ads for objectification and explicit contentBBCSep 2026DeepSeek AI generates sexual content despite safety controls and fabricates research citations中华网科技公司The Epoch TimesSep 2026Argentine Official Posts AI-Generated Image Depicting Political Rivals as InsectsClarinLa NacionSep 2026Man arrested for creating and circulating AI-generated obscene images of college acquaintancetimesofindia.indiatimes.comtribuneindia.comSep 2026Deepfake nude images of six schoolgirls created and shared in San Justo, ArgentinaTodo NoticiasLa NacionSep 2026Delhi man arrested for creating and circulating obscene AI-generated images of womanThe Times of IndiaKalingaTVAsianet News Network Pvt Ltd+2Sep 2026First U.S. Conviction Under Take It Down Act for AI-Generated Child Abuse MaterialWLWT5ClevelandNBC4i+1Sep 2026AI-Generated Fake Nude Images of Student Shared by Minors in São PauloNDCorreio BrazilienseSep 2026Social media algorithms expose Irish children to harmful content despite age restrictionsRTE.ieIrish ExaminerAug 2026Georgia man sentenced to 40 years for creating AI child sexual abuse materialCBS NewsFOX 5 AtlantaThe Atlanta Journal-Constitution+1Aug 2026German Intelligence Warns of AI Algorithms Fueling Online RadicalizationT-online.deAug 2026Israeli National Security Minister publishes AI-generated video depicting Palestinians in prisonJornal de BrasíliaBrasil 247Aug 2026AI-generated bomb threats prompt lockdowns at Georgia high schoolfox5atlanta.comwsbtv.comAug 2026US appeals court rules private possession of AI-generated CSAM protected by First AmendmentThe Daily WireFox NewsAug 2026AI-Generated Nude Images of Minors Investigated in Langreo, SpainAntena3La RazónAug 2026AI-Generated Sexual Deepfakes of Students Spark Violent Protests at Chilean SchoolBioBioChileLa CuartaAug 2026Man jailed for creating and sharing AI-generated indecent imagesBBCEXPRESSAug 2026Army officer's wife harassed with AI-generated explicit images in HyderabadTelangana TodayDeccan ChronicleINDToday+2Aug 2026South Korea blocks 64 AI deepfake porn sites더팩트연합뉴스Aug 2026Facebook and TikTok Algorithms Promote Child Recruitment by Armed Groups in ColombiaYahoo actualitésBFMTVAug 2026Brazilian Federal Police investigate teacher over AI-generated sexual content of minorNews Rondoniacidadeverde.comPonta Porã Informa - Notícias de Ponta Porã - MS e Pedro Juan Caballero - PY+3Aug 2026TikTok Algorithm Promotes Mafia Culture in Calabria, Study FindsGazzetta del SudGiornale di SiciliaANSA.it+2Aug 2026Brazilian Ministry seeks to block 80 deepfake nude AI sitesEstadãoJornal MidiamaxO Globo+2Aug 2026Meta and Apple failed to block AI app promoting nonconsensual intimate deepfakesWiredDigitAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM Deepfakesخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photowashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoTechCrunchWashington PostTimesNowAug 2026German TV Hosts Targeted by AI-Generated Deepfake PornographyT-online.deWEB.DEGMXAug 2026AI-Generated Antisemitic Attack Ad in Florida Congressional RaceDeseret NewsOne America News NetworkThe Times of Israel+3Aug 2026Jennie Targeted by AI-Generated Deepfake Videos; Agency Suestw.news.yahoo.comAug 2026AI Algorithms Linked to Surge in Online Crimes Against Minors in São PauloFato PaulistaInteligência Brasil ImprensaAug 2026Delhi High Court Orders Removal of Obscene AI-Generated Content Targeting Janhvi KapoorThe Indian ExpressIndia TodayAug 2026Pennsylvania sues TikTok over exposure of minors to adult contentTribLIVENBC10 PhiladelphiaAug 2026AI-Generated Deepfake Images Used to Harass Spanish Actor Santiago SeguraHola.comLibertad DigitalAug 2026UK children report surge in AI-generated explicit deepfakesThe GuardianAug 2026AI-generated deepfake pornography distributed depicting German womenNetzweltAbendzeitung MünchenExpress.de+2Aug 2026Portuguese teens use AI to create and share fake nude images of peersSAPORTP - Rádio Televisão PortuguesaAug 2026Meta ordered to pay $942m in New Mexico child safety lawsuitBBCafr.comAug 2026Meta CEO apologizes to Indian government for content moderation failuresDivya BhaskarABP Asmitagujarati.connectgujarat.com+5Aug 2026Meta CEO apologizes to Indian government for child abuse material and deepfakesiefimerida.grΣΚΑΪAug 2026AI-Generated Child Sexual Abuse Material Exploits Over 1.2 Million ChildrenAvaz.baRadio SarajevoFederalna+2Aug 2026Supor AI-Generated Advertisements Spark Backlash Over Inappropriate Content凤凰网（凤凰新媒体）每日经济新闻Aug 2026AI-Generated Videos Mocking Korean Independence Activists Posted on TikTok아시아투데이파이낸셜뉴스아시아경제+4
50 of 927 shownFilter all 927 in Explore →