Skip to content
Submit incident
AII-1000-36667
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

AI-Generated Deepfakes Target School Communities in Australia

AI-powered tools are being used to create deepfake images and videos of schoolchildren and teachers scraped from school social media accounts in Australia. Between January and March 2026, the eSafety Commissioner received over 100 reports of deepfakes used to sexually exploit, mock or defame victims, prompting new safety guidance for schools.

January 2026 Β· eSafety Commissioner Β· Harmful and abusive content
January 2026
AII-1000-366675 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Australia
Source
Mirage News
Date
January 2026
Drafted by
Raidu Incident Detection

What happened

Between January and March 2026, eSafety received more than 100 reports of anonymous accounts targeting schools and school staff with AI-generated content including dance videos, face swaps, memes and fabricated stories about principals and teachers, with almost all involving imagery harvested from school social media accounts or websites.

Much of the reported material appeared on anonymous TikTok and Instagram accounts with hundreds of followers, and included staff headshots used to create fake videos and teacher ratings. A significant number of cases involved AI-generated deepfake child sexual exploitation material originating from school settings, with other manipulations including sexualised AI imagery of teachers and altered body image AI dance videos.

Reported impact

Teachers, school staff and students faced humiliation, reputational damage and distress as a result of the AI-generated deepfakes. The escalating threat has prompted schools to reconsider their posting habits and establish action plans to respond when images are weaponised.

Index analysis

Images were scraped from official school social media feeds and run through generative AI to produce sexualised, mocking or damaging depictions. Powerful AI tools are now widely accessible as stand-alone apps and services, offered through social media and messaging platforms, and integrated into search engines.

Governance controls

eSafety released a new Online Safety Advisory to help schools make safer posting decisions and have action plans in place to respond when images are misused. As a result of eSafety action over the past year, seven of the most widely used 'nudify' services in Australia have withdrawn access or taken measures to comply with obligations under the Online Safety Act.

Classification

Category
Harmful and abusive content
Industry
Education and training
Country
Australia
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Psychological, Reputational, Human or fundamental rights
Harmed
Children, Workers
Failure modes
Deepfake image, Deepfake video, Unauthorised scraping
Consequences
System suspension or termination, Content removal
AI systems
AI deepfake generation tools, AI-powered 'nudifying' services

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Mirage News
School Photo Posts Vulnerable To Emerging AI Threat
27 July 2026
Nine
Frightening AI warning to schools over online photos
27 July 2026
The Sydney Morning Herald
'No risk-free way': Schools warned to stop posting student photos online
27 July 2026
7NEWS.com.au
Deepfake warning for Aussie schools sharing student photos
28 July 2026
Human Rights Watch
Australia School Photos Scraped for AI-Fueled Image Misuse
30 July 2026
Sep 2026Delhi man arrested for creating and circulating obscene AI-generated images of womanConfirmedHarmful and abusive contentThe Times of IndiaKalingaTVAsianet News Network Pvt Ltd+2Aug 2026TikTok Algorithm Promotes Mafia Culture in Calabria, Study FindsWell documentedHarmful and abusive contentGazzetta del SudGiornale di SiciliaANSA.it+2Aug 2026Pennsylvania sues TikTok over exposure of minors to adult contentAllegedHarmful and abusive contentTribLIVENBC10 PhiladelphiaAug 2026AI-Generated Videos Mocking Korean Independence Activists Posted on TikTokWell documentedHarmful and abusive contentμ•„μ‹œμ•„νˆ¬λ°μ΄νŒŒμ΄λ‚Έμ…œλ‰΄μŠ€μ•„μ‹œμ•„κ²½μ œ+4Jul 2026Instagram removes harassment videos filmed with Meta AI glassesConfirmedHarmful and abusive contentGIGAZINE