Experts warn of privacy risks in AI-edited children's social media content
Academic experts in Indonesia warned of privacy and data security risks associated with an emerging social media trend where parents use generative AI to edit their children's faces for entertainment content. The experts highlighted vulnerabilities including potential misuse of facial data, unauthorized reuse in AI training, and digital exploitation.
What happened
A trend has emerged on social media where parents use generative AI technology to edit their children's faces for dance content. According to Yeni Herdiyani, chair of the Artificial Intelligence Study Program at IPB University, generative AI systems can automatically generate realistic-looking images, videos, text and audio based on provided models and data, including real photographs of children.
Reported impact
Experts warn that uploading photos of children to public platforms creates risks. When photos are uploaded to public spaces, the data can be widely accessed and potentially misused by irresponsible parties, placing children in a vulnerable position in the digital ecosystem. Data provided to AI algorithms may be used to train models as datasets and could potentially reappear in different forms or contexts.
Index analysis
The use of children's faces as AI data is considered vulnerable to digital crime. Risks include data security breaches, privacy protection violations, and potential data misuse. Parents need to understand these digital risks before uploading or editing their children's faces using AI technology.
Governance controls
IPB University emphasizes the importance of digital literacy in society. The university consistently provides new students with materials on ethics and responsible use of technology through computational thinking courses from the first level, aiming to foster a more critical and responsible society in using AI technology.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.