Skip to content
Submit incident
AII-1002-56623
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.Supporting sources are pending verification.

Meta plans AI-generated user accounts on Facebook and Instagram

Meta plans to deploy AI-generated user accounts on Facebook and Instagram with fake profiles, biographies, and profile pictures that can interact with real users. Critics warn the accounts could be weaponized to amplify misinformation.

30 December 2024 Β· Meta Β· Misinformation and synthetic media
30 December 2024
AII-1002-56623
Quick facts
Organization
Meta (subject)
Category
Misinformation and synthetic media
Country
United States
Date
30 December 2024
Drafted by
Raidu Incident Detection

What happened

Connor Hayes, vice president of product for generative AI at Meta, stated that the company plans to create AI-generated 'people' with their own profiles, biographies, and profile pictures that can comment on posts and interact with users on Facebook and Instagram.

Meta is developing tools to help users create AI bots on Instagram and Facebook that could clone users' personalities and interact with other users on the network. Hayes said the company expects these AI bots to eventually exist on the platform like user accounts do today.

Reported impact

Critics have warned about risks related to the 'weaponization' of AI-generated content, with concerns that fake AI accounts could easily be used to amplify false information.

Index analysis

Hundreds of thousands of characters have already been created with Meta's previously released AI tools, which are currently available to US users and will expand to other markets.

The majority of these fake AI characters have been kept private by their creators, potentially indicating few content creators view generative AI as a mature and reliable technology for boosting engagement.

Governance controls

Meta has made integrating generative AI into its apps a priority, stating that the platforms need to become more entertaining and engaging.

Classification

Organization
Meta (subject)
Category
Misinformation and synthetic media
Industry
Media, social platforms and marketing
Country
United States
Harm status
Potential harm
Intent
Unknown
Timing
Unknown
Harm types
Public interest
Harmed
General public
AI systems
Meta AI

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident