Skip to content
Submit incident
AII-1001-88031
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Gmail deployment of AI models to detect phishing raises concerns about effectiveness

Google has deployed AI models in Gmail to combat phishing and malware, blocking over 99.9% of such attacks. However, cybersecurity experts warn that criminals are also using AI to create more sophisticated scams, and millions of users remain vulnerable despite the high blocking rate.

6 April 2025 Β· Google Β· Security and cyberattacks
6 April 2025
AII-1001-880312 sources ↓
Quick facts
Category
Security and cyberattacks
Country
Indonesia
Source
Forbes
Date
6 April 2025
Drafted by
Raidu Incident Detection

What happened

Google has distributed AI models to strengthen security defense in Gmail, including a language model trained to eradicate phishing, malware, and spam.

Google reports blocking over 99.9% of phishing attempts and malware-laden emails in Gmail, though experts note that criminals are also leveraging AI to create more convincing scams that are harder to detect.

Reported impact

Despite Gmail's high blocking rate, the sheer volume and rapid evolution of phishing attacks mean that millions of users remain at risk.

Spam accounted for over 46.8% of all email traffic in March, prompting some organizations to explore alternative communication channels such as Teams, Slack, WhatsApp and Telegram for internal collaboration.

Index analysis

McAfee notes that AI presents a double-edged sword in email security: while it can detect and eliminate fraud, it also empowers cybercriminals to develop more sophisticated attacks.

Email fraud remains a meaningful threat to online security, with increasingly sophisticated tactics aided by artificial intelligence.

Classification

Category
Security and cyberattacks
Industry
Digital security
Country
Indonesia
Harm status
Potential harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Economic or property
Harmed
Consumers, General public
AI systems
Gmail AI security defense models

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Forbes
Google Confirms Gmail Update Choice -- 3 Billion Users Must Now Decide
9 April 2025
News Directory 3
Gmail Users: Change Email Now, Google Warns - News Directory 3
12 April 2025