Skip to content
Submit incident
AII-1002-51629
Well documentedThree or more independent publishers report the core facts.

Amnesty International reports Denmark's welfare AI algorithms risk discriminating against vulnerable groups

Amnesty International reported that Denmark's welfare fraud detection algorithms, deployed by Udbetalning Danmark, risk discriminating against vulnerable populations by using citizenship and other sensitive personal data as proxies for protected characteristics. The organization warned that the system creates mass surveillance that may target rather than support the people it was designed to help.

12 November 2024 · Udbetalning Danmark · Discrimination and fairness
12 November 2024
AII-1002-516293 sources ↓
Quick facts
Category
Discrimination and fairness
Country
Denmark
Source
France 24
Date
12 November 2024
Drafted by
Raidu Incident Detection

What happened

Amnesty International examined four algorithms used by Udbetalning Danmark, Denmark's social benefits agency, among approximately 60 algorithms deployed over more than a decade to identify welfare fraud. The algorithms process personal data including place of residence, travel, citizenship, place of birth, family relationships and income from public databases of Danish residents.

One algorithm, 'Model Abroad,' is based on the beneficiary's nationality to determine whether people have moved abroad while still receiving social benefits. Amnesty argued that using citizenship as a primary criterion violates non-discrimination rights.

Reported impact

Amnesty International stated that mass surveillance through these algorithms has created a system that risks targeting rather than supporting vulnerable populations including people with disabilities, low-income families, and migrants. The organization warned the system is creating an atmosphere of fear among welfare recipients.

Index analysis

The algorithms use sensitive data points—such as citizenship, place of residence and family relationships—that Amnesty noted can serve as proxies for race, ethnicity, or sexual orientation. Amnesty argued that feeding personal data into algorithmic models to identify fraud risk requires greater care to avoid discrimination.

Classification

Category
Discrimination and fairness
Industry
Government, security and defence
Country
Denmark
Harm status
Potential harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Human or fundamental rights
Harmed
General public
Failure modes
Biased model
AI systems
Danish welfare fraud detection algorithms, Model Abroad
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

France 24
Perspective - Benefit fraud: Amnesty accuses Denmark of using AI to build 'system of surveillance'
14 November 2024
Amnesty International
Denmark: AI-powered welfare system fuels mass surveillance and risks discriminating against marginalized groups - report
12 November 2024
Fortune
Denmark's renowned safety net turns into a political battleground as AI and algorithms target welfare recipients
13 November 2024