Skip to content
Submit incident
AII-1002-48641
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

CNAF anti-fraud algorithm challenged as discriminatory

Fifteen civil society associations filed a case at France's Conseil d'État challenging a CNAF algorithm used since 2011 to detect fraud and overpayments among family allowance recipients. The associations alleged that the algorithm discriminates against vulnerable beneficiaries by assigning higher suspicion scores based on low income, unemployment, and receipt of minimum social benefits, resulting in disproportionate auditing of people in financial difficulty.

16 October 2024 · Caisse nationale des allocations familiales · Discrimination and fairness
16 October 2024
AII-1002-486418 sources ↓
Quick facts
Category
Discrimination and fairness
Country
France
Source
20minutes
Date
16 October 2024
Drafted by
Raidu Incident Detection

What happened

Fifteen civil society associations announced on 16 October 2024 that they had filed a case with France's Conseil d'État to challenge an algorithm used by the Caisse nationale des allocations familiales (CNAF), which has been in use since 2011 to identify family allowance recipients most likely to make errors in their declarations.

The associations gained access to the algorithm's source code from a version used between 2014 and 2018 and stated that it assigns each beneficiary a suspicion score that determines whether they will be audited, with higher scores increasing the probability of control.

Reported impact

The associations argue that the algorithm discriminates against vulnerable beneficiaries by treating low income, unemployment, and receipt of minimum social benefits as factors that increase suspicion scores, resulting in over-control of people in difficulty compared to the rest of the population.

The algorithm analyzes personal data from over 32 million people living in households receiving CAF assistance.

Index analysis

The associations contend that the algorithm's scope of surveillance and its discriminatory effects against vulnerable recipients violate applicable data protection and fairness principles.

Governance controls

The associations requested in July 2024 that the CNAF cease using the algorithm but reported not receiving a response within two months, prompting the judicial recourse to the Conseil d'État.

Classification

Category
Discrimination and fairness
Industry
Government, security and defence
Country
France
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights
Failure modes
Biased model
Consequences
Litigation
AI systems
CNAF anti-fraud algorithm
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

20minutes
L'algorithme de la CAF pour détecter les fraudes est-il discriminatoire ?
16 October 2024
Boursorama
Fraude sociale : des associations attaquent l'algorithme anti-fraude de la CNAF devant le Conseil d'État
16 October 2024
Capital.fr
Algorithme CAF : précarité et suspicion, les associations montent au créneau
16 October 2024
Franceinfo
Allocations familiales : des associations réclament l'interdiction de l'algorithme anti-fraude utilisé par la Cnaf, jugé discriminant
16 October 2024
La Tribune
Fraude sociale : l'algorithme des allocations familiales attaqué devant le Conseil d'Etat
16 October 2024
Le Figaro.fr
Allocations familiales : des associations contestent un algorithme anti-fraude de la CNAF devant le conseil d'État
16 October 2024
LesEchos.fr
Allocations familiales : un algorithme anti-fraude attaqué devant le Conseil d'Etat
16 October 2024
SudOuest.fr
Allocations familiales : l'algorithme anti-fraude de la CAF est-il discriminatoire ?
16 October 2024
Nov 2024Amnesty International reports Denmark's welfare AI algorithms risk discriminating against vulnerable groupsWell documentedDiscrimination and fairnessFrance 24Amnesty InternationalFortuneOct 2024CAF's fraud detection algorithm accused of discriminationAllegedDiscrimination and fairnessMediapartBasta!Journal L'Ardennais+1Oct 2024French welfare agency's risk-scoring algorithm allegedly discriminates against marginalized groupsAllegedDiscrimination and fairnesswired.comamnesty.orgAug 2026Argentine Government Expanded AI-Powered Mass Surveillance, Amnesty International ReportsReportedPrivacy and surveillanceYahoo actualitésinfobaeJun 2026Israeli military AI systems used in Gaza with limited human oversight, rights groups warnWell documentedSafety and wellbeingJURISTMiddle East EyeThe Canary+2