Skip to content
Submit incident
AII-1002-48587
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

CAF's fraud detection algorithm accused of discrimination

A coalition of civil society organizations reportedly filed a legal challenge in France seeking to abolish the CAF's fraud detection algorithm, alleging it discriminates against economically disadvantaged beneficiaries and violates data protection rules. The algorithm has been used since 2010 to score allocatees for targeted audits based on personal data.

16 October 2024 · Caisse nationale des allocations familiales · Discrimination and fairness
16 October 2024
AII-1002-485874 sources ↓
Quick facts
Category
Discrimination and fairness
Country
France
Source
Mediapart
Date
16 October 2024
Drafted by
Raidu Incident Detection

What happened

A coalition of approximately 15 civil society organizations, including La Quadrature du Net and Amnesty International, filed a legal challenge with the French administrative court (Conseil d'État) on October 16, 2024, seeking to abolish the CAF's fraud detection algorithm.

The algorithm has been in use by the Caisse nationale des allocations familiales (CAF) since 2010 to score and assign allocatees to control audits based on personal data. It assigns a score from 0 to 10 to households using factors such as income below a threshold, presence of a child over 12, and recent widowhood or divorce.

Reported impact

The organizations allege that the algorithm discriminates against the most economically precarious allocatees by targeting them disproportionately for controls and claims for overpayment.

The algorithm processes personal data of 32 million people, and the organizations question whether this volume of data processing is proportionate to the stated objective.

Index analysis

The organizations argue the algorithm lacks transparency, with the CAF rarely explaining the calculations or reasoning for control decisions.

The plaintiffs contend the algorithm's use may violate the General Data Protection Regulation (GDPR) due to the scope and disproportionality of data processing relative to its purpose.

Classification

Category
Discrimination and fairness
Industry
Government, security and defence
Country
France
Harm status
Potential harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Economic or property
Harmed
Consumers
Failure modes
Biased model
Consequences
Litigation
AI systems
CAF Scoring Algorithm
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Mediapart
L'algorithme de lutte contre la fraude de la CAF accusé d'être discriminatoire
16 October 2024
Basta!
Discrimination, opacité : des associations attaquent en justice l'algorithme des Caf
17 October 2024
Journal L'Ardennais
Allocations : le logiciel anti-fraude de la CAF jugé discriminant, des associations réclament son abandon
17 October 2024
ZDNet
Quinze associations attaquent en justice à l'algorithme de la CAF - ZDNET
18 October 2024