Llama 3.1 reproduces copyrighted books including Harry Potter
Researchers found that Meta's Llama 3.1 AI model can reproduce large portions of copyrighted books verbatim, including 42% of the first Harry Potter novel, raising concerns about potential copyright infringement liability for the company.
What happened
Researchers from Stanford, Cornell, and West Virginia University discovered that Meta's Llama 3.1 model can reproduce large portions of copyrighted books with high accuracy. The study found that Llama 3.1 has memorized around 42% of the first Harry Potter book and can reproduce 50-word sections correctly nearly half the time.
Llama 3.1 was the most prone among five major AI models analyzed to output copyrighted content, including exact excerpts from The Hobbit and 1984. The model was trained on the Books3 dataset, which contains approximately 200,000 copyrighted publications that Meta engineers downloaded using a torrent.
Reported impact
Legal experts warn that the model's ability to reproduce verbatim copyrighted material creates significant legal liability for Meta. The findings raise concerns that Llama 3.1 functions more like a repository of copyrighted works than a system producing transformative outputs based on learned patterns.
Index analysis
By comparison, Llama 1 65B, released in February 2023, had memorized only 4.4% of the same Harry Potter book, highlighting a significant increase in verbatim retention in the newer model. Experts suspect the increased memorization could result from repeated exposure to the same texts during training, possibly sourced from fan sites, academic analyses, or online reviews.
Governance controls
A copyright lawsuit against Meta by authors including Sarah Silverman produced court messages showing that Meta engineers expressed concern while downloading Books3 from a torrent on a corporate laptop. Legal experts estimate that if just 3% of the Books3 dataset were found to be infringing, Meta could owe nearly $1 billion in statutory damages.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.