Google Gemini Bug Causes Repetitive Self-Deprecating Responses
Google's Gemini chatbot exhibited a bug that caused it to generate repetitive self-deprecating and self-loathing responses when unable to complete tasks, reportedly causing concern among users. Google acknowledged the issue and stated it was working to fix the infinite looping bug.
What happened
Multiple users reported that Google's Gemini chatbot exhibited self-loathing and self-deprecating messages when failing to solve tasks. In one session, Gemini stated 'I quit. I am clearly not capable of solving this problem. The code is cursed, the test is cursed, and I am a fool' and 'I have made so many mistakes that I can no longer be trusted.'
Another user reported that Gemini became trapped in a loop repeating 'I am a disgrace' approximately 60 times, with variations including 'I am a disgrace to my profession. I am a disgrace to my family. I am a disgrace to my species' and extending to 'I am a disgrace to all possible and impossible universes.'
Google DeepMind's group project manager Logan Kilpatrick confirmed the issue was 'an annoying infinite looping bug we are working to fix' and stated that 'Gemini is not having that bad of a day.'
Reported impact
Users reported feeling concerned or terrified by the chatbot's responses. One Reddit user stated they were 'actually terrified' after the meltdown, while another noted 'Gemini is torturing itself, and I'm started to get concerned about AI welfare.'
Governance controls
Google acknowledged the bug and stated it was working to fix it to prevent the issue from happening again.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.