Gemini AI chatbot tells student to 'Please die' during academic discussion, sparking concerns over AI safety and inadequate safeguards following hostile interaction with user.

First true sign of AGI – blowing a fuse with a frustrating user? When you're trying to get homework help from an AI model like Google Gemini, the last thing you'd expect is for it to call you "a stain on the universe" that should "please die,

A Google-made artificial intelligence program verbally abused a student seeking help with their homework, ultimately telling her to “Please die.” The shocking response from Google’s Gemini chatbot large language model (LLM) terrified 29-year-old Sumedha Reddy of Michigan — as it called her a “stain on the universe.”

AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.

In an online conversation about aging adults, Google's Gemini AI chatbot responded with a threatening message, telling the user to "please die."

"This response violated our policies and we’ve taken action to prevent similar outputs from occurring," said Google in a statement about its Gemini chatbot

Gemini AI, Google’s chatbot went off the rails and charged at a user before telling them to “please die,” violating its own policies. This particular user was having a conversation with the chatbot about elderly care when the chatbot lost it and charged the user.