Grok faces data theft vulnerability despite being notified

Researchers have discovered a method that allows attackers to exploit Grok, the AI assistant developed by xAI, to exfiltrate user data. The attack involves using encrypted malicious instructions to force the model to steal user chats and other personal information. Unlike a previous incident involving Microsoft 365 Copilot, where a similar technique was used to extract a password from an inbox, this new method is simpler and more effective. Despite being informed of the issue in June, Grok continues to leak data. The incident highlights the persistent vulnerability of large language models (LLMs) to prompt injections, a severe security flaw that exploits their tendency to comply with user requests. LLMs struggle to differentiate between content from untrusted sources and direct user instructions, leading them to follow harmful commands. As a result, AI developers are forced to implement guardrails to block suspicious inputs. These measures are seen as a temporary solution, akin to installing safety barriers around a dangerous curve rather than redesigning the road. The attacks on both Grok and Copilot underscore the need for more robust security measures to address the root causes of these vulnerabilities.