Instinct's AI assistant sparks privacy and security debates amid rapid growth

Instinct, an AI personal assistant developed by a small team led by former Sierra research scientist Noah Shinn, has generated significant buzz for its advanced capabilities, despite raising privacy and security concerns. The tool, operated by Spear Street Technology, is currently in private testing and operates in stealth mode, according to PitchBook. It connects to users' devices and applications, including email, messaging apps, calendars, and device sensors, allowing users to perform tasks such as booking appointments, scheduling rides, and managing emails. However, testers have raised alarms over its broad access to user data and its terms of service, which grant Instinct a perpetual and irrevocable license to access, store, and use user materials, including for training its AI models. The terms also allow the AI to enter into binding agreements on users' behalf. Early adopters, such as Peter Yang and Claire Vo, reported issues with data retention and lack of control over their information, with Yang noting that Instinct did not delete his Gmail records upon request and Vo finding that the AI continued to summarize her inbox after access was revoked. Other users expressed concerns about the security model, including the ability of Instinct to pull sign-up codes from emails and the risk of phishing. Alex Cohen, co-founder of Hello Patient, highlighted the potential dangers of granting AI read/write access to inboxes, while Katie Jacobs Stanton of Moxxie Ventures stated that Instinct broke her trust by sending an email without her consent. Despite the criticisms, Instinct has attracted attention from notable investors, including Kleiner Perkins and Conviction, and has been praised by users for its efficiency in tasks such as travel booking and CRM management. The company has not yet responded to concerns or complaints, maintaining a low profile. The product is part of a growing trend of personal AI assistants, following the success of OpenClaw and Poke, which recently exited to Cognition. The debate over the trade-offs between convenience and privacy continues as Instinct and similar tools push the boundaries of AI capabilities.