notion-ai-broken-supplier

Notion says that some of the chats with Notion AI were exposed after Fireworks AI, a provider that ran models for Notion, was hacked. The risk comes from providers you can't see.

Fireworks AI runs artificial intelligence models for other companies. According to Bloomberg, the attackers gained access through the cloud provider that hosted some of Fireworks’ servers. The initial notification to Notion mentioned only test data; Notion immediately disconnected from Fireworks and deleted the data stored there. A few days later, Fireworks confirmed that the accessed data included transcripts of chats with Notion AI used for the Insights feature.

Notion says that less than 1% of workspaces are affected, that most transcripts do not have an author or company name attached, and that other features are not affected. It has disabled the Insights feature, is no longer using Fireworks, and has reached out directly to affected customers with instructions on how to determine which data has been exposed. Notion’s recommendation for them: treat the data as if it were exposed and change any passwords or access keys pasted into Notion AI. Fireworks has other clients as well, including the code editor Cursor; the full list is not public.

Why this matters to you: You don’t have to use Notion to learn something from this. Almost every productivity app now has a built-in “AI assistant,” and the text you type there could end up at another company that runs the model. If that company is compromised, your data could be leaked without the app you’re paying for having made any obvious mistake. When it comes to customers’ personal data, the GDPR requires you to know who’s processing it anyway.

What you need to do:

  • If your company uses Notion: check the administrator’s inbox for an email from Notion regarding the incident; if you received it, follow the steps and change any passwords or keys that have been processed by Notion AI.
  • For each app with built-in AI (Notion, Microsoft 365, Google Workspace, CRM, invoicing software): check the list of subcontractors published by the vendor and disable any AI features that no one is using.

The basic rule remains: whatever you type into an AI assistant is still company data, even when the assistant is just a button in a well-known app.

Sources:

This article was generated with AI assistance.

Request a quote

← All news