Front page
NewsCX Trust5m · 12:01 GMT · 8 min read
Fireworks AI Breach Exposes Wider Risks in Enterprise Security
An AI infrastructure provider breach raises fresh questions about the security of enterprise AI supply chains. This week’s security and privacy developments also highlight the risks posed by legacy systems, third-party providers, weak access controls and failures to act on customer data requests.
The U.K.’s fireworks celebrations last week may be behind us, but a breach at AI infrastructure provider Fireworks AI has kept the focus this week on a different kind of explosive fallout in the form of security risks in enterprise AI supply chains.
The incident exposed customer datasets, incomplete model weights and sensitive account information through a third-party provider, once again raising questions about the security of the infrastructure supporting enterprise AI services.
The concern for CX leaders is how much customer information now passes through systems and providers beyond a company’s direct control. Customers share personal details, account information and sensitive queries with businesses, often with little visibility into the external platforms processing that data.
For me, the Fireworks AI breach points to a wider challenge around customer trust and other developments this week show how broadly that challenge applies, with a number of developments suggesting implications for how enterprises protect customer information and maintain confidence in their services.
After all, the reputational cost of getting AI security and privacy wrong is high. As Ram Ramamoorthy, Director of AI Research at Zoho, told me in an interview this week:
“You want to be very privacy first… you are going to be in the news if you have a privacy breach, if you have a security breach… the reputational damage [from] a security breach or a privacy misconfiguration where data leaves the ecosystem is still too big when compared to the productivity gain that comes from using a lot of these tools.”
Protecting customer data remains a critical condition of adoption for enterprises weighing the efficiency gains of AI against the risks.
Fireworks AI Breach Exposes the Security Risks Behind Enterprise AI Supply Chains
The security incident involving Fireworks AI raises questions about how well enterprises understand the third-party systems processing their data, after attackers accessed customer account information, billing records, datasets and incomplete AI models.
Fireworks initially disclosed the security incident on October 9, after identifying the unauthorized use of internal credentials on October 6. At the time, it said attackers had accessed environment variables containing application programming interface (API) keys and tokens used in evaluation jobs across a limited number of customer accounts.
The initial investigation found no evidence that customer models, datasets, training data, personal information or inference traffic had been accessed. But an expanded investigation involving Palo Alto Networks’ Unit 42 subsequently identified a wider impact.
In an update on November 9, Fireworks said the incident had exposed resource metadata and billing information, including customer addresses, invoices, payment history, account balances and credit usage. For a limited number of accounts, attackers also accessed secrets, datasets and incomplete model weights.
The incident has implications beyond Fireworks’ direct customers. Notion confirmed that information accessed through its AI infrastructure provider included chat transcripts processed for its Insights feature, which helps customers understand their AI usage. On November 11, Notion confirmed that it had revoked exposed Notion API keys discovered in affected users’ messages.
Fireworks said it had found no impact to its Inference, Training SDK and Nexus services, which operate with zero data retention (ZDR) by default. But the incident demonstrates how evaluation jobs, stored datasets, development environments and other supporting workflows can create separate exposure points.
The implications for CX leaders extend to customer conversations and the information employees share with AI assistants. Businesses need to understand which external providers process prompts, where associated datasets and credentials are stored, and whether their suppliers’ security assurances cover the full AI supply chain.
The incident also raises questions about how quickly organizations can identify which downstream applications and customer interactions may have been affected by a supplier breach.
Maersk Investigates Unauthorised Access And Data Extraction From Legacy System
Shipping and logistics group Maersk is investigating unauthorized access to a local legacy system inherited through a previous acquisition, after identifying that data had been extracted from the environment.
In a November 11 security advisory, the company said its cybersecurity team had launched an investigation and taken steps to secure the affected system.
Maersk said initial findings strongly suggested that no sensitive data had been disclosed and there was no indication that other company systems or customer and partner environments connected through APIs and electronic data interchange (EDI) integrations had been affected.
The company said it does not currently anticipate disruption to customer operations, with its platforms for booking and managing shipments continuing to operate as usual.
The breach highlights the security challenges associated with technology inherited through acquisitions, as legacy environments can remain aporting day-to-day customer operations
FTC Privacy Case Against Hims & Hers Expands To Five More States
The U.S. Federal Trade Commission (FTC) has expanded its privacy lawsuit against telehealth provider Hims & Hers, with Arizona, Florida, Nebraska, Ohio and Wisconsin joining the action.
An amended complaint filed on November 10 alleges that Hims & Hers shared consumers’ sensitive health information with third-party advertising platforms, including Meta and Snap, despite making assurances about protecting their privacy.
The FTC also alleges that the company misled consumers about its billing practices, charging for prescriptions shortly after users submitted an intake form, before they had consulted a medical provider. The complaint further alleges that Hims & Hers made it difficult for customers to cancel subscriptions.
The five states join Utah and California, acting through the Los Angeles County Counsel, in the case. The amended complaint adds alleged violations of the five states’ consumer protection laws to existing claims under the FTC Act, the Restore Online Shoppers’ Confidence Act and California and Utah consumer protection legislation.
The case illustrates how privacy, consent and billing transparency can become interconnected customer experience issues. Businesses handling sensitive personal information need to ensure their privacy claims match their actual data-sharing practices, particularly when advertising technology providers are involved.
It also indicates the regulatory importance of straightforward cancellation processes and clear pricing disclosures. A customer journey that makes it difficult to understand how personal information is used or how to end a subscription can create legal and reputational exposure alongside customer dissatisfaction.
In Brief
Regulatory and security developments this week also point to growing scrutiny of how businesses use customer data, secure the systems behind their services and manage emerging AI risks.
ICO seeks evidence on agentic AI and data protection
The UK’s Information Commissioner’s Office (ICO) is inviting organizations to contribute to its call for evidence on how data protection law should apply to agentic AI. The consultation, which closes on November 20, covers data security, transparency, accountability, automated decision-making, fairness, purpose limitation and lawful processing.
The exercise is particularly relevant to businesses deploying autonomous agents in customer journeys, where systems may access personal information, make decisions or take actions on customers’ behalf.
CISA Adds Actively Exploited Vulnerabilities Affecting Communications And Business Systems
The U.S. Cybersecurity and Infrastructure Security Agency has added six vulnerabilities to its Known Exploited Vulnerabilities catalogue. The additions include weaknesses affecting Cisco BroadWorks, Microsoft Outlook and Google Chromium.
The vulnerabilities highlight risks across communications infrastructure, remote access, email security and browsers. Organizations are encouraged to prioritize remediation of vulnerabilities known to be actively exploited, particularly where systems support customer-facing operations.
Italian Regulator Fines Wind Tre €1.7MN Following Breaches Affecting 365,000 Customers
Italy’s Data Protection Authority (DPA) has fined telecoms provider Wind Tre €1.72MN ($1.91MN) following two breaches affecting more than 365,000 customers. Attackers impersonated technical support personnel to persuade retail employees to grant remote access to their devices, subsequently accessing customer identification and contact information. The payment-related details of 41,359 customers were also exposed.
The regulator identified weaknesses in credential and digital certificate management, API security and the company’s security assessments. The case indicates the risks of social engineering targeting frontline employees and the importance of securing retail systems and the customer data they can access.
Italian DPA Fines Clothing Company Over Unprocessed Erasure Request
The Italian regulator also fined clothing company Barbuti €5,000 after a customer continued receiving promotional text messages despite asking for their personal data to be erased. The company automatically acknowledged the customer’s email but failed to process the request. The regulator said requests submitted through contact channels provided by a data controller should generally be treated as valid.
The case is a reminder that marketing opt-outs and data erasure requests are part of the customer experience, as well as regulatory compliance. Businesses need processes to ensure requests reach the right teams and are acted on, rather than relying on customers to find the correct inbox or repeat their instructions.
What to Watch
The Fireworks AI breach and Wind Tre case both indicate how customer data can be exposed through parts of the service chain that receive less attention than core business systems. CX and security teams should review who can access customer data across these environments and how quickly access can be restricted when an incident occurs.
The ICO’s agentic AI consultation is another development to follow, particularly as businesses give AI agents greater access to customer records and permission to take action. Its findings could help shape expectations around accountability, transparency and data protection in automated customer interactions.
rate this storyhelps rank stories across CX Today
