- Microsoft CEO Satya Nadella and Palantir CEO Alex Karp warn that ungoverned AI use can transfer proprietary operational knowledge to AI labs that also compete in enterprise markets, a risk most governance frameworks have not addressed.
- Major providers including Google Cloud, Anthropic and Microsoft offer no-training guarantees by default, but supply chain gaps, evolving terms of service and employee use of personal accounts can undermine those commitments in practice.
- According to the Ramp AI Index, Anthropic overtook OpenAI in U.S. business AI adoption for the first time, with 34.4% of businesses in Ramp’s sample paying for its products against OpenAI’s 32.3%.
When companies feed internal workflows, edge-case handling and operational context into an AI system, they are not just sharing data. They are transferring the tacit knowledge that makes their operations distinctive. Microsoft CEO Satya Nadella put it plainly in a recent essay on X, coining the term “Reverse Information Paradox”: that “exhaust,” left ungoverned, distils institutional know-how into the systems of the very providers selling the intelligence.
The Reverse Information Paradox
Palantir CEO Alex Karp, in a July CNBC interview, described enterprise customers’ frustration directly: they are “livid,” he said, telling him “I am paying for tokens that create no value.” The prevailing view among enterprises, as Karp characterised it, is that they get no value while the labs “get my IP.” The concern is structural. Companies like Anthropic, OpenAI and Google DeepMind build the foundational models that enterprises license, but also develop applications that compete directly with those same customers’ markets. Adopting advanced AI means sharing intellectual property with entities that may eventually compete for the same business.
Nadella’s framing goes beyond conventional data privacy. A company might block an AI system from accessing explicit customer records while still exposing how its claims team handles edge cases, or how its engineers diagnose failures. That operational feedback is often what makes an AI agent effective, and it also represents a transfer of competitive knowledge that most governance frameworks have not accounted for.
What the Major Providers Actually Promise
Google Cloud states that for Gemini Enterprise, it does not use customer data to train or fine-tune AI models without prior permission. Google Cloud also offers pathways to “zero data retention,” though prompt logging for abuse monitoring may still occur unless customers request an exception.
Anthropic’s Claude API and enterprise deployments similarly exclude customer data from model training by default. More recently, Anthropic introduced a 30-day data retention policy for certain Claude models, citing safety purposes including defence against complex attacks; the company states this data will not be used to train new Claude models.
Microsoft, a major investor in OpenAI and provider of enterprise AI through Azure AI and Copilot, states that organisational data within Microsoft 365 applications, including Word, Outlook, Teams and SharePoint, is not used to train the underlying large language model, with processing contained within the Microsoft 365 service boundary. Azure OpenAI confirms it does not use customer data to retrain models, according to the company.
Where the Policies Break Down
The headline commitments are only as strong as the weakest link in the supply chain. An enterprise’s contract with a primary AI lab does not necessarily bind all sub-processors or third-party data vendors. A breach at Mercor, confirmed in late March 2026 and traced to a poisoned version of the widely used open-source LiteLLM library, reportedly exposed training strategies linked to OpenAI, Anthropic and Meta simultaneously, illustrating how a single compromised dependency can propagate across multiple providers at once.
Evolving terms create a separate vulnerability. When OpenAI updated its data usage policy in March 2026, questions arose about whether previously ingested data would be covered by new opt-out provisions. The direction of these changes is not always predictable. Enterprises that negotiated specific protections at contract signing may find the operational reality shifting under them.
There is also a distinct technical risk that sits outside the training question entirely. Retrieval Augmented Generation systems can fetch data from incorrect indices; prompt injection attacks can redirect model behaviour; and the opacity of many production models makes it difficult to audit what is being processed and how. A paper by Morris et al., presented at ICML in July 2026, suggests that for models trained on massive datasets, membership inference attacks succeed at little better than random guessing for most data points, but that finding does not address the broader exposure risk that occurs before or outside the training pipeline.
The Governance Response
A 2024 Cisco study found that the majority of organisations were already implementing controls to limit generative AI exposure, and Google Cloud’s push toward “zero data retention” as a customer-configurable option reflects the same pressure. Neither fully resolves the agent problem.
When an AI system moves beyond generating text to taking autonomous actions, resetting credentials, approving requests, triggering transactions, the access control problem changes in kind, not just degree. The emerging position across the industry is that AI agents need to be treated as first-class identities within enterprise infrastructure, with the same visibility, access scoping and governance lifecycle applied to human users. That is a significant operational lift for most security and compliance teams, and it sits largely outside the scope of what any provider’s no-training policy covers. For enterprises weighing these trade-offs, the cost implications of AI governance at scale deserve equal scrutiny alongside the data risk.
According to the Ramp AI Index, Anthropic overtook OpenAI in U.S. business AI adoption for the first time, with 34.4% of businesses in Ramp’s sample paying for its products against OpenAI’s 32.3%. Whether that lead holds as both providers continue updating their enterprise terms is harder to predict from public information alone. For more analysis on enterprise AI strategy, visit our Enterprise AI section.



