May 28, 2026 in Member Insights

Context is Key: Why Data Built for Humans Fall Short for Agents

SHARE: PRINT ARTICLE:print this page https://doi.org/10.1287/orms.2026.02.02

Context is Key Why Data Built for Humans Fall Short for Agents

While most agentic AI deployments fail in production, the reason isn’t the AI.

It’s the data underneath.

Today’s companies are scrambling to deploy AI agents that can function autonomously. These systems promise to handle customer service, manage supply chains, process financial transactions, and coordinate across departments - all without the need for continual human oversight.

The reality is less impressive. Most of these projects look good in demos, but they fall apart in production. The usual suspects receive the blame: immature technology, insufficient computing resources, insufficient training data. But the real problem – data architecture - runs deeper. Enterprise data systems were designed for use by humans, not autonomous agents. Until organizations fix this mismatch, agentic AI deployments will keep falling short.

Where AI Agents Fail

Here’s what’s happening: Companies built their data systems for decades on the assumption that people would use them. People bring context. For example, they understand that you can have different meanings for the term “revenue” in different systems. They know that the numbers reported at the end of the quarter take time to “settle.” They know enough to check when something looks strange. But AI agents contain none of this built-in knowledge. They need everything explicitly spelled out for them.

The scale of this problem is striking. Per UIPath’s 2025 report, data quality issues are the primary reason for pilot failures across different industries. That conclusion was echoed by Informatica’s 2025 CDO Insights survey, which found that 43% of organizations cite data quality and readiness as their top obstacle to AI success.

In financial services, these consequences are measurable. Per Blue Prism’s Global AI Survey 2025, 25% of financial organizations largely fail when deploying AI agents. The root cause: agents’ inability to distinguish data states that humans navigate instinctively, such as preliminary vs. final numbers, validated vs. unvalidated transactions, and real time vs. batch processed information. Agents don’t notice the glaring quality problems a human would easily pick up on.

Organizations design and deploy advanced AI orchestration platforms while missing the fundamental issue: the data doesn’t contain the context that agents need to work reliably.

 

The Four Essential Contexts

Successful agentic AI deployment requires four types of context that have historically been neglected by traditional data management. They are:

  • Semantic context: This means going beyond technical definitions and encoding what data means in the context of business. When organizations have data about a customer in three systems, agents need to know whether Customer ID #47392 in CRM, Account #47392 in billing, and Contact #47392 all refer to the same entity or person. Human analysts can easily figure this out as a consequence of
    the knowledge they possess about this data. Agents require explicit rules and mappings in their data layer.
  • Temporal context: Time is more than timestamps. Agents must understand data freshness and lag patterns. Is this sales prediction made more than two hours ago still relevant? Is the inventory system updated dynamically, or is it batch per four hours? Bad decisions start happening when agents work off “current” data that is actually hours old.
  • Operational context: This covers data quality and reliability. Agents need signals about whether data is trustworthy enough to act on. They need quality scores and pipeline health metadata sitting right next to the data to assess information reliability.
  • Policy context: This embeds compliance and privacy rules directly into the data. When agents make thousands of decisions per hour, you can’t rely on external gatekeepers. An agent shouldn’t be able to use European customer data for U.S. marketing any more than an elevator can go to a floor you don’t have access to. The restriction needs to be structural.

Companies successfully running agents at scale have landed on similar approaches, though they have not all arrived there the same way. Once they quit trying to develop one super-agent that did everything, these companies switched to operating specialist teams of agents in which one agent researches, one plans, others work toward an end, and yet others validate the work performed.

This reflects how well-performing teams really work. It is more stable and manageable than attempting to build a single platform that takes care of everything.

Semantic Layers and GraphRAGs

But specialization alone isn’t enough. The real breakthrough comes from what lies beneath: a semantic layer that gives all agents a shared understanding of what the data means.

Think of the semantic layer as a translator. For example, when an agent asks for a customer’s “lifetime value,” the semantic layer knows which tables to query, how to handle different customer ID schemes across systems, which calculation to use, and what caveats to add based on data freshness. The agent doesn’t need to know your specific data setup. It just speaks in business concepts, and the semantic layer handles the translation.

The best implementations go one step further into this territory. They combine semantic layers with knowledge graphs called GraphRAGs.

In a GraphRAG, agents see a structured web of facts and relationships that is updated continually rather than in chunks of text. In the case of a pharmaceutical organization conducting clinical trials, that means agents can reason based on drug interactions, patient eligibility, and regulations as interrelated knowledge rather than sets of jumbled documents. This will result in error rates dropping dramatically.

These knowledge graphs work as shared memory for multiple agents. When agents collaborate on complex tasks, the knowledge graph keeps everyone working from the same understanding of reality. This prevents the chaos that happens when isolated systems make decisions based on outdated or conflicting information.

Prioritizing Governance

Here’s the uncomfortable truth: Companies are deploying agents faster than they’re building appropriate governance. Company leaders create incentives to push this rapid growth, business units get rewarded for quick AI wins, and tech teams are evaluated based on deployment speed. No one gets promoted for building solid governance - until something goes wrong.

The numbers are sobering. A 2025 survey found that 96% of business leaders recognize that AI agents pose heightened security risks; yet fewer than 50% have implemented agent-specific governance policies. Deloitte’s Tech Trends 2026 report found that 65% of leaders cite agentic system complexity as their top barrier for two consecutive quarters.

The pattern in post-mortems has consistently demonstrated the impact of this failure in adequate governance. An agent makes a decision that individually looks fine but interacts with other agents’ decisions in unexpected ways. The problem spreads across hundreds of automated actions. By the time employees notice, it’s a systemic issue embedded throughout a company’s operations.

The task to correct such scenarios becomes more difficult as agents scale deployments. It is manageable for one agent to make bad decisions, but fifty agents interacting with one another create complexity that is difficult to track. When those agents operate across departments and systems, old-style oversight collapses entirely.

The answer isn’t to slow down. Competitive pressure is too intense, and the value is too high. The answer is to make governance an enabler rather than a bottleneck.

The best implementations use “bounded autonomy,” in which agents work freely within clear limits and escalate high-stakes decisions to humans. Every agent action creates an audit trail, and governance agents monitor other agents for policy violations or strange behavior.

The real test of any agent is simple: Does it make work better for the people using it?

When implementations succeed, you see shifts in how people spend time. Data stewards stop chasing duplicate records and start refining the policies that guide agents. Analytics teams stop fixing data quality problems and start building better data products. Business leaders get insights with context: what changed, why it matters, what to consider doing.

In the end, data context maturity will mean the difference between market success and failure.

Organizations that invest in context engineering get results. Those that try to add agents to existing infrastructure stay stuck in pilots. Companies that built data quality, lineage tracking, and governance frameworks before deploying agents will ultimately see them handling complex work autonomously.

 

Taking Stock of Your AI Readiness

If you’re responsible for AI strategy, start with an honest look at your data’s readiness. Not whether you have data - everyone does - but whether your data gives agents the context they need.

Can your agents locate relevant information without human help? Do they get real-time signals about data quality? Are compliance policies machine-readable and embedded in your data layer?

Gartner’s 2024 survey of 1,203 data management leaders found that 63% of organizations either do not have or are unsure if they have the right data management practices for AI. Gartner predicts that through 2026, organizations will abandon 60% of their AI projects that are unsupported by AI-ready data. This uncertainty represents both risk and opportunity, and it means you can focus investments on what really matters by:

  • Deploying specific, high-value processes rather than trying to transform everything. Pick workflows in which you can redesign your entire process regarding agent capabilities. Good candidates not only involve complex coordination across systems, but they also have clear success measures and defined boundaries.
  • Building your semantic layer before you scale agents. Every company that is successfully running agents at scale first invested heavily in semantic infrastructure. They created unified business glossaries, mapped relationships across data domains, and built the translation layer that lets agents understand data in business terms.
  • Treating governance as a competitive advantage - not compliance overhead. The fastest-moving organizations with agents aren’t the ones with the loosest policies; they’re the ones with the smartest guardrails. Clear boundaries create confidence, which enables broader deployment and greater value.

The Choice Ahead

The technology for autonomous agents is here. The economic pressure is real. The competitive stakes are high. What separates winners from losers won’t be who deploys agents fastest; it will be who builds the data foundations that make agents reliable and trustworthy at scale.

Market signals confirm this. Billions flow to data and metadata companies. The AI agent market is projected to expand from $5.32 billion in 2025 to $42.7billion in 2030. Gartner projects 40% of enterprise applications will include task-specific AI agents by the end of 2026, up from less than 5% in 2025.

The companies that will lead won’t be those with the biggest models or most agents. They’ll be organizations whose agents understand what their data means and can act reliably.

The shift from assistive to agentic AI is here. The strategic question is whether to build data architectures that make agents trustworthy for important decisions, or to keep using foundations designed for human consumption while wondering why AI stays stuck in pilots.

References

ByteIota, 2026, “AI Agent Governance Crisis: 40% Enterprise Failure in 2027.” https://byteiota.com/ai-agent-governance-crisis-40-enterprise-failure-in-2027/ 

Deloitte Insights, 2025, “The Agentic Reality Check: Preparing for a Silicon-based Workforce.” https://www.deloitte.com/us/en/insights/topics/technology-management/tech-trends/2026/agentic-ai-strategy.html 

Directual, 2025, “AI Agents in 2025: Why 95% of Corporate Projects Fail—and How to Join the Successful 5%.” https://www.directual.com/blog/ai-agents-in-2025-why-95-of-corporate-projects-fail 

Gartner. n.d., “Get AI Ready: What IT Leaders Need to Know and Do.” https://www.gartner.com/en/information-technology/topics/ai-readiness 

Gartner, 2025, “Lack of AI-ready Data Puts AI Projects at Risk.” https://www.gartner.com/en/newsroom/press-releases/2025-02-26-lack-of-ai-ready-data-puts-ai-projects-at-risk 

Gartner, 2025, “Gartner Predicts 40% of Enterprise Apps Will Feature Task-specific AI Agents by 2026, up from Less than 5% in 2025.” https://www.gartner.com/en/newsroom/press-releases/2025-08-26-gartner-predicts-40-percent-of-enterprise-apps-will-feature-task-specific-ai-agents-by-2026-up-from-less-than-5-percent-in-2025 

Kumar, P., 2025, “The Surprising Reason Most AI Projects Fail—and How to Avoid It at Your Enterprise,” Informaticahttps://www.informatica.com/blogs/the-surprising-reason-most-ai-projects-fail-and-how-to-avoid-it-at-your-enterprise.html#a-lack-of-data-in-a-time-of-data-overload 

Rathi, S., Jaiswal, I., and Sostarec, D., 2025, “10 AI Agent Statistics for 2026: Adoption, Success Rates, and More,” Multimodalhttps://www.multimodal.dev/post/agentic-ai-statistics

Davenport, T.H., Barkin, I., 2025, “Preparing for the Era of Agentic AI: 2025 UiPath Agentic AI report,” UiPathhttps://www.uipath.com/assets/downloads/agentic-ai-research-report 

SS&C Blue Prism, 2025, “Implementing Agentic and Generative AI: 2025 Global Enterprise AI Survey.” https://www.blueprism.com/resources/white-papers/agentic-and-gen-ai-2025-global-enterprise-ai-survey/ 

Mohan Krishna Mannava
Mohan Krishna Mannava

SHARE:

INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.