AI Won’t Save Business Intelligence If the Numbers Still Don’t Agree

Business intelligence vendors have an appealing new story. Ask a question in plain language, let AI find the data and produce a dashboard in moments. US enterprise data leaders are looking at something less theatrical. In October 2026 roundtables, their discussion of BI modernisation turned to semantic models, data governance, platform integration and the difficulty of making generative AI work with the tools already embedded in the business.

The uncomfortable proposition is simple. If two systems disagree about an essential business measure, adding a conversational interface will make the disagreement faster to discover. It will not make the organisation more intelligent.

The bottleneck is meaning, not chart creation

A US BI modernisation session explored the transition from report-oriented analytics towards AI-assisted interpretation and automated workflows. Participants described work on semantics and ontologies, cataloguing tools and AI-enabled reporting. They also discussed the practical difficulty of connecting models such as Claude to established platforms such as Power BI. A model might review a report design yet still lack a clean, governed route to produce the desired output inside the enterprise’s existing stack.

This is a problem of architecture and accountability as much as user experience. A chart may display sales, but whose definition of sales? Does it include returns, intercompany transactions or an acquired division? Which dates apply? If the product cannot resolve or clearly disclose those choices, the fastest possible dashboard is not necessarily a useful one.

Vendors should lead with the semantic contract between the business and the analytical system. Show how metrics are defined, validated, owned and reused. Demonstrate that an AI interface can follow that contract rather than improvise a new calculation when a user phrases a question differently.

The enterprise already owns a complicated stack

The US discussion reflected organisations operating multiple analytics, cloud, catalogue and AI environments. Participants referred to Power BI, Collibra, Purview and emerging analysis tools while exploring the role of AI gateways and secure internal services. Each platform addresses a need, but buyers are unlikely to discard the estate because a new AI front end looks impressive.

A credible solution therefore has to show interoperability. Can it work with existing permissions and data models? Can it reuse certified metrics? Can a report move from development to production without breaking established workflows? What occurs when the organisation changes its model provider or cloud configuration? The answer determines whether a promising demonstration becomes a deployable enterprise capability.

One participant described AI being used to generate semantic information and validate report standards. Another described AI-assisted analysis through secure internal systems. These examples suggest that the most useful AI may operate inside an established governance and delivery process rather than attempting to replace it wholesale.

Governance cannot be bolted on after self-service expands

AI makes analytical access easier. That is the benefit and the risk. A business user who previously waited for an analyst can now formulate questions directly. But the user may not know which source is authoritative, what a field means or whether the result is suitable for a regulated decision. A rapid increase in query volume can multiply inconsistent interpretations.

Vendors should explain how they handle user identity, source authorisation and sensitive data at the point of query. They should show how business context is supplied, how disputed metrics are handled and how responses can be audited. Governance is not a screen labelled ‘Compliance’. It is the behaviour of the product when a user asks an awkward question.

A system that refuses to guess and exposes uncertainty may initially feel less magical than one that always answers. In an enterprise setting, it may be the more commercially valuable product. Buyers need controlled confidence, not confident improvisation.

The next step is action, which raises the stakes again

The US sessions moved beyond chat interfaces to operational use cases: procurement support, executive reporting, inventory planning and workflows that increasingly connect analytics to decisions or automated actions. When AI simply drafts a chart, a human can review it. When AI initiates an operational step, an incorrect definition can become a costly transaction.

That progression changes the evaluation checklist. The buyer needs thresholds, approval points and logs showing not only what the model said but also what action followed. The platform should support human intervention, rollback where possible and clear ownership of outcomes. It should make a distinction between recommendation, approval and execution.

Suppliers that can demonstrate those transitions with real integration constraints will stand apart from vendors selling another standalone conversational dashboard. The question is no longer whether AI can describe the business. It is whether the business can safely depend on what AI describes.

The BI assistant is only as coherent as its business vocabulary

The easiest part of an AI-powered BI demonstration is producing a chart from a natural-language request. The harder part is deciding what the question means. A sales leader may ask for revenue by customer and assume that cancellations, currency conversion and ownership of an account have already been defined. A model can generate a technically valid query against a convenient table while quietly ignoring those assumptions. The result looks professional enough to be persuasive and wrong enough to distort the discussion.

The US BI modernisation discussion raised the ambition to bring BI and AI together through a shared ontology and semantic framework. Participants described evaluating several platform options while working within existing cataloguing, visualisation and cloud environments. They also discussed the difficulty of connecting AI tools directly to established BI artefacts. That operational detail is important: the transformation is not simply switching on a conversational interface in a report library.

For vendors, the first demonstration should therefore be semantic, not cosmetic. Choose a measure on which business departments disagree. Show the approved definition, the exceptions and how a natural-language question resolves to that definition. Then ask a deliberately ambiguous follow-up. A good system should request clarification or expose alternatives instead of presenting one interpretation as unquestionable fact.

A second demonstration should test continuity. If the organisation has governed Power BI reports or a mature lakehouse, can the proposed AI layer use those assets without creating a parallel, unaudited meaning of the business? Buyers need to understand what remains authoritative and where the new tool fits. That is a materially different proposition from promising to replace every dashboard with a chat box.

The integration problem is not a minor implementation detail

The US discussion included examples of Claude reviewing report designs without directly producing usable Power BI output, alongside experiments with Databricks and other tools for interactive charting. These accounts illustrate a reality that procurement presentations often disguise. Modern BI landscapes are assembled from multiple services that were not designed to share every artefact, permission rule or query semantic automatically.

A credible vendor should document the actual integration path. Which sources are queried directly? Which datasets are synchronised? Where are identities checked? How are metadata and semantic definitions brought into the AI system? How are generated visuals embedded into an existing workflow? What happens when a connector changes or an upstream report definition is updated? If the response relies on a manual export followed by a human cleanup, the buyer should know before the proof of concept begins.

Governance becomes especially important when analytics is decentralised. In another US discussion, participants described users producing dashboards with AI tools that were difficult to reproduce reliably against real enterprise data. This was not an argument against self-service. It was a warning that a quickly assembled report can bypass the definitions and controls that make a corporate measure reusable. Vendors should show how business users explore safely while data teams retain visibility into published and operationalised analyses.

A sensible test gives a business user access to a limited governed dataset and asks them to produce a repeatable answer. Then a data engineer independently verifies the lineage, query logic, filters and access permissions. If the workflow cannot survive that hand-off, the system has accelerated experimentation rather than delivered enterprise-grade business intelligence.

Once AI starts taking action, the standard rises again

US participants also discussed moving beyond chat-style reporting towards procurement assistance, inventory planning and automated decision workflows. When a tool merely summarises a trend, the immediate risk may be a poor recommendation. When it triggers an operational action, the quality of the underlying data and the limits of its authority become far more consequential. The buyer must decide what an AI system may recommend, initiate or complete without approval.

A vendor promising decision intelligence should make those distinctions explicit. What evidence justifies an action? What business rule applies? Which user or agent has permission to proceed? What happens when the model cannot reconcile conflicting figures? How can the organisation stop, reverse or investigate a decision? The integration architecture should record inputs, assumptions and outcomes so performance can be evaluated after deployment.

This is also where an apparently compelling ROI case can become expensive. Automated actions may save time, but errors can generate corrective work, operational disruption or compliance review. The business case should compare the whole controlled process with the existing human workflow, not just the time to generate a chart. Buyers may reasonably accept a slower but auditable process for critical decisions while allowing greater autonomy in lower-risk scenarios.

The vendor opportunity lies in bridging the two worlds. Traditional BI invested in consistent reporting, while generative AI creates new ways to access and use information. A provider that can preserve trusted semantics, integrate into existing applications and govern downstream actions has a stronger strategic proposition than one competing primarily on how conversational its interface feels.

Ask for one difficult question, not fifty easy prompts

A buyer can learn more from one carefully chosen reporting dispute than from a long demonstration of polished natural-language queries. Ask two business units to submit the same question using their normal terminology. Compare the system’s interpretation with the definitions approved by the data owner. If the answers differ legitimately, the product should explain why. If they differ because the platform selected incompatible sources, it should make the defect visible and direct it to someone able to resolve it.

US participants described real difficulty reconciling data semantics and connecting AI to established analytics tools. That suggests a practical acceptance standard for vendors: the output must be reproducible, linked to a governed definition and accessible under the correct user permissions. The application should also record its query or transformation logic so a reviewer can reconstruct the result later. A slick conversational interface may help adoption, but it is not evidence that an enterprise has finally agreed what its numbers mean.

The purchasing committee should also understand how different products interact when a report is wrong. An AI model vendor may be responsible for generation quality, a BI provider for the reporting layer, and a customer data team for business definitions. If nobody owns the interface between them, the buyer can find itself paying several suppliers to diagnose the same incident. A useful proposal documents responsibility for definitions, connectors, testing and rollback before the first production deployment.

What to demonstrate in the buyer meeting

  • The same business metric answered consistently across two different natural-language requests.
  • A visible, approved semantic definition and traceable source for the answer.
  • Working integration with the customer’s existing BI environment and access model.
  • An explicit response to ambiguous, stale or unauthorised data.
  • A regression test after a model, prompt or metric-definition change.
  • A controlled hand-off from AI recommendation to operational action.

Better BI will demand harder evidence

US data leaders are not rejecting AI in analytics. Their discussions suggest they are learning where the real engineering work lives. Semantic consistency, security and interoperability determine whether speed becomes value. A vendor that begins with ‘watch AI build this dashboard’ may win attention. A vendor that proves two business leaders can trust the same number is more likely to earn a serious evaluation.

For vendors: The Data Leadership Board connects solution providers with senior data and analytics decision-makers navigating AI-enabled BI. If your offering addresses the underlying trust and integration problem, enquire about relevant enterprise buyer conversations.

Optimized by Optimole