How long should an AI pilot run?

Long enough to produce evidence against a written threshold — commonly weeks, not quarters. A pilot that has run for two quarters without an acceptance decision has become a research project, and should be closed or converted deliberately.

Should pilots run on production data?

On the production data path, with appropriate controls. Testing on hand-assembled extracts hides exactly the access, quality and latency problems that block graduation.

Who should approve a pilot for production?

The business owner who funds the run, with a risk or evaluation approver holding a defined veto. If approval requires unanimous agreement across several functions, nothing ships.

What if the pilot works but the benefit is small?

That is a useful result. Close it, record why the benefit was smaller than expected, and let the prioritization model absorb the learning. Scaling a marginal use case to justify the effort is how programmes lose credibility.

Decision intelligence — Europe

From Pilot to Production: The Gates Where AI Programmes Actually Stall

A pilot proves a model can produce an output. Production requires that a real process changes, someone owns the result, and the organization can keep the system honest after the launch enthusiasm fades. Those are different tests.

Decision intelligenceWritten by NirjiX AI AdvisoryPublished January 2026Last reviewed February 20268 min read

Direct answer

Pilots stall at five predictable gates. There is no named business owner who loses something if the system never ships. The data used in the pilot was hand-assembled and cannot be accessed under governance at production cadence. No one defined what 'good enough' means, so evaluation becomes an opinion and approval never closes. The surrounding process was never redesigned, so the output arrives somewhere nobody acts on it. And the run cost — inference, monitoring, support and retraining — was never funded, so the system has no home in anyone's budget. Each gate is testable before the pilot begins, which is why a readiness assessment is cheaper than a pilot that cannot graduate.

The five gates, and the test that clears each one

Gate	Failure signal	What clears it
Ownership	The sponsor is a technology leader; no business P&L is affected	A named business owner whose number changes when the system works
Data access	Pilot data was exported once, by hand	A governed pipeline at production cadence, with access approved for the live use
Evaluation	'It looks good' with no threshold	A written acceptance standard, an evaluation set, and a named approver
Process redesign	The output lands in a report nobody is required to act on	The workflow, roles and exception handling changed alongside the model
Run cost and support	No line item for inference, monitoring or retraining	A funded run budget and a support path with an owner

Sequencing a pilot so it can graduate

01
Write the production definition first
State which process changes, whose number moves, and the acceptance threshold — before any build.
02
Pilot on the production data path
If the pilot cannot use governed data at real cadence, the pilot is testing something you cannot ship.
03
Change the process in the pilot, not after
Include the humans who will act on the output, with the new roles and exception handling in scope.
04
Fund the run before the launch
Commit the run budget at the evidence gate. A system without a run owner degrades quietly.

Signals that a pilot is already unlikely to graduate

The success criteria are qualitative and no one has written a threshold.
The data was prepared by a single person who is not part of the production plan.
No one has described how work is done differently after the system ships.
The business sponsor attends steering meetings but does not fund anything.
The pilot's value case relies on time saved with no plan to redeploy that time.

NirjiX view

The NirjiX view

Pilot count is the wrong metric. An organization with two systems in production and a funded run budget is further ahead than one with fifteen pilots and a portfolio review.

The honest test before starting the next pilot is whether the last one changed a business number. If not, the constraint is not model quality, and another pilot will not find it.

Frequently asked executive questions

How long should an AI pilot run?: Long enough to produce evidence against a written threshold — commonly weeks, not quarters. A pilot that has run for two quarters without an acceptance decision has become a research project, and should be closed or converted deliberately.
Should pilots run on production data?: On the production data path, with appropriate controls. Testing on hand-assembled extracts hides exactly the access, quality and latency problems that block graduation.
Who should approve a pilot for production?: The business owner who funds the run, with a risk or evaluation approver holding a defined veto. If approval requires unanimous agreement across several functions, nothing ships.
What if the pilot works but the benefit is small?: That is a useful result. Close it, record why the benefit was smaller than expected, and let the prioritization model absorb the learning. Scaling a marginal use case to justify the effort is how programmes lose credibility.

Continue

Related intelligence

The main guide on this topic

How do I know if my company is ready for AI?

This page covers one part of the decision. The full NirjiX guide to AI readiness assessment sets out the whole picture.

AI readiness assessment →

Explore

Connected guides

More AI decisions

AI Readiness
AI readiness is an organization's demonstrated ability to move an AI use case from decision to production and sustain it — measured across business intent, data foundations,…
AI Build vs Rent
Rent the capability that is commodity and improving fastest outside your organization — foundation models, general infrastructure, and horizontal productivity tooling.
AI Use Case Prioritization
Score every candidate on four axes: value at stake (the size of the business number it moves), feasibility (whether the process and decision rights allow deployment), data re…

Transparency

Sources and methodology

This page reflects NirjiX advisory practice rather than a survey or a vendor benchmark. The structure of the assessment — the dimensions, the maturity language and the sequencing logic — is the same framework used inside the NirjiX AI readiness assessment and the AI plan builder.

Where we describe patterns ("most organizations discover…"), we are describing what we observe across client engagements, not a measured statistic. We deliberately avoid quoting market numbers we cannot verify, because an AI investment case built on borrowed statistics collapses the first time a CFO tests it.

Any figure that ends up in your own plan should come from your own data: your cost base, your cycle times, your error rates, your volumes. The assessment and plan builder are designed to force that discipline.

Turn the judgement into a plan you can fund

The AI readiness assessment scores where the organization actually stands; the AI plan turns that into a sequenced, costed set of moves.

Run the AI assessment Build the AI plan

Outputs are preliminary and intended for advisor validation before funding decisions.