Skip to main content
Phil Therien - 

What a CTO Does With AI That a Consultant Won't

8 min read
What a CTO Does With AI That a Consultant Won't

Most companies asking for an AI strategy are not actually asking for a strategy. They are asking for something they can show a board, a client, or an investor to prove they are not falling behind.

That is a legitimate need. But it is a different problem than building something that works.

A consultant solves the first problem. A CTO solves the second one.

The Difference Is Accountability

When a consultant delivers an AI strategy, their job is done. What happens next is your problem.

When a CTO builds an AI strategy, they are still in the room when it breaks, when the vendor overpromises, when the team pushes back, and when the timeline slips. That changes every decision they make.

This is not a knock on consultants. It is a structural reality. Accountability shapes judgment.

A consultant is paid to produce a defensible recommendation. If the recommendation was reasonable given what was known at the time, they did their job, even if the project fails. A CTO is paid for the outcome. They have to live with the architecture they chose, the vendor they signed, and the estimate they gave the board. So they hedge differently, sequence differently, and say no far more often. Same question, different incentives, different answers.

What a CTO Actually Does With AI

They start with your codebase, not the market.

A consultant's strategy starts with what is possible. A CTO's starts with what you have. That means looking at your actual data infrastructure, current workflows, and team capabilities before recommending anything. AI built on a broken foundation does not fix the foundation. It makes it harder to see. This is why serious AI work usually begins with something like an engineering audit: you cannot sequence a roadmap around technical debt you have not mapped.

They filter the noise.

The AI vendor landscape is loud. Every tool claims to be transformative. A CTO applies technical judgment, not market enthusiasm. According to McKinsey's 2025 State of AI report, 88% of companies now use AI in at least one function, but only 39% see any meaningful financial impact. The gap between adoption and results is a judgment problem, not a tooling problem.

They protect you from expensive mistakes.

The most valuable thing a CTO does in an AI strategy conversation is say no. No to tools that create IP exposure. No to integrations that will require a rebuild in 18 months. No to automating processes that are broken and should be fixed first. According to RAND Corporation, over 80% of AI projects fail, twice the failure rate of non-AI technology projects. Most of those failures were avoidable with the right technical judgment early.

They write a roadmap the team can actually execute.

A strategy your engineering team cannot execute is a document, not a plan. A CTO writes the roadmap with real capacity in mind: who owns what, where you need to hire, and how long things actually take.

The AI Decisions a CTO Actually Owns

"Do AI" is not a decision. It is a category of decisions, and each one has a wrong answer that costs real money. These are the calls a CTO makes and stands behind, and the ones a strategy deck typically leaves to whoever reads it:

01

Build, Buy, or Wait

Build when the workflow is core to how you win and no vendor covers it. Buy when the problem is generic and switching costs are manageable. Wait when the capability is improving so fast that anything you build this quarter is commoditized next year. Each answer is defensible somewhere. Picking the wrong one for your situation is the expensive part.

02

Model and Vendor Selection

Which model family, which provider, hosted or self-managed, and what the exit path looks like if the vendor raises prices or degrades quality. A CTO designs for substitution from day one, because betting the workflow on a single provider with no abstraction layer is how lock-in happens.

03

Data Readiness

Whether the data the use case depends on actually exists, is clean enough to use, is legally usable for this purpose, and is accessible without a six-month integration project. Most AI roadmaps quietly assume yes on all four. A CTO verifies before committing a timeline.

04

Cost at Scale

A pilot that costs $200 a month can cost thousands a month in production once every user touches it. Inference cost, context size, and call volume compound. A CTO models the unit economics before launch, not after the first invoice.

05

Where AI Touches Customers

Internal drafting tools can tolerate errors. Customer-facing outputs, pricing decisions, and anything with legal or financial consequences cannot. A CTO decides where human review is mandatory and designs the workflow around that line, instead of discovering it after an incident.

06

Kill Criteria

Before a pilot starts, a CTO defines what success looks like, what failure looks like, and when the project gets shut down. Pilots without kill criteria do not fail. They linger, consuming budget and attention indefinitely. Killing a weak project early is a result, not an embarrassment.

Consultant vs Fractional CTO: What You Actually Get

Both can be the right call. The point of the comparison is not that one is good and one is bad. It is that they are different products, and buying one when you need the other is where budgets go to die.

DimensionAI ConsultantFractional CTO
Primary deliverableA strategy document and recommendationsDecisions made, shipped, and owned
AccountabilityEnds when the engagement endsContinues through execution and results
IncentiveA defensible recommendationAn outcome they have to live with
Relationship to your teamInterviews them as stakeholdersLeads them through delivery
Vendor conversationsMarket landscape and shortlistsNegotiates terms, owns the exit plan
When something breaksOut of scopeTheir problem to fix
Time horizonWeeks, then handoffQuarters, embedded part-time
Best fitYou have strong technical leadership and want outside validation or market researchYou have no senior technical owner and decisions are stalling

What This Looks Like in Practice

AI Readiness Assessment

Before any roadmap gets written, a CTO looks at where AI has a real ROI in your specific workflows. They audit your security and IP exposure. They identify what is a 4-week build versus an 18-month one. A Gartner study found it takes an average of 8 months to go from AI prototype to production. Knowing what you are actually getting into before you start is not optional.

A Sequenced Roadmap

Not a list of AI initiatives. A plan that accounts for dependencies, team capacity, infrastructure gaps, and the things that need to be fixed before AI can do anything useful on top of them. McKinsey found that organizations reporting significant financial returns are twice as likely to have redesigned workflows before selecting their AI tools.

Board-Ready Communication

When your board asks about AI, they are asking two things: are we falling behind, and what is the risk? A CTO answers both with specifics. Not slide deck language.

This is the shape of a structured AI readiness engagement: assessment first, sequencing second, communication throughout. The order matters. Roadmaps written before the assessment inherit every wrong assumption the assessment would have caught.

An AI-Readiness Check You Can Run This Week

You do not need an engagement to get a first read on whether your company is ready to put AI into production. Five questions cover most of it. Answer them honestly with your team in a room:

The Five Readiness Questions

  • Data: Can we get to it?

    Where does the data this use case needs actually live, who controls access, and is it clean enough to use without a remediation project first? If nobody can answer in one meeting, that is your answer.

  • Infrastructure: Can we plug it in?

    Do your systems expose APIs, or does every integration mean touching a legacy core nobody wants to modify? AI value comes from being wired into workflows, not from a chat window on the side.

  • People: Who owns it after launch?

    Name the person who maintains this in month six, when the model drifts or the vendor ships a breaking change. If the answer is the consultant who left, you are not ready.

  • Security: What leaves the building?

    Which data crosses into third-party models, under what contract terms, and with what retention? If no one has read the vendor's data processing terms, exposure is being accepted by default.

  • Process: Is the workflow worth automating?

    A messy, exception-heavy process automated is a messy, exception-heavy process that now fails faster. Fix the process or accept the exceptions consciously before layering AI on top.

Two or more weak answers means the first phase of your AI roadmap is not an AI project at all. It is data work, integration work, or process work. A CTO will tell you that plainly, because they are the one who has to build on top of it. A consultant is structurally tempted to scope the exciting part.

How AI Projects Fail Without Technical Ownership

The failure rate numbers above are abstract until you see the mechanisms. These are the patterns that show up again and again in companies that bought advice but not ownership:

Pilot purgatory.

The demo works. Everyone is impressed. Then production requirements arrive: error handling, permissions, edge cases, latency, monitoring, cost controls. Nobody scoped them, because the strategy stopped at the use case. The pilot neither ships nor dies. It just sits there, cited in board decks as progress.

Automating the broken process.

A workflow that produces bad outcomes slowly now produces bad outcomes at machine speed. AI amplifies whatever process it is attached to. Without someone accountable for the process itself, automation locks the dysfunction in.

Building what you should have bought.

Six months and two engineers spent on an internal tool that a configured off-the-shelf product would have delivered in three weeks. The reverse failure exists too: buying a rigid platform for a workflow that is your actual competitive advantage, then contorting the business around the vendor's roadmap. Both are build-vs-buy calls made without a technical owner weighing them.

Lock-in nobody priced.

The pilot vendor becomes the production vendor by inertia. Two years later the per-seat price has doubled, the data is in a proprietary format, and migration costs more than the original project. Exit paths are designed at the start or not at all.

Orphaned systems.

The engagement ends, the system stays. Models drift, prompts rot, upstream data schemas change, and output quality decays quietly because nobody is measuring it. An AI system without an owner and without evaluation in place is not an asset. It is a slow-motion incident.

Governance, Security, and Data: The Unglamorous Part

This is the section most AI strategy decks compress into one slide, and it is where companies get hurt. A CTO treats governance as architecture, not paperwork, because they are the one who answers for the incident.

  • Data boundaries

    An explicit ruling on which categories of data may be sent to which external models, and under what contract terms. Customer PII, source code, financials, and health data each need their own answer, not a blanket policy.

  • Human review where consequences live

    A defined line between AI outputs that ship automatically and outputs that require a human sign-off. Pricing, legal language, and anything customer-facing usually sit on the reviewed side of that line.

  • Logging and auditability

    When an AI-assisted decision is challenged, you need to reconstruct what the system saw and produced. If inputs and outputs are not logged, you cannot. Retrofit logging is far more expensive than designing it in.

  • Vendor terms that are actually read

    Training rights on your data, retention windows, subprocessors, and breach obligations. Someone technical has to read these before signature, because sales calls will not volunteer the uncomfortable clauses.

  • An incident plan for model failures

    What happens when the model produces something harmful or wrong at scale? Who can turn it off, how fast, and what is the fallback workflow? If the answer is improvised, the incident writes your policy for you.

Regulation is moving in the same direction. The EU AI Act is phasing in obligations for companies deploying AI systems, and customers increasingly ask about AI data handling in security questionnaires. Governance done early is a sales asset. Done late, it is a remediation project.

How to Tell You Need Ownership, Not Advice

Advice is the right purchase in specific situations: you already have a strong technical leader and want an outside check on their thinking, or you need a narrow market scan of vendors in one category. If that is you, hire the consultant and spend the difference on execution.

The signals that you need ownership instead are consistent:

  • You already have a strategy deck, possibly two, and nothing has shipped from either.
  • The board asks about AI and nobody in-house can answer with specifics about your data, your costs, or your risk.
  • Pilots keep starting and stalling, and no one can say precisely why.
  • Your engineers quietly disagree with the strategy but were never in the room when it was written.
  • AI spend is growing every quarter while its measurable impact stays unclear.
  • The same build-vs-buy decisions keep getting reopened because nobody with authority made the call.

Three or more of these is not a strategy gap. It is an ownership gap, and another document will not close it.

When You Do Not Have a Full-Time CTO

You do not need a full-time CTO to get this right. You need someone with the technical judgment and the accountability to make real decisions.

A fractional CTO or interim CTO can run your AI readiness work, build the roadmap, and stay engaged long enough to make sure it actually lands. Only 1% of companies describe their AI strategy as mature, according to McKinsey. The gap is not ambition. It is ownership.

The practical difference between the two: fractional is ongoing part-time leadership, a few days a week across quarters, which fits AI work well because the decisions arrive continuously. Interim is full-time coverage for a defined gap, usually while you search for a permanent hire. For AI specifically, most companies need the fractional shape: enough seniority to own the decisions, without the cost of a full-time executive the workload does not yet justify.

Conclusion

The companies doing interesting things with AI are not the ones who hired the best AI consultants. They are the ones who had someone technical enough to separate real opportunities from noise, and accountable enough to see it through.

If your board is asking about AI and no one in-house can answer with specifics, that is the actual problem to solve. If you want to talk through what ownership would look like for your company, get in touch.