Seven questions every AI tool vendor should answer before you renew
A practical checklist for your next vendor review: the questions that separate "the team loves it" from "the team is paying for it and quietly ignoring it."
Colin Cardwell
Your AI tool vendor has a smoother renewal conversation than you do. That's because they've had the conversation more times.
Every AI tool vendor's renewal playbook looks similar: show up a month out, walk through a pre-baked "success story" deck, ask if there's anything to iron out, and put the contract in front of you before the quarter closes. The deck is glossy. The numbers are flattering. The default action is to renew.
It's your job to make that default harder. Below are seven questions that separate the tools your team genuinely uses from the ones you're paying for out of inertia. Ask them at renewal (in writing if you can) and see which vendors answer crisply and which ones pivot to a demo.
1. What's our real adoption rate?Link to this section
Not "licensed seats". Not "sign-ups". The percentage of our licensed seats that have an active, sustained usage pattern, ideally measured weekly over the last quarter.
Any vendor's admin portal can show you this, but the number on the deck will often use the softest definition available (logged in once, or account activated). Pin them down on "at least one meaningful session per week for the last 8 weeks" and watch what happens to the number.
2. What's our hours saved per active user per week?Link to this section
Normalised. Total hours saved is impressive but meaningless: 500 hours saved in a 10-person team is stellar, 500 hours in a 500-person team is a rounding error. The comparable number is hours saved per active user per week.
As a rough starting point: under an hour a person a week is disappointing, two to three is healthy, and five or more is exceptional.
3. Which features are being used, and which are ignored?Link to this section
Good vendors can tell you. Great vendors can show you a breakdown by seat. This matters for two reasons:
- If 80% of your usage is one feature that other tools also do, you're paying for a premium suite to get commodity value. There may be a cheaper tool.
- If a feature the vendor charges extra for is sitting unused, you have something to negotiate with at renewal. "You're charging us for feature X and the data shows nobody's touching it. Either show us its value or drop the price."
4. How does our usage compare to similar organisations on your platform?Link to this section
Benchmarks are the single piece of data the vendor has that you don't. They see across hundreds of customers. Ask them where you sit. Are your power users above or below average? Is your adoption curve trending like healthy customers' or like customers about to leave?
Good vendors have this data ready. If a vendor says it doesn't share aggregate data, ask why; the answer tells you something either way.
5. What onboarding and enablement are you committing to this renewal?Link to this section
Renewals aren't passive. The tools that thrive in your organisation thrive because someone (often the vendor's customer success team, ideally) keeps reintroducing them to new hires, new teams and new uses. Many vendors give you white-glove onboarding in year one and leave you to fend for yourself afterwards.
Ask what they're committing to in year two onwards. Regular learning sessions? Monthly lunch-and-learns? A dedicated customer success contact? Feature-release walkthroughs? If they can't name a specific deliverable, you'll be paying the same price for significantly less support.
6. What's your roadmap for the issues our team has flagged?Link to this section
This assumes you know what your team has flagged, which is where a measurement tool like The GAiGE or a well-run quarterly retro proves its worth. If you can walk into the renewal with a list of specific, dated complaints from your actual users, the vendor has to engage with them.
Watch carefully how they respond. "That's on the roadmap for Q3" is fine. "That's interesting feedback, we'll look into it" is a brush-off. "No one else has raised that" is either untrue, or a sign your team uses the tool differently, in which case it's on the vendor to solve.
7. If we cancelled today, what would we lose?Link to this section
The single sharpest question. It makes the vendor spell out the specific value that would disappear from your team's week if the tool vanished overnight.
A good vendor will have an answer involving specific workflows and specific outcomes: "Your engineering team is saving about 6 hours a week on code review. Your marketing team generated 40 campaign variants last month they wouldn't have otherwise."
A struggling vendor will give you a feature list. Features are inputs. Outcomes are what you're paying for.
The licence is only part of what a tool costs: What does AI cost beyond the licences? sets out the rest, and Who should decide which AI tools are used? covers whose call the renewal is.
A note on attitudeLink to this section
Good vendors want these questions: they're selling to senior buyers who already ask them, and if you don't, they have to guess what matters to you. Asking them clearly and early improves the renewal conversation for everyone, and it moves the conversation from the vendor's deck to your own team's experience.
If you're comparing your team's answers with vendor claims, The GAiGE is built for exactly this job.
Colin Cardwell
Founder of AiGILE and The GAiGE. Colin has spent thirty years designing custom software for tough business problems.
Connect on LinkedIn (opens in a new tab)