What a CFO Should Ask Any AI Commerce Vendor
Before you sign, ask how impact is proven, who owns the checkout and the customer data, and whether the fee tracks incremental revenue. A CFO's checklist for AI commerce vendors.
Before you sign with any AI commerce vendor, you should be able to get clean answers to a short list of questions in a single meeting. The best vendors answer them plainly; the ones to avoid deflect on how impact is proven, who owns the checkout and the data, and whether their fee tracks revenue you would have earned anyway. Here is the due-diligence checklist a CFO can run before committing budget: six questions, and what a good answer sounds like.
1. How do you prove impact, attribution or a holdout?
Attribution counts every order the AI-powered shopping assistant touched and calls it results. That is an activity measure, not proof of cause. The only way to know what the assistant actually added is to compare shoppers who saw it against a randomized control group who did not, on your own traffic.
What to listen for: a permanent, randomized holdout, a share of visitors held out before any engagement, not a one-off pilot, a reference customer's screenshot, or a dashboard that claims credit for every touched order. Querytail ships a native holdout with every deployment; incremental revenue is the measured gap between the two groups on your traffic, not a number we assert.
2. Who owns the checkout, the customer data, and the customer relationship?
Some vendors route the transaction and the shopper through their own environment, then rent the relationship back to you. Ask exactly where checkout happens, who is merchant of record, where customer and conversation data live, and whether you can export all of it on demand.
What to listen for: checkout on your storefront, you as merchant of record, and customer data under your control. With Querytail the assistant runs on your site, checkout stays yours, and the customer and conversation data stay yours, as the product overview lays out. If a vendor owns the checkout, they own the customer, and you become a supplier on your own store.
3. Does the fee track incremental revenue, or do we pay for activity we'd have gotten anyway?
This is the question most vendors hope you won't ask. If the fee is calculated on every assisted order, you are paying for baseline sales that would have closed without the assistant. Ask what the billing base is and, critically, whether the vendor separates that billing base from the proven incremental lift.
What to listen for: a vendor that draws the line clearly. Querytail bills on ANR (Assisted Net Revenue), the net revenue of orders the assistant assisted, and treats it as exactly that: a billing base, not proof of impact. The incremental portion, the part that would not have happened without the assistant, is measured by the holdout and is never itself the pitch. Because the holdout runs continuously, you can always see what share of what you pay for was genuinely incremental.
4. What is the lock-in and data-portability story?
Ask what your first day after cancellation looks like. Who keeps the structured product data, the conversation history, the enriched catalog? Can you export it in an open, usable format, or is it trapped in a proprietary schema that makes leaving a migration crisis?
What to listen for: contractual data portability, exports in open formats, and no hostage-taking of your catalog or customers. Low lock-in is a direct consequence of ownership: because Querytail keeps your data and your checkout yours, leaving is a switch, not a rebuild. Be suspicious of any vendor whose retention strategy is making it painful to go.
5. What are the brand-safety guardrails on what the assistant can say?
An assistant that can say anything will eventually say something wrong, off-brand, or non-compliant. Ask what constrains its answers: does it respond only from approved product data, can it invent claims or prices, who controls tone, and is every answer logged for review?
What to listen for: answers grounded in approved data, brand-voice control you own, and an audit trail. Be wary of anyone promising "zero hallucinations" or "guaranteed accuracy"; that is not how language models work, and the claim itself is a warning sign. The honest answer describes how errors are constrained and caught. Querytail grounds the assistant in your approved product data, keeps brand voice in your hands, and governs and logs every response.
6. On GEO and AI visibility, are you selling readiness, or over-promising placement?
AI search is a real discovery channel: ChatGPT, Gemini, Perplexity, and Amazon's Rufus (renamed Alexa for Shopping in May 2026) increasingly recommend products inside the conversation. But no vendor controls how those engines rank or cite. Ask whether they make your catalog eligible and machine-readable, or promise placement.
What to listen for: "we make you eligible and readable" is the honest pitch; "we guarantee you'll be mentioned, ranked, or sent traffic" is a red flag, and reason to walk away. Querytail structures your catalog to be GEO-ready and is explicit that placement is never guaranteed. We are not a GEO agency selling rankings; we make your products readable to the engines and let the measurement speak.
FAQ
Isn't assisted or attributed revenue enough to prove ROI? No. Assisted revenue, including a billing base like ANR, measures activity the assistant was involved in. It cannot tell you what would have happened anyway. Only a holdout isolates the incremental revenue that justifies the spend.
Can a vendor guarantee we'll show up in ChatGPT or Rufus? No, and you should treat the promise as a red flag. GEO is about eligibility and readiness, not guaranteed placement. Anyone promising rankings, mentions, or AI traffic is selling something they do not control.
What's the single most revealing question? "Who owns the checkout and the data, and how do I leave?" It exposes lock-in, ownership, and, indirectly, how confident the vendor is that their incremental value will keep you.
Want to run this checklist against a live system? Book a walkthrough and we will answer every question here against your own traffic and catalog, or apply to the Design Partner program to build the measurement plan with our team.
Related Articles