← Case studies & research

Answer accuracy · Local commerce

One delivery question. Two different AI answers.

A delivery-policy review found conflicting AI answers to a purchase-critical question. The useful next step was to clarify the service facts before writing more content.

Study type
Anonymized research
Observation date
Scope
6 questions · 1 round
Current stage
Diagnosis complete · policy confirmation pending
ANSWER ACCURACYRESEARCH NOTE
Same need. Different conditions.
6
buyer questions
12
captured AI answers
1
test round
Confirm the policy → reconcile pages → retest
Summary of recorded observations · 2026-10-12

The useful finding

Being mentioned is only useful when the buying conditions are accurate.

ChatGPT and Gemini gave different answers about same-day delivery for the same destination. The source pages also described different service conditions.

01

The buying problem

For a local retailer, a delivery promise can determine whether a buyer proceeds. We checked both non-brand discovery questions and questions about the retailer's advertised service conditions.

02

What we checked

Six questions were checked in fresh, anonymous ChatGPT and Gemini sessions, once per platform. The review retained 12 full answer records and compared relevant statements with website policies.

This was an English-language diagnostic. Model versions were not fully exposed, location was not controlled, and no repeat round or real order was completed.

03

What the evidence showed

On one delivery question, one assistant rejected same-day service while the other described a prepaid same-day option and a slower general policy. Different website pages advertised different conditions, so the real policy needed confirmation.

The brand or associated candidates appeared in several discovery answers. A claim that the business was completely invisible would have misrepresented the evidence.

04

The recommended change

Make one service-policy table the reference for every relevant page, then rerun the original questions.

  • Confirm coverage by postcode, service level, payment method and order cutoff.
  • Reconcile general policies, local pages and FAQs against that confirmed table.
  • Repeat the same questions in two further rounds and record both accuracy and mentions.
05

Where the work stands

The diagnosis and delivery draft were completed. Service-policy confirmation, website implementation and repeat testing were still pending in the source record. No increase in traffic, orders or AI recommendations has been measured.

Evidence & boundaries

Based on retained answer text and website-source records. This public version uses paraphrases and omits identifying details; it does not reproduce private conversations or screenshots.

An anonymized diagnostic, not a paid-client testimonial. One round cannot establish answer stability, actual delivery availability, revenue loss or the cause of the disagreement.

Public summary published . Findings refer to the dated observations above.
Next stepConfirm the service policy, reconcile the pages, then repeat the original question set.Check your own website →Explore the other cases →
Contact
Contact molthubWhatsApp+86 158 6378 9235Emailchengzhao640@gmail.com