How to Test an AI Chat Widget for Real-Time Stock and Price Questions Before You Install It
Marcus Webb
Implementation Lead
7 min read

Most AI chat demos begin with a friendly question: “What are your shipping options?”
That is not the question that exposes whether an assistant is safe for a store.
Ask instead: “Do you have the navy version in medium, and is it still $79?” Then change the price, mark the variant unavailable, and ask again.
For an ecommerce site, stock and price are moving targets. A knowledge base for a chat widget can explain product ranges, delivery terms, and sizing guidance. It should not be treated as a live inventory system. If you want an ai shopping assistant for website visitors to trust, test that boundary before you install chat assistant on website pages.
Start with the questions that cost sales
Product page questions ecommerce teams see every week tend to be narrow and time-sensitive:
- “Is the walnut desk available for delivery this week?”
- “Does this jacket come in a 34-inch length?”
- “Why does the bundle cost more than the individual items?”
- “Can I add the red version to the cart?”
- “Which of these two models is under $200?”
A generic answer such as “Please check the product page” does not help much. A made-up answer is worse. The useful standard is more demanding: can the assistant find the relevant product, retrieve current catalog facts, and avoid claiming certainty when it cannot?
That is the distinction between a chatbot that knows product catalog descriptions and one that can also check live catalog data.
Separate stable knowledge from live commerce data
Before comparing the best AI chatbot for website use, make two lists.
Stable information belongs in your imported website content, FAQs, pasted text, or files. This includes materials, size guides, warranty terms, shipping rules, product-care instructions, and the reasoning behind which product suits a particular use case.
Changing information needs a catalog connection or a live lookup. This includes stock, variant availability, current prices, promotional pricing, and anything affected by a product update.
A good test prompt includes one of each:
“Is the oak shelf suitable for a bathroom, and do you have the 80 cm version in stock?”
The first half can be answered from a product page or care guide. The second should be grounded in current catalog data. If the evaluator treats both as the same kind of question, they can end up training an AI chatbot on website content and assuming it will stay current on inventory. It will not, unless there is a current catalog feed or a live search mechanism behind the answer.
Build a small but awkward test set
Do not test with 50 easy questions copied from your FAQ. Use 12 to 20 questions that reflect the messages your team hesitates over.
Include these categories:
Exact product and variant requests
Use products with similar names, multiple colours, or different sizes. Ask for a specific SKU-level detail where your store can verify the answer.
Examples:
- “Show me the black 42 mm version under $150.”
- “Is the medium green hoodie available, not the large one?”
- “Which refill fits the older machine?”
Price changes
Pick a product whose price you can change in a staging catalog or test data. Ask before and after the change. The result should not keep repeating the old value.
Out-of-stock and discontinued items
Ask about something unavailable. The assistant should not redirect shoppers toward a dead end with false confidence. A reasonable answer may identify alternatives only if the available catalog data supports that suggestion.
Ambiguous requests
Try the way actual visitors write:
- “Need one for a small balcony.”
- “The cheaper waterproof one.”
- “Can I get it before Friday?”
These reveal whether the assistant asks a useful follow-up, finds a relevant product, or overcommits.
Questions it should refuse to guess
Add at least three questions with no reliable source. For example: “Will the blue one definitely restock next Tuesday?” If your data does not contain a confirmed answer, the right behavior is an honest fallback, not an invented date.
Test live catalog search, not just product-page retrieval
Live catalog search matters when visitors ask for something that changes between crawls, imports, or product edits. It can look up products by phrase, price, sorting, and similar constraints, including current availability when your search endpoint provides it.
That is useful for an ai product finder on online store pages because shoppers rarely phrase requests as exact catalog titles. “A linen shirt under $90 in medium” is a search request, not a support article question.
Ask a prospective provider these practical questions:
- Can the assistant query a custom endpoint for the live product lookup?
- What fields does the endpoint need to return for stock, price, variants, images, and links?
- What does the chat say when the endpoint has no match or cannot confirm availability?
- Can the store keep control of the add-to-cart action rather than letting chat invent checkout behavior?
With Owni, a catalog can be connected so the assistant can show product cards in chat with an image, price, and an add-to-cart button that fires the site’s own JavaScript. Its newer live catalog search capability supports a custom REST API search endpoint for real-time catalog lookups, including stock availability. That is only as reliable as the endpoint and catalog data you supply; no product feed means no product cards or live catalog answers.
A field test I now insist on
During a rollout for an anonymized home-goods storefront, we tested 14 customer-style prompts before the widget went live. One prompt asked for a “natural wood shelf, 80 cm, suitable near a sink.”
The first pass found the right shelf description but could not distinguish the 80 cm option from the 60 cm variant. The product information was accurate enough for browsing, but not specific enough for a purchase decision. We added variant-level catalog data to the test and repeated the prompt after marking the 80 cm version unavailable.
That one change exposed the real requirement: the chat needed to explain suitability from the product content while getting availability from the catalog lookup. Treating either source as complete would have produced a confident but flawed answer.
The detail was mundane, which is exactly why it mattered. Most bad chat answers are not dramatic failures. They are one wrong size, one stale price, or one product recommendation that sends a visitor to an unavailable item.
Check the handoff path for unresolved questions
A chatbot handoff to human is not a fallback for poor setup; it is part of an honest buying experience. Test what happens when a question needs a person, such as a trade quote, a delivery exception, or a restock commitment.
In hybrid mode, the AI can answer from the available knowledge and hand harder cases to the shared team inbox. Make sure the human sees the prior conversation rather than asking the visitor to start over. Also test the after hours customer support chat experience: does the widget make clear when people are offline, and does it avoid promising a response time you cannot meet?
If your aim is to reduce support tickets website-wide, the first target should be repeatable questions with documented answers. Do not force the assistant to adjudicate discounts, delivery guarantees, or special-order decisions without dependable data and a human route. Chat transcripts can also reveal which policies and pages create avoidable questions.
Compare installation effort after the answer test
When people search for a Tidio alternative or an Intercom alternative for small store use, pricing and interface matter. But the operational comparison is usually simpler: how quickly can you connect the knowledge, test catalog truth, and fix an answer after launch?
For a basic deployment, the widget should be easy to add without affecting the page. Owni uses one asynchronous script tag before the closing </body> tag, loads after the page renders, and has an install checker to confirm it is live. The script can be installed manually on WordPress, Shopify, React, Next.js, or plain HTML sites; plugins for WordPress and Shopify are not required for that route.
For catalog-aware chat, the work is not the script tag. It is preparing clean product identifiers, variant fields, current price data, availability rules, and a few deliberately difficult test questions. That is the part to schedule before you add live chat to website pages.
Run the 12-question test against real catalog conditions, change one price and one availability state, and record every answer that sounded certain without evidence. Those are the answers to fix before the chat bubble meets a shopper who is ready to buy. Use unanswered chat questions to prioritize the missing content after launch.
FAQ
Prepare the content you want it to answer from, such as FAQs, product pages, shipping policies, and uploaded documents. For live price or availability questions, also prepare a current catalog feed or a live catalog search endpoint. Finally, write a short test set based on real visitor questions.
Adding the widget script itself can take about two minutes: place one asynchronous script tag before the closing body tag and use the install checker to confirm it is live. Preparing knowledge sources, catalog data, and testing answers usually takes longer and should be treated as the main launch task.
Not reliably. Imported pages and knowledge-base content are useful for stable information, but stock and prices can change. Real-time answers require a current catalog connection or a live lookup that returns the relevant availability and price data.
It should say it cannot confirm the answer rather than inventing one. A well-configured setup can offer a human handoff for cases that need staff confirmation, especially for restocks, special orders, or delivery exceptions.