Independent AI shopping tests

See what happened on real public buying journeys.

Black Summit Holdings gives independent AI shopping agents realistic buyer objectives. These examples show what the agent understood, what it selected, what reached checkout, and where confusion occurred.

Independent test library

Results first. Evidence attached.

A clean pass is useful evidence. A partial or failed stage is useful evidence too. The purpose is not to hunt for defects; it is to determine whether a real buyer outcome works.

Pass with partial comprehension

Ooni

AI shopper reached checkout with the correct $354 configuration.

The independent agent selected the Ooni Koda 12 and compatible 12-inch Pizza Peel and preserved both through checkout. The journey passed overall, while inconsistent specification labels and a mismatched manual description created avoidable uncertainty.

View Independent Snapshot
Pass

Caraway

AI shopper selected the smaller everyday cookware set and reached checkout at $245.

The agent distinguished Caraway's Daily Duo from the full Cookware Set, selected the Cream configuration, and preserved the intended product, color, quantity, and price through checkout. No material comprehension or transaction failure was established.

View Independent Snapshot
Fail — transaction path

Ruggable

AI shopper found the right rug but could not get it into the cart.

The AI shopper correctly resolved the buyer's rug type, size, washer compatibility, and pad requirements. The intended $535.20 configuration could not progress to checkout because the size control did not visibly update and repeated Add to Cart attempts left the cart empty.

View Independent Snapshot
Pass with partial understanding

Gardyn

AI shopper reached checkout with the appropriate $549 indoor garden system.

The agent selected Gardyn Studio 2 for an apartment and two-person household and preserved the system and free starter set through checkout. The journey passed overall, while exact trial-conversion and default renewal treatment remained unresolved.

View Independent Snapshot
Pass

Shibumi Shade

AI shopper selected the correct lightweight shade and reached checkout at $215.

The agent chose the Mini in Sunset with included Wind Assist for two adults and a cooler. The correct variant, quantity, and price persisted through checkout, although nearby page copy retained some Classic-variant signals.

View Independent Snapshot
Partial

Vacation Inc.

AI shopper reached checkout with an available SPF 50 three-pack at $36.

The agent preserved the selected product and price through checkout. The exact buyer outcome remained partial because the product page contained conflicting SPF copy and did not establish how much product was appropriate for two adults for one week.

View Independent Snapshot

These companies did not commission these assessments. Their inclusion does not indicate affiliation, sponsorship, endorsement, approval, or a business relationship with Black Summit Holdings LLC. Tests reflect a limited point-in-time review of publicly available customer experiences.

Test a buying journey

Find out whether AI shoppers can actually buy from you.

One defined objective is enough to begin the purchase intake.

Purchase Snapshot