Tests
A/B tests built from opportunities, deployed to your store, and tracked to statistical significance.
Tests is where opportunities become real experiments. Each test has its own detail page with setup, content (variant code), and analytics.
/screenshots/features/tests-kanban.pngTest status
The Tests page is a kanban board. Tests move through these statuses:
- Idea — the opportunity has been promoted to a test, but no variant has been generated yet.
- Generating — Spar is producing the variant code in the background.
- Draft — variant is generated and being edited.
- Ready — variant is finalized and ready to deploy.
- Running — live on the store, accumulating traffic.
- Paused — temporarily stopped (allocation is frozen but the test isn't finished).
- Completed — finished, with a result attached.
- Cancelled — abandoned before completing.
- Failed — something went wrong (deploy error, missing tracking, etc.).
Drag a card between lanes to update its status.
The three tabs on a test
- Setup — audience, allocation, hypothesis, metric.
- Content — the variant code (HTML, CSS, JS) and any content changes.
- Analytics — sample size, conversion deltas, and statistical significance over time.
/screenshots/features/test-setup-tab.png/screenshots/features/test-analytics-tab.pngHow Spar decides when a test is "done"
Spar uses sequential statistical testing. It monitors significance continuously and flags a winner at 95% confidence — you don't need to pick a fixed duration upfront. A test can also be ended manually any time.
Where tests run
Spar can deploy tests through a few channels depending on what you've connected:
- Shopify (theme app extension) — for Shopify stores.
- GrowthBook — for teams already standardized on GrowthBook.
- Intelligems — for teams using Intelligems for pricing tests.
Configure your default execution target under Settings → Tests.
Orphan suggestions
If you have running experiments on your platform (e.g. GrowthBook) that don't have a matching opportunity in Spar, the Tests page will surface them as orphan suggestions so you can wire them up.
Last updated on