Growth tests prices. Engineering gates releases. Data joins assignments to the warehouse. Same API, same statistics, different levers.
Annual-first vs monthly-first plan display, measured on revenue per visitor and 30-day churn. The winner ships itself once both clear.
1% → 5% → 25% → 50% → 100%, with p99 latency and error rate as guardrails. A regression rolls it back before a pager goes off.
Each funnel step is its own metric. Crawltic reports where variant B wins, where it leaks, and whether the lift survives to activation.
Every assignment streams into Snowflake, BigQuery, or Redshift. Join on user id and model lift with the SQL you already trust.
Open rate is a proxy. Crawltic follows each send through to purchase and picks the subject line that actually earns.
Cache policy, CDN routing, connection pooling. Latency, hit ratio, and cost per request are metrics like any other.
Quantaloop split pricing-page traffic between monthly-first and annual-first framing. Crawltic scored both on revenue per visitor and 30-day churn, then promoted annual-first after 11 days.
HoloStack gates every backend release behind a staged ramp. When p99 latency crosses the guardrail, Crawltic drops the variant to 0% and posts the incident, usually before anyone notices.
PixelForge's product team tests onboarding copy, layout, and step order straight from their feature branches. Results come back through the API into the internal tools they already use.
LatticeWorks streams every assignment and event into Snowflake, then joins them with billing and product data. Their analysts model experiment impact with the same SQL and dbt models they use for everything else.
Vellum's lifecycle team runs every campaign as an experiment. Crawltic follows each send and each landing-page visit through to purchase, and the Bayesian posterior shows how sure they can be.
Orbital's infra team tested stale-while-revalidate against a short TTL across their edge fleet. Variant B held a 94% hit ratio and cut p99 by 73%, verified with the same rigor as a product test.
Three steps. Every team above follows the same path.
One CLI call defines variants, the primary metric, and the decision rules: crawltic experiments create.
Your app calls /v1/assign on page load and /v1/events whenever revenue occurs.
Once quotas and confidence clear, Crawltic promotes the winner and fires a webhook to your deploy pipeline.
Tell us which team is testing first and we will map the setup with you.