Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.abtestly.com/llms.txt

Use this file to discover all available pages before exploring further.

Run your first test in 15 minutes

This guide takes you from signup to live experiment. No technical background required beyond editing your site’s HTML.

1. Sign up

Go to app.abtestly.com and create an account. The Free tier includes:
  • 1 site
  • 1 active experiment
  • 3,000 monthly tracked users (MTU)
Enough to validate the platform on a small page or a low-traffic site.

2. Add your site

After signup, click Add site and enter your domain (e.g., example.com). You’ll get a unique snippet code generated specifically for that site.
Each site needs its own snippet — they’re cryptographically tied to one domain. If you run acme.com AND blog.acme.com, add them as two separate sites and install the matching snippet on each.

3. Install the snippet

Copy the snippet code from your dashboard. Paste it into the <head> section of your HTML, as the first script tag, before any other JavaScript:
<head>
  <!-- ABTestly snippet — must be first script in head -->
  <script>!function(){/* your unique snippet */}();</script>

  <!-- Your other scripts come after -->
  <script src="https://www.googletagmanager.com/gtm.js?id=..."></script>
</head>
The snippet must load synchronously and before other scripts to prevent flicker. Don’t use async or defer. Don’t load via Google Tag Manager. See Snippet install for details.

4. Verify installation

Open your site in a fresh browser tab. Open DevTools (F12) → Console:
window.__ABTESTLY_CONFIG__
You should see an object with your site ID and config version number. If it returns undefined, the snippet didn’t load — check the snippet install guide.

5. Create your first experiment

In the dashboard, navigate into your site and click New experiment. The pipeline editor walks you through six steps:
1

Basics

Name, hypothesis, and the primary metric you’ll measure.
2

Locations

Which URLs the test runs on. Pick a saved Location or define rules inline (e.g., URL starts with /pricing).
3

Audiences

Who’s eligible. Filter by country, device, UTM, cookies, or any combination. Or leave blank to target everyone.
4

Variations

The original (control) and your variant(s). Each variant is a chunk of custom JavaScript and/or CSS that gets injected on matching pages.
5

Goals

Conversion events to track. Page visits, clicks, engaged sessions, or custom events fired via JavaScript.
6

Review & start

The pipeline shows green check marks once each step is complete. Click Start experiment when ready.

6. Start the test

Click Start. The new config propagates to all Cloudflare edge locations within ~60 seconds. Visitors start seeing variants based on their deterministic bucket assignment.

7. Watch results

The dashboard shows real-time exposures, conversion rates per variant, and statistical significance (95% / 99% confidence flags). Most tests need at least 5,000 exposures per variant to reach 95% confidence — plan your test runtime accordingly.

Next steps