Getting Started with Learnings

Learnings reads your finished A/B tests and tells you what they taught. It also shows which kinds of change tend to work on your website, and which questions are worth testing next. AI writes the words and runs its analysis on figures that Pertento's statistics have already computed. Every number you see comes from the statistics, never from the AI.

Learnings works per website. It reads one website's tests and nothing else, and never compares you with other websites or other customers.

Where you find it

• Experiments → Learnings. The main page. It shows the setup screen until learnings are on, then three views: Learnings, Evidence and Opportunities. See Reading the Learnings Page.
• The Library. Each finished test's row shows its learning once it has been written.
• A draft's hypothesis. Similar past tests appear under the hypothesis while you write it.
• Ask about this experiment. The assistant on an experiment's page reads the website's learnings when it answers. See Asking AI about an experiment.

Before you start: the foundation check

The setup screen opens with the foundation check. For every finished test on the website, it shows which of five things the test has written down: a hypothesis, notes, an expected mechanism, a PXL score and a debrief.

None of them is required. A test with gaps still counts, because a missing hypothesis does not change what the test measured. Filling the gaps makes its learning sharper: without an expected mechanism a test cannot join the mechanism patterns, and without a debrief its learning has no team's read beside it. If you turn learnings on while some tests have gaps, Pertento asks you to confirm.

The foundation check only reads what is already there. It works before learnings are on and uses no AI credits.

Turning learnings on

Learnings is off by default on every website. An Admin or Owner turns it on, either from the setup screen on Experiments → Learnings or in the website's settings.

• Tests that finish from now on. Turning learnings on covers tests that end from that moment. Nothing is written for older tests until you ask, so one click never spends a whole history's worth of AI credits.
• Past tests, when you choose. To include tests that finished earlier, confirm Write learnings for N tests. Pertento shows an estimate of the AI credits first. You can do this on the setup screen, or later in the website's settings.
• Read screenshots. On by default. It lets the AI look at screenshots of each variant, which makes a learning more accurate and costs more credits. Turn it off for cheaper, less specific learnings.

Learnings uses your account's AI credits. See Learnings and AI Credits.

While the first learnings are written

Right after you switch on, the page shows the tests waiting to be read. There is no progress bar, because Pertento works through a few tests at a time.

• Each test is read an hour after it ends, once its final statistics are in.
• If someone edited the test's debrief in the last 15 minutes, Pertento waits, so the learning includes the finished debrief.
• Learnings appear within minutes to an hour. A large batch of past tests takes longer, because they are written a few at a time.

In the Library, a line such as "Writing learnings: 12 of 40" shows how far along it is.

Turning learnings off

Turning learnings off stops new learnings and keeps the ones already written. If you turn it on again, it covers tests that finish from that moment, as before.

Who can do what

• Everyone on the website, Members included, can read learnings, use Ask about your learnings, mark a pattern as known or not useful, and dismiss an opportunity. Ask uses the account's AI credits, whoever asks.
• Roles that can create experiments can also use Draft experiment, Mark reviewed and Tracking is fixed, include it.
• Admins and Owners turn learnings on and off, write learnings for past tests, and change Read screenshots and the contribution settings.

Anyone else sees the switches, but cannot change them. See Roles and Permissions in Pertento.

Language

Learnings are always written in English, whatever language your website or your tests are in. Patterns group tests across the whole website, and one language keeps one label for one idea.

Product tours

The product tours on the Learnings page cover the setup screen, the waiting screen, each view, a pattern and a test's debrief.