Ask About Your Learnings

Learn how to ask questions about a website's learnings, what the assistant reads, how it quotes figures and cites tests, and its limits and costs.

3 min read


Ask about your learnings is a chat about a website's tests, docked beside the Learnings page. Use it for the questions the page prompts: what has worked on a page, why two tests disagree, what to try after a surprise.

Asking a question

Type in the Ask about your learnings field in the row above every view. The chat opens beside the page, whichever view you are on.

The first time, you accept a notice before you can ask. You accept it once.

What it reads

  • The Learnings page, as code built it: the headline, up to the 300 newest learnings, the patterns with their evidence levels and the tests behind each, which patterns share their tests, your team's Mark as known and Not useful feedback, and up to 12 open opportunities. The figures are not part of what it reads.
  • Test results, when it needs a figure. It reads a test's results as the Statistics tab shows them by default (Conversions, all currencies, frequentist, Holm-Bonferroni). While it reads, the chat shows, for example, "Reading the results of #5871". It reads up to six tests' results per answer, and can read any test on the website, including running tests and tests without a learning.

How it answers

  • It never produces a number. A measured figure appears only as the test's results gave it.
  • Every test it cites is checked. A test number in an answer is linked only if the assistant actually read that test, so it cannot link a test it made up or one from another website. Click a cited test to open its debrief beside the chat.
  • Older answers are marked. When more learnings have been written since an answer, it is marked as possibly out of date.

One shared conversation per website

  • Everyone who can see the website's learnings can read the conversation and ask, Members included. Each question shows who asked it.
  • One question is answered at a time on each website. If a colleague's question is being answered, yours has to wait.
  • The conversation is kept for 12 months. Older questions and answers are deleted automatically, and the whole conversation is deleted with the website.

Limits

  • A question is 3 to 2,000 characters.
  • Up to 20 questions an hour per person on each website, and 100 a day per website.

AI credits

Each answer uses the account's AI credits, whoever asks. Accounts not on AI credits share one monthly allowance between this chat, Ask about this experiment and the editor's AI assistant. When credits run out, Ask cannot answer until they return. See Learnings and AI Credits.

How it differs from Ask about this experiment

Ask about this experiment answers about one experiment: its result, set-up, brief and debrief. Ask about your learnings answers about the website's tests as a whole. The two read each other: Ask about this experiment reads the website's learnings, and Ask about your learnings reads each test's results the way the Statistics tab shows them.