Live Insights – Real-Time Experiment Results and Analytics

Pertento provides Live Insights for your experiments, meaning you get real-time performance tracking as the test runs. The platform’s analytics dashboard updates continuously to show how each variant is performing, so you can see results as they happen. Key metrics like conversion rates, uplift percentage, and statistical significance are calculated on the fly, giving you immediate feedback on experiment outcomes. Live Insights help you monitor progress without waiting for the test to conclude, enabling data-driven decisions and quick reactions if needed.

Viewing Experiment Results in Real Time

After launching an experiment, you can access its results in the Pertento Insights or Statistics page (the exact name may be “Statistics”, “Results”, or “Insights” in the Pertento interface). Here’s what you can expect:

• Traffic and Conversion Overview: The dashboard will display the number of visitors exposed to each variant (including control) and how many of those converted according to your defined goal. These counts update in near real time as new visitors participate and conversions occur.
• Conversion Rate: Pertento calculates the conversion rate for each variant (e.g., what percentage of users in that group performed the goal action). You’ll see the conversion rate metric updating live. For example, you might see “Variant A: 5.2% conversion, Control: 4.8% conversion” and these figures will adjust as more data comes in.
• Uplift / Difference: The platform also shows the uplift or difference between the variant and the control. This could be expressed as a percentage increase/decrease in conversion rate or a relative improvement. In the above example, if Variant A is 5.2% vs Control 4.8%, Pertento might display an uplift of about +8.3% for Variant A. This indicates how much better or worse the variant is doing compared to the baseline.
• Statistical Significance: Importantly, Pertento computes statistical significance in real time. It will indicate whether the observed difference is likely due to chance or if it’s statistically valid. This might be shown as a confidence level (e.g., 95% confidence) or a significance status (e.g., “ statistically significant” when a threshold is passed). The platform uses standard statistical tests (such as z-scores or t-tests under the hood) and updates the significance as the experiment collects more data. You may see a visual indicator like a green check or a probability value that grows as confidence increases.
• Graphs and Timelines: Pertento’s Live Insights may include charts plotting conversion rates or cumulative conversions for each variant over time. These visualizations update so you can observe trends (for instance, if one variant started strong but another caught up over time). Real-time graphs help in spotting any anomalies or changes in performance quickly.
• Goal Breakdown (if multiple goals): If you set more than one goal, the dashboard will typically show metrics for each goal separately in real time. You can monitor primary and secondary outcomes concurrently (for example, variant’s impact on sign-ups vs. add-to-cart events).

Utilizing Real-Time Data

• Monitoring Progress: With live data, you don’t have to wait until the end of a test to check results. You can monitor how the test is doing at any point. For example, an hour after launch you can see early conversion stats. This is useful for ensuring the experiment is functioning correctly (e.g., conversions are being tracked, traffic is splitting as expected).
• Making Early Decisions: In some cases, live insights might prompt you to act before the scheduled end of a test. If one variant is performing extremely poorly, you might decide to stop the experiment early to avoid negative impact. Conversely, if a variant is overwhelmingly positive and has already reached clear significance, you might choose to roll out that change to all users sooner. Pertento gives you the data to make these calls responsibly.
• Debugging and Validation: Real-time analytics also help in debugging. If you see zero conversions when you’d expect some, it could indicate a tracking issue or a bug in the variant. You can catch and address such issues quickly with live metrics.
• Sharing Results: Because the results are up-to-date, teams can watch the experiment together in real time (for example, during a marketing campaign or product launch). Pertento’s dashboard can serve as a live report to share with stakeholders, keeping everyone informed of the latest outcomes.

Live Insights empower you with instant feedback on experiment performance. All the critical data – how many converted on each side, which variant is winning, and whether it’s statistically significant – is at your fingertips throughout the test’s run. This transparency builds trust in experimentation, as you can literally see the evidence accumulate. By the time your experiment concludes or reaches a decision point, you’ll have seen the story unfold in real time, making the final analysis straightforward and free of surprises.