Feature availability: This feature is available only with the Wingz Advanced plan. If you downgrade your account to the Wingz Core plan after using Synthetic A/B Testing on the Wingz Advanced plan (including during a free trial), you can still view completed test reports. However, you cannot create, edit, or launch tests. For more information on pricing and plans, see Pricing.
Synthetic A/B testing in Wingify enables teams to validate design hypotheses instantly using Wingz AI-generated personas before committing live web traffic to a standard A/B test.
These personas are artificial, AI-generated users. They're designed to evaluate your control and variation pages the way real visitors might. Each persona reacts based on its defined traits and goals, responding to layout, messaging, and design choices.
By uploading screenshots of your control and variation pages, you can simulate user feedback. This feedback comes from customized synthetic personas and evaluation questions. It helps you assess early directional performance without setup wait times.
Info: Synthetic A/B testing serves as a directional validation tool using AI personas. It does not replace live user traffic testing in Web Experimentation.
Control and variation page screenshots in SVG, PNG, or JPG format.
Note: Remove or blur out any confidential data from your screenshots before uploading. Wingify does not automatically detect or blur sensitive content in uploaded images.
You can stop at any point, and Wingify automatically saves your progress as a draft in the Synthetic A/B dashboard. The dashboard indicates the next step you need to complete.
Info: You cannot edit a previous step while moving through setup. Editing becomes available only once you reach Step 5: Review and Launch.
Note: Running a Synthetic A/B test consumes credits, with the amount depending on your setup choices. For more information, see Manage Wingz AI Credits.
In the left navigation bar, navigate to Wingz > Synthetic A/B.
On the Synthetic A/B dashboard, click Create test.
In the setup wizard under the Screenshots tab:
Click Upload Control Screenshot (or drag and drop) to add screenshots of your control (baseline) design.
Click Upload Variation Screenshot (or drag and drop) to add screenshots of the proposed design.
Click Continue: Select Persona.
Note: In Wingz Core accounts, the Create Test feature is locked because it is available only on the Wingz Advanced plan. To upgrade, click the lock icon , which prompts you to upgrade or contact your account manager.
Personas represent synthetic end-user profiles with defined backgrounds, goals, and traits. Wingify uses these personas to generate synthetic or AI-generated participants who evaluate your uploaded screenshots and answer the evaluation questions you provide.
Select one or more target personas from the Suggested Personas list (for example, UX Insight Specialist, Growth Marketer, or Price-Sensitive Shopper). There's no limit to how many personas you can select. Choose as many as are relevant to the audience segments you want feedback from.
Optionally, to build your own, click Custom Persona at the bottom of the window and add the following details:
Persona Name: A short label (for example, Tech Professional).
Description: The persona's background and goals (for example, A tech professional who stays current with the latest trends and tools in technology).
Key Traits: Comma-separated attributes (for example, Curious, Analytical, Tech-savvy).
Click Create to save the persona.
Note: Creating a new persona costs more credits than reusing an existing one.
Choose questions that the synthetic participants should answer when comparing your screenshots. Wingz uses the participants' answers here to decide the winning variation. So, pick the questions that matter most for what you're testing.
Select from the recommended question prompts:
What is your first impression of this page?
What would you click on first?
What confused you about this design?
How would you complete your main goal here?
To add your own question, click Custom Question, type your text into the field, and confirm.
Set how many synthetic AI participants will evaluate your test using the following steps:
Adjust the count using the numeric input or the + / − buttons.
The panel shows recommended participant ranges to help you pick. Use a smaller count (1–25) for quick validation, and a larger one for deeper analysis on higher-impact pages.
Note: Higher participant counts increase credit usage. For example, a test with 20 existing personas costs approximately 50 credits. If the personas need to be created first, the test costs approximately 80 credits.
Once a test completes, the results are stored permanently in your account.
To view the reports:
Go to Wingz > Synthetic A/B.
Find your test in the list and check the Decision column for the outcome (for example, Variation wins, 97% confidence).
Click into the test to open the Analysis summary. This shows the winning variation, how many personas chose it (for example, Chosen by 8 of 8 personas), a summary explanation of why it won, and a Key Findings section.
Click View Full Analysis to view:
Side-by-side comparison: Screenshots of your control and variation pages.
Preference split: Exact ratios and percentages (for example, Variation Preference: 100.0% - 8 out of 8 personas).
Individual feedback: Detailed participant insights, including their assigned persona and evaluated traits.
There are no further actions available from a completed test. There is no direct path to launch it as a live campaign. To validate a winning hypothesis with real traffic, create a standard campaign in Wingify Web Experimentation.
Use the Synthetic A/B dashboard to track progress, resume drafts, and filter your test results.
Drafts: If you exit before launching, your progress is saved automatically. The Progress column on the Synthetic A/B dashboard indicates completed steps and the next required action (for example, 3 of 5 - Next: Set participants).
Filters: Use the Status dropdown to filter between Draft and Completed tests, or click Add filter to sort by Participants or Created at.
Note: In the Wingz Core plan, existing draft tests display a lock icon and cannot be opened or edited.
Does running a Synthetic A/B test consume Wingz AI credits? Yes. Synthetic A/B test executions draw from your allocated Wingz AI account credits. Credit usage depends mainly on how many personas you run and whether you create new ones or reuse existing ones. For more information about credit usage, see Manage Wingz AI Credits.
Does Synthetic A/B support multiple variations or multivariate testing? No. Synthetic A/B testing is limited to one Control and one Variation. It does not support tests with more than one variation, multivariate (MVT) testing, or Split URL testing.
How long are Synthetic A/B test reports stored in Wingify? Test data and generated analytical reports remain accessible in your account indefinitely.
How accurate are Synthetic A/B results? Wingify currently has no evaluation mechanism or published accuracy benchmark to measure how closely synthetic A/B responses reflect real-user behavior. Treat Synthetic A/B results as directional input for validating hypotheses, not as a substitute for live user testing.
Do personas account for regional, device, OS, or platform differences? No. Personas include attributes such as nationality and residence, but we don't currently use them to model regional, device, OS, or platform-specific behavior. Any regional or platform-specific patterns that appear in the results are incidental.
