Settings Experiments are a new type of A/B test in Vidalytics that lets you test any video setting — CTA timing, autoplay, thumbnail, play gate, and more — without manually duplicating your video or managing two separate library entries.
The original settings become your Control, the changed settings become your Variant, and traffic is split 50/50 on the same embed. No code changes required.
🔒 Availability & Restrictions
Settings Experiments are available on all plans that currently have access to the Experiments feature (Pro and above)
Any video setting available on your plan can be tested — there are no restrictions on which settings are eligible
The variant created for a Settings Experiment does not appear in your video library and does not count toward extra storage billing. Traffic sent to the variant is billed as usual
Only one active experiment can run per video at a time. If a video enters a split test, any pending recommendations for it will be hidden automatically
How It Works
When you create a Settings Experiment, Vidalytics handles everything behind the scenes. You stay on the same video, change one or more settings for the variant, and the system runs the experiment automatically. Your video library stays clean — no duplicate entries, no extra storage billing.
🧪 Creating a Settings Experiment
Open the Experiments section for the video you want to test
Begin creating a new experiment
In the variant selector, choose "Player settings" instead of "Another video"
Open the Variant settings and make your changes — adjust CTA timing, autoplay behavior, thumbnail, gating, or any other setting you want to test
Confirm your traffic split and any other experiment settings
Click Save to launch your experiment
💡 Tip: You can edit variant settings after the experiment has started using the regular settings editor — no need to restart the experiment.
Monitoring Your Experiment
Once your experiment is live, you can track its progress from the Experiment profile, where you'll see:
Control and variant settings side by side, with differences highlighted
Performance data for each variant
The option to review or edit variant settings at any time
🏆 Applying a Winner
When a variant outperforms the control and a winner is determined, you'll see a winner pop-up directly in the Experiment profile. From there:
Click Apply to copy the winning settings back to your original video instantly
Your video is immediately updated — no manual adjustments needed
Cancelling or Deleting an Experiment
Your original video and its settings remain completely unchanged, and it will be served to 100% of your traffic as usual.
Note: Make sure to re-publish your video after applying any winning settings for the changes to go live.
If you have questions or need support, contact us our Customer Happiness Team at [email protected]