A/B Testing
Collaborate to find out which variant is more beloved by the customer. Using A/B testing, we can conduct quantitative or qualitative survey and evaluate feedback to observe the interaction between the user and two prototype variants.
Instructions
Step 1. Define what is to be tested and how it will be tested. It may be helpful to begin with, the basic prototype and then define its two variants. In this step, we want to state our objective or what we want to learn by testing these two different prototypes and what type of data we are gathering. Do we need quantitative or qualitative feedback to determine the best prototype variant? The decision for quantitative or qualitative feedback will determine your test scenario.
.Step 2. Figure out how you will segment groups for testing. What randomize function will you use to assign users to a certain variant for testing? If you are conducting a quantitative test, assign the users randomly.
Step 3. Work with your team to develop the chronological sequence for the test.
Step 4. Evaluate findings. Examine the test results.
Step 5. According to your findings which prototype variant does our user perfer?
A/B Testing
Find out which variant is more beloved by the user. Using A/B testing, we can conduct quantitative or qualitative survey and evaluate feedback. Collaborate as a team in 1-2 member groups to observe the interaction between the user and two prototype variants. Work together to plan the test, how to segment users, how to test the user, and how to evaluate the test and document findings.
Group Size: 1-2
Materials Needed: A/B Testing, Pens, Markers and Post-its Prototype (online), voting tool, survey tool
Duration: 5-15 mins
A/B Testing
Play your digital story. Find a user who mirrors your digital story, then test two variants of a prototype with A/B testing to discover your user's preference. A/B tests consist of a randomized experiment with two prototypes or two variants, A and B. Begin by defining the basic prototype and test group. Next, select two variants of the prototype to be compared. With quantitative tests, assign users at random and conduct the test. Use the user-preferred variant for improving the prototype. Finally, repeat the test with new prototype variants or perform another validation test.
-
Determine which prototype variant is beloved by the user.
Perform a quantitative testing.
Perform qualitative testing.
Compare and contrast prototype variants.
-
Collaborate as a team in 1-2 member groups to observe the interaction between the user and two prototype variants. Work together to plan the test, how to segment users, how to test the user, and how to evaluate the test and document findings.
-
Step 1. Define what is to be tested and how it will be tested. It may be helpful to begin with, the basic prototype and then define its two variants. In this step, we want to state our objective or what we want to learn by testing these two different prototypes and what type of data we are gathering. Do we need quantitative or qualitative feedback to determine the best prototype variant? The decision for quantitative or qualitative feedback will determine your test scenario.
Step 2. Figure out how you will segment groups for testing. What randomize function will you use to assign users to a certain variant for testing? If you are conducting a quantitative test, assign the users randomly.
Step 3. Work with your team to develop the chronological sequence for the test.
Step 4. Evaluate findings. Examine the test results.
Step 5. According to your findings which prototype variant does our user perfer?
-
Determine what feedback you need: quantitative or qualitative.
The type of feedback (quantitative or qualitative) determines the test scenario.
Check one assumption at a time.
Each prototype variant should support the general assumption despite different characteristics.
Make use of web tools/ apps for A/B testing, especially for digital prototypes and front-end solutions.
The simpler or more trivial the test may seem, the more insights it may yield.