Mixed Method Testing
Let’s analyze how and to what extent our solution solves our customer problem. This is possible by crafting a combination of quantitative and qualitative questions.
Mixed Method Testing
Collaborate with your team reflect on your digital story and solution/prototype, and then craft a series of quantitative and qualitative questions to gain insight into how your solution solves the persona's problem.
Group Size: 2-5
Materials Needed: Print Mixed Method Testing, Pens, Markers and Post-its
Duration: 30-180 mins
Mixed Method Testing
Reflect on your persona's digital story and prototype, and then craft a series of questions to gain insight into how your solution solves the persona's problem.
-
Validate your prototype.
Define the roles of the team.
Develop ways to verify your hypothesis.
Develop empathy for your users.
-
Work as a team in 2-5 member groups and collaborate to determine the test scenario, criteria, procedure, roles, and questions to validate your prototype.
-
Step 1. Describe the test scenario. How and where will we test our solution?
Next, describe the test criteria. What type of questions can we ask to verify our hypothesis? What is the testing scenario, and what roles will our team members play? What platforms can help us catalog and assess the answers to our questions?
Step 2. After the test, document the test results using photos, video, and audio recordings.
Step 3. Finally, summarize your findings and draw conclusions as a group. Determine if your test results verify your hypothesis and what updates or changes need to be made to improve your current iteration.
-
Remember, the purpose is to test the user interaction with the prototype.
Plan your test scenario and sequence, roles, and questions to be asked.
Use the testing sheet for various tests like usability tests and solution interviews.
If the user is dissatisfied with the prototype, ask, "Why?"
Always ask permission before taking photos or making videos or audio recordings
Mixed Method Questions
Mixed method research is a research approach that combines both qualitative and quantitative methods in a single study to gain a more comprehensive and nuanced understanding of the research topic. It aims to leverage the strengths of both approaches while mitigating their individual weaknesses.
Qualitative: How would you describe the main problem you were facing before using our product solution?
Quantitative: On a scale of 1-10, how severe was the problem you experienced before using our product solution? (1 = not severe at all, 10 = extremely severe)
Qualitative: What aspects of our product solution do you find most helpful in addressing your problem?
Quantitative: Rate the effectiveness of our product solution in solving your problem on a scale of 1-5. (1 = not effective, 5 = extremely effective)
Qualitative: Can you share any specific scenarios or situations where our product solution made a significant difference in addressing your problem?
Quantitative: How frequently do you use our product solution to solve your problem? (daily, weekly, monthly, rarely, never)
Qualitative: What challenges, if any, do you still face even after using our product solution?
Quantitative: On a scale of 1-10, how well does our product solution address your problem now? (1 = not well at all, 10 = very well)
Qualitative: How has our product solution impacted your overall experience in dealing with this problem?
Quantitative: Would you recommend our product solution to others facing a similar problem? (Yes/No)
6.Qualitative: Have you noticed any positive changes in your life or work after using our product solution?
Quantitative: Rate the overall satisfaction with our product solution on a scale of 1-5. (1 = very dissatisfied, 5 = very satisfied)
7.Qualitative: How does our product solution compare to other solutions you've tried in the past?
Quantitative: Did you experience any measurable improvements in solving your problem after using our product solution? (Yes/No)
8.Qualitative: What additional features or improvements would you like to see in our product solution to make it even more effective for your needs?
Quantitative: How likely are you to continue using our product solution in the future? (1 = very unlikely, 5 = very likely)
9.Qualitative: How easy or challenging was it for you to learn and adapt to our product solution?
Quantitative: On a scale of 1-10, how user-friendly do you find our product solution? (1 = not user-friendly at all, 10 = very user-friendly)
10. Qualitative: Is there anything else you'd like to share about your experience with our product solution and how it has impacted your problem?
Quantitative: How much money, time, or effort has our product solution saved you in addressing your problem? (approximate values)
Validating your Prototype
Mixed methods research can be valuable for validating a prototype by combining qualitative and quantitative data collection and analysis techniques. Here's how mixed methods research can be used to validate a prototype:
Triangulation: Mixed methods research allows for triangulation, which involves integrating qualitative and quantitative data to gain a more comprehensive understanding of the prototype's effectiveness. By combining both types of data, you can cross-validate findings, identify patterns or inconsistencies, and gain a more robust understanding of users' perspectives.
Triangulation of Researchers: In mixed methods research, involving a multidisciplinary team of researchers or experts can further strengthen the validation process. Each researcher can bring their expertise to the data analysis, interpretation, and decision-making process, enhancing the credibility and reliability of the findings.