Actual Studies Feedback

Field Study November 12, 2018

Initial Questions and Methods: http://bit.ly/RegTesting
Test Planning: http://bit.ly/RegUXResearch
Project: New Registration

Keepers:

1. Record audio or video, or both
2. Continue to incentive with swag
3. Continue to put together scripts, well-written steps, planning, including:
1. Purpose: The Objectives
2. Method and Reason to use it?
3. Equipment & Supplies (Include if you need a Prototype, Wireframe, Copy, etc)
4. To Do: What you need to find or answer?
5. Script
4. Comment for the whole process from research to design: Meetings with IT constantly - work closely to know feasibility.

Improvements:

1. Plan in advance what designs or tools you need for the visit, who’s going, create a schedule.
2. Think about ways to Intercept them, once they get to the store, during check out line, when?
3. Open questions: Try to ask questions that don’t have only Yes - No answers.
4. Speak their language, our customers use daily language, not a proper one.
5. Interact with the device - Let them take control of the device and ask them to think-aloud.
6. Add few more targeted questions about things like layout and design, not just about the tasks.
7. Building our relations with the Branches and associates. How can we continue to do that better? Try bringing some donuts for them or something else. Explain to them what we’re doing, and ask them if they have ideas or know customers that could help.
8. Lina: Speak slower
9. Identify Blockers and let the manager know beforehand.
10. Planning Document should include:
1. Estimated Calendar or Schedule
2. People who are working on the project are the ones should be there, designer, writer, etc.
3. Who is going and their roles?
11. Include in the Script all those things we discover in the visit, all the process before the customer and setting up: Who from Ferguson we should talk, which one is the best branch, why is the right method, etc. Once we got to the branch we didn’t know what to expect, and the Manager just showed us a place behind the counter where we could stand but nothing else.
12. Rehearse the Script and do it with people involved before going to the branch. Define roles and who’s going in advance.
13. Coming up with solutions or designing make sure to keep in mind that we are doing an MVP, identifying “Nice features” vs “Needed Features”. It’s good to work together to prioritize features between “Nice to have” vs “Must have”. Any fancy functionality that doesn’t affect the actual functionality will take longer, especially if they haven’t done it before, BUT don’t limit your designs if you want it in there keep it, just let IT know to organize ideas and have the best possible design.

Moderated Remote Test February 2019

Initial Questions and Methods: http://bit.ly/SingCheckQuestions
Test Planning: http://bit.ly/SingCheckTest  
Project: Single-Page Checkout

Improvements:

1. Laurie’s comments after checking the Test Plan:

• Try to keep the questions open-ended, without mentioning exact labels – we want to see if they understand them on their own.
• Ask more direct questions if they miss something.
• It’s often best to let them start exploring and “thinking out loud” while we observe – it’s more of a “real world” scenario with more accurate results.