Steps to Setting Up a Test Plan
Joy Liu
Lessons
What is UX?
05:33 2What is Persona?
12:05 3How to Create a Persona
39:59 4What is the Point of Storytelling in UX?
08:25 5Using Storyboards & Scenarios
14:34 6Importance of User Stories & Use Cases
34:16 7Developing Wireframes
12:46 8Exercise: Nordstrom Case Study
28:20Lesson Info
Steps to Setting Up a Test Plan
the next thing we are going to talk about is setting up a test plan. So whenever you are testing, something is always good to set up a scope and set of an objective. So exactly what are you testing, right? Like really set it up. How much of the product will this test cover? So if you're only testing that, say, if you're working on a massive website, obviously you are not gonna test the entire website under 90 minutes. That's just not possible. So really, exactly what you're testing. So an example of this is if someone can make a purchase on the V two prototype of site X ray. So what we're doing here is is we're limiting the scope, so keeping the user in the constrain area. So if there's any areas that we find outside of, this couple will take a look at it later, but not know, right? This the purchase flow is the only thing that we're focusing on right now. Step two set up the scenario set up the users mind said right. So what? What should they be feeling? What should they be thinking w...
hen they're going through those part of the product. Um, you can always set up a scenario and give it to them beforehand. So any example of this can be you've been looking for a new computer chair. Your coworker recommends site X to you. And now you are looking like, now, after work, you're looking at Site X. So that is the mindset that your you use your testing participants should be going through. So, um, some of the, um So what we have here is this person is looking to buy a new computer chair. Right? So that's the mindset that there they will have and their co a corrupt recommended it to them. So Okay, this is someone they probably trust. You can use your coworker recommended to you. Or you can also ask Say that, um, a really good friend of yours recommended to you recommended this site to you. So you go on the side knowing that this is this came from someone you trust, etcetera. Or you might even set up the scenario asked. You've been looking at sneakers, and when you were doing your search on the search engine and it popped up on the right hand side of the um, the screen right. That's the ad section. So bored. You've been looking for a new place to eat for a long time, right? And that this sponsored post on your social media, um, showed up like a restaurant link like etcetera. All right, so defining your scope, defining your scenario, and now we need to set up the test metrics. So in this test, what date, Ari? Collecting and measuring. Right. Is it task completion? Great visit is our retesting. How many heirs they've encountered, our retesting, the time on task. Are we just getting some qualitative user feedback? Um, for example, whatever the likelihood to sign up, order the likelihood to recommend, um, overall satisfaction rate. Um, maybe measuring the ease of use. So we're measuring how many times say expressed their frustration or how many times they express how cool this product is. Um, is there any places that confuse them? So, for example, if this is a if this person is purchasing a computer chair on Site X and and we are we're trying to come up with, like, a new check out interaction, So maybe he doesn't even even have a cart anymore. It's like the next new check out flow. So we have to definitely make sure that no one is confused when we launch this. Um, do they like it? Do they dislike? It s It s Oh, definitely. Define your test metrics first. The next thing is wow, we're bored. Me user testing. Obviously, we need to recruit some participants. So what type of participants will be tested? How many participants do we need? Do we even need to write any type of screeners? For example, if this is a if this is a super technical thing So let's say if we are building A if we're building a tool for real estate agent to check their listing, um obviously is super beneficial to write. Write up a screen there to make sure we're filtering through all the real estate agent right? We don't want a chef to be a participant in this test, cause that's that is just not valid, right? There's nothing that the chef person can bring to us because those product is built for real estate agents, so you can definitely be clear. So if this is male female on what are the age range we can do um, are they working full time or they working part time? Um, if this is a so, for example, of the computer chair, we definitely want some participant who would be sitting or who has a job that requires sitting for six plus hours a day. So let's getting really, really realistic, right? If they're only sitting for a short period of time, then I think is okay. The chairs a little bit uncomfortable, right? But if there is sitting for eight hours a day or more, which is realistic for, um, maybe office workers or people who are requiring long time of sitting. We definitely want to get those participant because they will give us the more accurate feedback than anyone who requires your job. That's just standing around all day. Um, a good to all to to kind of narrowed down. It's also go go back to your persona. Take a look at what type of user you want, right? Start from there. And if the results come back, not what you want to, you can also say, Well, it's my persona. Akra, Did I get the right thing? Great. Um, that's also possible that your person eyes a little bit off. That's why your test result it's way off. So or you can also use your persona here to validate it. All right, On part of the test is to record it. Um, are you recording using video, audio or any other tools? Um, if you are testing, if you are testing a website, it's really cool. If you can use ah screen recording that you can kind of see where their cursors are hovering. Um, if you are testing a mobile app is it is better to do a video recording. So you're actually recording the participants hand movement? Um, some of the gesture that they're testing out on your mobile prototype. I always ask for permission to record. Obviously, some people get a little bit sensitive about that. Um, one great way to do this is just do voice recording. Um, I think a lot of people are super okay with that. Just this boy's record. Um I think is really useful to always partner up if you can, because, um, one person will be busy taking notes. The other person will be busy asking the right questions. Um, if you're doing this by yourself, then definitely get a recording device so you can go back and listen to the conversation again and to take now. Any information? Insights? Yep. Okay, um, and last but not least, running the test while wearing. When are we doing this? And for how long? Um, I recommend no more than 90 minutes. If you have a big website, you want to test, definitely break it down into sections. Um, you don't want to tire the participant out, because if they're getting fatigue than their data on my comeback inaccurate, Um, we're in one. Um, definitely make sure that I think environment is a big factor into testing for users. Obviously, if you have, um, if you have tons of cameras pointing at them with, like, a bunch of people, like staring at the participant, obviously is not. If you're testing for, ah, an object you were using your bedroom, then that's like that's a very different scenario. Or that's a very different environment, because I wouldn't have, like, cameras set up in the people. A bunch of people staring at me when I'm doing something in the bedroom. I like, for example, like if you are user testing a polo, you wouldn't have like a vendor. People standing around, um, so definitely kind of take into consideration the on the environment aspect. Um, And then also, for every single test you do, um, you should reset the environment for each participant. So everything. So all the tests are consistent. Um, for user testing, usually 52 eight is a good number. Anything beyond that, I think 55 is good. Um, anything beyond that, they will be just catching the same bugs or the same errors. Usually 80% will be capture with these 5 to 8 participants. So after you do these guys, you can go back and revise your prototype for your design, and then you can get maybe eight more guys to come out and just do do another test.
Class Materials
Ratings and Reviews
ZuZu
With all due respect... We're 2 hours in and I simply can't watch this any longer. I would NEVER pay money for this course as it is. Joy seems to have a great grasp of the material and I have no doubt that working with small start-ups is a good fit for her. That doesn't mean that she's well-qualified to actually teach this course. Joy will serve both herself and her audience by getting some coaching/guidance in becoming a better speaker. The constant ums, nervous hard swallows, monotonous tone, rambling, frequent pauses while she tries to think of the next thing to say, etc is not only painfully distracting but REALLY detracts from her credibility. And the casual, cutesy way that one interacts with family and friends is not necessarily the appropriate way to speak in front of students. The initial segment was a smart way to provide an experience for the students but it went on WAAAAAY too long to make a fairly simple point. I honestly can't follow her now, she's going on and on describing users doing this and maybe they'll do that and it just doesn't make any sense anymore. I shouldn't have to work so hard to follow an instructor! On the upside, her slides are excellent. I would strongly suggest that Joy joins Toastmasters (at the very least) to improve her speaking skills, but ideally she would get some professional assistance in her entire teaching presentation: organization and delivery of material (pedagogy) and her basic speaking skills. And I don't appreciate the host "spinning" this deficiency by saying "it's a lot to follow and that's why you should buy the course"... That's just shabby! Perhaps Joy could study other extremely polished and effective CreativeLive presenters like Chris Gilbert (as a woman role model) or others like John Lee Dumas or James Wedmore all of whom are also delivering complex technical material but do it with clarity, confidence and style.
user-7a3da3
Excellent class, especially for someone new to ux design, story boarding, etc. Very good examples showing wireframes too! thank you Joy Liu. PS - remember to floss, very important for your health!!
Student Work
Related Classes
Web Design