[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:01.36,0:00:04.35,Default,,0000,0000,0000,,There’s an intrinsic tension in design:
Dialogue: 0,0:00:04.35,0:00:09.56,Default,,0000,0000,0000,,On one hand, you’ll want to be able to get feedback from people as soon as you possibly can.
Dialogue: 0,0:00:09.56,0:00:15.62,Default,,0000,0000,0000,,On the other, in order to be able to get that feedback you need to make something that works.
Dialogue: 0,0:00:15.62,0:00:19.37,Default,,0000,0000,0000,,You’ve learned how to rapidly prototype things with paper prototyping.
Dialogue: 0,0:00:19.37,0:00:23.86,Default,,0000,0000,0000,,And today what we’re going to talk about is how you can test rapid prototypes with users.
Dialogue: 0,0:00:24.86,0:00:26.67,Default,,0000,0000,0000,,So, let’s imagine for a moment —
Dialogue: 0,0:00:26.67,0:00:31.75,Default,,0000,0000,0000,,What if it was possible to create an interactive application without writing much or any code
Dialogue: 0,0:00:31.75,0:00:35.94,Default,,0000,0000,0000,,and get feedback on that interactive application quickly?
Dialogue: 0,0:00:35.94,0:00:40.76,Default,,0000,0000,0000,,I think that’s a pretty powerful dream, and, like Dorothy learned in « The Wizard of Oz »,
Dialogue: 0,0:00:40.76,0:00:45.70,Default,,0000,0000,0000,,dreams can be really powerful, and, sometimes, they can even come true.
Dialogue: 0,0:00:45.70,0:00:49.27,Default,,0000,0000,0000,,And there’s something else that Dorothy learned that we’re going to use in the lecture:
Dialogue: 0,0:00:49.27,0:00:51.46,Default,,0000,0000,0000,,If you’ve seen the movie « The Wizard of Oz », you’ll know that
Dialogue: 0,0:00:51.46,0:00:54.70,Default,,0000,0000,0000,,when Dorothy and her compatriots arrived in the Emerald City,
Dialogue: 0,0:00:54.70,0:00:58.74,Default,,0000,0000,0000,,they saw a big giant wizard that was really scary and freaked them out.
Dialogue: 0,0:00:59.63,0:01:03.49,Default,,0000,0000,0000,,But eventually they learned that that wizard was just a little man behind a curtain,
Dialogue: 0,0:01:04.08,0:01:08.44,Default,,0000,0000,0000,,and the ability of that little man behind the curtain to put on a big realistic show
Dialogue: 0,0:01:08.44,0:01:13.36,Default,,0000,0000,0000,,that, to the visitors to the Emerald City, seemed completely real and immersive,
Dialogue: 0,0:01:13.36,0:01:17.53,Default,,0000,0000,0000,,is exactly what we’re going to accomplish with this video’s prototyping technique.
Dialogue: 0,0:01:18.82,0:01:20.58,Default,,0000,0000,0000,,So, the idea behind Wizard-of-Oz Prototyping
Dialogue: 0,0:01:20.58,0:01:24.37,Default,,0000,0000,0000,,is that we’re going to simulate interactive behaviour and machine functionality
Dialogue: 0,0:01:24.37,0:01:28.91,Default,,0000,0000,0000,,by having a human operator manipulate the levers behind the scenes.
Dialogue: 0,0:01:29.57,0:01:32.60,Default,,0000,0000,0000,,If you want to get a sense for just how this realistic this can be,
Dialogue: 0,0:01:32.60,0:01:36.38,Default,,0000,0000,0000,,watch our friend from « Seinfeld » call a “Movie Phone application”
Dialogue: 0,0:01:36.40,0:01:39.98,Default,,0000,0000,0000,,to try and find out when and where movies are playing.
Dialogue: 0,0:01:40.75,0:01:44.54,Default,,0000,0000,0000,,(Hello, and welcome to Movie Phone.
Dialogue: 0,0:01:44.54,0:01:48.66,Default,,0000,0000,0000,,If you know the name of the movie you’d like to see, press 1.
Dialogue: 0,0:01:48.66,0:01:50.49,Default,,0000,0000,0000,,[beep] C’mon, c’mon…
Dialogue: 0,0:01:50.49,0:01:56.16,Default,,0000,0000,0000,,Using the touch-tone keypad, please enter the first three letters of the movie title, now!
Dialogue: 0,0:01:56.16,0:01:58.18,Default,,0000,0000,0000,,[beep, beep]
Dialogue: 0,0:01:58.18,0:02:05.80,Default,,0000,0000,0000,,You’ve selected « Agent Zero ». If that’s correct, press 1.
Dialogue: 0,0:02:05.80,0:02:07.75,Default,,0000,0000,0000,,What?!
Dialogue: 0,0:02:07.75,0:02:09.84,Default,,0000,0000,0000,,Ugh…)
Dialogue: 0,0:02:09.84,0:02:13.47,Default,,0000,0000,0000,,So George thinks that he’s calling this automated Movie Phone application,
Dialogue: 0,0:02:13.47,0:02:17.31,Default,,0000,0000,0000,,but it turns out that, behind the scenes, it’s just Kramer who’s playing a wizard
Dialogue: 0,0:02:17.31,0:02:20.07,Default,,0000,0000,0000,,and behaving as if he were the machine.
Dialogue: 0,0:02:20.07,0:02:23.88,Default,,0000,0000,0000,,To be honest, he’s not very good — I think that you’d all be able to do better!
Dialogue: 0,0:02:24.63,0:02:28.05,Default,,0000,0000,0000,,Wizard of Oz techniques got their start with speech user interfaces.
Dialogue: 0,0:02:28.05,0:02:34.35,Default,,0000,0000,0000,,The term “Wizard of Oz” was coined by Jeff Kelly in his PhD dissertation around 1980.
Dialogue: 0,0:02:34.35,0:02:36.45,Default,,0000,0000,0000,,And Jeff’s setup at John Hopkins
Dialogue: 0,0:02:36.45,0:02:40.10,Default,,0000,0000,0000,,actually bore more of a resemblance to the Wizard of Oz than you might first imagine;
Dialogue: 0,0:02:40.10,0:02:45.78,Default,,0000,0000,0000,,so, in addition to some one-way mirrors and things like that, there literally was a curtain
Dialogue: 0,0:02:45.78,0:02:50.87,Default,,0000,0000,0000,,separating Jeff, as the wizard, from the participants that were using the speech user interfaces.
Dialogue: 0,0:02:50.87,0:02:55.07,Default,,0000,0000,0000,,And these Wizard-of-Oz prototypes were really important for understanding
Dialogue: 0,0:02:55.07,0:02:57.47,Default,,0000,0000,0000,,what would be an effective speech user interface,
Dialogue: 0,0:02:57.47,0:03:01.36,Default,,0000,0000,0000,,because, at the time, the recognition algorithms weren’t very good,
Dialogue: 0,0:03:01.36,0:03:03.25,Default,,0000,0000,0000,,but we knew they were going to get better.
Dialogue: 0,0:03:03.25,0:03:05.74,Default,,0000,0000,0000,,And Jeff asked the very important questions of:
Dialogue: 0,0:03:05.74,0:03:10.76,Default,,0000,0000,0000,,“If we get the recognition to the point where it was effective, what will the user interaction be?
Dialogue: 0,0:03:10.76,0:03:13.61,Default,,0000,0000,0000,,And what kind of strategies might be [the] most effective?”
Dialogue: 0,0:03:13.63,0:03:17.09,Default,,0000,0000,0000,,So the Wizard of Oz enabled Jeff to time-travel
Dialogue: 0,0:03:17.09,0:03:20.62,Default,,0000,0000,0000,,into a future where speech recognition technology worked better,
Dialogue: 0,0:03:20.62,0:03:24.33,Default,,0000,0000,0000,,to try and understand what the user experience issues of that domain would be.
Dialogue: 0,0:03:25.86,0:03:29.38,Default,,0000,0000,0000,,In general, a Wizard-of-Oz prototype comprises a couple of pieces:
Dialogue: 0,0:03:29.38,0:03:33.36,Default,,0000,0000,0000,,First, you’ve got some kind of user interface that you’re delivering to the user
Dialogue: 0,0:03:33.36,0:03:41.79,Default,,0000,0000,0000,,which feels-ish like a user interface — even if it’s sketches or custom-spoken words.
Dialogue: 0,0:03:41.79,0:03:47.04,Default,,0000,0000,0000,,And, at the same time, there’s not any or much code that goes behind it —
Dialogue: 0,0:03:47.04,0:03:53.86,Default,,0000,0000,0000,,the code and interactivity [that] is being created is a mirage from a human.
Dialogue: 0,0:03:53.86,0:03:57.56,Default,,0000,0000,0000,,Sometimes there’s a user interface that the wizard has,
Dialogue: 0,0:03:57.56,0:04:00.66,Default,,0000,0000,0000,,which they cobbled together to make life better for them —
Dialogue: 0,0:04:00.66,0:04:05.48,Default,,0000,0000,0000,,and in fact back in 2000 colleagues at Berkeley and I built a system called Suede,
Dialogue: 0,0:04:05.48,0:04:09.33,Default,,0000,0000,0000,,which helped automate Wizard-of-Oz testing and speech user interfaces.
Dialogue: 0,0:04:09.33,0:04:15.51,Default,,0000,0000,0000,,Wizard-of-Oz prototypes make sense when it’s faster and cheapter and easier than building the real thing,
Dialogue: 0,0:04:15.51,0:04:20.46,Default,,0000,0000,0000,,and that’s going to be especially true any time you have recognition-based interfaces,
Dialogue: 0,0:04:20.46,0:04:23.77,Default,,0000,0000,0000,,or personalization that’s custom to a user.
Dialogue: 0,0:04:24.49,0:04:28.87,Default,,0000,0000,0000,,This tradeoff of whether it’s cheaper and faster and easier is also going to depend on your abilities:
Dialogue: 0,0:04:28.87,0:04:33.29,Default,,0000,0000,0000,,There will be some things that you know how to do quickly and easily and then you might just implement;
Dialogue: 0,0:04:33.29,0:04:37.60,Default,,0000,0000,0000,,and there’s other things that may be more difficult or more time-consuming for you,
Dialogue: 0,0:04:37.60,0:04:40.04,Default,,0000,0000,0000,,and those you’ll choose to Wizard-of-Oz.
Dialogue: 0,0:04:40.64,0:04:46.19,Default,,0000,0000,0000,,Wizard-of-Oz prototypes, like any other kind of prototype, can be higher or lower fidelity.
Dialogue: 0,0:04:46.19,0:04:48.73,Default,,0000,0000,0000,,And there’s some important tradeoffs here —
Dialogue: 0,0:04:48.73,0:04:53.08,Default,,0000,0000,0000,,The higher fidelity the prototype, the more it feels like the real thing to users —
Dialogue: 0,0:04:53.08,0:04:58.98,Default,,0000,0000,0000,,In fact, sometimes you can build an interface that people don’t even know is being powered by a wizard,
Dialogue: 0,0:04:58.98,0:05:04.04,Default,,0000,0000,0000,,as in the famous story of the mechanical Turk, who is inside a chess machine.
Dialogue: 0,0:05:04.47,0:05:09.21,Default,,0000,0000,0000,,However, making a high-fidelity user interface is going to take a lot of time,
Dialogue: 0,0:05:09.21,0:05:15.02,Default,,0000,0000,0000,,and users may be more reluctant to critique a user interface that’s really high-fidelity,
Dialogue: 0,0:05:15.02,0:05:20.60,Default,,0000,0000,0000,,and so, early on, I recommend quick-and-dirty paper prototypes being the most powerful thing
Dialogue: 0,0:05:20.60,0:05:22.52,Default,,0000,0000,0000,,to use for Wizard-of-Oz tests.
Dialogue: 0,0:05:22.52,0:05:25.60,Default,,0000,0000,0000,,Because users will feel like they can give you any kind of feedback;
Dialogue: 0,0:05:25.60,0:05:28.27,Default,,0000,0000,0000,,it’s clear you haven’t put a lot of time into it yet,
Dialogue: 0,0:05:28.27,0:05:33.11,Default,,0000,0000,0000,,and it’s fast for you to make, and so you actually haven’t a lot time into it yet.
Dialogue: 0,0:05:33.77,0:05:37.21,Default,,0000,0000,0000,,A few years ago, my friend Sep Kamvar created a company called Aardvark,
Dialogue: 0,0:05:37.21,0:05:39.93,Default,,0000,0000,0000,,which is a social search engine.
Dialogue: 0,0:05:39.93,0:05:45.49,Default,,0000,0000,0000,,It was really good at helping you use your social network to find answers from other people.
Dialogue: 0,0:05:45.97,0:05:50.58,Default,,0000,0000,0000,,So the way it works is you ask a question via instant message, via Google chat;
Dialogue: 0,0:05:50.58,0:05:55.62,Default,,0000,0000,0000,,and it’s going to be automatically routed to a friend of yours, or a friend of a friend,
Dialogue: 0,0:05:55.62,0:05:58.60,Default,,0000,0000,0000,,who has the expertise to answer that question.
Dialogue: 0,0:05:58.60,0:06:04.34,Default,,0000,0000,0000,,One of the hard parts about building a service like this is: How do you do the routing?
Dialogue: 0,0:06:04.34,0:06:08.02,Default,,0000,0000,0000,,Eventually they figured out an algorithm to do this; but to bootstrap that —
Dialogue: 0,0:06:08.02,0:06:10.38,Default,,0000,0000,0000,,both to figure out what algorithm to build,
Dialogue: 0,0:06:10.38,0:06:15.23,Default,,0000,0000,0000,,and to get a user experience going before they had built anything —
Dialogue: 0,0:06:15.23,0:06:17.72,Default,,0000,0000,0000,,they had a Wizard-of-Oz prototype.
Dialogue: 0,0:06:17.72,0:06:21.48,Default,,0000,0000,0000,,So the way that worked was that Aardvark employees would get the question,
Dialogue: 0,0:06:21.48,0:06:25.33,Default,,0000,0000,0000,,and they would manually select the person that was going to get routed to.
Dialogue: 0,0:06:25.33,0:06:29.20,Default,,0000,0000,0000,,Damon Horowitz, the co-founder of Aardvark, put it this way in a conference:
Dialogue: 0,0:06:29.20,0:06:33.92,Default,,0000,0000,0000,,he said that, “If people like it in this super-crappy form, then it’s worth building,
Dialogue: 0,0:06:33.92,0:06:38.26,Default,,0000,0000,0000,,because they’ll like it even more when we build the real thing!”
Dialogue: 0,0:06:38.28,0:06:43.71,Default,,0000,0000,0000,,So, if you want to be like Kramer or Aardvark, how can you make a wizard-powered prototype?
Dialogue: 0,0:06:43.71,0:06:46.74,Default,,0000,0000,0000,,Here’s a sketch of what you’ll need to do in five easy steps:
Dialogue: 0,0:06:47.25,0:06:49.58,Default,,0000,0000,0000,,First, figure out what scenarios you’re going to support.
Dialogue: 0,0:06:49.58,0:06:54.36,Default,,0000,0000,0000,,It’s a lot of easier to build a Wizard-of-Oz prototype for a limited set of functionality.
Dialogue: 0,0:06:54.84,0:06:56.37,Default,,0000,0000,0000,,I like Wizard-of=Oz prototypes
Dialogue: 0,0:06:56.37,0:06:59.89,Default,,0000,0000,0000,,because it forces you to figure out what should happen in response to human behaviour.
Dialogue: 0,0:07:00.85,0:07:03.72,Default,,0000,0000,0000,,Then, put together some kind of user interface skeleton —
Dialogue: 0,0:07:03.72,0:07:06.24,Default,,0000,0000,0000,,the things that the end users are going to see.
Dialogue: 0,0:07:06.59,0:07:11.27,Default,,0000,0000,0000,,Third, if you need to, develop the “hooks” for the wizard [to] input if you’re going to have a remote wizard
Dialogue: 0,0:07:11.27,0:07:15.28,Default,,0000,0000,0000,,or if they’re going to control some software functionality from behind the scenes.
Dialogue: 0,0:07:16.05,0:07:17.48,Default,,0000,0000,0000,,Fourth, and as part of this,
Dialogue: 0,0:07:17.48,0:07:21.49,Default,,0000,0000,0000,,you’ll need to figure out exactly what kind of input the wizard is allowed to offer:
Dialogue: 0,0:07:21.49,0:07:26.85,Default,,0000,0000,0000,,Are they going to be selecting from a menu of options? offering free response? speaking text?
Dialogue: 0,0:07:26.85,0:07:31.23,Default,,0000,0000,0000,,Will you give them a decision tree that controls their behaviour?
Dialogue: 0,0:07:31.23,0:07:33.62,Default,,0000,0000,0000,,or you’re going let them be more free-form?
Dialogue: 0,0:07:33.62,0:07:36.92,Default,,0000,0000,0000,,If you have a paper prototype, their role is going to pretty manual —
Dialogue: 0,0:07:36.92,0:07:40.89,Default,,0000,0000,0000,,adding widgets and moving sliders, and making the interface go.
Dialogue: 0,0:07:41.73,0:07:43.74,Default,,0000,0000,0000,,When you’re doing this, it’s important to remember that,
Dialogue: 0,0:07:43.74,0:07:49.58,Default,,0000,0000,0000,,ultimately, the functionality that you’re wizarding now is ultimately going to be replaced with a computer,
Dialogue: 0,0:07:49.58,0:07:53.82,Default,,0000,0000,0000,,and so at some point down the line, you will have to build some software to make it go.
Dialogue: 0,0:07:53.82,0:07:58.78,Default,,0000,0000,0000,,And that’s important, because it can be easy to fake stuff that’s not possible to ever happen.
Dialogue: 0,0:07:59.47,0:08:03.43,Default,,0000,0000,0000,,And, last, as with any prototype that you’re going to test with people,
Dialogue: 0,0:08:03.43,0:08:07.17,Default,,0000,0000,0000,,practice it first with a friend or a colleague to get the hang of both doing the wizard —
Dialogue: 0,0:08:07.17,0:08:10.10,Default,,0000,0000,0000,,it’s a very different kind of interaction than you may be used to —
Dialogue: 0,0:08:10.10,0:08:15.44,Default,,0000,0000,0000,,and also, figuring out what scenarios are most effective, what instructions you’ll need to give people.
Dialogue: 0,0:08:15.44,0:08:19.82,Default,,0000,0000,0000,,Get out the easy bugs in the user interface before you bring in real users.
Dialogue: 0,0:08:20.30,0:08:25.64,Default,,0000,0000,0000,,And now you’re ready to run the user interface: Like I said, you’ll want to practice with a friend at first.
Dialogue: 0,0:08:27.38,0:08:32.12,Default,,0000,0000,0000,,Once you’ve got the really obvious kinks out, and when you’ve got your patter down and the tasks ready,
Dialogue: 0,0:08:32.12,0:08:35.18,Default,,0000,0000,0000,,then it’s time to recruit some people to come in and try out your prototype.
Dialogue: 0,0:08:35.18,0:08:41.57,Default,,0000,0000,0000,,You can even go to places like train stations, or airports, or city street corners, or coffee shops
Dialogue: 0,0:08:41.57,0:08:45.81,Default,,0000,0000,0000,,as a way of going to the people who might be using your system.
Dialogue: 0,0:08:47.23,0:08:50.43,Default,,0000,0000,0000,,In a Wizard-of-Oz prototype, there’s two roles:
Dialogue: 0,0:08:50.43,0:08:53.27,Default,,0000,0000,0000,,you’ve got a facilitator who’s going to talk to the user,
Dialogue: 0,0:08:53.27,0:08:55.87,Default,,0000,0000,0000,,and you’ve got a wizard who’s going to manipulate the prototype.
Dialogue: 0,0:08:55.87,0:09:00.09,Default,,0000,0000,0000,,If you have the luxury of a team, it’s helpful if there are two different people,
Dialogue: 0,0:09:00.09,0:09:03.74,Default,,0000,0000,0000,,in part because your mind is going to be full of all the things that you’ll have to do,
Dialogue: 0,0:09:03.74,0:09:08.70,Default,,0000,0000,0000,,and if you separate these roles, each person can concentrate more, do a better job,
Dialogue: 0,0:09:08.70,0:09:13.57,Default,,0000,0000,0000,,and you have two sets of eyes looking at what the person’s doing, so you can learn more.
Dialogue: 0,0:09:14.58,0:09:18.92,Default,,0000,0000,0000,,But can do this yourself if you need to — these can be one person doing two roles.
Dialogue: 0,0:09:19.60,0:09:22.38,Default,,0000,0000,0000,,If you’re trying to convince somebody that this is actually is a real system,
Dialogue: 0,0:09:22.38,0:09:27.03,Default,,0000,0000,0000,,then you’ll want your wizard to be hidden or remote somehow, like the Aardvark example.
Dialogue: 0,0:09:27.35,0:09:29.49,Default,,0000,0000,0000,,And think about how you’d like to get feedback from users —
Dialogue: 0,0:09:29.49,0:09:33.48,Default,,0000,0000,0000,,this is something that we’ll touch on several times more throughout this course.
Dialogue: 0,0:09:33.48,0:09:36.98,Default,,0000,0000,0000,,For now, think about whether you’d like to get think-aloud feedback —
Dialogue: 0,0:09:36.98,0:09:39.91,Default,,0000,0000,0000,,which is, when the person’s using the prototype,
Dialogue: 0,0:09:39.91,0:09:45.44,Default,,0000,0000,0000,,have them speak aloud what it is that’s going through their mind, what decisions they’re making and why,
Dialogue: 0,0:09:45.44,0:09:51.01,Default,,0000,0000,0000,,what they’re confused by when they run up against things that they can’t figure out what to do.
Dialogue: 0,0:09:51.72,0:09:58.11,Default,,0000,0000,0000,,This think-aloud protocol is great for getting stuff that otherwise you might not know or learn.
Dialogue: 0,0:09:58.11,0:10:03.07,Default,,0000,0000,0000,,However, as you can imagine, thinking aloud can change how people interact with the prototype.
Dialogue: 0,0:10:03.07,0:10:07.32,Default,,0000,0000,0000,,So, if think-aloud is too distracting, you can ask people at the end of the study
Dialogue: 0,0:10:07.32,0:10:09.86,Default,,0000,0000,0000,,what was going through their mind and what they were thinking about —
Dialogue: 0,0:10:09.86,0:10:11.82,Default,,0000,0000,0000,,that’s called a retrospective approach.
Dialogue: 0,0:10:11.82,0:10:14.40,Default,,0000,0000,0000,,If you like, you can even show them the video of them using it.
Dialogue: 0,0:10:14.40,0:10:18.72,Default,,0000,0000,0000,,You can then say things like, “When you got stuck here, what was the issue?”
Dialogue: 0,0:10:19.61,0:10:24.05,Default,,0000,0000,0000,,Third, if you have specific things that you’d like to make sure that your interface does well,
Dialogue: 0,0:10:24.05,0:10:30.16,Default,,0000,0000,0000,,you can have categories of problems or heuristics that you asked your users to pay attention to.
Dialogue: 0,0:10:30.16,0:10:34.62,Default,,0000,0000,0000,,And heuristic evaluation is something that we’re going to talk more about later in this course also.
Dialogue: 0,0:10:35.50,0:10:38.06,Default,,0000,0000,0000,,Once you’re all done, make sure to thank people for their time.
Dialogue: 0,0:10:38.06,0:10:43.16,Default,,0000,0000,0000,,You may want to give them a gift certificate, or ice-cream, or some other kind of thank-you.
Dialogue: 0,0:10:44.21,0:10:49.71,Default,,0000,0000,0000,,And, if you haven’t yet told them that there’s actually a wizard behind the scenes operating the user interface,
Dialogue: 0,0:10:49.71,0:10:52.31,Default,,0000,0000,0000,,the end of the experiment is probably a really good time to that —
Dialogue: 0,0:10:52.31,0:10:54.75,Default,,0000,0000,0000,,You’ll want to make sure to be honest with people.
Dialogue: 0,0:10:54.75,0:10:57.97,Default,,0000,0000,0000,,You can use wizards throughout the entire development of your software,
Dialogue: 0,0:10:57.97,0:10:59.94,Default,,0000,0000,0000,,not just at the very beginning.
Dialogue: 0,0:10:59.94,0:11:06.07,Default,,0000,0000,0000,,And so, if you have the fully-functional software here, and over time you move towards there,
Dialogue: 0,0:11:06.07,0:11:10.27,Default,,0000,0000,0000,,you can use wizards to fill in the gap of whatever is not built at that time.
Dialogue: 0,0:11:10.27,0:11:13.52,Default,,0000,0000,0000,,So, the wizard may do all of the interactions at the very beginning,
Dialogue: 0,0:11:13.52,0:11:16.20,Default,,0000,0000,0000,,and then, as you get closer and closer to a final project,
Dialogue: 0,0:11:16.20,0:11:19.92,Default,,0000,0000,0000,,you can have it just fill in only the parts that aren’t done yet.
Dialogue: 0,0:11:20.44,0:11:24.05,Default,,0000,0000,0000,,As you can see, there’s a lot to like about Wizard-of-Oz prototypes:
Dialogue: 0,0:11:24.46,0:11:27.79,Default,,0000,0000,0000,,They can be really fast to make, which makes them cheaper,
Dialogue: 0,0:11:27.79,0:11:31.12,Default,,0000,0000,0000,,and it also means you get to turn the crank on iteration more.
Dialogue: 0,0:11:32.43,0:11:35.62,Default,,0000,0000,0000,,Because they are quick, you can rapidly create multiple alternatives.
Dialogue: 0,0:11:35.62,0:11:39.08,Default,,0000,0000,0000,,And you decide that you want the “implementation” to work differently,
Dialogue: 0,0:11:39.08,0:11:42.65,Default,,0000,0000,0000,,you just give your wizard different instructions; there’s no code to rewrite.
Dialogue: 0,0:11:43.51,0:11:45.14,Default,,0000,0000,0000,,Because it is in a sense interactive,
Dialogue: 0,0:11:45.14,0:11:49.00,Default,,0000,0000,0000,,it is more real and you get better feedback than just from paper prototyping,
Dialogue: 0,0:11:49.00,0:11:52.14,Default,,0000,0000,0000,,although using paper prototypes as the substrate for a wizard
Dialogue: 0,0:11:52.14,0:11:55.72,Default,,0000,0000,0000,,is an excellent strategy early on in the design process.
Dialogue: 0,0:11:56.31,0:12:00.86,Default,,0000,0000,0000,,It’s a great way to get feedback about bugs and problems with your user interface design.
Dialogue: 0,0:12:00.86,0:12:05.16,Default,,0000,0000,0000,,Every single user interface that I’ve ever built, or that I’ve seen built,
Dialogue: 0,0:12:05.16,0:12:08.59,Default,,0000,0000,0000,,or that students of mine have ever built, has had bugs early on.
Dialogue: 0,0:12:08.59,0:12:11.32,Default,,0000,0000,0000,,It’s too hard to get right the first time.
Dialogue: 0,0:12:11.32,0:12:15.54,Default,,0000,0000,0000,,You’re going to iterate and fail fast, so that you can succeed sooner.
Dialogue: 0,0:12:15.54,0:12:18.91,Default,,0000,0000,0000,,And a Wizard of Oz is a great tool to be able to do that.
Dialogue: 0,0:12:20.05,0:12:22.54,Default,,0000,0000,0000,,Because you’re getting feedback from users early,
Dialogue: 0,0:12:22.54,0:12:26.44,Default,,0000,0000,0000,,it’s a great way to place people at the centre of the development process.
Dialogue: 0,0:12:27.01,0:12:29.91,Default,,0000,0000,0000,,It’s also really wonderful for forward-looking applications
Dialogue: 0,0:12:29.91,0:12:34.61,Default,,0000,0000,0000,,as we start to think about how sensors and cameras and other futuristic technologies
Dialogue: 0,0:12:34.61,0:12:37.21,Default,,0000,0000,0000,,might enable other new kinds of user interfaces.
Dialogue: 0,0:12:37.21,0:12:42.23,Default,,0000,0000,0000,,You can imagine these now by building Wizard-of-Oz prototypes.
Dialogue: 0,0:12:42.52,0:12:46.02,Default,,0000,0000,0000,,And lastly, strange as it may sound, you actually learn a lot
Dialogue: 0,0:12:46.02,0:12:50.12,Default,,0000,0000,0000,,about what your application logic of your interface ought to be, and what makes sense
Dialogue: 0,0:12:50.12,0:12:54.27,Default,,0000,0000,0000,,by playing the wizard and embodying that role in the system.
Dialogue: 0,0:12:54.99,0:12:58.28,Default,,0000,0000,0000,,But there are some disadvantages too:
Dialogue: 0,0:12:58.28,0:13:03.18,Default,,0000,0000,0000,,It can be easy to gloss over errors in technology that will ultimately come back to bite you —
Dialogue: 0,0:13:03.18,0:13:06.64,Default,,0000,0000,0000,,like speech recognition systems for example.
Dialogue: 0,0:13:06.66,0:13:11.64,Default,,0000,0000,0000,,If, at the end of the day, you’re going to have bugs in your speech system,
Dialogue: 0,0:13:11.64,0:13:14.45,Default,,0000,0000,0000,,you’ll want to make sure that your Wizard-of-Oz prototype encodes
Dialogue: 0,0:13:14.45,0:13:16.88,Default,,0000,0000,0000,,what happens when the speech reco[gnition]s screws up.
Dialogue: 0,0:13:16.88,0:13:20.05,Default,,0000,0000,0000,,Don’t assume it’s going to work perfectly all the time.
Dialogue: 0,0:13:20.05,0:13:24.72,Default,,0000,0000,0000,,’Cause if you’re not careful, you can end up simulating a technology that doesn’t exist and may never.
Dialogue: 0,0:13:25.39,0:13:27.81,Default,,0000,0000,0000,,People, for better or for worse, are inconsistent,
Dialogue: 0,0:13:27.81,0:13:32.89,Default,,0000,0000,0000,,and, to get them to play the wizard role, can require training, so that’s a ramp-up time.
Dialogue: 0,0:13:32.89,0:13:35.100,Default,,0000,0000,0000,,And because you have to have a physical human there to run it,
Dialogue: 0,0:13:35.100,0:13:38.19,Default,,0000,0000,0000,,your runtime efficiency is slower,
Dialogue: 0,0:13:38.19,0:13:42.16,Default,,0000,0000,0000,,and it can be more exhausting for the people that are playing the wizard role.
Dialogue: 0,0:13:42.16,0:13:46.98,Default,,0000,0000,0000,,Wizards are great for some kind[s] of functionality, like Kramer did with the speech user interface.
Dialogue: 0,0:13:46.98,0:13:51.37,Default,,0000,0000,0000,,But other stuff, it’s harder to figure out what you can do with a wizard interface,
Dialogue: 0,0:13:51.37,0:13:56.23,Default,,0000,0000,0000,,and it may not be quite as effective — it may be klunkier.
Dialogue: 0,0:13:56.23,0:13:57.96,Default,,0000,0000,0000,,Or it might be simply be inappropriate —
Dialogue: 0,0:13:57.96,0:14:05.84,Default,,0000,0000,0000,,there’re some situations where having a wizard around may not be ok.
Dialogue: 0,0:14:05.84,0:14:09.10,Default,,0000,0000,0000,,All in all, I think wizards are an incredibly powerful technique,
Dialogue: 0,0:14:09.10,0:14:11.52,Default,,0000,0000,0000,,and a really fun one to stretch your creativity.
Dialogue: 0,0:14:11.52,0:14:17.08,Default,,0000,0000,0000,,What kinds of new user interfaces can you imagine by creating a Wizard-of-Oz prototype?
Dialogue: 0,0:14:17.08,0:14:19.76,Default,,0000,0000,0000,,I’d like to thank Stephen Dow in creating this lecture —
Dialogue: 0,0:14:19.76,0:14:24.46,Default,,0000,0000,0000,,I drew on a lot of the materials that’s he’s used in writing and speaking about Wizard-of-Oz prototypes.
Dialogue: 0,0:14:24.46,0:14:30.92,Default,,0000,0000,0000,,And if you’re interested in learning more about wizards, you can see these resources here.