Return to Video

Lecture 4.1: Direct Manipulation (16:53)

  • 0:01 - 0:09
    The key innovation of the graphic user interface is that input is performed directly on top of output.
  • 0:09 - 0:14
    Today, we’re going to explore what makes an interface easy, hard, or “natural,”
  • 0:14 - 0:21
    and we’re going to do it by starting with something really simple: a measuring cup.
  • 0:21 - 0:25
    It has a user interface: it’s got label readout here.
  • 0:25 - 0:29
    There’s a task: Fill up a liquid to a desired amount.
  • 0:29 - 0:34
    So, how might you be able to improve this standard measuring cup design here?
  • 0:34 - 0:36
    What kind of things can you think of?
  • 0:36 - 0:39
    OXO is a company that sells kitchen utencils.
  • 0:39 - 0:46
    At the Gel Conference in 2008, OXO’s Alex Lee talked about their measuring cup:
  • 0:46 - 0:49
    The first prototype came unsolicited in the mail;
  • 0:49 - 0:55
    it inspired them to go out into the field and ask people about problems with their measuring cups
  • 0:55 - 0:57
    and suggestions for improvements.
  • 0:57 - 1:03
    They got things like: “It’s sometimes slippery” or “The handle gets hot”.
  • 1:03 - 1:06
    Nobody complained about the measuring part;
  • 1:06 - 1:11
    but, when they watched people measure things, they would do this:
  • 1:11 - 1:14
    Grab some liquid;
  • 1:14 - 1:18
    Pour it in;
  • 1:18 - 1:23
    Hold it up;
  • 1:23 - 1:26
    Pour some more in;
  • 1:26 - 1:29
    Hold it up;
  • 1:29 - 1:31
    Pour a little more;
  • 1:31 - 1:35
    There we go!
  • 1:37 - 1:40
    This stuttered-step measurement seems kind of inelegant,
  • 1:40 - 1:49
    so, to address this, OXO released a design with a clever insight: The numbers are visible from above.
  • 1:49 - 1:54
    This provides continuous interactive feedback on your actions.
  • 1:58 - 2:03
    Pour once; and when you get to the right level, you can see it directly and stop.
  • 2:04 - 2:08
    It’s a great design in lots of ways, but there’s still some room for further improvement.
  • 2:08 - 2:14
    For starters, the numbers that are written are sideways from the reader’s perspective.
  • 2:14 - 2:20
    Not a huge deal, but still, it’s kind of like when you have to tip your head to look at a table.
  • 2:20 - 2:24
    And also — some of you may like this, but I’ve always found this ridge here to be a little inelegant:
  • 2:24 - 2:30
    This feels like a medical device more than something that belongs in the kitchen.
  • 2:30 - 2:37
    And, when I went to the grocery store today, I actually found this measuring cup by Pyrex:
  • 2:37 - 2:44
    It takes the insight from the OXO measuring cup — that you can measure from above —
  • 2:44 - 2:46
    and improves upon it in two ways:
  • 2:46 - 2:53
    The first is that the numbers right here are readable from the reader’s perspective.
  • 2:53 - 2:58
    Hold it in the right hand if you want ounces, or in your left hand if you want millilitres.
  • 2:58 - 3:04
    The second is that, for me at least, this design is a whole lot cleaner and nicer-looking.
  • 3:07 - 3:10
    So, in this humble story of a better measuring cup,
  • 3:10 - 3:16
    Alex Lee at OXO has provided us with four important lessons about human-centred design.
  • 3:17 - 3:20
    There’s a common story that the carmaker Henry Ford once said,
  • 3:20 - 3:26
    “If I asked people what they wanted, they would have said ‘a faster horse.’”
  • 3:26 - 3:33
    [It] turns out that they probably didn’t say that — it’s probably made up — but it makes a good point.
  • 3:33 - 3:36
    Our first lesson is that in both transit and in cookware,
  • 3:36 - 3:42
    simply asking people what they want can often miss important opportunities.
  • 3:42 - 3:46
    The second is that you can find these problems and opportunities — like poor ergonomics —
  • 3:46 - 3:51
    by going out into the field and discovering what people actually do.
  • 3:51 - 3:56
    And, third, you can get extra power out of this observation by bringing prototypes along with you.
  • 3:56 - 4:00
    Fourth, the world is full of people tinkering in their garage,
  • 4:00 - 4:06
    and everyone wins when the stars align to bring those things into the world.
  • 4:06 - 4:11
    With measuring cups, like user interfaces, you can think of there as being two steps:
  • 4:11 - 4:19
    The first is having some action.
  • 4:19 - 4:22
    And the second is evaluating the outcome.
  • 4:22 - 4:28
    At each of these steps, you, as a designer, has an opportunity for success or for failure.
  • 4:28 - 4:34
    In our first step, what you have to cross is the gulf of execution:
  • 4:34 - 4:37
    How does the user know what to do?
  • 4:38 - 4:43
    And the gulf that you have to help the user cross is the gulf of evaluation:
  • 4:43 - 4:46
    How does the user know what happened?
  • 4:47 - 4:51
    My sketch here is based on a diagram that my colleague Bill Verplank often uses.
  • 4:52 - 4:59
    As a designer, here are six powerful questions that you can ask to ascertain what challenges may arise:
  • 4:59 - 5:04
    How usually can someone determine the function of a device, or what actions are possible?
  • 5:05 - 5:11
    And then, how can I determine the mapping from their goals to their physical movements —
  • 5:11 - 5:14
    what they actually do with the user interface?
  • 5:15 - 5:20
    Once they have the plan, how usually can they execute that action?
  • 5:21 - 5:27
    And, after they’ve executed that action, how usually can they tell what state the system is in
  • 5:27 - 5:30
    or whether it’s in a desired state?
  • 5:31 - 5:35
    And, more generally, can they figure out the mapping between the system state
  • 5:35 - 5:37
    and what they should interpret that to mean?
  • 5:38 - 5:43
    And, as a designer, here’s several things that you can do to actually make these easier:
  • 5:43 - 5:48
    The first and simplest is, if there’s functionality that a system can do,
  • 5:48 - 5:52
    the best way to communicate that to the user is to put that on the screen —
  • 5:52 - 5:55
    make it visible in one way or another.
  • 5:55 - 6:00
    And, if it’s in the physical world, give it a handle, or knob, or button.
  • 6:00 - 6:04
    These cues to action are called “affordances”.
  • 6:04 - 6:09
    Second, provide users with clear, continuous feedback, so they know exactly what’s happening.
  • 6:09 - 6:16
    Third, all things equal, be consistent with existing standards, platform conventions, and other idioms.
  • 6:16 - 6:22
    Fourth, whenever you can, make it possible for people to back up, through Undo or some other mechanism:
  • 6:23 - 6:26
    Very few things should be permanent and irreversible.
  • 6:26 - 6:29
    A benefit of having all operations being non-destructive
  • 6:29 - 6:32
    is that it also enables users to explore and try out things;
  • 6:32 - 6:35
    and especially in creative applications,
  • 6:35 - 6:40
    you see that people will try down branches and use Undo to come back.
  • 6:40 - 6:47
    Fifth, provide a systematic way for people to discover all of the functionality available in an application.
  • 6:47 - 6:50
    If you watched somebody use a new website, for example,
  • 6:50 - 6:54
    one thing that you might see them do when they’re trying to figure out how to navigate it,
  • 6:54 - 7:00
    is [to] roll over all the menu bars, to see what every option that’s out there is.
  • 7:00 - 7:05
    And, finally, reliable software is a usability issue:
  • 7:05 - 7:10
    The thing that’s supposed to happen should [happen]; and random stuff that isn’t, shouldn’t.
  • 7:10 - 7:14
    I know that reliability is easier said than done, but it’s still really important;
  • 7:14 - 7:19
    and a lot of the interfaces that people really like have this property of reliability.
  • 7:19 - 7:24
    So, now that we have these new conceptual tools of a gulf of execution and evaluation —
  • 7:24 - 7:30
    of knowing what you can do and whether what you’ve wanted is what happened —
  • 7:30 - 7:34
    let’s take a look at a video that Bill Moggridge and colleagues at IDEO put together
  • 7:34 - 7:39
    about someone trying to buy a soda from a vending machine in Japan
  • 7:39 - 7:42
    using their mobile phone.
  • 7:42 - 7:46
    While you’re watching this video, think about what’s causing the breakdowns,
  • 7:46 - 7:53
    and how you might fix them by using the bullet points that we’ve outlined in this lecture today.
  • 10:27 - 10:29
    We started out today looking at physical products,
  • 10:29 - 10:33
    and we moved on to explore smart products and mobile phones.
  • 10:33 - 10:39
    Now let’s think about what direct manipulation and the gulfs of execution and evalution mean
  • 10:39 - 10:41
    for building software.
  • 10:41 - 10:46
    What’s better? A command line or a graphical user interface?
  • 10:46 - 10:49
    Well, I think the answer is going to have to be “it depends.”
  • 10:49 - 10:54
    Nearly every design is good for something and bad for something else.
  • 10:54 - 10:59
    But let’s try to figure out what makes them different: think about moving a file between two folders.
  • 10:59 - 11:05
    On a graphical user interface, you simply pick it up in one location, and drop it in another:
  • 11:05 - 11:10
    You have continuous feedback about what’s happening.
  • 11:10 - 11:14
    All of the objects that are of interest to you are available onscreen,
  • 11:14 - 11:19
    and you can simply point at what you want — “input on output”.
  • 11:19 - 11:24
    With a command line, you have to know, a priori, what the name of the command that is that you’d like to use.
  • 11:24 - 11:29
    You also have to remember the syntax for using that move command
  • 11:29 - 11:32
    there’s minimal feedback about whether the operators that you’re dealing with —
  • 11:32 - 11:36
    like files or folders — are actually available,
  • 11:36 - 11:41
    and there’s not much in confirmation that you’ve moved it ultimately to the right place —
  • 11:41 - 11:45
    it can be easy to make errors.
  • 11:45 - 11:49
    What we see with the graphical interface is the power of direct manipulation —
  • 11:49 - 11:54
    immediate feedback on all actions, continuous representations of the objects,
  • 11:54 - 11:58
    and they leverage metaphors that we have from the physical world.
  • 11:58 - 12:01
    These metaphors are especially important when you’re learning a new interface,
  • 12:01 - 12:04
    and so when the graphical interface was first released,
  • 12:04 - 12:10
    being able to rely on what people knew about desks, folders, and files was really helpful;
  • 12:10 - 12:15
    those become less valuable once you’ve become accustomed to the computer world.
  • 12:15 - 12:18
    So, give some thought to which of these principles hold
  • 12:18 - 12:22
    for both the command-line interface and the graphical interface.
  • 12:23 - 12:24
    From my perspective,
  • 12:24 - 12:31
    the graphical interface does a much better job in terms of visibility, feedback, and consistency.
  • 12:34 - 12:37
    In either interface style, Undo is possible,
  • 12:37 - 12:42
    although the GUI generally does a better job of exposing when Undo is available
  • 12:42 - 12:46
    and what undoing will actually do.
  • 12:48 - 12:53
    One place that a graphical interface really shines is in terms of discoverability —
  • 12:53 - 12:59
    you can leaf through every single menu in a system, and see all of the operations that are there;
  • 12:59 - 13:01
    with a command-line interface,
  • 13:01 - 13:07
    there’s really no way to know what’s the full set of operations that you could possible type into a terminal.
  • 13:07 - 13:12
    There’s no mater list.
  • 13:12 - 13:17
    In terms of reliability, either interface style can be made to be reliable.
  • 13:20 - 13:23
    “But how can this be?” some of you may be saying,
  • 13:23 - 13:27
    “The command-line interface can be so much better sometimes!”
  • 13:27 - 13:30
    And it is!
  • 13:30 - 13:31
    When is that?
  • 13:31 - 13:33
    The command-line interface works better
  • 13:33 - 13:40
    when the indirection that it offers is a benefit rather than a drawback.
  • 13:40 - 13:43
    And in fact that indirection that it offers is a kind of abstraction,
  • 13:43 - 13:46
    and that’s what gives programming its power,
  • 13:46 - 13:51
    and so the command-line interface, like programming — because in some way it kind of is programming —
  • 13:51 - 14:00
    gets its power when you can express stuff more abstractly and thereby do work more efficiently.
  • 14:00 - 14:07
    So, for example, moving all of the files that match a certain set of criteria from one place to another,
  • 14:07 - 14:11
    that can sometimes be more efficiently accomplished with a command line.
  • 14:11 - 14:16
    And even that wonderful discoverability of the graphical user interface has a dark side:
  • 14:17 - 14:20
    This is a picture from my colleague Takeo Igarashi.
  • 14:20 - 14:26
    Takeo made this picture by turning on all of the menu bars in a certain version of Microsoft [PowerPoint].
  • 14:26 - 14:32
    And you can see that, on his laptop screen, all of those menu bars crowded things out so much
  • 14:32 - 14:36
    that there was almost no screen left over for the slides.
  • 14:36 - 14:41
    So, is this interface discoverable? Absolutely! All of the functionality is right there.
  • 14:41 - 14:46
    But you pay a cost in terms of screen real estate.
  • 14:46 - 14:50
    In this introductory course, we won’t have a chance to talk much about gestural interfaces.
  • 14:50 - 14:54
    But, given their recent popularity, and tablet interfaces, game controllers,
  • 14:54 - 15:00
    and movies like « the Minority Report », I want to conclude today’s lecture with an eye to the future:
  • 15:00 - 15:04
    Gestural interfaces offer a wonderful solution to menu creep,
  • 15:04 - 15:08
    in that they don’t take up any permanent screen real estate.
  • 15:08 - 15:14
    The downside, of course, is that they are non–self-disclosing —
  • 15:14 - 15:18
    you don’t know what functionality might be available.
  • 15:18 - 15:25
    And, at their best, gestural interfaces can be even more direct than their graphical user interface counterpart.
  • 15:25 - 15:31
    In recent years, I’ve watched in amazement at people of all ages and from all backgrounds
  • 15:31 - 15:36
    have figured out how to use tablet computers really effectively.
  • 15:36 - 15:39
    And the directness, I think, is one big reason for that.
  • 15:39 - 15:42
    Learning to use a mouse is actually kind of a big deal:
  • 15:42 - 15:44
    Once you’ve got the hang of it you forget that,
  • 15:44 - 15:47
    but there is this indirectness that you’ll have to learn
  • 15:47 - 15:51
    that what you’re doing over here matters over here.
  • 15:51 - 15:56
    With a tablet, the thing that you touch is the thing that you’re interacting with.
  • 15:56 - 16:03
    And the best gestures in these interfaces, like pinching to zoom, just feels so natural —
  • 16:03 - 16:09
    the metaphor is very clear, the feedback is immediate, the outcome is predictable.
  • 16:09 - 16:14
    In other cases, when the mapping is more arbitrary or harder to guess,
  • 16:14 - 16:17
    I think these interfaces are less effective.
  • 16:17 - 16:24
    For example, if I swipe with four fingers, that will bring up a menu bar on an iPad.
  • 16:24 - 16:28
    How on earth would I ever figure that out?
  • 16:28 - 16:33
    So, in gestural interfaces, like in all others, things work best when the feedback is clear,
  • 16:33 - 16:38
    and the interface provides cues through metaphors or visual signals
  • 16:38 - 16:42
    that help you know what you can do within the user interface.
  • 16:42 - 16:46
    To learn more about direct manipulation interfaces and the psychology of design,
  • 16:46 - 16:50
    I strongly recommend Don Norman’s book « The Design of Everyday Things ».
  • 16:50 - 16:53
    We’ll see you next time.
Title:
Lecture 4.1: Direct Manipulation (16:53)
Video Language:
English

English subtitles

Revisions