iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Leah Anthony Libresco

Leah Anthony Libresco

Posted: February 21, 2011 01:00 PM

Watching the three-day Jeopardy match between Watson the IBM supercomputer, and former Jeopardy champions Ken Jennings and Brad Rutter, I couldn't help but feel bad for humankind. As a former Jeopardy contestant myself, I knew Watson was beating them where it hurt, not with superior general knowledge of trivia, but by avoiding typical human logical weaknesses.

If you've ever watched Jeopardy at home yelling out answers, you've noticed that contestants can't buzz in until after Alex Trebek finishes reading a question, but in the studio, the procedure is a little more complicated. The buzzing system is turned on by a Jeopardy employee who presses a button in another room once Alex finishes reading. Once the button is pressed, lights come up on the sides of the screen and the buzzers are activated. If you try to buzz in before the activation button is pressed and the lights go on, you're locked out of trying again for a quarter of a second, pretty much guaranteeing you won't get another shot.

After all, whether you're in the College Championship like me, or on the standard show, when you're on Jeopardy, you'll almost never be the only contestant who knows an answer. Once more than one person knows the answer, it all comes down to buzzer timing. Really excellent players like Brad and Ken buzz even if they haven't yet figured out the answer, since they're confident they will have figured it out by the time they're called on. To stand a chance, you have to sync up your reactions to the reflexes of the persons turning on the board, and if you lose your rhythm or the button-pusher varies his timing, you quickly get left behind.

Watson does better at buzzing, not because his electrical relays are so much faster than our nervous system (also running on electrical signaling), but because he has less data about when to buzz in. Watson doesn't receive any audio input -- he doesn't hear Alex read the clues or other players try to answer them. His buzzer timing is based solely on the electrical signal he receives. Players are much slower to react to the cue, since the signal lights may not come on when we expect them to, based on the pacing and tone of Alex's voice and the previous timing of the board-unlocking button.

More data can be a detriment to accurate decision making. In his 2004 book The Paradox of Choice: Why More Is Less, psychologist Barry Schwartz made a case that when people are confronted with too many options, they cannot efficiently choose between them. The strain of choosing and filtering causes emotional exhaustion and pain. And even when we escape emotional consequences of data overload, our reasoning can still be perverted by too much information.

In a famous test of logical reasoning, researchers Amos Tversky and Daniel Kahneman showed people this question:

Linda is 31 years old, single, outspoken, and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations.
Which is more probable?

1. Linda is a bank teller.
2. Linda is a bank teller and is active in the feminist movement.

Eighty-five percent of those surveyed picked option two. Despite their conviction, option two is definitionally less likely. Both options assume Linda is a bank teller, but option two assumes that Linda is a bank teller and also is an active feminist. If proposition two is true, proposition one must be true, but if proposition one is true, proposition two could still be false. Option one must be more likely, but the additional data given in option two cause more respondents to gravitate to it. This mistake is very common and is called the conjunction fallacy. People feel like more details point to plausibility, even though the opposite is true.

You can take advantage of this flaw in human reasoning if you're ever stuck in a long line. In a 1978 study, researchers Langer, Blank, and Chanowitz found that people in line at a Xerox machine were more willing to let someone cut in line if s/he said, "Excuse me, I have five pages. May I use the Xerox machine because I'm in a rush?" than if the person said, "Excuse me, I have five pages. May I use the Xerox machine?" Being in a rush wasn't new data -- why else would they ask to jump the line -- but the perception of more data, explanatory data, influenced the people in line to accede to the line-skipper.

Human reasoning is littered with similar flaws -- the detritus of evolutionary pressures. Overcoming our biases is difficult, but learning where we're weakest is a good first step. The IBM team did an excellent job programming Watson. Maybe their next task should be reprogramming us.

 

Follow Leah Anthony Libresco on Twitter: www.twitter.com/leahlibresco

Watching the three-day Jeopardy match between Watson the IBM supercomputer, and former Jeopardy champions Ken Jennings and Brad Rutter, I couldn't help but feel bad for humankind. As a former Jeopard...
Watching the three-day Jeopardy match between Watson the IBM supercomputer, and former Jeopardy champions Ken Jennings and Brad Rutter, I couldn't help but feel bad for humankind. As a former Jeopard...
 
 
  • Comments
  • 6
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
photo
HUFFPOST SUPER USER
Robert Blackburn
12:47 PM on 02/25/2011
When we finally program the human mind in the computer, its abilities will far exceed anything we
can presently envision; however, we're still a long way from a working model of the human mind -
but not because we lack the hardware, software, or programming skills. The artificial intelligence
community has yet to concede that the human mind is directed by a program for "survival," which is
the only program of the human mind that can be placed in the machine at this time - or in the foreseeable future. The machine cannot feel pain, pleasure, or sex, so these programs are currently un-workable in the computer; but the survival program can be reproduced in today's computers. For
more, see: RevolutionOfReason.com and YouTube: RobertLBlackburn
This user has chosen to opt out of the Badges program
photo
09:09 PM on 02/22/2011
I did not know Jeopardy was this screw up, this system leave the door wide open for game fixing.
08:27 PM on 02/22/2011
As HAL 9000 illustrated in "2001 A Space Odyssey", computers can fool people some of the time, but not all of the time.

In fact, the reason computers will never completely take over the world is one of human beings' earliest intellectual evolutions: The Tantrum.

How many Smart-Aleck computers have succumbed to a fist brought down hard on their cases (their keyboards when they were integral units), to being picked up and slammed down, to being kicked over or across rooms, even only to having their plugs yanked from the wall when their data was processing, or not saved?

How many? No one will ever know. For some reason almost no one will ever confess to killing their computer.

The computers almost always "just died", "just quit", "went haywire", or "(vernacular for engagement in as inexplicable as unlikely sexual activity) up."

Yes, the monkey who can pull the plug, on purpose, rules the world

And always will

At least in his own mind

And will hold his breath until he turns blue if you don't say so, too...
photo
HUFFPOST SUPER USER
Infostream
03:59 PM on 02/21/2011
I agree the competition is apples and oranges unless Watson is also hearing the question and using voice recognition. IN order for Watson to "know" when the question ends, he's receiving a definite signal, unlike the human contestants. The jeopardy staffer who activates the buzzer is also guessing when the question is over, so it's double guesswork for the humans.

Obviously there was some play in how Watson was set up for this, and I highly doubt IBM would have participated without knowing they'd probably win.
03:35 PM on 02/21/2011
Cool article. Point of order: the study w/ the Xerox machine showed humans to be even sillier than that. In one condition, the person said, "Excuse me, I have five pages. May I use the Xerox machine because I have to make some copies?" This turned out to be just as effective as saying "because I'm in a rush," even though "I have to make some copies" isn't actually a reason for cutting in line.
01:59 PM on 02/21/2011
Watson has an advantage that has nothing to do with knowledge or psychology. Watson is a machine with a reaction time about one million times faster than a human. To slow it down a bit they make it activate a solenoid to press it's button, but it can still reliably buzz in within a few milliseconds of when it gets the signal that answers are allowed. To have any chance of getting in when Watson knows the answer, the humans have to guess when the light will appear and be incredibly lucky.