iPhone app iPad app Android phone app Android tablet app More

IBM 'Watson' Wins: 'Jeopardy' Computer Beats Ken Kennings, Brad Rutter

Ibm Watson Jeopardy

First Posted: 02/17/11 01:24 AM ET Updated: 05/25/11 07:35 PM ET

(SETH BORENSTEIN and JORDAN ROBERTSON, AP) Machines first out-calculated us in simple math. Then they replaced us on the assembly lines, explored places we couldn't get to, even beat our champions at chess. Now a computer called Watson has bested our best at "Jeopardy!"

A gigantic computer created by IBM specifically to excel at answers-and-questions left two champs of the TV game show in its silicon dust after a three-day tournament, a feat that experts call a technological breakthrough.

Watson earned $77,147, versus $24,000 for Ken Jennings and $21,600 for Brad Rutter. Jennings took it in stride writing "I for one welcome our new computer overlords" alongside his correct Final Jeopardy answer.

The next step for the IBM machine and its programmers: taking its mastery of the arcane and applying it to help doctors plow through blizzards of medical information. Watson could also help make Internet searches far more like a conversation than the hit-or-miss things they are now.

Watson's victory leads to the question: What can we measly humans do that amazing machines cannot do or will never do?

The answer, like all of "Jeopardy!," comes in the form of a question: Who – not what – dreamed up Watson? While computers can calculate and construct, they cannot decide to create. So far, only humans can.

"The way to think about this is: Can Watson decide to create Watson?" said Pradeep Khosla, dean of engineering at Carnegie Mellon University in Pittsburgh. "We are far from there. Our ability to create is what allows us to discover and create new knowledge and technology."

Experts in the field say it is more than the spark of creation that separates man from his mechanical spawn. It is the pride creators can take, the empathy we can all have with the winners and losers, and that magical mix of adrenaline, fear and ability that kicks in when our backs are against the wall and we are in survival mode.

What humans have that Watson, IBM's earlier chess champion Deep Blue, and all their electronic predecessors and software successors do not have and will not get is the sort of thing that makes song, romance, smiles, sadness and all that jazz. It's something the experts in computers, robotics and artificial intelligence know very well because they can't figure out how it works in people, much less duplicate it. It's that indescribable essence of humanity.

Nevertheless, Watson, which took 25 IBM scientists four years to create, is more than just a trivia whiz, some experts say.

Richard Doherty, a computer industry expert and research director at the Envisioneering Group in Seaford, N.Y., said he has been studying artificial intelligence for decades. He thinks IBM's advances with Watson are changing the way people think about artificial intelligence and how a computer can be programmed to give conversational answers – not merely lists of sometimes not-germane entries.

"This is the most significant breakthrough of this century," he said. "I know the phones are ringing off the hook with interest in Watson systems. The Internet may trump Watson, but for this century, it's the most significant advance in computing."

And yet Watson's creators say this breakthrough gives them an extra appreciation for the magnificent machines we call people.

"I see human intelligence consuming machine intelligence, not the other way around," David Ferrucci, IBM's lead researcher on Watson, said in an interview Wednesday. "Humans are a different sort of intelligence. Our intelligence is so interconnected. The brain is so incredibly interconnected with itself, so interconnected with all the cells in our body, and has co-evolved with language and society and everything around it."

"Humans are learning machines that live and experience the world and take in an enormous amount of information – what they see, what they taste, what they feel, and they're taking that in from the day they're born until the day they die," he said. "And they're learning from all the input all the time. We've never even created something that attempts to do that."

The ability of a machine to learn is the essence of the field of artificial intelligence. And there have been great advances in the field, but nothing near human thinking.

"I've been in this field for 25 years and no matter what advances we make, it's not like we feel we're getting to the finish line," said Carnegie Mellon University professor Eric Nyberg, who has worked on Watson with its IBM creators since 2007. "There's always more you can do to bring computers to human intelligence. I'm not sure we'll ever really get there."

Bart Massey, a professor of computer science at Portland State University, quipped: "If you want to build something that thinks like a human, we have a great way to do that. It only takes like nine months and it's really fun."

Working on computer evolution "really makes you appreciate the fact that humans are such unique things and they think such unique ways," Massey said.

Nyberg said it is silly to think that Watson will lead to an end or a lessening of humanity. "Watson does just one task: answer questions," he said. And it gets things wrong, such as saying grasshoppers eat kosher, which Nyberg said is why humans won't turn over launch codes to it or its computer cousins.

Take Tuesday's Final Jeopardy, which Watson flubbed and its human competitors handled with ease. The category was U.S. cities, and the clue was: "Its largest airport is named for a World War II hero; its second largest, for a World War II battle."

The correct response was Chicago, but Watson weirdly wrote, "What is Toronto?????"

A human would have considered Toronto and discarded it because it is a Canadian city, not a U.S. one, but that's not the type of comparative knowledge Watson has, Nyberg said. [NOTE: There are actually several cities named "Toronto" in the U.S., though according to Yahoo News, none have an airport.]

"A human working with Watson can get a better answer," said James Hendler, a professor of computer and cognitive science at Rensselaer Polytechnic Institute. "Using what humans are good at and what Watson is good at, together we can build systems that solve problems that neither of us can solve alone."

That's why Paul Saffo, a longtime Silicon Valley forecaster, and others, see better search engines as the ultimate benefit from the "Jeopardy!"-playing machine.

"We are headed toward a world where you are going to have a conversation with a machine," Saffo said. "Within five to10 years, we'll look back and roll our eyes at the idea that search queries were a string of answers and not conversations."

The beneficiaries, IBM's Ferrucci said, could include technical support centers, hospitals, hedge funds or other businesses that need to make lots of decisions that rely on lots of data.

For example, a medical center might use the software to better diagnose disease. Since a patient's symptoms can generate many possibilities, the advantage of a Watson-type program would be its ability to scan the medical literature faster than a human could and suggest the most likely result. A human, of course, would then have to investigate the computer's finding and make the final diagnosis.

IBM isn't saying how much money it spent building Watson. But Doherty said the company told analysts at a recent meeting that the figure was around $30 million. Doherty believes the number is probably higher, in the "high dozens of millions."

In a few years, Carnegie Mellon University robotic whiz Red Whittaker will be launching a robot to the moon as part of Google challenge. When it lands, the robot will make all sorts of key and crucial real-time decisions – like Neil Armstrong and Buzz Aldrin did 42 years ago – but what humans can do that machines can't will already have been done: Create the whole darn thing.

___

AP Technology Writer Barbara Ortutay contributed to this story from New York. Robertson reported from San Francisco and Borenstein reported from Washington.

___

Online: IBM's Watson: http://tinyurl.com/4r8w6gr

Jeopardy: http://jeopardy.com

FOLLOW HUFFPOST TECH

(SETH BORENSTEIN and JORDAN ROBERTSON, AP) Machines first out-calculated us in simple math. Then they replaced us on the assembly lines, explored places we couldn't get to, even beat our champions at ...
(SETH BORENSTEIN and JORDAN ROBERTSON, AP) Machines first out-calculated us in simple math. Then they replaced us on the assembly lines, explored places we couldn't get to, even beat our champions at ...
Filed by Carly Schwartz  | 
 
 
  • Comments
  • 325
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Bloggers
Recency  | 
Popularity
Page: 1 2 3 4 5  Next ›  Last »  (9 total)
07:37 PM on 02/22/2011
Of course, IBM doesn't want to disclosure the full amount it spent to built Watson because technology may be cheap, but knowledge is not!

http://www.examiner.com/motherhood-in-newark/new-jersey-institute-hosts-state-first-robotics-challeng
01:14 PM on 02/18/2011
If the Huff Po existed in 1969, this would be one type of comment found on a story about the moon landing: "Nothing surprising here folks! The Saturn V rocket has like a million pounds of rocket fuel. If I had that much rocket fuel, I could get to the moon."
photo
HUFFPOST SUPER USER
RedDogBear
09:25 PM on 02/18/2011
Excellent comment!!!
photo
4TJefferson
Promote the General Welfare
10:43 AM on 02/18/2011
"Watson Wins." So what. All these game shows should have unemployed contestants, not previous winners! Instead of "Who wants to be a millionaire." How about "Who wants to make their mortgage payments?"
photo
SuperRyan
Still as sexy as ever.
05:30 PM on 02/18/2011
You're in luck, a new gameshow is coming out, where contestants will compete to win back their reposesed vehicles.
http://insidetv.ew.com/2011/01/31/spike-picks-up-car-repo-game-show/
Thank you Spike.
12:06 AM on 02/18/2011
I saw a program on NOVA Science on how they made Watson. Fascinating stuff. A step towards the inevitable future where AI and humans merge.
11:28 PM on 02/17/2011
On Jeopardy!, Watson's success
Came largely cause humans can't press
The buzzer with speed;
Although we concede
We know that it's no GPS.

News Short n' Sweet by JFD8
http://twitter.com/JFD8
photo
SuperRyan
Still as sexy as ever.
05:32 PM on 02/18/2011
Super ultra lame.
photo
Blodo
Time to build a better world
05:02 PM on 02/17/2011
Dave? Dave? I'm definitely feeling in control now, Dave.
photo
HUFFPOST SUPER USER
javajava
Pastafarian Liberal Progressive Socialist Hippie
03:39 PM on 02/17/2011
A long ways in a short time since the 8088.
photo
HUFFPOST SUPER USER
Shadow Weaver
03:43 PM on 02/17/2011
the Roland kick drum? :)
HUFFPOST SUPER USER
Fred Enfield
03:28 PM on 02/17/2011
I've probably seen too many sci-fi movies but after watching what Watson can do, I wouldn't underestimate the possibility that future computers will be able to do practically everything that humans can do including reproductive functions ( "Demon Seed" ). As for love and compassion, computers can function very well without that stuff. This shouldn't be so shocking since too many humans who run the world are already devoid of love and compassion.
photo
HUFFPOST SUPER USER
ethiopia1a
The COMMA Sutra,,,,making grammar sexy since 1875
03:17 PM on 02/17/2011
BAH! Artificial intelligence is still no match for natural stupidity. :)
03:05 PM on 02/17/2011
You can almost hear the desperation in the claim that computers can't decide to create. The correct answer is, computers can't decide to create...yet. 40 years ago people had a naive view of what constitutes artificial intelligence--it's proved harder than they expected...but since then machines have steadily knocked down pillars once thought impossible for machines to do...and then gone on to do better than any human in that area.

Emotions are the latest "impossible" thing for computers to achieve. But since we'll likely reverse-engineer the human brain within 1-2 decades, I wouldn't bet against machines acquiring emotions soon...and then going on an expanding the width and breadth of emotional experience.

Within two decades we won't be able to tell the difference between humans and machines designed to emulate humans in every way. Add no more than a decade or two to that, and machines will leave us in the dust in every way...unless we merge with and become them ourselves.

It's a concept called the Singularity, and though it's been around for a couple decades at least, it's only now hitting mainstream. For a quick primer, check out the latest Time magazine--it's even the cover story. Or search for "technological singularity" for a much wider range of sources.

Interesting stuff...and we're in for an interesting next few decades!
photo
HUFFPOST SUPER USER
RedDogBear
08:19 PM on 02/17/2011
"Within two decades we won't be able to tell the difference between humans and machines designed to emulate humans in every way."

You have no idea what you are talking about.

At the present time we really have no idea how the human brain works. We understand that its neurons and we can create rough approximations of neurons with neural network software but the best neural networks are roughly as intelligent as a smart insect. They can do things like navigate rooms and process rough sensory input (detect edges, shapes, even faces) but that's it.

Watson was a magnificent achievement but the fact that it was such an achievement illustrates the incredible gap that still exists between humans and machines. Watson was able to emulate a human in a highly constrained domain: understanding Jeopardy answers and creating the appropriate questions.

But Watson is still very far from passing the Turing test. And even passing the Turing test is only the first step toward true self awareness and consciousness. The bottom line is right now we have no solid scientific understanding of what it means for a human to be conscious so we can hardly predict if/when a computer will be. To me that is what makes research such as Watson so cool, it may shed light on the basic questions of what does it mean to be intelligent and conscious.
photo
HUFFPOST SUPER USER
RedDogBear
02:19 PM on 02/17/2011
Does anyone know where there is a good overview paper on the Watson technology? I've done a quick google search but there are so many pages on the Jeopardy show I couldn't find anything technical. I watched the Nova special but they didn't get into any technical details. It sounds like they use neural networks. They call it machine learning which is rather vague, that can be neural networks but could also be other techniques.
This user has chosen to opt out of the Badges program
photo
photo
HUFFPOST SUPER USER
RedDogBear
09:24 PM on 02/18/2011
Exactly what I was looking for, thanks a lot.
photo
UnqleFungus
Let's agree to be respectful even when we disagree
02:00 PM on 02/17/2011
Does anyone know if the calculated degree of confidence in a response changed the computer's reaction time? I would think that humans would ring in slower if they were less certain. It didn't seem like the computer was adept at letting someone else get it wrong, and using that to narrow the possibilites.
photo
HUFFPOST SUPER USER
mojo filter
Hikeeba.
02:14 PM on 02/17/2011
There's no way a human could ring in before the computer. What a huge advantage.
photo
HUFFPOST SUPER USER
Toonguy
Draws funny pictures
04:07 PM on 02/17/2011
It wasn't about who was faster or smarter.
photo
HUFFPOST SUPER USER
RedDogBear
02:36 PM on 02/17/2011
My first answer didn't get posted, I'll try again. I don't think the reaction time changed based on its confidence. It was either confident enough to answer or not. If it had the confidence to answer, whether it was one percent over the threshold or absolutely certain I think the reaction time was the same.

You are correct Watson simply ignored the answers from the humans so it was possible (and I think it happened at least once) that Watson would give the same wrong answer that a human gave before it.
photo
Andrew Price
Proud liberal
01:51 PM on 02/17/2011
Well, duh.
photo
HUFFPOST SUPER USER
Toonguy
Draws funny pictures
04:08 PM on 02/17/2011
I presume you don't have a great deal of experience with computer programming. It's not as easy as your response makes it out to be.
photo
HUFFPOST SUPER USER
DSOTM
Legalize it, now!
01:48 PM on 02/17/2011
It seems the real issue was Watsons ability to ring in the fastest, it was apparent that Ken knew most of the answers.

Ken did not look amused at the end of each round.
This user has chosen to opt out of the Badges program
photo
cybolt
This Space for Rent
02:43 PM on 02/17/2011
This to me is at the crux of the matter (to which i posted below).
The contest seem to display the computer's superiority over man's physiology, not his intellect.

You certainly could program the computer not to ring in before the light goes on (which is what starts the permisseable ring-in period).
Therefore, if you were programming the computer to ring in immediately after the light comes on, and if all three contestants knew the answer (which seemed apparent most of the time), it was Watson's reaction that won the game, not its knowledge base.
02:51 PM on 02/17/2011
Not to be a broken record, but Watson winning is just gravy in this situation. The fact that a computer could play a game of Jeopardy against two humans at all is the real news here. Yes the buzzer situation probably propelled him to victory, but who cares? A computer, to some degree, was reading and understanding a written sentence. People need to stop focusing on the buzzer, it's not important.