Cocktail Party Effect Researchers Use Robot To Study Human Hearing In Noisy Environment

Scientists call it the "cocktail party problem." To understand the person talking to you in a noisy room, you've got to filter out all of the conversations, clinking glass, and other noises in the background. Fortunately, our brains are up to the challenge, and now—thanks to a little help from a humanoid robot—researchers have found new clues to how we do it.

A group of hearing scientists at NTT Communication Science Laboratories in Kagawa, Japan, conducted the study. The researchers didn't head out to their
local bar to investigate the cocktail party problem. Instead, they opted for a far more antisocial environment. They recruited volunteers and asked
them to sit alone in a small room and face a speaker. Then the team played a combination of two different tones (somewhat like the sound file at right). At first, just like people at a loud
party, the volunteers heard the sound as one cacophonous noise. But within a few seconds, they were able to isolate one tone from the other.

Then the researchers brought in the robot. Team leader Hirohito Kondo explains that he and his colleagues wanted to know if head movements could reset
the cocktail party effect—that is, once we've filtered out the background noise, does turning our heads bring back the cacophony? It's not an easy
question to answer. When we turn our heads, sounds reach our ears in a different way, the sources of various sounds appear to shift, and we even pay
attention to different things. The robot—a humanoid head with built-in microphones designed to mimic how we hear—helped Kondo's team figure out
which, if any, of these factors could reset the cocktail party effect.

Here's how the experiments worked. In one room a human volunteer listened to the two-toned sound relayed from microphones in the robot's ear canal. At
various points, the researchers would instruct the volunteer to turn his or her head. In another room, the robot turned its head in synch with the
person's. With a series of trials using this setup—some in which only the source of the sound changed, some where there was only head motion, and
some with both—the team was able to isolate the consequences of head motion on the cocktail party effect.

Rapid head motion resets the cocktail party effect, Kondo and colleagues report online today in the Proceedings of the National Academy of Sciences. But just changing the things we pay attention
to—in this case, the human looking at different LED lights placed across the room—does not. And when the cocktail party effect is reset and the
cacophony returns, the researchers found, it only takes a few seconds for our brain to sift out the noises again. So a quick swivel of the head makes
us reset our perception of what we're hearing. We then start the process of teasing out the separate parts of the noise again.

Josh McDermott, a hearing scientist at New York University, describes the research as "highly novel" and points out that the key result is surprising.
"If you move your head such that the acoustic stimulus at the ears changes, but the environment itself doesn't, you wouldn't have thought you would
need to restart the process of interpretation," he says.

This setup does not appear to be optimal, he adds, because it means that you're re-evaluating the auditory scene for no good reason. "For me the take
home from this paper is that this is not actually adaptive. It reveals a little bit of a bug in the system: that your brain can't completely discount
the effect of the head motion."

Al Bregman, a hearing scientist at McGill University in Montreal, Canada, was impressed by the research but is reluctant to believe that such a flaw in
the brain exists. Instead, he suggests, there could be a problem with the sound stimulus used in these sorts of studies. "The system is so exquisite in
its capabilities, able to detect sub-millisecond asynchronies between the signals at the two ears," he says, "that it is hard for me to believe that
the Kondo et al. results reflect a crude flaw in the system."

Original article:
http://news.sciencemag.org/sciencenow/2012/04/of-robots-and-cocktails.html?rss=1

ScienceNOW, the daily online news service of the journal Science

Also on HuffPost:

Comments

[jonny dipstick]

04:40 PM on 04/10/2012

That's not creepy, its awesome! Now make me a female one!

[Ossit]

02:00 AM on 04/12/2012

I just saw a video a while back of a female robot on display in a Japanese show window. It looked as artificial as this one. A female robot would be great for you, johnny dipstick. Nothing but pre-programmed responses.

[jonny dipstick]

09:06 AM on 04/12/2012

Oh cool! That would be so nice. I would enjoy the predictability and fact that I dont have to talk with her about stupid stuff.

[tree456]

08:40 PM on 04/09/2012

Transhumanism, human non-humans, artifical intelligance, genetic engineering of humans/animals/plants. What some people do not realize is there is a new constiitution being drafted up right now ( in Ohio) with contributions ($733,000) from the FEDS for post humanity. Nat Geo in 2007 reported that the first human non-human would be unveiled within 10 years. Not my idea of progress. more like replacment.

[Gas-Bag]

10:45 PM on 04/09/2012

If it doesn't mind doing the dishes, I'm all for it.

[Ossit]

02:09 AM on 04/12/2012

Once saw a German robot(it didn't have human form though)cooking, making sandwiches loading and unloading a dishwasher. But they had to be programmed with parameters first, then amazingly, the robots figured out how to make sandwitches, take a casserole out of the oven, load/unload a dishwasher. I suppose one day there'll be a human looking(with a lot more work)robot who'd actually get its hands wet washing dishes and pre-programmed. We've come a long way in robotics from just learning how to walk without falling over. You ever see the Japanese robot Asimo, Gas-Bag? He's amazing! He can walk and jog unassisted and even climb any type of ladder with 'his' programming. There's this other prototype robot head that looks like Einstein that can perfectly mimic human expression, and another named Julian, who can talk with a lot of programming. Now 'he' looks scarily real. And he has an English accent.