iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Madeline Schwartzman

GET UPDATES FROM Madeline Schwartzman
 

Put on a Happy Face (Or If You Can't, Use Electricity)

Posted: 04/19/2012 2:11 pm

Happy Halloween -- test 0, 2011

Daito Manabe + Satoru Higa, Rhizomatiks

Halloween is still seven months away, but this dreamy experiment with face tracking will make your day -- and not just on Halloween. Created by researcher and programmer Daito Manabe and Satoru Higa, Happy Halloween is among Manabe's most benign experiments with the human face. The artists used FaceTracker, a sophisticated but user-friendly face tracking system, to detect the movements of Manabe's face in real time, and superimpose onto it creatures and features that turn him into an ever-changing hybridized being. Face tracking isn't new technology, but this video uses it in a process-oriented, refreshingly experimental way, without becoming overly slick and focused on the end product. Manabe is filmed looking into the computer monitor as he tries on different expressions and watches the drawing in action. He really is "seeing himself sensing."

Virtual projections are tolerable, but we humans don't like people or things messing with the face. We may slap on make-up and experiment with new shades of color, get the occasional piercing to create some asymmetry or piss off a parent, kill off a wrinkle or three by injection or resurfacing or go under the knife for major topographical or tensile adjustments. But the latter surgeries are anything but experimental. They are a one-way journey, meant to last.

But there are researchers and artists who see the face as terra incognita, as a potential blank slate, a computer-mutable landscape or testing grounds for understanding the brain and communication. Say goodbye to the benign Happy Halloween and welcome to the X-Games of human research, where engineers, programmers and artists put forward their own bodies as sites of exploration, pushing the limits of the human apparatus and, in the process, delivering feedback on what it means to be human. Whether through surgical implants, new organs or intersections with computers, these researchers are on the cutting edge (truly cutting), considered by some to be extreme and by others, including this author, to be modern day explorers who talk the talk and walk the walk. Among them are University of Reading Professor Kevin Warwick, the first person to connect the nervous system to a computer; Australian performance artist Stelarc, the first person to have a third ear sewn onto his arm; French artist Orlan, whose medium is facial transformation through surgery; University of Toronto Professor Steve Mann, one of the first cyborgs, who has logged over thirty years of "seeing" through his own version of augmented reality; and Daito Manabe and his team of technologists and musicians, among the latest group of researcher to take electrocution to the level of an art form.


Electric Stimulus to the Face -- test4
Manabe: Direction, programming and composition
Supported by Masaki Teruoka and Katsuhiko Harada: device
Taeji Sawai: sound design


Inspired by the work of Guillaume-Benjamin-Amand Duchenne (de Boulogne), a 19th century researcher who identified the specific nerves involved in human facial expressions through the use of electrical stimulation -- shock, essentially -- Daito and his collaborators began experimenting with facial electrical stimulation controlled by a computer, synchronizing individual or groups of faces into a mildly painful ballet that resembles various emotions, but is entirely devoid of them. In Face Visualizer, he syncs up four friends, Muryo Honma, Setsuya Kurotaki, Motoi Ishibashi and Seiichi Saito, to an electronic beat that sometimes makes brows and nostrils swing, and other times scrunches their features up into unbearable grimaces. Is it torture? Maybe a little bit. But it is also productive and fascinating research. "Instead of using technologies to achieve an ever 'higher-resolution' of illusionistic reality," Manabe explains that his work "aims at recovering the beauty of transient events through careful observations and exploration of the basic properties of body, computer and computer programming." Face Visualizer lays bare humanity's common denominator: that we are all really a sack of centrally controlled nerves and muscles and that emotion is a fleeting and inaccurate visual language. One person's electrical shock-induced snarl is another person's distain.

2012-04-19-502pxDuchenneFacialExpressions.jpg
G.-B. Duchanne de Boulogne, Synoptic plate 4, courtesy of Wikimedia commons.


Almost 150 years separates the work of Duchenne de Boulogne and Daito Manabe.
Duchenne de Boulogne's grotesque but elucidating photos of people receiving electrical stimulation to the face, published in his monograph Mécanisme de la Physionomie Humaine, (1862) aimed to decode the relationship between prototypical human internal emotional states -- the soul, so he believed -- and facial expression by charting the neural pathways that triggered the muscles. He used five of his patients for the experiments, and one vacant-seeming toothless old man whose face he deemed blank, and he managed to map out over fifty distinct emotions and associated muscles. While Duchenne de Boulogne used the relatively new medium of photography to disseminate his ideas, Manabe uses the Internet. With the exception of the more polished Face Visualizer video, Manabe typically posts real time experiments where he's viewing and recording his own image in the computer monitor, which means that we're seeing him through the eye of the computer.

But don't try electrical stimulation at home. It's risky and it can have a negative effect on one's vision and breath. Manabe is restricted to undergoing electrocution a maximum of two times a month (he travels extensively and gives workshops. You can try this!). He also experiments with lasers, and LEDs, both less invasive than electrical stimulation. In UV Laser Fadeout an individual is photographed using an infrared camera. A laser then exposes the image, bit by bit, onto a phosphorescent screen. The completed image then slowly fades away. In Party in the Mouth Manabe programs sound and light into an electrical storm behind the teeth.

405nm laser fade out test 2 Daito Manabe + Motoi Ishibashi



Party in the Mouth (led in my mouth -test3)
Sound + light programming: Daito Manabe
LED device programming:Motoi Ishibashi


Manabe's threatened to using trans-cranial magnetic stimulation in the future -- stimulating the brain with pulsed magnetic fields. "I've wanted to experiment with this for a while," he said, "but meddling with the brain is pretty dangerous." If he does go for trans-cranial magnetic stimulation, face electrocution will soon seem like a gentle pastime.

This Blogger's Books from Amazon.com.
'See Yourself Sensing' website: www.madelineschwartzman.com.
Blogger website: www.seeyourselfsensing.blogspot.com/.
Tumblr: seeyourselfsensing.tumblr.com/.
Facebook: www.facebook.com/pages/See-Yourself-Sensing/184369981612805.

 
 
 
FOLLOW SCIENCE
Happy Halloween -- test 0, 2011 Daito Manabe + Satoru Higa, Rhizomatiks Halloween is still seven months away, but this dreamy experiment with face tracking will make your day -- and not just on Ha...
Happy Halloween -- test 0, 2011 Daito Manabe + Satoru Higa, Rhizomatiks Halloween is still seven months away, but this dreamy experiment with face tracking will make your day -- and not just on Ha...
 
 
  • Comments
  • 17
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
photo
HUFFPOST SUPER USER
Christine Shackleton
02:28 PM on 04/23/2012
For me the ear transplant is getting a little close to Dachau -- aussie or not

creative thinking includi8ng voice recognition computers are aussie world firsts--mike and tina
and for power
the leading research boffins for australian government are seeing happy faces--
http://au.news.yahoo.com/today-tonight/video/watch/29048430/power-saving-breakthrough/
HUFFPOST SUPER USER
methodman
12:42 AM on 04/23/2012
Also there is a lot of literature from a curiosity and the subjects spun off are out in the open. I found quite a lot of curious facial state stuff so where you are going is good. I just as a rule of thumb don't buy into ideals by fruition of blank slate. It doesn't happen. Ignorance doesn't create change. Sorry religious.
03:35 AM on 04/23/2012
I am not denying that our bodies are from nature. I recognize there is something that is underlying human essence. Rather, our ascetic ideals deny us the very essence of human nature. There is more to being human than what we know and what we think we know. In fact some things we know to be true could very well be false. Nothing is ever truly knowable of nature because we are not its creators. As Albert Einstein has said, "No problem can be solved by the same level of consciousness that created it." We are able to get closer to truths through technology and other means but perhaps this is the best we can do.
HUFFPOST SUPER USER
methodman
06:57 PM on 04/23/2012
I think you are confused. Buy your kids a copy of Mathematica student version and Maple student version; so that you can expose yourself to it. First of all complicated things are explainable. I subscribe to both Safari online books (technical, math, science) and I take the ideas I read out of that and insert them into Questia.com(liberal arts.) I come up with many surprising tangents that force me to add an extra parameter or re order but I have an idea why certain orders are interesting for particular sets of problems The doubt stuff is for the evangelicals. That group is stupid!!! They have no learn able doctrines and they promote doubt as a gift from their imaginary God. Please don't be like that! You are the one that misses out. I grasp more because I can enlarge my accountability and passions. I was raised religious and through all of it's doubt out. I don't serve doubt. I don't serve religion.
HUFFPOST SUPER USER
methodman
12:37 AM on 04/23/2012
The empty blank slate idea is debunked. Even when I buy a musical sequencing package; there are modes which have to be chosen to begin with. Not everyone can mimic anybody with a super model aire. The good news is that with the aid of patience and yoga odd nervous retardation and twitches can be contacted and reading can bring light and change and heat and geometry into places that don't automatically mature. I know this is going on with me I have changed in the last 10 years more than I ever did in my teenage years. However one has to fight the religious control freaks and while MD's are very supportive they work from disease and this healing doesn't fall under that category. So it is between the cracks and I am on my own. Blank slate was made up by the religious and plantation owners. I hold deep arguments and contempt for it. John Locke also had some backwards editors who had churchly revisionist tendency' The plantation pastors like it, the rest of us will argue against "blank slate."
photo
simzillyjp
Up, Up & Away
04:11 PM on 04/22/2012
Anyone thing we can bbq on "head top" while getting electrified?
03:42 PM on 04/22/2012
art? ho hum, I don't think so
This user has chosen to opt out of the Badges program
02:57 PM on 04/22/2012
I bought a Suzanne Summers thingy for your face. It shocks your face muscles keeping them tight. I tried it and laughed so hard - it hurt! Why did I buy such nonsense? Sometimes I watch the instructional dvd for fun, women shocking their faces while smiling sweetly. Gee, if I want to look great maybe I should put my tongue on the wall-socket.
tccat4
We all have a right to our opinion, like it or not
05:36 AM on 04/23/2012
Like the woman on TV using the electric epilady on her legs....since when is ripping the hairs out in bunches fun... and she is smiling...I swear she is out of her mind or on drugs.....lol

I wondered why Suzanne looked different... now I know.. shock therapy...
02:26 PM on 04/22/2012
Wow. We are living among a time when Nietzsche's philosophy is brought to fruition through science and experimentation. Nietzsche, the famous German philosopher against ascetics, says it is impossible to fully know what we sense because as soon as we sense, the brain immediately translates senses into consciousness. By consciousness, I mean things that have been already created for us through society. As I stare at this computer screen typing, my brain immediately translates all of these sense into one conscious, namely computer screen. What we are actually sensing are photons, pixels, color, shape, and all the most basic elements of life which are summed up into consciousness. Nietzsche says it is impossible to rely on the senses for this reason but now, through these studies, Nietzsche's philosophy is put to the test and rectified so that we are able to think of ourselves in completely different ways through the aid of technology. Thus questioning what it truly means to be human. Being human is not just about the common functionality that we prescribe to it such as hands feeling and eyes seeing. What happens when an eye touches or a hand sees? Thus, our bodies becomes performances, ourselves the actors. in one instant my hand touches, the next it sees. The hand is completely able to do this and more. We are unable to relinquish consciousness because we constantly only use hands to feel; that is what we are told is the functionality of hands from everyone around us.
HUFFPOST SUPER USER
Tim Day
Am I waiting to Live or Waiting to Die.....
01:49 PM on 04/22/2012
That is similiar to an EEG test
photo
HUFFPOST SUPER USER
RealWoman Para
Got any Piccalilli or Chow Chow?
01:40 PM on 04/22/2012
Well, there's 3:43 I'll never get back.
Autora
No micro-bio for me, thanks
01:32 PM on 04/22/2012
Very cool stuff. I'm sure it said in the article, and I missed it, but those are Japanese 'experimenters' if I am not wrong. Trust some young people with some of the world's best technology to start playing around with it!

Made me smile.
01:29 PM on 04/22/2012
How attractive....