iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Jonathan D. Moreno

GET UPDATES FROM Jonathan D. Moreno
 

Robot Soldiers Will Be a Reality -- And a Threat

Posted: 05/14/2012 9:51 am

Much controversy has surrounded the use of remote-controlled drone aircraft or "unmanned aerial vehicles" in the war on terror. But another, still more awe-inducing possibility has emerged: taking human beings out of the decision loop altogether. Emerging brain science could take us there.

Today drone pilots operate thousands of miles away from the battlefield. They must manage vast amounts of data and video images during exceptionally intense workdays. They are scrutinized by superiors for signs of stress, and to reduce such stress the Air Force is attempting shift changes, less physical isolation on the job, and more opportunities for rest.

Yet even as this remarkable new form of war fighting is becoming more widely recognized, there are at least two more possible technological transitions on the horizon that have garnered far less public attention. One is using brain-machine interface technologies to give the remote pilot instantaneous control of the drone through his or her thoughts alone. The technology is not science fiction: Brain-machine interface systems are already being used to help patients with paralytic conditions interact with their environments, like controlling a cursor on a computer screen.

In a military context, a well-trained operator, instead of using a joystick for very complicated equipment, may be able to process and transmit a command much more rapidly and accurately through a veritable mind-meld with the machine.

There are enormous technical challenges to overcome. For example, how sure can we be that the system is not interpreting a fantasy as an intention? Even if such an error were rare it could be deadly and not worth the risk.

Yet there is a way to avoid the errors of brain-machine interface that could change warfare in still more fundamental and unpredictable ways: autonomous weapons systems combining the qualities of human intelligence that neuroscience has helped us understand with burgeoning information and communications technologies.

Even now there are defensive weapons systems on U.S. naval ships that routinely operate on their own, but with human monitoring. A new automated weapons system has been deployed at the demilitarized zone between North and South Korea. This robot sentry is said to be the first that has integrated systems for surveillance, tracking, firing and voice-recognition. Reportedly it has an "automatic" mode that would allow it to fire without a human command, but that mode is not being used.

Robot warriors, proponents argue, would not be subject to the fatigue, fear and fury that often accompany the chaos of combat -- emotions can result in accidental injuries to friends or even barbaric cruelties motivated by a thirst for revenge and a sense of power. Others say the proponents of robot warriors are naive: What would inhibit dictators or nonstate actors from developing robotic programs that ignored the laws of war?

Moreover, some security analysts already worry that remote control unacceptably lowers the bar for a technologically superior force to engage in conflict. And will their adversaries, frustrated by their lack of opportunity to confront an enemy in person, be more likely employ robotic terror attacks on soft targets in that enemy's territory? Will this be the death knell of whatever ethos of honor remains in modern military conflict?

Another technology is even more radical. Neuroscientists and philosophers are exploring the parameters of "whole brain emulation," which would involve uploading a mind from a brain into a non-biological substrate. It might be that Moore's Law (the idea that computing capacity doubles about every two years) would have to persist for decades in order for a computer to be sufficiently powerful to receive an uploaded mind. Then again, the leap might come by means of the new science of quantum computing -- machines that use atomic mechanical phenomena instead of transistors to manage vast amounts of information. Experiments with quantum computing are already being performed at a number of universities and national laboratories in the United States and elsewhere.

Robotic warriors whose computers are based on whole brain emulation raise a stark question: Would these devices even need human minders? Perhaps, if we're not careful, these creatures could indeed inherit the Earth.

National security planners and arms-control experts have already begun to have conversations about the ethical and legal implications of neurotechnologies and robotics in armed conflict. For it is inevitable that breakthroughs will be incorporated into security and intelligence assets.

The various international agreements about weapons and warfare do not cover the convergence of neuroscience and robotic engineering. Thus new treaties will have to be negotiated, specifying the conditions under which research and deployment may proceed, what kinds of programming rules must be in place, verification procedures, and how human beings will be part of the decision loop.

Given the obvious dangers to human society, fully autonomous offensive lethal weapons should never be permitted. And though the technical possibilities and operational practicalities may take decades to emerge, there is no excuse for not starting to develop new international conventions, which themselves require many years to craft and negotiate before they may be ratified by sovereign states. The next presidential administration should lead the world in taking up this complex but important task.

A version of this article appeared May 12, 2012, on page A15 in some U.S. editions of The Wall Street Journal, with the headline: Robot Soldiers Will Be a Reality -- and a Threat.

 

Follow Jonathan D. Moreno on Twitter: www.twitter.com/pennprof

FOLLOW TECH
Much controversy has surrounded the use of remote-controlled drone aircraft or "unmanned aerial vehicles" in the war on terror. But another, still more awe-inducing possibility has emerged: taking hum...
Much controversy has surrounded the use of remote-controlled drone aircraft or "unmanned aerial vehicles" in the war on terror. But another, still more awe-inducing possibility has emerged: taking hum...
 
 
  • Comments
  • 27
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
Page: 1 2  Next ›  Last »  (2 total)
cosmicdart
paragon of paradigms
05:03 PM on 05/18/2012
This means that future wars will be bloodless demonstrations of superior AI robotic technology. The nation who wins the most robot wars controls the Earth. This will result in the technological evolution of a race of autonomous military robots who will supersede humans as they meld with the human mind taking over the species. Someday humans will be half machine and half biological whereby they are all interconnected as a universal cooperative mind. We shall all belong to the bio-machine Hive! Yeah!
ThinkCreeps
Seriously, it's time.
05:21 PM on 05/17/2012
If brain interfaces are not used in live-pilot aircraft, there is absolutely no justification for them in remote-pilot aircraft.

Installing portable brains into mechanical soldiers? I'm seeing it being cheaper to keep rounding up recruits from housing projects.
photo
OutAtFirst
Mountain goat, desert rat and sea dog
12:33 PM on 05/17/2012
"There are enormous technical challenges to overcome. For example, how sure can we be that the system is not interpreting a fantasy as an intention?"

The enemy will become confused when the robots start attempting self-gratification on the battlefield.
photo
HUFFPOST SUPER USER
smoknjoe
Condemnant quod non intellegunt.
03:32 AM on 05/17/2012
We may be able to make an independent killing machine, but will we be able to infuse it with the creativity that is needed on the battlefield to come up with unique solutions to complex problems? I once read that pilots are psychologically more poet than engineer. That ability may not be captured.
photo
HUFFPOST SUPER USER
libwingoflibwing
Leftist, Christian, Non-Violent Revolutionary
10:21 PM on 05/15/2012
Why not just do the whole think in computers that calculate our causalities and both sides can have those designated as causalities report to disintegration chambers?
photo
Peace-riding
Cause Peace has places to be.
09:13 AM on 05/16/2012
Because 400 years from now Capt. Kirk will come in and screw it all up.
photo
HUFFPOST SUPER USER
smoknjoe
Condemnant quod non intellegunt.
03:33 AM on 05/17/2012
Exactly! LOL! That was my thought. Everyone to the disintegration booths!
photo
laymancanuck
IGNORANCE has used up its quota of TOLERANCE
06:35 PM on 05/15/2012
What is frightening, as soldiers are further from the battle field, society is less and less engaged in war. Making it easier for politicians to engage in war without citizen's support or even knowledge.
photo
HUFFPOST SUPER USER
smoknjoe
Condemnant quod non intellegunt.
03:34 AM on 05/17/2012
We are already at that point. Special Forces.
ThinkCreeps
Seriously, it's time.
05:13 PM on 05/17/2012
They seem to be human, just fewer in number.
HUFFPOST SUPER USER
frank1946
Tell the Truth
08:18 AM on 05/15/2012
Homicide becomes high tech, everyday !

Send the Robot to do Dirty Harry's Work ?

Flash Gordon would only say, " I told you so" !

All the Sci Fi writers are right. Earth is becoming a frightening place to live.
02:55 AM on 05/15/2012
I'm happy to see less of our guys get blowed up by IEDs doing supply and protect missions. If bots and drones can take that load and free up the people to work with the locals and do more relationship building and counter-intel, then this is something I can support.
ThinkCreeps
Seriously, it's time.
05:14 PM on 05/17/2012
GIven the success of the wetware with relationship building so far, we might be better off with metal mickey doing the meet and greet.
HUFFPOST SUPER USER
frank1946
Tell the Truth
12:56 AM on 05/15/2012
Install Robot Warriers outside Treasury and Federal Reserve, any agent of QE 1, 2, 3, 4, will be
destroyed on sight !

Very Cool.
07:49 PM on 05/14/2012
In your book "Undue Risks" you posit that the rights of human subjects deserve to be held paramount over any needs of national security. Does a robotic artificial mind have the ability to recognize a white flag of surrender? The Iraq soldiers laid down their guns and ran out of the bunkers to surrender. How does an artificial mind make a decision about this act? The fact that the computers in the government offices can be hacked makes one pause in sorting the facts and making a decision in his heart whether to really have confidence that this could not happen in a drone operated by a robotic, heartless, hackable machine capable of taking life from one or more living humans that willnot be allowed to surrender.
photo
BluePhantom2
The Blacksmith & the Artist reflected in their art
07:14 PM on 05/14/2012
Inovation in warfare is not something we should negotiate away. Our competition is working on the same stuff and will not negotiate, and non-state players will not be far behind. As to rules of war? there should be none as war is supposed to be terrible and by limiting it we simply prolong the horror, that should be avoided at all cost. Look at the chaos in Iraq and Afganistan that is a product of limited war or what is currently underway in the horn of Africa. There is no honor in war just the warriors and by limiting their actions (Rules of engagement/rules of war) you simply prolong the horror for everyone involved. PLS don't interpret this as me condoning war as I do not, but if we are going to fight we need to fight to win and be done with it. Otherwise we should not invest our blood and treasure in the never ending meat grinder that we are seeing with modern conflicts.
nschomer
Scientifically Progressive Libertarian Socialist
01:02 PM on 05/15/2012
I think you miss the point. Of course if you are "forced" into war then you do what you have to to win. But if your armies and navies and air force are manufactured, not born, then there is nothing to loose by going to war except hardware. You say that war is supposed to be terrible, but if nobody ever sees the repurcussions, it is only horrible for those it is waged upon. It lowers the bar to the point where if a country, say, tries to levee a tariff on one of our exports, hey, why not send in the drones? A country just beat you out for Olympic gold - AND there is some suspicion that they cheated? Send in the drones...that's what no rules war means if you've got no real skin in the game.
photo
BluePhantom2
The Blacksmith & the Artist reflected in their art
04:56 PM on 05/15/2012
Yea I got the point and have some serious issues with the new techno-war we are able to wage. As it appears bloodless to us but not to those we wage it against. They are forced to keep up or use other means (Terrorism) to defend themselves. Diplomacy seems dead as we are toothless on the global scale (Thanks to the UN and our own rules) but able to wage a very personnel war against those we choose too. What is real scary is when we send in our drones to destroy thier drones and humanity gets caught up in the middle.
This user has chosen to opt out of the Badges program
photo
04:58 PM on 05/14/2012
Skynet is here. Cue John Conner........
This user has chosen to opt out of the Badges program
photo
Saint Brian the Godless
Visit me at Saint Brian's Chronicles
04:44 PM on 05/14/2012
Hollywood tries to warn us, and yet we persist...
photo
HUFFPOST SUPER USER
Eric Sandoval
Patriotism IS the last bastion of the scoundrel
04:06 PM on 05/14/2012
We ARE getting very close to Ridley Scott's BISHOP becoming a physical reality in our lifetimes. But we still haven't reached situational cognizance in our A.I. systems just yet, so for now it's just a bunch of random choices preprogrammed into a system, but we're not too far off from situational cognizance. And when we get THERE, then there might be real trouble. Because right now, robots can THINK they understand human emotion and feeling, but they actually cannot. It just might look that way on a demo video or two, but they're not there yet. But within our lifetimes if you're under 60, you'll be seeing some real rapid changes. If you thought the quick changes from telephones that you had to physically dial, into the cordless, into the carphone, into the wireless mobile phone into the smart-phone was a rapid change in technology that's happened in the past 40 years, then you ain't seen NOTHING yet. Because we're only being shown a small fraction of where we're really at already. Heck, you probably still think those flying saucers are little grey guys with big eyes. THINK AGAIN!! We are FAR more ahead than you think! And that's a GOOD thing!!
photo
HUFFPOST SUPER USER
PMJ79
02:07 PM on 05/14/2012
Judgement Day is inevitable.