New role for robot warriors

New laws will be needed to constrain the use of autonomous (without a human operator) robot weapons on the battlefield, argues Noel Sharkey, a professor of artificial intelligence and robotics at Britain's University of Sheffield, in an essay last year. He sees two huge ethical hurdles in the way: One is the unproven ability of robotic weapons to discriminate between friend and foe, avoiding hitting civilians and other noncombatants. The other questions a computer's ability to judge "proportionate" force, enough to gain military advantage while minimizing civilian casualties.

Both these concepts are seen as essential to waging ethical warfare.

"Humans understand one another in a way that machines cannot," Dr. Sharkey writes. "Cues can be very subtle and there are an infinite number of circumstances where lethal force is inappropriate." International talks on the use of autonomous robots in warfare "are needed urgently," he says.

What experts do agree on is that today's robots fall far short of the kind of artificial intelligence (AI) they need to operate effectively on their own, let alone act ethically. "When it comes to high-stakes decisions that hinge on understanding subtle human preferences and intentions, we still have a bunch of research to do at the level of basic science to give AI systems the same common sense that people have," says Eric Horvitz, principal researcher at Microsoft Research and immediate past president of the Association for the Advancement of Artificial Intelligence. The AAAI plans to issue a report later this year on the challenges and opportunities presented by the growing relationship between humans and AI.

Arkin's work is of great interest to Patrick Lin, director of the Ethics and Emerging Sciences Group at California Polytechnic State University in San Luis Obispo. His group is working on software for military robots that would include ethical behavior.

"We're sending machines to do our dirty work," says Dr. Lin, who is also an ethics fellow at the US Naval Academy and is working on a book on robotic ethics. The military should adopt a slow "crawl, walk, run philosophy" to introduce autonomous robots to the battlefield, he says.

Many kinds of limits could be put on military robots, Lin says. For example, their use could be confined to a "kill box," an area known to contain only enemy troops. They could be authorized to fire only on opposing robots or other nonhuman targets. Or they might carry only nonlethal weapons, such as water cannons or devices that only stun.

Right now, Arkin argues, the discussion about the use of robots in war is in its infancy. It reminds him of the attitudes people held before the Wright brothers flew the first airplane. At that time, some wondered if humans were intended to fly at all or whether flying could ever become a safe thing to do.

Robots don't need to have a perfect ethical record to win a place on the battlefield, Arkin argues. They only have to behave better than humans, who have a deeply flawed ethical record in warfare.

"This is not about robot armies out to kill us," Arkin says. "This is actually about reducing noncombatant fatalities."

Previous

1 | 2