Artificial intelligence can learn Atari games from scratch, say scientists

Developers at DeepMind took cues from the human brain, creating a program that can master ‘Space Invaders’ all on its own.

AP Photo/Richard Drew
A child plays Ms. Pac-Man in New York. Computers already have bested human champions in Jeopardy! and chess, but artificial intelligence now has gone to master an entirely new level: Space Invaders. (FILE)

Is a robot uprising coming in 2015?

Maybe – but only to show you up at the arcade.

Led by researchers Demis Hassabis and Volodymyr Mnih, Google-owned DeepMind Technologies has created an artificial intelligence capable of playing simple video games with minimal training. They described their breakthrough today in Nature.

Dubbed the deep Q-network agent (or DQN), DeepMind’s program can play a number of popular Atari 2600 titles, including ‘Pong,’ ‘Space Invaders,’ and ‘Breakout.’ According to the study, it is “the first artificial agent that is capable of learning to excel at a diverse array of challenging tasks.”

Video game-playing AI already exists, as any lonely gamer can tell you. In the absence of a real human opponent, most games allow players to challenge the “computer.” But in those games, the AI is endowed with a series of specific rules that guide its behavior. DQN, on the other hand, is given only one objective – maximize the score. From there, it “watches” the gameplay to learn new strategies in real time. Like the human brain, it learns from experience.

“It looks trivial in the sense that these are games from the 80s and you can write solutions to these games quite easily,” Dr. Hassabis, who co-founded DeepMind, told BBC. “What is not trivial is to have one single system that can learn from the pixels, as perceptual inputs, what to do. The same system can play 49 different games from the box without any pre-programming. You literally give it a new game, a new screen and it figures out after a few hours of gameplay what to do.”

Perhaps more impressively, DQN can take these strategies and apply them to games it hasn’t played before. In other words, when DQN gets better at one video game, it’s actually getting better at a whole host of games.

The program is far from perfect, however. While it rivals human players in action-oriented games, it struggles with more open-ended titles.

“Games where the system doesn't do well are ones that require long-term planning,” Dr. Mnih told NBC. “For instance, in Ms. Pac-Man, if you have to get to the other side of the maze you have to perform quite sophisticated pathfinding and avoid ghosts to get there.”

As DeepMind prepares DQN for ever more complex gameplay, an even greater potential waits on the horizon. Even more so than chess, video games can provide a model of the real world – one that requires intricate, adaptive decision-making. Researchers remain silent on exactly what real-world functions they have planned, but slyly noted that their program could someday drive a real car with “a few tweaks.” Does that mean DQN could go from Mario Kart champ to digital chauffeur? Only time will tell.

You've read  of  free articles. Subscribe to continue.

Dear Reader,

About a year ago, I happened upon this statement about the Monitor in the Harvard Business Review – under the charming heading of “do things that don’t interest you”:

“Many things that end up” being meaningful, writes social scientist Joseph Grenny, “have come from conference workshops, articles, or online videos that began as a chore and ended with an insight. My work in Kenya, for example, was heavily influenced by a Christian Science Monitor article I had forced myself to read 10 years earlier. Sometimes, we call things ‘boring’ simply because they lie outside the box we are currently in.”

If you were to come up with a punchline to a joke about the Monitor, that would probably be it. We’re seen as being global, fair, insightful, and perhaps a bit too earnest. We’re the bran muffin of journalism.

But you know what? We change lives. And I’m going to argue that we change lives precisely because we force open that too-small box that most human beings think they live in.

The Monitor is a peculiar little publication that’s hard for the world to figure out. We’re run by a church, but we’re not only for church members and we’re not about converting people. We’re known as being fair even as the world becomes as polarized as at any time since the newspaper’s founding in 1908.

We have a mission beyond circulation, we want to bridge divides. We’re about kicking down the door of thought everywhere and saying, “You are bigger and more capable than you realize. And we can prove it.”

If you’re looking for bran muffin journalism, you can subscribe to the Monitor for $15. You’ll get the Monitor Weekly magazine, the Monitor Daily email, and unlimited access to CSMonitor.com.