Video: Trained A.I. Beats Humans In Doom Deathmatches

The great terror of 1993, realized

AI Plays Doom

A.I. Plays Doom

In front of the A.I. player are the bodies of its enemies.Screenshot by author, from YouTube

The researchers taught the robot to kill. In the researcher’s defense, they only taught it to kill hell-spawned demons on Mars. Working with “Doom,” the 1993 first-person shooter, the researchers trained an Artificial Intelligence to defeat the native enemies in the game, as well as human players fighting in the same deathmatch arena.

Why Doom? Guillaume Lample and Devendra Singh Chaplot, the paper's authors, note that humans have already trained A.I. to learn Atari 2600 games, and games like Chess and Go, where all the information needed is immediately visible to all players. Doom, it turns out, more closely resembles the real world. Not so much the demons everywhere, or the scattered guns on every sidewalk and in every corner bit. No, what Doom offers is a 3D environment, and concealed information.

From the paper:

Previous methods have usually been applied to 2D environments that hardly resemble the real world. In this paper, we tackle the task of playing a First-Person-Shooting (FPS) game in a 3D environment. This task is much more challenging than playing most Atari games as it involves a wide variety of skills, such as navigating through a map, collecting items, recognizing and fighting enemies, etc. Furthermore, states are partially observable, and the agent navigates a 3D environment in a first-person perspective, which makes the task more suitable for real-world robotics applications.

So what is the A.I. doing, exactly, when it plays Doom? It turns out, the A.I. is playing two different games at all times. The first is navigating the environment and looking for items, and the other is immediately dispatching any enemies it can find. Researchers first trained it to navigate empty maps, and added in rewards for finding items, as well as penalties for stepping on lava.

It took a week to train the A.I. to navigate the map, and a few hours to train it to recognize enemies. After that training, the A.I. outperformed humans in single-player games versus native enemies, and outfought humans in multiplayer death matches. This is all good news for A.I. navigating 3D spaces with imperfect information and solving problems, provided the problem is “can I pick this gun up and use it to shoot an enemy?”

That might not be the most comforting scenario, but I’d hold off the panic about A.I. intelligence in video games until they can accomplish something much more advanced. When an A.I. can beat Myst, that’s when I panic.

Watch the A.I. fight a full deathmatch below.