Inside the Scene-Stealing 3-D Technology Behind James Cameron's Avatar

James Cameron is stubborn. He decided nearly a decade ago to film his humans-versus-aliens sci-fi adventure Avatar in 3-D, but he refused to start production until technology could convince the viewer that he or she could step through the screen and pick up a bow alongside the Na’vi, the film’s 10-foot-tall, blue, cat-faced alien protagonists. To give scenes realistic depth, Cameron, who brought a computer-generated liquid-metal T-1000 to life in Terminator 2, and camera whizzes Vince Pace and Patrick Campbell built the Pace/Cameron Fusion Camera System to capture images the same way as a human eye does. Cameron then used a virtual camera to walk—or fly—around in the virtual world to record any shot of the Na’vi that he wanted and combined that with the real-life footage. Here, a guide to making the most convincing 3-D film yet.

How James Camerson Made a Truly Lifelike 3-D Movie

1. Build the Stage
An array of 72 to 96 cameras, depending on the size of the set, hang around the perimeter of a sound stage and are configured in a grid. Later, a computer replaces the studio walls, floor and ceiling with digitally rendered three-dimensional environments and structures. The grid is also marked on the floor to provide reference within this virtual world.

2. Capture Motion
Actors, weapons and props marked with reflective dots move around the stage while the camera grid tracks only the dots. A computer records the dots’ movement, triangulates their location, and assembles these data points into wire-frame skeletons that in Avatar will be “dressed” with computer-generated Na’vi bodies.

3. Shoot in 3-D

Next Cameron films the flesh-and-blood characters in 3-D so that they will look at home alongside the Na’vi in the virtual 3-D world. Older 3-D tech used two cameras mounted side by side to create a left eye/right eye effect. Because of their bulk, those cameras were placed far apart and could shoot only straight ahead. The Fusion Camera System has two cameras, but by using small high-definition digital image sensors, the lenses can sit closer together than your pupils. The line of sight of the lenses is adjustable so that, during a shot, they can be angled closer together to focus on nearby objects, or farther apart for those in the distance, just as your eyes do. The system combines the images into a single image with realistic depth.

4. Climb into the Movie
After a computer inserts the motion-capture performances into the digital environment, Cameron carries a virtual camera—an LCD display with buttons and grips similar to a videogame controller—onto the set. As he moves, radio and optical detectors track the camera’s location and relay it to computers offstage, which render the virtual world as viewed from that vantage and send it to the tablet. This allows Cameron to walk through the virtual action to record any shot he wants—he can even set the vantage point to take shots that would require a crane or helicopter. Later, the 3-D footage of human characters can be added to these scenes.

5. Watch It
At RealD 3-D shows, a projector alternately displays the left-eye and right-eye images, each in an oppositely circular polarized direction, 144 times per second. Polarized glasses ensure that each eye sees only the image meant for it.

single page