newsletter sign up
give a gift
popular science merch
Skip to content
How Gestural Control Could Change Everything
By Tom Foster
August 19, 2013
Developers have already created hacks that allow a user to control real aircraft simply by mimicking the roll, pitch, and yaw motions of flight with an outstretched hand. The apps mostly apply to small quadcopter drones, but engineers at NASA recently used the same technique to control Athlete, the agency's 2,000-pound flying planetary rover.
With accuracy of up to .01 millimeters, a
device could enable doctors to perform precise surgical procedures by manipulating robotic arms. It could also allow them to treat patients remotely—particularly useful for soldiers in combat zones or astronauts in space. The ability to manipulate robotic arms precisely and at a distance could transform other detailed or remote mechanical work—for example, repairing a fighter jet on the other side of the world.
Courtesy Intuitive Surgical Inc.
David Holz's frustration with 3-D computer-aided design was the impetus behind Leap Motion. It makes sense, then, that one of the company's first partnerships is with the design-software company Autodesk. With a Leap plug-in, users will be able to "shape" a 3-D model just as they would a lump of clay.
With password-based computer security increasingly compromised, hardware makers are looking for new biometric security systems. Technologies such as retina scanning are prohibitively expensive, however. A company called Battelle has developed an app that can identify an individual based on the unique shape and movement of his hand. With the app and a Leap Motion–equipped machine, one can sign on by simply waving at the sensor.
With gestural control, students could interact directly with complex visualizations. They could model chemicals or DNA. They could explore space (the app Exoplanet already allows them to do so). Or they could easily manipulate data visualizations to test different scenarios. Holz makes the analogy that people develop an understanding of basic physics by interacting with the world. By allowing virtual exploration to take on experiential qualities, gestural control could make the most abstract concepts real and intuitive.
Four stellar telescopes for every stargazer
The real reason we’re seeing more wildlife during the pandemic
A new vaccine protects mice from another dangerous coronavirus
Did Uranus get smacked so hard it spun sideways?
Polyhedral gaming dice are the weapons of your imagination
Sony’s new DualSense PS5 controller promises more realistic tactile feedback
Portable scanners that make the world your office
Air quality monitors that verify the safety of the air in your home
We once thought nostalgia was a disease, but it might be key to our survival
The School of Game Design can teach you to make your own games at home
Eighteen digital freebies and extended trials you can take advantage of right now
‘Tiger King’ would have been more disturbing if it had focused on the big cat trade
Animal Crossing’s most elusive fish has a bizarre real-life backstory
How to start your own survival garden
Meditation apps want to calm you down on the same device that stresses you out
Soothing stories to take your mind off stressful things
Tigers can get coronavirus—but you won’t catch COVID-19 from your cat