Feature
Her work could put lifelike physical feedback not just into videogames, but into online shopping and the instruments used to perform remote surgery

Katherine Kuchenbecker John B. Carnett

Subjects are screaming in Katherine Kuchenbecker’s lab; they feel as if they’ve been shot. Kuchenbecker is testing a vest that she and her students designed to make videogames and military training more immersive. To simulate a bullet impact, the vest launches an actuator-controlled plunger called a solenoid into the unlucky gamer’s skin where a bullet would have penetrated. “People jump out of their chairs,” she says. “Crossing that barrier from the screen to your body makes the experience so much more real.”

Kuchenbecker built her career on making things feel real. Her dream is to help make haptics, the science of incorporating touch into human-computer interaction, as convincing as photography. At the moment, however, the field is still immature. With even the best available haptic interfaces (like the Phantom system by SensAble, through which users can “touch” virtual objects), “everything feels soft and squishy,” she says. “We call it Nerf World.” To better match haptic feedback to reality’s sharp edges, Kuchenbecker captures tactile information using a tool outfitted with accelerometers and other sensors. As the tool crosses a surface, it records the forces encountered. She then creates a mathematical model of the interaction
and re-creates that interaction in a consumer product. Rather than a blunted set of Nerf-like sensations, the process gives rise to a deep tactile vocabulary.

Lifelike haptography could change medicine. Kuchenbecker’s father was a surgeon. “In my dad’s day, there wasn’t virtual surgery,” she says. “You learned by practicing on real patients. That’s risky and stressful.” But virtual surgery is still too clumsy, in Kuchenbecker’s view. Surgeons operating with the da Vinci robotic surgical system—used in place of open surgery all over the world—today receive mainly visual feedback, and only the gentlest physical response. So last year, Kuchenbecker designed VerroTouch, a device that measures the vibrations produced by touching flesh and reproduces them in da Vinci tools. Early results suggest that surgeons using VerroTouch do more delicate work.

Kuchenbecker believes haptography could someday capture the feel of archaeological artifacts, establishing a haptic “fingerprint” alongside other identifying characteristics, or could give online buyers the chance to “touch” merchandise remotely. In the end, her work could close the gap between simulation and reality for us all.

See the rest of PopSci's Brilliant 10 for 2010.

13 Comments

The Matrix is all around you!

I don't think that will be very popular in video games.

Just like the internet, it's porn that will advance this technology.

The video gamers might not go for this but the army and the police departments probably will.

-my name here- and viinci, I think you are both wrong. I think it would be very popular in video games. I know it would make first person shooters a bit more interesting for me, atleast

hey xiaoqiniio, will you shut up?!

I agree that people who play video games probably won't go for this technology. I am going to college for mechanical engineering so this kind of technology fascinates me, but the kids on my floor sure wouldn't like to play Call of Duty anymore. It would hurt to have a vest hit you hundreds of times in one game.

Man ! ... Such a WICKed grin !

Settle down, Fellow Nerds ... She's wearing a ring.

Bet her husband ain't writing comments, tonite!

OR ... "Other" (Due respect is all).

What was the article about? ... Plunging solenoids ??

You gotta be kidding me ! ... Another "Robin" moment.

Zoiks!

This is perfect for video game addicts! Set them up in this thing, make them play Call of Duty for a few hours, and they will never touch a controller again.

If the bullet sim makes them scream, what happens if they hit something really explosive?



June 2013: American Energy Independence

Five amazing, clean technologies that will set us free, in this month's energy-focused issue. Also: how to build a better bomb detector, the robotic toys that are raising your children, a human catapult, the world's smallest arcade, and much more.


Online Content Director: Suzanne LaBarre | Email
Senior Editor: Paul Adams | Email
Associate Editor: Dan Nosowitz | Email
Assistant Editor: Colin Lecher | Email
Assistant Editor: Rose Pastore | Email

Contributing Writers:
Rebecca Boyle | Email
Kelsey D. Atherton | Email
Francie Diep | Email
Shaunacy Ferro | Email

circ-top-header.gif
circ-cover.gif