Dancing a Song With the Full-Body Wiimote Music Controller Suit

An electronic musician’s brilliant wearable hack uses eight Nintendo Wii controllers to create and manipulate sound in real time
W_space: the fully wearable Wiimote audio controller: Photo by Courtesy Tom Tlalim

Soon after the Nintendo Wii’s release, hackers immediately began uncovering ways to use its unique motion-sensing controller to interface with other things—PCs, musical instruments, you name it. But Tom Tlalim, an Israeli-born composer who now lives in the Netherlands, may have outdone them all: His full-body, eight-piece “suit” of Wiimotes interfaces fully with custom software to turn his entire body into an electronic instrument that responds to his every motion. In his suit, Tlalim doesn’t play songs. He dances them.

“W_space,” as his suit has been christened, uses up to eight Wiimotes attached to the wearer’s arms and legs to form what is effectively a DIY motion-capture suit. The accelerometers on the Wii send tilt and acceleration readings to an open-source music synthesis software package called SuperCollider, for which Tlalim wrote a custom module that translates the data from W_space’s Wiimotes and allows them to manipulate and create sounds of various timbres in real time.

For Tlalim, the Wiimotes mean that he no longer needs to be hunched in front of a computer screen when he plays.

W_space: On the Wall: The Wiimotes and Nunchuk attachments fit into elastic sleeves. Photo by Courtesy Tom Tlalim

"They're allowing me to express myself, as a computer musician, more with my body, rather than the tips of my fingers," says Tlalim, who also plays jazz guitar. "I've always been interested in developing my own ‘gestural’ devices to control computers – as a way to go back to the spontaneous act of picking up a guitar."

The development process began a few months before the Wii’s November 2006 release. Tlalim was researching 3-dimensional rotation interfaces for audio software at Amsterdam's Steim Institute at the time, and when the Wii came out, Tlalim realized that modding the mass-produced remote would be a lot cheaper than building his own device from scratch. When his homemade Theremin broke right before a prestigious gig at the Dutch Electronic Art Festival in April 2007, Tlalim decided to put his idea to the test. On the train on the way to his performance, he wrote the code for SuperCollider that allowed a single Wiimote to mimic the effects of the Theremin.

"I was pretty much coding it while we were sound-checking and just before we went onstage," he says. "When we went onstage, it was the first time I got to try this instrument -- and I can tell you that it was mind-boggling, for the audience and for me, to discover the world of sound that can come out of gesture." He has performed several times since with the W_space, which has now grown to include as many as eight Wiimotes at a time.

Unlike the many gimmicky Wiimote mods that have surfaced, using the remote to make sounds creates genuinely new options for any musical form that encourages eclectic blending, from hip-hop and dance music to jazz and experimental composition. Dancers suddenly have the potential to be musicians in a way that wasn't before possible.

At a September 2007 conference about Wii-controlled music at the Steim Institute, Tlalim and other electronic composers showed off their mods, as did the Dutch "WiiJ" Tim Groeneboom (aka WiiJ Timski), who uses the Wiimote to control the mixes as he roves through dance clubs.

Tlalim is currently collaborating on a W_space project with dancer Doron Hirsch and director Paola Tognazzi. The goal? Freeing electronic music performers from the keyboard and mouse, once and for all.

See Tlalim and W_space in action below. And for a closer look, see our photo gallery here.


Fore more information, see tomtlalim.tk

2 Comments

Comments

svseigel

from APO, AE

Article Rating:
1
2
3
4
5

I think that Tlalim is visionary to use Wiimotes this way. I am either too old to appreciate his music or the reproduction was weak, or he lacks much innate musicality. I'm headning to iTunes Store to see what he sounds like at a higher bandwidth. As an old EE, I would probably have a variety of mods, and reserve wiimote 8 for moving through them. For example, one might include a distortion guitar, sax and drums, while another could include a strings, woodwinds and brass ensemble. By using more raw noise (this sounds like sampling with the wiimote modifying the pitch and volume) I think he sacrifices true musicality in a misguided attempt to go avante-garde. Another alternative is to sample instruments and then mod from there--but not wind, jet airplanes or audio feedback.

1 out of 2 people found this comment helpful
Nathan171
Article Rating:
1
2
3
4
5

It's a great idea, but the music was weird and I couldn't see much of a relation between the screeching and his movement. I'd like to see a recognizable song played using the suit. Play Free Bird, and then I'll be impressed :)

0 out of 0 people found this comment helpful

Popular Tags

Regular Features

PPX: The PopSci Predictions Exchange

RSS Link

Entertainment & Gaming

Ready to bet on the future? Start here!

Subscribe for 2 free issues!

may2008_cover.jpg