It's the r-r-r-r-remix.

super mario spacetime organ (illucia & soundplane) from paperkettle on Vimeo.

Chris Novello is working on some hardware called Illucia, a system that can route information between computer programs. What does that look like? Well, let him show you. Here he takes Super Mario, jacks Illucia into it, and starts messing with the game's RAM, controlling it all with a multi-touch surface called the Soundplane. He explains:

I begin by playing the game as one normally would, just using buttons on illucia.. but I also have access to the game's memory, so I use the Y axis on the Soundplane to alter the value in the memory address that determines Mario's Y position onscreen. This is how I make Mario fly and hover during the playthrough.

Novello calls it codebending, and the final result looks like a dub-step reinterpretation of the classic game. He continues:

Also, before I start playing, notice that I flip a switch on illucia. This triggers recording — not video, but actually recording the entire memory state of the NES for each game frame. Because I'm saving the game ~30 times a second (and keeping log of all saves) I'm able to go back to any moment in Mario's life. Sort of like a Super Mario time machine.
So then I use the X-axis of the Soundplane to sweep through the timeline of Mario's universe. Not only that, but the Soundplane is multitouch, so I use a second finger to specify start and endpoints in a playback loop. This is similar to the way samplers and granular synths work, but for recordings of the entire memory state of the NES rather than audio data. Conceptually, it is like Super Mario meets Groundhog Day. Mario's universe computer / time machine gets caught in hellish loops.

Poor guy. Not going to be easy to save the princess like that.

[paperkettle via Kotaku]

8 Comments

Wow PopSci must be desperate for something to print....what junk.

@gizmowiz, you stole my comment. :)

---
In space, no one can hear a tree fall in the forest.

To the inventor and PoPSCi, it is amazing what boredom can achieve invent and write about, lol.

Still, this guy is smart and I do appreciate he is not using his brains to hack someone on the internet. THANK YOU!

^ I don't see either of you two inventing anything useful.

^- I'm the sole developer on a project under development that has 1 patent and 3 pending.

---
In space, no one can hear a tree fall in the forest.

Wow, that was crap. Nowhere was there anything that resembled music or mixing or anything...a 4 year old could bang on those switches and make something that sounded or looked equally impressive....which is to say...not impressive at all.

I liked it, and it would be interesting to have that feature in videogames so you could just "rewind" the game a bit instead of using save points.

Popular Tags

Regular Features


140 years of Popular Science at your fingertips.



Popular Science+ For iPad

Each issue has been completely reimagined for your iPad. See our amazing new vision for magazines that goes far beyond the printed page



Download Our App

Stay up to date on the latest news of the future of science and technology from your iPhone or Android phone with full articles, images and offline viewing



Follow Us On Twitter

Featuring every article from the magazine and website, plus links from around the Web. Also see our PopSci DIY feed


April 2013: How It Works

For our annual How It Works issue, we break down everything from the massive Falcon Heavy rocket to a tiny DNA sequencer that connects to a USB port. We also take a look at an ambitious plan for faster-than-light travel and dive into the billion-dollar science of dog food.

Plus the latest Legos, Cadillac's plug-in hybrid, a tractor built for the apocalypse, and more.


Online Content Director: Suzanne LaBarre | Email
Senior Editor: Paul Adams | Email
Associate Editor: Dan Nosowitz | Email
Assistant Editor: Colin Lecher | Email
Assistant Editor:Rose Pastore | Email

Contributing Writers:
Rebecca Boyle | Email
Kelsey D. Atherton | Email
Francie Diep | Email
Shaunacy Ferro | Email

circ-top-header.gif
circ-cover.gif