A team of computer scientists at MIT may have just solved one of the digital age's most annoying occurrences, one that somehow has not been addressed in any real way by major device manufacturers. It's the I-have-something-on-my-computer-screen-that-I-need-to-transfer-to-my-phone problem, and it plagues everyone. Now, a small software solution has come to our aid, allowing users to throw applications--in their same states--between computers and mobile devices using the smartphone's camera.
The problem: as you're preparing to leave for dinner, you look up Yelp reviews on your desktop, or maybe you map the restaurant in Google Maps so you know where you're going. You do this out of ease--it's simpler to perform these tasks with a full keyboard than via your iPhone or Droid. But now it's time to leave, and you really need that Yelp screen or map on your phone display.
Generally, this is where you start the process all over again on your smartphone. But a program called Deep Shot is drastically simplifying this process. Many Web applications convey information via a uniform resource identifier (URI)--this is the same long string of symbols that you see in a Google Maps link--and that can be exploited via computer vision algorithms.
Here's how it works. Deep Shot requires installing a little bit of software on both your phone and any computers you want it to interact with. To toss, say, a map you've augmented with specific directions from your computer screen to your phone screen, you simply snap an image with the mobile device. Your phone identifies the app running on the computer screen and sends a request to the computer, where the corresponding software then extracts the URI from the designated app and sends it to the phone.
Now in possession of the URI, your phone launches Google Maps AND plots the directions you designated on your computer. The same would work with an app like Yelp. Snap the image on your computer screen and your phone doesn't just open Yelp, but goes right to the specific restaurant page you were perusing on the computer. The URI doesn't just transfer app information, but the specific state of the app as well.
It also works the other way, from phone to desktop/laptop. Right now, the app only works with apps that reveal their states through URI, but that's a lot of common apps. Some aren't optimized to work with Deep Shot, but with minimal additional coding they could be. Which means it may soon be possible to use your mobile device and your desktop more seamlessly as if they were extensions of the same device. In other words, in the way we always knew we were intended to.
Simple, but awesome tech. There are so many possible uses for something like this.
One step closer to the "swipe-load" to another device we see in most futuristic movies (avatar, minority report, etc)
Ahh.. finger tracking is coming along, nanoscopic carbon chips are growing up, displays are progressing faster than expected. Such an awesome time to be a tech geek!
Playing Devil's Advocate since 1978
"The only constant in the universe is change"
-Heraclitus of Ephesus 535 BC - 475 BC
Google has had this for some time using the chrome browser extension Chrome to Phone. It recognizes what it is that you are working on, maps, addresses, websites, driving directions, etc and when you click, send to phone, it pops up on your phone using the preferred app to display the data.
This is similar to Google Youtube remote that works with Youtubes Leanback. Where you can control any web browser that is pointed at Youtube Leanback from your phone.
Really slick and have been using both of the features for nearly a year now.
cool. technology is moving so fast nowadays.
i want it.
does it also work with hulu?
Nice try. However, I think it's too late. HP already uses a similar method that's much more elegant called "Touch to Share" for the webOS mobile operating system. This will let users take advantage of their latest technologies (Palm Pre3, HP Veer, HP Touchpad) using webOS to share and transfer information instantly without having to even point, focus, and shoot a camera. You just tap the smartphone against the tablet device and tada! The same web page you have on your smartphone is instantly duplicated on the tablet and vice versa.
@popscipeek...does that work with a lap top? or are you comparing apples to oranges?
This is cool, but it already exists for google chrome. It's called Google Chrome to Phone. Its just an android app and an extension to chrome. Then with the push of a button, whatever is in chrome is sent directly to the android phone. The only difference is that it can't send from the phone to computer.