Here’s another virtual sandbox meets real sandbox project. A team at UC Davis is behind this depth-mapped and digitally projected sandbox environment. The physical sandbox uses fine-grained sand which serves nicely as a projection surface as well as a building medium. It includes a Kinect depth camera over head, and an offset digital projector to add the virtual layer. As you dig or build elevation in parts of the box, the depth camera changes the projected view to match in real-time. As you can see after the break, this starts with topographical data, but can also include enhancements like the water feature seen above.
It’s a big step forward in resolution compared to the project from which the team took inspiration. We have already seen this concept used as an interactive game. But we wonder about the potential of using this to quickly generate natural environments for digital gameplay. Just build up your topography in sand, jump into the video game and make sure it’s got the attributes you want, then start adding in trees and structures.
Don’t miss the video demo embedded after the break.
http://www.youtube.com/watch?v=j9JXtTj0mzE
[Thanks Jake]
I love this. It’s honestly the first hack that’s got me seriously thinking about buying a Kinect.
They need to add an asteroid feature.
coming soon to children’s museums near you
I hope you understand that you have created one of the most awesome things I have ever seen! I am not just saying that this is AMAZING! Very technical as well as highly aesthetic. I applaud you Sir!
Any chance of exporting the data to Minecraft?
This would be perfect for Tower Defence games!
That is really, really cool. I caught myself thinking, “Careful! You’ll spill water on the loungeroom floor”.
I’d love to see this develop into something more than just a simulator. I may perhaps attempt it if that were the case…
Two words:
Minecraft Converter
Some more words:
It seems like one could take the image data and determine the color of each ‘block’ to determine if some area should be a hunk of rock or wood, rather than sand. Even neglecting this, Imagine building a big sand castle and converting it into a Minecraft chunk. 🙂
The KeckCAVES thing is pretty cool. Any UC Davis readers, if you ever get the chance to go see it, do it.
I’d love to make one of these but I’m far too poor to get myself a connect or a projector. My thoughts for this project would be a table top game. Have it detect several types of “units” that can be moved in a warhammer type manner. I think displaying the firing radius, health, ammo, and other stats would be very cool for any unit that you tapped a finger on. Lots of table top players geek out over their carefully created tables. This would put them all to shame.
I hit submit right as another thought occurred to me (sorry about the double post). Whenever a piece is simply removed from the field have it assume the piece was killed and draw on an appropriate blood splatter or pile of burning debris. Fire would be pretty cool on this because it would animate during game play. I bet you could even do a fair job rendering sharing across curves and shadows of units as fires flicker.
Now you need to simulate multi-coloured sand.
I’ed like to put this thing over my cat’s litter box, it would BLOW HER MIND!
+1 here
This project is really similar to the game From Dust.
But I vote for the Minecraft Converter 😉
_THE_ coolest thing I have seen this year. I actually started thinking if I should get a cheap projector myself for similar hacks.
What an amazing build :), this would stack so well with http://from-dust.ubi.com/from-dust/en-gb/home/index.aspx
I think the reason this video looks so good is because the projector is well aligned with video camera shooting the action. In the earlier post projection was from above. Not sure this one would look so good from another viewpoint.
This is an incredible input and display device! But I wonder what would it take to reverse the process? Something similar to one of those “pin clocks” where each pin is pushed up/out to represent a pixel?
How cool would it be to design something in a world creator or sketchup and port it back to the sand table? A device similar to a 3D printer with a sand moving head. The math behind sand behavior is can’t be that complex. Well no now more complicated than calc III anyway…