I never have been a “3D” developer, neither a “shader” developer. Actually, I’m just that random flash coder that love to learn those unknown and cool looking techologies.
I also had the chance of working on some digital exhibitions. No browser, no Internet, no screen. It was very refreshing. We worked on a setup for “la FNAC”, a french store of music, books, DVD, and digital stuff. With the success of fifty shades of grey, La FNAC had a whole week dedicated to erotic novels with some conferences to promote some writers. Here at marcel, we worked on a standalone exhibition that was installed in one of their store. Here is the video we presented at the Cannes’ festival which explains better than me the whole idea behind it (in english). For non-french speakers here, the sentence could be translated “With that caress from the hand, so intoxicating, sweet carress of pur desir, he cherished the curves of the belly, went down…” or something like that…
Here is another video I shot during the exhibition, so you can here the sentence better.
I’m not allowed to talk about how we dealt with the sound stretching thing, but I can give you a quick overlook of the whole setup. A PC was hidden in a small room close to the wall, controling 6 webcams hidden in the floor in some kind of a ramp along the 7 meter long wall. The PC was grabbing every webcam stream, and crop the sides to get a picture of the wall with no gaps or duplicates. Every few second or so, that giant picture was saved to get a “reference” picture if no movement were detected. Then by taking the difference between the reference picture and the current webcam stream, you can get the position of everything that were “added” to the scene, ie. hands of people interacting with the wall. Those differences were tracked using some features of the computer vision library to get “multi touch” feature.
Then, the position of the hand of the first user would be used to “seek and play”, back and forth on the recorded sentence that would match the one displayed on the wall. The resulting feeling was the ability to control the rythme of the sentence, slowing down on some teasing words. One thing some user did and that we didn’t think about was to “read” another sentence by jumping from word to word, remixing the whole meaning of the phrase.
Well, any way, I hope you enjoy it as I did working on this project ! Feel free to leave your comments.
And for the future, I hope I will be able to work on webGL soon. Also, I need to take some time to write about the rainbow spectrum as some people asked me for it.
Stay tunned !