I have a great interest in the merging of gaming and music technology. My interest is in total immersion and interaction- interaction with outside objects, sound reaction, and integration of controllers into an environment.
We´ve been experimenting with combining music performance and mixed reality. We made a test video with a new song by Alayna. Pier is playing the drums in VR. We made the setup in Unity and used Soundstage for the VR instruments. This is the Proof video. We plan to branch this into a full performance and streaming show.
During the Sonar Innovation Challenge- New Gaming theme, we devloped an environment for interaction with real world objects and affecting the game environment. This changed lights, sounds, shaders or gameobjects.