Movesician is a mixed reality (MR) project that reimagines music creation through play and interaction. Designed for everyone, even non-musicians, it allows users to explore sound through unique scenes that combine visuals, touch, and motion.
Mix Reality Unity Interaction
Game Jam
Onboarding:
Introduce the interface and its role as the gateway to the three scenes.
Scene 1: Jumpy Music
Users interact with floating models of the word "Movesician."
Pick up letters to hear their unique sounds.
Place them back to see them bounce, creating a visual and rhythmic effect like waves.
Scene 2: Touch Music
Users build music by stacking cubes, like playing with blocks.
When two cubes touch, they create a sound.
Players can experiment with configurations to build their own music.
Scene 3: Bounce Music
Players throw balls into the scene, where they bounce off walls and rebound boards, creating randomized music.
The more balls in motion, the more dynamic the sound.
Movesician makes music creation accessible and playful, inviting users to explore the boundaries of sound and interaction. Through immersive scenes, we aim to reshape how people engage with music in the digital age.
Are you ready to shape the future of music? Dive into Movesician and explore a world where sound meets creativity.
Challenge:
This project was a collaborative effort with a strict time limit, undertaken by a team of designers with no prior coding experience. As our first Mixed Reality (MR) project, it was both exciting and challenging.
We encountered significant obstacles, particularly in areas like room scanning and gesture recognition. To overcome these challenges, we leveraged Meta's SDK package, which provided tools to address most of the technical difficulties.
Since the project is music-focused, all the music was uniquely composed by our partner, adding a creative and distinctive element to the experience.
Additionally, the process of uploading the project to GitHub presented its own challenges. Packaging and documenting the project in a clear and complete way was a steep learning curve, but it gave us invaluable experience in collaborative project management and technical workflows.
Through these challenges, we not only completed the project but also learned a great deal about MR development, teamwork, and documentation.