Unveiling Paths
An interactive diorama
Description:
The project is designed as an interactive diorama game that functions similarly to a board game. Players engage with the game by following audio instructions and visual cues to navigate and complete each level sequentially. This leveled structure ensures that players must clear one area before progressing to the next. The game concludes after players successfully complete the final level, providing a structured and immersive gameplay experience.
Role:
- Academic solo thesis project
Date:
- Sep 2023 ~ May 2024
Conceptualization
Previous experience
I had a previous experience of making a smaller version. This version is more a experimental and test . To see how the whole build feels and interacts with people. And it turns out quite nice but lacks meaning and exciting viuals, which are the important elements I start to focus on my thesis project.
Projection mapping
At the same time, I also picked up on how to control projection mapping with MadMapper. Here is a test of projection mapping tracking with a moving object. I want to add the projection mapping to the interactive parts of the diorama to make a more immersive experience.
Diorama & Technology setup plan
The diorama consists of three columns, each constructed from three 12x12 inch foam panels stacked in two layers. The bottom layer serves as the foundation of the entire structure, while the top layer forms the actual base of the diorama and includes a space in the middle for placing Arduino components. Each column has its own Arduino that only needs to be plugged into a power source during setup. This design makes the diorama easy to carry and install. The only major component that needs to be set up separately is the projector, which covers the entire terrain from above.
The technology part starts with the Arduino, which uses WifiNINA to connect to Unity and send trigger signals based on the physical sensors. Unity acts as a server, recording everything and applying the game rules. Then, Unity sends the signal to MadMapper through OSC. Finally, MadMapper displays the visuals.
Arduino magnet reed trigger sends a signal to Unity.
Arduino receives a signal and then sends it to MadMapper via OSC.
MadMapper presents visuals based on Unity's message.
Development process
Starting with two foam blocks for diorama structure tests, I shaped them to look like terrain and added sculptamold for texture. I tested how well the blocks blended as separate pieces, which is important for the diorama's modular design. The results were positive, with the colors and texture paints enhancing the overall look.
.jpg)
.jpg)
I use resin printing to make movable objects that will have magnets and electronics inside.
Use white foam as the base structure to ensure the whole build is light and firm. Carve out objects or shapes that are easy to create by hand with foam; if not, revert to the previous 3D printing method. Add magnets at the connecting points between the foam boards so they snap together when placed side by side. Internally tape the breadboards under the top layer and connect all the wires accordingly.
.jpg)
The finished, unpainted version is here. All the parts are working as intended, and I can interact with and inspect each individual sensor on unity's logging system.
.jpg)
.jpg)
Reflection
Learning Experience
I enjoy revisiting the process of making a diorama, but what's most important to me is ensuring that the Unity server functions properly. Specifically, I focus on figuring out how to connect the Arduino, Unity, and MadMapper together. This is the first part of the thesis process that I work on because I am familiar with the process. Fortunately, I am able to finish it quite early into the process.
Project Insights
Modularize diorama build : The modularized build was a huge help during thesis week, as I could easily transport it from home to school and set it up quickly.
Use Unity as a server : By using Unity as a server, I could monitor whether any sensor on the diorama was working. This was incredibly helpful for ensuring the project ran smoothly throughout the thesis show.
Immersive game play: The combination of physical play, audio, and projection mapping made the gameplay process feel very immersive.