In 2022 the MIT Museum moved to a brand new location with 20+ installations across four major galleries.
As the Executive Tech Director for experiential media, I was deeply involved from pitch to installation in this close collaboration between Studio Joseph, Bluecadet, and Pentagram. Playing both a creative and a client-facing role, I worked across disciplines and studios to develop original concepts and prototypes, research new tech and oversee AV/fabrication integration.
During production, I oversaw a team of a dozen developers, defined technical standards, systems architecture, flow of communication and best practices across various stacks for all Bluecadet installations.
Featured Experience
Black Box
This experience demonstrates how neural networks work, how they're trained, and why they're biased. Visitors draw a facial expression, which is then analyzed in real-time on a large holographic projection.
The installation encourages playful iteration and interaction with the custom-trained A.I. model. This is an original concept that I sketched, presented, and prototyped—final design and implementation by the team at Bluecadet.
Volumetric Projection
The installation is projected onto 3 transparent layers of Hologauze using 3 projectors, creating the illusion of a single 2.5D volume in a void.
This required careful planning, visualization, and physical mock-ups with the spatial AV projection specialists. Baffles, curtains, and absorbent materials were used to capture the spill.
Custom A.I.
With a technical topic like A.I., it was important to provide visitors with an emotional hook as an entry point.
This is why the model analyzes facial expressions. To do that, we collected 7,000+ drawings via a custom web app and trained an NN to analyze expressions in real-time.
Featured Experience
Audio Cones
Driving science and innovation at MIT, at its core, are the people that make up its community. We worked with the museum to bring these voices to visitors via proximity-triggered audio.
In the A.I. and Essential MIT galleries, 9 Audio Cones react to visit presence using lighting and audio. I was involved with early UX and tech prototyping, and systems planning and worked closely with AV and fabricators to integrate all the components seamlessly.
Featured Experience
Collaborative Poetry
In this experience, visitors are invited to write a poem with an A.I., posing the question if an A.I. can be creative before models like ChatGPT were available. I helped coordinate the spatial and AV integration and consulted on user experience design.
Physical Design
Experientially it was important to create a space where users could focus on writing while others could still engage and watch from afar.
We used a curved OLED to create a swooping canvas for all published poems above visitors. This was informed by various mockups, scale testing and careful planning to ensure the control boxes and mounting were elegantly integrated.
On the software side, we used Unity's cloth sim to emulate the floating paper across the large canvas.
Moderation & Safety
Through MIT, I worked with OpenAI to get early access to their GPT-3 API. Based on our UX principles and OpenAI's requirements, I developed a moderation and safety strategy for this experience. These standards eventually formed the foundation for all user-generated content at the museum.
