Tyama: Melbourne Museum's Stunning Immersive AV Experience

Melbourne Museum’s Tyama is more than a highly engaging new exhibit, it’s an investment in an immersive future. Put it this way: when you spend hundreds of thousands of dollars on projection alone, you expect more than six months of ‘good feels’ from a temporary exhibition. “We were looking ahead to the next five years with this investment,” confirms Melbourne Museum’s Project Technical Lead, Richard Pilkington.

How many projectors is enough? Richard spec’ed 46. Working with projection engineers, Light Engine, it was deemed that a combination of 45 Panasonic PT-MZ13K and PT-MZ10K solid state laser projectors was enough to entirely paint the 30m x 30m empty space, providing a notional ‘every eventuality’ number, with the 46th acting as a spare.

Projection Is Dead, Long Live.....

As immersive experiences become a bigger deal, projection’s star continues to rise. An LED-dominated AV future can wait as high-brightness, increasingly-compact projectors remain the go-to weapon for theming oversize spaces. “Early on in planning I had people in my ear asking ‘what about LED?’,” recalls Richard Pilkington. “I did some due diligence on that front but I was left in no doubt that projection technology was still the preferred platform on which to build our immersive future at Melbourne Museum.”

In other words, Richard needed some serious convincing to turn his back on proven museum and display technology in favour of a brave new LED world:

“I knew projectors could do what I wanted for a much better price.

“I knew that I was starting with a big, dark box, so any light was going to be under my control and I could control light from projectors far more effectively than LED.

“LED is heavy and needs extra infrastructure.

“LED creates more heat, which is a potential problem when an AV experience includes traditional exhibits, such as the moth cabinets in Tyama.

“I wasn’t as convinced by the ease in which I could stitch multiple different signals together in LED — there were still unknowns.

“Projectors are proven performers and LED would have been a case of biting off more than we could chew at this point.

“The likes of Panasonic has a whole range of products and lenses that that give us flexibility to build a bespoke project. At this point, LED forces you to design around it rather than the other way around.”

Moth Night Sky

Become a moth by interacting with, then attaching yourself to, one of the projected creatures. Lead your moth to the right blossom for dinner. Then stand back, slightly aghast, as your moth finds a mate and engages in some procreation.

Two Intel RealSense sensors are stitched together to cover the floor area. 8 Panasonic MZ-series projectors are fed data from two Unreal Engine servers running the eight outputs. The blob track created by the sensors (fed to an Intel NUC 9 ‘sensor PC’ in the ceiling) act like a joystick or a mouse to control the movement of the corresponding moth in the video content. The video comes from the server rack where Nvidia GPUs spit out the video via Displayport into HDBaseT converters.

Life Through a Lens

Panasonic’s range of lenses, including the ultra short throw lenses, were a significant selling point. Lumicom took care of the projector installation, led by Damien Vanslambrouck. Damien met Panasonic’s range of UST lenses when it got him out of a jam during the ACMI Museum of the Moving Image install. “There was a straight wall and then it bent to a 90 degree curve. The client didn’t have budget for two projectors and the ET-DLE020 UST lens allowed us to do it with one projector. It was like AV sorcery!”

Melbourne Museum bought two of the Panasonic ET-EMU100 (0.33:1 – 0.353:1, zero offset) lenses for Tyama. “We knew ceiling space was going to be tight at times. And when you need a large image, the EMU100 has been great. With lower ceiling heights the fact the lens is zero offset means you don’t have to mount the projector higher than the top of the screen. We didn’t necessarily have a predetermined application for the two EMU100 UST lenses, we just knew they were going to save our bacon during the install. What with all the other services in the ceiling space it was impossible to reliably predict each of the mounting points. The AV guys are always the last in the queue and the EMU100 afforded us huge flexibility when things looked impossible.”

Events Mentality

The investment in technology that you see in Tyama represents a subtle but profound switch in philosophy for the museum. The 30m x 30m blank canvas that Tyama occupies will play host to future immersive exhibitions. For Richard, it’s taking on more of an AV events mindset towards museum exhibits, namely keeping a stock of technology that can be repurposed and will be equally applicable year on year.

The arsenal of Panasonic projection is the most conspicuous aspect of the grand plan but the lighting, the truss, the audio, media servers, the RealSense sensors and sensor UI, and the HDBaseT baluns all play a big role in the future of immersive at Melbourne Museum.

"“We have an amorphous box that we’ll always start with, and I wanted to invest in elements from there,” explains Richard Pilkington. “The events approach resonated with me. That said, Tyama is operating seven days a week from 9am to 5pm. So the equipment is worked constantly for a six-month period and this necessitates some control and monitoring overlays you mostly don’t need in an events situation.”"

Bat Cave

Visitors become bats, triggering echo location ‘pings’ to navigate the tunnel. Melbourne Museum commissioned AX Interactive to build a UI that allows AV staff to visualise the use of multiple sensors. In this case, the Bat Cave uses audio sensors (microphones). RME mic preamps feed the NUC sensor PC, which prioritises the loudest clap sound coming from the four mics.

The Unreal engine subscribes to the sensor data: the loudest clap originated from ‘Quadrant 4A’, say, and Unreal will send content down the HDBaseT line to the relevant projectors to display the echo location graphics and send a message to QLab to play the interaction sound through the multichannel audio setup.

Bat Cave employs four Panasonic MZ-series projectors and 16 loudspeakers.

The Shallows

Join a shoal of anchovies, then heartlessly lure them to the shallows where they are savagely devoured by an array of predators, such as a stonefish and hungry gannets. 14 Panasonic MZ-series projectors paint every surface of a geometrically complex space, including five for the inner cylinder alone.

Four Intel RealSense sensors feed one Intel NUC 9 Extreme to provide the ‘blob track’ for interactive data. The audio cues go to the QLab server, which plays/triggers the sound effects and the backing track over the seven Genelec PoE speakers and Yamaha passive speakers.

Twenty-two Genelec PoE loudspeakers and Yamaha passive loudspeakers take care of the audio immersion including upward firing speakers in the floor to bring the audio image down to where the action is.

Whale Room

Huge 8m high walls provide a colossal canvas for the gentle giants of the sea. 15 Panasonic MZ-series projectors are employed, with 14 of them used in portrait orientation. The horizontal pixel count is immense.

Richard Pilkington: “The light bouncing off a projection screen in an otherwise dark room is very different to a light emitting diode. It’s easier on the eye and, as a result, it’s easier to get immersed in that environment. ‘Just turn down the LED output,’ you might say. But I know those panels aren’t designed with that in mind.”

Panasonic’s Incontrol software is used to do the image fade for the projection blend, while the Vioso media server takes care of the actual image blend. Richard Pilkington, “by using Panasonic Incontrol blending I can fix the drift that inevitably happens over time, without going back through that process of a blend in Vioso. In my view, it just reduces the number of things that can possibly go wrong.”

Measure of Success

A big immersive experience like Tyama, by its very nature, has a different impact on different people. Some are happy to stand to one side and take it all in; others (mostly kids, if we’re honest!) immediately understand the mechanics of the interactions and delight in it; and there are myriad responses in between.

Having spaces that allow up to 20 people to simultaneously interact with the content is pretty special and demonstrates how AV has the power to bring people together through wonder and shared experiences.

What is Tyama?

Tyama (CHAH-MUH) is the Keerray Woorroong language verb ‘to know’. It is about knowing, not just with our minds, but with our whole body. By listening closely with all our senses, we can embody these learnings and understand our place in the world. Grounded in First Peoples knowledge, Tyama blends the physical and digital to create an unmissable immersive experience to reawaken your connection to the natural world. Tyama transports you to Victoria’s nocturnal worlds, immersing you in 360° responsive projections, breathtaking effects, and exquisite soundscapes.

Are you planning new projector applications?

We have an expert team ready to support you.

Tyama: Melbourne Museum's Stunning Immersive AV Experience

Projection Is Dead, Long Live.....

Moth Night Sky

Life Through a Lens

Events Mentality

Bat Cave

The Shallows

Whale Room

Measure of Success

What is Tyama?

Are you planning new projector applications?

Read more insights…

Grand Hyatt Singapore, Grand Ballroom

Funky Forest: Children's Season 2010 at the Singapore Art Museum

i Light Marina Bay 2014

Singapore Night Festival 2013