Skip to content
ACMI Conversations: Art, Science and Tech in VR episode artwork

Apr 27, 2018 1 hr 18 min

ACMI Conversations: Art, Science and Tech in VR

from ACMI Stories & Ideas Hosted by ACMI

From the surface of the sun to the depths of the prehistoric seas and the earth's orbit, VR continues to open portals onto worlds we could never physically inhabit. What potential does this technology hold for expanding the realms of human experience? Erth's Scott Wright (Prehistoric VR), artist Jessie Hughes (Soul Of Sol – La Palma) and astrophysicist Professor Alan Duffy (Swinburne Uni) discussed art, tech and science in their latest VR works. Copyright acknowledgements: Clips Played Title: Mars 2030 Copyright: Mars 2030 was created by FUSION in collaboration with NASA and is powered by Nvidia GeForce Link played: https://www.youtube.com/watch?v=prpQB0nlRV8 Purchase / Experience: http://store.steampowered.com/app/510850/Mars_2030/ Title: the Blu: Whale Encounter | 3D 360 VR Copyright: Transport Wevr Link played: https://www.youtube.com/watch?v=hUpkVa4UkMg Purchase / Experience: https://www.transportvr.com/theblu-series Title: Tree VR – Seedling Copyright: Rainforest Alliance Link played: https://www.youtube.com/watch?v=ERffRXjTAqM Purchase / Experience: https://www.treeofficial.com/ Title: Soul of Sol | Inspiration | NASA | Thermonuclear Art – The Sun In Ultra-HD (4K) Copyright: NASA's Goddard Space Flight Center Link played: https://vimeo.com/167370549 Title: Soul of Sol | La Palma Copyright: Jessie Hughes Link played: https://vimeo.com/167207800 Title: Soul of Sol | Artist Residency Copyright: Jessie Hughes Link played: https://vimeo.com/167368978 Images Shown Prehistoric VR, Erth http://erth.com.au/ Sci VR,http://www.scivr.com.au/

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

ACMI Conversations: Art, Science and Tech in VR

0:00 1:18:53
of matches

Transcript Auto-generated, may contain errors

ACMI events take place on the lands of the Wurundjeri people of the Kulin Nation, and we pay respect to the elders past and present. Welcome to the ACMI Conversations podcast, where we explore the world of the moving image and its connections to politics, society, culture, and art. This is a recording of a live event, and it may reference visual material. You can view this on our YouTube channel. Hey, so this evening we're going to have a discussion with three professional storytellers. Each is a celebrated expert in their own field who has tried to extend what is possible with their craft by embracing emerging technologies. Tonight, of course, we're focusing on their experience with immersive storytelling in the medium of virtual reality.

Now, I'm sure that many of you, like me, are familiar with the rollercoaster of expectations that Vihar has been riding since the first Oculus came out in 2013. The hype cycle can be very, very unkind, and tonight is not going to be about is it a thing, is it not a thing. Instead, we're going to talk about the potential, and we're going to talk about the potential of immersive storytelling for communicating something new, for expanding our horizons, and what it's like to try and do that as an artist or an educator. We'll have a presentation from each of our guests that's going to introduce you briefly to their work and experience and then a discussion including some other examples of VR which is trying to do exactly that, expand our horizons. So first of all I'd like to say that Scott Wright's award-winning theatre company Earth has been inspiring people by immersing them in paleontology as performance for decades. He's taken a dinosaur zoo to Broadway and now he's installed a prehistoric aquarium downstairs. He's quoted as saying puppets are the new black but rather than quoting old interviews I'll let him speak for himself. Please welcome Scott Wright.

So, despite the fact that I look like the oldest person in the room, I'm very, very new to VR. Probably the most naive of anyone sitting on this panel. I work with a company that kind of revels in... doing things differently to everyone else and a company that embraces beautiful accidents. And our current show, which is Earth's Prehistoric Aquarium, prior to the show starting, two of the puppeteers go out into the foyer and collect six children and bring them backstage and then induct them into safe diving practices, such as breathing techniques. They put a diving suit on and diving helmets. And so 15 minutes before the show starts, we get...

six members of the cast that didn't know they were going to be in the show to start with. And then halfway through the show, those six kids are then brought up on stage and then they become kind of like the avatars of the audience. They experience this unique underwater space and they kind of navigate that space with one of the hosts of the show. It's a great show and I totally recommend that you should see it at the Melbourne Art Centre in September next year. But we were doing the show at Adelaide Festival earlier last year, five-star rating, and Katrina Cedric, who is the director of Acme, and I were in the artist's bar having a few drinks. And Katrina said to me, if you were going to make a VR Scott, what would you do? And as is my charm, I said I would either make a horror film where nothing happened or I would...

make a six-minute version of Prehistoric Aquarium. And Katrina thought that was a good idea. And so having never made a film, let alone a VR, I found myself with a commission. And very quickly it kind of escalated. And we managed to secure some funding from Screen New South Wales. We got a massive amount of in-kind support from Australian Film and Television School. And we also worked with StartVR, who were kind of like a corporate VR company in Sydney.

But all throughout that whole time of pulling our resources together, I continued to say that I had no interest in what anybody else was doing in VR. And in fact, I tried to avoid VR as much as possible so that I didn't get bogged down by what everybody told me you couldn't do. And we shot it in February this year. We had three days in the studio. The thing that I hated the most about it was that we were doing it in the Australian Film and Television School. Not that that's a bad thing, but it meant that we were doing something that had all this baggage that was related back to film and television. And VR, even by my limited experience, is definitely not a film space. It's a theatre space, and it needs to be treated that way. And I found the most frustrating thing in what we were trying to achieve in the studio was that...

There's just too many people who had statuses that I needed to be made aware of. We just couldn't work fast enough. The lighting guy needed to make sure I knew he was the lighting guy. And also because we're using an Ozo, which is sort of like a top-of-the-range VR camera, it sort of looks like one of the Sentinels from Matrix. It's like a small grapefruit with eight cameras. It has two stereoscopic cameras at the front, which gives you 3D. And the problem with that is that it takes 36 hours to render down everything that you shoot, so you can't look back at what you've done. And so we're kind of just having to sort of just punch it out as much as we could with the kind of, I won't say limited sort of enthusiasm of the crew, but...

It didn't give you much room to sort of learn from your mistakes. You just sort of had to do as much as you could in the time that you had and then hope to God three weeks later, once everything had been rendered and stitched, that you had something that was worth showing. And fortunately, a lot of the post-production was done voluntarily by the staff or people from AFTRS. So I do owe a lot to the generosity of other people. But it also meant that there was a very long period of time in which we could produce the product.

And it sounds like such an ugly word using the word product, but there was a lot of playing around and still I felt like we were bogged down because everybody was kind of using this sort of idea that we were making a film or we were making a movie or something. These are the kids. That's... Oh. I just wanted to tell you Stella and Bella, the girl that welcomes you into the tank, and then Bella at the end who tells you that we're going to the Great Barrier Reef. We're thinking of enlisting them to make a VR about them talking about their bedrooms, because they're so enthusiastic and they're such great little girls. I think the other thing about what we've done in the VR space is that we've used puppetry, and as far as I know, no one else has done this yet.

I know that people are playing with puppetry, but no one's ever done anything on this scale yet. And the thing that I like about it is that, you know, puppetry really relies on the suspension of disbelief. It really... You know, it tricks your brain, it tricks your mind into believing that a completely inanimate object is alive. And then when you combine that with VR, which in turn is tricking the mind into believing that it's somewhere that it's not, you're kind of double-tricking the brain at the same time. And I quite like the idea of sitting in that space and exploring that further. So how much can we potentially push that? I think that the lessons learnt from prehistoric VR is that for the next little while...

And when I say we, I mean Earth, what we're going to do is kind of just try and find a better way of making things really fast. Don't get bogged down with computers and programming and lighting guys and all that sort of stuff. But actually just sort of play with the idea of taking off-the-shelf equipment like... the new Samsung Gear 360, which is like a two-lens camera, like the size of a golf ball that sits on an egg cup, and stick it on a table and basically make little miniature cardboard cutouts of everything and just sort of make stuff, you know, and play with everything but not have to be delayed by anything. I feel like you kind of have to, because VR is such a new space...

you just have to sort of throw yourself in. It's like climbing up to the top of the tree as far as you possibly can and just seeing how much further you can go before it breaks and you fall. And I feel like that's where I want to go with it. I want to find out how long I can sit underwater for without having to come up for a breath or... You know, it's a space that is unknown and therefore it's dangerous and that's what excites me. And I don't think... The more people tell me that you can't do stuff, the more I'm determined to do it.

Is that 10 minutes? I reckon that will do. We're going to pick up on some of these things. We'll definitely be coming back to some of those points that you raised, Scott. So, last year, Jessie Hughes was named one of Australia's future changes. That's just a tiny brief for her there, but I think you'll all agree that she's up to it. As well as being a passionate advocate for digital innovation as a positive social influence, she's also a very accomplished artist. Her virtual reality and new media works have been exhibited at Cannes, South by Southwest, Sundance, and the Tate Gallery in London.

Last year, and she was quite busy, obviously, she won the very prestigious TechNart Artist Residency, which formed the basis of her latest work. Here to tell you about it, please welcome Jessie Hughes. Thank you. Yeah, so I suppose a bit of the problem is that I love everything so much that I haven't been able to mail down exactly what I want to do. And so just given the topic of tonight was art, science and tech, I tried to just pick two projects which I think relate.

strongest to this theme tonight. So I'll start with my artist residency. So last year I stumbled across a brief asking how we can merge art, science and technology together. And these are typically quite different worlds, but I think it's incredible if we can tie them together. So this artist residency was at Roque de las Machatas Astronomical Observatory over in Spain in the Canary Islands. And when I researched them, I found out they had the most highly resolving solar telescopes in the world. So we had a bit of jealousy over here from an actual physicist.

And so I found out this fact, and I was like, okay, well, obviously we have to do something about the sun. That's what we need to be nailing down. Now, this footage is by NASA. It's incredible. So what they did... Do you know much background about this? Probably better explained by you. Yeah, yeah. So it's a beautiful telescope that's floating out in the world. Not in the world. Past the world. And they recorded the sun moving in all these different wavelengths, and you're able to see... To me, it looked like it was alive. I just saw this isolated, alone ball of energy all by itself, and yet...

the reason we have life on Earth is because of the sun. And so that was kind of what inspired me to, okay, how can we bring these emotions, these human emotions of empathy and appreciation and a connection between humanity and, you know, the thing that gives us life on this earth, how can we tie that together? And that was through art, science, and tech all coming in one little bundle. So that resulted in my project, Soul of Soul. And, yes, there's a little pun there, of course. And so I wanted to capture the spirit of the sun, and I did that using data. So if we look at, when you say stars, they have, like...

their own spectrum of what makes... Oh, sorry, this is during my residency there. They had, like, I think it was 12, maybe even 13 or 14, yeah, of, like, the world's best telescopes, which was beautiful. Yeah, and so I just wanted to really think, okay, how can we take data, which to the general public is scary or boring, or, you know, why does 1,000 numbers on a page have any interest to anyone? How can we make that something that someone can look at and be like, oh, yeah, I do feel something?

And so with this data, I visualized it in a way that I was able to build an actual structural form. And so the spectral is kind of like the fingerprint of a sun. Each star has its own, you know, spectra of information that defines what it's made of or how old it is and all these factors which typically we associate to a person. We could take all these characteristics and how I could put that into, like, a way that someone could empathize with. The other element of what I loved, during my residency, I was exposed to this incredible audio file of the sun's heartbeat. And so how it'd been recorded was, using this data from this telescope, the sun, it's constantly shaking. It's constantly boiling. If you imagine a pot of water boiling, it's constantly shaking. And so...

what these physicists had done was capture these wavelengths and brought it up to the audible hearing range, and it was this beautiful pulsating sound, which to me, as an artist, I was like, I'm using this for sure. Yeah, so it had this really beautiful sound to it. And I then did a data visualization of this audio and how we could, you know, see and feel this heartbeat. So I had this element of the fingerprint of the sun, its heartbeat, and then, of course, it was solar-powered, and so it had the solar power, like, triggering the whole installation. Yeah, and so it was just... I spent a month living at this observatory, which my astrophysicist partner was very jealous of. I was like, sorry, stole your dream. Yeah, so yeah, it was just a crazy awesome time. I was really excited to push how we are able to merge these different worlds together with just a bit of, you know, programming or creative thinking and how we can bring these worlds together, which I think... The reason the observatory wanted to do it was because they had these amazing discoveries, which were, you know, the most forward-thinking humanity had ever gotten to. We're going past and beyond and beyond and beyond.

And predominantly, unless you've read, like, a few research papers, you have no idea about it. The general public have no idea. And why would we? It's not accessible and it's not interesting looking at a giant data set. So it's this whole idea of how we can make it interesting or beautiful or relatable. And so that was our project in a nutshell, which was...

Awesome. And so then when I finished that, I came back to Australia and I was selected for Oculus' VR for Good program over in the States. So my background is in interactive visual design, art, that kind of thing. I hadn't really done film or VR, that stuff beforehand. And yet I just kind of ended up in this field. And last year I was at Facebook headquarters. I'm sitting in a room. And we were dropping names before, but like the names of VR were all in the room. Everyone was in the room. Can I get up with a microphone like?

Thanks for being here, everyone. It's great. So just a heads up, we don't really know what we're doing either. So it's all good. And so it's just crazy to have these people who in the industry are considered, you know, the best of the best. And they're like, you know, it's such an experimental space right now. We're going to tell you best practices. That's all we know is the best practices. We're still trying to figure out what is the best of the best way to go. So... So...

So how VR for Good worked was Oculus paired 10 filmmakers with 10 not-for-profits to make these really impactful, immersive stories. So I also have a background in the social good sector in fundraising. And I've done face-to-face fundraising for years. And trying to be on a street, trying to convince somebody to care about something is really hard. Because they have to imagine it. They have to be like, yeah, I suppose living without electricity would suck. And you're like, okay, but why would it suck? What is the real reason? Where's the struggle? What's the oppression you're going through? And so with VR...

We can physically take somebody and place them in that exact experience. My first VR experience was in a shopping center over in the States. I don't know if you've heard of Tom's before. Tom's is an awesome shoe company. If you buy a pair of shoes, they give a pair of shoes to a kid in need. And they work predominantly in South America, I think, but I think they've expanded. They've become massive. Yeah, so I was just shopping, strolling around. I saw one of these sitting there. Check this out. Put it on. And I was...

falling in a shopping centre. And I just had tears falling down my face. I was watching a child get his first pair of shoes. And I'm in a school, I'm in a village in Peru, I think it was, and this child was just so happy they got their first pair of shoes. And the fact that I got to experience this child's...

like what was happening in his life and just the experience, the impact that Thomas had created for this child. I took that headset off and I was like, you know what, what can I do to help? How can I be part of this? And so coming from that fundraising background, I was like, this is going to be something big. Like this has to be something big. And which we've seen over the past few years is that using VR as a fundraising tool has been phenomenal because it allows people...

to stand in that show and to deal with it themselves and to see it and to see how their dollars can genuinely make an impact in people's lives. Yeah, so for VR for Good, I partnered with the Global Brightlight Foundation. This is at Facebook headquarters. Best day of my life. Yeah, so this is on a shoot in Guatemala. This is the Nokia Ozo we were talking about before. It's like a puffer fish. It's like, he survives. It's adorable. Yeah. So this is in the school that I was filming in. So my story followed, it says director Jesse Yenna Hughes. They used to tease me because I'm an Australian accent in American career. I was like, yeah, nah, yeah, nah, don't worry about it. Like, yeah, nah, don't worry about it. I'm like, what do you want me to do?

Yeah, so my story followed the life of Anderson and Arely. So Anderson's family have, and this is a true story, so Anderson's family have access to solar light. Arely doesn't. Both absolutely beautiful kids, both super intelligent, have heaps of potential. But, you know, Arely doesn't have access to solar light, which means when the sun goes down, that's the end of the day for her. That means no studying after dark. Her parents aren't able, you know, as soon as the sun goes out, that's the end of the money. They're making like $1, $2 a day for working the fields their entire life, and then the sun goes down. And that's super hard to connect with family members. You know, I think when the sun sets, we get together with our family, we eat dinner, we watch TV. But life really stops. And for...

for communities that are making barely any money as it is, productivity is massive, economy is massive, so buying candles. These families are spending 25% of their income on candles when it's like 2.5 for a typical US family. So yeah, it was just, what we wanted to do with this film was not show white Americans coming in, dropping off some solar lights and leaving. It was about, with this film we wanted to show... What is life really like for these kids? And how does Soul Light genuinely impact somebody's life? And so really getting that like why story across. And that's what I found with VR to be so, such an incredible experience was that it's narrated by the grandmother on the left. So she tells the story about how, you know, she's so grateful that her son, she didn't have this opportunity, but now her son has this opportunity, her grandson has this opportunity of Soul Light and how it's impacted her life.

And as a viewer, to be able to be in a headset and hear the voice of a loving grandmother tell you about how she's so grateful that her child now has the potential to grow up and be someone. But, you know, his best friend doesn't. But if you help, he does. Like, it was just so, yeah, a really, really impactful process. And making it was so much fun. Yeah, the whole 360 shoot, you can't be in the shot. So it's kind of like, set up a camera for the best and out you get. And, like, that's what we were doing in the shoots. We have shoots in, like, fields where people are working in the fields. And we're hiding in the grass, like, lying down. And I'm like, everybody, get down. Yeah, so it was such a fun experience to actually.

make and film. I forgot to add to the end of the thing. I've been working really strongly in this space for the past year and a half. Other things I've done recently was I went over to Borneo and did 360 of orangutans over there. That was so much fun. Again, I fell out of a canoe and broke my camera. Don't have to talk about that either. The other area of what I'm working in at the moment is an experimentation of how we can teach people sign language in virtual reality. We're in an awesome space right now with hand tracking technologies using a thing called a leap motion. What I'm playing with is how we have a headset, we put a tracker on, a person can go in and...

physically, you know, inhabit the body, see the hands moving below them, and just, yeah, it's just an entirely different learning experience. The reason I wanted to do, like, merge these two worlds was to make learning sign language something super fun and super cool, and to chuck on a headset and be so immersed in this that when they take it off, they're like, oh my God, sign language is so much fun and cool, like, let's go out and learn it. And so that's, like, the kind of what we're trying to get across, and we're still developing it. It's really hard to, like, track hands super accurately when you've got, like, three dimensions and stuff, but, yeah, I think this space that I'm so grateful that I was, like, slingshot right to the top of it, and I'm like, okay, what else can we figure out? But, yeah, super fun, and I love it.

And I encourage everyone, if it is an area of something that interests you, Samsung Gears are, like, I think they're just $200, maybe $300. $220. Deal. Bargain, guys. And, yeah, I mean, I worked with the Nokia OZO and Facebook, and, like, that camera was worth $40,000 US dollars. We had to carry a generator around the whole time because there was no electricity. Like, every single shoot took hours, and it was just so hard. I took the Samsung Gear 360 to Borneo, tucked on a stick. Off we go. And...

Honestly, yes, the quality is better with the OZO, but if you're trying to make stuff, just go out and make it. I use the gear professionally still. It's a $200 camera. I use it for universities, like professional clients, because it works just as well. So yeah, I really recommend if you are interested, just go out and play with it. If you are more into the hard-coding VR stuff with Unity and tech, there's so much cool learning out there at the moment. And yeah, I definitely recommend anyone to...

Jump on into it. Can you tell that I'm a cheater, right? Yeah, I was going to ask it. Were they moon boots that you were wearing? So there's actually a story behind that. So I was at Facebook, and I found out I won this VR thing. It had no details. And I walked in, and they're like, oh, here's your not-for-profit. I'm like, oh, you do that call. And he's like, so you're making a movie for us, right? I'm sitting here being like, I've never made a movie in my life. I'm like, am I making a movie for you? And I was like, yeah, okay, cool. And I was like, oh, my God. And he said he worked in Guatemala. I was like, oh, that's sick. I wish I could come, ha-ha. And he's like, oh, I'm going next week. Do you want to come? Yeah.

I was sick and I had no clothes because I was packed and dressed all pretty and show off in San Francisco and I actually bought those shoes from an op shop and they were two sizes too big for me but they were the only ones they had and I had a day to buy it and get my needles and everything sorted the same day. So there's the story behind the shoes. They're not my choice. Okay, thanks Jessie. Alright, Associate Professor Alan Duffy is an astrophysicist whose main interests according to his bio are making baby universes on supercomputers and vast halos of invisible dark matter.

We're very lucky he doesn't mind explaining science to the rest of us on television as well. So here in his role of science communicator, please welcome Alan. All right, so over the next few minutes, I really want to share with you my effort to tell virtual stories. And in particular, that was to teach in what I hoped would be a different way. It wasn't. So instead, it's going to be about the lessons that I learned from not particularly telling stories in a different way.

It all began with an idea that I had. Again, I think there's been a running theme of those ideas, just coming together, right people, right place. Maybe I'll call them all done. And it was the recognition that a lot of my science lectures, by definition, had to be in a lecture theater. And I was seeing the same people. And that's fine. That's great. They're my students. They should be there. But I was also in the evening lectures. It would be the same sort of crowd, too.

I wondered with my colleagues, if we could free ourselves from the lecture theatre and take the science to where the public were, would we get a different audience? Could we teach the science in a different way? And really, what actually did we need from the lecture theatre? And fundamentally, it was just about having a high-definition image or video. And we've seen some of the beautiful examples from Soho and the Solar Dynamics Observatory. I mean, absolutely stunning content.

So we decided to apply for a National Science Week grant, and to my horror, we got it, because I had to deliver on this. And when I say I, I actually mean Carl Knox and Mark Myers from OzGrav, the Center of Exist Gravitation Wave Discovery. They had to deliver on this. And what they ended up delivering was science and VR, right? So cyber is an app that you can download from App Store or Google Play. And you get this nifty little headset for like 20 bucks from our uni store these days. But you can use any Google headset. And fundamentally, it was about making an app that was free and making a headset that cost less than even $2.20.

Five bucks for a Google headset. This is a little bit flasher, right? It's like a little bit of gold. I like playing. As you might tell, I like to dress up. And I want my headsets to color match. So we had this idea that if we could create an app that featured the science, that we could do a science lesson differently. So we partnered with the State Library of Victoria and Mind & Goat Brewery. And I thought, I'm going to be able to catch two different audiences. I don't think the Venn diagram is totally overlapping in that group.

With the app, you get to explore the sort of classics of Saturn, the solar system. You get to explore these super extreme objects called neutron stars, the very sort of cutting edge of astronomy. And indeed, you can see the entire night sky in different wavelengths of light. And this is the Milky Way seen in H1. It's a giant radio telescope, it's like the Parkes radio telescope, the dish. In fact, this is using some of that data. And it reveals a universe that is very different to the one that we experience in our daily lives.

And that was exciting for me to see, and I hope that it might be exciting for an audience as well. And look, we're in a bit of a hurry, so we just use a lot of text. I recognize that the voiceover is way better, right? I like text. Text is brutal. If you're in the universe, I got so carried away with the science lesson, fully half of the universe is text. You look at Ryan, it's like, more facts. So yeah, I got very carried away with the science aspect of it, but I probably should have left it a bit more with the user experience. And what we wanted to do was, in a live event, go somewhere distinct from a lecture theater to a science talk. But we wanted to cater for anyone who couldn't get there too. Because if people had the visuals that were on the app, they didn't really need to be at the lecture. They didn't need to be in the Minds and Go Beru at State Library. They could watch a live stream.

And just in case they downloaded the app before the live stream commenced, as we have here tonight, I gave them a load of facts too. Awkwardly, I got some facts wrong. And people in the audience could read the fact and were like, excuse me, it's actually 200 Kelvin, not 400. I was like, oh, how embarrassing. So at least from that, and then I was like, of course. Ah, just testing. Good that you're all checking your facts. So that was the idea. And it worked in the sense that we got new audiences. So this is at the Mountain Goat Brewery. We managed to get 80% entirely new audiences to National Science Week.

which is pretty good. And I think National Science Week is pretty happy with this. I don't know because I forgot to do the paperwork to submit to them and that's on my list. Four in five of our attendees were new to National Science Week, which is particularly astounding because 99% plus were somewhat interested in science. So this is the group that National Science Week wants to target. And four fifths had never gone to a single event before, but something about the virtual reality spoke to them. It was a new way to tell an old story and it resonated.

Was it going to the new environment? Was it the new technology? In the post-survey, it turns out it is a bit of both. So that was pretty encouraging. So that was one of my lessons. You can reach a new audience with a new technology, but you have to do something new too. The app isn't enough. What surprised me was the age group who arrived. We really did get a clean mix between the, I'm going to say above middle age, I'm going to be rude, a slightly older audience, and younger sort of hipsters, and there were people with turtlenecks. That's actually my friend, by the way.

So, again, new audiences, but a range of audiences. It wasn't just the younger group. Everyone wanted to experience something different with this new technology. And that was very encouraging. It was very exciting. Now, what I wasn't expecting, however, and this is the shot from State Library of Victoria, and this was a live event with my co-host, Dr. Katie Mack, who sadly just left Australia for a professorship in America, so fair enough. If you're on Twitter, hands up who's on Twitter. Do you follow Astro Katie?

Not yet. All right. Okay. Like half the world folder. She's amazing. Anyway, so the two of us tried this live talk and we find a surprising barrier where this is a phone app and it's with a cardboard headset. There is literally no way to make VR more user-friendly or simple or, you know, fewer moving parts. And, you know, if you've never used a headset, it's literally just the two lenses. It's a split screen on your phone. And what we found was really surprising. For our audience at home, three and four were entirely new to VR 75%.

And that astounded me. I thought everyone had experienced VR, but apparently I am in a little bubble in a university of advanced technology, so who knew? In the actual live events, it was a slightly more familiar crowd about HAF, weren't you? But still, you're coming to a virtual reality event, and HAF had never used virtual reality before, but they were willing to give it a go, and that was very encouraging too, again, of all age groups. But I wasn't prepared for the level of actual physical demonstration of how it worked.

My poor team were trying to run the event and also show hundreds of people how to install or how to run, how to literally fit it in, where to click. And I wasn't prepared for that. I thought it was intuitive. And that's, of course, because I'm at a center for advanced technology. I'm very exposed to VR. I'd underestimated the new technology's newness. It felt intuitive, but it was anything. So that was my second lesson. Just because I think this is as simple as it can be doesn't mean it's simple enough. So don't underestimate that when you're trying to tell a story a different way. Now.

We got there, even though some people unfortunately missed it on the experience because they didn't have a phone. So luckily, we actually had a big screen. So the library had asked, do you want to use a big projector? And I was like, well, the whole point was to free us from the projector. But thank God we took a stream from my phone and telecast it up there so that the audience could enjoy it because there was a significant fraction who didn't have a phone, who didn't understand that was the requirement, virtual reality. Now, the final lesson I learned and the entire point for me on a personal level was can I teach differently in virtual reality?

And at some level, not really. It kind of worked. We were telling stories virtually, telling lessons. And in this picture, you can see where everyone has their headsets on. Everyone is exploring the solar system. They could have any view of the solar system in the world. They could go to any planet. They could have skipped that. They could have gone all the way to the edge of the universe. They could have seen the after the big bang, the cosmic microwave background. They could have seen the sun. They could have seen neutron stars. They could have seen black holes.

No one did anything but follow me. I narrated their exploration of the entire universe and no one raced ahead. And I was very disappointed in that because I thought I can give the audience the universe to play in. Where will they go? They sat waiting for me. And even worse, by the way, by the end, this is later on, I just want you to note the number of faces that are not using the headsets anymore. They're just looking at a TV. Again, after the State Library, we recognized, oh, flip, we do need a projector just in case, but it's a brewery, so we had to wheel in a TV. Most of the people weren't even using the headsets by the end. So again, I was in love with this idea of a new technology allowing me to tell a story differently, to teach differently. But the user experience was different to what I'd hoped.

So my failing, and I still don't know how, but I'm very interested in hearing from the panelists, is how to tell that story differently with this new medium. I just want to give a shout out, by the way. This was one of the hardest things I've ever done. I create universes on supercomputers. Trying to do, create the app, create the headsets, ship it all from international distributors, do a live stream. Here's Alistair running our social feeds, trying to get people to log in. We're taking multiple different views. We're switching between. We made Mark.

Mars looked like a DJ as he tried to switch between all these views. All of this ridiculous effort, what was supposed to free the audience from the requirements of electric theatre to tell that story differently. I'm very proud of my team. I think they did an astounding job. But I would say that, again, the level of technology we find ourselves trapped in to use got in the way of the story. And that was a surprise to me because I thought I knew better than let technology leave me by the nose, but it absolutely wasn't.

My final lesson, and this one I'll give for free. You can find a new audience with a new technology, but don't underestimate the barrier of that technology to that new audience. Thirdly, you do have to think differently about how you tell a story, and that's not something I've understood. But in my experience, the new story goes down easier when you have a beer with it. Thank you. Thank you, Alan. Most things go down easier if you have a beer with it, don't they? A theatre director.

an artist and filmmaker, and a science educator. You're all experimenting in different ways with your own practice or your pedagogy by trying this kind of immersion. Before you started, when you kind of just kind of grasped onto the idea of immersive experiences, taking people somewhere else, when you're a VR virgin, let's say, what was in your head? Like, what did you actually think? Oh, this is what I'm going to do. This is what I really want to do. Like, what was the fantasy VR experience you were going to create? I think I underestimated how powerful VR actually is. Like, I'd done gaming before and all that kind of stuff, and I think in my head, I kind of thought it was a new way of...

playing the game or something like that. I thought you'd be very aware that you're in it. Definitely, I think with lower-end VR headsets, there is that disconnect between the total immersion. But if you put on a proper headset, like the Oculus Rift or HTC Vive, and you go into that land, I think I was just genuinely astonished at how much I did believe I was in that environment. Because, yeah, the way your brain can just be so convinced that you look around and you feel it and you believe that you're in there, it actually surprised me in a positive way of just being like, oh my gosh, I can't believe.

We're here with tech right now, and I'm so excited to see how it goes further with developments with CG and just where it's going to be even better if we can be having these creative worlds, which still right now, I suppose, even in film, if we see animated characters, we know they are animated characters, but I think as that just gets even better and better and we're able to interact in these VR worlds where you can walk around and be disconnected, I'm so excited. I think it's going to be, yeah, it's definitely getting there so much more, and I think what they're really hoping to do at the moment, so for the Oculus Rift or the HTC Vive, which I'm talking about, you have to be plugged. into a really good computer. So when I was working for them, they gave me one of these things, it was worth like $1,200, and I was stoked, I was like, yeah, I'm going to do all this VR. And I can't play it. My headset went to my boyfriend, and I never saw him ever again, because he was trapped in his computer land. But that's it. You have to have all of the necessary technical equipment, which for my parents to see my film, which I made, which I spent six months working on, they had to go to my boyfriend's house, and I was like, can we just go inside for a second? It's that accessibility thing, which I think is...

what I think is the problem right now. And once we are at a stage where we do have the high-end headsets that don't need to be plugged into a computer, that's when I think it's going to be what everyone's kind of waiting for, necessarily. I reckon VR is exactly what I thought it would be. No, that's a lie. When Katrina and I were talking about it, I imagined what it would be like to play Fallout 4 and how much I admire that game for its writing. There's some really, really clever shit going on in there and it's well worth the effort that's been put into it. And I'm excited about what Last of Us is going to be like. But seriously, when I said to her, I want to make a short version of our show, it's exactly what we did. And it looks... I mean, I didn't imagine the studio at AFTRS, but...

Maybe I inhabit spaces and think about them in those ways already. It's just having a camera that allowed me to have a full 360 degree view. What does it bring specifically to a puppetry show though? The nature of it. Why does it mesh well?

For you, you say it's exactly how you imagined it would be. I think part of me doesn't want to know. It's about being excited and stimulated by it, and it's about not questioning the magic. And if I analyse it too much, it would lose its appeal. It's the intangible aspect of it. I am somewhere, but I'm not, but I am.

But I'm not. But you're not. But I am. It's the exact thought. It is that process of being like, I know I'm here, but I'm not here, but I am here. And just that being aware, and when you do really get immersed in a story, you generally forget where you are. And again, tears are falling down my face because I think I'm in Peru. And just that strength to be able to transport people. But I think good storytelling is really, really key. And I've since...

you know, relax a bit more and how to look at what other people are making. And there's some real shit out there. And sadly, it's the cowboys with the money that can afford the equipment. They're going, oh, why are we doing it? Oh, it's so cool. And you go, actually, you're not. You're really boring. And you're just wasting our time. Like, there's much better things like the clouds over sitter and, you know, the work that you've done. And that's far more important than knowing what it's like for a guy with a...

too much money to play. Oh, you know, like it just shits me. I think what we are going on about with the whole storytelling is that when we walked, you know, walked in, again, the best of the best, and they said, you know, these people with 20 years film experience, they said, I want you to get everything you know about film, because... what we're making is experiences. And that was the difference that you are designing how somebody feels, not what they see, you're designing how they feel in that space. So when you set up a camera, you think about, okay, I've got to get the height right. How does somebody want to feel in that space? Do they want to be sitting down? Are we lowering that? And for directing people as well, it's massive. Because like I said, they were waiting to be told what to do. So for us, things like, I have a motorbike to go past in a scene. And naturally, you hear a motorbike going around your ears. You turn. And then there's information standing there. Because it's really hard to know where somebody's going to be looking when they're in a scene. Like, oh, that's pretty. And there's like this giant murder scene going on over there.

And you're like, oh, cool, yeah. And you've missed it. And so with designing these stories and these experiences, the whole time you have to be thinking about how you are going to capture that direction. And while you can say that you want somebody to experience 360 space, awesome. You need to give them time.

to take in that environment and then have something amazing happening because um yeah it was like even watching it during our edit like each of my editors would have an entirely different experience of when we were watching what they were looking at and we're like no you're meant to be looking over there but they don't know that um and so you'd have to drop audio cues in or you'd have to cut it faster and get a kid walking past and be like hey you know and so just little cues like that um and just having that whole element of if you're creating experiences and when we set up for a shoot i always stand exactly where the camera is And I think that how I feel, and it's that, okay, is something small, will be inside, will be outside, what's lighting? Yeah, it's entirely... But don't you reckon also that it's...

To pick up on what you were saying before, maybe all those people would have gone off on lots of different tangents if you had to stop talking. If they hadn't have been devoted to you and listening to you, if you had have inducted them in a way to say, what we're about to do is something that's never been done before. You are all potentially new explorers. We don't know where you're going to go. Off you go. Yeah, so that's interesting. You raise exactly what the new grant says. And it was because we tried to mar the old way of storytelling with the new technology that we didn't realize the benefits of the new technology. I mean, it's still cool, though.

And I suspect that if... I just don't know, am I going to get an audience to come into a space and they get told that, yeah, the talk is your journey, you get to do it, I'll see you in 50, and just walk out on them. What would they do? Would they lose it? I don't know. I'm interested to find out. I don't know if National Science Week is willing to pay to find out, but we'll see. So I think that, getting back to the original question about...

I thought the power of the technology would be so overwhelming that it would transform the experience without me having to personally change as a lecturer, as an educator. And that's simply not true. And I think it's, as you say, we do need to allow the audience permission or to empower them to go on that journey themselves. And possibly it is as simple as... See you later. I'm going to be off stage. And that's when it changes the dynamic. But audio is a really key thing to kind of signpost and to flag things that are about to happen if there's things that you want people to experience. I just want to pick up on that a little bit. So when Jesse's talking about designing for immersion, what you're saying is that you need to design outside the experience itself almost. You need to be prepared to create the nose to tail of an immersive experience the instant they walk in the door if you're going to do something in a public setting.

Yeah, if you want to do something new, then from start to end, maybe even just the emails, the way you're preparing them before they even arrive, you want to flag that this is going to be new. But I really love your ideas of the audio drops, and I think that's key. And that's one of the things that struck me about the failure so far, I think, of VR films to really take off. And that's because we're still doing it in the old fashion where I know where I want you to look, and I'm the director, and you're going to look there, and this is the story. But in VR, you just wandered off. You missed that bit. And how do you design a world that will still allow the...

the viewer to get the experience that you as the storyteller want but without forcing them literally holding their head to move them around and you do it by nudges right we just had the behavioral economics Nobel Prize in order for nudge behavior it's those simple cues you don't realize you're being told to do something what i think is funny in saying that i am curious to see what somebody's experience would have been like if instead of a google cardboard they had the rift I'm curious because I even find cardboards difficult. Typically, you're like, okay, put in a camera and you need this. I was just saying before, so QT up in Brisbane, I work for them, and they did the exact same, made all these Google cardboards, spent thousands, made thousands, and these kids are walking around like, oh, this is so cool, this is amazing. There's no phone in it. They just thought this was fun in itself. Yeah, so I think unless you were directly, if I go this to my mom, she'd have no idea what to do with it. And so I think just, again, making everything as easy as possible is...

a great way with, like, getting people ready for that kind of step. But I'd be really curious to see whether they felt more free to explore. So we demoed this up at Swinburne with the Vive setup. And we actually, and the cable is a nightmare, by the way. Completely broken. Dropshade experience. You're literally, your head is being tugged back. It's an umbilical cord to the back of your head. I'm so ready for cordless. Yeah, oh, I know, seriously. Oh, data rates. Anyway, but the core, the easy solution is you just pull it up and you have a little close order. You know, some sort of a little peg that just loops over on the roof. So they don't feel the weight anymore. And that's very freeing. Not every home is going to, you know, knock off.

but that was enough to get the immersion and what we find was the user experience was truly incredible when you feel that you are floating in space and there is the sun in front of you or there's a galaxy forming in front because it's more powerful one of the things I couldn't do was show my simulated universes which broke my heart a little bit because I wanted to be in one of my universes this universe sucks and unfortunately it's only on the Bible you can do that but to see something spin up in front of you to reveal the galaxy that's cool That is a genuinely moving, affecting moment. What I would love to then do is say, here are the force vectors. Here is the spin. This is the bit of physics. Now you're getting to understand rotational mechanics because you're seeing it and seeing is believing it. And it becomes so much easier to learn quite challenging physics concepts when you can see them. And that's not something you can easily do in the lab. Certainly you don't get to do it for an audience of 300. And that's really where I want to take this. I still have my lecture theater, but everyone gets to be in the experiment.

And that will be the moment that I think we can really push education in VR. Have you played that VR game where you're in a spaceship flying to the galaxy? I can't remember the name of it right now. So pretty much everything. No, no, no. It's amazing. I'm sorry if I was about to wreck your world, but they made pretty much exactly what you're talking about. Sorry. And it's this VR game, and it's made by real data. I don't know who made it, but a real true simulation of the entire universe made by real data. And yeah, you go on a spaceship, and there's missions and stuff. I wasn't really interested in that, but the fact that I could sit in a spaceship and fly around Saturn and look at it.

It's all real. It's all true, real generated. And me, just as a viewer, not looking at it on a science level, was like, wow, this is stunning. It's a stunning experience. And so I feel like something like that, where you look around and these planets are flying, everything's great. If you could then have that element of science on top of that, definitely. And I feel like, yeah, just going down that path of using those really high power, you need a really strong system to run that. But yeah, if we merge all that stuff together with education, of engaging education, that's what I was doing, the sign language thing was about how can we make education something...

super fun or super immersive. And that's what I think VR does. It makes it enjoyable or interesting or cool just in itself. And then if we can apply the learning we actually want at the same time, bundle it up. I'm going to get you the name of it. You're going to love this thing. Love or hate it. Is it about a return then? Like you watch it once, but then you watch it twice. Once you get sucked in and then you find out the shit and then you go back in and go, oh, that's what it is. It's like watching Westworld twice. I think it seems like a good time to talk about some other examples that I've collected together, which I think are about trying to do.

We've got a bit of a flatty trailer here. Has anyone tried this out in the audience?

Well, yeah, so this VR experience is meant to show what strolling around Mars will be like in 2030 around the time that NASA plans to get there. So the spaceship, the habitat and the spacesuits are all based on NASA's concepts with the highest regard for scientific accuracy. So, Scott, you're a master of suspending disbelief. Is realism really going to be that important to immersive technology, in your opinion? Is something like this? Well, I have it on good authority that that's not what Mars looks like. And which authority would that be? I got really hardcore geek earlier when we were looking. I was like, that's not the sunset you would get on Mars. It actually, sunsets are blue.

And midday is red. It scatters light the opposite way to Earth. But I think the important point about disbelief, if you were to see a blue sunset, that would just break you out of the experience. You would not buy it. Even though...

That was really the way it is. I suspect it would break into it. But what happened with Avatar where everybody just so wanted to believe it that they actually developed a depression over the fact that they couldn't go there? That's disbelief, isn't it? That's total suspension. That's like, this is a place that I really want to go to and film James Cameron has made it possible and now I so believe that it's possible that now I've got to go see a psychiatrist. That wasn't real. That's the difference, right? They had strived for beauty and a heavenly world by going down the reality path.

They make Mars look pretty crappy. They're like, I don't really want to go there, right? It looks dry and dead. But it's actually, of course, it's striking and it's beautiful. And it's very, you know, as a scientist, I adore that fascination I have in the realism. But just as I bagged them up for not having the right son says, I do wonder if the...

If what they're trying to do is aspirational, educational, then I think that's the right way to go. And if we can hang out with orangutans in Borneo, then I'll suspend my disbelief as much as possible. But do you think it needs to be hyper-realistic in order to do that? No, I don't think so at all. I think we live in a world where everything is possible. Definitely when I said that puppetry is the new black, it was because shows like Lion King and War Horse and even...

King Kong here meant that the greater population had a better appreciation of what puppetry could be. A horse doesn't have to be real on stage. You can see through it, but you can still be dragged into the emotional quality of it. I think people underestimate their imaginations. As children are the ones who actually know how to do it, you work that stuff much better than adults because adults are more worried about their mortgages and, you know, whether they get their tax done in time. I'm really worried about my tax at the moment. Is it a useful way to understand what's happening in space? I mean, obviously, I've made that decision. Yeah, so I think the, so if you've not seen this, has anyone done the on-scene destinations? There was an experience where you could, yeah, I mean, for me that's even better because that's the...

the images from Curiosity rover and the actual rover on Mars. It's like, oh, it's right there. Oh, that's pretty neat. And even better is as you begin to look around, from the vantage point of view as the geologist, Marsologist, whatever, you can see there's a fossilized riverbed. Like you don't need a sketchy picture that someone like me, the Zen on ABC or whatever, trying to explain to you. You can see that that's clearly an ancient riverbed. And it's because you've been able to get these images from Curiosity super accurate, stitched together beautifully. And then you as the explorer get that experience and that learning opportunity.

So I think you have a place for hyper-realistic imagery when you want to do that kind of a lesson. But I don't think it's necessary to go to that degree if what you just want is perhaps the physics lesson because that is more conceptual. And it would be interesting, in fact, in that movie. better learning is actually the sunset and midday sky than perhaps the topology, beautiful as it is. Unless you could chip away at the surface. If you could reach out tactile style and chip a bit of that Mars and then you're real. I mean, then you've got to be real and then the reality really pays the dividends. Otherwise, I suspect you might be able to just go, here's what you think you're seeing and here's what it would really look like and change the sky and just break the person's experience that way. Don't hang up on the fact that you've done that massive transformation because actually the fun learning is that big reveal. But yeah, I think hyperreal is...

great and gorgeous and I love it and obviously I have top end everything at the uni but I suspect that it's the suspension of disbelief works so well even on this smartphone app the user experience people made it real people got vertigo off their phone it's incredible to me just sorry just adding on from that so I feel like Yeah, you get bored unless you either have a story or you have interaction. And so with VR games and that whole interactive play, yeah, if you can pick up rocks and throw them and like run around, like that's going to be great fun. NASA just did a 360, a real 360 video stream of like the spacewalk. Oh, the cosmonauts, holy hell. And so like the person, you know, like real footage of somebody floating out of space and stuff, which I unfortunately just looked at on a laptop and 360, I really do want to do it in a headset. But just looking on a computer, it kind of like, yes, it was stunning. It was real. I knew this was actually exactly happening. And I was kind of like, and then what?

And it was like, how am I here being like, and then what? I feel like the fact that we have this incredible technology, this incredible ability to show anything we want to. But unless there's that emotional hook or that sense of like, if I was floating in space and then I could wiggle my hands as well, then yeah, that'd be great fun. But it's just, I don't know. It was like, it lacked. It was stunning. Did you wait till the end? Because you see them. Oh my God. They threw a satellite. Like that's how they went into orbit. They're literally like hanging outside the space station. Get what looks like an old Sputnik. It was sort of celebration. What, 56 years of Sputnik? Bye. Bye. Thanks. I've never seen that. Are you kidding me? Because usually my camera's pointed somewhere else. I was like, oh my God. Recently did you see they put a camera on top of a rocket and shot it up? Have you seen that? No. And when you're like, you're on top of the rocket looking down at the ground, it's shot somewhere in.

another part of the world, and you pull jets. The rocket takes off and you physically feel it in your body like you're being pulled down, like you can feel it and you know that it's not real. I'm glad you mentioned interactivity because I was going to talk about Blue Next, which is a bit of an exception in that it has no gameplay elements, but it's still one of the most popular VR experiences on the Vive. It's an underwater experience by WeVR for Vive where you encounter deep sea creatures. It ended up becoming a museum experience at the LA Natural History Museum, but it's pretty much that. I think they're going to drive it in the Vive box.

Is this the one with the whale? Yeah, it's the one with the whale. Spoilers. Sorry. I'm trying to find the whale. So it's actually got three separate experiences on this one. There's one where you're on a reef and there's lots of jellyfish coming past. There's one where you go down... Into a cave? Into a cave, yeah. And then there's this one. There's just... This one here. So you can actually walk around. It's room scale, so you can walk around a little in this, but there's very little to do other than to look. Hmm?

Yeah, it does. It has lovely sound. But I've seen this a few times and it dates really quickly. Yeah. I feel... As in you don't watch it again? You don't watch it again. Well, after the first time I was going, wow, when I went back the second time, it was like, oh. Yeah, okay. Wales over it. Well, I think that's quite interesting, actually, because what's it for is quite a good question. I mean, it's a short experience. Very little happens to you in the experience, but...

Does it have value in taking you to a portal that you can't... Yeah. I actually showed it to a 10-year-old today, and she'd never been snorkeling before, hadn't actually been snorkeling, and neither had her mother, and they both watched it, and they're off, you know, booking snorkeling. That's great. Snorkeling holidays. Yeah, yeah, and for them, it was just so otherly, and I'm kind of interested, I suppose, also in the educative potential of just seeing things, not doing anything. We tend to get very...

I don't know. So that was computer generated. So a friend of mine, one of the other VR for Good People, she did an underwater shoot. And it was all about the fact, obviously, we're wrecking all the reefs and stuff. But it was really cool to see the fact that we can get these 360 cameras underwater. And I grew up in the Torres Straits. I went diving every single day of my life. But the fact for someone who hasn't, and that is a novelty experience, it was really cool. And when you're in a headset, you think you're underwater. Your body thinks you're underwater as well. It's that whole just trickiness psychology. And it's a really calming...

interesting experience vice versa to that there's another experience where you're standing in this beautiful place and sharks are swimming underneath you and you know you're standing in a bedroom and I was so on edge I wanted to pick up my feet because there's these giant white sharks underneath me um and having that disability of just completely tricking your brain into having a fear or having a reaction or an experience. I don't have to leave my room and I think there's a shock underneath me. We're going to have a lot of psychological issues in the next 30 years. I think that's actually an interesting point. We talk about this sort of user experience making it real. And when it's about space, that's inspiring and wonderful and truly is wondrous. And the same to the deep diving. But I wondered, we make it so real that we actually end up scarring people, right? Do people freak out that badly? And if you haven't total experience, I can't believe I'm going to maybe say this, but it really sounds like something from...

The Daily Mail back in the 90s about games. But are you desensitizing a population now when perhaps you go from zombie hunts in VR to GTA style? Are you going to eventually get to the point where you just desensitize? Does it become that real? Because it's triggering people to go and actually have the real experience.

Oh, well, shit, well, in that case, that's terrible if it's GTA. Sorry, if you have not played Grand Theft Auto, you don't want a lot of people thinking that's what they want to do in their lives, right? It's pretty violent. Just going on what you guys are mentioning, virtual therapy, virtual reality therapies, has anyone looked into that much? So what they're using now is for medical issues to overcome things. I watched a video the other day of what you were saying about desensitizing. There was a man who had PTSD. He'd been to war, and he was constantly, if you go to the shopping center, sounds would go up like a check, just PTSD responses.

he couldn't leave his house because he was so scared of all these noises. And so what they did was they put him in a VR experience of him being in a tank, you know, he's going along, and there are bombs going off. And it's to make him desensitise to that environment that he'd been used to. But he then had ownership of it. And I think they developed... This game was made by professors at a university and they were working on it. But this is the ability in that they studied him afterwards and he had such a positive result from...

being desensitized to this experience where his brain thought he was there but he knew he wasn't there but he was there but he was safe um and then he was able to you know get back into regular society and you know be able to go to shops without having that fear because he had become used to being desensitized so i think it's like really interesting space um if you are looking at um yeah sexuality therapies they're doing some crazy stuff at the moment um and we are seeing really positive results so i think the more that gets like experimented with and where they go of what we can do if you trick the brain like um vertigo if you reply it's like they've had massive massive breakthroughs with that people are standing on the ground, but they think they're standing on top of a skyscraper, and that fear that people have, like, those heart rates flying through the roof, like, they think they're about to jump off a skyscraper. And, yeah, and just through the therapy that they do each little while and stuff, it's that whole desensitizing and then being adjusted to it. So I think it's going to be pretty cool to see how it is going to be used as an actual, you know, medical assistance in the future.

I was going to talk a little bit more about things like haptics and what happens when you bring physical sensations into the VR experience, but I'm aware we've actually only got a few minutes left and I was told to leave time for questions. Do people have questions? Five minutes? Yeah, all right. Unless the first audience question was about haptics. Let's jump forward to Tree.

So basically one of the most exciting possibilities for future immersive experiences is the possibility that you can gauge all the senses. Tree VR is a virtual experience that transforms you into a rainforest tree. With your arms as branches and the body as the trunk, you experience the tree's growth from a seedling into its fullest form and witness its fate firsthand. So the filmmakers work with MIT labs to include a haptic feedback component, but there's a little visual kind of thing of you turning into a seed growing up through the earth. So the haptic's providing that sense of resistance? So if I can talk over the top. So they did this as part of their research into body ownership, illusion, and VR.

and this is you being born as a tree. Oh, thank you. You can feel the rain. So yeah, yeah, you can. So basically, I'll tell you the technical details in a second, but they're kind of like these haptic sleeves that you put on, and then you stood on a platform that had vibration coming through it. It was covered in grass as well. It was beautiful. They had a whole set stage design as well. So you have the grass and you have haptics. They stage it really beautiful. Do you want to explain it having experienced it? The thing that I really think is cool about is that whole element of scale.

like what I was mentioning before, if you keep a camera low, like you think you're a child. And so the fact that they've tricked the brain into thinking you're gromming by starting small and that having that whole scale change is just really, really cool. There's some cool stuff with bees and you think you're a bee is flying around and stuff. But with, yeah, with three, I think it was scales awesome. Haptics, it's a funny one because everybody's body shapes are different. And so when you get, you know, they've obviously made it for a generic thing, but you want it to be right on your heart or right on your throat or right on your key points. Whereas like the suits that I've tried on,

They're all, you know, they're not perfect. And if you want, if someone's hitting here and the heart's over here, it just doesn't, it's just not yet right, perfect. And you have things where they all, like, squeeze you a bit so you feel as if, you know, that scary tightness. And I think it's awesome that people are experimenting with it. I think it's going to go places definitely. Right now, it's, for me, it wasn't the experience. It detracted from the experience for me. I was taken out of the immersion because I was aware that that wasn't my heartbeat pumping because it was, you know, too high or too low and, yeah, not the right thing. So I think once we do evolve to it, it could be cool. But right now, I think it's detracting from the immersion, unfortunately.

They also did things like put fans to make a breeze and heat so you could feel a forest fire coming and that sort of thing to put you in the position where you felt like you were experiencing the life of the tree. I'd like to ask you all to give a big round of applause for our panel this evening. Scott Wright, get the cues. You've been listening to an ACMI Conversations podcast. Visit acmi.net.au for information about upcoming events, exhibitions and film screenings.

Frequently asked questions

How long is this episode of ACMI Stories & Ideas?

This episode is 1 hour and 18 minutes long.

When was this ACMI Stories & Ideas episode published?

This episode was published on April 27, 2018.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this ACMI Stories & Ideas episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.