Asbjoern Andersen


Virtual reality has been a LONG time coming. I remember reading about it back in the early 90s where it was being hailed as the next big thing – and then 20+ years passed, and nothing much happened, at least in the eye of the general public. However, with devices such as the Oculus Rift nearing completion, it looks like we’re finally getting there.

With this revolutionary new approach to entertainment and immersion just around the corner, what does this mean for the way audio is created and used?

I decided to reach out to Varun Nair for some insights. He’s co-founder of Two Big Ears, an Edinburgh-based company developing audio solutions for games and virtual reality. Here is what he has to say about audio for virtual reality – and the unique possibilities and challenges it offers:

 

Hi Varun, where does virtual reality currently stand in terms of audio?

It is still early days, in terms of technology, workflow and design principles. While the art of designing sound would still be similar (as would the art of image composition, storytelling, etc), virtual reality as a medium needs exploration. In the past two years we have seen some incredible work on the visual front, with thousands of people around the world experimenting with the medium. Comparatively, there’s very little experimentation happening with audio and VR.

The technology is still catching up. Most VR users and developers use headphones, given that it is a personal experience. Binaural audio, which works great over headphones is a perfect fit for VR. Many of the long standing problems with real-time synthesised binaural audio can be overcome thanks to the head and positional tracking sensors and algorithms in VR devices.

Binaural or positional 3D audio makes a huge difference to the virtual reality experience. There was a lot of commercial work around binaural audio in the 90s but it has since retreated into academic and research spheres. Much of our work at Two Big Ears is making such technology (and many more) work really well across game engines, operating systems and hardware devices. It’s not just about having a straight up binaural panner, but also about advanced audio algorithms that can help create a more realistic experience.

From a design perspective, audio for VR is very much an open book. Many of the game design principles (especially those related to FPS games) crumble in virtual reality. I’m curious to see what can be uncovered for audio. For example, I’ve personally found the idea of depicting the scale of objects through sound very intriguing. With binaural audio, the space around the player becomes another parameter to play with. There’s lots that needs to be defined for mixing too. Creating a real-time binaural mix over headphones is very different to mixing on speakers.

How does sound for a 360 degree film work? Nobody is entirely sure! That’s the exciting part!

Outside the scope of games, there’s much work that needs to be done with VR films too. How does sound for a 360 degree film work? Nobody is entirely sure! That’s the exciting part!

 

What are some of the challenges presented by audio in virtual reality?

Designing visuals for VR needs to be treated as a different process (rather than upgrading existing content to support VR) and I’m convinced that the same applies for audio too. A lot of the techniques we take for granted, such as designing sounds for menu screens or HUD elements might not be applicable any more. Quite a few of the VR games are leaning towards user interface elements existing within the virtual space around the player. Could sound be used to draw attention to them?

Another area that has seen almost no discussion is music. How do we treat a background score? Must it be diegetic and exist within the scene? Could it just be a ‘normal’ stereo track in the background? Foley is an interesting area too. Could it be used to help achieve presence in a scene?

Technologically there are challenges too. Game audio needs a real push across the whole stack. We are working hard at it and so are our competitors =) The next few years are going to be an interesting time for audio.
 

As a sound designer for VR, how do you achieve presence and spatialization in your sound design?

For spatialisation we have to rely on technology. Binaural rendering and room modelling makes a massive difference. Although, the spatialisation effect itself can be greatly enhanced by the quality of the sounds. I don’t just mean recording quality, but the timbre and envelope of the sound. As humans, we’re better at localising sounds with higher mid and high frequency content. HDR mixing and ducking can help massively in clearing up a mix.

As for presence — I’m not entirely sure yet. Spatialisation helps, but I feel generative, procedural and dynamic content can greatly improve the experience. I’m personally interested in seeing how input devices for VR evolve. I’m always looking for ways to map sensor data to sound!
 

Battle of the virtual reality platforms
There are several large platforms in development for virtual reality. Best-known is Oculus Rift, a Kickstarter-funded project that ended up being purchased by Facebook. Their latest ‘Crescent Bay’ prototype includes headphones.

Project Morpheus is Sony’s take on virtual reality, announced in March 2014. This platform will be, at least initially, exclusively for the PlayStation 4.

Oculus VR – the company making the Oculus Rift – is also behind the Samsung VR, which offers a novel approach where a Samsung Galaxy Note 4 phone is used as the device display. Final pricing and availability has not been announced for any of the devices.

 

Outside of games, what are some of the areas where you envision VR being used – and how does audio fit into those scenarios?

There’s been a lot of talk lately about education and it is quite easy to see the impact VR can have on it. I also think it can redefine audio post-production, especially with VR movies. We would have to lean towards using game audio tools, but in many ways they can be inadequate for a structured and curated experience.

Being a long time advocator of procedural and generative audio techniques, I think there will be a strong need for those techniques too. Somebody just needs to create the tools that will help us move beyond vehicle, impact, rain and gun-shot models. It is tough work, but it needs getting done. If I had more time in a day, I’d be spending all of it on that!


Popular on A Sound Effect right now - article continues below:


Trending right now:

  • – Evolved WATER Sound Library


    This isn’t just another water library, this is a professional’s dream library, and we feel you are all going to love it. Not only from all the source recordings, but also from all the incredible designed sounds. It really is an all around workhorse that will have you covered for everything WATER. With over 1600 files and over 3,000 sounds, this library is absolutely massive. Everything from rain, lakes, waterfalls, rivers, and bubbles all the way up to KYMA designed cinematic impacts. We spent over a year recording and designing this collection and are so proud to offer it to you for your toolbox!

    Why make another Water library? Because here at SoundMorph we always want to push the limits and quality of what is out on the current marketplace. Elements like WATER present a huge challenge to make modern and exciting. This is what we aimed for with this collection. Watch the Behind The Scenes video by clicking on the “How’s Made Button” to find out just how much went into making this colossal release. A new standard for any working sound professional!

    70 %
    OFF
    Ends 1731106799
  • Gore Sound Effects Gore 2 Play Track 5000+ sounds included $119.70

    Enter GORE 2, The follow up to our first smash hit GORE sound library. Full of the most insane blood explosions, drips, flesh rips, splatters, blood gurgles, and intense fight and ultra violence sounds. Why did we make it? Because we wanted a HUGE collection of bigger, wetter, juicer, and crazier GORE sounds that could be a forever go to for professional sound designers. We recorded over 5,000 sounds and 300+ files to make this a whopping 20+ GB collection with lots of variations for all your scenes, film, gameplay or project. The GORE 2 library is split up into 3 sections, designed, source, and builds. Design – Bone, blood, melee & slaughter categories. Source – Featuring 192Khz 32 Bit Sanken Co-100k mic recordings, allowing you to pitch up ultra high or ultra low without loosing fidelity. Builds – Halfway between source material and designed, allowing you flexibility to start with some sounds that are slightly designed. GORE 2 is a classic giant collection that will serve you for years and years.

    70 %
    OFF
    Ends 1731106799
  • Sci-Fi Sound Effects Robotic Lifeforms 2 Play Track 4100+ sounds included $119.70

    It’s been 5 years since the release of our Robotic Lifeforms 1 library, and we just felt we could do more! So we teamed up with an epic team of Sound Designers to create an ultimate follow up to it all with Robotic Lifeforms 2. This is no joke, a library of love and over 4,100 files and 12.5GB!

    Using some of the most advanced microphones, Kyma, and synths, we really went all out to bring what we think is the most advanced and modern Robot library ever created. Not only do you get over 2,700 designed sounds, but you also get over 1,300 source audio files recorded in 192 kHz 24Bit with the Sanken c1000 mic, so you can pitch the sounds to infinity to create some stellar new sounds of your own.

    In our opinion, this is THE robot library to have in your tool box. We aren’t just saying that because we made it, we are saying it because we believe it to be a fact.
    Take Robotic Lifeforms 2 for a ride, and you will be happy to own the most advanced robot library ever made so far!

    Library highlights:

    • 2,700+ designed sound effects
    • 1,300+ source audio files recorded in 192 kHz 24Bit with a Sanken c1000
    • Transforms, Mechanisms, Movements
    • Power
    • Servos
    • Air Hydraulics
    • Energy
    • Footsteps
    • Impacts
    • Computer
    • Devices
    • Attack Defense
    • Textures
    • Engines
    • Synth
    • Whooshes
    • Drills
    • Air Pneumatics
    • Motors
    • Bonus Recordings
    70 %
    OFF
    Ends 1731106799
  • Firearms Sound Effects Sci-Fi Weapons (Principle Sound) Play Track 2626 sounds included $50

    The Sci-Fi Weapons library delivers more than 2600 futuristic weapon shots, charges, ricochets and other related sounds.

    All of them were designed using exclusively recorded Foley sounds, synthetic layers, various sound manipulation and morphing techniques.

    Single shots and automatic fire, reloading ammo, energy blasts, impacts and explosions, surface hits – it’s all there, ready to be used in your sci-fi projects!

    Version 1.5 is out:
    In v1.5 update we add 11 new weapons and two new reloads/ricochets packs. The total number of sounds in the library comes up to 2626.

    50 %
    OFF

Latest releases:

  • Door Sound Effects Sci Fi Doors Play Track 845 sounds included $57

    Step into the future with SciFi Doors, a huge library of 845 high-quality sound effects that will take your audio designs to a whole level when it comes to bringing futuristic environments to life.

    Perfect for any sound designer, filmmaker, or game developer looking for a wide variety of sound elements for crafting immersive sci-fi scenes—from sleek space stations to high-tech laboratories.

    SciFi Doors has all the building blocks that would go into creating custom door sounds, user interfaces, and even futuristic AI interactions organized into four well-curated categories.

    Building Blocks (434 sounds):
    With these core elements, you’ll have everything needed to create your own unique sci-fi door sounds.
    This section includes raw recordings and synthesized audio to get you up and running:

    Air bursts, Hydraulics, Friction, Electric motors, Real door recordings and much more.

    The possibilities are endless when composing just the perfect door sequence to fit any aesthetic your project requires.

    User Interface Sounds (243 sounds):
    Add life to your science fiction worlds with a range of UI sounds, from subtle data streams through to more active scanning and access noises. Perfect for futuristic consoles, control panels, and other interactive elements. Includes:

    Whirring, Beeping, Typing, Streaming data, Access signals, Scanning and more

    Futuristic Pre-Designed Sci-Fi Doors (107 sounds):
    Need ready-to-use, fully designed sci-fi door sounds? Then this category’s got you covered, with 107 pre-designed drag-and-drop door sounds. All sounds can be enacted right away and add a professional touch to it.

    AI Assistant Sound Effects (61 sounds):
    Give voice to your future control systems with AI Assistant Vocal Sounds. This category features both male and female AI voices that utter common phrases to bring your sci-fi doors alive and give them an extra layer of interaction.

    All sounds are provided in 96kHz, 24-bit, ensuring clarity and detail. This full library is also UCS compliant and includes rich embedded metadata, which allows for easier searching, categorization, and integration into any workflow.

    SciFi Doors are all about unlocking the sound of the future, where every opened door leads to new sonic possibilities.

    24 %
    OFF
    Ends 1731365999
  • Environments & Ambiences African Desert Sahara Play Track 83+ sounds included, 486 mins total From: $220 From: $176

    African Desert: Sahara is a collection of stereo and quad soundscapes recorded in the barren but beautiful mountain range at the heart of the Sahara desert. This is the largest hot desert on Earth, incredibly difficult to access and explore. It’s a breathtaking place with a huge dynamic range, from dead silence to powerful winds. The soundscapes in this collection were recorded around giant rock formations, rocky outcrops, canyons and sand dune expanses.

    20 %
    OFF
    20 %
    OFF
    20 %
    OFF
  • All files are recorded 32bit, 192 kHz, with Shure KSM 137, Line Audio Omni1, FEL Clippy XLR EM272 and Sonorous Objects SO.3 and microphones, Sound Devices MixPre-6 II & Zoom F3 recorders. Library contains wav files of driving, interior and exterior foley, mechanical and electrical sounds. It is also available in UCS.

  • Music Dark Tales Play Track 20 sounds included, 75 mins total $19.99

    Dark Tales is a collection atmospheric music and musical sound effects suitable for horror and other dark settings.

    Everything from safe areas to thrilling chase-music is included with this album.

    All tracks have Loop versions

    All tracks are Royalty Free

    Composer and sound designer: Johannes Wetterbro –

    Audio Brush Studio

    audiobrushstudio@gmail.com

    Album art:  Julia Nguyen – Artstation

     

    33 %
    OFF
  • Car Sound Effects Car Horns 2 Play Track 300 sounds included, 8 mins total $45
    50 models, 300 car horn sounds! 3 different styles from both interior and exterior perspectives. All files are recorded 32bit, 192 kHz, with RØDE NTG1, Shure KSM137 and Line Audio Omni1 microphones, Sound Devices MixPre-6 II recorder. The library is also available in UCS.
Need specific sound effects? Try a search below:


If sound designers want to get started doing sound for VR, how do they go about it?

It is tough to design for VR without a device — so getting access to one would be a good place to start :) The audio tools exist and are constantly being improved upon. I think it would be great for sound designers to also jump into the video game development process, with game engines like Unreal Engine 4 that have a low price barrier — picking up those skills can help when communicating with the rest of the game development team too.

We definitely need more sound designers breaking new ground, failing, iterating and pushing the medium forward.

Another approach would be to work with the many VR enthusiasts around the world. There are lots of great indie projects around the web and I’m sure they would all value the contribution of a sound designer.

We’ve found that a number of the VR developers around the world care a lot about audio and they are willing to experiment with new technology and techniques.

We definitely need more sound designers breaking new ground, failing, iterating and pushing the medium forward.

 

Please share this:


 

About Varun Nair
Varun has worked on over 400 projects in films, games and advertising and music. He’s the co-founder of Two Big Ears, a company developing advanced audio solutions for games and VR. They offer 3Dception, a unique binaural audio and room modeling solution for game engines and middleware.

 

 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog from a myriad of independent sound creators, all covered by one license agreement - a few highlights:

  • – Evolved WATER Sound Library


    This isn’t just another water library, this is a professional’s dream library, and we feel you are all going to love it. Not only from all the source recordings, but also from all the incredible designed sounds. It really is an all around workhorse that will have you covered for everything WATER. With over 1600 files and over 3,000 sounds, this library is absolutely massive. Everything from rain, lakes, waterfalls, rivers, and bubbles all the way up to KYMA designed cinematic impacts. We spent over a year recording and designing this collection and are so proud to offer it to you for your toolbox!

    Why make another Water library? Because here at SoundMorph we always want to push the limits and quality of what is out on the current marketplace. Elements like WATER present a huge challenge to make modern and exciting. This is what we aimed for with this collection. Watch the Behind The Scenes video by clicking on the “How’s Made Button” to find out just how much went into making this colossal release. A new standard for any working sound professional!

    70 %
    OFF
    Ends 1731106799
  • Gore Sound Effects Gore 2 Play Track 5000+ sounds included $119.70

    Enter GORE 2, The follow up to our first smash hit GORE sound library. Full of the most insane blood explosions, drips, flesh rips, splatters, blood gurgles, and intense fight and ultra violence sounds. Why did we make it? Because we wanted a HUGE collection of bigger, wetter, juicer, and crazier GORE sounds that could be a forever go to for professional sound designers. We recorded over 5,000 sounds and 300+ files to make this a whopping 20+ GB collection with lots of variations for all your scenes, film, gameplay or project. The GORE 2 library is split up into 3 sections, designed, source, and builds. Design – Bone, blood, melee & slaughter categories. Source – Featuring 192Khz 32 Bit Sanken Co-100k mic recordings, allowing you to pitch up ultra high or ultra low without loosing fidelity. Builds – Halfway between source material and designed, allowing you flexibility to start with some sounds that are slightly designed. GORE 2 is a classic giant collection that will serve you for years and years.

    70 %
    OFF
    Ends 1731106799
  • Sci-Fi Sound Effects Robotic Lifeforms 2 Play Track 4100+ sounds included $119.70

    It’s been 5 years since the release of our Robotic Lifeforms 1 library, and we just felt we could do more! So we teamed up with an epic team of Sound Designers to create an ultimate follow up to it all with Robotic Lifeforms 2. This is no joke, a library of love and over 4,100 files and 12.5GB!

    Using some of the most advanced microphones, Kyma, and synths, we really went all out to bring what we think is the most advanced and modern Robot library ever created. Not only do you get over 2,700 designed sounds, but you also get over 1,300 source audio files recorded in 192 kHz 24Bit with the Sanken c1000 mic, so you can pitch the sounds to infinity to create some stellar new sounds of your own.

    In our opinion, this is THE robot library to have in your tool box. We aren’t just saying that because we made it, we are saying it because we believe it to be a fact.
    Take Robotic Lifeforms 2 for a ride, and you will be happy to own the most advanced robot library ever made so far!

    Library highlights:

    • 2,700+ designed sound effects
    • 1,300+ source audio files recorded in 192 kHz 24Bit with a Sanken c1000
    • Transforms, Mechanisms, Movements
    • Power
    • Servos
    • Air Hydraulics
    • Energy
    • Footsteps
    • Impacts
    • Computer
    • Devices
    • Attack Defense
    • Textures
    • Engines
    • Synth
    • Whooshes
    • Drills
    • Air Pneumatics
    • Motors
    • Bonus Recordings
    70 %
    OFF
    Ends 1731106799
Explore the full, unique collection here

Latest sound effects libraries:
 
  • Door Sound Effects Sci Fi Doors Play Track 845 sounds included $57

    Step into the future with SciFi Doors, a huge library of 845 high-quality sound effects that will take your audio designs to a whole level when it comes to bringing futuristic environments to life.

    Perfect for any sound designer, filmmaker, or game developer looking for a wide variety of sound elements for crafting immersive sci-fi scenes—from sleek space stations to high-tech laboratories.

    SciFi Doors has all the building blocks that would go into creating custom door sounds, user interfaces, and even futuristic AI interactions organized into four well-curated categories.

    Building Blocks (434 sounds):
    With these core elements, you’ll have everything needed to create your own unique sci-fi door sounds.
    This section includes raw recordings and synthesized audio to get you up and running:

    Air bursts, Hydraulics, Friction, Electric motors, Real door recordings and much more.

    The possibilities are endless when composing just the perfect door sequence to fit any aesthetic your project requires.

    User Interface Sounds (243 sounds):
    Add life to your science fiction worlds with a range of UI sounds, from subtle data streams through to more active scanning and access noises. Perfect for futuristic consoles, control panels, and other interactive elements. Includes:

    Whirring, Beeping, Typing, Streaming data, Access signals, Scanning and more

    Futuristic Pre-Designed Sci-Fi Doors (107 sounds):
    Need ready-to-use, fully designed sci-fi door sounds? Then this category’s got you covered, with 107 pre-designed drag-and-drop door sounds. All sounds can be enacted right away and add a professional touch to it.

    AI Assistant Sound Effects (61 sounds):
    Give voice to your future control systems with AI Assistant Vocal Sounds. This category features both male and female AI voices that utter common phrases to bring your sci-fi doors alive and give them an extra layer of interaction.

    All sounds are provided in 96kHz, 24-bit, ensuring clarity and detail. This full library is also UCS compliant and includes rich embedded metadata, which allows for easier searching, categorization, and integration into any workflow.

    SciFi Doors are all about unlocking the sound of the future, where every opened door leads to new sonic possibilities.

    24 %
    OFF
    Ends 1731365999
  • Environments & Ambiences African Desert Sahara Play Track 83+ sounds included, 486 mins total From: $220 From: $176

    African Desert: Sahara is a collection of stereo and quad soundscapes recorded in the barren but beautiful mountain range at the heart of the Sahara desert. This is the largest hot desert on Earth, incredibly difficult to access and explore. It’s a breathtaking place with a huge dynamic range, from dead silence to powerful winds. The soundscapes in this collection were recorded around giant rock formations, rocky outcrops, canyons and sand dune expanses.

    20 %
    OFF
    20 %
    OFF
    20 %
    OFF
  • All files are recorded 32bit, 192 kHz, with Shure KSM 137, Line Audio Omni1, FEL Clippy XLR EM272 and Sonorous Objects SO.3 and microphones, Sound Devices MixPre-6 II & Zoom F3 recorders. Library contains wav files of driving, interior and exterior foley, mechanical and electrical sounds. It is also available in UCS.

  • Music Dark Tales Play Track 20 sounds included, 75 mins total $19.99

    Dark Tales is a collection atmospheric music and musical sound effects suitable for horror and other dark settings.

    Everything from safe areas to thrilling chase-music is included with this album.

    All tracks have Loop versions

    All tracks are Royalty Free

    Composer and sound designer: Johannes Wetterbro –

    Audio Brush Studio

    audiobrushstudio@gmail.com

    Album art:  Julia Nguyen – Artstation

     

    33 %
    OFF
  • Car Sound Effects Car Horns 2 Play Track 300 sounds included, 8 mins total $45
    50 models, 300 car horn sounds! 3 different styles from both interior and exterior perspectives. All files are recorded 32bit, 192 kHz, with RØDE NTG1, Shure KSM137 and Line Audio Omni1 microphones, Sound Devices MixPre-6 II recorder. The library is also available in UCS.

   

2 thoughts on “Exploring New Sonic Worlds: Sound for Virtual Reality

  1. Speaking of mapping sensor data to sound, you might be interested in the work being done on haptics and haptic-tactile broadcasting, esp. for live virtual reality events where the “feeling” of the remote event can be captured, added to the audio and video VR stream and then decoded and used by the remote VR participant (using the appropriate haptic-tactile hardware such as a platform, vest, gloves, etc.) adding significant presence to the event.

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.