Asbjoern Andersen


What goes into creating the sound for such a vast game as No Man’s Sky? Find out in Anne-Sophie Mongeau’s in-depth talk with Paul Weir, audio director on the game:


Interview by Anne-Sophie Mongeau



Video Thumbnail

Trailer for the new Pathfinder update for No Man’s Sky


 

The game No Man’s Sky was an ambitious project which presented considerable challenges regarding audio, due to both its procedurally generated universe, as well as its style and art. How did those challenges reflect on audio design and implementation?

Paul Weir (PW): From the beginning, I aimed to keep the ambiences as natural as possible, using lots of original recordings of weather effects and nature sounds. It was a sensible decision to use Wwise and drive the ambiences using the state and switch systems. The advantage of this approach is that you can relatively easily construct an expandable infrastructure into which you can add layers of sound design that respond to the game state.

With a game like No Man’s Sky you need to pass as much information as practical from the game to the audio systems in order to understand the environment and state of play. For example, what planet biome you’re on, what the weather is doing, where you are relative to trees, water or buildings, whether you’re close to a cave or in a cave, underwater, in a vehicle, engaged in combat and so on.
 

A simple example of how this information can be brought together without additional programmer support is the introduction of interior storm ambience. We have a control value (an RTPC in Wwise terminology) for ‘storminess’ and know whether the player is indoors or out. It was a simple job then to add different audio, such as shakes and creaks, when indoors and a storm is raging, without having to rely on a programmer to add this.

It helps that nearly all of our audio is streamed, so I have few restrictions on the quantity of audio I can incorporate.

There’s a certain pride I take in recording unassuming everyday objects and using them for key sounds

I wouldn’t usually use electronic sounds as much as recorded acoustic material, but given the sci-fi nature of the game, a lot of the obviously sci-fi features do use synth sounds, although often combined with real-world mechanical sounds. There’s a certain pride I take in recording unassuming everyday objects and using them for key sounds. For example in the most recent update where we added vehicles, the buggy is my own unglamorous car, recorded using contact microphones, the hovercraft is a combination of a desktop fan and air conditioning unit and the large vehicle sounds come from programmer Dave’s Range Rover, I just dropped a microphone into the engine then we went for a spin around Guildford.

Apart from my usual rule of every sound being original, which I appreciate is in itself pretty dogmatic, I have no set approach as to where the sounds come from. It’s whatever works.
 

Can you define in a few words the difference between generative and procedural for the readers?

PW: There is no recognised definition for either term, so it’s not possible to definitively describe the difference. For me, generative means it is a randomised process with some rules of logic to control the range of values, it does not need to be interactive. Procedural is different in that it involves real-time synthesis that is live and interactive, controlled by data coming back from the game systems. This differentiation works reasonably well for audio but graphics programmers will no doubt have their own definitions.
 

How much of the game’s audio is procedurally generated and how would you compare these new innovative techniques to the more common sound design approaches?

PW: Very little of the audio is procedurally created, only the creature vocals and background fauna. At the moment it’s too expensive and risky to widely use this approach, although there are several tools in development that may help with this. Procedural audio is just one more option amongst more traditional approaches and the best approach as always is to use whatever combination best works for a particular project.
No Man's Sky sound
 

Can you tell us about the generative music system (Pulse) – the goals, what it allows to do, and its strengths compared to other implementation tools?

PW: Pulse, at its heart, is really just a glorified random file player with the ability to control sets of sounds based on gameplay mechanics. We have a concept of an instrument which is an arbitrary collection of sounds, usually variations of a single type of sound. This is placed within a ‘canvas’ and given certain amounts of playback logic, such as how often the sound can play, its pitch, pan and volume information. When these instruments play depends on the logic for each soundscape type, of which there are four general variations consisting of planet, space, wanted and map. So for example when in space, instruments in the ‘higher interest’ area play as you face a planet in your ship or when you’re warping. In the map the music changes depending on whether you’re moving and in your direction of travel.

We currently have 24 sets of soundscapes, so that’s 60 basic soundscapes, plus special cases like the map, space stations, photo mode, etc.

Pulse also makes the implementation of soundscapes relatively simple. Once you drag the wavs into the tool it creates all the Wwise XML data itself and injects it into the project, so you never manually touch anything to do with the soundscapes from Wwise.
 

 

In NMS, how are music and sound effects interacting together? What was your approach towards mixing those 2, and do you have any recommendations on how to mix music and SFX dynamically?

PW: I always mix as I go, the mix process wasn’t as difficult as you might expect and as a PS4 title, we’re mixed to the EBU R128 standard.

You have to accept that you’re never going to have a perfect mix with this type of title, so just embrace the chaos

Whilst there’s a lot of randomisation in the game, I always know the upper and lower limits of any sound and so over time you reach a reasonably satisfactory equilibrium in the mix. It helps a lot that we don’t have any dialogue. You also have to accept that you’re never going to have a perfect mix with this type of title, so just embrace the chaos.

I do have to be careful with the music though. 65 Day’s of Static like creating sounds with very resonant frequencies so sometimes I use EQ to avoid these from standing out too much. Similarly I’ll take out sounds that are too noise-based as they might sound like a sound effect. On the whole though, 90% of what the 65’ers make goes straight into the game.
 

What’s your opinion on sourcing any audio from libraries VS creating original content?

PW: On larger projects I am most irritating in insisting that all of the audio is original and not a single sound is sourced from a library, if at all possible. It does depend largely on the game and practicalities but I’ve been able to do this on No Man’s Sky so far. On smaller projects or where time is of the essence, then obviously it makes sense to dip into libraries. Over the years I’ve amassed a large personal collection of sounds that I’m constantly adding to.
 

Can you tell us about the tools you used for NMS’s procedural/synthesised audio, what other software was involved in its creation?

PW: Early in development we used Flowstone to prototype the VocAlien synthesis component. Flowstone has the advantage of being able to export a VST so Sandy White, the programmer behind VocAlien, wrote a simple VST bridge to host plugins in Wwise. For release though it obviously needs to be C++ and cross-compile to PS4 and Windows. VocAlien is not just a synthesiser, it’s several components, including a MIDI control surface and MIDI read/write module.
 

 

Popular on A Sound Effect right now - article continues below:

 

Latest releases:  
  • Mechanical Vintage Tape Machine Play Track 107 sounds included $35 $25

    Mechanical sounds from a classic vintage Studer A-80 reel-to-reel tape machine including switches, motor, magnetic tape, buttons, levers, metal and plastic spools, reels, spin-offs, and more.

    29 %
    OFF
    Ends 1571781599
    Add to cart
  • Cars Porsche Cayenne I 4.8 V8 Play Track 60+ sounds included, 58 mins total $80

    The Porsche Cayenne 4.8 V8 sound library features 58 high quality files recorded with multi mic setup. The engine was recorded in sync with cabin interior ambients, and you’ll find different styles of driving – from casual city driving, through accelerations on a highway up to rpm ramps and constant rpm loops for game audio.

    In addition to engine recordings, this sound effects library features exterior passes, whooshes and other road related sounds recorded in mono and stereo. Last but not least, there are foley recordings that covers interior and exterior perspectives of different activities.

    Add to cart
  • Destruction & Impact Volcano Play Track 13+ sounds included, 116 mins total $75 $50

    MAFX019 Volcano is a collection of unique sounds recorded in Ethiopia’s Afar region at Erta Ale volcano. Erta Ale is one of only a handful of volcanoes with lava lakes in the world, situated in the Danakil Depression, one of the hottest and most inhospitable places in the world. The name means Smoking Mountain in the local Afarigna language and Erta Ale does not disappoint in this regard, as you can see in the video. This place is also known as the Gateway to Hell, an appropriate moniker given the 47C/117F temperatures and lots of dead fauna we encountered.

    Video Thumbnail

    There were only a few lava pits when the library was recorded but plenty of continuous and violent toxic gas releases. Occasionally the ground would move creating low frequency rumbles and debris falling. I had to use a long boompole in order to suspend my trusty MKH8060 over the edge and I improvised a spaced omni array by taping the MikroUsi mics to a video tripod ballhead. The expedition wasn’t 100% risk-free but it was more than worth it for these beautiful sounds.

    33 %
    OFF
    Ends 1571263199
    Add to cart
  • The Evolved Game Creatures monster sounds collection brings producers and sound designers a versatile and wide-ranging selection of large to medium-sized creature sounds. Includes monster vocalizations and large angry creature sound effects.

    Includes over 160 distinctive, immersive, optimized creature sound effects, vocalizations, attacks, sounds of monsters dying, special SFX, growling sounds.

    Creating compelling cinematic game characters and outstanding gameplay audio experiences has never been easier. Explore the possibilities for your monster and large creature character sounds thru ten inspiring sound sets in the sound library. Easily outfit mystical creatures, griffins, dinosaurs, and otherworldly critters.

    Creature Character List:

    • Ancient Dragon – (Dinosaur Creature)
    • Balor – (Supernatural Creature)
    • Basilisk – (Lizard/Reptile Creature)
    • Frost Giant – (Large Humanoid Creature)
    • Kraken – (Water Creature)
    • Mammoth – (Elephant Creature)
    • Roc – (Dinosaur Bird Creature)
    • Sphinx – (Lion/Tiger Creature)
    • Spider Queen – (Insect Creature)
    • Treant – (Tree Creature)

    Each monster includes multiple attacks, death, pain, special fx, character specific fx and other vocalizations. All Royalty-Free and all files are pre mixed and mastered, optimized in length and file size to reduce game distributions and memory. RTU-OTB

    Add to cart
  • City Life Seashell Resonance Play Track 25+ sounds included, 75 mins total $19 $17

    This library comprises ambiences recorded from inside a sea shell/conch in various settings as city streets, nature, waves, traffic, walla.

    Discover distorted realities from the sea shell, the sounds are filtered, occluded by the natural shell, an organic resonator.

    In addition there are few sounds that are created by blowing inside the shell and making a note, which is a traditional Inca instrument (Pututo).

    WHAT’S INSIDE:
    25 stereo files (15 ambiences + 10 Shell Blowing note)

    11 %
    OFF
    Ends 1571349599
    Add to cart

Want the chance to win 20 premium sound effects libraries from Sound Ex Machina?


Enter the Gigantic Giveaway here
Need specific sound effects? Try a search below:
 

 

On a more technical point of view, how was audio optimisation handled? Did using procedural audio improve CPU/Memory usage?

PW: VocAlien is very efficient and on average our CPU usage is low. However due to the nature of the game, where we can’t predict the range of creatures or sound emitting objects on a planet, the voice allocation can jump around substantially. We have to use a lot of voice limiting based on distance to constantly prioritise the sounds closest to the player.
 

What would you think is the best use of procedural audio? Would it be more adequate for some types of projects or sounds than others?

PW: Procedural audio, according to my suggested definition above, only makes sense if it solves a problem for you that would otherwise be difficult to resolve using conventional sound design.

There are complex qualities that we instantly react to with natural sounds, it’s a lot harder to do this with synthetic sound

It’s still a poor way to create realistic sounds. I’m not generally in favour of using it to create wind or rain effects for example. As a sound designer I find this a very functional approach to sound, ignoring the emotive qualities that natural sound can have. Wind can be cold, gentle, spooky, reassuring. There are complex qualities that we instantly react to with natural sounds, it’s a lot harder to do this with synthetic sound.

No Man's Sky game audio

Finally, NMS’s audio is of a such greatly varied nature and represents a massive achievement overall, do you have a few favourite sounds in game?

PW: Thank you, I’ll very gratefully take any compliments. Although it started off quite incidental, I like how we’ve managed to insert so many different flavours of rain into the game. I thanked Sean recently for letting me make SimRain, the game itself is incidental.

What gives me pleasure is knowing the everyday items that make it into the game, such as an electric water pump, vending machine, garage motor. I’ve included some examples of the raw sounds that were used as source material below.
 

Big thanks to Paul Weir for this interview and his insights on procedural audio!

 

Please share this:


 


 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog from a myriad of independent sound creators, all covered by one license agreement - a few highlights:
 
 
  • Game Audio Packs & Bundles Vintage Anime SFX Play Track 350+ sounds included $69

    The Vintage Anime Sound Effects Library brings all of the excitement of your favorite Japanese animated series to your fingertips. Inspired by classic cartoons from the 80's and 90's, these recognizable and versatile sounds will instantly enhance any FX collection. Vintage synths were used to create the auras, beams, mecha blasters, atmospheres, magic spells, guns, sonic blasts and explosives that makeup this pack of over 350+ custom 24bit/96khz .WAV files. Perfect for film, video games, podcasts and any project that could benefit from a power up!

    Both designed sounds and source recordings:

    • Classic anime sfx from the 80’s and 90’s

    • Auras, mecha, beams, blasters, spells, explosives and more! 350+ sounds!

    • Tons of source material for experimentation

    • Expert crafted metadata

    • Vintage Anime PDF

    Add to cart
  • Drones & Moods Darkscapes Play Track 30 sounds included, 35 mins total $14.99 $7.99

    DARKSCAPES is a collection of 30, seamlessly looping, dark, horror-inducing soundscapes and ambiences with total run time of 35 minutes.

    All sound effects have been created using real field recordings in order to add organic feel to them and trick your brain into
    perceiving them as something realistic and later edited with top of a line outboard and plugins to add dark, horror-inducing depth to them.

    All SFX have baked-in Soundminer’s meta data

    RECORDED WITH: Sound Devices MixPre 6 + Senhheiser MKH8060, DPA4060, PCM D100
    EDITED WITH: iZotope RX, Wormhole, Adaptiverb, Modular, FabFilter, Waves, TC Electronics, Pro Tools.

    47 %
    OFF
    Add to cart
  • The “Screams & Shouts 2 – Humans” sound effects library brings you over 1.200 human shouts of pain and death, disturbing screams plus grunts of anger, struggle and attack from several men, women and children.

    All sounds have been edited precisely and cut clean for instant use in your projects.

    Add to cart
 
Explore the full, unique collection here

Latest sound effects libraries:
 
  • Mechanical Vintage Tape Machine Play Track 107 sounds included $35 $25

    Mechanical sounds from a classic vintage Studer A-80 reel-to-reel tape machine including switches, motor, magnetic tape, buttons, levers, metal and plastic spools, reels, spin-offs, and more.

    29 %
    OFF
    Ends 1571781599
  • Cars Porsche Cayenne I 4.8 V8 Play Track 60+ sounds included, 58 mins total $80

    The Porsche Cayenne 4.8 V8 sound library features 58 high quality files recorded with multi mic setup. The engine was recorded in sync with cabin interior ambients, and you’ll find different styles of driving – from casual city driving, through accelerations on a highway up to rpm ramps and constant rpm loops for game audio.

    In addition to engine recordings, this sound effects library features exterior passes, whooshes and other road related sounds recorded in mono and stereo. Last but not least, there are foley recordings that covers interior and exterior perspectives of different activities.

  • Destruction & Impact Volcano Play Track 13+ sounds included, 116 mins total $75 $50

    MAFX019 Volcano is a collection of unique sounds recorded in Ethiopia’s Afar region at Erta Ale volcano. Erta Ale is one of only a handful of volcanoes with lava lakes in the world, situated in the Danakil Depression, one of the hottest and most inhospitable places in the world. The name means Smoking Mountain in the local Afarigna language and Erta Ale does not disappoint in this regard, as you can see in the video. This place is also known as the Gateway to Hell, an appropriate moniker given the 47C/117F temperatures and lots of dead fauna we encountered.

    Video Thumbnail

    There were only a few lava pits when the library was recorded but plenty of continuous and violent toxic gas releases. Occasionally the ground would move creating low frequency rumbles and debris falling. I had to use a long boompole in order to suspend my trusty MKH8060 over the edge and I improvised a spaced omni array by taping the MikroUsi mics to a video tripod ballhead. The expedition wasn’t 100% risk-free but it was more than worth it for these beautiful sounds.

    33 %
    OFF
    Ends 1571263199
  • The Evolved Game Creatures monster sounds collection brings producers and sound designers a versatile and wide-ranging selection of large to medium-sized creature sounds. Includes monster vocalizations and large angry creature sound effects.

    Includes over 160 distinctive, immersive, optimized creature sound effects, vocalizations, attacks, sounds of monsters dying, special SFX, growling sounds.

    Creating compelling cinematic game characters and outstanding gameplay audio experiences has never been easier. Explore the possibilities for your monster and large creature character sounds thru ten inspiring sound sets in the sound library. Easily outfit mystical creatures, griffins, dinosaurs, and otherworldly critters.

    Creature Character List:

    • Ancient Dragon – (Dinosaur Creature)
    • Balor – (Supernatural Creature)
    • Basilisk – (Lizard/Reptile Creature)
    • Frost Giant – (Large Humanoid Creature)
    • Kraken – (Water Creature)
    • Mammoth – (Elephant Creature)
    • Roc – (Dinosaur Bird Creature)
    • Sphinx – (Lion/Tiger Creature)
    • Spider Queen – (Insect Creature)
    • Treant – (Tree Creature)

    Each monster includes multiple attacks, death, pain, special fx, character specific fx and other vocalizations. All Royalty-Free and all files are pre mixed and mastered, optimized in length and file size to reduce game distributions and memory. RTU-OTB

  • City Life Seashell Resonance Play Track 25+ sounds included, 75 mins total $19 $17

    This library comprises ambiences recorded from inside a sea shell/conch in various settings as city streets, nature, waves, traffic, walla.

    Discover distorted realities from the sea shell, the sounds are filtered, occluded by the natural shell, an organic resonator.

    In addition there are few sounds that are created by blowing inside the shell and making a note, which is a traditional Inca instrument (Pututo).

    WHAT’S INSIDE:
    25 stereo files (15 ambiences + 10 Shell Blowing note)

    11 %
    OFF
    Ends 1571349599
 
FOLLOW OR SUBSCRIBE FOR THE LATEST IN FANTASTIC SOUND:
 
                              
 
GET THE MUCH-LOVED A SOUND EFFECT NEWSLETTER:
 
The A Sound Effect newsletter gets you a wealth of exclusive stories and insights
+ free sounds with every issue:
 
Subscribe here for free SFX with every issue

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.