Asbjoern Andersen


What goes into creating the sound for such a vast game as No Man’s Sky? Find out in Anne-Sophie Mongeau’s in-depth talk with Paul Weir, audio director on the game:


Interview by Anne-Sophie Mongeau





No Man’s Sky - The Path Finder Update Trailer | PS4


Trailer for the new Pathfinder update for No Man’s Sky


 

The game No Man’s Sky was an ambitious project which presented considerable challenges regarding audio, due to both its procedurally generated universe, as well as its style and art. How did those challenges reflect on audio design and implementation?

Paul Weir (PW): From the beginning, I aimed to keep the ambiences as natural as possible, using lots of original recordings of weather effects and nature sounds. It was a sensible decision to use Wwise and drive the ambiences using the state and switch systems. The advantage of this approach is that you can relatively easily construct an expandable infrastructure into which you can add layers of sound design that respond to the game state.

With a game like No Man’s Sky you need to pass as much information as practical from the game to the audio systems in order to understand the environment and state of play. For example, what planet biome you’re on, what the weather is doing, where you are relative to trees, water or buildings, whether you’re close to a cave or in a cave, underwater, in a vehicle, engaged in combat and so on.
 

A simple example of how this information can be brought together without additional programmer support is the introduction of interior storm ambience. We have a control value (an RTPC in Wwise terminology) for ‘storminess’ and know whether the player is indoors or out. It was a simple job then to add different audio, such as shakes and creaks, when indoors and a storm is raging, without having to rely on a programmer to add this.

It helps that nearly all of our audio is streamed, so I have few restrictions on the quantity of audio I can incorporate.

There’s a certain pride I take in recording unassuming everyday objects and using them for key sounds

I wouldn’t usually use electronic sounds as much as recorded acoustic material, but given the sci-fi nature of the game, a lot of the obviously sci-fi features do use synth sounds, although often combined with real-world mechanical sounds. There’s a certain pride I take in recording unassuming everyday objects and using them for key sounds. For example in the most recent update where we added vehicles, the buggy is my own unglamorous car, recorded using contact microphones, the hovercraft is a combination of a desktop fan and air conditioning unit and the large vehicle sounds come from programmer Dave’s Range Rover, I just dropped a microphone into the engine then we went for a spin around Guildford.

Apart from my usual rule of every sound being original, which I appreciate is in itself pretty dogmatic, I have no set approach as to where the sounds come from. It’s whatever works.
 

Can you define in a few words the difference between generative and procedural for the readers?

PW: There is no recognised definition for either term, so it’s not possible to definitively describe the difference. For me, generative means it is a randomised process with some rules of logic to control the range of values, it does not need to be interactive. Procedural is different in that it involves real-time synthesis that is live and interactive, controlled by data coming back from the game systems. This differentiation works reasonably well for audio but graphics programmers will no doubt have their own definitions.
 

How much of the game’s audio is procedurally generated and how would you compare these new innovative techniques to the more common sound design approaches?

PW: Very little of the audio is procedurally created, only the creature vocals and background fauna. At the moment it’s too expensive and risky to widely use this approach, although there are several tools in development that may help with this. Procedural audio is just one more option amongst more traditional approaches and the best approach as always is to use whatever combination best works for a particular project.
No Man's Sky sound
 

Can you tell us about the generative music system (Pulse) – the goals, what it allows to do, and its strengths compared to other implementation tools?

PW: Pulse, at its heart, is really just a glorified random file player with the ability to control sets of sounds based on gameplay mechanics. We have a concept of an instrument which is an arbitrary collection of sounds, usually variations of a single type of sound. This is placed within a ‘canvas’ and given certain amounts of playback logic, such as how often the sound can play, its pitch, pan and volume information. When these instruments play depends on the logic for each soundscape type, of which there are four general variations consisting of planet, space, wanted and map. So for example when in space, instruments in the ‘higher interest’ area play as you face a planet in your ship or when you’re warping. In the map the music changes depending on whether you’re moving and in your direction of travel.

We currently have 24 sets of soundscapes, so that’s 60 basic soundscapes, plus special cases like the map, space stations, photo mode, etc.

Pulse also makes the implementation of soundscapes relatively simple. Once you drag the wavs into the tool it creates all the Wwise XML data itself and injects it into the project, so you never manually touch anything to do with the soundscapes from Wwise.
 

[tweet_box]Paul Weir Q&A on the Procedural Audio of No Man’s Sky[/tweet_box]  

In NMS, how are music and sound effects interacting together? What was your approach towards mixing those 2, and do you have any recommendations on how to mix music and SFX dynamically?

PW: I always mix as I go, the mix process wasn’t as difficult as you might expect and as a PS4 title, we’re mixed to the EBU R128 standard.

You have to accept that you’re never going to have a perfect mix with this type of title, so just embrace the chaos

Whilst there’s a lot of randomisation in the game, I always know the upper and lower limits of any sound and so over time you reach a reasonably satisfactory equilibrium in the mix. It helps a lot that we don’t have any dialogue. You also have to accept that you’re never going to have a perfect mix with this type of title, so just embrace the chaos.

I do have to be careful with the music though. 65 Day’s of Static like creating sounds with very resonant frequencies so sometimes I use EQ to avoid these from standing out too much. Similarly I’ll take out sounds that are too noise-based as they might sound like a sound effect. On the whole though, 90% of what the 65’ers make goes straight into the game.
 

What’s your opinion on sourcing any audio from libraries VS creating original content?

PW: On larger projects I am most irritating in insisting that all of the audio is original and not a single sound is sourced from a library, if at all possible. It does depend largely on the game and practicalities but I’ve been able to do this on No Man’s Sky so far. On smaller projects or where time is of the essence, then obviously it makes sense to dip into libraries. Over the years I’ve amassed a large personal collection of sounds that I’m constantly adding to.
 

Can you tell us about the tools you used for NMS’s procedural/synthesised audio, what other software was involved in its creation?

PW: Early in development we used Flowstone to prototype the VocAlien synthesis component. Flowstone has the advantage of being able to export a VST so Sandy White, the programmer behind VocAlien, wrote a simple VST bridge to host plugins in Wwise. For release though it obviously needs to be C++ and cross-compile to PS4 and Windows. VocAlien is not just a synthesiser, it’s several components, including a MIDI control surface and MIDI read/write module.
 


Popular on A Sound Effect right now - article continues below:


Trending right now:

  • Cinematic & Trailer Sound Effects Abandoned Oil Tank Play Track 327 sounds included $40

    On a recording trip to the smaller Danish port town Struer, I came across an abandoned empty oil tank. Inside I found two giant wires attached to the floor and the ceiling of the tank, almost like a huge 2 stringed double bass. I’m telling you the reverb in there was longer than the Eiffel Tower on a cloudless day !

    On the outside this was just an empty abandoned building, but it turned out it was not empty at all because it was full of sound and a few dead birds. I’m glad I was curious enough to go inside for a closer investigation and not just pass by.

    After several hours of concentrated recording, it was nice to get my ears back out in dry air. I’m happy there are no open sends to Valhalla in real life but experiencing the eternal resonance on the low frequencies from the wires was absolutely amazing.

    Abandoned Oil Tank was recorded with a LOM basic Ucho stereo pair, a Zoom H6 and the LOM Geofon. All files are in 96 kHz/24 bit and contain the original recordings.

    The result is a unique sound effect library including balloon pop impulse responses from a truly unique location that very recently became even more unique since word says that the oil tank is no more and has abandoned this world.

    327 individual sounds – all tagged with Universal Category System (UCS) metadata.

    www.katrineamsler.com

    20 %
    OFF
    Ends 1713131999
  • Electricity Sound Effects Polarity Play Track 975 sounds included $72

    Polarity delivers more than 950 sounds of electricity, science and technology – captured in several locations around the world, from electricity museums to science labs. About 50% of the library is all about electricity, with various types of Jacob’s Ladders, Tesla Coils, Ruhmkorff lamp and all sorts of impactful bursts of energy.

    Then we go through welders, plasma spheres, 3D printers, starting to cover a more broad technology theme – like old phones, telegraphs, dynamo wheels, rotary dials, whirling watchers, alarm, lab centrifuges, something scientists call a roller and a rocker, servo sounds, neon lights, a wimshurst machine and sparklers.

    Many sounds in this section were captured from vintage equipment, from a 1928’s tram to old telephone switchboards, high voltage levers and control surfaces.

    All content was recorded at 192KHz with a Sanken CO100K, a couple of Sennheiser 8040 and a Neumann 81i, translating into final assets that have plenty of ultrasonic content, ready for the most extreme manipulation.

    Bonus: Two extra libraries included for free:
    This library also includes two additional releases from Mattia Cellotto - for free: Crunch Mode delivers 230 crunchy sounds made with a variety of vegetables, fresh bread, pizza crust and a selection of frozen goods. The Borax Experiment gets you 158 squishy, gory, slimy and gooey sounds.
    20 %
    OFF
  • Trench Rammers is a one-of-a-kind sound library, created by sound designer Barney Oram. It features recordings of two 20th century Trench Rammers, some of the last operating machines of their kind in the world. The library features 48 files in total, capturing the Trench Rammers using a variety of microphones and perspectives, supplied in 192kHz 24bit WAV file format.

    This library contains multiple recordings of two antique Trench Rammers, the Pegson ER5 and the Warsop Benjo, and also features additional recordings of four antique stationary engines, the Amanco Hired Man (1920s), the JAP 1947, the Lister D (1940s) and the Norman T3000.

    Recorded in Leeds, UK, this library features multi-mic coverage and a range of distance positions captured on all included source content. Microphones used include; Sanken, Sennheiser, Neumann and DPA, captured with Sound Devices and Tascam recorders.

    This library includes detailed SoundMiner metadata and utilizes the UCS system for ease of integration into your library.

    Behind the Scenes Video:


    Trench Rammer


  • Kawaii UI Trailer

Latest releases:

  • Trench Rammers is a one-of-a-kind sound library, created by sound designer Barney Oram. It features recordings of two 20th century Trench Rammers, some of the last operating machines of their kind in the world. The library features 48 files in total, capturing the Trench Rammers using a variety of microphones and perspectives, supplied in 192kHz 24bit WAV file format.

    This library contains multiple recordings of two antique Trench Rammers, the Pegson ER5 and the Warsop Benjo, and also features additional recordings of four antique stationary engines, the Amanco Hired Man (1920s), the JAP 1947, the Lister D (1940s) and the Norman T3000.

    Recorded in Leeds, UK, this library features multi-mic coverage and a range of distance positions captured on all included source content. Microphones used include; Sanken, Sennheiser, Neumann and DPA, captured with Sound Devices and Tascam recorders.

    This library includes detailed SoundMiner metadata and utilizes the UCS system for ease of integration into your library.

    Behind the Scenes Video:


    Trench Rammer


  • The cozy natural rhythms of hums, scrapes, splashes and thuds soundtrack the pottery workshop where the earth meets art. Find the true sound of it with Vadi Sound Library.

     

    About Pottery Workshop

     

    84 sounds that are clean, subtle and capture pretty much every object and action of the magic of fire and earth.

    From the rhythmic hum of the spinning potter’s wheel, to the splash of water, the scrape of clay with the tools shaping and smoothing surfaces, listen up for the symphony of creation.

    You will hear the tapping and thud of ceramic pottery, wooden ribs, wire cutters, loop tools, and sponges, all kinds of rummage, and mud actions on the potter’s wheel. The clicking and whirring of mechanisms during firing cycles add a mechanical counterpoint to the workshop’s natural rhythms.

    You will get variations of sounds in different proximity, size, and style of action. This collection is handy due to the clarity and diversity of the raw sounds. They have both Foley and practical usability and room for further sound design.

    You will get intuitive, detailed naming, UCS compatibility and the usual Vadi Sound craft and attention to detail in 84 pristine sounds. Recorded in 24bit-96kHz.WAV format on our favorite Sennheiser MKH 8040 stereo pair and Zoom F6.

     

    Keywords

    Pottery, workshop, electric potter’s wheel, wheel, oven, heat gun, mud, clay, ceramic, glass, wooden, metal, cup, handle, push, pull, move, remove, shape, tap, shake, clank, level, lid, tool, organizer, toolbox, rummage, fiberboard, button, bucket, sponge, plate, Dremel.

     

    What else you may need

    You may also want to check out Drag & Slide for 477 sound files of dragging, sliding, scraping and friction sounds of different objects made of wood, plastic, metal on various surfaces. Our bestseller Crafting & Survival is another good choice to get access to 1000+ survival, gathering, movement and crafting sounds.

  • All files are recorded 32bit, 192 kHz, with Shure KSM 137, Line Audio Omni1, FEL Clippy XLR EM272, Sonorous Objects SO.3 and JrF C-Series Pro+ microphones, Sound Devices MixPre-6 II & Zoom F3 recorders. Library contains wav files of driving, interior and exterior foley, mechanical and electrical sounds. It is also available in UCS.

  • Introducing Devils Bane Trailer, a chilling symphony of horror encapsulated in 533 meticulously crafted sound files, ready to unleash terror upon your audience. Dive into a nightmare realm where every creak, whisper, and shriek is meticulously designed to send shivers down your spine.

    • 533 files
    • 3.5 GB of game audio assets
    • All in 96k 24bit .wav
    • Dark Horror Movie Trailer Sound Effects Library
    17 %
    OFF
  • Birdsong from the countryside of the Swedish rural region of Värmland.

Need specific sound effects? Try a search below:


 

On a more technical point of view, how was audio optimisation handled? Did using procedural audio improve CPU/Memory usage?

PW: VocAlien is very efficient and on average our CPU usage is low. However due to the nature of the game, where we can’t predict the range of creatures or sound emitting objects on a planet, the voice allocation can jump around substantially. We have to use a lot of voice limiting based on distance to constantly prioritise the sounds closest to the player.
 

What would you think is the best use of procedural audio? Would it be more adequate for some types of projects or sounds than others?

PW: Procedural audio, according to my suggested definition above, only makes sense if it solves a problem for you that would otherwise be difficult to resolve using conventional sound design.

There are complex qualities that we instantly react to with natural sounds, it’s a lot harder to do this with synthetic sound

It’s still a poor way to create realistic sounds. I’m not generally in favour of using it to create wind or rain effects for example. As a sound designer I find this a very functional approach to sound, ignoring the emotive qualities that natural sound can have. Wind can be cold, gentle, spooky, reassuring. There are complex qualities that we instantly react to with natural sounds, it’s a lot harder to do this with synthetic sound.

No Man's Sky game audio

Finally, NMS’s audio is of a such greatly varied nature and represents a massive achievement overall, do you have a few favourite sounds in game?

PW: Thank you, I’ll very gratefully take any compliments. Although it started off quite incidental, I like how we’ve managed to insert so many different flavours of rain into the game. I thanked Sean recently for letting me make SimRain, the game itself is incidental.

What gives me pleasure is knowing the everyday items that make it into the game, such as an electric water pump, vending machine, garage motor. I’ve included some examples of the raw sounds that were used as source material below.
 

Big thanks to Paul Weir for this interview and his insights on procedural audio!

 

Please share this:


 



 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog from a myriad of independent sound creators, all covered by one license agreement - a few highlights:

  • Metal Sound Effects MetalMotion Play Track 2000+ sounds included, 239 mins total $110

    MetalMotion is a sound design construction kit that contains four hours of moving metal mayhem: clicks and clanks, rolls and drags, wronks and squeals, scrapes and rattles, ranging from from tiny to monstrous. Nathan Moody’s unique performances with unusual combinations of props produce everything from Foley-like movements to intense groans and howls.

    Whether you’re covering a robot’s movements, sweetening weapon Foley, making crafting or pick-up sounds in a game, placing unusual layers beneath a kaiju’s roar, or crushing a submarine with undersea pressure, this collection covers the full range of subtle to raucous. Each file has many performance variations for creative choice and game audio asset creation.

    While there are some tasty impacts within, this library’s true focus is on characterful movements: handling, rummaging, opens, closes, ratchets, swirls, rolls, drags, drops, spins, rubs, zuzzes, and bows. Metal containers, filing cabinets, modern appliances, vintage (and very rusty) tools, cymbals, bells, grills, plates, bars, rods, and tubes, and many other props lent their voices to this collection.

    This UCS-compliant library was recorded with a combination of standard, contact, and ultrasonic-capable microphones through Millennia preamps. Sample rates vary based on the amount of ultrasonic content in each file. The audio files are mastered for realism, ready for extreme processing and pitch shifting of your own, but still useful in more grounded contexts.

  • Kawaii UI Trailer
  • Ice Sound Effects Ultrasonic Dry Ice Play Track 635+ sounds included, 71 mins total $38.40

    Ultrasonic Dry Ice is a library containing over 600 sounds themed metal resonances, scrapes and all sorts of weird.
    All the content has been recorded at 192KHz with a Sanken CO100K, a couple of Sennheiser MKH8040 and a MKH416.
    The resulting ultrasonic spectrum is rich and allows for truly extreme manipulation of the content.

    Bonus: Two extra libraries included for free:
    This library also includes two additional releases from Mattia Cellotto - for free: Crunch Mode delivers 230 crunchy sounds made with a variety of vegetables, fresh bread, pizza crust and a selection of frozen goods. The Borax Experiment gets you 158 squishy, gory, slimy and gooey sounds.
    20 %
    OFF
    Ends 1712872800
Explore the full, unique collection here

Latest sound effects libraries:
 
  • Trench Rammers is a one-of-a-kind sound library, created by sound designer Barney Oram. It features recordings of two 20th century Trench Rammers, some of the last operating machines of their kind in the world. The library features 48 files in total, capturing the Trench Rammers using a variety of microphones and perspectives, supplied in 192kHz 24bit WAV file format.

    This library contains multiple recordings of two antique Trench Rammers, the Pegson ER5 and the Warsop Benjo, and also features additional recordings of four antique stationary engines, the Amanco Hired Man (1920s), the JAP 1947, the Lister D (1940s) and the Norman T3000.

    Recorded in Leeds, UK, this library features multi-mic coverage and a range of distance positions captured on all included source content. Microphones used include; Sanken, Sennheiser, Neumann and DPA, captured with Sound Devices and Tascam recorders.

    This library includes detailed SoundMiner metadata and utilizes the UCS system for ease of integration into your library.

    Behind the Scenes Video:


    Trench Rammer


  • The cozy natural rhythms of hums, scrapes, splashes and thuds soundtrack the pottery workshop where the earth meets art. Find the true sound of it with Vadi Sound Library.

     

    About Pottery Workshop

     

    84 sounds that are clean, subtle and capture pretty much every object and action of the magic of fire and earth.

    From the rhythmic hum of the spinning potter’s wheel, to the splash of water, the scrape of clay with the tools shaping and smoothing surfaces, listen up for the symphony of creation.

    You will hear the tapping and thud of ceramic pottery, wooden ribs, wire cutters, loop tools, and sponges, all kinds of rummage, and mud actions on the potter’s wheel. The clicking and whirring of mechanisms during firing cycles add a mechanical counterpoint to the workshop’s natural rhythms.

    You will get variations of sounds in different proximity, size, and style of action. This collection is handy due to the clarity and diversity of the raw sounds. They have both Foley and practical usability and room for further sound design.

    You will get intuitive, detailed naming, UCS compatibility and the usual Vadi Sound craft and attention to detail in 84 pristine sounds. Recorded in 24bit-96kHz.WAV format on our favorite Sennheiser MKH 8040 stereo pair and Zoom F6.

     

    Keywords

    Pottery, workshop, electric potter’s wheel, wheel, oven, heat gun, mud, clay, ceramic, glass, wooden, metal, cup, handle, push, pull, move, remove, shape, tap, shake, clank, level, lid, tool, organizer, toolbox, rummage, fiberboard, button, bucket, sponge, plate, Dremel.

     

    What else you may need

    You may also want to check out Drag & Slide for 477 sound files of dragging, sliding, scraping and friction sounds of different objects made of wood, plastic, metal on various surfaces. Our bestseller Crafting & Survival is another good choice to get access to 1000+ survival, gathering, movement and crafting sounds.

  • All files are recorded 32bit, 192 kHz, with Shure KSM 137, Line Audio Omni1, FEL Clippy XLR EM272, Sonorous Objects SO.3 and JrF C-Series Pro+ microphones, Sound Devices MixPre-6 II & Zoom F3 recorders. Library contains wav files of driving, interior and exterior foley, mechanical and electrical sounds. It is also available in UCS.

  • Introducing Devils Bane Trailer, a chilling symphony of horror encapsulated in 533 meticulously crafted sound files, ready to unleash terror upon your audience. Dive into a nightmare realm where every creak, whisper, and shriek is meticulously designed to send shivers down your spine.

    • 533 files
    • 3.5 GB of game audio assets
    • All in 96k 24bit .wav
    • Dark Horror Movie Trailer Sound Effects Library
    17 %
    OFF
  • Birdsong from the countryside of the Swedish rural region of Värmland.


   

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.