procedural game audio Asbjoern Andersen


How do you keep your game audio varied – without needing countless individual audio files? Procedural sound design can help with exactly that, and in this hands-on guide, senior lecturer, teacher fellow and author of the Game Audio Implementation book, Richard Stevens, demonstrates how the concept works in the Unreal Engine.

When creating a sound effect for a movie you’ll know that the audience is only going to hear it on one specific occasion, and you’ll likely build it up through editing and layering different sound elements to get just what you want.

01_game_audio_Explosion

Figure 01 ‘An explosion’

 

Most games, like sports, are about skill and mastery, so the player will be repeating similar actions again and again, and consequently they will be hearing the same sounds again and again. The trouble is that we’re very sensitive to this kind of repetition, since it just doesn’t happen in real life.
 



Explosion_Baked


Video: Explosion Baked


 
The obvious answer is just to have loads and loads of sounds but it would be far too much work to create 30-40 versions of every sound in the game (plus there are obviously limitations as to how much we can fit on a disk!).
If we look at our ‘explosion’ sound again we can see that the final sound is made up of different characteristic components, and this idea is key to starting to think about procedural approaches to sound design.

02_game_audio_Explosion_Components

Figure 02 ‘Explosion Components’

What we want to do is to keep these components separate when we import them into a game so that we can recombine them in different ways at run time. A lot of sounds in games aren’t ‘sounds’ at all, they are systems of sounds. This kind of procedural approach requires a different way of thinking, and sometimes different kinds of sound assets, since we often want to isolate the individual components that make up a sound.

When we bring these components into a Sound Cue in the Unreal Engine we can build a system of playback, and by having a few different versions of each component we can randomly combine them to create variation.

03_game_audio_Procedural_Explosion

Figure 03 ‘Procedural Explosion’

 



Explosion_Components


Video: Explosion Components


 
By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system. Randomizing the combinations of layers can vastly increase the number of potential outcomes with only a few additional sounds.

By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system

In the above example we have four sets of three possible sounds that can potentially be heard so this will give us 81different sound outcomes. If we added just one other ‘Crack’ element then we’d get 108 potential sounds.


WANT MORE LIKE THIS?
FOLLOW A SOUND EFFECT FOR THE LATEST IN FANTASTIC SOUND:
 
          

We can increase this variation even more by adding some slight randomized delays and modulations of pitch and volume to each element, giving us.. erm… a very large number of possible outputs.

04_game_audio_Delay_Mod

Figure 04 ‘Adding Delay and Modulation nodes’

[tweet_box]Why Procedural Game Sound Design is so useful – demonstrated in the Unreal Engine:[/tweet_box]



Explosion_Delays_and_Modulations


Video: Explosion Delays and Modulation


 

Another thing we might want to do is to change the sound depending on what was being blown up, or the materials of nearby objects. Again by keeping these material components separate we can choose to layer them into the Sound Cue when appropriate by using a switch.


Popular on A Sound Effect right now - article continues below:


Trending right now:

  • Twisted Zither introduces you to the haunting allure of the zither, a complete kit of sounds drawn from the resonant tones of this unique stringed instrument, characterised by its flat, wooden body and horizontal strings.

    Twisted Zither features:

    • A rich assortment of over 130 recorded gestures, textures, bows, sweeps, hits, and scrapes, providing a comprehensive toolkit for sound design.
    • Over 50 ready to go custom-designed sounds, including haunting whooshes, atmospheric drones, and powerful impacts and stingers.
    • 130 individually note samples spanning 2 octaves and 3 or more velocity ranges, perfect for creating your own melodic sample instruments or sound design.

    All captured in stereo 24-bit, 96kHz resolution.

    Don’t miss out on the opportunity to add an extra layer of haunt and horror to your projects with ‘Twisted Zither’. This is an excellent addition to your arsenal for horror and haunting sounds. With a diverse range of meticulously crafted gestures, textures, and custom-designed effects, this library is your key to creating spine-chilling atmospheres and immersive soundscapes.

    38 %
    OFF
  • In High Desert Ambiences 1: Miniature, get a mini-nature collection of desolately beautiful sounds of the American southwest as the sun brings to life the songs of desert wildlife. This collection features sounds that will make you fall in love with the desert with the trickling of distant rivers, smooth cricket chirps, echoey caws from ravens so close you can hear the details in their wings flaps, snorts from a cautious yet curious mule deer, choruses of birds at dawn, and much more. Most recordings are well over 4 minutes, with one half-hour night-time track that will make you want to take out your tent immediately. For a mini-nature collection of lush, peaceful nature sounds from the heart of the American Southwest, here’s High Desert Ambiences 1: Miniature.

    2% for the Planet:
    Two percent of the price of this library is donated to an environmental cause. I view it as an “artist royalty” for the planet!

    KEY FEATURES:

    • Sounds in this library are NOT included in High Desert Ambiences 2 and 3.
    • This library contains a small selection of both “active” and “quiet” nature sounds from the high deserts of West Texas.
    • If you need more “active” or “quiet” nature sounds check out: High Desert Ambiences 2: Active Nature or High Desert Ambiences 3: Quiet Nature.
    • Featured on Designing Sound: “Our Favorite Sounds of 2016
    • Desert dawn and evening choruses
    • Distant flowing river, songbirds, and insects
    • Ravens soaring and squawking in a stark and resonant valley
    • Lengthy night-time cricket chorus
    • Partially audible and ultrasonic bat clicks up to 70kHz
    • Ghostly distant animal calls
    • Mule deer warning snorts and jumping movement
    • Files ranging from 31 seconds to 30 minutes
    • Rio Grande dawn chorus along the Texas/Mexico river border
    • Locations: Near Marfa, Texas (in a mountain valley at an altitude of 6,000 ft) and Big Bend National Park along the Rio Grande River, Texas/Mexico border.
    • These desert ambiences are extremely quiet, so I have included descriptive markers to signal interesting events in an otherwise featureless waveform. These markers can be read in programs such as RX, Reaper, and Soundminer. The markers are also included as .txt files in the sound files folder.
    ambiences_markers

    GEAR USED:
    • Sennheiser MKH 50/30 MS pair
    • Mid/Side recordings decoded to LR stereo
    • Sound Devices 702
    • Rycote AG MS Blimp
    ***Note – the name of this library was changed from High Desert Ambiences 1 to High Desert Ambiences 1: Miniature on 11/28/17. This was a name change only. No audio files were updated.
  • City Life Sound Effects Diffuse City Play Track 116+ sounds included, 752 mins total $75

    Diffuse City is the unique urban ambience sound effects library you didn’t know you were missing. It captures the urban environment in its many forms – all based around the idea of diffuse ambience.

    The Diffuse City library is purpose-built for the times an environment needs to be felt, but not be distracting.

    Every track in Diffuse City was recorded with some sort of real life “filter” in mind; be it distance, elevation, time of day, physical material – Anything to provide the feeling of city life with out the specificity of many urban ambience libraries. No distracting close car pass-bys or people talking; only great natural ambience beds.

    Diffuse City was recorded in big cities, suburbs, small towns, and rural settings over a span of two years. It was largely recorded over very late nights, when very few people we’re around. Occasionally, however, a car would pass by… a gun would go off… While these were edited out of the recordings, they are included as “extras” in the library. Perfect for adding some flavor to a moment that’s authentic to the environment it was recorded in.

    Metadata – and markers:

    In addition to thorough metadata, each ambience in Diffuse City is embedded with markers highlighting unique moments that aren’t easily visible in a waveform. Software like Soundminer v4.5 and Reaper can display these markers, making it easy to identify distinct sonic moments in an otherwise nondescript waveform.

    reaper-markers-example

    Markers in Reaper

    There are 10 areas of focus in Diffuse City:

    Elevated City • Distant Highways • Underground City • Distant City • Under Bridges • City Rumble • Empty Parking Lots • Alleys • Industrial • Window Contacts

    Hear examples and learn more about each one below

  • Environments & Ambiences SEASIDE Play Track 16 sounds included, 50 mins total $16

    Get the sounds of the sea – captured at different beaches along the Japan coast and the French Normandy coast. Recorded at the marina, pier, harbor, bridges and beaches, the SEASIDE library delivers around 50 minutes of waves, water, seagulls and more. All recordings are AB ORTF stereo, and there’s a mono center added in some cases to deliver a LCR format.


Latest releases:

  • ‘Cartoon & Animation Vol 2’ by Cinematic Sound Design delivers the ultimate sound effects library tailored for your comedic creations, cartoons, games, and music productions. Dive into a realm of whimsical wonders with this curated collection of handcrafted sound effects, featuring an array of delightful cartoon pops, boings, jumps, crashes, impacts and a lot more.
    Crafted and captured using top-of-the-line outboard equipment including the ‘Sound Devices 702’ field recorder and Neumann KM184 microphones, each sound is processed through an Apogee Symphony AD/DA for unparalleled clarity, depth, and impact. Discover an array of truly unique SFX meticulously crafted to infuse your projects with personality and charm with a selection of zany boings, energetic jumps, clumsy falls, quirky snaps, lively runs and playful mallets.

    Product Details:

    • 121 Designed Cartoon SFX
    • 24-Bit/96kHz
    • 100% Royalty-Free

  • Unleash the full potential of your audio production with the Tool Bag Foley Sound Effects Library. Meticulously recorded with precision, this library offers an expansive collection of sounds straight from the tool shed. Whether you’re in film, television, game development, or theatre, these sounds will enhance your soundscapes and bring your scenes to life.

    29 %
    OFF
  • CRRRACK!!!

    Introducing “Wood Destruction” – a powerful sound library that brings the raw and intense sounds of wood breaking to your audio projects. This collection is designed to provide sound designers, filmmakers, and video professionals with an extensive range of wood destruction sounds. From small wooden objects to massive structures, every breaking sound is meticulously captured to deliver a sense of power and scale.

    The sounds in “Wood Destruction” are presented in a clean and isolated format, allowing for seamless integration into your projects without the need for extensive editing. Each sound is carefully labeled and categorized, making it easy to find the perfect wood destruction sound for your specific scene or sequence.

    From explosive demolition scenes to suspenseful moments of destruction, this library will be your ultimate resource for authentic and impactful wood destruction sound effects.

    26 %
    OFF
  • Environments & Ambiences Natural Water Streams Play Track 10 sounds included, 30 mins total $18

    This meticulously crafted sound effects library is an essential tool for professionals in film, game development, and audio production who seek authentic and high-quality water soundscapes.

    Recorded using high-quality equipment such as Zoom H4N, H1, and H6, these sounds offer unparalleled clarity and realism. Whether you’re creating serene nature scenes or designing complex audio environments, ‘Natural Water Streams’ provides a versatile range of water sound effects.

    28 %
    OFF
  • Industrial Ambiences Wind Turbines Inner Sounds Play Track 45 sounds included, 144 mins total $15

    Wind turbine rotations and motor movements recorded subterraneously, through wire fences, metal steps and the body of the turbine.

     The results are a selection of metallic movements, evolving eerie soundscapes, atmospheric hums, whines.

     Excellent design source and sound morphing material, eerie atmospheres and dystopian environments.

    https://www.youtube.com/watch?v=QSGOZXKJWbc

    Number of Sounds : 45

    Number of Files : 45      

    Total Audio Time : 2 hours  22 minutes  18  secs  ( 142 minutes 18 seconds)

    Type : WAV Stereo

    Sample Rate / Bit Rate : 192 kHz / 24 Bit

    Mastered : No

    Normalised : No

    Size : 9.92 Gb

    Metadata : Files are stamped with detailed UCS compliant metadata in Soundminer

    Documentation Included : Copyright, EULA, Images, Metadata (exported in multiple formats)

    License : A Sound Effect EULA / Terms and Conditions https://www.asoundeffect.com/license-agreement/

    Recorders : Zoom F3 and Sound Devices Mix Pre 10 II

    Microphones :  LOM Geofon, Stille and Klang small spots, Sennheiser 8040’s and 8050

    Microphone Configuration : Magnetic, Spike, Contact. ORTF and Centre Mic

    KEYWORDS : Wind Turbine , Back, Wire Fence, Metal Steps, Underground, Rotate, Inner, Motor, Vibrate, Whirr, Bass, Hum, Whine, Pulse, Atonal, Disharmonious, Breeze

    FXNAME :  Abandoned Environment, Deserted Environment, Design Source, Dystopian, Eerie Atmosphere, Post Apocalypse, Sound Morph, Uninhabited, Wind Turbine

    25 %
    OFF
    Ends 1715205599
Need specific sound effects? Try a search below:


By getting information from the game about what type of material is being blown up we can use this to control the switch, and therefore which material components of sound get added to the overall explosion sound.

05_game_audio_Explosion_Materials

Figure 05 ‘Explosion Materials’

Thoughts on the term ‘Procedural Sound Design’:

In writing the book we made a conscious decision to term this kind of sound design, that is typical in the current practice of game audio, ‘Procedural Sound Design’ to differentiate it from ‘Procedural Audio’.

Andy Farnell, who coined or at least popularised the term ‘Procedural Audio’ sees it as any kind of system where the sound produced is the result of a process. He describes these ideas more fully here. So under that definition, as soon as you set up any kind of system of playback you could see it as being procedural audio.

However there has been a lot of important work and progress in terms of procedural audio for games in the last few years (see http://proceduralaudionow.com/), and this has encompassed a variety of techniques, but there has been some emphasis on the idea of these procedural systems being synthesis based, which ultimately is probably the most flexible solution for interactivity.

This is a specialist field which we don’t go into in any depth in the book since there are other great books out there on this (not least Andy’s book ‘Designing Sound’). In the book we attempt to describe the range of procedural approaches by saying, “This approach to sound design exists on a spectrum from procedural sound design, where we tend to be manipulating pre-existing assets, to procedural audio, a term more frequently used when systems of synthesis are used to generate the sounds themselves (with much in between that combine both approaches)”.

To throw another thing into the discussion, when discussing music systems we also use the term algorithmic, which again could be used to describe any kind of system of playback. Although we could just call this procedural music (as others such as Karen Collins have done), but we felt it worth preserving and highlighting ‘algorithmic’ given the long history of algorithmic techniques explored for music in the past, which a search for ‘procedural music’ is going to miss.

 



Explosion_Materials


Video: Explosion Materials


 

Now we have all the elements of a sound as separate components we can also do other things with them, like spatialize them around the player in different ways. For the Game Audio Implementation book we built a simple system that will throw sounds around the player for people listening in 5.1 or 7.1. This could be used for elements of the explosion itself or for debris.

06_game_audio_Spatialized_Diagram

Figure 06 Diagram

 

07_game_audio_Spatialized_Detail

Figure 07 Detail

 

This was done in Unreal’s Blueprint system – which looks a bit daunting at first but once you get the hang of it you can pretty much do anything you might dream up!

08_game_audio_Blueprint

Figure 08 Blueprint

 



Explosion Spatialized


Video: Explosion Spatialized


 
By using a procedural approach to sound design we now have an explosion sound that’s different each time, is ‘aware’ of the different materials involved in the explosion, and spatializes around the player in stereo, 5.1 or 7.1.
 

A big thanks to Richard Stevens for his insights on procedural game audio! If you want to know more about procedural sound design for games then check out the Game Audio Implementation book from Focal Press. If you’re new to UE4 you can get UE4 here for free, and you can download all the levels that go alongside the book here (also for free!) to get started.
 

Please share this:


 



 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog
from a myriad of independent sound creators, all covered by one license agreement
- a few highlights:
  • COMPATIBLE WITH ANY VIDEO SOFTWARE
    CRAFTED BY INDUSTRY PROFESSIONALS
    INSTANT DIGITAL DOWNLOAD
    100% ROYALTY FREE

    Introducing the Ultimate Sound FX Bundle – your all-in-one solution to level up your audio game! Say goodbye to wasting countless hours searching for the perfect sound effects, and hello to a seamless editing process that enhances your creativity.

    This bundle includes sound effects from different genres and subjects, so you’ll have everything you need right at your fingertips. Whether you’re working on a film, game, podcast, or music project, this bundle has got you covered.

    With the Ultimate Sound FX Bundle, you can speed up your workflow and take your creativity to new heights. Imagine having access to a vast library of high-quality sound effects that perfectly match your project’s needs, all in one place. No more time wasted on sifting through endless sound effect libraries – this bundle has it all.

    Don’t let sound effects be a pain point in your creative process any longer. Invest in the Ultimate Sound FX Bundle today and experience a smoother, more efficient workflow that unleashes your full creative potential.

    Image
  • Car Sound Effects Car Pass By Interior Play Track 940 sounds included, 354 mins total $48

    Description:

    Car Pass By Interior features a diverse set of recordings of cars passing by heard from the interior of a car.

    Recordings have been edited into wet and dry, single pass bys, groups of cars, windows up and down, close and distant pass bys. All easy to search with the UCS standard naming and meta data. With this library you should be able to cover a wide range of scenarios.

    The cars recorded are misc compact to large combustion cars driving at city speeds.

    Key features: 

    Flexible use with various mic setups

    Wet and Dry conditions

    Windows up and down

    From clear close up pass bys to muffled distant pass bys

    Realistic traffic

    Gear Setups:

    Sound Devices 10 MKII

    A DPA 4017 mono

    B DPA 4060 Mono

    C LOM Usi Stereo set with a LOM Geophone mounted on the metal door frame to catch the car wobbling.

    D Røde NT1-A Stereo set with a LOM Geophone mounted on the metal door frame.

    DPA 4017 and DPA 4060 mics are production sound mixers favorites. The 4060 presents the pass bys more soft and 4017 more dramaticly, cars feel faster, both has nice low frequencies.

     Notes:

    Recording was done from a Toyota Yaris 2013, a small car that wobbles with cars passing close by. It also has a dampened car interior, that isn’t too roomy like cars with glass roofs, the recordings can be used with many car interiors.

    The library is ideal for sfx editors, sound designers, editors looking for realistic car interior ambiences and pass bys to sync to picture. Because of the wobbling of the car it can be great source material for designing whooshes.

    20 %
    OFF
  • User Interface (UI) Sound Effects Interactive Play Track 3917 sounds included, 225 mins total $149.99
    User Interface (UI) Sound Effects - get more than 3900+ sounds in the INTERACTIVE sound library

    Introducing ‘INTERACTIVE’ by Rock The Speakerbox: Your ultimate organic Game UI Sound Design Toolkit. Elevate your UI sound design with a comprehensive sound effects library crafted to meet the exacting demands of modern game development. ‘INTERACTIVE’ is a massive toolset designed to empower you with a diverse range of components for creating immersive, dynamic and organic sounding UI.

    Structured into three packages:

    Construction Kit (3151 Sounds):
    Unlock a world of possibilities with a massive set of generic components like clicks, whooshes, pops, and textures, alongside elaborate recordings for specific contextual needs such as coins, paper, medieval weapons and many more. Explore elemental textures like water, wood, stone, etc for added depth and a comprehensive arsenal of percussive and tonal instruments.

    Building Blocks (606 Sounds):
    Streamline your workflow with pre-designed sounds of basic UI components, including impacts, clicks, whooshes, specific contextual actions and textures (clattering coins, rustling paper, igniting fires, alchemical reactions, growing vegetation) plus tonal and musical feedback for different moods (positive, negative, rewarding, warning, triumphal, holy)

    Designed (160 Sounds):
    Choose from four sets of ready-to-use sounds tailored for the most common UI actions in different game styles (Casual, Dark, Medieval, Modern).

    Each of the four sets gives you following UI sounds:
    • Confirm
    • Select
    • Notification
    • Purchase
    • Open Menu
    • Back/Close Menu
    • Positive Light
    • Positive Heavy
    • Negative Light
    • Negative Heavy

    With 699 sound files, each offering more than 5 variations in average, ‘INTERACTIVE’ delivers a total of over 3900 sounds – ensuring that you’ll never run out of options to bring your creative vision to life. This library gives you everything you need to captivate your audience and create immersive UI soundscapes that truly resonate.

Explore the full, unique collection here
 
 
   

3 thoughts on “Why Procedural Game Sound Design is so useful – demonstrated in the Unreal Engine

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.