procedural game audio Asbjoern Andersen


How do you keep your game audio varied – without needing countless individual audio files? Procedural sound design can help with exactly that, and in this hands-on guide, senior lecturer, teacher fellow and author of the Game Audio Implementation book, Richard Stevens, demonstrates how the concept works in the Unreal Engine.

When creating a sound effect for a movie you’ll know that the audience is only going to hear it on one specific occasion, and you’ll likely build it up through editing and layering different sound elements to get just what you want.

01_game_audio_Explosion

Figure 01 ‘An explosion’

 

Most games, like sports, are about skill and mastery, so the player will be repeating similar actions again and again, and consequently they will be hearing the same sounds again and again. The trouble is that we’re very sensitive to this kind of repetition, since it just doesn’t happen in real life.
 



Explosion_Baked


Video: Explosion Baked


 
The obvious answer is just to have loads and loads of sounds but it would be far too much work to create 30-40 versions of every sound in the game (plus there are obviously limitations as to how much we can fit on a disk!).
If we look at our ‘explosion’ sound again we can see that the final sound is made up of different characteristic components, and this idea is key to starting to think about procedural approaches to sound design.

02_game_audio_Explosion_Components

Figure 02 ‘Explosion Components’

What we want to do is to keep these components separate when we import them into a game so that we can recombine them in different ways at run time. A lot of sounds in games aren’t ‘sounds’ at all, they are systems of sounds. This kind of procedural approach requires a different way of thinking, and sometimes different kinds of sound assets, since we often want to isolate the individual components that make up a sound.

When we bring these components into a Sound Cue in the Unreal Engine we can build a system of playback, and by having a few different versions of each component we can randomly combine them to create variation.

03_game_audio_Procedural_Explosion

Figure 03 ‘Procedural Explosion’

 



Explosion_Components


Video: Explosion Components


 
By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system. Randomizing the combinations of layers can vastly increase the number of potential outcomes with only a few additional sounds.

By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system

In the above example we have four sets of three possible sounds that can potentially be heard so this will give us 81different sound outcomes. If we added just one other ‘Crack’ element then we’d get 108 potential sounds.


WANT MORE LIKE THIS?
FOLLOW A SOUND EFFECT FOR THE LATEST IN FANTASTIC SOUND:
 
          

We can increase this variation even more by adding some slight randomized delays and modulations of pitch and volume to each element, giving us.. erm… a very large number of possible outputs.

04_game_audio_Delay_Mod

Figure 04 ‘Adding Delay and Modulation nodes’

[tweet_box]Why Procedural Game Sound Design is so useful – demonstrated in the Unreal Engine:[/tweet_box]



Explosion_Delays_and_Modulations


Video: Explosion Delays and Modulation


 

Another thing we might want to do is to change the sound depending on what was being blown up, or the materials of nearby objects. Again by keeping these material components separate we can choose to layer them into the Sound Cue when appropriate by using a switch.


Popular on A Sound Effect right now - article continues below:


Trending right now:

  • Strident and Demonic

    Expand the timbre of your horror violins and cellos with CIRCUS, a sinister sample pack featuring 180 WAV sounds of screeching or high-pitched string noises, perfect for horror music and dark sound design.

    Creative Tension

    This collection offers a curated selection of screeches, high-tension tremolo, heavy jeté strokes, dark demonic textures, finger patterns, chaotic string elements, clock loops and bow accents.

    Haunting and Experimental

    Create haunting atmospheres, perfect for horror, thriller or experimental soundtracks. Every element has been designed to unsettle and disturb, blurring the line between music and noise.

  • ⏰ For a very limited time:
    Add this library to the cart and enter ah4launch in the cart coupon field – to sprinkle an extra launch discount, on top of the current discount!

    Animal Hyperrealism Vol IV is a sound library containing animal vocalisations, from real to designed creatures totaling more than 2000 individual sounds in 294 files. The sounds were recorded in zoos, and wildlife centers.

    The asset list includes but is not limited to: hippos, hyenas, vultures, dwarf mongooses, elephants, African cranes, parrots, tigers, pigmy hippos, rhea ostriches, brown bears, pheasants, wildebeests, African wild dogs and many more. The content has been recorded at 192KHz with a Sanken CO100K, an Avisoft CMPA and a Sennheiser 8050 for center plus two Sennheiser MKH8040 for stereo image.

    The resulting ultrasonic spectrum is rich and allows for truly extreme manipulation of the content.

    15 %
    OFF
  • Destruction & Impact Sounds Cataclysm Play Track 1482 sounds included $195

    Cataclysm is a vast collection of recorded, synthesized and designed sounds created to support important destructive moments and add a stronger sense of extreme consequence to any sound.

    The recorded section of library features elements such as flash powder explosions, propane cannon blasts and artillery cannons recorded in unique natural environments with violent transients and lush, long and varied tails. It also features falling trees, forge burners, large trebuchet wood groans, rock smashes as well as more ordinary items recorded and designed to feel like an over the top version of themselves such as vacuum cleaner suctions, metal vase holders, ground pounders and more.

    The synthesized section of the library features equally rich textures in the form of explosion sweeteners, other-worldly environmental reflections, scorching energy risers and more.

    Finally, recorded and synthesized content was employed to develop the designed section, where the hyperrealism of the recordings meets the clean yet aggressive textures of the synthesized section in catastrophic assets themed around the library’s title.

    Bonus: Two extra libraries included for free:
    This library also includes two additional releases from Mattia Cellotto - for free: Crunch Mode delivers 230 crunchy sounds made with a variety of vegetables, fresh bread, pizza crust and a selection of frozen goods. The Borax Experiment gets you 158 squishy, gory, slimy and gooey sounds.
  • Animal Sound Effects Animal Hyperrealism Vol III Play Track 1711 sounds included $180

    Animal Hyperrealism Vol III is a library containing sounds themed animal vocalisations, from real to designed creatures totaling more than 1700 individual sounds in 279 files.

    The sounds were recorded in zoos and wildlife centers. The asset list includes but is not limited to: european red deers, monkeys, reindeers, hornbills camels, crickets, tamarins, boars, frogs, red ruffed lemurs, parrots, and many more.

    The content has been recorded at 192KHz with a Sanken CO100K plus a Sennheiser 8050 for center image and a couple of Sennheiser MKH8040 for stereo image.
    Part of the cheats section of the library features samples recorded at 384KHz. For these sounds an additional microphone was employed, specifically the CMPA by Avisoft-Bioacoustics which records up to 200 KHz. This microphone was used to record most of the library but the 384KHz format was preserved only where energy was found beyond 96KHz not to occupy unnecessary disk space.
    All files are delivered as stereo bounce of these for mics, though in some instances an additional couple of CO100K was added to the sides.
    The resulting ultrasonic spectrum is rich and allows for truly extreme manipulation of the content.

    Bonus: Two extra libraries included for free:
    This library also includes two additional releases from Mattia Cellotto - for free: Crunch Mode delivers 230 crunchy sounds made with a variety of vegetables, fresh bread, pizza crust and a selection of frozen goods. The Borax Experiment gets you 158 squishy, gory, slimy and gooey sounds.

Latest releases:

  • All files are recorded 32bit, 192 kHz, with RØDE NTG1, Line Audio Omni1 and FEL Clippy XLR EM272 microphones, Sound Devices MixPre-6 II recorder. Library contains wav files of driving, interior and exterior foley, mechanical and electrical sounds. It is only available in UCS.

  • Hum, Buzz & Glitch Sound Effects Massive Soldering Play Track 426 sounds included, 15 mins total $29.99

    MASSIVE SOLDERING – 426 files of solder sound effects, from several component repair sessions. From quick zips and zaps, to burning, sizzling and melting sears. Massive Soldering comes in at over 15 minutes, of metallic hisses and harsh bubbling. Bring the power of metallic vapors to your next project. Recorded at 192kHz and 32bit, using microphones capable of recording ultrasonic frequencies. Massive Soldering filenames are in the Universal Category System format with additional Metadata baked-in.
    Don’t need a Massive amount of Solder sound effects? We offer ‘Mini’ sound effect libraries as companions for all of our ‘Massive’ sound effect libraries. All recordings are unique to each library with no overlap. Go Mini today, and upgrade to the corresponding Massive library later, when you need more of that particular sound effect.

    40 %
    OFF
  • Hum, Buzz & Glitch Sound Effects Mini Soldering Play Track 50 sounds included, 2 mins total $6.99

    MINI SOLDERING – 50 files of solder sound effects, from several component repair sessions. From quick zips and zaps, to burning, sizzling and melting sears. Mini Soldering comes in at over 2 minutes, of metallic hisses and harsh bubbling. Bring the power of metallic vapors to your next project. Recorded at 192kHz and 32bit, using microphones capable of recording ultrasonic frequencies. Mini Soldering filenames are in the Universal Category System format with additional Metadata baked-in.
    Looking for a Massive amount of Solder sound effects? We offer ‘Massive’ sound effect libraries as companions for all of our ‘Mini’ sound effect libraries. All recordings are unique to each library with no overlap. Go Mini today, and upgrade to the corresponding Massive library later, when you need more of that particular sound effect.

    30 %
    OFF
  • Foley Sound Effects Cards and Dice Play Track 930+ sounds included $14.99

    Cards and Dice is a winning collection of tactile tabletop sounds. Shuffle, riffle, deal, flip and fold through two distinct decks — one old and soft, one crisp and snappy.

    Roll D20s, D6s and mini D6s by hand or with a dice tumbler across felt, wood and cork tabletops.

    Stack, slide and scatter poker chips with satisfying weight and precision.

    Perfect for games, animations and interface feedback.

    Includes 930 files recorded in 24bit / 96khz.

    25 %
    OFF
  • Suit Foley is a focused foley library capturing the subtle textures and movements of formal wear in action. Featuring wool blend suits, jackets, and pants, this collection includes fast and slow turns, sprints, walks, light jumps, and detailed clothing interactions such as jacket pickups, foldings, put ons, and take offs. Intended for film, games, and animation, these recordings highlight the realistic movement of layered fabric under natural performance conditions. Whether you’re designing a refined character, corporate setting, or stealthy agent in motion, Suit Foley brings detail and clarity to dressed movement.

Need specific sound effects? Try a search below:


By getting information from the game about what type of material is being blown up we can use this to control the switch, and therefore which material components of sound get added to the overall explosion sound.

05_game_audio_Explosion_Materials

Figure 05 ‘Explosion Materials’

Thoughts on the term ‘Procedural Sound Design’:

In writing the book we made a conscious decision to term this kind of sound design, that is typical in the current practice of game audio, ‘Procedural Sound Design’ to differentiate it from ‘Procedural Audio’.

Andy Farnell, who coined or at least popularised the term ‘Procedural Audio’ sees it as any kind of system where the sound produced is the result of a process. He describes these ideas more fully here. So under that definition, as soon as you set up any kind of system of playback you could see it as being procedural audio.

However there has been a lot of important work and progress in terms of procedural audio for games in the last few years (see http://proceduralaudionow.com/), and this has encompassed a variety of techniques, but there has been some emphasis on the idea of these procedural systems being synthesis based, which ultimately is probably the most flexible solution for interactivity.

This is a specialist field which we don’t go into in any depth in the book since there are other great books out there on this (not least Andy’s book ‘Designing Sound’). In the book we attempt to describe the range of procedural approaches by saying, “This approach to sound design exists on a spectrum from procedural sound design, where we tend to be manipulating pre-existing assets, to procedural audio, a term more frequently used when systems of synthesis are used to generate the sounds themselves (with much in between that combine both approaches)”.

To throw another thing into the discussion, when discussing music systems we also use the term algorithmic, which again could be used to describe any kind of system of playback. Although we could just call this procedural music (as others such as Karen Collins have done), but we felt it worth preserving and highlighting ‘algorithmic’ given the long history of algorithmic techniques explored for music in the past, which a search for ‘procedural music’ is going to miss.

 



Explosion_Materials


Video: Explosion Materials


 

Now we have all the elements of a sound as separate components we can also do other things with them, like spatialize them around the player in different ways. For the Game Audio Implementation book we built a simple system that will throw sounds around the player for people listening in 5.1 or 7.1. This could be used for elements of the explosion itself or for debris.

06_game_audio_Spatialized_Diagram

Figure 06 Diagram

 

07_game_audio_Spatialized_Detail

Figure 07 Detail

 

This was done in Unreal’s Blueprint system – which looks a bit daunting at first but once you get the hang of it you can pretty much do anything you might dream up!

08_game_audio_Blueprint

Figure 08 Blueprint

 



Explosion Spatialized


Video: Explosion Spatialized


 
By using a procedural approach to sound design we now have an explosion sound that’s different each time, is ‘aware’ of the different materials involved in the explosion, and spatializes around the player in stereo, 5.1 or 7.1.
 

A big thanks to Richard Stevens for his insights on procedural game audio! If you want to know more about procedural sound design for games then check out the Game Audio Implementation book from Focal Press. If you’re new to UE4 you can get UE4 here for free, and you can download all the levels that go alongside the book here (also for free!) to get started.
 

Please share this:


 



 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog
from a myriad of independent sound creators, all covered by one license agreement
- a few highlights:
  • Strident and Demonic

    Expand the timbre of your horror violins and cellos with CIRCUS, a sinister sample pack featuring 180 WAV sounds of screeching or high-pitched string noises, perfect for horror music and dark sound design.

    Creative Tension

    This collection offers a curated selection of screeches, high-tension tremolo, heavy jeté strokes, dark demonic textures, finger patterns, chaotic string elements, clock loops and bow accents.

    Haunting and Experimental

    Create haunting atmospheres, perfect for horror, thriller or experimental soundtracks. Every element has been designed to unsettle and disturb, blurring the line between music and noise.

  • ⏰ For a very limited time:
    Add this library to the cart and enter ah4launch in the cart coupon field – to sprinkle an extra launch discount, on top of the current discount!

    Animal Hyperrealism Vol IV is a sound library containing animal vocalisations, from real to designed creatures totaling more than 2000 individual sounds in 294 files. The sounds were recorded in zoos, and wildlife centers.

    The asset list includes but is not limited to: hippos, hyenas, vultures, dwarf mongooses, elephants, African cranes, parrots, tigers, pigmy hippos, rhea ostriches, brown bears, pheasants, wildebeests, African wild dogs and many more. The content has been recorded at 192KHz with a Sanken CO100K, an Avisoft CMPA and a Sennheiser 8050 for center plus two Sennheiser MKH8040 for stereo image.

    The resulting ultrasonic spectrum is rich and allows for truly extreme manipulation of the content.

    15 %
    OFF
  • Animal Sound Effects Collections Animal Hyperrealism Vol I Play Track 290+ sounds included $180

    Animal Hyperrealism Vol I is a library containing sounds themed animal vocalisations, from real to designed creatures totaling more than 1300 individual sounds in 290 files.

    The sounds were partly recorded with animals trained for media production, partly recorded in zoos and wildlife centers. The asset list includes but is not limited to: african lions, bengal tigers, horses, donkeys, cows, exotic birds, owls, bobcats, pumas, dromedaries, wolves, dogs, geese, lemurs, gibbons and many more.

    All the content has been recorded at 192KHz with a Sanken CO100K plus a Sennheiser 8050 for center image and a couple of Sennheiser MKH8040 for stereo image. All files are delivered as stereo bounce of these four mics, though in some instances an additional couple of CO100K was added to the sides.

    The resulting ultrasonic spectrum is rich and allows for truly extreme manipulation of the content.

    Bonus: Two extra libraries included for free:
    This library also includes two additional releases from Mattia Cellotto - for free: Crunch Mode delivers 230 crunchy sounds made with a variety of vegetables, fresh bread, pizza crust and a selection of frozen goods. The Borax Experiment gets you 158 squishy, gory, slimy and gooey sounds.
Explore the full, unique collection here
 
 
   

3 thoughts on “Why Procedural Game Sound Design is so useful – demonstrated in the Unreal Engine

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.