procedural game audio Asbjoern Andersen


How do you keep your game audio varied – without needing countless individual audio files? Procedural sound design can help with exactly that, and in this hands-on guide, senior lecturer, teacher fellow and author of the Game Audio Implementation book, Richard Stevens, demonstrates how the concept works in the Unreal Engine.

When creating a sound effect for a movie you’ll know that the audience is only going to hear it on one specific occasion, and you’ll likely build it up through editing and layering different sound elements to get just what you want.

01_game_audio_Explosion

Figure 01 ‘An explosion’

 

Most games, like sports, are about skill and mastery, so the player will be repeating similar actions again and again, and consequently they will be hearing the same sounds again and again. The trouble is that we’re very sensitive to this kind of repetition, since it just doesn’t happen in real life.
 

Video Thumbnail

Video: Explosion Baked


 
The obvious answer is just to have loads and loads of sounds but it would be far too much work to create 30-40 versions of every sound in the game (plus there are obviously limitations as to how much we can fit on a disk!).
If we look at our ‘explosion’ sound again we can see that the final sound is made up of different characteristic components, and this idea is key to starting to think about procedural approaches to sound design.

02_game_audio_Explosion_Components

Figure 02 ‘Explosion Components’

What we want to do is to keep these components separate when we import them into a game so that we can recombine them in different ways at run time. A lot of sounds in games aren’t ‘sounds’ at all, they are systems of sounds. This kind of procedural approach requires a different way of thinking, and sometimes different kinds of sound assets, since we often want to isolate the individual components that make up a sound.

When we bring these components into a Sound Cue in the Unreal Engine we can build a system of playback, and by having a few different versions of each component we can randomly combine them to create variation.

03_game_audio_Procedural_Explosion

Figure 03 ‘Procedural Explosion’

 

Video Thumbnail

Video: Explosion Components


 
By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system. Randomizing the combinations of layers can vastly increase the number of potential outcomes with only a few additional sounds.

By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system

In the above example we have four sets of three possible sounds that can potentially be heard so this will give us 81different sound outcomes. If we added just one other ‘Crack’ element then we’d get 108 potential sounds.


WANT MORE LIKE THIS?
FOLLOW A SOUND EFFECT FOR THE LATEST IN FANTASTIC SOUND:
 
          

We can increase this variation even more by adding some slight randomized delays and modulations of pitch and volume to each element, giving us.. erm… a very large number of possible outputs.

04_game_audio_Delay_Mod

Figure 04 ‘Adding Delay and Modulation nodes’

Video Thumbnail

Video: Explosion Delays and Modulation


 

Another thing we might want to do is to change the sound depending on what was being blown up, or the materials of nearby objects. Again by keeping these material components separate we can choose to layer them into the Sound Cue when appropriate by using a switch.
 


Popular on A Sound Effect right now - article continues below:

 

Latest releases:  
  • 'Organic Lifeform Textures' by Bluezone Corporation is an inspirational sound effect library offering a selection of 99 ( 24 bit / 96 kHz / stereo ) unusual and mysterious sounds : From huge organisms to tiny insects, unexpected groans to invertebrate creatures moving through mud, this SFX library will offer you ultra high quality malleable textures for all your projects. This downloadable sample pack is very usefull for pro editors, film makers, music producers and video game sound designers.

    All sounds were recorded using various sources and processed meticulously using high-end gear. These sound effects have been layered to give you ready-to-use elements. You can easily pitch, modulate, mangle and stretch these sounds to create thousands of variations. 'Organic Lifeform Textures' has been designed to enhance science fiction, mystery, suspense and fantasy video game and scoring projects. Note: The background ambience in the demo is not part of the product but is added free of charge.

    Add to cart
  • Space Cargo Play Track 138 sounds included $22

    Bluezone Corporation presents 'Cargo – Spaceship Sound Effects', a new sci-fi sample library covering a wide range of elements including cockpit and interior ambiences, interface and beep sounds, reactor rumbles, spaceship passby sounds and more. Created with a large selection of high quality recordings and then meticulously layered, this downloadable sample pack will enhance your creative potential with as many as 138 highly usable sounds.

    All sound files are named according to their content and sorted thematically. WAV files are provided as 24 Bit / 96 kHz and sorted in 11 folders. In order to give you ready-to-use sounds for your productions, all samples are royalty-free for all your commercial projects.

    Add to cart
  • Whooshes Cinematic Metal – Titan Play Track Up to 4600 sounds included From: $119 From: $95.20

    CINEMATIC METAL – TITAN pushes big screen sound design beyond its comfort zone. New and unheard HITS, BRAAMS, BOOMS, IMPACTS, STINGERS and much more await you in the comprehensive Construction Kit and devastating Designed edition. Get over 12GB worth of clean, dazzling sound effects – available as individual components as well as layered, processed and ready to use.

    The library is available in two versions & a special bundle:

    CINEMATIC METAL – TITAN CONSTRUCTION KIT

    CINEMATIC METAL – TITAN sounds massive from start to finish. This Construction Kit in particular starts off with an unusual amount of kick. While foley and other, more meticulous applications are certainly possible, the main purpose here is to bring out the big guns and stomp any hint of moderation into the ground.

    LOCK AND LOAD
    Supplement your designs with detailed, high-end metallic sounds. The Construction Kit allows you to build unique, multi-accent effects that not only impress in scale, but also in fidelity, rhythm and character. This library particularly shines in situations, where the visible picture doesn’t necessarily produce the envisioned sound, but warrants its own supernatural emphasis.


    Files: 700 • Sounds: 4200 • Size: 10.9 GB


    CINEMATIC METAL – TITAN DESIGNED:

    Optimized for trailers, action scenes, in-game cinematics and special effects, the Designed edition brings fresh and exciting sounds to the table.

    Discover the force of aggressive, low, soft, processed, clean and tonal HITS, BRAAMS, IMPACTS, SCREECHES, STINGERS and SLAMS.

    DARK AND POWERFUL
    Paint a sense of dread and awe – CINEMATIC METAL – TITAN Designed can evoke fear of the unknown but just as easily kick into rampage mode: Empowered, ready for battle and thirsty for revenge. Find your perfect blend of haunting thriller and jacked, gritty anti-hero.
    Files: 100 • Sounds: 400 • Size: 1.5 GB


    CINEMATIC METAL – TITAN BUNDLE:

    THE BUNDLE – The best of both worlds at a discounted price.
    The Bundle gives you the full sound design power as it contains both – the DESIGNED and the CONSTRUCTION KIT edition at a discounted price.


    Files: 800 • Sounds: 4600 • Size: 12.4 GB
    Included sounds – keywords:

    Braam, impact, rattle, squeak, rumble, clang, crunch, bell, groan, squeak, creak, cymbal, stinger, rusty, gate, container, flam, click, chain, dragging, thwack, bolt, door, train, metallic, iron, sliding, pole, oil drum, scrap, nail, gutter, break, steel, rim, scaffold, crowbar, swell, brass, hook, grate
    20 %
    OFF
    Ends 1563487200
  • Environments New Zealand Ambiences Play Track 27 sounds included, 88 minutes mins total $30

    New Zealand Ambiences is a beautifully crafted ambience library exploring the incredible country and sounds of New Zealand (mainly focusing on the South Island). This library will take you on a sonic adventure exploring the many unique birds and creatures ranging from locations such as: Haast, Queenstown, Lake Paringa, Lake Wakatipu, Te Anau, the Clay Cliffs and Pukaki!

    Recorded at 24 bit/192 kHz you’ll have the flexibility to pitch these ambiences and bird songs to create some truly amazing other worldly atmospheres!

    Add to cart
  • City Life Jamaican Vibrations Vol. 2 Play Track 90 sounds included, 702 mins total From: $30

    Get the sounds and ambiences of Jamaica in this very special sound effects library, featuring almost 12 hours of authentic recordings.

    An Additional Library of Vol 1. the Jamaican Vibrations SFX library includes Walla sounds of Jamaican Patois chatting, urban and village ambiences, high mountain atmospheres, forest sounds, car rides, coffee farm working sounds, wooden house sounds, roomtones, beaches, as well as a luxury hotel visit. So if you're looking for the real sounds of Jamaica, here they are:


Sound Effects Sale

The Sound Effects Summer Sale is now live!

Land huge savings on 100s of excellent sound effects libraries right here

Need specific sound effects? Try a search below:
 

By getting information from the game about what type of material is being blown up we can use this to control the switch, and therefore which material components of sound get added to the overall explosion sound.

05_game_audio_Explosion_Materials

Figure 05 ‘Explosion Materials’

Thoughts on the term ‘Procedural Sound Design’:

In writing the book we made a conscious decision to term this kind of sound design, that is typical in the current practice of game audio, ‘Procedural Sound Design’ to differentiate it from ‘Procedural Audio’.

Andy Farnell, who coined or at least popularised the term ‘Procedural Audio’ sees it as any kind of system where the sound produced is the result of a process. He describes these ideas more fully here. So under that definition, as soon as you set up any kind of system of playback you could see it as being procedural audio.

However there has been a lot of important work and progress in terms of procedural audio for games in the last few years (see http://proceduralaudionow.com/), and this has encompassed a variety of techniques, but there has been some emphasis on the idea of these procedural systems being synthesis based, which ultimately is probably the most flexible solution for interactivity.

This is a specialist field which we don’t go into in any depth in the book since there are other great books out there on this (not least Andy’s book ‘Designing Sound’). In the book we attempt to describe the range of procedural approaches by saying, “This approach to sound design exists on a spectrum from procedural sound design, where we tend to be manipulating pre-existing assets, to procedural audio, a term more frequently used when systems of synthesis are used to generate the sounds themselves (with much in between that combine both approaches)”.

To throw another thing into the discussion, when discussing music systems we also use the term algorithmic, which again could be used to describe any kind of system of playback. Although we could just call this procedural music (as others such as Karen Collins have done), but we felt it worth preserving and highlighting ‘algorithmic’ given the long history of algorithmic techniques explored for music in the past, which a search for ‘procedural music’ is going to miss.

 

Video Thumbnail

Video: Explosion Materials


 

Now we have all the elements of a sound as separate components we can also do other things with them, like spatialize them around the player in different ways. For the Game Audio Implementation book we built a simple system that will throw sounds around the player for people listening in 5.1 or 7.1. This could be used for elements of the explosion itself or for debris.

06_game_audio_Spatialized_Diagram

Figure 06 Diagram

 

07_game_audio_Spatialized_Detail

Figure 07 Detail

 

This was done in Unreal’s Blueprint system – which looks a bit daunting at first but once you get the hang of it you can pretty much do anything you might dream up!

08_game_audio_Blueprint

Figure 08 Blueprint

 

Video Thumbnail

Video: Explosion Spatialized


 
By using a procedural approach to sound design we now have an explosion sound that’s different each time, is ‘aware’ of the different materials involved in the explosion, and spatializes around the player in stereo, 5.1 or 7.1.
 

A big thanks to Richard Stevens for his insights on procedural game audio! If you want to know more about procedural sound design for games then check out the Game Audio Implementation book from Focal Press. If you’re new to UE4 you can get UE4 here for free, and you can download all the levels that go alongside the book here (also for free!) to get started.
 

Please share this:


 


 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog
from a myriad of independent sound creators, all covered by one license agreement
- a few highlights:
  • City Life Collected Ambiences Play Track 33-380 sounds included From: $30 From: $15

    Each SFX library in the “Collected Ambiences” series features 33 Stereo Ambiences from many different locations.
    The series includes ambiences such as Public Spaces, Roomtones, Drones, Forests, City, Train, Bus ride, Rain and many (many!) more.

    Collected Ambiences highlights:

    Vol 1: Airplane Landing/Take Off, Backyards, City, Car Wash, Residential Area, Construction Site, Birds, Fireworks, Crowd, Train, Roomtone and more. 33 files, 3.85 GB, 111 minutes

    Vol 2: Car Wash, Chop Shop, Backyard, City, Residential Area, Fireworks, Construction Site, Supermarket, Train, Roomtone and more. 33 files, 3.58 GB, 103 minutes

    Vol 3: City, Birds, Crows, Pedestrian Area, Residential Area, Bus, Roomtone, Village Fair, Weekly Market, Roomtone and more. 33 files, 3.45 GB, 100 minutes

    Vol 4: City, Traffic, Birds, Funfair, Pedestrian Area, Residential Area, Bus, Roomtone, Shopping Mall, Train, Roomtone, Drone and more. 33 files, 4,69 GB, 136 minutes

    Vol 5: City, Park, Train Station, Plaza, Birds, Crows, Pedestrian Area, Residential Area, Bus, Roomtone, Village Fair, Weekly Market, Roomtone and more. 33 files, 4.66 GB, 135 minutes

    Vol 6: Public Spaces, Roomtones, Forests, City, Small Towns, Country Side, Rain and more. 33 files, 4.65 GB, 134 minutes

    Vol 7: City, countryside, creek, forest, park, open-air bath, small town, water park and more. 33 files, 4.9 GB, 147 minutes

    Vol 8: Public Spaces, Roomtones, Public Bath, City, Busride, Farm and more. 33 files, 5.14 GB, 148 minutes

    Vol 9: Public Spaces, Industrial, Animal Shelter, Factory, Mall Food Courts, City, Park, Schoolyard and more. 33 files, 4.62 GB, 129 minutes

    Vol 10: Public Spaces, Gym, Train Interiors, Fireworks, Public Bath, , City, Train, Busride, Rain and Wind, Wind and many more. 50 files, 8.94 GB, 248 minutes

    Vol 11: Beach, Public Space, City, Rain, Wind, Weekly Market, Bistro and many more. 33 Files, 4.93 GB, 122 minutes

    All recorded with Sound Devices 744T, Sennheiser MKh8040 ORTF, Beyerdynamic MC930 ORTF, RODE NT4 or Sony PCM-D100. All files were cleaned, edited and most of the files loop seamlessly.

    Please check the Content Lists below for each library to see what the full list of ambiences in each library – and if you get all 10 Collections together, you land some great savings compared to the individual collection prices.

    60 %
    OFF
  • Fire Designed Fire Play Track 255 sounds included, 34 mins total
    Rated 5.00 out of 5
    $35 $25

    Designed Fire explores the further sonic realms of a powerful element. It features special effects, ambiences, swooshes, whooshes, fly-bys, drones, textures, glitches and more, that range from heavily designed to basic elements.

    Created in collaboration with Thibault Csukonyi.

    Designed Fire highlights:

    255 24bit / 96kHz WAV files / Meta-tagged (Soundminer)
    89 Swooshes / Wooshes
    75 Short elements
    29 Impacts
    28 Winds
    34 Textures

    29 %
    OFF
    Add to cart
  • Hum, Buzz & Glitches Designed Circuits Play Track 272 sounds included, 46 mins total
    Rated 5.00 out of 5
    $25 $15

    Designed Circuits captures the essence of electric circuits and transforms them into something new. It features special sound effects, ambiences, glitches, drones, and more, that range from heavily designed to basic elements.

    Recorded with a LOM Elektrosluch 3+, designed with various fx tools.

    Created in collaboration with sound designer Will Organ.

    Designed Circuits highlights:

    272 24bit/96kHz WAV files / Meta-tagged
    58 Ambiences
    17 Glitches
    24 Hums
    52 SFX
    44 Harmonics
    29 Interferences
    38 Noise Bursts
    10 Source Recordings

    40 %
    OFF
    Add to cart
Explore the full, unique collection here
 
   
FOLLOW OR SUBSCRIBE FOR THE LATEST IN FANTASTIC SOUND:
 
                              
 
GET THE MUCH-LOVED A SOUND EFFECT NEWSLETTER:
 
The A Sound Effect newsletter gets you a wealth of exclusive stories and insights
+ free sounds with every issue:
 
Subscribe here for free SFX with every issue

3 thoughts on “Why Procedural Game Sound Design is so useful – demonstrated in the Unreal Engine

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.