procedural game audio Asbjoern Andersen


How do you keep your game audio varied – without needing countless individual audio files? Procedural sound design can help with exactly that, and in this hands-on guide, senior lecturer, teacher fellow and author of the Game Audio Implementation book, Richard Stevens, demonstrates how the concept works in the Unreal Engine.

When creating a sound effect for a movie you’ll know that the audience is only going to hear it on one specific occasion, and you’ll likely build it up through editing and layering different sound elements to get just what you want.

01_game_audio_Explosion

Figure 01 ‘An explosion’

 

Most games, like sports, are about skill and mastery, so the player will be repeating similar actions again and again, and consequently they will be hearing the same sounds again and again. The trouble is that we’re very sensitive to this kind of repetition, since it just doesn’t happen in real life.
 



Explosion_Baked


Video: Explosion Baked


 
The obvious answer is just to have loads and loads of sounds but it would be far too much work to create 30-40 versions of every sound in the game (plus there are obviously limitations as to how much we can fit on a disk!).
If we look at our ‘explosion’ sound again we can see that the final sound is made up of different characteristic components, and this idea is key to starting to think about procedural approaches to sound design.

02_game_audio_Explosion_Components

Figure 02 ‘Explosion Components’

What we want to do is to keep these components separate when we import them into a game so that we can recombine them in different ways at run time. A lot of sounds in games aren’t ‘sounds’ at all, they are systems of sounds. This kind of procedural approach requires a different way of thinking, and sometimes different kinds of sound assets, since we often want to isolate the individual components that make up a sound.

When we bring these components into a Sound Cue in the Unreal Engine we can build a system of playback, and by having a few different versions of each component we can randomly combine them to create variation.

03_game_audio_Procedural_Explosion

Figure 03 ‘Procedural Explosion’

 



Explosion_Components


Video: Explosion Components


 
By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system. Randomizing the combinations of layers can vastly increase the number of potential outcomes with only a few additional sounds.

By taking this approach we don’t need thousands of complete sounds in our game to be able to get thousands of different sounds out of the system

In the above example we have four sets of three possible sounds that can potentially be heard so this will give us 81different sound outcomes. If we added just one other ‘Crack’ element then we’d get 108 potential sounds.


WANT MORE LIKE THIS?
FOLLOW A SOUND EFFECT FOR THE LATEST IN FANTASTIC SOUND:
 
          

We can increase this variation even more by adding some slight randomized delays and modulations of pitch and volume to each element, giving us.. erm… a very large number of possible outputs.

04_game_audio_Delay_Mod

Figure 04 ‘Adding Delay and Modulation nodes’

[tweet_box]Why Procedural Game Sound Design is so useful – demonstrated in the Unreal Engine:[/tweet_box]



Explosion_Delays_and_Modulations


Video: Explosion Delays and Modulation


 

Another thing we might want to do is to change the sound depending on what was being blown up, or the materials of nearby objects. Again by keeping these material components separate we can choose to layer them into the Sound Cue when appropriate by using a switch.


Popular on A Sound Effect right now - article continues below:


Trending right now:

  • User Interface (UI) Sound Effects Interactive Play Track 3917 sounds included, 225 mins total $149.99
    User Interface (UI) Sound Effects - get more than 3900+ sounds in the INTERACTIVE sound library

    Introducing ‘INTERACTIVE’ by Rock The Speakerbox: Your ultimate organic Game UI Sound Design Toolkit. Elevate your UI sound design with a comprehensive sound effects library crafted to meet the exacting demands of modern game development. ‘INTERACTIVE’ is a massive toolset designed to empower you with a diverse range of components for creating immersive, dynamic and organic sounding UI.

    Structured into three packages:

    Construction Kit (3151 Sounds):
    Unlock a world of possibilities with a massive set of generic components like clicks, whooshes, pops, and textures, alongside elaborate recordings for specific contextual needs such as coins, paper, medieval weapons and many more. Explore elemental textures like water, wood, stone, etc for added depth and a comprehensive arsenal of percussive and tonal instruments.

    Building Blocks (606 Sounds):
    Streamline your workflow with pre-designed sounds of basic UI components, including impacts, clicks, whooshes, specific contextual actions and textures (clattering coins, rustling paper, igniting fires, alchemical reactions, growing vegetation) plus tonal and musical feedback for different moods (positive, negative, rewarding, warning, triumphal, holy)

    Designed (160 Sounds):
    Choose from four sets of ready-to-use sounds tailored for the most common UI actions in different game styles (Casual, Dark, Medieval, Modern).

    Each of the four sets gives you following UI sounds:
    • Confirm
    • Select
    • Notification
    • Purchase
    • Open Menu
    • Back/Close Menu
    • Positive Light
    • Positive Heavy
    • Negative Light
    • Negative Heavy

    With 699 sound files, each offering more than 5 variations in average, ‘INTERACTIVE’ delivers a total of over 3900 sounds – ensuring that you’ll never run out of options to bring your creative vision to life. This library gives you everything you need to captivate your audience and create immersive UI soundscapes that truly resonate.

  • Game Audio Packs Warfare Sounds Play Track 2492 sounds included $28

    WARFARE SOUNDS is a massive collection of 2492 professionally recorded, edited and designed sound effects.  Including guns, bullet flybys, bullet impacts, silenced guns, explosions, footsteps, Foley, nature ambiances and more!

    WARFARE SOUNDS contains sounds from our other sound packages, including:

    Gun Sound Pack
    Bullet Impact Sounds
    Silenced Gun Sounds
    Explosion Sound Pack
    Footstep and Foley Sounds

    Plus additional content from Pro Sound Collection! This is the ultimate sound package for anyone working on a military type film or game.  Perfect for an FPS or any type of shooter.

    ALL sounds from WARFARE SOUNDS are already included in our full package Pro Sound Collection. So if you need more sounds. Be sure to check it out before purchase.

    28 %
    OFF
  • The China: Temple Bells & Crowds sound library was recorded in two locations. The first within the Yungang Grottoes, a UNESCO World Heritage site from the Wei Dynasty era, and the second, an ancient Taoist temple built in the Tang Dynasty in the outskirts of Beijing.

    The library includes recordings of large prayer bells, Buddhist wind chimes, wooden wishing sticks adorned with twinkling bells, background and foreground crowd walla in Mandarin, Chinese, birds, and other ambient sounds captured on location in stereo. We’ve also included some bonus designed sounds made from the recordings.

    These authentic recordings offer a sonic window into the atmosphere of ancient Chinese temples and shrines as they exist today. The sounds can be useful for adding realism to cinematic, game, or multimedia projects requiring an accurate representation of this cultural setting, or as fodder for creating mystical and spiritual designs.

    Specs:
    34 Sounds – 18 Buddhist Temple, 9 Taoist Temple, 7 Designed Sounds
    Total Runtime 48:44
    1.64GB in Total
    Stereo – 24 bit, 96kHz

    China: Temple Bells & Crowds Sound Library Teaser

  • Punchy Transients is an organized toolbox that serves as a reliable source of ”layers of impact” which many, many sounds do require to be in their best fit. It is also a trusty stash for designers who need to save some time to focus on something else.

    The library content was made by recording a collection of hits on a punching bag using many techniques. Also, a dry version of each sample and a folder of bonus thumps are included.

    58 %
    OFF

Latest releases:

  • Bringing you the distinctive sounds of electric tufting guns.

    With 60 files and 182 sounds, you will get rhythmic, repetitive thuds as the gun drives the tufts of yarn or fabric into the rug, and the whirring, buzzing and more.

    All organically recorded at 192 and 96kHz, in stereo and mono with a Sennheiser MKH8040 stereo pair, F3 and Tascam DR-40X. You’ll have long, short and medium durations, continuous and in intervals.

    Rich electronic and mechanical clunks and whirs accompanied by the occasional thuds, buzzing and whirring. The resulting spectrum is rich and allows for manipulation of the sounds for complex sound design.

    182 sounds / 100% royalty-free / comes with detailed naming / UCS compatible

    Find the true sound of it with Vadi Sound Library.

     

    Keywords

    Tufting, machine, gun, electric, cut, pile, loop, rug, carpet, yarn, fabric, whirring, buzzing, clunk, weaving, thud, click.

     

    What else you may need

    You may want to check out the new Pottery Workshop for 84 sounds of hums, scrapes, splashes, thuds and more. Our Mechanicals library is another option for 600+ sounds of mechanics, tools, Foley and equipment.

  • Game Audio Packs Bandit / Thug SFX Play Track 14 sounds included $4.99

    Give your bandit/thug character a unique personality with these 14 original sound effects

    29 %
    OFF
  • Immerse players in intense firefights with these distinctive, futuristic laser weapons sounds, each sound meticulously crafted to evoke a strong sense of tactility

    30 %
    OFF
  • Immerse players in fierce gameplay with 27 meticulously crafted, authentic sword fighting sounds, designed to elevate the realism and intensity of their gaming experience

    30 %
    OFF
  • From subtle button clicks to satisfying scrolling sounds, each of the 91 sounds in this pack is crafted to enhance the interactivity between player and interface, ensuring a captivating and unforgettable gaming experience

    23 %
    OFF
Need specific sound effects? Try a search below:


By getting information from the game about what type of material is being blown up we can use this to control the switch, and therefore which material components of sound get added to the overall explosion sound.

05_game_audio_Explosion_Materials

Figure 05 ‘Explosion Materials’

Thoughts on the term ‘Procedural Sound Design’:

In writing the book we made a conscious decision to term this kind of sound design, that is typical in the current practice of game audio, ‘Procedural Sound Design’ to differentiate it from ‘Procedural Audio’.

Andy Farnell, who coined or at least popularised the term ‘Procedural Audio’ sees it as any kind of system where the sound produced is the result of a process. He describes these ideas more fully here. So under that definition, as soon as you set up any kind of system of playback you could see it as being procedural audio.

However there has been a lot of important work and progress in terms of procedural audio for games in the last few years (see http://proceduralaudionow.com/), and this has encompassed a variety of techniques, but there has been some emphasis on the idea of these procedural systems being synthesis based, which ultimately is probably the most flexible solution for interactivity.

This is a specialist field which we don’t go into in any depth in the book since there are other great books out there on this (not least Andy’s book ‘Designing Sound’). In the book we attempt to describe the range of procedural approaches by saying, “This approach to sound design exists on a spectrum from procedural sound design, where we tend to be manipulating pre-existing assets, to procedural audio, a term more frequently used when systems of synthesis are used to generate the sounds themselves (with much in between that combine both approaches)”.

To throw another thing into the discussion, when discussing music systems we also use the term algorithmic, which again could be used to describe any kind of system of playback. Although we could just call this procedural music (as others such as Karen Collins have done), but we felt it worth preserving and highlighting ‘algorithmic’ given the long history of algorithmic techniques explored for music in the past, which a search for ‘procedural music’ is going to miss.

 



Explosion_Materials


Video: Explosion Materials


 

Now we have all the elements of a sound as separate components we can also do other things with them, like spatialize them around the player in different ways. For the Game Audio Implementation book we built a simple system that will throw sounds around the player for people listening in 5.1 or 7.1. This could be used for elements of the explosion itself or for debris.

06_game_audio_Spatialized_Diagram

Figure 06 Diagram

 

07_game_audio_Spatialized_Detail

Figure 07 Detail

 

This was done in Unreal’s Blueprint system – which looks a bit daunting at first but once you get the hang of it you can pretty much do anything you might dream up!

08_game_audio_Blueprint

Figure 08 Blueprint

 



Explosion Spatialized


Video: Explosion Spatialized


 
By using a procedural approach to sound design we now have an explosion sound that’s different each time, is ‘aware’ of the different materials involved in the explosion, and spatializes around the player in stereo, 5.1 or 7.1.
 

A big thanks to Richard Stevens for his insights on procedural game audio! If you want to know more about procedural sound design for games then check out the Game Audio Implementation book from Focal Press. If you’re new to UE4 you can get UE4 here for free, and you can download all the levels that go alongside the book here (also for free!) to get started.
 

Please share this:


 



 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog
from a myriad of independent sound creators, all covered by one license agreement
- a few highlights:
  • Dive into the enchanting world of Anime Magical Girl with these 274 magical sound effects, experiencing the excitement of transforming into a dazzling, beautiful soldier!

    Grab your magic wand and immerse yourself in solo or group henshin moments with sound effects ranging from shimmers, sparkles, and captivating melodies– even your enemies will pause in awe as you undergo your mesmerizing transformation.

    Let the sound effects accompany you on a journey where every note is a musical and enchanting spell, and every beat is a step toward a universe filled with wonder!

  • Game Audio Packs Warfare Sounds Play Track 2492 sounds included $28

    WARFARE SOUNDS is a massive collection of 2492 professionally recorded, edited and designed sound effects.  Including guns, bullet flybys, bullet impacts, silenced guns, explosions, footsteps, Foley, nature ambiances and more!

    WARFARE SOUNDS contains sounds from our other sound packages, including:

    Gun Sound Pack
    Bullet Impact Sounds
    Silenced Gun Sounds
    Explosion Sound Pack
    Footstep and Foley Sounds

    Plus additional content from Pro Sound Collection! This is the ultimate sound package for anyone working on a military type film or game.  Perfect for an FPS or any type of shooter.

    ALL sounds from WARFARE SOUNDS are already included in our full package Pro Sound Collection. So if you need more sounds. Be sure to check it out before purchase.

    28 %
    OFF
  • Punchy Transients is an organized toolbox that serves as a reliable source of ”layers of impact” which many, many sounds do require to be in their best fit. It is also a trusty stash for designers who need to save some time to focus on something else.

    The library content was made by recording a collection of hits on a punching bag using many techniques. Also, a dry version of each sample and a folder of bonus thumps are included.

    58 %
    OFF
Explore the full, unique collection here
 
 
   

3 thoughts on “Why Procedural Game Sound Design is so useful – demonstrated in the Unreal Engine

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.