Future Of Game Audio Asbjoern Andersen


What’s ahead for game audio? That’s the question we’re looking to answer with this brand-new interview series, with some of the leaders, heroes and influencers in the game audio world. And to kick things off, we’re excited to share this interview with Matthew Smith.

Matthew Smith spent more than 11 years at Rockstar North, as audio director overseeing the sound for legendary franchises such as Grand Theft Auto, Red Dead Redemption and more. Now, he’s branched out into the non-audio side of games, while still continuing to work with audio plug-in development at Krotos, Ltd.

In this exclusive interview, Matthew shares his insights on what’s next for game audio:


Interview by Jennifer Walden



 

What’s one advancement you’ve seen in game sound in the past year that you’re excited about?

Matthew Smith (MS): Modelling the effects of an environment on a game’s audio, and how it reaches the player’s ears, has long been a passion of mine, and while there has been much work done on this over the years, it’s always remained a little niche. HRTFs, binaural, Ambisonics — they all seem to pop up every few years and then never properly take hold. The rise of VR seems to be finally changing that. I hope in a few years we’ll take far more immersive (which is not to say realistic) audio for granted.
 

What’s the biggest challenge for game audio at the moment – and how do you see that resolved in the future? Tech wise, what would you want to see for game sound?

MS: I think a bunch of the traditional audio tech concerns are borderline solved at this point. I might be expelled from the secret society of sound designers for saying this, but in-game I can’t tell the difference between a 48 kHz/256kbps mp3 file and the uncompressed 96 kHz file it was created from. Likewise, increasing simultaneous channel-count is a game of diminishing returns.

Instead, I think the fun and the challenge is increasingly in the tools — enabling the creation of huge quantities of crazy-detailed interactive SFX, and giving sound designers control of the huge resources available to them.

I’ve been lucky enough to be involved with Krotos over the last year, makers of Dehumaniser. And what drew me to work with them wasn’t the tech behind the scenes, it was how instantly intuitive and natural their tools are for sound designers. Using it, you think, “Awesome Monster!” not “Awesome DSP!”
 

Creatively, what would you like to see in the future for game sound?

MS: Audio still gets dragged along by the rest of game development all too often, having to react to changes rather than being thought about as a core part of a designer’s toolset. Music and dialogue far less so, but certainly the overall sound design. And when you play a game like Inside, where that quite clearly wasn’t the case, it’s obvious how much sound design can offer beyond just the nuts-and-bolts of matching the visuals.

For years I thought it was a 99% cultural problem, but perhaps there is a tech route through it too

But enough whining, what’s the solution? No one single thing, for sure. For years I thought it was a 99% cultural problem, but perhaps there is a tech route through it too. If audio tools were good enough that mere mortals could create passable placeholder audio trivially easily, maybe people would experiment more in the early stages of design?
 

In terms of your own work, any exciting stuff on the horizon you can talk about?

MS: The team at Krotos have some amazing products in the pipeline. One thing we’ll be showing at GDC is Dehumaniser running real-time in-game. You get so used to most voice-changing tools sounding cliché and comedic; it’s a breath of fresh air to hear something sound totally natural and yet super-flexible. In a VR environment especially, where your sense of presence is that much greater, sounding like you really are someone/something else is incredibly powerful.
 

What opportunities do you hope VR will offer game sound pros?

MS: It’s a huge opportunity, in lots of different ways. What surprised me most about VR was the level of intimacy it brings to seemingly mundane things. I was instantly absorbed just blowing up balloons in the Vive setup tutorial, in a way a non-VR experience couldn’t possibly replicate. That level of detailed interaction lends itself so well to creating realistic, interactive sound design that will make or break the reality of a VR experience.

VR opens up a whole order of magnitude of useful detail you can go into and the interactivity is even more important, because you feel able to gently poke everything in the world, not just blow it up.

In my Rockstar days, we were blessed with the resources and talents to create super-detailed and expansive soundscapes, and I felt like the raw detail of the SFX we’d create had almost hit a wall. At times there was no need to make things any more detailed, as it would be lost. The challenges started to become interactive mixing, and higher-level problems. But VR opens up a whole order of magnitude of useful detail you can go into and the interactivity is even more important, because you feel able to gently poke everything in the world, not just blow it up.
 


Popular on A Sound Effect right now - article continues below:

 

Latest releases:  
  • We have created a small library to help with the ongoing need for safety videos during this strange time in our lives. From hand sanitizer’s to spray bottles, we have compiled a library to cover all forms of day to day sanitizing.

    20 %
    OFF
    Ends 1591394399
    Add to cart
  • Jump in a hot-off-the-assembly-line 2020 Porsche 911 “992” Carrera S from the comfort of your home or studio chair. This library won’t lose a cent of value when you drive it off the lot!

    Great for linear work or games – especially since it includes an easy-to-use Interior vs. Exterior mockup folded down to 2-channel files (ISO’s also included separately).

    This is our premiere foray into sound libraries here at Steamboat Sound, and we worked real hard to make it equally high-quality and easy-to-use – we hope you enjoy!

    Recordings include:

    Mockup channel order (panned, for easy editing in NLE):
    Channel 1 (left) – Exterior
    Channel 2 (right) – Interior

    Isolated tracks of all Exterior and Interior perspectives on idles, revs, engine starts & stops, various speeds, and more!

    Interior knobs, buttons, dials, seatbelts, sunroof, turn signals, buttons, windshield wipers, door open/close.

    Recorded with industry-standard equipment used on theatrical films and name-brand commercials, for your listening pleasure.

    40 %
    OFF
    Ends 1591307999
    Add to cart
  • MAGIC SOUND EFFECTS REDEFINED
     
    Enter the world of MAGIC – ARCANE FORCES, where supernatural entities can be heard raging with ultimate power and fury. The distinctly forceful and kinetic character of this comprehensive sound effects library and its designs is supported by countless pristine source recordings of the elements being pushed to their limits. Whether in post production or sound design for games, MAGIC – ARCANE FORCES gives you the edge on the other side.

    WHAT’S INSIDE:
    INCLUDED SOUNDS – KEYWORDS
    ACID, ARCANE, BARRIER, BREATH, BUFF, CURSED, DEBUFF, DIVINE, ELECTRIC, ENERGY, FIRE, GLASS, ICE, IMPACT, LIGHT, LIQUID, METAL, PROCESSED, PROJECTILE, RUMBLE, SEQUENCE, SUMMON, SWEETENER, SWISH, TELEPORT, TEXTURE, VOICE, WATER, WHOOSH, WIND
    20 %
    OFF
    Ends 1591999199
  • “The Shoe Collection: Soft Hardwood – Woman’s Knee-High Boot“ by Periscope Post & Audio, provides 22 high quality footsteps on soft hardwood floors with the knee-high boot.  The audio files are recorded at 24bit, 192k with mono and stereo recordings.  The Sennheiser MKH-60 was used for the mono files with a slightly more distant mic placement than the stereo files, which were recorded with the Sennheiser MKH8050 and the Sennheiser MKH-30 near the shoe.  From different walking speeds, to jogging, sprinting, jumping, hard stops, scuffs, and more!  There are several performances with each file to fit the right action you need.  That’s a whopping 620 footsteps between the mono and stereo files!

    17 %
    OFF
    Ends 1591135199
    Add to cart
  • Recording of the Pulse Jet Snowmobile. Powered by a 50 Hz Pulse ethanol/water jet engine the same used by a WW2 V-2 rocket.


    The Pulse Jet Snowmobile sound collection shares 28 clips of field recordings in 1.42 gigabytes of audio. Powered by a 50 Hz Pulse ethanol/water jet engine the same used by a WW2 V-2 rocket, this bundle presents the snowmobile racing at extreme speeds for a mix of perspectives.

    Both onboard and exterior perspectives are shared in two takes. The exterior perspectives arrange microphones at a mix of distances at the beginning, end, and middle of the racing strip. The onboard microphones were positioned onboard the body and at the jet engine to portray steady fast driving, with bonus custom mixes of the onboard and exhaust tracks.

    The sound library includes iXML, Soundminer, BWAV, and MacOS Finder embedded metadata, metadata keyword import files for 7 languages, and Pro Tools and Reaper mixing sessions.

    Add to cart


Need specific sound effects? Try a search below:
 

We’d also go to great lengths on Grand Theft Auto and Red Dead Redemption to try and capture the acoustic effects of an environment — helping to make a subway feel oppressive, or a sweeping vista seem grand, but in non-VR games it’s all about the space and relatively little about the player.

In VR, that whole world of super-subtle spatial audio clues is available to sound designers

The subtle differences in audio that everyone’s brain subconsciously reads with a simple tilt of the head, or moving close to a wall, are impossible to capture with the blunt movement of a third-person character, or even in first-person. In VR, that whole world of super-subtle spatial audio clues is available to sound designers.

On the same theme, the scope for conflict between visual and motion senses to cause nausea are pretty well understood at this point. I wonder how much we have left to learn about the role audio has to play in creating a complete feeling of presence.
 

 

What advice would you give to game audio pros, both those already in the industry and those looking to join it?

MS: I spent a good chunk of last year working on the non-audio elements of game development, making whole games from scratch with a tiny team, and it was a real eye-opener working hands-on in so many different disciplines.

It’s difficult of course to make the time to do that while you’re buried deep in the detail of a specialism, but these days it’s so easy to download a AAA-quality game engine for free and just dive in, following some YouTube tutorials. The perspective and empathy it gives you is incredibly valuable. So I’d encourage anyone in or wanting in on the game audio community to carve out a wee chunk of their time to find out what it really means to be an animator or a physics programmer, and hopefully become a better audio professional as a result.

That idea of a T-shaped person is nothing new, but in an industry that changes so quickly, it feels more relevant than ever.
 

A big thanks to Matthew Smith for his insights on the future of game audio – and to Jennifer Walden for the interview! As mentioned, we’re just kicking off this new series, so stay tuned for more thoughts and insights on the future of game audio.
 

Please share this:


 


 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog from a myriad of independent sound creators, all covered by one license agreement - a few highlights:
 
 
  • Alchemy of Guns is a comprehensive weapon laboratory of single sounds made to be mixed, assembled and fit with each other.
    We built the library as an array of modular layers, each one bound to a specific alchemical element, each one made with a specific Xfer Serum setup, and since we enjoyed finding ourselves sketching on paper combinations of elements according to the combinations of the samples, we kept this general structure.

    33 %
    OFF
    Ends 1591135199
    Add to cart
  • Sci-Fi Advanced Propulsion Play Track 1191 sounds included $99

    ADVANCED PROPULSION is a next-gen sound design toolkit built for creating dynamic sci-fi vehicle engines and passbys. The designed engine sounds are all seamless loops, making them perfect for use with various plug-ins and interactive applications. All raw source material used to design the engines is included, giving you maximum creative flexibility.

    Add to cart
  • The “Computer Sound FX 2“ Sound Effects Library from SoundBits contains over 1000 designed computer sound effects including interface, noise, glitch, alarm, bleep, processing, loading, interaction, malfunction, access, and 8-Bit SFX.

    From simple select and confirmation sounds to more complex loops and processing one shots and alarms, you’ll find a large and composite collection of sound effects to give your interface or animation the right sonic treatment.

    The sounds are divided into the following categories:
    • Menu:
    – Access Granted | Confirm
    – Select
    – Access Denied
    – Open
    – Close


    • Loading Processing
    – Loops
    – OneShots


    • Glitch | Malfunction
    • Mechanic
    • Retro | 8-Bit
    • Alarms

    Add to cart
 
Explore the full, unique collection here

Latest sound effects libraries:
 
  • We have created a small library to help with the ongoing need for safety videos during this strange time in our lives. From hand sanitizer’s to spray bottles, we have compiled a library to cover all forms of day to day sanitizing.

    20 %
    OFF
    Ends 1591394399
  • Jump in a hot-off-the-assembly-line 2020 Porsche 911 “992” Carrera S from the comfort of your home or studio chair. This library won’t lose a cent of value when you drive it off the lot!

    Great for linear work or games – especially since it includes an easy-to-use Interior vs. Exterior mockup folded down to 2-channel files (ISO’s also included separately).

    This is our premiere foray into sound libraries here at Steamboat Sound, and we worked real hard to make it equally high-quality and easy-to-use – we hope you enjoy!

    Recordings include:

    Mockup channel order (panned, for easy editing in NLE):
    Channel 1 (left) – Exterior
    Channel 2 (right) – Interior

    Isolated tracks of all Exterior and Interior perspectives on idles, revs, engine starts & stops, various speeds, and more!

    Interior knobs, buttons, dials, seatbelts, sunroof, turn signals, buttons, windshield wipers, door open/close.

    Recorded with industry-standard equipment used on theatrical films and name-brand commercials, for your listening pleasure.

    40 %
    OFF
    Ends 1591307999
  • MAGIC SOUND EFFECTS REDEFINED
     
    Enter the world of MAGIC – ARCANE FORCES, where supernatural entities can be heard raging with ultimate power and fury. The distinctly forceful and kinetic character of this comprehensive sound effects library and its designs is supported by countless pristine source recordings of the elements being pushed to their limits. Whether in post production or sound design for games, MAGIC – ARCANE FORCES gives you the edge on the other side.

    WHAT’S INSIDE:
    INCLUDED SOUNDS – KEYWORDS
    ACID, ARCANE, BARRIER, BREATH, BUFF, CURSED, DEBUFF, DIVINE, ELECTRIC, ENERGY, FIRE, GLASS, ICE, IMPACT, LIGHT, LIQUID, METAL, PROCESSED, PROJECTILE, RUMBLE, SEQUENCE, SUMMON, SWEETENER, SWISH, TELEPORT, TEXTURE, VOICE, WATER, WHOOSH, WIND
    20 %
    OFF
    Ends 1591999199
  • “The Shoe Collection: Soft Hardwood – Woman’s Knee-High Boot“ by Periscope Post & Audio, provides 22 high quality footsteps on soft hardwood floors with the knee-high boot.  The audio files are recorded at 24bit, 192k with mono and stereo recordings.  The Sennheiser MKH-60 was used for the mono files with a slightly more distant mic placement than the stereo files, which were recorded with the Sennheiser MKH8050 and the Sennheiser MKH-30 near the shoe.  From different walking speeds, to jogging, sprinting, jumping, hard stops, scuffs, and more!  There are several performances with each file to fit the right action you need.  That’s a whopping 620 footsteps between the mono and stereo files!

    17 %
    OFF
    Ends 1591135199
  • Recording of the Pulse Jet Snowmobile. Powered by a 50 Hz Pulse ethanol/water jet engine the same used by a WW2 V-2 rocket.


    The Pulse Jet Snowmobile sound collection shares 28 clips of field recordings in 1.42 gigabytes of audio. Powered by a 50 Hz Pulse ethanol/water jet engine the same used by a WW2 V-2 rocket, this bundle presents the snowmobile racing at extreme speeds for a mix of perspectives.

    Both onboard and exterior perspectives are shared in two takes. The exterior perspectives arrange microphones at a mix of distances at the beginning, end, and middle of the racing strip. The onboard microphones were positioned onboard the body and at the jet engine to portray steady fast driving, with bonus custom mixes of the onboard and exhaust tracks.

    The sound library includes iXML, Soundminer, BWAV, and MacOS Finder embedded metadata, metadata keyword import files for 7 languages, and Pro Tools and Reaper mixing sessions.

 
FOLLOW OR SUBSCRIBE FOR THE LATEST IN FANTASTIC SOUND:
 
                              
 
GET THE MUCH-LOVED A SOUND EFFECT NEWSLETTER:
 
The A Sound Effect newsletter gets you a wealth of exclusive stories and insights
+ free sounds with every issue:
 
Subscribe here for free SFX with every issue

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.