Shaun’s foley solution was a combination of custom recordings, sample libraries, and midi. Get the details below, and be sure to check out the special video at the end of the post to hear the foley sounds in isolation. Here’s his post – reprinted with his kind permission.
When I began my contract at Netherrealm Studios back in July of 2014, Rich Carle, Netherrealm’s audio director, informed me that one of my primary tasks would be to “own the foley process” for Mortal Kombat X’s Story Mode over the next several months. Little did I know what I was in for…
The team decided to take a different approach to foley for this game.
The team decided to take a different approach to foley for this game. Typically in visual media (TV, film, games), footstep, cloth, and interaction foley is performed live to picture, and then cleaned up and edited in post, if need be. In my experience, the largest amount of time spent in foley is on footsteps. Timing, performance, and volume all need to be practiced multiple times to picture, memorizing the scene and its nuances, until you’ve hopefully captured your best take.
In games and animation (where production sound is absent and all audio needs to be created from scratch), a 7 minute scene with 6 characters, all needing footsteps (with varying shoe types) performed to picture can quickly grow to be time consuming with diminishing returns. Also take into account the nature of animation and game design. In film or TV, the visual aspects of a character are locked. For example, after picture lock, you can count on a certain character in a specific scene having the same shoe type, for it to not be raining, and for the character’s costume to remain the same.
In games, where dozens of people are simultaneously refining environments, effects, character models, etc., this is not the case, and any one item in the foley track in a scene may need to be swapped quickly to match something visual that has changed. Hopefully you can see how important time, energy, and flexibility were when creating audio for MKX’s story mode.
Our solution? There are currently a few companies offering MIDI solutions to our foley problem, specifically for footsteps. We initially decided upon 2:
• Signo SFX-Instruments
• Foley Collection
Both services provide the same thing: individual footfalls for a variety of surfaces and shoe types, performed at varying volumes and mapped to keys in custom patches that work in Native Instruments’ Kontakt. This allowed us the option to, say if a surface changed or character costume was altered, easily swap out the patch for an already performed MIDI region. Timing and volume remain the same, but our surface or shoe type could be altered on the fly. This still requires quite a bit of time, as footfalls need to be performed to picture in real-time.
However, unlike recording in a foley booth where if a timing or volume mistake was made for any one footfall, with MIDI this is no problem
However, unlike recording in a foley booth where if a timing or volume mistake was made for any one footfall, with MIDI this is no problem; you could finish your performance and open the MIDI region, nudge notes for precise timing and change any volumes on the fly. Hell, swap the patch entirely while all of the data that was needed to be performed in real-time remains unchanged.
As for cloth and interaction foley:
This was either created from foley recordings done in house, or designed using a mixture of the former and library material, and then edited and placed accordingly. Here is a picture of a typical foley session in Nuendo. Note the separation of scenes and Kontakt instances based on ground type and MIDI routing to group tracks for easy stem bouncing of each individual character:
And here’s a zoomed view of a typical amount of footstep patches in one instance of Kontakt, and the MIDI performances associated with each character and their footstep patch:
We later contracted John Roesch and his foley team at Warner Brother’s Sound Studios in Burbank and had them record additional footfalls and scuffs, which we then edited and programmed into our own Netherrealm Footstep Foley patches for use in Kontakt. This ended up being the go-to material for footsteps.
I believe our combination of MIDI patches for footsteps in conjunction with traditional foley recording and editing yielded a great result and saved a ton of time and hair pulling
In retrospect, I believe our combination of MIDI patches for footsteps in conjunction with traditional foley recording and editing yielded a great result and saved a ton of time and hair pulling, especially for the amount of times scenes changed throughout development. There were additional surfaces we felt we could have used towards the end, particularly raised wood and corrugated metal, but I was able to design something that sounded just fine.
This video highlights footstep, cloth, and interaction foley using the processes outlined above. Anything we classified as sound design (punches, characters breaking items, etc.) have been omitted. VO is included for context (warning: the video is graphic):
Please share this:
License agreement for users of Sound Examples downloaded through A SOUND EFFECT (www.asoundeffect.com) (as “Distributor”).
This end user license agreement (the “Agreement”) is entered into between you, a single user natural person (the “Licensee”), who has downloaded one or more Sound Examples through the Distributor, and the creator or creators of these Sound Examples (the “Licensor”). For multi-user licenses, please contact email@example.com.
This Agreement covers one or more Sound Examples downloaded by the Licensee via the Distributor.
The Licensor is the creator or creators of the Sound Examples, stated as such in the downloaded file(s) (“File”) the Licensee receives after registering with a valid email address and name.
By downloading, the Licensee accepts this EULA and agrees to be bound by the terms and conditions set out in this EULA and the EULA’s with similar terms for each Licensor in the File. Any files or material included in the File not specifically mentioned in each Licensor’s EULA is covered by the terms below. By downloading the Sound Examples, you'll also receive the A Sound Effect newsletter from time to time. You can unsubscribe from this anytime.
1. Grant of License
In consideration for the download of the Sound Examples via the Distributor, the Licensor grants the Licensee a worldwide, non-exclusive, perpetual, royalty free license to use the Sound Examples (“Sounds”) on the terms and conditions set out in this Agreement.
2. Rights Granted
The license granted in this agreement allows the Licensee to:
a. install and use the Sound Examples on one workstation at a time, although the Licensee is permitted to make and keep backup copies of the Sound Examples on other storage devices, and
b. distribute and publicly perform reproductions of the Sounds, where these are incorporated in and synchronized with other media productions, which shall mean products that contains at least one additional media element to the Sounds (music, voice, image, etc.), including but not limited to radio and television broadcasts, film, music compositions, web sites, podcasts, mobile apps, advertising, multi-media presentations, video games and similar.
The Licensee is not permitted to distribute or perform reproductions of the Sounds where these are not incorporated in and synchronized with other media productions, including but not limited to in toys, product design, greeting cards, ringtones, applications such as soundboards, hardware devices, media authoring tools etc.
To the furthest extension permitted by law, the Licensee is prohibited from adapting, modifying or repackaging any Sounds, except as permitted in Clause 2.
4. Intellectual property rights
All rights to the Sound Examples are owned by the Licensor and other than the license rights granted in this Agreement all rights in the Sounds and Sound Effect Libraries remain the property of the Licensor. The Licensee must not claim ownership or authorship of the Sounds or the Sound Examples.
The Licensee’s right to use the Sound Examples will automatically terminate in the event of any breach by the Licensee of the terms of this Agreement. In the event of termination, the Licensee shall delete or destroy all copies of the Sound Examples which the Licensee has produced.
The Licensee shall indemnify Licensor and Distributor from, and against any and all claims, demands, suits, awards, damages, suits, injuries, liabilities and all reasonable expenses, including attorney’s fees incurred by the Licensor and the Distributor with respect to any matter that arises as a result of the Licensee’s breach of this Agreement.
Licensor and/or Distributor shall not be liable for any damages or for any loss of business or business profits, business interruption, or any other direct or indirect loss resulting directly or indirectly from the use of any of Licensor’s Sounds.
To the furthest extension permitted by law, the Licensee must not assign, license, sublicense, sell or otherwise assign the Sounds to any third party, except as set out in Clause 2.B.
9. Applicable Law
This Agreement is governed by the law of Denmark without giving effect to the Uniform Law on the International Sale of Goods and the Uniform Law on the Formation of Contracts for the International Sale of Goods.