Synthesizing COCOON’s Surreal Game Audio – with Jakob Schmid and Julian Lentz

COCOON is a unique indie puzzle game in which the player (taking on the persona of a beetle) explores worlds within worlds. These worlds are contained within beautiful glowing orbs. The player enters the orb, and finds other orbs, which contain a new worlds. These orbs also give the player unique abilities and help to power machines to solve puzzles. When the player reaches the end of each orb’s world, they battle a boss. Overcoming this foe gives the player a new ability for the orb.

COCOON was developed by Denmark-based game studio Geometric Interactive, co-founded by Jeppe Carlsen – the lead gameplay designer of other indie favorites LIMBO and INSIDE – and Audio Director/Composer Jakob Schmid, who also worked on INSIDE. Schmid received the 2013 Independent Games Festival award for ‘Excellence in Audio’ for his sound work on Carlsen’s game 140.

Here, Schmid and Sound Designer Julian Lentz talk about using only sythesized sounds for COCOON and the challenge they faced in taking that approach, how they created the sounds for the orbs, and the worlds within the orbs, how the generative music system was designed using custom built synthesizers, how they utilized FMOD, and much more!

COCOON | Reveal Trailer

Can you describe your overall aesthetic for the sound of COCOON? What were some of the adjectives or keywords you used to help guide your choices for sound?

‘Cocoon’ Audio Director/Composer Jakob Schmid

Jakob Schmid (JS): Our main keyword for the sound production was “synthetic.”

From the beginning, I wanted to make a generative soundtrack for the game based on software synthesizers. For a puzzle game where the player might take arbitrarily long “thinking breaks,” I thought it would be important that the music didn’t have distracting loops. I liked the idea that every play session could have a somewhat unique soundtrack.

With that idea in mind, I thought about what sound design aesthetic could fit the very synthetic sound of the generative music. I was watching the original Dragon Ball series from the 1980s, and I noticed that a lot of the sound effects were clearly made with synthesizers. It worked well, even though it sounded artificial.

I also had quite a lot of experience with using synthesis for sound design from the game 140 that COCOON director Jeppe Carlsen and I released back in 2013.

Finally, I thought synthetic sound effects could fit Erwin’s worlds, which to me felt both alive and synthetically created at the same time.

What went into the sounds for the Orbs themselves? (Each one has its own power and helps to solve the puzzles – how did you reinforce that with sound?)

‘Cocoon’ Sound Designer Julian Lentz

Julian Lentz (JL): The powers you unlock for each of the orbs in the game are all inherited from the abilities of the different guardians. After you have defeated a guardian, its powers essentially become tied to the orb. It was essential for us to sonically convey this relationship between orb-guardian and orb-ability.

To achieve this aural link, most often the sound design language from the boss fight was established first and then transformed into something that had a lesser weight and could fit with the size of the orb and the ability graphics.

The ability for the red orb – that allows you to access otherwise invisible paths – is a granular interpretation of the first guardian generating its crystal trap. The crystalline characteristic of this sound was made in Ableton Live by feeding white noise into the built-in Spectral Resonator effect, followed by a very long chain of different types of effect processing. I achieved the whirlpool-like movement of the ability by dragging my crystal-like sounds into Sound Particles, where I simulated movement and Doppler effect.

What went into the sound inside each Orb? (Such as the environmental sounds? And the overall characteristics of the sounds in each of those environments – like the puzzle feedback sounds?)

JL: The different worlds you warp into are vastly different from each other, both in terms of biome, color, and mood.

The contrast when warping from one world to another is visually strong, and brings a really nice sense of constant spatial fluctuation when playing. It was a goal of mine from early on to make these transitions, which are a crucial part of the game, feel like you are in a very different place once a warp is complete. I spent a substantial amount of time trying to add tactility and believability to the environment sounds of the different worlds. The graphics of COCOON are oftentimes abstract, to say the least, and I wanted the sound to go in another direction, adding to the game a more well-textured and sensory aspect, that I felt was otherwise missing.

Imperfections and fluctuations were often added to sounds that had to resemble something natural.

Achieving this was oftentimes a challenge due to our dogma of only using synthesis for sound generation, due to the perfectionism of synthetic timbres quickly dragging towards an unreal and unnatural feeling. Imperfections and fluctuations were often added to sounds that had to resemble something natural. I wrote some custom Max For Live devices that helped me with these fluctuations, for example, a non-musical oriented arpeggiator that allowed me to add imperfections to timing and a wind generating synthesizer that utilizes an unstable LFO.

I think the result of this work linked the sound design to a kind of eerie, subconscious effect, where it tries badly to sound authentic but never really achieves it fully.

Which puzzles were the most challenging sonically? Why? Can you talk about your approach to the sound of those puzzles? Also, what was your favorite puzzle sonically? Which one stands out to you?

JL: In the game, there are some prism-shaped switches that you can hit by firing energy bullets at them. Visually, they stand out from the rest of the geometry, as their “unlit” look makes them resemble a black hole.

…they should sound alien and with physics-bending qualities.

We tried a large range of directions to go in, with the main keyword being that they should sound alien and with physics-bending qualities. The struggle we faced boiled down to the fact that the player will often hit these targets frequently and in rapid succession. In game audio, I find this to often be a challenge, to find the balance of making a sound feel exciting and iconic, whilst not being overpowering in the mix when often repeatedly played.

What were your biggest technical challenges in terms of sound on COCOON? Can you talk about your solutions for overcoming those hurdles?

JL: I find the giant gates opening in COCOON very satisfying. They are the culmination of several events and puzzles leading up to it and represent unlocking a new type of area of a world. The gates are these huge metal walls that each open in a very interesting and complex manner, with lots of small distinct animations adding up and becoming one of the coolest gate openings I’ve seen in video games.

…the biggest hurdle throughout production has got to be the constant efforts needed to transform a synthesizer…into something non-musical and noise-like.

Each of the smaller metallic movements needed to have sound, so a great deal of time went into designing metallic sound variants. Ableton Live has a built-in physical modeling effect called Corpus that was probably one of the most used effects throughout the entire sound design across the audio team. It allows you to create some very interesting and detailed metallic timbres.

I think the biggest hurdle throughout production has got to be the constant efforts needed to transform a synthesizer, which very often comes in the shape of a musical key instrument, into something non-musical and noise-like. Synplant (version 1) was introduced to me by our other sound designer, Mikkel Anttila, when he joined the sound team, and it was an eye opener for me. That synth in particular is probably one of the most competent pieces of software for creating complex, weird, and non-tonal synth sounds.

I was also constantly using frequency shifters and vocoders (often with noise as a carrier) as a way of turning something too perfect and tonal into something more noisy and non-musical.

Did you use middleware? Or, did you have proprietary tools created specifically for this game? What was helpful about going in that direction? Can you talk about the benefits of that choice?

JS: We use the audio middleware FMOD Studio for all sound in the game, which we used to set up music and sound effects. The game code can communicate with FMOD using events and parameters, that then start and modify sound effects and music elements.

For the music, I developed four software synthesizers in C++, designed to run in real-time as FMOD plugins. They were custom-designed for the game; some of them are based on standard synthesis methods, and some of them use new forms of synthesis. I wrote a subtractive MiniMoog-inspired synthesizer for playing bass tones and arpeggios, and a granular synthesizer that generated soft pads that would serve as a foundation for the other instruments. Both of these have arpeggiators, that can be used to generate patterns and random sequences in a set key and scale.

developed four software synthesizers in C++, designed to run in real-time as FMOD plugins.

Another plugin was a new type of FM synthesizer that generates sound using a large set of operators and allows for interpolation between different timbres. We used it for atonal musical drones with a high degree of timbral variation. I also wrote a new type of synthesizer designed to simulate the sound of wind and rain, which also found musical use for mysterious atonal “dripping” sounds.

The synthesizer plugins worked for generating most of the ambient music in the game, and had the immediate benefit of being loop-free. It also had the interesting side effect of each player having a somewhat unique soundtrack for their game session.

Can you talk about your approach to music, and how you use music in the game to reinforce the action?

JS: I divided the game into three types of scenarios that each had a specific musical approach.

First, we had “themes,” which were short non-looping musical vignettes that were triggered at important moments in the game, such as entering a new world, opening one of the big gates, unlocking an ability, beating a boss, etc. They were produced as grand New Age-style synthesizer themes that fill out the entire soundscape.

I always tried to set up the generative music to take long breaks and not play all the time.

Secondly, we had generative “ambient music,” which plays during most of the puzzle gameplay. It was designed to be in the background and not take up too much space in the soundscape. I always tried to set up the generative music to take long breaks and not play all the time. I think this gives a feeling of the soundtrack being alive and accompanying the player, and makes for a more balanced audio experience.

Thirdly, we had “boss music,” which was usually a hybrid of generative music that was continuously modified by the movement and actions of the bosses, creating a sort of “accompaniment” for the boss fight, combined with pre-produced clips for important actions of the boss, for maximum dramatic effect.

What are you most proud of in terms of your sound work on COCOON?

JS: I’m very proud that we followed through on our concept of synthesizing every single sound in the game. When we hired our amazing sound designers, Julian Lentz and Mikkel Anttila, they took this concept and ran with it; they synthesized footsteps, rain, thunder, alien creatures, and mechanical devices with both a high degree of realism and detail, as well as an unreal sci-fi quality that I’m very fond of. The end result was way better than I would have thought possible.

…I managed to make generative music plugins that actually run on computers and consoles around the world…

I’m also personally very happy with the fact that I managed to make generative music plugins that actually run on computers and consoles around the world, generating different notes and timbres for every play session. It is very satisfying to think that my little music machines are playing for all those people, even if they don’t notice that the music is generated.

A big thanks to Jakob Schmid and Julian Lentz for giving us a behind-the-scenes look at the sound of COCOON and to Jennifer Walden for the interview!

Please share this: