blind vr sound Asbjoern Andersen


Blind is a narrative-driven psychological virtual reality thriller where the player experiences a complete loss of sight and must explore their surroundings using echolocation. In this interesting article by sound designers Paolo Armao and Aram Jean Shahbazians, they discuss the challenges they faced - and the solutions they adopted - to support the VR experience using sound and music.
Written by Paolo Armao and Aram Jean Shahbazians. Images courtesy of the authors and Tiny Bull Studios.
Please share:
Two men sit at their workstation

Aram and Paolo at the Zero dB Studios, Turin

Blind is a narrative-driven psychological thriller game built for virtual reality by developer Tiny Bull Studios, where the player gets to explore its surroundings using echolocation. We wake up as Jean, a young woman who finds herself in a strange room with a hazy memory and loss of sight. Led by the voice of the mysterious and unsettling Warden, the player uses echolocation to briefly reveal the outlines of objects, navigate the eerie mansion, solve puzzles and uncover the mystery of Jean’s past. Approaching the truth, however, Jean will be forced to confront her worst enemy – that which she does not, or will not, see.

It should be noted that this was never an exercise in simulating the experience of a visually impaired human being, but rather an exploration of how echolocation could be used as a game mechanic to guide the player through an experience where sight is limited by darkness.

Due to the circumstances, we found ourselves compelled to look for new solutions, and this affected our production: sometimes constraints can be twisted enough to become occasions to investigate and reveal new creative approaches.

In this article, we will discuss the challenges we had to face and the solutions we adopted to support the VR experience using sound and music.
 

Emotional Engine

Paolo:
It is hard to not consider emotions when we talk about immersive experiences. In Blind we wanted to focus on the concept of empathy to better represent the emotional status of Jean during gameplay. Even though there were some evident restrictions based on the budget of a small indie team, we were driven by the curiosity of shaping the emotional experience throughout the whole evolution of the game. Thus, we started designing an emotional engine to control Jean’s reaction to what was happening around her.

We got in touch with Vincenzo Lombardo, Associate Professor of Computer Science at University of Turin. Simone Pellegrini, one of his students, was working on a master’s thesis about the role of sound in creating emotions. His thesis analyzed the main speculations regarding emotional theories, from James-Lange to Two Factor Theory, and the emotional models (systems to classify emotions) derived from them, with a particular focus on theories that represent emotion as weighted reaction to cognition and world interpretation.

How to try Blind VR:

Want to experience the game yourself? You’ll find it in the Steam store here. Learn more about the game at Tiny Bull Studios’ page here.

Inspired by Russel, Ortony, Clore, Collins and many others, Simone designed a model to guide emotional elicitation through sound during gameplay. As we had to strengthen our means, he researched sound design techniques to highlight the emotional state of Jean. Keeping in mind that Jean is in a coma during the whole game, he focused his research on aural disease and aural illusion, using Weinel’s research as a starting point to analyze the aural representation of ASC (Altered State of Consciousness).

Positive and negative emotions graphed by intensity

Wheel of emotions

We noticed that the emotional status was negatively influencing the player experience, i.e. distorting sounds that were essential for the gameplay or for the comprehension of the story.

During QA sessions, we noticed that the emotional status was negatively influencing the player experience, i.e. distorting sounds that were essential for the gameplay or for the comprehension of the story. Also, we had moments in which a particular emotional status was lasting too long, distracting the player from the main scope of the game. After discussing it with the game designers, we worked on a “control engine” that reduced unwanted twists in the world perception of the player.
 

Emotional sound Spheres first proposal and final FMOD implementation

The results obtained during our R&D phase gave us the confidence to take sound design choices on solid theoretic bases and inspired our creativity, giving us the power to solve audio-related challenges supported by documented principles and psycho-cognitive theories. In the following example, sounds and voices previously heard are recomposed into a dynamic soundscape that reflects the altered mental state of Jean.
 

Corner Loop

Foley

Paolo:
In Blind, the work behind the foley production was particularly intriguing, as we wanted to make the player feel the interactions with the world resonating into Jean’s body.

We know today that part of hearing happens (and resonates) through our body: tones between 4 Hz and 16 Hz can be perceived via the body’s sense of touch (but in this case we are limited by the technology used). 60 Hz, 120 Hz and 240 Hz resonates on our fingertips, and frequencies between 4 Hz and 60 Hz are perceived as a whole body vibration (Howarth and Griffin,1988). All the foleys for the main character were recorded together with Vito Martinelli at the Zero dB sound studios in Turin using a Sennheiser MKH 416 shotgun microphone, supported by a Barcus Berry 4000 PI positioned on the objects (Jean can interact with more than 120 objects placed in the environment, so this part of the production required extra care to convey the appropriate feeling to the players) or on the surface of the foley pit.

A shallow wooden box with a cover with handles

Zero dB studios Foley Pit

We later added some sub-harmonics using Waves LoAir and then filtering unwanted low frequencies using iZotope Neutron EQ and transient shaper. In FMOD different tracks contained Shotgun mic and Contact Mic signal, thus giving us a more precise control to be used in different situations.
 

Footsteps FMOD Implementation

Environmental Modeling and Binaural Rendering

Paolo:
As Early Reflections help us determine the direction and the distance from an audio source, you can imagine how precise we needed to be in the case of Blind VR. After several attempts as mentioned above, our choice fell on the Oculus Spatial Reverb, a very precise rendering engine developed by the Oculus Developer Center.

We defined each room’s characteristic (room height – width – depth and walls reflectivity), automating these parameters through the use of FMOD snapshots. Late Reflections (Tail) contribute to our sense of space and, in order to optimize CPU use, these have been managed through the use of FMOD standard reverb. This solution for the environmental modeling thus consists in splitting the processing of Early Reflections and Late Reflections, mixing a World Geometry & Acoustics technique for the ER with the support of artificial (2D) reverb, computationally less intensive that gives more depth to the aural space.

As the game development process began in 2014, the available engines for binaural rendering were still in early development stage. During pre-production we had to decide which tools best suited our technical needs. This choice had a strong influence on our workflow, as the use of echolocation was one of the main mechanics of the game. Furthermore, the binaural render plugin had to be compatible with the middleware (FMOD) and our target platforms (Oculus Rift, PSVR), making the support of third party developers essential. Luckily, the plugin developers have always been available for support, even though some of them were acquired by other companies and in some cases their development suspended.


Popular on A Sound Effect right now - article continues below:


Trending right now:

  • Cinematic & Trailer Sound Effects Abandoned Oil Tank Play Track 327 sounds included $40

    On a recording trip to the smaller Danish port town Struer, I came across an abandoned empty oil tank. Inside I found two giant wires attached to the floor and the ceiling of the tank, almost like a huge 2 stringed double bass. I’m telling you the reverb in there was longer than the Eiffel Tower on a cloudless day !

    On the outside this was just an empty abandoned building, but it turned out it was not empty at all because it was full of sound and a few dead birds. I’m glad I was curious enough to go inside for a closer investigation and not just pass by.

    After several hours of concentrated recording, it was nice to get my ears back out in dry air. I’m happy there are no open sends to Valhalla in real life but experiencing the eternal resonance on the low frequencies from the wires was absolutely amazing.

    Abandoned Oil Tank was recorded with a LOM basic Ucho stereo pair, a Zoom H6 and the LOM Geofon. All files are in 96 kHz/24 bit and contain the original recordings.

    The result is a unique sound effect library including balloon pop impulse responses from a truly unique location that very recently became even more unique since word says that the oil tank is no more and has abandoned this world.

    327 individual sounds – all tagged with Universal Category System (UCS) metadata.

    www.katrineamsler.com

    20 %
    OFF
    Ends 1713131999
  • Electricity Sound Effects Polarity Play Track 975 sounds included $72

    Polarity delivers more than 950 sounds of electricity, science and technology – captured in several locations around the world, from electricity museums to science labs. About 50% of the library is all about electricity, with various types of Jacob’s Ladders, Tesla Coils, Ruhmkorff lamp and all sorts of impactful bursts of energy.

    Then we go through welders, plasma spheres, 3D printers, starting to cover a more broad technology theme – like old phones, telegraphs, dynamo wheels, rotary dials, whirling watchers, alarm, lab centrifuges, something scientists call a roller and a rocker, servo sounds, neon lights, a wimshurst machine and sparklers.

    Many sounds in this section were captured from vintage equipment, from a 1928’s tram to old telephone switchboards, high voltage levers and control surfaces.

    All content was recorded at 192KHz with a Sanken CO100K, a couple of Sennheiser 8040 and a Neumann 81i, translating into final assets that have plenty of ultrasonic content, ready for the most extreme manipulation.

    Bonus: Two extra libraries included for free:
    This library also includes two additional releases from Mattia Cellotto - for free: Crunch Mode delivers 230 crunchy sounds made with a variety of vegetables, fresh bread, pizza crust and a selection of frozen goods. The Borax Experiment gets you 158 squishy, gory, slimy and gooey sounds.
    20 %
    OFF
  • Door Sound Effects Noisy Doors Play Track 44 sounds included $10

    This library contains recordings of eleven different types of doors specifically chosen for their interesting sound. I performed all actions with a lot of detail covering “open/close”, “knocks”, “bangs and thuds”, “handle grab and rattle” and when possible also “crackles and squeaks” (all recorded at various intensities)

    50 %
    OFF
    Ends 1711666799
  • Metal Sound Effects MetalMotion Play Track 2000+ sounds included, 239 mins total $110

    MetalMotion is a sound design construction kit that contains four hours of moving metal mayhem: clicks and clanks, rolls and drags, wronks and squeals, scrapes and rattles, ranging from from tiny to monstrous. Nathan Moody’s unique performances with unusual combinations of props produce everything from Foley-like movements to intense groans and howls.

    Whether you’re covering a robot’s movements, sweetening weapon Foley, making crafting or pick-up sounds in a game, placing unusual layers beneath a kaiju’s roar, or crushing a submarine with undersea pressure, this collection covers the full range of subtle to raucous. Each file has many performance variations for creative choice and game audio asset creation.

    While there are some tasty impacts within, this library’s true focus is on characterful movements: handling, rummaging, opens, closes, ratchets, swirls, rolls, drags, drops, spins, rubs, zuzzes, and bows. Metal containers, filing cabinets, modern appliances, vintage (and very rusty) tools, cymbals, bells, grills, plates, bars, rods, and tubes, and many other props lent their voices to this collection.

    This UCS-compliant library was recorded with a combination of standard, contact, and ultrasonic-capable microphones through Millennia preamps. Sample rates vary based on the amount of ultrasonic content in each file. The audio files are mastered for realism, ready for extreme processing and pitch shifting of your own, but still useful in more grounded contexts.


Latest releases:

  • Trench Rammers is a one-of-a-kind sound library, created by sound designer Barney Oram. It features recordings of two 20th century Trench Rammers, some of the last operating machines of their kind in the world. The library features 48 files in total, capturing the Trench Rammers using a variety of microphones and perspectives, supplied in 192kHz 24bit WAV file format.

    This library contains multiple recordings of two antique Trench Rammers, the Pegson ER5 and the Warsop Benjo, and also features additional recordings of four antique stationary engines, the Amanco Hired Man (1920s), the JAP 1947, the Lister D (1940s) and the Norman T3000.

    Recorded in Leeds, UK, this library features multi-mic coverage and a range of distance positions captured on all included source content. Microphones used include; Sanken, Sennheiser, Neumann and DPA, captured with Sound Devices and Tascam recorders.

    This library includes detailed SoundMiner metadata and utilizes the UCS system for ease of integration into your library.

    Behind the Scenes Video:


    Trench Rammer


  • The cozy natural rhythms of hums, scrapes, splashes and thuds soundtrack the pottery workshop where the earth meets art. Find the true sound of it with Vadi Sound Library.

     

    About Pottery Workshop

     

    84 sounds that are clean, subtle and capture pretty much every object and action of the magic of fire and earth.

    From the rhythmic hum of the spinning potter’s wheel, to the splash of water, the scrape of clay with the tools shaping and smoothing surfaces, listen up for the symphony of creation.

    You will hear the tapping and thud of ceramic pottery, wooden ribs, wire cutters, loop tools, and sponges, all kinds of rummage, and mud actions on the potter’s wheel. The clicking and whirring of mechanisms during firing cycles add a mechanical counterpoint to the workshop’s natural rhythms.

    You will get variations of sounds in different proximity, size, and style of action. This collection is handy due to the clarity and diversity of the raw sounds. They have both Foley and practical usability and room for further sound design.

    You will get intuitive, detailed naming, UCS compatibility and the usual Vadi Sound craft and attention to detail in 84 pristine sounds. Recorded in 24bit-96kHz.WAV format on our favorite Sennheiser MKH 8040 stereo pair and Zoom F6.

     

    Keywords

    Pottery, workshop, electric potter’s wheel, wheel, oven, heat gun, mud, clay, ceramic, glass, wooden, metal, cup, handle, push, pull, move, remove, shape, tap, shake, clank, level, lid, tool, organizer, toolbox, rummage, fiberboard, button, bucket, sponge, plate, Dremel.

     

    What else you may need

    You may also want to check out Drag & Slide for 477 sound files of dragging, sliding, scraping and friction sounds of different objects made of wood, plastic, metal on various surfaces. Our bestseller Crafting & Survival is another good choice to get access to 1000+ survival, gathering, movement and crafting sounds.

  • All files are recorded 32bit, 192 kHz, with Shure KSM 137, Line Audio Omni1, FEL Clippy XLR EM272, Sonorous Objects SO.3 and JrF C-Series Pro+ microphones, Sound Devices MixPre-6 II & Zoom F3 recorders. Library contains wav files of driving, interior and exterior foley, mechanical and electrical sounds. It is also available in UCS.

  • Introducing Devils Bane Trailer, a chilling symphony of horror encapsulated in 533 meticulously crafted sound files, ready to unleash terror upon your audience. Dive into a nightmare realm where every creak, whisper, and shriek is meticulously designed to send shivers down your spine.

    • 533 files
    • 3.5 GB of game audio assets
    • All in 96k 24bit .wav
    • Dark Horror Movie Trailer Sound Effects Library
    17 %
    OFF
  • Birdsong from the countryside of the Swedish rural region of Värmland.

Need specific sound effects? Try a search below:


Music

Aram:

Blind is a game about confronting your inner fears and dealing with regret and acceptance

We knew from the start that music would be crucial to support the emotions of the main character and to drive the narrative. From the beginning we aimed to unify our visions and practices, as we wanted to achieve a more unified aural experience in the game, twisting and breaking the barrier between music and sound. Blind is a game about confronting your inner fears and dealing with regret and acceptance: one of the most interesting elements was the evolution of Jean’s perception of time and guilt through the story. At the beginning of the game, she is listening to a song while driving the car with her brother, but as she gets in an accident time freezes and she finds herself struggling in a limbo made of pieces of her memories.

We started by working with Fulvio Chiara for the title song “Close Your Eyes” that plays on the car radio, and we all agreed that the player should experience the perspective of Jean on everything, both visually (when Jean becomes blind, the player is also unable to see) and aurally. This meant that we needed to provide to the player her perception of time and reality making use of every instrument at our disposal; the music was no exception.

The concept of “frozen time” in music is not something new and it was already explored by Gyorgy Ligeti in many iconic works (“I am becoming aware that there is an art to which I feel very close: the heaviness of time, the frozenness of time. The process of time not as a light dance but congealed, petrified.”). Over the last decades many composers have approached the concept of non-linearity of time and space, and one of the most notable examples in film music is found in the scores of Inception and Dunkirk, by Hans Zimmer, where he explored the perception of the fleetingness of time. We wanted this to be the starting point of our research and investigate the relationship between time and emotion, as Jean finds herself in a building made with bricks of frozen clocks, memories and dark thoughts.

This setting called for a different kind of score and that’s what I’ve been working on from the start. The music for Blind was created manipulating sonic elements of the game: sound effects, voices, footsteps, environmental sounds. These elements were processed and combined together to form a structure that supports the narrative design of the game through a musical codex: micro-elements of music that serve as leitmotif associated with each character and setting, rearranged in different orders based on the moment. This allowed me to work really close to the Audio Director and create a homogeneous soundscape where music and sound design blend into one unique aural experience.

Sheet music for simple melodies

The main menu theme mirrors the song Jean is listening at the beginning, but while the song is in D major, the theme of when she becomes blind switches to D minor.

Time freezes when Jean is listening to “Close Your Eyes” and she gets in a car crash. We decided that this new frozen world was ticked by an imaginary clock made with that song and the other sounds surrounding Jean (rain on the car window, windshield wipers moving and so on), to which I applied Paul Stretch, a very useful open source tool for extreme sound stretching, on instrumental stems of “Close Your Eyes”. I then used granular synthesis and micro pitch shifts to obtain a warm and emotional pad and as soon as I heard it I knew this was the sound we were looking for. I ended up using these layers as a base for several tracks and it became the common theme on which I built all the other cues.
 


Acoustic Guitar Stretch


Blind VR Main Menu

 
At the end of the game, when Jean is approaching the exit of the limbo and is therefore going to wake up in her car, I processed the rain and windshield wipers to obtain some large menacing drums and used them as a cue to push a sensation of anxiety to the player while she is escaping, but also to suggest that she is reaching the end of her journey. Upon waking up, the drums turn back to being the sound of the windshield wipers revealing that she is stuck in her car right after the accident shown in the opening sequence.
 


Windshield Wipers Sound Design

One of the objectives which remained of utmost importance was not to overwrite the score. Blind is an introspective game with dark and hazy atmospheres. The music needed to flow seamlessly into the narrative, so I worked on dynamic drones that changed based on the position and distance of the player from the points of interest. They were crafted and edited according to the degree of emotional distress the character was feeling at that moment and combining several voice dialogues inside the textures.
 

Voice Stretch


Drone

 

A big thanks to Aram Jean Shahbazians and Paolo Armao for giving us a look at the interesting sound of Blind VR! You’ll find Blind VR in the Steam store here.

 

Please share this:


 



 
 
THE WORLD’S EASIEST WAY TO GET INDEPENDENT SOUND EFFECTS:
 
A Sound Effect gives you easy access to an absolutely huge sound effects catalog from a myriad of independent sound creators, all covered by one license agreement - a few highlights:

  • Door Sound Effects Noisy Doors Play Track 44 sounds included $10

    This library contains recordings of eleven different types of doors specifically chosen for their interesting sound. I performed all actions with a lot of detail covering “open/close”, “knocks”, “bangs and thuds”, “handle grab and rattle” and when possible also “crackles and squeaks” (all recorded at various intensities)

    50 %
    OFF
    Ends 1711666799
  • Metal Sound Effects MetalMotion Play Track 2000+ sounds included, 239 mins total $110

    MetalMotion is a sound design construction kit that contains four hours of moving metal mayhem: clicks and clanks, rolls and drags, wronks and squeals, scrapes and rattles, ranging from from tiny to monstrous. Nathan Moody’s unique performances with unusual combinations of props produce everything from Foley-like movements to intense groans and howls.

    Whether you’re covering a robot’s movements, sweetening weapon Foley, making crafting or pick-up sounds in a game, placing unusual layers beneath a kaiju’s roar, or crushing a submarine with undersea pressure, this collection covers the full range of subtle to raucous. Each file has many performance variations for creative choice and game audio asset creation.

    While there are some tasty impacts within, this library’s true focus is on characterful movements: handling, rummaging, opens, closes, ratchets, swirls, rolls, drags, drops, spins, rubs, zuzzes, and bows. Metal containers, filing cabinets, modern appliances, vintage (and very rusty) tools, cymbals, bells, grills, plates, bars, rods, and tubes, and many other props lent their voices to this collection.

    This UCS-compliant library was recorded with a combination of standard, contact, and ultrasonic-capable microphones through Millennia preamps. Sample rates vary based on the amount of ultrasonic content in each file. The audio files are mastered for realism, ready for extreme processing and pitch shifting of your own, but still useful in more grounded contexts.

  • Electricity Sound Effects Polarity Play Track 975 sounds included $72

    Polarity delivers more than 950 sounds of electricity, science and technology – captured in several locations around the world, from electricity museums to science labs. About 50% of the library is all about electricity, with various types of Jacob’s Ladders, Tesla Coils, Ruhmkorff lamp and all sorts of impactful bursts of energy.

    Then we go through welders, plasma spheres, 3D printers, starting to cover a more broad technology theme – like old phones, telegraphs, dynamo wheels, rotary dials, whirling watchers, alarm, lab centrifuges, something scientists call a roller and a rocker, servo sounds, neon lights, a wimshurst machine and sparklers.

    Many sounds in this section were captured from vintage equipment, from a 1928’s tram to old telephone switchboards, high voltage levers and control surfaces.

    All content was recorded at 192KHz with a Sanken CO100K, a couple of Sennheiser 8040 and a Neumann 81i, translating into final assets that have plenty of ultrasonic content, ready for the most extreme manipulation.

    Bonus: Two extra libraries included for free:
    This library also includes two additional releases from Mattia Cellotto - for free: Crunch Mode delivers 230 crunchy sounds made with a variety of vegetables, fresh bread, pizza crust and a selection of frozen goods. The Borax Experiment gets you 158 squishy, gory, slimy and gooey sounds.
    20 %
    OFF
Explore the full, unique collection here

Latest sound effects libraries:
 
  • Trench Rammers is a one-of-a-kind sound library, created by sound designer Barney Oram. It features recordings of two 20th century Trench Rammers, some of the last operating machines of their kind in the world. The library features 48 files in total, capturing the Trench Rammers using a variety of microphones and perspectives, supplied in 192kHz 24bit WAV file format.

    This library contains multiple recordings of two antique Trench Rammers, the Pegson ER5 and the Warsop Benjo, and also features additional recordings of four antique stationary engines, the Amanco Hired Man (1920s), the JAP 1947, the Lister D (1940s) and the Norman T3000.

    Recorded in Leeds, UK, this library features multi-mic coverage and a range of distance positions captured on all included source content. Microphones used include; Sanken, Sennheiser, Neumann and DPA, captured with Sound Devices and Tascam recorders.

    This library includes detailed SoundMiner metadata and utilizes the UCS system for ease of integration into your library.

    Behind the Scenes Video:


    Trench Rammer


  • The cozy natural rhythms of hums, scrapes, splashes and thuds soundtrack the pottery workshop where the earth meets art. Find the true sound of it with Vadi Sound Library.

     

    About Pottery Workshop

     

    84 sounds that are clean, subtle and capture pretty much every object and action of the magic of fire and earth.

    From the rhythmic hum of the spinning potter’s wheel, to the splash of water, the scrape of clay with the tools shaping and smoothing surfaces, listen up for the symphony of creation.

    You will hear the tapping and thud of ceramic pottery, wooden ribs, wire cutters, loop tools, and sponges, all kinds of rummage, and mud actions on the potter’s wheel. The clicking and whirring of mechanisms during firing cycles add a mechanical counterpoint to the workshop’s natural rhythms.

    You will get variations of sounds in different proximity, size, and style of action. This collection is handy due to the clarity and diversity of the raw sounds. They have both Foley and practical usability and room for further sound design.

    You will get intuitive, detailed naming, UCS compatibility and the usual Vadi Sound craft and attention to detail in 84 pristine sounds. Recorded in 24bit-96kHz.WAV format on our favorite Sennheiser MKH 8040 stereo pair and Zoom F6.

     

    Keywords

    Pottery, workshop, electric potter’s wheel, wheel, oven, heat gun, mud, clay, ceramic, glass, wooden, metal, cup, handle, push, pull, move, remove, shape, tap, shake, clank, level, lid, tool, organizer, toolbox, rummage, fiberboard, button, bucket, sponge, plate, Dremel.

     

    What else you may need

    You may also want to check out Drag & Slide for 477 sound files of dragging, sliding, scraping and friction sounds of different objects made of wood, plastic, metal on various surfaces. Our bestseller Crafting & Survival is another good choice to get access to 1000+ survival, gathering, movement and crafting sounds.

  • All files are recorded 32bit, 192 kHz, with Shure KSM 137, Line Audio Omni1, FEL Clippy XLR EM272, Sonorous Objects SO.3 and JrF C-Series Pro+ microphones, Sound Devices MixPre-6 II & Zoom F3 recorders. Library contains wav files of driving, interior and exterior foley, mechanical and electrical sounds. It is also available in UCS.

  • Introducing Devils Bane Trailer, a chilling symphony of horror encapsulated in 533 meticulously crafted sound files, ready to unleash terror upon your audience. Dive into a nightmare realm where every creak, whisper, and shriek is meticulously designed to send shivers down your spine.

    • 533 files
    • 3.5 GB of game audio assets
    • All in 96k 24bit .wav
    • Dark Horror Movie Trailer Sound Effects Library
    17 %
    OFF
  • Birdsong from the countryside of the Swedish rural region of Värmland.


   

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.