“Inside the Narrative” is a research project at the University of Bergen’s Faculty of Fine Art, Music and Design exploring the narrative potential of Virtual Reality (VR) in documentary filmmaking. The project investigated how VR can move beyond traditional storytelling to create immersive, interactive experiences where the viewer’s presence and agency influence the narrative.
Shadow of War VR application, in Norwegian language compatible with Meta Quest, translates a documentary concept into an interactive virtual experience. Extended Media, with Rafal Hanzl as a key contributor, partnered with Torkell Bernsen and Gustav Kvaal of the University of Bergen’s Faculty of Fine Art, Music and Design on the groundbreaking Inside the Narrative research project. This project pushed the boundaries of documentary filmmaking by exploring the immersive and interactive potential of Virtual Reality (VR). Inside the Narrative focused on the concept of “storyliving,” moving beyond traditional cinematic techniques to create experiences where the viewer is an active participant, rather than a passive observer. Hanzl served as project manager, Unreal Engine generalist, and implementation specialist, also handling sound implementation and spatial VFX.
The experience centers on 92-year-old Erik Kvaal’s firsthand account of the 1940 bombing of Bodø and the sinking of the DS Prinsesse Ragnhild during World War II. The technical approach combined a drawn and animated visual style with an ambisonic soundscape to create a deeply immersive environment. Key technologies employed included Unreal Engine, and a range of spatial techniques to create a “close and informative experience” of this historic event. The project is deeply connected to the idea of transferrable learning from the past to better understand and reflect on the present.
Music and VR Sound Design played a crucial role in Shadow of War’s immersive impact, with Odd Torleiv Furnes serving as the project’s composer and sound designer. Furnes, a Norwegian composer, musician, educator, and researcher professionally affiliated with Høgskulen på Vestlandet (Western Norway University of Applied Sciences) in Bergen, holds a doctorate in musicology. He is the author of the book “Dybdelæring i musikk – musikalsk forståelse gjennom sansning, følelser og begreper” (“Deep Learning in Music – Musical Understanding Through Perception, Emotions and Concepts”), in which he explores the role of deep learning in music education, analyzing the relationship between music and emotions, perception, and embodied cognition. Furnes brought this specialized expertise in creating spatial audio environments that respond dynamically to the user’s movements and interactions within the virtual space. His approach to the soundscape went beyond traditional film scoring, incorporating three-dimensional audio positioning and binaural techniques that enhance the psychological weight of Erik Kvaal’s wartime testimony. Working closely with Hanzl’s spatial VFX implementation, Furnes crafted an audio narrative that seamlessly blends historical authenticity with emotional resonance, using period-appropriate sound elements and original compositions to guide users through the traumatic events of the 1940 Bodø bombing. The collaboration between Furnes’ musical sensibilities and the project’s technical framework demonstrates how contemporary VR experiences can leverage sophisticated audio design to create deeper empathetic connections between historical events and modern audiences.
A comprehensive record of the “Inside the Narrative” project can be found on the Research Catalogue, an international, open-access repository and database specifically designed for artistic research and practice-based research: https://www.researchcatalogue.net/view/818058/818059.
No Matter Where is an earlier, experimental immersive documentary project that served as a precursor to “Shadow of War,” exploring volumetric film and photogrammetry environments. Rafal Hanzl, as creative technologist, was responsible for creating a 360° panoramic virtual set using still photographs, implemented within the Unity software. He also integrated a virtual volumetric set environment, utilizing photogrammetry and a volumetric recording studio.
No Matter Where aimed to push the boundaries of VR storytelling by incorporating principles from visual communication, interaction design, and game development. This was achieved, in part, by requiring a live operator to manage the VR installation setup. The final sequence of the presentation, which involved interaction with a virtual volumetric character, concluded with contact with the operator. This human touch creatively broke the immersion, enhancing the final dramatic accent by juxtaposing the virtual and real worlds.
Shadow of War is a thought-provoking virtual reality experience that delves into the emotional and psychological impact of the war conflict. Available on SideQuest, a platform for VR content, Shadow of War offers a unique perspective on the realities of war https://sidequestvr.com/app/34157/shadow-of-war.
The experience utilizes immersive storytelling and interactive elements to engage users and challenge their perceptions.