MAX-R

MAX-R, the Mixed Augmented and Extended Reality Media Pipeline, aimed to define, develop, validate and demonstrate a range of tools for making, processing and delivering maximum-quality XR content. The tools are be based on open APIs, open file and data transfer formats, which enable the development and support the integration of new tools. We built on research and advances in VP technologies to develop real-time processes and tools that deliver better quality, greater efficiency, ease of use and interoperability between proprietary and open-source software. The new tools and processes will deliver enhanced interactivity and novel content based on XR media data.

 

The MAX-R consortium is led by Universitat Pompeu Fabra and includes the following partners:

 

 

Further information can be obtained from the official website: MAX-R.EU

 

DEVELOPMENTS & TOOLS

In September 2024, the R&D team from Animationsinstitut released a video highlighting the latest developments in the MAX-R project. It provides a comprehensive overview of the tools - AnimHost, DataHub and VPET - all built on the Animationsinstitut’s open-source framework TRACER FOUNDATION and further developed within MAX-R.

These tools are designed to enhance XR media production, offering seamless integration with industry-standard software such as Unreal and Blender. They enable a variety of functions, from real-time scene editing in VPET to data synchronisation through DataHub and advanced animation generation with AnimHost. Together, they offer flexible solutions for improving workflows in animation, virtual and XR media production.

 

DIGITAL LOCATIONS

DIGITAL LOCATIONS demonstrates the potential of the advanced virtualisation of shooting locations for film production, offering a streamlined approach to pre-visualisation, location scouting, shot planning and Virtual Production. By creating realistic digital twins of real-world locations, it enables filmmakers to visualise scenes, plan complex shots and collaborate effectively while maintaining creative flexibility and control.
Additionally, the concept of DIGITAL LOCATIONS facilitates the virtual exploration of buildings, heritage sites and natural landmarks from anywhere in the world without the need for extensive travel. This not only reduces production costs but also supports sustainability initiatives like the EU Green Deal.
 

KEY BENEFITS & FEATURES:

• Efficient Pre-Vis & Scouting: shot-planning with realistic digital twins of locations
• Virtual Production Ready: minimising on-location filming, available 24/7
• Remote Collaboration: exploring locations virtually, from anywhere
• Supporting Sustainability: reducing costs and travel needs
• Open-Source: built on adaptable technology with customisation on request

 
The current demonstrator is a platform prototype utilising core MAX-R technologies developed by Filmakademie Baden-Württemberg (VPET, TRACER, DataHub) and UPF (wgpuEngine). This project was created in close collaboration with members of the MAX-R Creative User Group: Film Commission Region Stuttgart and Third Picture GBR - reflecting a commitment to advancing industry practices.
 
Latest versions of the DIGITAL LOCATION demo were presented at CVMP 2024 and at the European Film Market during Berlinale 2025.

 

 

 
As part of the DIGITAL LOCATIONS initiative, we have released two datasets under the Creative Commons licence:
The initial dataset features CONTAINER CITY STUTTGART, while the second presents the old horse stables of the MARIENWAHL LUDWIGSBURG estate. Both are available for download below.

 


Download Container City Stuttgart Dataset 2024

 


Download Marienwahl Ludwigsburg Dataset 2025

SHORT FILM SURVIVOR

In MAX-R, we are developing AI-assisted software tools and pipelines designed to streamline and enhance workflows for 3D animated film productions. These tools aim to empower filmmakers and animators to create bipedal character animations in real-time with the aid of the latest advances in machine learning.
 
AnimHost, an integral component of the TRACER ecosystem, addresses these challenges by connecting animation generators to Digital Content Creation (DCC) applications and other clients. The generated animations can be exported, further processed and refined in standard DCC applications such as the open-source software Blender. This integration allows animation artists to remain within their familiar creation environments while utilising machine learning capabilities and maintaining ultimate creative control over their content.
 
The use-case of the TRACER framework within MAX-R was presented at CVMP 2024 in an AnimHost demo.
 
To test, evaluate and visualise this workflow in a realistic production environment, we produced an animated short film titled SURVIVOR:

Set in a dystopian, desolate world of rusted metal, the film follows a lonely old robot racing towards an unknown destination. Pursued by an all-consuming red fog, he climbs a massive mountain to protect his precious cargo. Faced with an insurmountable obstacle and the danger closing in rapidly behind him, he must make a critical decision to ensure his survival.

 

 
 

ANIMHOST MOTION CAPTURE DATASET 2024 & 2025

 
The training data for the AnimHost animation generator was developed through two dedicated motion capture sessions at the Filmakademie Baden-Württemberg, ensuring fair use and traceability of ownership. The second session focused specifically on running movements.
 
These datasets were released under the Creative Commons licence by Filmakademie Baden-Württemberg.
 


Download Survivor AnimHost Motion Capture Dataset 2024

 


Download Survivor AnimHost Motion Capture Dataset 2025

 
 

SHORT FILM UNREAL PROJECT DATASET 2025

 
The Unreal scene and character assets used to produce the final short film, SURVIVOR, which evaluates the animation workflow, are released under the Creative Commons licence by Filmakademie Baden-Württemberg.
 


Download Survivor Short Film Unreal Project Dataset 2025

BROWSER BEATS

As part of MAX-R, our project partners Improbable and the BBC developed tools to enhance live digital experiences and redefine virtual performances. To evaluate their workflow and platform, Filmakademie Baden-Württemberg captured a live DJ performance and, in collaboration with Popakademie Baden-Württemberg, hosted the virtual experience BROWSER BEATS. This event brought the minimalist electro DJ set into an interactive online environment, enabling participants to engage with each other as 3D avatars and experience the performance directly through a standard web browser.

 

 

PUBLICATIONS & PRESENTATIONS


Jonas Trottnow, Volker Helzle, Film Commission Region Stuttgart. 2025.
Berlinale 2025, European Film Market, Demo. MAX-R Demo: Digital Location.
February 13 - 19, 2025. Gropius Bau, Berlin, Germany.
Jonas Trottnow, Simon Spielmann, Francesco Andreussi, Simon Haag. 2024.
CVMP 2024, Short Paper. TRACER: Modular Open-Source Framework for Real-Time XR Collaboration.
November 18 - 19, 2024. BFO Southbank, London, UK.
Jonas Trottnow, Simon Spielmann, Volker Helzle, Francesco Andreussi, Simon Haag. 2024.
CVMP 2024, Demo. MAX-R Demo: AnimHost.
November 18 - 19, 2024. BFO Southbank, London, UK.
Jonas Trottnow, Simon Spielmann, Volker Helzle, Alexandru-Sebastian Tufis-Schwartz. 2024.
CVMP 2024, Demo. MAX-R Demo: Digital Location.
November 18 - 19, 2024. BFO Southbank, London, UK.
Digital Production - Magazin für Digitale Medienproduktion Ausbildung für eine grünere Zukunft (Low-Res, High-Res).
Fabian Stetzler. March 2023.

This project has received funding from the European Union's Horizon Europe Research and Innovation Programme under Grant Agreement No 101070072.

Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or European Health and Digital Executive Agency. Neither the European Union nor the granting autority can be held responsible for them.