The EU funded project Dreamspace will research, develop and demonstrate tools that enable creative professionals to combine live performances, video and computer-generated imagery in real time and collaborate to create imaginative entertainment and experiences.
The film and TV industry is seeking ways of producing audiovisual media that combine the real world, CGI and 3D animation in real time at a quality sufficient for major movies, but at a cost that is accessible to European film and TV companies. Meeting the demand will need advances on the state of the art in a wide range of areas, including the combination of 2D and 3D methods, depth and lighting capture, omni-directional video, real-time depth-based processing and compositing, real-time high quality rendering and new approaches to manipulating CG objects and video in a virtual environment. The ability to assemble, try out, play with and even improvise virtual productions will have profound creative consequences for the media industry, performance groups and individual artists
We are developing a holistic approach for collaborative tools that allow real-time on-set light, asset and animation editing via an intuitive interface. VPET is a tablet based onset editing application to work within a virtual production environment. It is designed to run on mobile and head mounted devices allowing easy access to operators without dedicated training. It provides functionality to edit assets during a virtual shooting and synchronize changes with the film pipeline. VPET communicates through a network interface to main applications and other clients, allowing live editing of object, light and animation parameters. The development is open-source and particularly considers established (offline) film pipelines.