In 'Here', Zemeckis tests the excellence and innovation of Artificial Intelligence in cinema

A room can hold countless lives throughout its centuries. Director Robert Zemeckis proposes in 'Here' an unforgettable journey through time with the help of the latest Artificial Intelligence techniques where the past and present intertwine like never before.

Here It takes place in a single location, showing moments from prehistory to events far in the future. By interweaving personal and universal themes, the film invites audiences to reflect on love, loss, and the passage of time reflected in the marriage formed by Richard (Tom Hanks) y Margaret (Robin Wright). To achieve the impressive time travel reflected in the faces of the protagonists Hanks and Wright who, together with Paul Bettany y Kelly Reilly protagonizan la historia, Robert Zemeckis went to the team Metaphysic con Your plate leading his supervision and the British-Indian visual effects studio DAY under the leadership of Johnny Gibson.

the movie written by Eric Roth based on the graphic novel of the same name by Richard McGuire, it featured a budget of 45 million dollars using three sets in its filming that housed two identical copies of the room so that one could be filmed while the other was decorated according to the period. In addition, the exterior scenes prior to the construction of the house were filmed on a third set.

He director of photography Don Burgess He agreed with Zemeckis that, after trying body doubles and countless makeup tests, the film will only be viable with the help of Artificial Intelligence. And achieving this level of realism through traditional computer graphics techniques that involve 3D modeling, rendering and facial capture, would have been impossible given the quality demands required by the production of Here.

Neural Performance Toolset (NPT)

Miramax (the film and television production company owned by beIN Media Group y Paramount) then invited the Metaphysics studio to carry out a screen test for the project, recreating a young Tom Hanks, who remembered his youth in films like Big but with the experience of the passing of the years of an actor of his stature. The Neural Performance Toolset (NPT) technology from Metaphysics is revolutionizing the world of AI-generated visuals with its innovative machine learning framework. Designed to deliver unmatched realism and control, this technology leverages next-generation model architectures, advanced latent space manipulation, and neural animation techniques.

They are complex data processing system and their neural networks of the latest generation are designed to obtain results of high resolution without losing control or flexibility. This architecture not only preserves the integrity of facial performance transfer, but also maintains context- and identity-specific nuances during training. With these tools, the production visual effects supervisor in Here, Kevin Baillie, and the visual effects producer, Sandra Scott, they decided that the time had come for AI to show on screen how far it can go.

Although neural network models achieved remarkable photorealistic results in the first tests, Metaphysics developed new tools for the eye line control of actors and other techniques that support the sudden movements of the actors' heads.

The team developed facial features in up to five different ages for Tom Hanks, four ages for Wright and two ages for Bettany and Riley. In total, the film uses facial replacement in 53 of the 104 minutes of its total footage. To match the movements of the actors with the fictitious age recreated by AI, monitors were set up on the filming set for each talent in which the image from the camera and the result after the application of the AI ​​were shown. Thanks to this work in real time, the actors could adjust their performances as well as the makeup teams (with real makeup alongside digital makeup), hairdressing or props check the result according to the time frame of the scene.

The final result in which the actors travel through time invisibly to the public was a mixture of multiple neural renders of Artificial Intelligence and the composition in Nuke from Foundry. The evolution of the passage of time outside behind the main window of the living room used an LED wall with content from each era moved by the motor of Unreal.

IA made in Spain

In the impeccable production of Here has played a key role, in addition to the potential of Metaphysics' NPT, the Artificial Intelligence tools of the Spanish company Generative Suite that with your proposal Magnificent allowed increasing the resolution of the images.

Created by Javi Lopez y Emilio Nicolas, Magnific achieves an advanced AI upscaler and unenhancer capable of effectively reimagining much of the image details, guided by a series of cues and parameters. Its results are evident in Here with a masterful result.

https://www.youtube.com/watch?v=11rXdSI5XqQ