The Mask of Time

2021 – 2022

Artificial Intelligence, 3D creation and modelling, sound design and fashion, interwoven with the Fondazione Giorgio Cini heritage of collections and archives have given rise to a highly original work of art: The Mask of Time. This audiovisual work by Mattia Casalegno and Martux_m raises awareness of the need to enhance the Teatro Verde.

Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time

èquipe

the project

Commissioned by Vittorio Cini and inaugurated in 1954, the open-air amphitheatre designed by architect Luigi Vietti (1903-1998) has often been an important cultural venue in Venice and has hosted excellent productions of the performing arts. In 2021 the theatre was the subject of a major restoration project that, thanks to a partnership with Cartier,  brought its architecture back to life and made the most of all the qualities of the building materials, the surrounding greenery, the fascinating spaces and the stunning landscape views.

To enhance this beautiful theatre and relaunch its leading creative role, Fondazione Giorgio Cini invited Mattia Casalegno, one of Italy’s most successful digital artists based in New York, to create a work that would showcase the beauty of the theatre starting from the photogrammetric acquisition carried out with drones by Factum Foundation, an institutional partner of ARCHiVe. Curatorship is by Ennio Bianco.

In The Mask of Time, the architecture and history of the Teatro Verde have been brought back to life in a world inhabited by hyper-realistic avatars, made through the creative use of pioneering 3D animation and text processing software, combined with sound designed by Maurizio Martuscello aka Martux_m. The avatars will become actors performing the theatre’s great historical productions. Photorealistic digital human beings are immersed in real sets as well as dreamlike environments in a post-human sci-fi world, somewhere between fiction and representation, in which Nature and Art breathe and flourish. The narrative unfolds through intense imagery in four acts on the subject of the Teatro Verde: History, Performances, Present and Future. It thus explores themes such as teatri di verzura (garden theatres), the golden age of the amphitheatre, and its dialogue with Nature, both dominated and dominating and now a creative force cooperating in the theatre’s new lease of life.

© Fondazione Giorgio Cini
© Fondazione Giorgio Cini
© Fondazione Giorgio Cini
© Fondazione Giorgio Cini
© Massimo Pistore for Fondazione Giorgio Cini

objectives

Mattia Casalegno’s work starts from the idea of theatre as a place of fiction and representation. Situated at the intersection between Nature and Culture, it explores the relationships and tensions that unite the natural environment, the human world, and technologies.

The project starts from the notion that people interact with the world through multiple sensory streams: we see objects, hear sounds, read words, feel textures, taste flavours, combine information, and form associations between the senses. Similarly, real-world data is made up of various signals occurring simultaneously, such as video frames and audio tracks, web images, captions, and voice tracks. Casalegno adopts this common logic in the creation of the multimodal work The Mask of Time.

In The Mask of Time, thanks to a combination of in-depth archival research on material held by the Fondazione Giorgio Cini’s Institute of Theatre and Opera and the innovative application of Artificial Intelligence with the visual power of new kinds of software, the architecture and the history of the Teatro Verde have been brought back to life in a world inhabited by hyper-realistic avatars. Fundamental is also the creative use of pioneering 3D animation and text processing software, combined with sound designed by Martux_m and the costume designs of the 3D garments by Amin Farah. All of these competencies are perfectly blended into a single artistic meta-language.

documents + technologies

1.

The Institute of Theatre and Opera provided over 10000 images of stage designs and performances held at the Teatro Verde, including photos of costumes from the plays on the Greek myth of Pasiphaë and the Minotaur to the Goldonian Commedia dell’Arte.

2.

Factum Foundation provided a complete survey of the Teatro Verde by making expert use of drones for the photogrammetry as part of the 3D digitisation project of the Island of San Giorgio.

3.

Mattia Casalegno was thus able to move some high-definition realistic human-digital actors within the space of the virtual Teatro Verde, created using the Unreal Engine MetaHuman Creator and the Reallusion Character Creator.

4.

MetaHuman Creator is a software enabling the designer to create photorealistic digital human beings. The character is refined by sculpting tools and control guides to achieve infinite variations in facial and body features.

5.

Character Creator 3 allows the designer to easily create and customise realistic subjects for use in the Unreal Engine and Unity platforms, combining 3D character generation, animation, rendering and interactive design in a single system. It thus allows 3D scanning technology, produced by Scanlab Photogrammetry and adopted from Hollywood game productions, to be applied to a stationary person to create a fully clothed speaking character moving freely in space.

6.

These digital human actors, or hyper-real avatars, can thus move or be fixed in digital tableaux vivants within a virtual theatrical spatiality, made possible by Unity Technologies Unity software.

future developments

In the future it will be possible to draw on all the materials used for this video, for example, to recreate paths inside the Teatro Verde enabling audiences to converse with characters generated in augmented reality, or to offer an interactive virtual tour experience of the Teatro Verde in a metaverse.