a work by arturo tedeschi

Artificial intelligence meets movie storyboarding

Artificial intelligence meets film storyboarding in Arturo Tedeschi’s last work. The generative customs AI system DALL·E, the Italian artist translated descriptive texts inspired by famous films into rich, colorful and impressively detailed images.

‘The art of storyboarding deserves attention not only because of its graphic quality, technique or speed, but as a creative bridge between screenplay and film or, if you prefer, as a link between language and image. AI systems went beyond the ‘traditional’ process of creating high-resolution images from a training set of pre-existing images. Sophisticated systems like DALL·E have learned the relationship between image and text used to describe them,’ writes Tedeschi.

Featuring storyboard texts inspired by films like “Pulp Fiction” and “Back to the Future,” the project demonstrates how new, meaningful possibilities can be unlocked using this immersive technology.

using AI, arturo tedeschi turns storyboard texts into eye-catching images

(Manhattan W.Allen) ‘ab/w scene of a man and a woman sitting on a bench, in New York, Queensboro bridge in the background, misty atmosphere’

from ‘manhattan’ to ‘pulp fiction’

Tedeschi (see more here) created the first image with text describing a famous scene in Woody Allen’s masterpiece, “Manhattan.” The description reads as follows:A b&w scene of a man and a woman sitting on a bench, in New York, Queensboro bridge in the background, misty atmosphere.’

Jumping back to AI, the artist asked: DALL E to work as a storyboard artist using the description selected above; to complete the toolkit, Tedeschi threw in some photos of the Queensboro Bridge to better depict the scene. The resulting images were taken in 15 seconds.

It’s very interesting how the AI ​​combines ‘archetypal’ concepts (man, woman, sitting, couch) with elements derived from using real-world descriptions: the phrase ‘Queensboro bridge’ that was triggered – along with generating the bridge itself – realistic and specific urban details such as trees, skyline,’ he commented.

artificial intelligence meets movie storyboarding 3
(Pulp Fiction) ‘a sketch of a woman with big blue eyes, thin nose, red lipstick and black bob with fringes, dressed in a white shirt, sitting at a table, drinking a milkshake through a straw’

As a second experiment, Tedeschi tried to describe the fictional character Mia Wallace from ‘Pulp Fiction’ with the following description:a sketch of a woman with big blue eyes and black bob with bangs sitting at a table drinking a milkshake through a straw, American bar background.’

The first iteration generated a naive outline that was surprisingly enhanced by adding a few more details:a sketch of a woman with big blue eyes, thin nose and black bob with fringes, wearing a white shirt, sitting at a table, drinking a milkshake through a straw, American bar background’

Using “serious woman” and adding “with red lipstick” and “white shirt” was enough to get a few sketches closer to the original character.

artificial intelligence meets movie storyboarding 6
(Once Upon a Time in America) ‘an oil painting of a street with red buildings on both sides and the giant Manhattan Bridge in the background, central perspective, human silhouettes’

The investigation continued with scenes from other films such as ‘Ex Machina’, ‘Once Upon a Time in America’, ‘Blade Runner’ and ‘Back to the Future’. Tedeschi concludes by writing: ‘The results showed that AI can immediately be used as a powerful and fast companion to visualize ideas. In the future, systems like DALL-E are likely to be integrated into the design process. AI is more than a tool, it will probably expand our capabilities and the way we create things, without taking over the human creative process.”

artificial intelligence meets movie storyboarding 8
(Back to The Future) ‘an oil painting of a Delorean dmc12 struck by lightning, dark city background, wet road’

artificial intelligence meets movie storyboarding 9
(Back to the future)

Leave a Comment

Your email address will not be published.