← All work

Agentic AI · Prototyping

Agentic AI VFX asset generation

Studios need large libraries of 2D VFX elements. I prototyped a Griptape workflow that generates them with alpha channels, so compositors can drop them straight into a shot, utilising AI without affecting the original plate.

The fx_generator Nuke Gizmo and its Griptape node graph, with a generated fire element composited into a woodland plate

The challenge

During Griptape demos, a common issue clients raised was needing a large library of 2D VFX assets. These were either time-consuming to build internally or costly to buy from third parties, and clients asked how AI could be used to generate them instead.

What I did

I designed a prototype agentic workflow in Griptape that combines image and video generation models to create 2D visual effects with accompanying alpha channels. The elements can be composited into shots in the traditional way, without affecting the original plate.

I exported the workflow as a Nuke Gizmo to show how compositors can use it without ever needing to open Griptape.

I also created a video to showcase the workflow and added it as an example in the Griptape intro deck.

Outcome

The video has had 6.6k views, with higher than average audience retention. The workflow has had a positive response both internally and from clients, and I’ve been invited to present it at the ACM Rainbow Conference.

The FX_generator workflow in Griptape Nodes, with image prompt, video prompt and alpha generation groups feeding the Nuke end flow
The FX generator workflow in Griptape Nodes. Click to view full size.
Generated dust element in colour
Alpha channel of the generated dust element
ColourAlpha
Drag to compare the generated element with its alpha channel.