WEBVTT

00:00.000 --> 00:03.291
Welcome to AI for visual effects,
I'm Doug Hogan.

00:04.000 --> 00:07.125
In this video, I'm going to walk you
through a powerful workflow

00:07.125 --> 00:09.916
for generating visual effects utility passes

00:09.916 --> 00:13.083
directly from your footage
using ComfyUI.

00:13.458 --> 00:16.208
This workflow gives
you multiple ways to generate mattes,

00:16.208 --> 00:19.291
including facial features for beauty work,

00:19.333 --> 00:24.791
as well as depth and normals passes,
all inside a single workflow.

00:24.791 --> 00:28.750
In visual effects production
utility passes are essential, but they can

00:28.791 --> 00:30.666
sometimes be a bottleneck.

00:30.666 --> 00:35.791
They take time, can be very manual,
but this workflow solves that.

00:35.833 --> 00:39.250
You can choose from three
different methods to alpha generation

00:39.250 --> 00:41.041
and temporality,

00:41.041 --> 00:43.833
stable normals and depth pass generation.

00:43.833 --> 00:45.750
Everything starts
with your source plate.

00:45.791 --> 00:49.416
Upload the footage the workflow, extracts
its resolution and frame rate

00:49.416 --> 00:53.666
and applies those settings that across
the entire graph using git and set nodes.

00:53.708 --> 00:56.708
From there,
we branch into different utility outputs.

00:56.708 --> 00:59.708
The first option is RMBG.

00:59.916 --> 01:03.000
This is prompt based background removal.

01:03.000 --> 01:06.583
You describe the subject
you want to isolate and it generates

01:06.583 --> 01:08.208
a matte automatically.

01:08.208 --> 01:13.375
This is a very fast solution, great
for simple shots and quick slap comps,

01:13.375 --> 01:17.791
but it can break down when elements
overlap or motion gets complex.

01:17.791 --> 01:21.166
So next is Sam 3
using the text prompt.

01:21.166 --> 01:25.791
This is similar to RMBG
but gives you more control under the hood.

01:25.791 --> 01:29.041
We load the model, run
segmentation on the footage,

01:29.041 --> 01:32.708
and then propagate
that mask across the entire shot.

01:32.708 --> 01:37.208
So instead of road wing frame by frame,
we'll just let the model do it for us.

01:37.208 --> 01:40.083
This is ideal for specific moving
characters,

01:40.083 --> 01:44.583
medium complexity shots, and anything
where consistency matters.

01:44.666 --> 01:48.958
Third, the most controlled option
the Sam 3 points editor option.

01:49.000 --> 01:52.833
Here you can define positive points
with a left click and negative points

01:52.833 --> 01:54.125
with a right click.

01:54.125 --> 01:57.166
Think of this like crypto mattes
for live action footage.

01:57.708 --> 02:00.041
Use this
for when prompts just aren't enough

02:00.041 --> 02:03.375
and you need precise control of your matte
creation.

02:03.416 --> 02:07.041
Finally, if you have footage
that will need beauty work in comp,

02:07.041 --> 02:11.750
you can use face segment RMBG
to generate mattes

02:11.750 --> 02:14.916
for important facial landmarks.

02:14.916 --> 02:19.916
On top of alphas, this workflow
also generates depth and normal passes.

02:19.916 --> 02:21.500
These are key elements

02:21.500 --> 02:26.000
for relighting integrating CG elements
into live action footage.

02:26.041 --> 02:30.208
Also, this workflow includes an app mode,
so if the node graph

02:30.208 --> 02:33.625
feels overwhelming, you can use this mode
to upload your footage,

02:33.625 --> 02:36.750
enter your prompt,
set your points, and run it.

02:36.791 --> 02:40.708
It will then run all the options
available in the comp.

02:40.875 --> 02:43.375
Same results, much simpler workflow.

02:43.375 --> 02:48.416
At the end of this you've got production
ready, utility passes, super fast alphas,

02:48.416 --> 02:51.000
stable depth, and normals.

02:51.083 --> 02:55.000
All generated directly
from your footage inside ComfyUI.

02:55.291 --> 02:55.958
Thanks for watching.