All language subtitles for 8. ControlNets for Stable Diffusion 1.5 Depth Map Exercise

So let's see how to create a control net from scratch inside of stable diffusion 1.5 so

So we've got loading up here the dreamshaper 7

Checkpoint and we've got a Mayan or Aztec pyramid in overground Jung

Sunset it's going to be a 512 by 512 image and at the rest of it you can see here now what

What will do is to apply the control net so we need to first of all input an image so

Say add load up and we need to get an image

Okay let's try to double click

And we can choose load image

And that's fine so we'll need to change this so I'll just make sure I

Locate the right directory

So we'll bring in our Aztec Temple and this is going to

I need to be processed by preprocessor so we'll just go ahead and open up preprocessor and

And if we go to preprocessors you can see we've got a number of maps there will choose

Play Les rezz

Depth map

And from the depth map we can go straight to the

We can output to an image so we can say image preview

What preview image

And we can bring that down here

Make that about the same size as the original image

And then we need to connect this to the control net

So we'll grab this and bring it out here and it's going to be a little bit difficult maybe to

Define control net so what we'll do is double click and choose control net

Control net apply

Go ahead and drag the image to the image that

And we can go ahead and apply the conditioning

Pause that for a second what I want to do is to

Load the other control net so we need a load control net

Option let me just move this up there for the time being

Load control net model so there's two options load control net model and

Remote control net model diff which sometimes

Is needed

We'll go for the load control module

Because we need the depth one we'll go ahead and choose depth

And we can bring this guy here

Go ahead and disconnect up this guy with this guy

If we run this what will happen is that we should get the

The depth map showing up here

And maybe you can see the the way the things are connected a little bit easier now

But we're still not getting the thing applied according to the control is pretty good but we're not getting it controlled by

What's the according to the to the control net so what we'll do is go ahead and take the app

Play control Nets and

First of all I think we'll link the text

And then link the out text to the positive

And then we'll try again

Accidentally applying the control Laura rather than control net so we'll choose the

Connect control net and I think it's this one no I want to go for the

41 so we'll go

For this guy here sd-15 depth now this should work

Let's run that

It's going to be using this particular image to

Make the the image here and we've got a strength of one and I have an old

What's the depth map at all so that's something that I could play around with to see how

How different it could be now you can see that the result is broadly speaking as we would

I want maybe I can make that a little bit brighter let's make that

Afternoon

Awesome so you can see that that's the result we got there and the resemble resemblance is pretty clear between the

The original the

Depth map and the outcome here so that's how you would go about doing it from scratch

I will share this with you

For this tutorial this will be a resource and I think this could perhaps be something you

Maybe go ahead and refer to if you need to set up more control Nets it's a fairly straightforward process

And the main thing is just to make sure you get the control net correct otherwise you'll get that weird

Error message coming up now the other thing is the The Prompt plays

Really significant role so if we were to change this to

Maybe we could put in tourists

National Geographic photography

The only thing you'll see is just how quick it is when using configure it is so quick

To complete everything okay we haven't got the tourist but maybe that's a good thing so we've got our overgrown jungle

And something for a little bit photographic maybe a little bit more work to do to get it to be full

Play photographic but you can see how easy it is to create a control net

And to use that for your comfy UI exploits now there are so many other control

Unless it's generally relatively easy to find which one goes with

Which other processor so obviously when you are working

I don't like this you are going to need to figure out which processor to use we could for instance there's no way

Changing these ones are in place so we could

Double click

Depth and we could try the Zoe

Processor

See if that works

So basically using a little bit of

Intelligent guesswork

And making sure everything is connected so that's connected up

So that one just froze without any kind of error message so we go to view Q

We trying to cancel that one

End of the council doesn't work we will stop the software running in the background using the command prompt

So I went ahead and replaced it using the Midas depth map let's connect that one

Finally to the control map so that was obviously not working and intelligent guess what will get you so far

Please control this but it's not 100% perfect let's see if we can get this

Connected

And sometimes it won't cancel and that's that can be a real pain sometimes what I will do when

When I'm having trouble getting it to cancel I'll hit control a on the keyboard to select everything and then

Control m

To just pause everything what that does sometimes it will interrupt the flow but it's only really works to inter

Update if something is Flowing if it's actually moving forward in a positive way so what I'm going to do

Instead is to I'm going to hit control M again

Re-establish everything dot dot control em just deactivates everything anything you've got selected

Deactivated and control M will reactivate it again clicking away will get rid of the selection

Opening up the Q

Just going to the queue

The View queue

Hidden cancel sometimes that works sometimes it doesn't work that's a real Quirk inside of

How come you are and in that situation you have to stop it outside using the what I hate to do using the

Play using the command prompt so what I would do in this situation if I can't get it to work I'll stop

Open outside and then restart and then we'll try to see if it works with the might just one

And we obviously lose our history every time we restart the the the the the

Play command prompt and that's a bit of a pain but I did remember where we were so we can now try to run the

The software again and it seems to have worked so this one here Works a little bit differently from the other

But both of these ones will work as preprocessors and also remember you can bring in

Turn your own image so you can bring in your own death Maps as well so one possibility will be to create a depth map

Stop in software like Dimension Adobe dimension for instance so here

Add protein an image from Adobe Dimension is a depth map from Adobe Dimension we won't need this

What's processor here for for this particular edit so we can just connect this straight to the

Control net and we could then try to see what happens if we apply this control

With this particular

Prompt see if it does anything interesting it's got oh it's actually processed it but it's

It's not going to actually use this preprocessor image but we might actually use this preposterous

So there you've got some letters that

Spell out to certain word being used as a kind of a paramedical form I'm going to just go ahead and

Actually go ahead and connect from here again because I think the pre-process that did a really really good job

Let's go ahead and try to bring a bit more lights here

And using the pre-processed image this time you can say it's very very fast inside of coffee

Real serious delay this is an amount of 20 that we're using for the steps

Andy gets done pretty quickly

So that looks brilliant and I can think of all sorts of all sorts of

Interesting outcomes that we could have for that if I was to change this maybe to lettering because this is actually

Play a letter

Letter form

And instead of keep it a bit more simple just say it

Mayan temple in bright letter

Notorious cuz they never appeared do they

And then let's go and see what that looks like

And that's the outcome so that's the this is actually the from

I'm a thumbnail that I created so it's the 7950 XT 3D

It's kind of working with the lettering to produce a very interesting result there so you can play around with

Depth maps that you've got already or you can create depth maps using things like the Midas depth map

A little bit of intelligence work does go a long way and you can use these these

Control Nest to produce all kinds of interesting images what I'm going to suggest is Maybe

Go down to canva download a few images that you want to play around with some scribbles

Some some things that would have good depth information in them and then just play around with it see what sort of results