Instruction-based image editing

0:00 If you want, you can even load in pose references or dress your character using the virtual tryon section of the workflow. All of this is based on entirely free open source models that you can run on your own computer. And by the end of this tutorial, you'll know how to create perfectly realistic humans or stylized characters, how to train your own Laura models of these characters if necessary, and how to generate extremely realistic and perfectly consistent HD or even 4K videos of your characters all locally on your own computer.

0:47 So, make sure to subscribe and let's get started. All right. So, this is made possible by the new instructionbased image models like Seedream 4 or Nano Banana by Google. These models let you input one or multiple images and then say something like, "Hey, show me a side view of this character or put this character in this scene." And this works really well, but these tools are heavily censored. Generating images can be a bit tedious and it can get expensive since these are closed source commercial tools.

1:11 So, let's look at the free option, Gwen image edit. This is an open source model by Alibaba, and it lets you merge different characters into one scene, put characters in all sorts of different backgrounds, make them wear all kinds of clothes, or even extract poses from one image, and then apply them to your characters. Here, I'm using my free Gwen image edit workflow for Conf UI. And I'm going to show you how to set it up in a minute.

1:34 But first, let me show you how easy it is. All you need to do is just drag and drop in the images that you want to reference. So let's say we want to marry these two characters. And maybe you remember this guy. This is Hans Schmankal from my first ever consistent character tutorial. And then you just need to connect them to this text and code note here like this. And then you can write a simple prompt in natural language.

1:57 They are holding hands. Getting married. Wedding photography Pixar style. Let's do that. This worked perfectly. They're holding hands. And now let's make them kiss. I just change out the prompt to create an extreme close-up of the faces. The characters are kissing. And now I'm going to use only one reference, the image that we just created. Let's see what happens. Well, that's an awkward kiss. Eyes are closed. Okay, that's much better. So, you can see how easy it is to create like entire stories using this technique.

2:20 For realistic characters, this will work as well, but you can see it still has a little bit of that plastic AI look. I'm currently working on fixes for that, but in most cases, training a custom model for your character, Allora, is still the best way for maximum quality and character consistency. It also gives you flexibility with the model you want to use for generating images or videos, which is something that this model when image edit can't do, of course.

2:43 So, I've built this automated workflow for a