Stable Diffusion

4337 readers

2 users here now

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

founded 2 years ago

MODERATORS

[email protected]

What models can we use for img2img today? (lemmy.dbzer0.com)

submitted 2 months ago by [email protected] to c/[email protected]

1 comments fedilink hide all child comments

I'd like to fine tune a model that does img2img with a text prompt to guide the output. I think img2img-turbo might be the closest to what I'm after, though by default it uses a fixed prompt which can be made variable with some tweaking of the training code.

At the moment I only have access to 24GB VRAM which limits my options. What I'm after is training a model to make specific text-based modifications to images, and I have plenty of before to after images plus the modification text prompts to train on. Worst case, I can try to see if reducing the image size during training makes it possible with my setup.

Are there any other options available today?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 2 months ago

I found this guide on how to make an inpainting model out of any model. Though it's pretty out of date.