Using the Image Prompt Adapter (IP-Adapter)

Modified on Fri, 09 Feb 2024 at 09:01 PM

The Image Prompt Adapter (IP-Adapter) is a feature that allows you to inspire a new image with the content of an image.


While the Image to Image process uses the color and structure to guide the denoising process with your text prompt, the Image Prompt Adapter uses the concepts that the AI can detect in your imagery to inspire new content. This can be a great way to control the diffusion process when you don't know how to articulate or put a visual concept into words - You can let the system do that for you.


A Weight of 1 will strongly enforce the concepts of your Image Prompt - It's typically advised to reduce the weight to between .3-.6 if you are attempting to use a Text Prompt alongside your Image Prompt. Image Prompts will also inherit a large number of the model characteristics - If you are using an Art model like Invoke's Fantasy & Art model, you'll find outputs to be more artistic in nature. 


Image Prompt


Text Prompt


a deer in a glade


Image Weight .25
Image Weight .5
Image Weight .75
Image Weight 1





Took see the Image Prompt Adapter in action, take a look at the video below (starting at 9:10):





Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select atleast one of the reasons

Feedback sent

We appreciate your effort and will try to fix the article