Generating Avatar in landscapes

I recently played around with image generation to create this : And also did my avatar with it :

Making it

Online (not available anymore)

Something used to available online here with everything ready here : Illusion Diffusion | AI Playground | fal.ai

Self-hosted

The idea is to leverage :
  • Stable Diffusion on your own mac / PC
  • A QR Code optimized model
  • Take a highly contrasted image for controlnet
  Stable Diffusion Today the most common UI to use is : AUTOMATIC1111/stable-diffusion-webui You will need to install the controlnet extension here as well : Mikubill/sd-webui-controlnet QR Code optimized SD + controlnet models You can find 2 here (that use the same stable diffusion model, but different controlnets) : To install, DL all files (you can git clone the repo) and :
  • move control_ files on the controlnet models folders
    • <stable_diffusion_install_folder>/models/ControlNet/
  • move diffusion_ files on the SD models folders
    • <stable_diffusion_install_folder>/models/Stable-diffusion/
Prepare controlnet image In the example of Datadog, take the original logo and create a very contrasted version (Preview for mac is enough for that) : becomes Another example with my face : ->
Scary but working
 Putting all that together