Self-Attention Guidance can drastically improve fine details

[lendrick]

This is a new type off guidance that replaces CFG scale and seems to improve the coherence of fine details quite a bit. I'd love to see what this can do with better weights than vanilla SD.

Example: https://imgur.com/a/zypdU5D (Top image was run at CFG scale 10. Bottom image has SAG enabled; note how much cleaner the details are.)

Github: https://github.com/SusungHong/Self-Attention-Guidance

Paper: https://arxiv.org/abs/2210.00939

Huggingface demo: https://t.co/LnkSiwSCnx (They picked a weirdly low default CFG scale of 3, but details are still better even set at the max of 10)

Diffusors implementation: https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_sag.py

[ghost]

This could improve controlnet generations

[lendrick]

Personally the issue I'm having a lot of the time is that background details in some images tend to be indistinct and nonsensical, and it seems like this could fix that issue.

[beyondarmonia]

It's crazy no one has implemented this yet. The improvement from my testing seem drastic.

[kgonia]

Hi @beyondarmonia
Did you succed with your implementation?

[catboxanon]

https://github.com/ashen-sensored/sd_webui_SAG

[catboxanon]

Open an issue on the repo page, I'm not the one who made this.

[kgonia]

I just misread repo, It's working. I'm already testing. Comparision on reddit soon.

[elen07zz]

how i install it, I try following the instructions:

run the following command in root directory stable-diffusion-webui/:

git apply --ignore-whitespace extensions/sd_webui_SAG/automatic1111-CFGDenoiser-and-script_callbacks-mod-for-SAG.patch

im getting this error
error: patch failed: modules/script_callbacks.py:53
error: modules/script_callbacks.py: patch not applied

[Sakura-Luna]

The default version is not compatible with older versions of webui, so I packaged a compatible modified version and it now works out of the box on my fork.

[kgonia]

@elen07zz
cd /extensions
git pull https://github.com/ashen-sensored/sd_webui_SAG.git

tehn you can make git apply