mirror of
https://github.com/leejet/stable-diffusion.cpp.git
synced 2026-11-11 11:26:34 +00:00
updated README.md to include instructions and notes for running PhotoMaker
This commit is contained in:
1 parent
464f1f8d8b
commit
4b31b75ebd
1 file changed
+29
@@ -296,6 +296,35 @@ You can use ESRGAN to upscale the generated images. At the moment, only the [Rea
|
|||||||
sd -m ../models/v1-5-pruned-emaonly.safetensors -p "a lovely cat" --upscale-model ../models/RealESRGAN_x4plus_anime_6B.pth
|
sd -m ../models/v1-5-pruned-emaonly.safetensors -p "a lovely cat" --upscale-model ../models/RealESRGAN_x4plus_anime_6B.pth
|
||||||
```
|
```
|
||||||
|
|
||||||
|
#### Using PhotoMaker to personalize image generation
|
||||||
|
|
||||||
|
You can use [PhotoMaker](https://github.com/TencentARC/PhotoMaker) to personalize generated images with your own ID.
|
||||||
|
|
||||||
|
**NOTE**, currently PhotoMaker **ONLY** works with **SDXL** (any SDXL model files will work).
|
||||||
|
|
||||||
|
Download PhotoMaker model file (in safetensor format) [here](https://huggingface.co/bssrdf/PhotoMaker). The official version (in .bin format) does not work with ```stablediffusion.cpp```.
|
||||||
|
|
||||||
|
- Specify the PhotoMaker model path using the `--stacked-id-embd-dir PATH` parameter.
|
||||||
|
- Specify the input images path using the `--input-id-images-dir PATH` parameter.
|
||||||
|
|
||||||
|
Another relevant cli parameter for PhotoMaker:
|
||||||
|
|
||||||
|
- ```--style-ratio (0-100)%``` default is 20 and 10-20 typically gets good results. Lower ratio means more faithfully following input ID (not necessarily better quality).
|
||||||
|
|
||||||
|
Other parameters recommended for running Photomaker:
|
||||||
|
|
||||||
|
- ```--cfg-scale 5.0```
|
||||||
|
- ```-H 1024```
|
||||||
|
- ```-W 1024```
|
||||||
|
|
||||||
|
If on low memory GPUs (<= 8GB), recommend running with ```--vae-on-cpu``` option to get artifact free images.
|
||||||
|
|
||||||
|
Example:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
bin/sd -m ../models/sdxlUnstableDiffusers_v11.safetensors --vae ../models/sdxl_vae.safetensors --stacked-id-embd-dir ../models/photomaker-v1.safetensors --input-id-images-dir examples/scarletthead_woman -p "a girl img, retro futurism, retro game art style but extremely beautiful, intricate details, masterpiece, best quality, space-themed, cosmic, celestial, stars, galaxies, nebulas, planets, science fiction, highly detailed" -n "realistic, photo-realistic, worst quality, greyscale, bad anatomy, bad hands, error, text" --cfg-scale 5.0 --sampling-method euler -H 1024 -W 1024 --style-ratio 10 --vae-on-cpu -o output.png
|
||||||
|
```
|
||||||
|
|
||||||
### Docker
|
### Docker
|
||||||
|
|
||||||
#### Building using Docker
|
#### Building using Docker
|
||||||
|
|||||||
Reference in new issue
Block a user