HOME | DD

Published: 2023-12-25 19:51:04 +0000 UTC; Views: 550; Favourites: 1; Downloads: 0
Redirect to original
Description
Check here to see full article > medium.com/@furkangozukara/dre…
It was requested of me to test ground truth Regularization / Classification images effect during Stable Diffusion XL (SDXL) DreamBooth training.
So for this experimentation I have used an anime SDXL model name as : Starlight XL 星光 Animated V3.
I used the configuration I shared here currently. It has been discovered after 120 different full trainings experimentation : www.patreon.com/posts/very-bes…
Hopefully I will make a full big tutorial of DreamBooth training and show all the settings.
For training Kohya SS GUI is used. If you don’t know how to install and use Kohya SS GUI here the tutorial you need > youtu.be/sBFGitIvD2A
And here is the tutorial that shows how to use shared configuration both on Windows and RunPod > www.youtube.com/watch?v=EEV8RP…
So I used the below images as training images dataset.
This training dataset is at best medium quality because it has repeating backgrounds, repeating clothing and missing fully body pose.
Then for training configuration I did the following.
When training with regularization images, I did 1 epoch and 150 repeating. So more regularization images are used. And saved checkpoints at every 30 epochs. To make it that way calculate the number of steps you need to save. It is easy. 15 * 30 * 2 + 1
When training without regularization images, i set the repeating 1, trained up to 150 epochs and saved checkpoints at every 30 epoch. That is also why model names has different format. One has epoch number 1 has steps number.
I have used ultra high quality manually picked Unsplash real images having man dataset as regularization images dataset. This means they were ground truth regularization images like how Stable Diffusion was initially trained.
You can download dataset from > www.patreon.com/posts/massive-…
5200 images for both man and woman. Perfect quality cropped and resized to many common resolutions.
All training images and reg images were 1024x1024 pixels.
I used the 275 Fooocus amazing styles file to generate images with models so that I could pick later on.
You can find styles file (styles . csv) and styles file generator script here : www.patreon.com/posts/all-amaz…
I saved both After Detailer (ADetailer) before and after images. So some images are ADetailer used and some not. This is in settings panel to set both. For after detailer I used 0.7 inpainting denoise and 80 steps manually set. Improves quality.