Stable Diffusion- Training SDXL 1.0 - Finetune, LoRA, D-Adaptation, Prodigy

Stable Diffusion- Training SDXL 1.0 - Finetune, LoRA, D-Adaptation, Prodigy

kasukanra via YouTube Direct link

Intro

1 of 44

1 of 44

Intro

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Stable Diffusion- Training SDXL 1.0 - Finetune, LoRA, D-Adaptation, Prodigy

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Overview of SDXL 1.0 and SD 1.5 models
  3. 3 Dataset Overview
  4. 4 Short explanation about my ComfyUI node setup
  5. 5 WAS Node Suite text concatenation
  6. 6 CLIP G and CLIP L
  7. 7 CLIPTextEncodeSDXL
  8. 8 Naive local finetuning with Adafactor
  9. 9 How to fit finetuning settings into 24 gb VRAM consumer GPU
  10. 10 Local finetune with Adafactor settings
  11. 11 Min SNR Gamma paper
  12. 12 Installing local Tensorboard to view event logs
  13. 13 Runpod overview
  14. 14 How much Runpod costs
  15. 15 Runpod finetune settings
  16. 16 Weights and Biases overview
  17. 17 Determining the initial learning rate for AdamW finetune
  18. 18 Adding a sample prompt to training settings to visually gauge training progress
  19. 19 Checking AdamW finetune sample images
  20. 20 Efficiency nodes for XY plot
  21. 21 How to retrieve your models from Runpod
  22. 22 Evaluating finetune XY plot
  23. 23 D-Adaptation overview
  24. 24 D-Adaptation training settings
  25. 25 Decoupled Weight Decay Regularization paper
  26. 26 What does weight decay do?
  27. 27 Betas and Growth Rate
  28. 28 drhead's choice of hyperparameters
  29. 29 LoRA network dimensions and alpha
  30. 30 Tensorboard analysis for D-Adaptation LoRA
  31. 31 D-Adaptation sample images analysis
  32. 32 Prodigy repository
  33. 33 Prodigy training settings
  34. 34 How to enable cosine annealing
  35. 35 Prodigy training settings version 2
  36. 36 Prodigy code deep dive
  37. 37 Why I didn't use any warmup for Prodigy training settings
  38. 38 Weights and Biases analysis for Prodigy
  39. 39 Prodigy sample images analysis
  40. 40 Prodigy XY plot
  41. 41 Prodigy AdamW and Higher Weight Decay analysis
  42. 42 Prodigy final version XY plot
  43. 43 Closing thoughts
  44. 44 CivitAI SDXL Competition

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.