Try size: 768 x 1024
Weights: 0.8~1
Clip skip: 2
Training material from bing
Pictures from OOO_v80
Note: The orca is more interesting as example images, so provide trigger words. I believe the new parameters can make it more stable. For OOO, the "Debiased Estimation loss and AdamW and constant_with_warmup" are better. (OOO)
(Actually, the name aquarium could cover a wider range. I hope you don’t mind whether it is a dolphin. Dolphins account for about 70% to 80% of the training material).