playground-v2-512px-base-anime-finetune

playground-v2-512px-base-anime-finetune■This is an experimental fine tuning.I trained using onetrainer.I would like to share the possibilities of playground v2 512px base with everyone.It is the same as SDXL, so you can download it and use it immediately.The advantage of this model is 512px, so I thought it would be ideal if you want to train SDXL architecture but have problems such as lack of VRAM.Fine tuning is done at 512px.An advantage is that there is no need to prepare a 1024px dataset. You can use the dataset that has been used in SD1.5 so far, so it is less burdensome.Training time can also be reduced.1024px eats up training time, cache time, cache space, VRAM, hard disk, etc...It's 4 times faster than 1024px. I'm sorry if my calculations are wrong... Learning is fast and fun since you can get the benefits of SDXL architecture even at low resolutions.I think this model may be a good choice for those who want to use the SDXL architecture but feel that the generated size of 1024px is too large or want to generate at 512px.This model may have potential.Please be careful as sexual images are also generated.There are cases where the look of something realistic or AI comes out strongly.It might be a good idea to add "realistic" to the negative prompt.On the other hand, it might be fun to try something other than anime.New discoveries are made in areas that were not originally intended.If you have created your favorite image, please share it with us!It's okay not to expect perfection too much.This model is still immature.The broken results are more interesting!It would be interesting to generate various tags using something that can automatically generate tags.■The standard size for this model is 512pxA ratio like 512x768 like SD1.5 is suitable.768px 1024px is not trained, so the result will be disastrous.If you set it to a large size when doing i2i, it will fail.The limit would be 1.5x magnification and denoise 0.5.I like dpmpp_sde step:12 cfg:3-5.　Euler a is also stable and good. The generation speed will also be faster.■Added a merge model with stable quality.I extracted the difference between playground-v2-1024px-aesthetic and the pre-training model and merged it with + 0.5.Other than 512px has also been improved to improve stability when scaling up with i2i.Although the style and tag recognition rate will change, the aesthetic aspects are also enhanced, so we recommend this if you find the original model difficult to use.There is no problem even if the cfg is around 3. If the color is dark, please set the value lower.It's a lot more fun than I expected.When it comes to sexual things, the original model is more likely to respond.It may be fun to search for the ideal combination on your own.The image may be a little blurry and you may need to sharpen it by upscaling or other means.■Added a model that merged 0.4 text encoder of anime-xl-3.1 to v0.0_aesthetic.A detailed explanation is written in the v0.0_aesthetic_TE tab.It's very experimental, so I can't recommend it with confidence, but if you're interested, please give it a try!Who does the character in the sample image look like? lol!■There is no consistency in style.The quality is poor and there are no fixed settings or prompts.It has no advantage over existing models and has a narrower dataset.The advantage is that it is lightweight.If you notice any other benefits, please let me know.■I am training with the danbooru tag.A small number of tags will produce a disastrous result.The tags that are often used in danbooru and SD are the quality tags for this model.We are only learning general tags such as 1gril, and we are not training artist or anime work tags.I would be happy if you could give me your opinion on what datasets I would like to have if I continue training in the future.The order of tags is important. Every tag has a unique image.The more popular the tag, the better the quality may be, but the image will be reflected more strongly, so it is also effective to offset it with other tags or change the order to dilute it."Looking at viewer" can easily be of high quality.I'm training without adding the "nsfw" tag, but I feel like it's effective for some reason...■It's an incomplete and very difficult model, but if you're interested, please give it a try. I'm not very good with prompts, so if you can generate interesting results, please share them so I can make this model even stronger.Your feedback will motivate us to train on a wider range of datasets.There are still tags that have not yet been learned, so more diverse expressions will be possible.■I've added the comfyui workflow that I'm using for generation tests.It consists of steps up to 1.5x magnification and i2i.It doesn't matter what software you use, please try out various software and generate it!■Merging with SDXL fails.If there is a way to merge, it would be helpful if you could let me know.Once you are able to merge, you can benefit from other great SDXL models!It has a different weight than SDXL, so there is basically no compatibility, but it would be fun to find a way to combine them.I think it can be merged with other playgrounds. It could also be interesting.If you have any chemical reactions caused by merging different models, please share!It doesn't matter if it's real or anime.■Added the training source playground-v2-512px-base model for differential merging with other playground_v2.I have uploaded it to the v0.0 model tab, so please check it there.Now you can extract the aesthetic training + fine tuning weights of other playground_v2 1024px by performing differential extraction. If you add and merge them at a rate of +1.0, the 512px base will match 1024px. +0.5 gives an intermediate result and can be matched over a wide range. On the other hand, if you do a difference with my model, you will be able to extract only my fine tuning results and add and merge them to another playground_v2 1024px. There are various combinations and it is fun.I think lora can be trained like SDXL.There are still many things that are unclear, so I won't provide a detailed explanation, but if there is a positive opinion, I would like to share as much information as possible.■Added float32 checkpoint and diffuser model for fine tuning. The training configuration is onetrainer_config that comes with the diffuser model.I have uploaded it to the v0.0 model tab, so please check it there.Both u-net and text encoder are fine tuned.If the training tool you are using supports SDXL, you can train without any problems. If you are still worried, you can be more at ease with onetrainer, which I used for training.Training this model is fun as it learns very well even at 512px.It would be fun to add 512px training to further increase concepts at a low training cost.or, By adding 384px+768px and doing multi-resolution training, It will be fun to be able to flexibly support lower and higher resolutions while maintaining 512px, reducing upscaling failures and making it easier to remember finer details and concepts.There is no problem even if the sample images during training are not of good quality.When I actually used inference and automatically generated tags, it worked surprisingly well. It's okay as long as the training doesn't fail and it doesn't become noise.Even if the training results are bad, if you merge other models, the non-existent aesthetic elements trained with 512px_base or later will be added and the high resolution will be stronger, so you can generate images that exceed your imagination!It might be interesting to replace it with an SDXL model text encoder such as anime or pony before training and then train.The text encoder starts with the characters and danbooru tags already known. All you have to do is train unet!It might also be a good idea to merge the text encoders with 0.5 to keep both properties and train them further.playground-v2-512px-base is an SDXL model that is in the middle of training before aesthetic fine tuning.This is a very rare item that we would normally not be able to obtain.There are endless possibilities.By using this as a starting point, you may be able to create a specialized model as you wish.I only drew a slightly unsatisfying picture of the wonderful campus.It will be a great picture if you add to it.My dream is to see more SDXL models that can be generated at lower resolutions such as 512px!I'm new to civitai, so if you have any opinions, I'd appreciate it if you could let me know.Your reaction is my driving force. ｍ（＿　＿）ｍ■Great pre-trained model used for fine tuning.https://huggingface.co/playgroundai/playground-v2-512px-base