BAXL | Blue Archive Flat Celluloid Style Fine-tune | 碧蓝档案赛璐璐平涂画风 [Kohaku Δ & Animagine XL v3]

BAXLv3 is up now!Focus on generalization ability, cover art style of most copyright characters without catastrophic forgetting / overfitting.test img @QR0W_What you should expected from this update:Better generalizationCloser to Blue Archive styleBeautiful glareMuch improved LoRA compatibility based on KohakuΔ.What you should NOT expected from this update:Better anatomy, always good hands and feeteasy to usefocus on given prompts (compare to previous version)multiple person / nsfw support (this is not gonna get any close to pony.)detailed backgroundHow-to:Prompting logic is same to KohakuΔ.1girl, <character>, <general tag>, <quality tag>Negative:lowres, error, worst quality, low quality, jpeg artifacts, watermark, signature, usernameKeep prompt clean and tidy. Suggest prompt length < 75 tokens.Suggetion:CFG: 4-7 （higher will have slightly better anatomy）Sampler: Euler A @ 25stepsResolution: 768 - 1792(ultrawide only), +32 each step.Use DanTagGen.Set a low temperature (<1)Ban words: sketch, comic, flat color, .official., .boy., mecha, no humans, text, pixel art, speech bubbleTotal tag length: shortUse Hires.FixUpscaler: DATx2Denoising: 0.4-0.5Use ADetailer.face_yolov8n.ptIf you want generate typical color, put color scheme to at first.What's difference:Base model switch to KohakuΔ rev1.ReasonAesthetic rating which AniXL used is NOT friendly to Celluloid art style, quality / negative tags of AniXL are effortless, sometimes even drawback for drawing clean, thin lines. Also it seems like AniXL has some overfitted characters.👆TBH, I haven't use same training methods on AniXL3.1 yet. Maybe it can be fixed by the final training config I use.Meanwhile, KohakuΔ is undertrained, which means flexible, more friendly to fine-tune art style.I have no idea how to tag like AniXL3.1, but I know how to tag like KohakuΔ, since I could get the exact same dataset from Hakubooru.Better generalization & horizonal composition.KohakuΔ rev1 is not good at anatomy & composition, due to lack of training time (dual 3090 bro, what you expected).Due to Regularization, this fine-tune do make things better (especially horizonal image), but I'm not gonna lie you, BAXLv3-Δ is VERY EASY to generate bad hand / extra legs, get worse if the prompts have problems (too long / semantic repetition / immoderate tag order).Regularization / Datasets Update.Regularization Danbooru Dataset, class token=solo:1000+ horizonal imagefav count > 30tag with "1girl, solo"1000+ vertical imagefav count > 30tag with "1girl, solo"artist who is celluloid art style & BA art style imitatorDataset update to 0068 events CG, include 5th PV screenshots.Training Details:Image count: 574 without repeat.min_bucket_reso = 256max_bucket_reso = 4096bucket_reso_steps = 32train_batch_size = 2gradient_accumulation_steps = 32learning_rate = 7.5e-6 Unet onlylr_scheduler = "constant_with_warmup"lr_warmup_steps = 100optimizer_type = "Lion8bit"min_snr_gamma = 5Batch size = 2mixed_precision = "fp16"full_fp16 = trueoptimizer_args = [ "weight_decay=0.1", "betas=0.9,0.95" ]shuffle_caption = trueweighted_captions = falsekeep_tokens = 0caption_tag_dropout_rate = 0.1Known issues:halo / heterochromia / .focus. seems to be overfitted in some circumstances. Can be helped by put them in negative tags.Background is not stable, keen to draw something unnecessary even if you type simple background, white backgroundLicense & DisclaimerLicense:Fair AI Public License 1.0-SDDislcaimer:According to Blue Archive's Fanart Guidelines ( JP | CN ), this model shall not be used for any kind of commercial use, including but not limited to selling this model or merges of this model, selling image generated by this model or merges of this model, or 'paid member exclusive' for monetization platforms like Patreon/Fanbox/etc.===========XLv2 INFO===========TL; DR:Based on Animagine XL V3, use Blue Archive's official artwork as fine-tune dataset for its art style. You are prohibited to use this model for any kind of commercial use. Please read the disclaimer below before you use this model.How-to:Suggest prompt order:character name, 1girl, other tags, quality tags,Suggest quality tags (please delete other quality tags in prompts):flat_coating clear_color highres absurdres best_qualityDO NOT USE masterpiece if you are generating genral images. It will ruin the flat coating.Suggest negative:nsfw, lowres, worst quality, low quality, bad perspective, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, artist nameDO NOT USE blurry as negative prompts.Suggest Resolution: same to A3XL, but limited to 1600x900 vertical, horizonal is lower.Higher resolution = Closer to BA styleCFG 5 Euler A step 25You can treat this like Animagine XL V3, all tag still work at same methods.LoRA based on Animagine XL V3 will work fine on it.Suggest Upscaler: AnimeVideo v3No color scheme trainingFeel free to give feedback, I need your suggestion for further developments.Disclaimer:Animagine XL V3's license asked that merges of this model should be released as same permissions, which is allowed user to use generation service or sell generated images of the model.But according to Blue Archive's Fanart Guidelines ( JP | CN ), this model (BArtstyle) shall not be used for any kind of commercial use, including but not limited to selling this model or merges of this model, selling image generated by this model or merges of this model, or 'paid member exclusive' for monetization platforms like Patreon/Fanbox/etc.The license change of this model is permitted by Cagliostro Research Lab, the author of Animagine XL. Once again, I sincerely thank them for their understanding and dedication for open-source community. (Permission Source)免责声明:根据 Animagine XL V3 的许可证，基于该模型的衍生模型应以相同授权方式公开，即允许用户使用线上生成服务，或售卖该模型生成的图片。但根据《<蔚蓝档案>同人创作指引》 ( 日文 | 中文 )，此模型（BArtstyle）不得用于任何形式的商业用途，包括但不限于售卖该模型及其衍生模型自身或其生成的图片，或Patreon/Fanbox等众筹平台的“订阅会员限定”服务。该许可证授权范围变更得到 Animagine XL 作者 Cagliostro Research Lab 的许可。在这里再次感谢他们的理解，以及他们对于开源社区的贡献。（授权来源）===========XLv1 INFO===========How-to:This model is in ALPHA phase, pretty much undertrained, only works perfect for Blue Archive's characters.You can treat this like Animagine XL V3, all tag still work at same methods.LoRA based on Animagine XL V3 will work fine on it.Suggest Upscaler: AnimeVideo v3Still trained with color tags like BArtstyleDBv1, but seems not very effective.Feel free to give feedback, I need your suggestion for further developments.Training Details:AdamW8bit200 Images@1024x1024200 epoch@batch size 1UNET: 1E-5TE1/TE2: 5E-6Cosine with 15 Restarts===========DBv1 INFO===========How-to:Positive Prompts:Just like BArtstyle LoRA, color scheme still work, and I managed to make these typical color like blue theme or pink theme much closer to original data without overfitting.Natural Language + Low CFG (4.5-6) + Roll dices + cherry-pick > "quality tags"From my test, about 30% image should be good enough at first glance. If you can't get similar result, check if there are any duplicate/conflict tags in your prompt, shrink it and lower your CFG.Negative Prompts:DO NOT USE FCKING LONG NEGATIVE PROMPTS UNLESS YOU KNOW WHAT ARE YOU DOING!!!For randomly generate, simple EasyNegativeV2 is good enough.You can try to add glowing, 3d, painting (medium), photorealistic, nsfw in negative prompts if you think this model is still have too much CounterFeit artstyle, but I can't guarantee the effect.VAE: WD1-4-kl-f8-anime2-bless09.ckptSampler: Euler Astep 50-100Yeh, CHAD Euler A still better than Virgin DPMUpscaler: AnimeVideo v3step 10-15Denoising 0.45-0.55Base Model:Counterfeit V3-fp16-fixAfter 6 MONTHS wait, author has released a vae fix version of CFv3. Original version had a serious VAE issue that make all the LoRA of CFv3 is bit broken, even if you replace the VAE won't help. Strongly recommend to update if you use it.It seems like it is the ONLY TRAINING model that is capable with NAI 1.0 LoRA. That means only this model is good for fine-tuningDataset:200 images from Blue Archive's Official Artwork + flip, 400 in total.TOTALLY OVERHAULED DATASET COMPARE WITH BArtstyle LoRA.Highest resolution I could found, cropped to improve dataset qualityUse XnConvert Downscale to 1280x1280Training Setting:OPTIMIZER: AdamW8bitSCHEDULER: Constant with WarmupWarmup to 10% of total steps.UNET LR: 1e-6TE LR: 1.25-71/8 of UNET LR as suggestionStop TE Training at 50% of total steps.EPOCH: 100BATCH SIZE: 1STEP: 40000RES: 1280X1280TIME: 10H27M