XLabs-AI

--- license: apache-2.0 language: - en pipeline_tag: text2text-generation tags: - pytorch - transformers ---

This repository provides a checkpoint with trained LoRA photorealism for FLUX.1-dev model by Black Forest Labs Training details XLabs AI team is happy to publish fine-tuning Flux scripts, including: Training Dataset Dataset has the following format for the training process: A .json file contains "caption" field with a text prompt. lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

This repository provides a IP-Adapter checkpoint for FLUX.1-dev model by Black Forest Labs Models IP-Adapter is trained on 512x512 resolution for 50k steps and 1024x1024 for 25k steps resolution and works for both 512x512 and 1024x1024 resolution. Model is training, we release new checkpoints regularly, stay updated. We release v1 version - which can be used directly in ComfyUI! Please, see our ComfyUI custom nodes installation guide See examples of our models results below. Also, some generation results with input images are provided in "Files and versions" To try our models, you have 2 options: 1. Use main.py from our official repo 2. Use our custom nodes for ComfyUI and test it with provided workflows (check out folder /workflows) Instruction for ComfyUI 1. Go to ComfyUI/customnodes 2. Clone x-flux-comfyui, path should be ComfyUI/customnodes/x-flux-comfyui/, where is all the files in this repo 3. Go to ComfyUI/customnodes/x-flux-comfyui/ and run python setup.py 4. Update x-flux-comfy with `git pull` or reinstall it. 5. Download Clip-L `model.safetensors` from OpenAI VIT CLIP large, and put it to `ComfyUI/models/clipvision/`. 6. Download our IPAdapter from huggingface, and put it to `ComfyUI/models/xlabs/ipadapters/`. 7. Use `Flux Load IPAdapter` and `Apply Flux IPAdapter` nodes, choose right CLIP model and enjoy your genereations. 8. You can find example workflow in folder workflows in this repo. Limitations The IP Adapter is currently in beta. We do not guarantee that you will get a good result right away, it may take more attempts to get a result. Our weights fall under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

This repository provides a Depth ControlNet checkpoint for FLUX.1-dev model by Black Forest Labs See our github for train script, train configs and demo script for inference. Models ControlNet is trained on 1024x1024 resolution and works for 1024x1024 resolution. We release v3 version - better and realistic version, which can be used directly in ComfyUI! Please, see our ComfyUI custom nodes installation guide See examples of our models results below. Also, some generation results with input images are provided in "Files and versions" To try our models, you have 2 options: 1. Use main.py from our official repo 2. Use our custom nodes for ComfyUI and test it with provided workflows (check out folder /workflows) Our weights fall under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

This repository provides a collection of ControlNet checkpoints for FLUX.1-dev model by Black Forest Labs See our github for train script, train configs and demo script for inference. Our collection supports 3 models: - Canny - HED - Depth (Midas) Each ControlNet is trained on 1024x1024 resolution and works for 1024x1024 resolution. We release v3 versions - better and realistic versions, which can be used directly in ComfyUI! Please, see our ComfyUI custom nodes installation guide See examples of our models results below. Also, some generation results with input images are provided in "Files and versions" To try our models, you have 2 options: 1. Use main.py from our official repo 2. Use our custom nodes for ComfyUI and test it with provided workflows (check out folder /workflows) 3. Use gradio demo 1. Clone our x-flux-comfyui custom nodes 2. Launch ComfyUI 3. Try our cannyworkflow.json 1. Clone our x-flux-comfyui custom nodes 2. Launch ComfyUI 3. Try our depthworkflow.json 1. Clone our x-flux-comfyui custom nodes 2. Launch ComfyUI 3. Try our hedworkflow.json Our weights fall under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

This repository provides a Hed ControlNet checkpoint for FLUX.1-dev model by Black Forest Labs See our github for train script, train configs and demo script for inference. Models ControlNet is trained on 1024x1024 resolution and works for 1024x1024 resolution. We release v3 version - better and realistic version, which can be used directly in ComfyUI! Please, see our ComfyUI custom nodes installation guide See examples of our models results below. Also, some generation results with input images are provided in "Files and versions" To try our models, you have 2 options: 1. Use main.py from our official repo 2. Use our custom nodes for ComfyUI and test it with provided workflows (check out folder /workflows) Our weights fall under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

This repository provides a Canny ControlNet checkpoint for FLUX.1-dev model by Black Forest Labs See our github for train script, train configs and demo script for inference. Models ControlNet is trained on 1024x1024 resolution and works for 1024x1024 resolution. We release v3 version - better and realistic version, which can be used directly in ComfyUI! Please, see our ComfyUI custom nodes installation guide See examples of our models results below. Also, some generation results with input images are provided in "Files and versions" To try our models, you have 2 options: 1. Use main.py from our official repo 2. Use our custom nodes for ComfyUI and test it with provided workflows (check out folder /workflows) Our weights fall under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

This repository provides a checkpoint with trained ControlNet Canny model for FLUX.1-dev model by Black Forest Labs ComfyUI Training details XLabs AI team is happy to publish fune-tuning Flux scripts, including: - LoRA 🔥 - ControlNet 🔥 Training dataset Dataset has the following format for the training process: A .json file contains "caption" field with a text prompt. To test our checkpoints, use commands presented below. License controlnet.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

This repository provides a checkpoint with trained LoRAs for FLUX.1-dev model by Black Forest Labs Training details XLabs AI team is happy to publish fune-tuning Flux scripts, including: Training Dataset Dataset has the following format for the training process: A .json file contains "caption" field with a text prompt. Thank https://civitai.com/user/dobrosketchkun and https://civitai.com/user/sadxzero for datasets for loras lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License

FP8 quantized version of [FLUX.1 [dev] model](https://huggingface.co/black-forest-labs/FLUX.1-dev) License The model falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License