neuralvfx
Z-Image-SAM-ControlNet
Z-Image-SAM-ControlNet-a
LibreFlux-ControlNet
This model/pipeline is the product of my LibreFlux ControlNet training repo, which uses LibreFLUX as the underlying Transformer model for the ControlNet. For the dataset, I auto labeled 165K images from the SA1B dataset and trained for 1 epoch. I've tested using this ControlNet model as a base for transfer learning to less generic datasets, the results are good! How does this relate to LibreFLUX? - Base model is LibreFLUX - Trained in same non-distilled fashion - Uses Attention Masking - Uses CFG during Inference Fun Facts - Trained on 165K segmented images from Meta's SA1B Dataset - Trained using this repo: https://github.com/NeuralVFX/LibreFLUX-ControlNet - Transformer model used: https://huggingface.co/jimmycarter/LibreFlux-SimpleTuner - Inference code roughly adapted from: https://github.com/bghira/SimpleTuner