Instructions to use xinsir/controlnet-union-sdxl-1.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use xinsir/controlnet-union-sdxl-1.0 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("xinsir/controlnet-union-sdxl-1.0", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
training guide?
#13
by lenML - opened
Thank you for sharing this powerful model. I have two related questions and suggestions:
Could you provide a detailed training guide? Currently, the model doesn't fully support all control modes, so perhaps the community could assist in training to further enhance the model's capabilities.
Are there any plans to experiment with new ControlNet modes? For example, InstantID/CLIP. The community might be able to help experiment with these new modes.
it's on the todo it seems:
https://github.com/xinsir6/ControlNetPlus/blob/main/README.md#todo
Todo:
ControlNet++ for gradio
ControlNet++ for Comfyui
release training code and training guidance.
release arxiv paper.
截至目前为止,训练代码还没有开放,有人知道是什么原因吗?diffusers上有对应的训练代码吗?