README.md

metadata

tags:
  - text-to-image
  - lora
  - diffusers
  - template:diffusion-lora
base_model: black-forest-labs/FLUX.1-Kontext-dev
instance_prompt: null
license: apache-2.0
pipeline_tag: image-to-image

RefControl Flux Kontext – Reference Canny LoRA

📝 Short description

A LoRA for Flux Kontext Dev that fuses a reference image (left) with a canny edge map (right).
It preserves identity and style from the reference while following the edges and outlines from the control.

Trigger word: refcontrolcanny

Demo video

---

📊 Examples

Reference	Result

---

📖 Extended description

This LoRA was primarily trained on humans and characters, but it works with objects and scenes as well.
The main purpose is to preserve identity — facial features, clothing, style — from the reference image, while using the canny edge map to define contours, composition, and layout.

---

⚙️ How to use

1. Concatenate two images side by side:
   • Left: reference image (person, character, or object).
   • Right: canny edges (line structure).
2. Add the trigger word refcontrolcanny in your prompt.
3. Adjust LoRA weight (recommended 0.8–1.0) depending on how strictly you want to follow edges.

✅ Example prompt

refcontrolcanny, change canny edges to photo with reference from left

---

🎯 What it does

• Preserves style and identity of the reference.
• Uses canny edges to control structure, outline, and composition.
• Produces consistent results across different poses and layouts.

---

⚡ Tips

• Works best if the canny map captures clean edges with minimal noise.

---

📌 Use cases

• Character consistency in illustrations and comics.
• Stylized redraws of objects with sharp outlines.
• Scene composition based on silhouettes.
• Rapid prototyping of layouts and storyboards.

---