README.md

---
tags:
- text-to-image
- lora
- diffusers
- template:diffusion-lora
base_model: black-forest-labs/FLUX.1-Kontext-dev
instance_prompt: null
license: apache-2.0
pipeline_tag: image-to-image
---


# RefControl Flux Kontext – Reference Canny LoRA

## 📝 Short description
A LoRA for **Flux Kontext Dev** that fuses a **reference image** (left) with a **canny edge map** (right).  
It preserves **identity and style** from the reference while following the **edges and outlines** from the control.

**Trigger word:** `refcontrolcanny`


[Demo video](https://youtu.be/T0IH0jT2h8M)

---


## 📊 Examples

| Reference | Result |
|-----------|--------|
| ![ref1](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-canny-lora/resolve/main/examples/1a.png) | ![res1](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-canny-lora/resolve/main/examples/1b.png) |
| ![ref2](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-canny-lora/resolve/main/examples/2a.png) | ![res2](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-canny-lora/resolve/main/examples/2b.png) |
| ![ref3](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-canny-lora/resolve/main/examples/5a.png) | ![res3](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-canny-lora/resolve/main/examples/5b.png) |

---

## 📖 Extended description
This LoRA was primarily trained on **humans and characters**, but it works with objects and scenes as well.  
The main purpose is to **preserve identity** — facial features, clothing, style — from the **reference image**, while using the **canny edge map** to define contours, composition, and layout.

---

## ⚙️ How to use
1. Concatenate two images side by side:  
   - **Left:** reference image (person, character, or object).  
   - **Right:** canny edges (line structure).  
2. Add the trigger word `refcontrolcanny` in your prompt.  
3. Adjust LoRA weight (recommended **0.8–1.0**) depending on how strictly you want to follow edges.  

### ✅ Example prompt
refcontrolcanny, change canny edges to photo with reference from left

---

## 🎯 What it does
- Preserves **style and identity** of the reference.  
- Uses **canny edges** to control structure, outline, and composition.  
- Produces consistent results across different poses and layouts.  

---

## ⚡ Tips
- Works best if the canny map captures **clean edges** with minimal noise.  

---

## 📌 Use cases
- Character consistency in illustrations and comics.  
- Stylized redraws of objects with sharp outlines.  
- Scene composition based on silhouettes.  
- Rapid prototyping of layouts and storyboards.  

---