Video-to-Video
Diffusers
English
ltx-video
ltx-2.3
ic-lora
low-light
shadow-reconstruction
generative-video
vfx
lighting
Instructions to use FuzzPuppy/LTX-2.3-Black-Magic-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use FuzzPuppy/LTX-2.3-Black-Magic-LoRA with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("FuzzPuppy/LTX-2.3-Black-Magic-LoRA", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "Restore this underexposed video to a natural, well-exposed version with realistic colors and recovered shadow detail. A woman performs poi fire dancing. She has her back to the camera and is facing an audience." image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
File size: 8,127 Bytes
7e778ca 07d39be 7e778ca 07d39be 31ba739 07d39be | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 | ---
license: other
license_name: ltx-2-community-license
license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE
base_model:
- Lightricks/LTX-2.3
base_model_relation: adapter
pipeline_tag: video-to-video
library_name: diffusers
language:
- en
tags:
- ltx-video
- ltx-2.3
- ic-lora
- low-light
- shadow-reconstruction
- generative-video
- vfx
- lighting
widget:
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. A woman performs poi fire dancing. She has her back to the camera and is facing an audience.
output:
url: examples/back-poi.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. A man and woman dance at a nightclub.
output:
url: examples/dance-couple.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. A fire pit in front of a house in the forest.
output:
url: examples/firepit-house.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. Three men in a snowy field.
output:
url: examples/men-snow.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. A monkey eats corn on the cob.
output:
url: examples/monkey.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. An owl in the forest.
output:
url: examples/owl.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail.
output:
url: examples/poi-festival.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. A porcupine under a rock.
output:
url: examples/porcupine.mp4
- text: >-
Restore this underexposed video to a natural, well-exposed version with
realistic colors and recovered shadow detail. A tiger in the forest.
output:
url: examples/tiger.mp4
---
# Black Magic: LTX-2.3 22B Shadow Reconstruction IC-LoRA
Black Magic is a video-to-video IC-LoRA for
[LTX-2.3 22B](https://huggingface.co/Lightricks/LTX-2.3) that transforms dark or underexposed footage into a plausible, visually rich interpretation of the hidden scene. It doesn’t simply brighten the video. It interprets what might be hidden in the dark.
<Gallery />
**Black Magic is a generative VFX model, not conventional low-light enhancement.** It does not claim to reveal the original signal faithfully. Where the input contains too little information, it creates a temporally coherent interpretation of what could be in the dark.
## Model File
- [`black-magic-ic-lora-450.safetensors`](./black-magic-ic-lora-450.safetensors)
## Model Details
- **Base model:** LTX-2.3 22B
- **Training type:** IC-LoRA (video-to-video)
- **Reference input:** dark video
- **Reference downscale factor:** 1
- **Recommended LoRA strength:** `1.0`–`1.25`
## Intended Use & Out-of-Scope
**Intended use:** Generative shadow reconstruction for short creative and VFX
shots. The model is designed to preserve visible subjects, composition, motion,
and light placement while imagining plausible detail in crushed shadows. This makes Black Magic especially suited to dark concerts, festivals, animals in the wild at night, nighttime footage, and other shots where a compelling reconstruction matters more than accuracy.
**Out of scope:** Faithful photographic restoration, scientific enhancement,
surveillance, forensics, or any use that requires hidden details to match the
original scene. Indiscernible content is generated, not
recovered.
## Usage
### ComfyUI
A ready-to-run, two-phase ComfyUI graph is included:
[`ltx23-black-magic-lora-workflow.json`](./ltx23-black-magic-lora-workflow.json).
It uses ComfyUI core nodes and the official
[Lightricks ComfyUI-LTXVideo](https://github.com/Lightricks/ComfyUI-LTXVideo)
package. No Black Magic custom nodes are required.
1. Put `black-magic-ic-lora-450.safetensors` in `ComfyUI/models/loras`.
2. Install or update the official Lightricks ComfyUI-LTXVideo nodes.
3. Load `ltx23-black-magic-lora-workflow.json`.
4. Select the dark source in the **Load Video** node.
5. Update the positive prompt with a short scene description that guides the
reconstruction (see below).
6. Queue the workflow.
### Prompting
The following is the instruction used during training and is the recommended
prompt prefix:
```text
Restore this underexposed video to a natural, well-exposed version with realistic colors and recovered shadow detail.
```
Append a short description of what the scene contains, or what Black Magic
should plausibly construct in the shadows:
```text
A tiger in a forest.
```
The description acts as creative direction. Keep it concise if you want the
visible reference to remain dominant; add more detail when the shadows are
nearly empty and you want to steer the reimagined content. Long or strongly
stylized prompts can intentionally pull the result farther from the source and may produce a painted look.
## Recommended Settings
- **Black Magic strength:** `1.0`–`1.25`
- **Distilled LoRA strength:** `0.5`
- **Phase one:** 8 distilled Euler steps at approximately 640×352 for 16:9 video
- **Phase-one guidance:** video CFG `3`, audio CFG `1`, modality guidance `2`,
rescale `0.7`
- **Phase two:** CFG `1`, seed `43`, sigmas `0.85, 0.7250, 0.4219, 0`
- **Output:** 1280×704 for the included 16:9 workflow
The included workflow safely decodes up to 129 output frames in one LTX VAE
temporal tile. For a longer valid LTX sequence, set:
```text
minimum temporal_size = output frame count + 7
```
Use frame counts that are one more than a multiple of eight, such as 81, 121,
or 129. Keep input dimensions divisible by 32.
## Tips and Limitations
- Visible evidence of subjects, composition, or motion gives the model stronger
anchors. Fully black regions leave more room for invention.
- A concise scene description steers what the model imagines in ambiguous
shadows.
- Re-running with another seed can produce a different but still plausible
interpretation of the same darkness.
- This LoRA reconstructs video appearance; it was not trained as an audio
model.
## Dataset
The model was trained on video from
[Pexels](https://www.pexels.com/videos/) and
[BVI-RLV](https://doi.org/10.21227/mzny-8c77). Pexels videos were
synthetically darkened to create aligned reference and target pairs and are
subject to the [Pexels license](https://www.pexels.com/license/).
Real low-light pairs came from *BVI-Lowlight: Fully registered datasets for
low-light image and video enhancement* by P. Anantrasirichai, A. Malyugina,
R. Lin, and D. R. Bull (2023), available under
[CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) from
[IEEE DataPort](https://doi.org/10.21227/mzny-8c77). The clips were cropped,
resized, and temporally sampled for training.
## Training
- **Technique:** IC-LoRA (rank 32, alpha 32) on the LTX-2.3 22B video
transformer
- **Checkpoint:** step 450
- **Infrastructure:** [LTX-2 Community Trainer](https://github.com/Lightricks/LTX-2/tree/main/packages/ltx-trainer)
## License
The model weights are released under the
[LTX-2 Community License](https://github.com/Lightricks/LTX-2/blob/main/LICENSE).
The source datasets remain subject to their respective licenses described in
the Dataset section above.
## Acknowledgments
- [Lightricks](https://www.lightricks.com/) for LTX-2.3, the official ComfyUI
nodes, and the LTX-2 Community Trainer.
- The creators whose videos from
[Pexels](https://www.pexels.com/videos/) and
[Mixkit](https://mixkit.co/free-stock-video/) were used as the reference videos to produce the
model-card examples.
- The Pexels creators and the BVI-RLV authors for the source training material.
|