File size: 8,127 Bytes
7e778ca
 
 
 
07d39be
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7e778ca
07d39be
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31ba739
 
 
 
07d39be
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
---
license: other
license_name: ltx-2-community-license
license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE
base_model:
- Lightricks/LTX-2.3
base_model_relation: adapter
pipeline_tag: video-to-video
library_name: diffusers
language:
- en
tags:
- ltx-video
- ltx-2.3
- ic-lora
- low-light
- shadow-reconstruction
- generative-video
- vfx
- lighting
widget:
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. A woman performs poi fire dancing. She has her back to the camera and is facing an audience.
  output:
    url: examples/back-poi.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. A man and woman dance at a nightclub.
  output:
    url: examples/dance-couple.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. A fire pit in front of a house in the forest.
  output:
    url: examples/firepit-house.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. Three men in a snowy field.
  output:
    url: examples/men-snow.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. A monkey eats corn on the cob.
  output:
    url: examples/monkey.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. An owl in the forest.
  output:
    url: examples/owl.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail.
  output:
    url: examples/poi-festival.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. A porcupine under a rock.
  output:
    url: examples/porcupine.mp4
- text: >-
    Restore this underexposed video to a natural, well-exposed version with
    realistic colors and recovered shadow detail. A tiger in the forest.
  output:
    url: examples/tiger.mp4
---

# Black Magic: LTX-2.3 22B Shadow Reconstruction IC-LoRA

Black Magic is a video-to-video IC-LoRA for
[LTX-2.3 22B](https://huggingface.co/Lightricks/LTX-2.3) that transforms dark or underexposed footage into a plausible, visually rich interpretation of the hidden scene. It doesn’t simply brighten the video. It interprets what might be hidden in the dark.

<Gallery />

**Black Magic is a generative VFX model, not conventional low-light enhancement.** It does not claim to reveal the original signal faithfully. Where the input contains too little information, it creates a temporally coherent interpretation of what could be in the dark.

## Model File

- [`black-magic-ic-lora-450.safetensors`](./black-magic-ic-lora-450.safetensors)

## Model Details

- **Base model:** LTX-2.3 22B
- **Training type:** IC-LoRA (video-to-video)
- **Reference input:** dark video
- **Reference downscale factor:** 1
- **Recommended LoRA strength:** `1.0``1.25`

## Intended Use & Out-of-Scope

**Intended use:** Generative shadow reconstruction for short creative and VFX
shots. The model is designed to preserve visible subjects, composition, motion,
and light placement while imagining plausible detail in crushed shadows. This makes Black Magic especially suited to dark concerts, festivals, animals in the wild at night, nighttime footage, and other shots where a compelling reconstruction matters more than accuracy.

**Out of scope:** Faithful photographic restoration, scientific enhancement,
surveillance, forensics, or any use that requires hidden details to match the
original scene. Indiscernible content is generated, not
recovered.

## Usage

### ComfyUI

A ready-to-run, two-phase ComfyUI graph is included:
[`ltx23-black-magic-lora-workflow.json`](./ltx23-black-magic-lora-workflow.json).
It uses ComfyUI core nodes and the official
[Lightricks ComfyUI-LTXVideo](https://github.com/Lightricks/ComfyUI-LTXVideo)
package. No Black Magic custom nodes are required.

1. Put `black-magic-ic-lora-450.safetensors` in `ComfyUI/models/loras`.
2. Install or update the official Lightricks ComfyUI-LTXVideo nodes.
3. Load `ltx23-black-magic-lora-workflow.json`.
4. Select the dark source in the **Load Video** node.
5. Update the positive prompt with a short scene description that guides the
   reconstruction (see below).
6. Queue the workflow.

### Prompting

The following is the instruction used during training and is the recommended
prompt prefix:

```text
Restore this underexposed video to a natural, well-exposed version with realistic colors and recovered shadow detail.
```

Append a short description of what the scene contains, or what Black Magic
should plausibly construct in the shadows:

```text
A tiger in a forest.
```

The description acts as creative direction. Keep it concise if you want the
visible reference to remain dominant; add more detail when the shadows are
nearly empty and you want to steer the reimagined content. Long or strongly
stylized prompts can intentionally pull the result farther from the source and may produce a painted look.

## Recommended Settings

- **Black Magic strength:** `1.0``1.25`
- **Distilled LoRA strength:** `0.5`
- **Phase one:** 8 distilled Euler steps at approximately 640×352 for 16:9 video
- **Phase-one guidance:** video CFG `3`, audio CFG `1`, modality guidance `2`,
  rescale `0.7`
- **Phase two:** CFG `1`, seed `43`, sigmas `0.85, 0.7250, 0.4219, 0`
- **Output:** 1280×704 for the included 16:9 workflow

The included workflow safely decodes up to 129 output frames in one LTX VAE
temporal tile. For a longer valid LTX sequence, set:

```text
minimum temporal_size = output frame count + 7
```

Use frame counts that are one more than a multiple of eight, such as 81, 121,
or 129. Keep input dimensions divisible by 32.

## Tips and Limitations

- Visible evidence of subjects, composition, or motion gives the model stronger
  anchors. Fully black regions leave more room for invention.
- A concise scene description steers what the model imagines in ambiguous
  shadows.
- Re-running with another seed can produce a different but still plausible
  interpretation of the same darkness.
- This LoRA reconstructs video appearance; it was not trained as an audio
  model.

## Dataset

The model was trained on video from
[Pexels](https://www.pexels.com/videos/) and
[BVI-RLV](https://doi.org/10.21227/mzny-8c77). Pexels videos were
synthetically darkened to create aligned reference and target pairs and are
subject to the [Pexels license](https://www.pexels.com/license/).

Real low-light pairs came from *BVI-Lowlight: Fully registered datasets for
low-light image and video enhancement* by P. Anantrasirichai, A. Malyugina,
R. Lin, and D. R. Bull (2023), available under
[CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) from
[IEEE DataPort](https://doi.org/10.21227/mzny-8c77). The clips were cropped,
resized, and temporally sampled for training.

## Training

- **Technique:** IC-LoRA (rank 32, alpha 32) on the LTX-2.3 22B video
  transformer
- **Checkpoint:** step 450
- **Infrastructure:** [LTX-2 Community Trainer](https://github.com/Lightricks/LTX-2/tree/main/packages/ltx-trainer)

## License

The model weights are released under the
[LTX-2 Community License](https://github.com/Lightricks/LTX-2/blob/main/LICENSE).
The source datasets remain subject to their respective licenses described in
the Dataset section above.

## Acknowledgments

- [Lightricks](https://www.lightricks.com/) for LTX-2.3, the official ComfyUI
  nodes, and the LTX-2 Community Trainer.
- The creators whose videos from
  [Pexels](https://www.pexels.com/videos/) and
  [Mixkit](https://mixkit.co/free-stock-video/) were used as the reference videos to produce the
  model-card examples.
- The Pexels creators and the BVI-RLV authors for the source training material.