File size: 4,775 Bytes
f3d4b2a 2843260 612265e 3b574f5 f3d4b2a 612265e edc8763 9356877 8bc9d3b 9356877 44f07c0 9356877 8bc9d3b 612265e 2843260 612265e 0e787ca 8bc9d3b 9356877 7f8e85a 9356877 8bc9d3b 9356877 7f8e85a 9356877 8bc9d3b 9356877 7f8e85a 9356877 8bc9d3b 9356877 7f8e85a 9356877 0e787ca 612265e ed93337 8bc9d3b 9356877 44f07c0 9356877 8bc9d3b 9356877 44f07c0 9356877 edc8763 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 | ---
license: other
license_name: ltx-2-community-license-agreement
license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE
base_model: Lightricks/LTX-2.3
tags:
- ltx
- ltx-2.3
- video-to-audio
- foley
- sound-effects
- lora
- safetensors
library_name: diffusers
---
# LTX-2.3 Foley
LTX-2.3 Foley is a video-to-audio LoRA for LTX-2.3. It adds realistic,
visually synchronized Foley and sound effects to video without adding a music
overlay.
This LoRA is especially useful when LTX-2.3 adds background music, score, or
rhythmic soundtrack material but the desired output is audible real-world sound
effects.
## Tutorial
[](https://youtu.be/qnHFDlrySmw)
[Watch the tutorial on YouTube](https://youtu.be/qnHFDlrySmw)
## Demo with and without LoRA
<video controls playsinline preload="metadata" style="width: 100%; max-width: 960px; border-radius: 8px;">
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/comparisons/sharpei-comparison-hf.mp4" type="video/mp4">
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/comparisons/sharpei-comparison-hf.mp4">Download video</a>
</video>
## Compatibility
This LoRA is intended for use with LTX-2.3 base or distilled video-to-audio
models.
## License
This model is released under the LTX Community License configured on the
Hugging Face repository.
## Files
- `ltx-2.3-foley-400-steps.safetensors`: 400-step Foley LoRA weights
## Recommended Usage
Use a LoRA multiplier between `1` and `3`.
Start around `1`. If music or score still appears, increase the multiplier
toward `2` or `3`.
Prompt with a short description of the visible action in the video, followed by:
```text
No speech is present. No music is present.
```
Example prompt:
```text
A barista uses an espresso machine to steam milk. No speech is present. No music is present
```
Recommended negative prompt:
```text
music, melody, song, singing, vocals, score, soundtrack, beat, rhythm bed, instrumental backing, tinny, thin, harsh, clipped, distorted, low bitrate
```
## Examples
Example videos generated with the LoRA:
### Door close
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/door-close-hf.mp4" type="video/mp4">
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/door-close-hf.mp4">Download video</a>
</video>
### Pineapple slicing
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/pineapple-hf.mp4" type="video/mp4">
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/pineapple-hf.mp4">Download video</a>
</video>
### Race car
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/racecar-hf.mp4" type="video/mp4">
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/racecar-hf.mp4">Download video</a>
</video>
### Squash
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/squash-hf.mp4" type="video/mp4">
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/examples/squash-hf.mp4">Download video</a>
</video>
Comparisons showing LTX-2.3 outputs with and without the Foley LoRA:
### Barista comparison
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/comparisons/barista-comparison-hf.mp4" type="video/mp4">
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/comparisons/barista-comparison-hf.mp4">Download video</a>
</video>
### Tennis comparison
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/comparisons/tennis-comparison-hf.mp4" type="video/mp4">
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-LoRA/resolve/main/comparisons/tennis-comparison-hf.mp4">Download video</a>
</video>
## ComfyUI Workflow
Use the companion ComfyUI workflow here:
[FuzzPuppy/LTX-2.3-Foley-Workflow](https://huggingface.co/FuzzPuppy/LTX-2.3-Foley-Workflow)
|