Instructions to use FuzzPuppy/LTX-2.3-Foley-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use FuzzPuppy/LTX-2.3-Foley-LoRA with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Lightricks/LTX-2.3", torch_dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("FuzzPuppy/LTX-2.3-Foley-LoRA") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - LTX.io
How to use FuzzPuppy/LTX-2.3-Foley-LoRA with LTX.io:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --frozen
# Download the weights from this repo, plus the Gemma text encoder hf download FuzzPuppy/LTX-2.3-Foley-LoRA --local-dir models/LTX-2.3-Foley-LoRA hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
# Text/image-to-video with the LoRA on the HQ two-stage base pipeline uv run python -m ltx_pipelines.ti2vid_two_stages_hq \ --checkpoint-path path/to/checkpoint.safetensors \ --distilled-lora path/to/distilled_lora.safetensors 0.8 \ --spatial-upsampler-path path/to/spatial_upsampler.safetensors \ --gemma-root models/gemma-3-12b \ --lora models/LTX-2.3-Foley-LoRA/<weights>.safetensors 1.0 \ --prompt "your prompt here" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Upload V2A/Foley LoRA 400-step checkpoint
Browse files- README.md +5 -12
- comparisons/sharpei-comparison.mp4 +2 -2
README.md
CHANGED
|
@@ -26,8 +26,8 @@ effects.
|
|
| 26 |
## Demo with and without LoRA
|
| 27 |
|
| 28 |
<video controls playsinline preload="metadata" style="width: 100%; max-width: 960px; border-radius: 8px;">
|
| 29 |
-
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/
|
| 30 |
-
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/
|
| 31 |
</video>
|
| 32 |
|
| 33 |
## Compatibility
|
|
@@ -80,13 +80,6 @@ Example videos generated with the LoRA:
|
|
| 80 |
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/examples/door-close-modal-worked.mp4">Download video</a>
|
| 81 |
</video>
|
| 82 |
|
| 83 |
-
### Man diving
|
| 84 |
-
|
| 85 |
-
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
|
| 86 |
-
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/examples/man-diving-modal-worked.mp4" type="video/mp4">
|
| 87 |
-
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/examples/man-diving-modal-worked.mp4">Download video</a>
|
| 88 |
-
</video>
|
| 89 |
-
|
| 90 |
### Pineapple slicing
|
| 91 |
|
| 92 |
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
|
|
@@ -110,11 +103,11 @@ Example videos generated with the LoRA:
|
|
| 110 |
|
| 111 |
Comparisons showing LTX-2.3 outputs with and without the Foley LoRA:
|
| 112 |
|
| 113 |
-
###
|
| 114 |
|
| 115 |
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
|
| 116 |
-
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/
|
| 117 |
-
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/
|
| 118 |
</video>
|
| 119 |
|
| 120 |
### Tennis comparison
|
|
|
|
| 26 |
## Demo with and without LoRA
|
| 27 |
|
| 28 |
<video controls playsinline preload="metadata" style="width: 100%; max-width: 960px; border-radius: 8px;">
|
| 29 |
+
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/sharpei-comparison.mp4" type="video/mp4">
|
| 30 |
+
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/sharpei-comparison.mp4">Download video</a>
|
| 31 |
</video>
|
| 32 |
|
| 33 |
## Compatibility
|
|
|
|
| 80 |
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/examples/door-close-modal-worked.mp4">Download video</a>
|
| 81 |
</video>
|
| 82 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 83 |
### Pineapple slicing
|
| 84 |
|
| 85 |
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
|
|
|
|
| 103 |
|
| 104 |
Comparisons showing LTX-2.3 outputs with and without the Foley LoRA:
|
| 105 |
|
| 106 |
+
### Barista comparison
|
| 107 |
|
| 108 |
<video controls playsinline preload="metadata" style="width: 100%; max-width: 720px; border-radius: 8px;">
|
| 109 |
+
<source src="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/barista-comparison.mp4" type="video/mp4">
|
| 110 |
+
<a href="https://huggingface.co/FuzzPuppy/LTX-2.3-Foley/resolve/main/comparisons/barista-comparison.mp4">Download video</a>
|
| 111 |
</video>
|
| 112 |
|
| 113 |
### Tennis comparison
|
comparisons/sharpei-comparison.mp4
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:524ba2080370ebc8732e24f0f9c146506613a2a29633d048d4e01e714738c46b
|
| 3 |
+
size 12756486
|