Instructions to use Shriramnag/ShivAI-Image-to-Video with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Shriramnag/ShivAI-Image-to-Video with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Shriramnag/ShivAI-Image-to-Video", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
| # LTX-2 Trainer | |
| This package provides tools and scripts for training and fine-tuning | |
| Lightricks' **LTX-2** audio-video generation model. It enables LoRA training, full | |
| fine-tuning, and training of video-to-video transformations (IC-LoRA) on custom datasets. | |
| --- | |
| ## π Documentation | |
| All detailed guides and technical documentation are in the [docs](./docs/) directory: | |
| - [β‘ Quick Start Guide](docs/quick-start.md) | |
| - [π¬ Dataset Preparation](docs/dataset-preparation.md) | |
| - [π οΈ Training Modes](docs/training-modes.md) | |
| - [βοΈ Configuration Reference](docs/configuration-reference.md) | |
| - [π Training Guide](docs/training-guide.md) | |
| - [π§ͺ Inference Guide](../ltx-pipelines/README.md) | |
| - [π§ Utility Scripts](docs/utility-scripts.md) | |
| - [π LTX-Core Documentation](../ltx-core/README.md) | |
| - [π‘οΈ Troubleshooting Guide](docs/troubleshooting.md) | |
| --- | |
| ## π§ Requirements | |
| - **LTX-2 Model Checkpoint** - Local `.safetensors` file | |
| - **Gemma Text Encoder** - Local Gemma model directory (required for LTX-2) | |
| - **Linux with CUDA** - CUDA 13+ recommended for optimal performance | |
| - **Nvidia GPU with 80GB+ VRAM** - Recommended for the standard config. For GPUs with 32GB VRAM (e.g., RTX 5090), | |
| use the [low VRAM config](configs/ltx2_av_lora_low_vram.yaml) which enables INT8 quantization and other | |
| memory optimizations | |
| --- | |
| ## π€ Contributing | |
| We welcome contributions from the community! Here's how you can help: | |
| - **Share Your Work**: If you've trained interesting LoRAs or achieved cool results, please share them with the | |
| community. | |
| - **Report Issues**: Found a bug or have a suggestion? Open an issue on GitHub. | |
| - **Submit PRs**: Help improve the codebase with bug fixes or general improvements. | |
| - **Feature Requests**: Have ideas for new features? Let us know through GitHub issues. | |
| --- | |
| ## π¬ Join the Community | |
| Have questions, want to share your results, or need real-time help? | |
| Join our [community Discord server](https://discord.gg/ltxplatform) to connect with other users and the development | |
| team! | |
| - Get troubleshooting help | |
| - Share your training results and workflows | |
| - Collaborate on new ideas and features | |
| - Stay up to date with announcements and updates | |
| We look forward to seeing you there! | |
| --- | |
| Happy training! π | |