Instructions to use Shriramnag/ShivAI-Image-to-Video with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Shriramnag/ShivAI-Image-to-Video with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Shriramnag/ShivAI-Image-to-Video", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
LTX-2 Trainer
This package provides tools and scripts for training and fine-tuning Lightricks' LTX-2 audio-video generation model. It enables LoRA training, full fine-tuning, and training of video-to-video transformations (IC-LoRA) on custom datasets.
π Documentation
All detailed guides and technical documentation are in the docs directory:
- β‘ Quick Start Guide
- π¬ Dataset Preparation
- π οΈ Training Modes
- βοΈ Configuration Reference
- π Training Guide
- π§ͺ Inference Guide
- π§ Utility Scripts
- π LTX-Core Documentation
- π‘οΈ Troubleshooting Guide
π§ Requirements
- LTX-2 Model Checkpoint - Local
.safetensorsfile - Gemma Text Encoder - Local Gemma model directory (required for LTX-2)
- Linux with CUDA - CUDA 13+ recommended for optimal performance
- Nvidia GPU with 80GB+ VRAM - Recommended for the standard config. For GPUs with 32GB VRAM (e.g., RTX 5090), use the low VRAM config which enables INT8 quantization and other memory optimizations
π€ Contributing
We welcome contributions from the community! Here's how you can help:
- Share Your Work: If you've trained interesting LoRAs or achieved cool results, please share them with the community.
- Report Issues: Found a bug or have a suggestion? Open an issue on GitHub.
- Submit PRs: Help improve the codebase with bug fixes or general improvements.
- Feature Requests: Have ideas for new features? Let us know through GitHub issues.
π¬ Join the Community
Have questions, want to share your results, or need real-time help?
Join our community Discord server to connect with other users and the development team!
- Get troubleshooting help
- Share your training results and workflows
- Collaborate on new ideas and features
- Stay up to date with announcements and updates
We look forward to seeing you there!
Happy training! π