Orpheus_3b_0.1_rkllm

Orpheus_3b_0.1_rkllm is a Text-to-Speech model built from Orpheus 16bit and GGUF F16, using the Rkllm-Toolkit.

Features

• 🎙️ Text-to-Speech capability with optimized inference
• 🧠 Built from Orpheus 16bit & GGUF F16 formats
• 🚀 Runs on RK3588 NPU using w8a8 quantization
• ⚙️ Powered by RKLLM Toolkit v1.2.1b1
• ⚡ Designed for high-performance on edge devices

Requirements

• RK3588-based device
• RKLLM Toolkit v1.2.1b1
• Compatible runtime environment for deploying quantized models

Usage

1. Clone or download the model from Hugging Face.
2. Clone the github repo
3. Run the model using python implementation or using C++ implementation .

License

This model is released under the Apache-2.0 license.

---