Instructions to use N-Bot-Int/OpenRP3B-Llama3.2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use N-Bot-Int/OpenRP3B-Llama3.2 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Llama-3.2-3B-Instruct-bnb-4bit") model = PeftModel.from_pretrained(base_model, "N-Bot-Int/OpenRP3B-Llama3.2") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Studio
How to use N-Bot-Int/OpenRP3B-Llama3.2 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for N-Bot-Int/OpenRP3B-Llama3.2 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for N-Bot-Int/OpenRP3B-Llama3.2 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for N-Bot-Int/OpenRP3B-Llama3.2 to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="N-Bot-Int/OpenRP3B-Llama3.2", max_seq_length=2048, )
OpenRP3 is now Discontinued, Use OpenElla3B for a more finer And Better AI Experience
Llama 3.2 - 3B OpenRP-A
"OpenRP-A Model"
Llama 3.2 - OpenRP 3B is a fine-tuned version of the Meta Llama 3.2 3B Instruct model, optimized for role-playing (RP) tasks. This model was developed using the Unsloth AI training tool and fine-tuned over 60 epochs on two datasets: openerotica/mixed-rp (a diverse role-playing dataset from Openerotica) and kingbri/PIPPA-shareGPT (a supplementary dataset enhancing conversational RP capabilities). With 3 billion parameters, it delivers robust performance for uncensored, creative, and interactive applications.
Prompt framework
This model adopts the Llama 3.2 prompting framework. For optimal performance and the best user experience, please adhere to this structure when crafting prompts.
Parameter
3B Model
Training
- 60 steps per Dataset
- Unsloth AI
- Google Colab
- Downloads last month
- -