Instructions to use nvidia/llama-3.1-nemoguard-8b-content-safety with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use nvidia/llama-3.1-nemoguard-8b-content-safety with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "nvidia/llama-3.1-nemoguard-8b-content-safety") - Notebooks
- Google Colab
- Kaggle
Usage example
4
#4 opened over 1 year ago
by
AmenRa
LORA Adapter Weights not available
2
#3 opened over 1 year ago
by
ilml
Unable to load model with PEFT due to nested file structure
👍 1
1
#1 opened over 1 year ago
by
david-rai