How to use abhayesian/llama-3.3-70b-honly-rank_8-small_lr-no_hhh with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("togethercomputer/Meta-Llama-3.3-70B-Instruct-Reference") model = PeftModel.from_pretrained(base_model, "abhayesian/llama-3.3-70b-honly-rank_8-small_lr-no_hhh")
https://huggingface.co/abhayesian/llama-3.3-70b-honly-rank_8-small_lr-no_hhh/resolve/main/tokenizer.json
hf download hf://abhayesian/llama-3.3-70b-honly-rank_8-small_lr-no_hhh/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/abhayesian/llama-3.3-70b-honly-rank_8-small_lr-no_hhh/resolve/main/tokenizer.json
