How to use GemmaLatte/llama3_ko_chavis_JH with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("beomi/Llama-3-Open-Ko-8B-preview") model = PeftModel.from_pretrained(base_model, "GemmaLatte/llama3_ko_chavis_JH")
beomi/Llama-3-Open-Ko-8B-preview์ ๊ธฐ๋ฐ์ผ๋ก ํ๊ตญ์ด ํ์ธํ๋ ํ์์ต๋๋ค. ๋น ๋ฅด๊ฒ ์ข์ ๋ชจ๋ธ์ ์ ๋ก๋ ํด์ฃผ์ beomi๋๊ป ๊ฐ์ฌ๋๋ฆฝ๋๋ค.
Ko_alpaca Custom dataset์ผ๋ก ํ์ต ๋์์ต๋๋ค.
Base model
