Model Details
Llama-3.3-70B-Korean-4Bit-bnb
Llama-3.3-70B-Korean-4Bit-bnb is continued pretrained(4bit quantization fine-tuned) language model based on Llama-3.3-70B-Instruct.
This model is trained fully with publicily available resource at HuggingFace dataset hub, preprocessed Korean texts.
The train was done on A6000 48GB * 4.
Model developers Dongwook Min (mindw96)
Dataset beomi/KoAlpaca-v1.1a
Input Models input text only.
Output Models generate text and code.
Model Release Date 04.01.2025.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for mindw96/Llama-3.3-70B-Korean-4Bit-bnb
Base model
meta-llama/Llama-3.1-70B Finetuned
meta-llama/Llama-3.3-70B-Instruct
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mindw96/Llama-3.3-70B-Korean-4Bit-bnb", dtype="auto")