Instructions to use mindw96/KULLM3_bnb_4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mindw96/KULLM3_bnb_4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mindw96/KULLM3_bnb_4bit", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| library_name: transformers | |
| language: | |
| - ko | |
| base_model: | |
| - nlpai-lab/KULLM3 | |
| base_model_relation: quantized | |
| # Model Card for Model ID | |
| <!-- Provide a quick summary of what the model is/does. --> | |
| ## Model Details | |
| **KULLM3 bnb 4bit Quantizaiton** | |
| KULLM3 bnb 4bit Quantizaiton is continued pretrained(fully fine-tuned) language model based on KULLM3. | |
| This model is trained fully with publicily available resource at HuggingFace dataset hub, preprocessed Korean texts. | |
| The train was done on RTX 3090 24GB * 1. | |
| **Model developers** Dongwook Min (mindw96) | |
| **Input** Models input text only. | |
| **Output** Models generate text only. | |
| **Model Release Date** 02.06.2024. |