Shekswess/medical_llama3_instruct_dataset_short
Viewer • Updated • 2k • 33 • 13
How to use Shekswess/llama-3-8b-Instruct-bnb-4bit-medical with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Shekswess/llama-3-8b-Instruct-bnb-4bit-medical", device_map="auto")To utilize the fine-tuning of the model, you need to use the gemma instruction prompt template for this medical version of the model:
<|start_header_id|>system<|end_header_id|> Answer the question truthfully, you are a medical professional.<|eot_id|><|start_header_id|>user<|end_header_id|> This is the question: {question}?<|eot_id|>
Metrics:
Base model
unsloth/llama-3-8b-Instruct-bnb-4bit