Shekswess/medical_gemma_instruct_dataset_short
Viewer • Updated • 2k • 20
How to use Shekswess/gemma-1.1-7b-it-bnb-4bit-medical with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Shekswess/gemma-1.1-7b-it-bnb-4bit-medical", device_map="auto")To utilize the fine-tuning of the model, you need to use the gemma instruction prompt template for this medical version of the model :
<start_of_turn>user Answer the question truthfully, you are a medical professional. This is the question: {question}<end_of_turn>
Metrics:
Base model
unsloth/gemma-1.1-7b-it-bnb-4bit