How to use Shekswess/mistral-7b-instruct-v0.2-bnb-4bit-medical with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Shekswess/mistral-7b-instruct-v0.2-bnb-4bit-medical", device_map="auto")
Shekswess commited on 