Transformers How to use TheBloke/h2ogpt-gm-oasst1-en-2048-falcon-40b-v2-GGML with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("TheBloke/h2ogpt-gm-oasst1-en-2048-falcon-40b-v2-GGML", device_map="auto") 
