How to use TheBloke/h2ogpt-gm-oasst1-en-2048-falcon-40b-v2-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/h2ogpt-gm-oasst1-en-2048-falcon-40b-v2-GGML", device_map="auto")
Silverspoon7