Instructions to use BAAI/Aquila-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BAAI/Aquila-7B with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("BAAI/Aquila-7B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
8691937
1
Parent(s): e77ef02
Update README.md
Browse files
README.md
CHANGED
|
@@ -40,8 +40,8 @@ from transformers import AutoTokenizer, AutoModelForCausalLM
|
|
| 40 |
import torch
|
| 41 |
from cyg_conversation import covert_prompt_to_input_ids_with_history
|
| 42 |
|
| 43 |
-
tokenizer = AutoTokenizer.from_pretrained("BAAI/
|
| 44 |
-
model = AutoModelForCausalLM.from_pretrained("BAAI/
|
| 45 |
model.eval()
|
| 46 |
model.to("cuda:0")
|
| 47 |
vocab = tokenizer.vocab
|
|
|
|
| 40 |
import torch
|
| 41 |
from cyg_conversation import covert_prompt_to_input_ids_with_history
|
| 42 |
|
| 43 |
+
tokenizer = AutoTokenizer.from_pretrained("BAAI/Aquila-7B")
|
| 44 |
+
model = AutoModelForCausalLM.from_pretrained("BAAI/Aquila-7B")
|
| 45 |
model.eval()
|
| 46 |
model.to("cuda:0")
|
| 47 |
vocab = tokenizer.vocab
|