Instructions to use Xilabs/instructmix-llama-3b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Xilabs/instructmix-llama-3b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("openlm-research/open_llama_3b_v2") model = PeftModel.from_pretrained(base_model, "Xilabs/instructmix-llama-3b") - Notebooks
- Google Colab
- Kaggle
Commit ·
212389d
1
Parent(s): 2da83ca
Update README.md
Browse files
README.md
CHANGED
|
@@ -83,7 +83,6 @@ def evaluate(
|
|
| 83 |
#print(output)
|
| 84 |
return output.split("### Response:")[1]
|
| 85 |
|
| 86 |
-
# Sample Test Instruction Used by Youtuber Sam Witteveen https://www.youtube.com/@samwitteveenai
|
| 87 |
instruction = "What is the meaning of life?"
|
| 88 |
print(evaluate(instruction, num_beams=3, temperature=0.1, max_new_tokens=256))
|
| 89 |
```
|
|
|
|
| 83 |
#print(output)
|
| 84 |
return output.split("### Response:")[1]
|
| 85 |
|
|
|
|
| 86 |
instruction = "What is the meaning of life?"
|
| 87 |
print(evaluate(instruction, num_beams=3, temperature=0.1, max_new_tokens=256))
|
| 88 |
```
|