Instructions to use prem-research/Funcdex-1.7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use prem-research/Funcdex-1.7B with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("prem-research/Funcdex-1.7B", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -491,7 +491,7 @@ EM is a strict metric, and penalizes string arguments in function calls that may
|
|
| 491 |
|
| 492 |
## Deployment with vLLM
|
| 493 |
|
| 494 |
-
`vllm serve
|
| 495 |
|
| 496 |
# Quickstart
|
| 497 |
|
|
|
|
| 491 |
|
| 492 |
## Deployment with vLLM
|
| 493 |
|
| 494 |
+
`vllm serve ojus1/Qwen3-1.7B-Instruct --enable-lora --lora-modules prem-research/Funcdex-1.7B=prem-research/Funcdex-1.7B --enable-auto-tool-choice --tool-call-parser hermes`
|
| 495 |
|
| 496 |
# Quickstart
|
| 497 |
|