Instructions to use AhmedSSoliman/MarianCausalLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AhmedSSoliman/MarianCausalLM with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="AhmedSSoliman/MarianCausalLM")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("AhmedSSoliman/MarianCausalLM")
model = AutoModelForCausalLM.from_pretrained("AhmedSSoliman/MarianCausalLM", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use AhmedSSoliman/MarianCausalLM with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "AhmedSSoliman/MarianCausalLM"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AhmedSSoliman/MarianCausalLM",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/AhmedSSoliman/MarianCausalLM

SGLang

How to use AhmedSSoliman/MarianCausalLM with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "AhmedSSoliman/MarianCausalLM" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AhmedSSoliman/MarianCausalLM",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "AhmedSSoliman/MarianCausalLM" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AhmedSSoliman/MarianCausalLM",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use AhmedSSoliman/MarianCausalLM with Docker Model Runner:
```
docker model run hf.co/AhmedSSoliman/MarianCausalLM
```

MarianCausalLM

Commit History

Update generation_config.json

1c3c30c

AhmedSSoliman commited on Jul 26, 2023

Update config.json

d421c05

AhmedSSoliman commited on Jul 26, 2023

Update tokenizer_config.json

99dda84

AhmedSSoliman commited on Jul 17, 2023

Update generation_config.json

703f8d1

AhmedSSoliman commited on Jul 17, 2023

Update config.json

f85ad7f

AhmedSSoliman commited on Jul 17, 2023

Update tokenizer_config.json

c675538

AhmedSSoliman commited on Jul 17, 2023

Update generation_config.json

2ea0cb7

AhmedSSoliman commited on Jul 17, 2023

Update config.json

0c4f88f

AhmedSSoliman commited on Jul 17, 2023

Update config.json

5278319

AhmedSSoliman commited on Jul 17, 2023

Update tokenizer_config.json

9922fbd

AhmedSSoliman commited on Jul 17, 2023

Update generation_config.json

8533cdd

AhmedSSoliman commited on Jul 17, 2023

Update config.json

f91cd72

AhmedSSoliman commited on Jul 17, 2023

Update tokenizer_config.json

e6e0103

AhmedSSoliman commited on Jul 17, 2023

Update generation_config.json

9501df8

AhmedSSoliman commited on Jul 17, 2023

Update config.json

ec9cc2a

AhmedSSoliman commited on Jul 17, 2023

Update tokenizer_config.json

686a775

AhmedSSoliman commited on Jul 16, 2023

Update generation_config.json

bc22590

AhmedSSoliman commited on Jul 16, 2023

Update config.json

b578f7c

AhmedSSoliman commited on Jul 16, 2023

Upload tokenizer

fc4a287

AhmedSSoliman commited on Jul 16, 2023

Upload MarianForCausalLM

e63aa78

AhmedSSoliman commited on Jul 16, 2023

initial commit

f83c15f

AhmedSSoliman commited on Jul 16, 2023

Commit History

Update generation_config.json 1c3c30c

Update config.json d421c05

Update tokenizer_config.json 99dda84

Update generation_config.json 703f8d1

Update config.json f85ad7f

Update tokenizer_config.json c675538

Update generation_config.json 2ea0cb7

Update config.json 0c4f88f

Update config.json 5278319

Update tokenizer_config.json 9922fbd

Update generation_config.json 8533cdd

Update config.json f91cd72

Update tokenizer_config.json e6e0103

Update generation_config.json 9501df8

Update config.json ec9cc2a

Update tokenizer_config.json 686a775

Update generation_config.json bc22590

Update config.json b578f7c

Upload tokenizer fc4a287

Upload MarianForCausalLM e63aa78

initial commit f83c15f

Update generation_config.json

1c3c30c

Update config.json

d421c05

Update tokenizer_config.json

99dda84

Update generation_config.json

703f8d1

Update config.json

f85ad7f

Update tokenizer_config.json

c675538

Update generation_config.json

2ea0cb7

Update config.json

0c4f88f

Update config.json

5278319

Update tokenizer_config.json

9922fbd

Update generation_config.json

8533cdd

Update config.json

f91cd72

Update tokenizer_config.json

e6e0103

Update generation_config.json

9501df8

Update config.json

ec9cc2a

Update tokenizer_config.json

686a775

Update generation_config.json

bc22590

Update config.json

b578f7c

Upload tokenizer

fc4a287

Upload MarianForCausalLM

e63aa78

initial commit

f83c15f