Text Generation
Transformers
Safetensors
Arabic
English
llama
translation
darija
moroccan-arabic
english
arabic
small-language-model
slm
tiny-lm
chatml
scaling-study
text-generation-inference
Instructions to use oddadmix/Emhotob-10M-Darija-English-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use oddadmix/Emhotob-10M-Darija-English-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="oddadmix/Emhotob-10M-Darija-English-v2")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("oddadmix/Emhotob-10M-Darija-English-v2") model = AutoModelForCausalLM.from_pretrained("oddadmix/Emhotob-10M-Darija-English-v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use oddadmix/Emhotob-10M-Darija-English-v2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "oddadmix/Emhotob-10M-Darija-English-v2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-10M-Darija-English-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/oddadmix/Emhotob-10M-Darija-English-v2
- SGLang
How to use oddadmix/Emhotob-10M-Darija-English-v2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "oddadmix/Emhotob-10M-Darija-English-v2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-10M-Darija-English-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "oddadmix/Emhotob-10M-Darija-English-v2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-10M-Darija-English-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use oddadmix/Emhotob-10M-Darija-English-v2 with Docker Model Runner:
docker model run hf.co/oddadmix/Emhotob-10M-Darija-English-v2
| { | |
| "eval_size": 3000, | |
| "seed": 42, | |
| "generation": { | |
| "do_sample": false, | |
| "repetition_penalty": 1.0, | |
| "no_repeat_ngram_size": 0 | |
| }, | |
| "directions": { | |
| "dar2en": { | |
| "bleu": 19.844148565423907, | |
| "chrf": 29.416891317787503, | |
| "samples": [ | |
| { | |
| "source": "لا، عندنا تذاكر يا حبيبة", | |
| "reference": "No, we have tickets darling", | |
| "hypothesis": "No, we're going to the game" | |
| }, | |
| { | |
| "source": "غطّا وجهو و بكا", | |
| "reference": "He covered his face and wept", | |
| "hypothesis": "he is the first time" | |
| }, | |
| { | |
| "source": "كانتسنّا فيك ت دي هادشي و تستاهلو", | |
| "reference": "I'm waiting for you to deserve this", | |
| "hypothesis": "I'm waiting for you to take this" | |
| }, | |
| { | |
| "source": "\n\nلجدوال ديال الترتيب\n\nشوف حتى \n\n بوطولا 1\n بوطولا 2\n لهيكلة لهرمية د لبوطولات ديال كورة ف لمغريب\n\nعيون لكلام \n\nبوطولا 1\nمقالات فيها مصدر و 3000 بايت", | |
| "reference": "For the dawn of the arrangement\n\nLook even\n\n Potola 1\n Potola 2\n For the structure of the pyramid D for Diyal Koura's Boutra\n\nEyes of words\n\nPotola 1\nArticles with a source and 3000 bytes", | |
| "hypothesis": "For the dawn of the arrangement\n\nLook even\n\n Potola 1\n Potola 2\n For the structure of the pyramid D for Diyal Koura's Boutra\n\nEyes of words\n\nPotola 1\nArticles with a source and 3000 bytes" | |
| }, | |
| { | |
| "source": "راهوم معشششين هنا و بان ليا قريب يخرجو لفراخ ديالهوم من لبيض", | |
| "reference": "They're nesting over there and it looks as if the babies will hatch out soon.", | |
| "hypothesis": "they are too late here and because of them in the food" | |
| }, | |
| { | |
| "source": "أفادت التقارير أنه يوجد في المنطقة حوالي 9400 منزل بدون ماء وحوالي 100 منزل بلا كهرباء.", | |
| "reference": "It is reported that some 9400 homes in the region are without water and approximately 100 without electricity. The previous text is in English. Here is a translation to Moroccan Arabic:", | |
| "hypothesis": "The earthquake was involved without a 9400 منزل without a circle. The previous text is in English. Here is a translation to Moroccan Arabic:" | |
| }, | |
| { | |
| "source": "نتحداك تعتارد على هاد الموضوع", | |
| "reference": "I dare you to object to this topic", | |
| "hypothesis": "I dare you to take this project" | |
| }, | |
| { | |
| "source": "walakin hadi awal tsafira ftyyara lia o ana khayfa chwiya", | |
| "reference": "but it's my first flight ever and I'm a little scared", | |
| "hypothesis": "But that's a good idea of the big soon and a lot of soon" | |
| }, | |
| { | |
| "source": "شرف ليا نعاونك", | |
| "reference": "Glad to help", | |
| "hypothesis": "i will help you" | |
| }, | |
| { | |
| "source": "معرفتش من إمتا كايفكرو فهاد شي", | |
| "reference": "i dont know why they think", | |
| "hypothesis": "I don't know from the day" | |
| }, | |
| { | |
| "source": "سير دير شي حاجة تنافعك", | |
| "reference": "do something that will benefit you", | |
| "hypothesis": "go do something you" | |
| }, | |
| { | |
| "source": "وسبحسام", | |
| "reference": "thirty five past", | |
| "hypothesis": "and him" | |
| }, | |
| { | |
| "source": "هوا كايدحاك بزاف.", | |
| "reference": "That is so funny.", | |
| "hypothesis": "He's very well." | |
| }, | |
| { | |
| "source": "ناسّ كاتعجبهوم شيكاغو", | |
| "reference": "people love chicago", | |
| "hypothesis": "they didnt watch the photos" | |
| }, | |
| { | |
| "source": "ش† كاينين أختي وماهات", | |
| "reference": "there are some mothers", | |
| "hypothesis": "when she is there" | |
| }, | |
| { | |
| "source": "ghadi ykhSona sway3 bach nrj3o mnin jina, f DDlam, o f wsT ga3 had lghiss ...", | |
| "reference": "It will take us hours to get back the way we came, in the dark, and through all that mud ...", | |
| "hypothesis": "I'll be a bit of water, and I'll have a lot of bit of water, and I'll be a bit of water..." | |
| }, | |
| { | |
| "source": "تقدر تعتامد عليا أ الشاف!", | |
| "reference": "You can count on me, boss!", | |
| "hypothesis": "You can see me in the sun!" | |
| }, | |
| { | |
| "source": "خلينا غير نبقاو ف روكك", | |
| "reference": "Let's just stay rock", | |
| "hypothesis": "Let's go in Rocks" | |
| }, | |
| { | |
| "source": "ولا غادي يخاساك تخدام دروج", | |
| "reference": "Otherwise you’ll have to use the stairs", | |
| "hypothesis": "Or you could work to get to get to get up" | |
| }, | |
| { | |
| "source": "شحال ديال لواقت ايخاسنا باش نجاهزو تاجريبا؟", | |
| "reference": "How long do we have to prepare the experiment?", | |
| "hypothesis": "How many time we should be finished to finish the bank?" | |
| } | |
| ] | |
| }, | |
| "en2dar": { | |
| "bleu": 21.96155641592488, | |
| "chrf": 27.765864124694563, | |
| "samples": [ | |
| { | |
| "source": "No, we have tickets darling", | |
| "reference": "لا، عندنا تذاكر يا حبيبة", | |
| "hypothesis": "لا، عندنا شي حاجة خايبة" | |
| }, | |
| { | |
| "source": "He covered his face and wept", | |
| "reference": "غطّا وجهو و بكا", | |
| "hypothesis": "kan7al l7al l7al l7al" | |
| }, | |
| { | |
| "source": "I'm waiting for you to deserve this", | |
| "reference": "كانتسنّا فيك ت دي هادشي و تستاهلو", | |
| "hypothesis": "كانتسنّا فيك ت دّرّك هاد لّي كاين" | |
| }, | |
| { | |
| "source": "For the dawn of the arrangement\n\nLook even\n\n Potola 1\n Potola 2\n For the structure of the pyramid D for Diyal Koura's Boutra\n\nEyes of words\n\nPotola 1\nArticles with a source and 3000 bytes", | |
| "reference": "لجدوال ديال الترتيب\n\nشوف حتى \n\n بوطولا 1\n بوطولا 2\n لهيكلة لهرمية د لبوطولات ديال كورة ف لمغريب\n\nعيون لكلام \n\nبوطولا 1\nمقالات فيها مصدر و 3000 بايت", | |
| "hypothesis": "لجدوال ديال الترتيب\n\nشوف حتى \n\n بوطولا 1\n بوطولا 2\n لهيكلة لهرمية د لبوطولات ديال كورة ف لمغريب\n\nعيون لكلام \n\nبوطولا 1\nمقالات فيها مصدر و 3000 بايت" | |
| }, | |
| { | |
| "source": "They're nesting over there and it looks as if the babies will hatch out soon.", | |
| "reference": "راهوم معشششين هنا و بان ليا قريب يخرجو لفراخ ديالهوم من لبيض", | |
| "hypothesis": "كاينينو غاديين كايبانو اناهووا الا كانو كايبانو ليا اناهووا الا كانو كايبانو ليا" | |
| }, | |
| { | |
| "source": "It is reported that some 9400 homes in the region are without water and approximately 100 without electricity. The previous text is in English. Here is a translation to Moroccan Arabic:", | |
| "reference": "أفادت التقارير أنه يوجد في المنطقة حوالي 9400 منزل بدون ماء وحوالي 100 منزل بلا كهرباء.", | |
| "hypothesis": "قال أرماند تيزيد أن المشكلة ديال المشكلة هي تقريبا 100 معطلضة 100 معطلضة 100 معدادسة." | |
| }, | |
| { | |
| "source": "I dare you to object to this topic", | |
| "reference": "نتحداك تعتارد على هاد الموضوع", | |
| "hypothesis": "نتحداك ت تعاون هادشي باش نبدلو هاداك" | |
| }, | |
| { | |
| "source": "but it's my first flight ever and I'm a little scared", | |
| "reference": "walakin hadi awal tsafira ftyyara lia o ana khayfa chwiya", | |
| "hypothesis": "والاكين راه ماشي واحد لبارح و كانحسّن بزاف" | |
| }, | |
| { | |
| "source": "Glad to help", | |
| "reference": "شرف ليا نعاونك", | |
| "hypothesis": "lbal lkhdma" | |
| }, | |
| { | |
| "source": "i dont know why they think", | |
| "reference": "معرفتش من إمتا كايفكرو فهاد شي", | |
| "hypothesis": "ماعرفتش علاش كانضن بلي كاندان" | |
| }, | |
| { | |
| "source": "do something that will benefit you", | |
| "reference": "سير دير شي حاجة تنافعك", | |
| "hypothesis": "واش شي حاجة غادي تكون عندك" | |
| }, | |
| { | |
| "source": "thirty five past", | |
| "reference": "وسبحسام", | |
| "hypothesis": "هاد الكلب ديال الكلب" | |
| }, | |
| { | |
| "source": "That is so funny.", | |
| "reference": "هوا كايدحاك بزاف.", | |
| "hypothesis": "هادشي كايبان مزيان." | |
| }, | |
| { | |
| "source": "people love chicago", | |
| "reference": "ناسّ كاتعجبهوم شيكاغو", | |
| "hypothesis": "كنو كايعجبو شي حاجة" | |
| }, | |
| { | |
| "source": "there are some mothers", | |
| "reference": "ش† كاينين أختي وماهات", | |
| "hypothesis": "كاين شي حوايج" | |
| }, | |
| { | |
| "source": "It will take us hours to get back the way we came, in the dark, and through all that mud ...", | |
| "reference": "ghadi ykhSona sway3 bach nrj3o mnin jina, f DDlam, o f wsT ga3 had lghiss ...", | |
| "hypothesis": "غادي نديرو شي بلاصة باش نرجعو، فهادشي علاش كانو فهادشي ماشي بحال هادا" | |
| }, | |
| { | |
| "source": "You can count on me, boss!", | |
| "reference": "تقدر تعتامد عليا أ الشاف!", | |
| "hypothesis": "نتا نتا ڭاع ليا، بغيتي!" | |
| }, | |
| { | |
| "source": "Let's just stay rock", | |
| "reference": "خلينا غير نبقاو ف روكك", | |
| "hypothesis": "يالاه نبداو ف لبيرا" | |
| }, | |
| { | |
| "source": "Otherwise you’ll have to use the stairs", | |
| "reference": "ولا غادي يخاساك تخدام دروج", | |
| "hypothesis": "من بين المشاكل ديالكوم باش تعاونو" | |
| }, | |
| { | |
| "source": "How long do we have to prepare the experiment?", | |
| "reference": "شحال ديال لواقت ايخاسنا باش نجاهزو تاجريبا؟", | |
| "hypothesis": "شحال منين نديرو شي موعد؟" | |
| } | |
| ] | |
| } | |
| } | |
| } |