Instructions to use sifat-febo/banglish-companion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use sifat-febo/banglish-companion with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="sifat-febo/banglish-companion") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("sifat-febo/banglish-companion") model = AutoModelForCausalLM.from_pretrained("sifat-febo/banglish-companion", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use sifat-febo/banglish-companion with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "sifat-febo/banglish-companion" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sifat-febo/banglish-companion", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/sifat-febo/banglish-companion
- SGLang
How to use sifat-febo/banglish-companion with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "sifat-febo/banglish-companion" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sifat-febo/banglish-companion", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "sifat-febo/banglish-companion" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sifat-febo/banglish-companion", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use sifat-febo/banglish-companion with Docker Model Runner:
docker model run hf.co/sifat-febo/banglish-companion
Banglish Companion: Now It Knows How You Feel
Reads the message before it answers
A chatbot for Banglish — romanized Bengali, typed the way people actually type it. It works out what the message is asking for, then answers.
you aj mood bhalo na
model mama mood shob change hoy! Tui ki feel korchish?
Built on SmolLM2-1.7B, further trained on Banglish conversation. The layer that reads the message ships on its own as banglish-ontor, which is where to look for what it reads and how to put it in front of anything else.
Banglish e Model Card
ei model ta ki? — ekta Banglish chatbot. ekhon shune, bujhe.
ki pare? adda, khela, gaan, khabar. mon kharap er kotha shune.
ki parbe na? English/Bengali script na. choto model — sometimes bhul. doctor/lawyer na.
bipod hole? kichu message er uttor model dey na — companion.py age
oigulo dekhe ney, tomar kichu korte hobe na.
Use it
pip install transformers torch huggingface_hub
hf download sifat-febo/banglish-companion --local-dir banglish
python banglish/companion.py
That is the whole thing: it answers, then keeps talking. In your own code,
from companion import reply is the only import you need — it reads the
message with the ontor layer that ships here, checks the guard before the
model, and builds the ChatML prompt this model was trained on.
The weights are 6.8 GB (fp32) — plan for that on download and in RAM. Your own personal computer, your CPU, nothing leaves it.
Smaller, and newer. Same weights quantized: bangla-banglish-companion-gguf for llama.cpp, from 1.06 GB, and bangla-banglish-companion-mlx for Macs, 1.9 GB. There is also a newer model built on a 3B base — banglish-companion-3b and its Mac build — which answers shorter and stays closer to the question.
What the layer changes
Take the layer away and the same weights answer the same message like this:
You: aj mood bhalo na
weights only: mama mood bhalo feel kor! Jodi sad hole — ekhon karo
kichu kore khujho. Tui ki feel korte chao? Sometimes
just expressing emotion e kichu korba feel kore.
Longer, and answering a question nobody asked. The reply at the top of this page is the same weights with the layer in front. Why it is small, and why it is always on →
Picked by the Author, Not Numbers
What's published here is safetensors. The comparison below is a record of what we did locally — not a menu of downloads.
We converted all three formats (F16, Q8_0, Q4_K_M) for our own use and checked each one against the weights it came from. We compared them by hand, on the same prompts.
Q8_0 read tightest to us: better listening behavior, less advice-dumping than F16.
Limits and what it does not answer
Some messages are answered from a file that ships here rather than by the
model, and reply() checks that first on every turn. Written text, no
generation, nothing for you to wire up.
Specs
| Model | SmolLM2-1.7B fine-tune + ~0.5M parameter perception |
| Perception | a small layer reads the message first — banglish-ontor |
| Fixed answers | some messages are answered from a file, not by the model |
| Runtime | CPU. No GPU. |
| Published format | safetensors |
Which one suits you depends on your machine.
| Format | GGUF Size | Note |
|---|---|---|
| Q4_K_M | 1.06 GB | Smallest |
| Q8_0 | 1.82 GB | What we run locally |
| F16 | 3.42 GB | Closest to the published weights |
Limitations: Banglish only. May hallucinate. Not a professional advisor. Safety is best-effort; a small share of edge cases involve borderline deflections.
| Component | Status |
|---|---|
| Model weights — 1.7B base + perception layers | Open |
| BanglishBench (smoke test) | Open |
Inference pipeline (ontor/perceive.py) |
Open |
| The file that answers instead of the model | Open |
| Training data, pipeline and settings | Closed |
AI Disclosure
The author designed the system, chose the base models, ran all training and measurement on the author's own machine, read the models' conversations, and chose what to publish and what to withhold. Claude Code (Anthropic) was used as a coding and writing tool under that direction.
License
Apache 2.0
Cite the technical report, which describes how the models were built, trained and measured: https://doi.org/10.5281/zenodo.22371896
@misc{febo2026banglishcompanion,
author = {Febo, Sifat},
title = {Banglish Companion: Small Chat Models for Romanized Bengali
— Technical Report},
year = {2026},
month = sep,
publisher = {Zenodo},
version = {1.0},
doi = {10.5281/zenodo.22371896},
url = {https://doi.org/10.5281/zenodo.22371896},
note = {Repository: sifat-febo/banglish-companion}
}
- Downloads last month
- 3,248