Text Generation
Transformers
TensorBoard
Safetensors
gemma3_text
Generated from Trainer
sft
trl
conversational
text-generation-inference
Instructions to use talha970/function-gemma-boost with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use talha970/function-gemma-boost with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="talha970/function-gemma-boost") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("talha970/function-gemma-boost") model = AutoModelForCausalLM.from_pretrained("talha970/function-gemma-boost", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use talha970/function-gemma-boost with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "talha970/function-gemma-boost" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "talha970/function-gemma-boost", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/talha970/function-gemma-boost
- SGLang
How to use talha970/function-gemma-boost with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "talha970/function-gemma-boost" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "talha970/function-gemma-boost", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "talha970/function-gemma-boost" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "talha970/function-gemma-boost", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use talha970/function-gemma-boost with Docker Model Runner:
docker model run hf.co/talha970/function-gemma-boost
| "set assignee to johny",edit_task,"{""assignee"":""johny""}" | |
| "set assignee to zayvion",edit_task,"{""assignee"":""zayvion""}" | |
| "set assignee to marcell",edit_task,"{""assignee"":""marcell""}" | |
| "set assignee to teo",edit_task,"{""assignee"":""teo""}" | |
| "set assignee to faris",edit_task,"{""assignee"":""faris""}" | |
| "set assignee to nuri",edit_task,"{""assignee"":""nuri""}" | |
| "set assignee to eshan",edit_task,"{""assignee"":""eshan""}" | |
| "set assignee to anya",edit_task,"{""assignee"":""anya""}" | |
| "set assignee to lev",edit_task,"{""assignee"":""lev""}" | |
| "set assignee to omri",edit_task,"{""assignee"":""omri""}" | |
| "set assignee to kael",edit_task,"{""assignee"":""kael""}" | |
| "set assignee to micah",edit_task,"{""assignee"":""micah""}" | |
| "set assignee to soren",edit_task,"{""assignee"":""soren""}" | |
| "set assignee to bram",edit_task,"{""assignee"":""bram""}" | |
| "set assignee to irie",edit_task,"{""assignee"":""irie""}" | |
| "assign this to johny",edit_task,"{""assignee"":""johny""}" | |
| "assign this to zayvion",edit_task,"{""assignee"":""zayvion""}" | |
| "assign this to marcell",edit_task,"{""assignee"":""marcell""}" | |
| "assign this to teo",edit_task,"{""assignee"":""teo""}" | |
| "assign this to faris",edit_task,"{""assignee"":""faris""}" | |
| "assign this to nuri",edit_task,"{""assignee"":""nuri""}" | |
| "assign this to eshan",edit_task,"{""assignee"":""eshan""}" | |
| "assign this to anya",edit_task,"{""assignee"":""anya""}" | |
| "assign this to lev",edit_task,"{""assignee"":""lev""}" | |
| "assign this to omri",edit_task,"{""assignee"":""omri""}" | |
| "assign this to kael",edit_task,"{""assignee"":""kael""}" | |
| "put johny on it",edit_task,"{""assignee"":""johny""}" | |
| "put zayvion on it",edit_task,"{""assignee"":""zayvion""}" | |
| "put marcell on it",edit_task,"{""assignee"":""marcell""}" | |
| "put teo on it",edit_task,"{""assignee"":""teo""}" | |
| "put faris on it",edit_task,"{""assignee"":""faris""}" | |
| "put nuri on it",edit_task,"{""assignee"":""nuri""}" | |
| "put eshan on it",edit_task,"{""assignee"":""eshan""}" | |
| "put anya on it",edit_task,"{""assignee"":""anya""}" | |
| "put lev on it",edit_task,"{""assignee"":""lev""}" | |
| "put omri on it",edit_task,"{""assignee"":""omri""}" | |
| "make the assignee johny",edit_task,"{""assignee"":""johny""}" | |
| "make the assignee zayvion",edit_task,"{""assignee"":""zayvion""}" | |
| "make the assignee marcell",edit_task,"{""assignee"":""marcell""}" | |
| "make the assignee teo",edit_task,"{""assignee"":""teo""}" | |
| "make the assignee faris",edit_task,"{""assignee"":""faris""}" | |
| "make the assignee nuri",edit_task,"{""assignee"":""nuri""}" | |
| "set location to bay q7",edit_task,"{""location"":""bay q7""}" | |
| "set location to room zx 14",edit_task,"{""location"":""room zx 14""}" | |
| "set location to north pit 3",edit_task,"{""location"":""north pit 3""}" | |
| "set location to corridor mint",edit_task,"{""location"":""corridor mint""}" | |
| "set location to unit k2",edit_task,"{""location"":""unit k2""}" | |
| "set location to dock c orange",edit_task,"{""location"":""dock c orange""}" | |
| "set location to attic west 9",edit_task,"{""location"":""attic west 9""}" | |
| "set location to lab beta",edit_task,"{""location"":""lab beta""}" | |
| "set location to tower 5 niche",edit_task,"{""location"":""tower 5 niche""}" | |
| "set location to vault m",edit_task,"{""location"":""vault m""}" | |
| "move this to bay q7",edit_task,"{""location"":""bay q7""}" | |
| "move this to room zx 14",edit_task,"{""location"":""room zx 14""}" | |
| "move this to north pit 3",edit_task,"{""location"":""north pit 3""}" | |
| "move this to corridor mint",edit_task,"{""location"":""corridor mint""}" | |
| "move this to unit k2",edit_task,"{""location"":""unit k2""}" | |
| "move this to dock c orange",edit_task,"{""location"":""dock c orange""}" | |
| "move this to attic west 9",edit_task,"{""location"":""attic west 9""}" | |
| "make the location lab beta",edit_task,"{""location"":""lab beta""}" | |
| "make the location tower 5 niche",edit_task,"{""location"":""tower 5 niche""}" | |
| "make the location vault m",edit_task,"{""location"":""vault m""}" | |
| "set plan to aqx 12",edit_task,"{""plan"":""aqx 12""}" | |
| "set plan to fp zebra 4",edit_task,"{""plan"":""fp zebra 4""}" | |
| "set plan to c note 17",edit_task,"{""plan"":""c note 17""}" | |
| "set plan to mep kiwi",edit_task,"{""plan"":""mep kiwi""}" | |
| "set plan to rcp delta 8",edit_task,"{""plan"":""rcp delta 8""}" | |
| "set plan to sheet plum 3",edit_task,"{""plan"":""sheet plum 3""}" | |
| "set plan to aa 19",edit_task,"{""plan"":""aa 19""}" | |
| "set plan to p memo 6",edit_task,"{""plan"":""p memo 6""}" | |
| "set plan to detail fox 2",edit_task,"{""plan"":""detail fox 2""}" | |
| "set plan to zone maple",edit_task,"{""plan"":""zone maple""}" | |
| "move this to plan aqx 12",edit_task,"{""plan"":""aqx 12""}" | |
| "move this to plan fp zebra 4",edit_task,"{""plan"":""fp zebra 4""}" | |
| "move this to plan c note 17",edit_task,"{""plan"":""c note 17""}" | |
| "move this to plan mep kiwi",edit_task,"{""plan"":""mep kiwi""}" | |
| "move this to plan rcp delta 8",edit_task,"{""plan"":""rcp delta 8""}" | |
| "make the plan sheet plum 3",edit_task,"{""plan"":""sheet plum 3""}" | |
| "make the plan aa 19",edit_task,"{""plan"":""aa 19""}" | |
| "make the plan p memo 6",edit_task,"{""plan"":""p memo 6""}" | |
| "make the plan detail fox 2",edit_task,"{""plan"":""detail fox 2""}" | |
| "make the plan zone maple",edit_task,"{""plan"":""zone maple""}" | |
| "add a comment hold for iris from unit 4",edit_task,"{""comments"":""hold for iris from unit 4""}" | |
| "add a comment leave badge at desk q",edit_task,"{""comments"":""leave badge at desk q""}" | |
| "add a comment call vendor about model x9",edit_task,"{""comments"":""call vendor about model x9""}" | |
| "add a comment access only after 6 15",edit_task,"{""comments"":""access only after 6 15""}" | |
| "add a comment do not touch valve p",edit_task,"{""comments"":""do not touch valve p""}" | |
| "add a comment send photo to arun",edit_task,"{""comments"":""send photo to arun""}" | |
| "add a comment key is with lena",edit_task,"{""comments"":""key is with lena""}" | |
| "add a comment owner asked for quiet cart wheels",edit_task,"{""comments"":""owner asked for quiet cart wheels""}" | |
| "add a comment temp sensor reads odd at noon",edit_task,"{""comments"":""temp sensor reads odd at noon""}" | |
| "add a comment use orange tape only",edit_task,"{""comments"":""use orange tape only""}" | |
| "note that hold for iris from unit 4",edit_task,"{""comments"":""hold for iris from unit 4""}" | |
| "note that leave badge at desk q",edit_task,"{""comments"":""leave badge at desk q""}" | |
| "note that call vendor about model x9",edit_task,"{""comments"":""call vendor about model x9""}" | |
| "note that access only after 6 15",edit_task,"{""comments"":""access only after 6 15""}" | |
| "note that do not touch valve p",edit_task,"{""comments"":""do not touch valve p""}" | |
| "note that send photo to arun",edit_task,"{""comments"":""send photo to arun""}" | |
| "note that key is with lena",edit_task,"{""comments"":""key is with lena""}" | |
| "note that owner asked for quiet cart wheels",edit_task,"{""comments"":""owner asked for quiet cart wheels""}" | |
| "note that temp sensor reads odd at noon",edit_task,"{""comments"":""temp sensor reads odd at noon""}" | |
| "note that use orange tape only",edit_task,"{""comments"":""use orange tape only""}" | |
| "set title to roof hatch corrosion followup",edit_task,"{""title"":""roof hatch corrosion followup""}" | |
| "set title to chilled water pump alarm 7",edit_task,"{""title"":""chilled water pump alarm 7""}" | |
| "set title to west lobby punchlist item",edit_task,"{""title"":""west lobby punchlist item""}" | |
| "set title to rtu 4 filter swap",edit_task,"{""title"":""rtu 4 filter swap""}" | |
| "set title to gc callback for unit 18",edit_task,"{""title"":""gc callback for unit 18""}" | |
| "change title to rfi pending storefront mullion",edit_task,"{""title"":""rfi pending storefront mullion""}" | |
| "change title to ahu 2 condensate reroute",edit_task,"{""title"":""ahu 2 condensate reroute""}" | |
| "change title to slab edge patch south tower",edit_task,"{""title"":""slab edge patch south tower""}" | |
| "rename to kitchen gfi nuisance trip",edit_task,"{""title"":""kitchen gfi nuisance trip""}" | |
| "rename to level 8 fan coil rattle",edit_task,"{""title"":""level 8 fan coil rattle""}" | |
| "call it millwork scratch at suite 204",edit_task,"{""title"":""millwork scratch at suite 204""}" | |
| "call it dehumidifier drain slope",edit_task,"{""title"":""dehumidifier drain slope""}" | |