Instructions to use lilyzhng/gpt-oss-20b-tb2-sft-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use lilyzhng/gpt-oss-20b-tb2-sft-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("openai/gpt-oss-20b") model = PeftModel.from_pretrained(base_model, "lilyzhng/gpt-oss-20b-tb2-sft-lora") - Notebooks
- Google Colab
- Kaggle
gpt-oss-20b TB2 SFT LoRA (PEFT)
LoRA adapter from Tinker SFT on Nemotron 500 terminus-2 trajectories.
| Field | Value |
|---|---|
| Base model | openai/gpt-oss-20b |
| LoRA rank | 32 |
| Checkpoint | step 250 |
| Tinker | tinker://bf2715a6-440c-54c8-876c-a83603f51849:train:0/sampler_weights/000250 |
| W&B | https://wandb.ai/alchemxz/afterquery-tb2-sft/runs/a4rbl6xl |
Serve (vLLM)
vllm serve openai/gpt-oss-20b --enable-lora --enable-mixed-moe-lora-format \
--lora-modules '{"name":"tb2-sft","path":"lilyzhng/gpt-oss-20b-tb2-sft-lora","is_3d_lora_weight":false}' \
--trust-remote-code
Harbor eval model: hosted_vllm/tb2-sft with api_base=<vllm_url>/v1.
- Downloads last month
- 1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for lilyzhng/gpt-oss-20b-tb2-sft-lora
Base model
openai/gpt-oss-20b
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("openai/gpt-oss-20b") model = PeftModel.from_pretrained(base_model, "lilyzhng/gpt-oss-20b-tb2-sft-lora")