Text Generation
Transformers
Safetensors
English
lora
aya
tiny-aya
multilingual
code
legesher
tiny-aya-expedition
language-decoded
unsloth
phase-2
the-stack-v1
deprecated
Instructions to use legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k
- SGLang
How to use legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Unsloth Studio
How to use legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k", max_seq_length=2048, ) - Docker Model Runner
How to use legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k with Docker Model Runner:
docker model run hf.co/legesher/language-decoded-lora-phase-2-the-stack-v1-condition-1-en-5k
| [ | |
| { | |
| "loss": 1.0164, | |
| "grad_norm": 0.039307065308094025, | |
| "learning_rate": 0.00012, | |
| "epoch": 0.03546099290780142, | |
| "step": 10 | |
| }, | |
| { | |
| "loss": 1.1027, | |
| "grad_norm": 0.03674926236271858, | |
| "learning_rate": 0.00019988926445681492, | |
| "epoch": 0.07092198581560284, | |
| "step": 20 | |
| }, | |
| { | |
| "loss": 1.1062, | |
| "grad_norm": 0.03771359100937843, | |
| "learning_rate": 0.0001986463043917528, | |
| "epoch": 0.10638297872340426, | |
| "step": 30 | |
| }, | |
| { | |
| "loss": 1.0428, | |
| "grad_norm": 0.03601245582103729, | |
| "learning_rate": 0.00019603921063437793, | |
| "epoch": 0.14184397163120568, | |
| "step": 40 | |
| }, | |
| { | |
| "loss": 1.0116, | |
| "grad_norm": 0.04361054301261902, | |
| "learning_rate": 0.0001921040354671897, | |
| "epoch": 0.1773049645390071, | |
| "step": 50 | |
| }, | |
| { | |
| "loss": 1.0443, | |
| "grad_norm": 0.04239841178059578, | |
| "learning_rate": 0.00018689519659051467, | |
| "epoch": 0.2127659574468085, | |
| "step": 60 | |
| }, | |
| { | |
| "loss": 1.0685, | |
| "grad_norm": 0.03858834505081177, | |
| "learning_rate": 0.00018048472460553257, | |
| "epoch": 0.24822695035460993, | |
| "step": 70 | |
| }, | |
| { | |
| "loss": 1.0954, | |
| "grad_norm": 0.058491941541433334, | |
| "learning_rate": 0.00017296126693671884, | |
| "epoch": 0.28368794326241137, | |
| "step": 80 | |
| }, | |
| { | |
| "loss": 1.0308, | |
| "grad_norm": 0.04502752423286438, | |
| "learning_rate": 0.00016442886196799464, | |
| "epoch": 0.3191489361702128, | |
| "step": 90 | |
| }, | |
| { | |
| "loss": 1.0046, | |
| "grad_norm": 0.03750888630747795, | |
| "learning_rate": 0.00015500550034448413, | |
| "epoch": 0.3546099290780142, | |
| "step": 100 | |
| }, | |
| { | |
| "loss": 1.0566, | |
| "grad_norm": 0.04296468198299408, | |
| "learning_rate": 0.00014482149333496454, | |
| "epoch": 0.3900709219858156, | |
| "step": 110 | |
| }, | |
| { | |
| "loss": 1.0718, | |
| "grad_norm": 0.04349366948008537, | |
| "learning_rate": 0.0001340176708181637, | |
| "epoch": 0.425531914893617, | |
| "step": 120 | |
| }, | |
| { | |
| "loss": 1.0893, | |
| "grad_norm": 0.04348432272672653, | |
| "learning_rate": 0.00012274343381211066, | |
| "epoch": 0.46099290780141844, | |
| "step": 130 | |
| }, | |
| { | |
| "loss": 1.0306, | |
| "grad_norm": 0.039543844759464264, | |
| "learning_rate": 0.00011115468847720245, | |
| "epoch": 0.49645390070921985, | |
| "step": 140 | |
| }, | |
| { | |
| "loss": 1.0367, | |
| "grad_norm": 0.03936546668410301, | |
| "learning_rate": 9.941169016269379e-05, | |
| "epoch": 0.5319148936170213, | |
| "step": 150 | |
| }, | |
| { | |
| "loss": 1.0447, | |
| "grad_norm": 0.03707996383309364, | |
| "learning_rate": 8.767682731028415e-05, | |
| "epoch": 0.5673758865248227, | |
| "step": 160 | |
| }, | |
| { | |
| "loss": 1.0971, | |
| "grad_norm": 0.04127993807196617, | |
| "learning_rate": 7.611237586016557e-05, | |
| "epoch": 0.6028368794326241, | |
| "step": 170 | |
| }, | |
| { | |
| "loss": 1.0177, | |
| "grad_norm": 0.04585001990199089, | |
| "learning_rate": 6.487825521280109e-05, | |
| "epoch": 0.6382978723404256, | |
| "step": 180 | |
| }, | |
| { | |
| "loss": 1.0081, | |
| "grad_norm": 0.04047301039099693, | |
| "learning_rate": 5.4129816778190936e-05, | |
| "epoch": 0.6737588652482269, | |
| "step": 190 | |
| }, | |
| { | |
| "loss": 1.1236, | |
| "grad_norm": 0.03668837621808052, | |
| "learning_rate": 4.401569569374668e-05, | |
| "epoch": 0.7092198581560284, | |
| "step": 200 | |
| }, | |
| { | |
| "loss": 1.1207, | |
| "grad_norm": 0.039949752390384674, | |
| "learning_rate": 3.467575541836305e-05, | |
| "epoch": 0.7446808510638298, | |
| "step": 210 | |
| }, | |
| { | |
| "loss": 1.0138, | |
| "grad_norm": 0.03711694851517677, | |
| "learning_rate": 2.6239153625937784e-05, | |
| "epoch": 0.7801418439716312, | |
| "step": 220 | |
| }, | |
| { | |
| "loss": 1.0105, | |
| "grad_norm": 0.05135485529899597, | |
| "learning_rate": 1.882255614419376e-05, | |
| "epoch": 0.8156028368794326, | |
| "step": 230 | |
| }, | |
| { | |
| "loss": 1.0054, | |
| "grad_norm": 0.04557114839553833, | |
| "learning_rate": 1.2528523637410838e-05, | |
| "epoch": 0.851063829787234, | |
| "step": 240 | |
| }, | |
| { | |
| "loss": 1.1106, | |
| "grad_norm": 0.04462781921029091, | |
| "learning_rate": 7.4440933428779e-06, | |
| "epoch": 0.8865248226950354, | |
| "step": 250 | |
| }, | |
| { | |
| "loss": 1.0755, | |
| "grad_norm": 0.03919963911175728, | |
| "learning_rate": 3.6395754735699894e-06, | |
| "epoch": 0.9219858156028369, | |
| "step": 260 | |
| }, | |
| { | |
| "loss": 1.0508, | |
| "grad_norm": 0.03482827916741371, | |
| "learning_rate": 1.1675809310361497e-06, | |
| "epoch": 0.9574468085106383, | |
| "step": 270 | |
| }, | |
| { | |
| "loss": 1.062, | |
| "grad_norm": 0.03561776503920555, | |
| "learning_rate": 6.229377380218005e-08, | |
| "epoch": 0.9929078014184397, | |
| "step": 280 | |
| }, | |
| { | |
| "train_runtime": 4962.1033, | |
| "train_samples_per_second": 0.907, | |
| "train_steps_per_second": 0.057, | |
| "total_flos": 7.86793932867502e+16, | |
| "train_loss": 1.0566039296752172, | |
| "epoch": 1.0, | |
| "step": 282 | |
| } | |
| ] |