---
license: apache-2.0
base_model: Qwen/Qwen3-8B
tags:
  - crewai
  - code-generation
  - fine-tuned
  - gguf
  - ollama
language:
  - en
pipeline_tag: text-generation
---

# CrewAI Qwen3-8B GGUF

Fine-tuned Qwen3-8B model for generating CrewAI multi-agent code.

## Model Description

This model was fine-tuned on 2,500 high-quality CrewAI code examples to generate complete CrewAI crews including:
- Agent definitions (role, goal, backstory, tools)
- Task definitions with context dependencies
- Crew instantiation with process type
- Kickoff code with inputs

## Usage with Ollama

1. Download the GGUF file (Q4_K_M recommended for most users)
2. Create a Modelfile:

```
FROM ./qwen3-8b.Q4_K_M.gguf

TEMPLATE """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction:
{{ .System }}

### Input:
{{ .Prompt }}

### Response:
"""

PARAMETER temperature 0.7
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.2
PARAMETER stop "### Instruction:"
PARAMETER stop "### Input:"
PARAMETER num_ctx 8192
```

3. Create the model: `ollama create crewai-qwen3-8b -f Modelfile`

## Quantization Options

| File | Size | Description |
|------|------|-------------|
| Q4_K_M | ~4.7 GB | Good balance of quality/size (recommended) |
| Q5_K_M | ~5.5 GB | Better quality, larger size |
| Q8_0 | ~8.2 GB | Best quality, largest size |

## Training Details

- Base model: Qwen/Qwen3-8B
- Training framework: Unsloth
- Dataset: 2,500 CrewAI code examples in Alpaca format
- Epochs: 3
- LoRA rank: 16

## License

Apache 2.0