---
base_model: unsloth/Qwen3-4B-unsloth-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- qwen3
- gguf
license: apache-2.0
language:
- en
---

# Eval
<pre>
+-------------+------------+-----------------+---------------+-------+---------+---------+
| Model       | Dataset    | Metric          | Subset        |   Num |   Score | Cat.0   |
+=============+============+=================+===============+=======+=========+=========+
| callq4.gguf | gpqa       | AveragePass@1   | gpqa_extended |    50 |  0.34   | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | gpqa       | AveragePass@1   | gpqa_main     |    50 |  0.32   | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | gpqa       | AveragePass@1   | gpqa_diamond  |    50 |  0.32   | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | gpqa       | AveragePass@1   | OVERALL       |   150 |  0.3267 | -       |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | gsm8k      | AverageAccuracy | main          |    50 |  0.76   | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Act.EM          | in_domain     |    42 |  0.2619 | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Act.EM          | out_of_domain |    47 |  0.3617 | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Act.EM          | OVERALL       |    89 |  0.3146 | -       |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Plan.EM         | in_domain     |     0 |  0      | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Plan.EM         | out_of_domain |     0 |  0      | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Plan.EM         | OVERALL       |     0 |  0      | -       |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | F1              | in_domain     |    42 |  0.2095 | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | F1              | out_of_domain |    47 |  0.2527 | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | F1              | OVERALL       |    89 |  0.2323 | -       |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | HalluRate       | in_domain     |    42 |  0.119  | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | HalluRate       | out_of_domain |    47 |  0.0851 | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | HalluRate       | OVERALL       |    89 |  0.1011 | -       |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Rouge-L         | in_domain     |    42 |  0.0394 | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Rouge-L         | out_of_domain |    47 |  0.0676 | default |
+-------------+------------+-----------------+---------------+-------+---------+---------+
| callq4.gguf | tool_bench | Rouge-L         | OVERALL       |    89 |  0.0543 | -       |
+-------------+------------+-----------------+---------------+-------+---------+---------+ 
</pre>