| step generator AUROC |
| 1 deepseek-r1-distill-qwen-32b 0.2805 |
| 1 falcon3-10b-instruct 0.3570 |
| 1 gemini-1.5-pro 0.3709 |
| 1 gemini-2.0-flash 0.2720 |
| 1 gemini-pro 0.3453 |
| 1 gemini-pro-paraphrase 0.2916 |
| 1 gpt-3.5-turbo 0.3571 |
| 1 gpt-4-turbo 0.2368 |
| 1 gpt-4-turbo-paraphrase 0.2468 |
| 1 gpt-4.5-preview 0.5575 |
| 1 gpt-4o 0.3554 |
| 1 gpt-4o-mini 0.3077 |
| 1 llama-2-70b-chat 0.4459 |
| 1 llama-2-7b-chat 0.3627 |
| 1 llama-3.1-8b-instruct 0.3680 |
| 1 llama-3.3-70b-instruct 0.3066 |
| 1 ministral-8b-instruct-2410 0.3903 |
| 1 mistral-7b-instruct-v0.2 0.4420 |
| 1 mixtral-8x7b-instruct-v0.1 0.3680 |
| 1 o3-mini 0.2241 |
| 1 qwen1.5-72b-chat-8bit 0.2817 |
| 1 text-bison-002 0.3249 |
| 1 MACRO_AVG 0.3406 |
|
|
