| 2026-04-13 09:50:51,623 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 09:50:51,623 INFO RADAR × RAID — Multi-Generator + Multi-Evasion |
| 2026-04-13 09:50:51,623 INFO strategy=mixed human=None AI=None/gen |
| 2026-04-13 09:50:51,623 INFO Active attacks: ['t5_paraphrase', 'synonym_replacement', 'homoglyphs', 'article_deletion', 'misspelling'] |
| 2026-04-13 09:50:51,623 INFO NLTK available: True |
| 2026-04-13 09:50:51,623 INFO Fixes: ls=0.15 det_every=2 clip=[0.01,0.99] warmstart=0 kl=0.001 |
| 2026-04-13 09:50:51,623 INFO device=cuda |
| 2026-04-13 09:50:51,623 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 09:50:51,623 INFO Loading custom JSONL dataset ... |
| 2026-04-13 09:50:51,623 INFO Train: /home/shushanta/target_mining_deberta/adal/train.jsonl |
| 2026-04-13 09:50:51,624 INFO Val : /home/shushanta/target_mining_deberta/adal/val.jsonl |
| 2026-04-13 09:50:51,624 INFO Caps : human=None AI=None/gen |
| 2026-04-13 09:50:51,624 INFO Loading /home/shushanta/target_mining_deberta/adal/train.jsonl ... |
| 2026-04-13 09:55:40,685 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 09:55:40,685 INFO RADAR × RAID — Multi-Generator + Multi-Evasion |
| 2026-04-13 09:55:40,685 INFO strategy=mixed human=None AI=None/gen |
| 2026-04-13 09:55:40,685 INFO Active attacks: ['t5_paraphrase', 'synonym_replacement', 'homoglyphs', 'article_deletion', 'misspelling'] |
| 2026-04-13 09:55:40,685 INFO NLTK available: True |
| 2026-04-13 09:55:40,685 INFO Fixes: ls=0.15 det_every=2 clip=[0.01,0.99] warmstart=0 kl=0.001 |
| 2026-04-13 09:55:40,685 INFO device=cuda |
| 2026-04-13 09:55:40,685 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 09:55:40,685 INFO Loading custom JSONL dataset ... |
| 2026-04-13 09:55:40,685 INFO Train: /home/shushanta/target_mining_deberta/adal/train.jsonl |
| 2026-04-13 09:55:40,685 INFO Val : /home/shushanta/target_mining_deberta/adal/val.jsonl |
| 2026-04-13 09:55:40,685 INFO Caps : human=None AI=None/gen |
| 2026-04-13 09:55:40,685 INFO Loading /home/shushanta/target_mining_deberta/adal/train.jsonl ... |
| 2026-04-13 09:56:40,467 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 09:56:40,468 INFO RADAR × RAID — Multi-Generator + Multi-Evasion |
| 2026-04-13 09:56:40,468 INFO strategy=mixed human=None AI=None/gen |
| 2026-04-13 09:56:40,468 INFO Active attacks: ['t5_paraphrase', 'synonym_replacement', 'homoglyphs', 'article_deletion', 'misspelling'] |
| 2026-04-13 09:56:40,468 INFO NLTK available: True |
| 2026-04-13 09:56:40,468 INFO Fixes: ls=0.15 det_every=2 clip=[0.01,0.99] warmstart=0 kl=0.001 |
| 2026-04-13 09:56:40,468 INFO device=cuda |
| 2026-04-13 09:56:40,468 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 09:56:40,468 INFO Loading custom JSONL dataset ... |
| 2026-04-13 09:56:40,468 INFO Train: /home/shushanta/ADAL_AI_Detector/train.jsonl |
| 2026-04-13 09:56:40,468 INFO Val : /home/shushanta/ADAL_AI_Detector/val.jsonl |
| 2026-04-13 09:56:40,468 INFO Caps : human=None AI=None/gen |
| 2026-04-13 09:56:40,468 INFO Loading /home/shushanta/ADAL_AI_Detector/train.jsonl ... |
| 2026-04-13 09:56:41,462 INFO Human texts : 9,101 |
| 2026-04-13 09:56:41,462 INFO AI generators (22): ['deepseek-r1-distill-qwen-32b', 'falcon3-10b-instruct', 'gemini-1.5-pro', 'gemini-2.0-flash', 'gemini-pro', 'gemini-pro-paraphrase', 'gpt-3.5-turbo', 'gpt-4-turbo', 'gpt-4-turbo-paraphrase', 'gpt-4.5-preview', 'gpt-4o', 'gpt-4o-mini', 'llama-2-70b-chat', 'llama-2-7b-chat', 'llama-3.1-8b-instruct', 'llama-3.3-70b-instruct', 'ministral-8b-instruct-2410', 'mistral-7b-instruct-v0.2', 'mixtral-8x7b-instruct-v0.1', 'o3-mini', 'qwen1.5-72b-chat-8bit', 'text-bison-002'] |
| 2026-04-13 09:56:41,462 INFO deepseek-r1-distill-qwen-32b -> 901 texts |
| 2026-04-13 09:56:41,462 INFO falcon3-10b-instruct -> 879 texts |
| 2026-04-13 09:56:41,462 INFO gemini-1.5-pro -> 1,072 texts |
| 2026-04-13 09:56:41,462 INFO gemini-2.0-flash -> 1,079 texts |
| 2026-04-13 09:56:41,462 INFO gemini-pro -> 276 texts |
| 2026-04-13 09:56:41,463 INFO gemini-pro-paraphrase -> 265 texts |
| 2026-04-13 09:56:41,463 INFO gpt-3.5-turbo -> 1,374 texts |
| 2026-04-13 09:56:41,463 INFO gpt-4-turbo -> 272 texts |
| 2026-04-13 09:56:41,463 INFO gpt-4-turbo-paraphrase -> 276 texts |
| 2026-04-13 09:56:41,463 INFO gpt-4.5-preview -> 278 texts |
| 2026-04-13 09:56:41,463 INFO gpt-4o -> 1,336 texts |
| 2026-04-13 09:56:41,463 INFO gpt-4o-mini -> 1,358 texts |
| 2026-04-13 09:56:41,463 INFO llama-2-70b-chat -> 269 texts |
| 2026-04-13 09:56:41,463 INFO llama-2-7b-chat -> 262 texts |
| 2026-04-13 09:56:41,463 INFO llama-3.1-8b-instruct -> 1,063 texts |
| 2026-04-13 09:56:41,463 INFO llama-3.3-70b-instruct -> 405 texts |
| 2026-04-13 09:56:41,463 INFO ministral-8b-instruct-2410 -> 1,100 texts |
| 2026-04-13 09:56:41,463 INFO mistral-7b-instruct-v0.2 -> 266 texts |
| 2026-04-13 09:56:41,463 INFO mixtral-8x7b-instruct-v0.1 -> 264 texts |
| 2026-04-13 09:56:41,463 INFO o3-mini -> 1,075 texts |
| 2026-04-13 09:56:41,463 INFO qwen1.5-72b-chat-8bit -> 271 texts |
| 2026-04-13 09:56:41,463 INFO text-bison-002 -> 265 texts |
| 2026-04-13 09:56:41,463 INFO Total AI : 14,606 |
| 2026-04-13 09:56:41,463 INFO Loading /home/shushanta/ADAL_AI_Detector/val.jsonl ... |
| 2026-04-13 09:56:41,603 INFO Human texts : 1,277 |
| 2026-04-13 09:56:41,603 INFO AI generators (22): ['deepseek-r1-distill-qwen-32b', 'falcon3-10b-instruct', 'gemini-1.5-pro', 'gemini-2.0-flash', 'gemini-pro', 'gemini-pro-paraphrase', 'gpt-3.5-turbo', 'gpt-4-turbo', 'gpt-4-turbo-paraphrase', 'gpt-4.5-preview', 'gpt-4o', 'gpt-4o-mini', 'llama-2-70b-chat', 'llama-2-7b-chat', 'llama-3.1-8b-instruct', 'llama-3.3-70b-instruct', 'ministral-8b-instruct-2410', 'mistral-7b-instruct-v0.2', 'mixtral-8x7b-instruct-v0.1', 'o3-mini', 'qwen1.5-72b-chat-8bit', 'text-bison-002'] |
| 2026-04-13 09:56:41,603 INFO deepseek-r1-distill-qwen-32b -> 106 texts |
| 2026-04-13 09:56:41,603 INFO falcon3-10b-instruct -> 113 texts |
| 2026-04-13 09:56:41,603 INFO gemini-1.5-pro -> 145 texts |
| 2026-04-13 09:56:41,603 INFO gemini-2.0-flash -> 139 texts |
| 2026-04-13 09:56:41,603 INFO gemini-pro -> 59 texts |
| 2026-04-13 09:56:41,603 INFO gemini-pro-paraphrase -> 70 texts |
| 2026-04-13 09:56:41,603 INFO gpt-3.5-turbo -> 200 texts |
| 2026-04-13 09:56:41,603 INFO gpt-4-turbo -> 63 texts |
| 2026-04-13 09:56:41,603 INFO gpt-4-turbo-paraphrase -> 59 texts |
| 2026-04-13 09:56:41,603 INFO gpt-4.5-preview -> 45 texts |
| 2026-04-13 09:56:41,603 INFO gpt-4o -> 209 texts |
| 2026-04-13 09:56:41,603 INFO gpt-4o-mini -> 214 texts |
| 2026-04-13 09:56:41,603 INFO llama-2-70b-chat -> 65 texts |
| 2026-04-13 09:56:41,603 INFO llama-2-7b-chat -> 72 texts |
| 2026-04-13 09:56:41,603 INFO llama-3.1-8b-instruct -> 158 texts |
| 2026-04-13 09:56:41,603 INFO llama-3.3-70b-instruct -> 54 texts |
| 2026-04-13 09:56:41,603 INFO ministral-8b-instruct-2410 -> 139 texts |
| 2026-04-13 09:56:41,603 INFO mistral-7b-instruct-v0.2 -> 68 texts |
| 2026-04-13 09:56:41,603 INFO mixtral-8x7b-instruct-v0.1 -> 70 texts |
| 2026-04-13 09:56:41,603 INFO o3-mini -> 132 texts |
| 2026-04-13 09:56:41,603 INFO qwen1.5-72b-chat-8bit -> 63 texts |
| 2026-04-13 09:56:41,603 INFO text-bison-002 -> 69 texts |
| 2026-04-13 09:56:41,603 INFO Total AI : 2,312 |
| 2026-04-13 09:56:41,603 INFO Train -> human=9,101 AI=14,606 |
| 2026-04-13 09:56:41,603 INFO Val -> human=1,277 AI=2,312 |
| 2026-04-13 09:56:41,603 INFO GeneratorScheduler: strategy='mixed' generators=['deepseek-r1-distill-qwen-32b', 'falcon3-10b-instruct', 'gemini-1.5-pro', 'gemini-2.0-flash', 'gemini-pro', 'gemini-pro-paraphrase', 'gpt-3.5-turbo', 'gpt-4-turbo', 'gpt-4-turbo-paraphrase', 'gpt-4.5-preview', 'gpt-4o', 'gpt-4o-mini', 'llama-2-70b-chat', 'llama-2-7b-chat', 'llama-3.1-8b-instruct', 'llama-3.3-70b-instruct', 'ministral-8b-instruct-2410', 'mistral-7b-instruct-v0.2', 'mixtral-8x7b-instruct-v0.1', 'o3-mini', 'qwen1.5-72b-chat-8bit', 'text-bison-002'] |
| 2026-04-13 09:56:41,603 INFO Loading paraphraser 'ramsrigouthamg/t5_paraphraser' … |
| 2026-04-13 09:56:42,082 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect" |
| 2026-04-13 09:56:42,277 INFO HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/ramsrigouthamg/t5_paraphraser/d78f7749656e21d8b6fdf372efb5c5d1dbce577f/tokenizer_config.json "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:42,452 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found" |
| 2026-04-13 09:56:42,614 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:42,866 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect" |
| 2026-04-13 09:56:43,032 INFO HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/ramsrigouthamg/t5_paraphraser/d78f7749656e21d8b6fdf372efb5c5d1dbce577f/config.json "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:43,197 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/model.safetensors "HTTP/1.1 404 Not Found" |
| 2026-04-13 09:56:43,386 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/model.safetensors.index.json "HTTP/1.1 404 Not Found" |
| 2026-04-13 09:56:43,551 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/pytorch_model.bin "HTTP/1.1 302 Found" |
| 2026-04-13 09:56:43,729 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/model.safetensors "HTTP/1.1 404 Not Found" |
| 2026-04-13 09:56:43,928 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:44,615 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/commits/main "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:44,911 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/discussions?p=0 "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:45,421 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/commits/refs%2Fpr%2F1 "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:45,595 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/refs%2Fpr%2F1/model.safetensors.index.json "HTTP/1.1 404 Not Found" |
| 2026-04-13 09:56:45,798 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/refs%2Fpr%2F1/model.safetensors "HTTP/1.1 302 Found" |
| 2026-04-13 09:56:46,078 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/generation_config.json "HTTP/1.1 404 Not Found" |
| 2026-04-13 09:56:46,257 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect" |
| 2026-04-13 09:56:46,350 INFO HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/ramsrigouthamg/t5_paraphraser/d78f7749656e21d8b6fdf372efb5c5d1dbce577f/config.json "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:46,681 INFO Loading detector 'roberta-large' … |
| 2026-04-13 09:56:46,856 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/tokenizer_config.json "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:47,044 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 307 Temporary Redirect" |
| 2026-04-13 09:56:47,260 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found" |
| 2026-04-13 09:56:47,472 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 307 Temporary Redirect" |
| 2026-04-13 09:56:47,675 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:48,071 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/config.json "HTTP/1.1 200 OK" |
| 2026-04-13 09:56:48,288 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/model.safetensors "HTTP/1.1 302 Found" |
| 2026-04-13 09:56:51,621 INFO Starting adversarial training loop … |
|
|
| 2026-04-13 09:57:10,442 INFO [Step 1/200] det=skip para=0.8223 raw_rwd=0.3132±0.0245 rwd=0.3132 |
| 2026-04-13 09:57:10,442 INFO per-gen rewards: deepseek=0.318 falcon3-=0.295 gemini-1=0.315 gemini-2=0.301 gemini-p=0.316 gemini-p=0.363 gpt-3.5-=0.313 gpt-4-tu=0.291 gpt-4-tu=0.289 gpt-4.5-=0.370 gpt-4o=0.315 gpt-4o-m=0.325 llama-2-=0.313 llama-2-=0.368 llama-3.=0.303 llama-3.=0.313 ministra=0.304 mistral-=0.316 mixtral-=0.301 o3-mini=0.314 qwen1.5-=0.319 text-bis=0.319 |
| 2026-04-13 10:01:51,397 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 10:01:51,397 INFO │ MACRO_AVG 0.3406 ◄ |
| 2026-04-13 10:01:51,397 INFO │ deepseek-r1-distill-qwen-32b 0.2805 |
| 2026-04-13 10:01:51,397 INFO │ falcon3-10b-instruct 0.3570 |
| 2026-04-13 10:01:51,397 INFO │ gemini-1.5-pro 0.3709 |
| 2026-04-13 10:01:51,397 INFO │ gemini-2.0-flash 0.2720 |
| 2026-04-13 10:01:51,397 INFO │ gemini-pro 0.3453 |
| 2026-04-13 10:01:51,397 INFO │ gemini-pro-paraphrase 0.2916 |
| 2026-04-13 10:01:51,397 INFO │ gpt-3.5-turbo 0.3571 |
| 2026-04-13 10:01:51,397 INFO │ gpt-4-turbo 0.2368 |
| 2026-04-13 10:01:51,397 INFO │ gpt-4-turbo-paraphrase 0.2468 |
| 2026-04-13 10:01:51,397 INFO │ gpt-4.5-preview 0.5575 |
| 2026-04-13 10:01:51,397 INFO │ gpt-4o 0.3554 |
| 2026-04-13 10:01:51,397 INFO │ gpt-4o-mini 0.3077 |
| 2026-04-13 10:01:51,397 INFO │ llama-2-70b-chat 0.4459 |
| 2026-04-13 10:01:51,397 INFO │ llama-2-7b-chat 0.3627 |
| 2026-04-13 10:01:51,397 INFO │ llama-3.1-8b-instruct 0.3680 |
| 2026-04-13 10:01:51,397 INFO │ llama-3.3-70b-instruct 0.3066 |
| 2026-04-13 10:01:51,397 INFO │ ministral-8b-instruct-2410 0.3903 |
| 2026-04-13 10:01:51,397 INFO │ mistral-7b-instruct-v0.2 0.4420 |
| 2026-04-13 10:01:51,397 INFO │ mixtral-8x7b-instruct-v0.1 0.3680 |
| 2026-04-13 10:01:51,397 INFO │ o3-mini 0.2241 |
| 2026-04-13 10:01:51,397 INFO │ qwen1.5-72b-chat-8bit 0.2817 |
| 2026-04-13 10:01:51,397 INFO │ text-bison-002 0.3249 |
| 2026-04-13 10:01:51,397 INFO │ (prev best) 0.0000 |
| 2026-04-13 10:01:51,397 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 10:01:51,398 INFO │ article_deletion 0.4621 ▲ |
| 2026-04-13 10:01:51,398 INFO │ homoglyphs 0.1819 ▼ |
| 2026-04-13 10:01:51,398 INFO │ misspelling 0.4607 ▲ |
| 2026-04-13 10:01:51,398 INFO │ no_attack 0.3165 ~ |
| 2026-04-13 10:01:51,398 INFO │ synonym_replacement 0.2741 ~ |
| 2026-04-13 10:01:51,398 INFO │ t5_paraphrase 0.0000 ▼ |
| 2026-04-13 10:01:51,398 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 10:01:53,735 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 10:01:54,769 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 10:01:54,769 INFO ✓ New best macro AUROC = 0.3406 — saved. |
| |
| 2026-04-13 10:01:54,769 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 10:01:55,327 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 10:01:55,492 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 404 Not Found" |
| 2026-04-13 10:02:00,845 INFO HTTP Request: POST https://huggingface.co/api/repos/create "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:00,846 INFO Created repo: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:02:01,519 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 404 Not Found" |
| 2026-04-13 10:02:07,859 INFO HTTP Request: POST https://huggingface.co/api/repos/create "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:07,860 INFO Created repo: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:02:07,860 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 10:02:08,019 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:09,160 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:09,362 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:09,668 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:09,882 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:22,697 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:22,884 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:23,976 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:24,191 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:25,025 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:25,219 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:26,299 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:26,300 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:02:26,300 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 10:02:26,469 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:27,144 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:27,354 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:27,551 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:27,773 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:44,603 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:02:44,604 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:02:44,604 INFO ── Hub push complete ── |
| |
| 2026-04-13 10:03:25,977 INFO [Step 2/200] det=4.1193 para=-0.0083 raw_rwd=0.3652±0.0120 rwd=0.3652 |
| 2026-04-13 10:03:25,977 INFO loss components: L_human=1.034 L_xm_original=0.519 L_t5_para=0.500 L_synonym_replacement=0.511 L_homoglyphs=0.524 L_article_deletion=0.522 L_misspelling=0.515 total=4.126 |
| 2026-04-13 10:03:25,977 INFO per-gen rewards: deepseek=0.370 falcon3-=0.359 gemini-1=0.369 gemini-2=0.371 gemini-p=0.370 gemini-p=0.370 gpt-3.5-=0.369 gpt-4-tu=0.369 gpt-4-tu=0.370 gpt-4.5-=0.371 gpt-4o=0.364 gpt-4o-m=0.370 llama-2-=0.371 llama-2-=0.368 llama-3.=0.356 llama-3.=0.354 ministra=0.359 mistral-=0.371 mixtral-=0.337 o3-mini=0.365 qwen1.5-=0.371 text-bis=0.370 |
| 2026-04-13 10:03:40,556 INFO [Step 3/200] det=skip para=-0.0203 raw_rwd=0.3662±0.0103 rwd=0.3662 |
| 2026-04-13 10:03:40,556 INFO per-gen rewards: deepseek=0.362 falcon3-=0.363 gemini-1=0.370 gemini-2=0.371 gemini-p=0.372 gemini-p=0.370 gpt-3.5-=0.370 gpt-4-tu=0.339 gpt-4-tu=0.371 gpt-4.5-=0.322 gpt-4o=0.365 gpt-4o-m=0.365 llama-2-=0.371 llama-2-=0.368 llama-3.=0.369 llama-3.=0.369 ministra=0.370 mistral-=0.368 mixtral-=0.366 o3-mini=0.363 qwen1.5-=0.370 text-bis=0.370 |
| 2026-04-13 10:04:20,359 INFO [Step 4/200] det=4.1805 para=-0.0030 raw_rwd=0.3650±0.0114 rwd=0.3650 |
| 2026-04-13 10:04:20,359 INFO loss components: L_human=0.876 L_xm_original=0.566 L_t5_para=0.595 L_synonym_replacement=0.563 L_homoglyphs=0.538 L_article_deletion=0.568 L_misspelling=0.535 total=4.241 |
| 2026-04-13 10:04:20,359 INFO per-gen rewards: deepseek=0.370 falcon3-=0.362 gemini-1=0.371 gemini-2=0.370 gemini-p=0.339 gemini-p=0.369 gpt-3.5-=0.370 gpt-4-tu=0.370 gpt-4-tu=0.369 gpt-4.5-=0.369 gpt-4o=0.371 gpt-4o-m=0.365 llama-2-=0.368 llama-2-=0.343 llama-3.=0.370 llama-3.=0.371 ministra=0.365 mistral-=0.339 mixtral-=0.369 o3-mini=0.345 qwen1.5-=0.366 text-bis=0.347 |
| 2026-04-13 10:04:34,901 INFO [Step 5/200] det=skip para=-0.0180 raw_rwd=0.3706±0.0049 rwd=0.3706 |
| 2026-04-13 10:04:34,901 INFO per-gen rewards: deepseek=0.367 falcon3-=0.374 gemini-1=0.372 gemini-2=0.372 gemini-p=0.375 gemini-p=0.373 gpt-3.5-=0.373 gpt-4-tu=0.371 gpt-4-tu=0.375 gpt-4.5-=0.372 gpt-4o=0.367 gpt-4o-m=0.368 llama-2-=0.370 llama-2-=0.373 llama-3.=0.371 llama-3.=0.364 ministra=0.371 mistral-=0.370 mixtral-=0.369 o3-mini=0.371 qwen1.5-=0.373 text-bis=0.373 |
| 2026-04-13 10:09:17,785 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 10:09:17,785 INFO │ MACRO_AVG 0.5000 ◄ |
| 2026-04-13 10:09:17,785 INFO │ deepseek-r1-distill-qwen-32b 0.6489 |
| 2026-04-13 10:09:17,785 INFO │ falcon3-10b-instruct 0.6615 |
| 2026-04-13 10:09:17,785 INFO │ gemini-1.5-pro 0.5179 |
| 2026-04-13 10:09:17,785 INFO │ gemini-2.0-flash 0.5804 |
| 2026-04-13 10:09:17,785 INFO │ gemini-pro 0.2950 |
| 2026-04-13 10:09:17,785 INFO │ gemini-pro-paraphrase 0.2680 |
| 2026-04-13 10:09:17,786 INFO │ gpt-3.5-turbo 0.4799 |
| 2026-04-13 10:09:17,786 INFO │ gpt-4-turbo 0.4235 |
| 2026-04-13 10:09:17,786 INFO │ gpt-4-turbo-paraphrase 0.2729 |
| 2026-04-13 10:09:17,786 INFO │ gpt-4.5-preview 0.7521 |
| 2026-04-13 10:09:17,786 INFO │ gpt-4o 0.6077 |
| 2026-04-13 10:09:17,786 INFO │ gpt-4o-mini 0.6023 |
| 2026-04-13 10:09:17,786 INFO │ llama-2-70b-chat 0.4436 |
| 2026-04-13 10:09:17,786 INFO │ llama-2-7b-chat 0.2951 |
| 2026-04-13 10:09:17,786 INFO │ llama-3.1-8b-instruct 0.6269 |
| 2026-04-13 10:09:17,786 INFO │ llama-3.3-70b-instruct 0.7082 |
| 2026-04-13 10:09:17,786 INFO │ ministral-8b-instruct-2410 0.6718 |
| 2026-04-13 10:09:17,786 INFO │ mistral-7b-instruct-v0.2 0.4498 |
| 2026-04-13 10:09:17,786 INFO │ mixtral-8x7b-instruct-v0.1 0.4014 |
| 2026-04-13 10:09:17,786 INFO │ o3-mini 0.6222 |
| 2026-04-13 10:09:17,786 INFO │ qwen1.5-72b-chat-8bit 0.3694 |
| 2026-04-13 10:09:17,786 INFO │ text-bison-002 0.3020 |
| 2026-04-13 10:09:17,786 INFO │ (prev best) 0.3406 |
| 2026-04-13 10:09:17,786 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 10:09:17,786 INFO │ article_deletion 0.7343 ▲ |
| 2026-04-13 10:09:17,786 INFO │ homoglyphs 0.8720 ▲ |
| 2026-04-13 10:09:17,786 INFO │ misspelling 0.8829 ▲ |
| 2026-04-13 10:09:17,786 INFO │ no_attack 0.5960 ~ |
| 2026-04-13 10:09:17,786 INFO │ synonym_replacement 0.8540 ▲ |
| 2026-04-13 10:09:17,786 INFO │ t5_paraphrase 0.8000 ▲ |
| 2026-04-13 10:09:17,786 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 10:09:22,676 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 10:09:24,820 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 10:09:24,820 INFO ✓ New best macro AUROC = 0.5000 — saved. |
| |
| 2026-04-13 10:09:24,820 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 10:09:25,239 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 10:09:25,445 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 10:09:25,446 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:09:25,647 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 10:09:25,648 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:09:25,649 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 10:09:25,832 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:09:27,000 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:09:27,241 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:09:27,456 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:34,627 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:34,760 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:35,635 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:35,775 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:36,652 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:36,817 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:37,446 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:37,447 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:10:37,447 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 10:10:37,558 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:38,175 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:38,317 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:38,451 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:54,451 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:10:54,452 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:10:54,452 INFO ── Hub push complete ── |
| |
| 2026-04-13 10:11:35,076 INFO [Step 6/200] det=4.2146 para=-0.0013 raw_rwd=0.3691±0.0063 rwd=0.3691 |
| 2026-04-13 10:11:35,076 INFO loss components: L_human=0.822 L_xm_original=0.617 L_t5_para=0.559 L_synonym_replacement=0.550 L_homoglyphs=0.571 L_article_deletion=0.595 L_misspelling=0.593 total=4.307 |
| 2026-04-13 10:11:35,076 INFO per-gen rewards: deepseek=0.368 falcon3-=0.370 gemini-1=0.369 gemini-2=0.369 gemini-p=0.372 gemini-p=0.370 gpt-3.5-=0.368 gpt-4-tu=0.371 gpt-4-tu=0.372 gpt-4.5-=0.373 gpt-4o=0.372 gpt-4o-m=0.372 llama-2-=0.368 llama-2-=0.370 llama-3.=0.363 llama-3.=0.368 ministra=0.368 mistral-=0.372 mixtral-=0.370 o3-mini=0.371 qwen1.5-=0.349 text-bis=0.370 |
| 2026-04-13 10:11:49,675 INFO [Step 7/200] det=skip para=-0.0121 raw_rwd=0.3680±0.0029 rwd=0.3680 |
| 2026-04-13 10:11:49,675 INFO per-gen rewards: deepseek=0.369 falcon3-=0.368 gemini-1=0.367 gemini-2=0.369 gemini-p=0.368 gemini-p=0.362 gpt-3.5-=0.369 gpt-4-tu=0.371 gpt-4-tu=0.370 gpt-4.5-=0.367 gpt-4o=0.368 gpt-4o-m=0.365 llama-2-=0.370 llama-2-=0.368 llama-3.=0.370 llama-3.=0.370 ministra=0.367 mistral-=0.368 mixtral-=0.365 o3-mini=0.368 qwen1.5-=0.368 text-bis=0.371 |
| 2026-04-13 10:12:30,038 INFO [Step 8/200] det=4.2973 para=-0.0002 raw_rwd=0.3678±0.0025 rwd=0.3678 |
| 2026-04-13 10:12:30,038 INFO loss components: L_human=0.682 L_xm_original=0.703 L_t5_para=0.534 L_synonym_replacement=0.525 L_homoglyphs=0.570 L_article_deletion=0.617 L_misspelling=0.599 total=4.230 |
| 2026-04-13 10:12:30,038 INFO per-gen rewards: deepseek=0.369 falcon3-=0.365 gemini-1=0.367 gemini-2=0.368 gemini-p=0.370 gemini-p=0.365 gpt-3.5-=0.368 gpt-4-tu=0.371 gpt-4-tu=0.368 gpt-4.5-=0.369 gpt-4o=0.369 gpt-4o-m=0.369 llama-2-=0.365 llama-2-=0.370 llama-3.=0.367 llama-3.=0.367 ministra=0.366 mistral-=0.367 mixtral-=0.370 o3-mini=0.368 qwen1.5-=0.366 text-bis=0.371 |
| 2026-04-13 10:12:44,582 INFO [Step 9/200] det=skip para=-0.0186 raw_rwd=0.3566±0.0038 rwd=0.3566 |
| 2026-04-13 10:12:44,582 INFO per-gen rewards: deepseek=0.356 falcon3-=0.356 gemini-1=0.354 gemini-2=0.358 gemini-p=0.359 gemini-p=0.348 gpt-3.5-=0.356 gpt-4-tu=0.357 gpt-4-tu=0.356 gpt-4.5-=0.357 gpt-4o=0.357 gpt-4o-m=0.358 llama-2-=0.358 llama-2-=0.356 llama-3.=0.356 llama-3.=0.359 ministra=0.358 mistral-=0.358 mixtral-=0.359 o3-mini=0.356 qwen1.5-=0.357 text-bis=0.357 |
| 2026-04-13 10:13:24,922 INFO [Step 10/200] det=4.0340 para=-0.0148 raw_rwd=0.3560±0.0047 rwd=0.3560 |
| 2026-04-13 10:13:24,922 INFO loss components: L_human=0.586 L_xm_original=0.575 L_t5_para=0.505 L_synonym_replacement=0.522 L_homoglyphs=0.471 L_article_deletion=0.618 L_misspelling=0.490 total=3.767 |
| 2026-04-13 10:13:24,922 INFO per-gen rewards: deepseek=0.358 falcon3-=0.357 gemini-1=0.359 gemini-2=0.353 gemini-p=0.355 gemini-p=0.360 gpt-3.5-=0.356 gpt-4-tu=0.358 gpt-4-tu=0.359 gpt-4.5-=0.358 gpt-4o=0.357 gpt-4o-m=0.356 llama-2-=0.349 llama-2-=0.345 llama-3.=0.357 llama-3.=0.354 ministra=0.354 mistral-=0.358 mixtral-=0.357 o3-mini=0.354 qwen1.5-=0.358 text-bis=0.357 |
| 2026-04-13 10:18:09,837 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 10:18:09,837 INFO │ MACRO_AVG 0.8495 ◄ |
| 2026-04-13 10:18:09,837 INFO │ deepseek-r1-distill-qwen-32b 0.8016 |
| 2026-04-13 10:18:09,837 INFO │ falcon3-10b-instruct 0.8637 |
| 2026-04-13 10:18:09,837 INFO │ gemini-1.5-pro 0.7614 |
| 2026-04-13 10:18:09,838 INFO │ gemini-2.0-flash 0.8156 |
| 2026-04-13 10:18:09,838 INFO │ gemini-pro 0.7949 |
| 2026-04-13 10:18:09,838 INFO │ gemini-pro-paraphrase 0.8390 |
| 2026-04-13 10:18:09,838 INFO │ gpt-3.5-turbo 0.9181 |
| 2026-04-13 10:18:09,838 INFO │ gpt-4-turbo 0.8849 |
| 2026-04-13 10:18:09,838 INFO │ gpt-4-turbo-paraphrase 0.8713 |
| 2026-04-13 10:18:09,838 INFO │ gpt-4.5-preview 0.8622 |
| 2026-04-13 10:18:09,838 INFO │ gpt-4o 0.9151 |
| 2026-04-13 10:18:09,838 INFO │ gpt-4o-mini 0.9161 |
| 2026-04-13 10:18:09,838 INFO │ llama-2-70b-chat 0.8170 |
| 2026-04-13 10:18:09,838 INFO │ llama-2-7b-chat 0.8096 |
| 2026-04-13 10:18:09,838 INFO │ llama-3.1-8b-instruct 0.8324 |
| 2026-04-13 10:18:09,838 INFO │ llama-3.3-70b-instruct 0.8892 |
| 2026-04-13 10:18:09,838 INFO │ ministral-8b-instruct-2410 0.8536 |
| 2026-04-13 10:18:09,838 INFO │ mistral-7b-instruct-v0.2 0.8488 |
| 2026-04-13 10:18:09,838 INFO │ mixtral-8x7b-instruct-v0.1 0.8051 |
| 2026-04-13 10:18:09,838 INFO │ o3-mini 0.9089 |
| 2026-04-13 10:18:09,838 INFO │ qwen1.5-72b-chat-8bit 0.8448 |
| 2026-04-13 10:18:09,838 INFO │ text-bison-002 0.8355 |
| 2026-04-13 10:18:09,838 INFO │ (prev best) 0.5000 |
| 2026-04-13 10:18:09,838 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 10:18:09,838 INFO │ article_deletion 0.9445 ▲ |
| 2026-04-13 10:18:09,838 INFO │ homoglyphs 1.0000 ▲ |
| 2026-04-13 10:18:09,838 INFO │ misspelling 0.9736 ▲ |
| 2026-04-13 10:18:09,838 INFO │ no_attack 0.8791 ~ |
| 2026-04-13 10:18:09,838 INFO │ synonym_replacement 0.9994 ▲ |
| 2026-04-13 10:18:09,838 INFO │ t5_paraphrase 0.9800 ▲ |
| 2026-04-13 10:18:09,838 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 10:18:14,512 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 10:18:16,630 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 10:18:16,631 INFO ✓ New best macro AUROC = 0.8495 — saved. |
| |
| 2026-04-13 10:18:16,631 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 10:18:16,885 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 10:18:17,008 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 10:18:17,010 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:18:17,131 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 10:18:17,131 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:18:17,132 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 10:18:17,246 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:18:18,637 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:18:18,785 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:18:18,952 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:18:19,084 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:16,802 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:16,985 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:17,698 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:17,850 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:18,740 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:18,881 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:19,644 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:19,644 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:19:19,644 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 10:19:19,755 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:20,376 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:20,520 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:20,654 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:20,765 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:36,740 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:19:36,741 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:19:36,741 INFO ── Hub push complete ── |
| |
| 2026-04-13 10:19:51,780 INFO [Step 11/200] det=skip para=-0.0066 raw_rwd=0.3342±0.0127 rwd=0.3342 |
| 2026-04-13 10:19:51,780 INFO per-gen rewards: deepseek=0.331 falcon3-=0.319 gemini-1=0.340 gemini-2=0.339 gemini-p=0.338 gemini-p=0.337 gpt-3.5-=0.340 gpt-4-tu=0.298 gpt-4-tu=0.338 gpt-4.5-=0.338 gpt-4o=0.325 gpt-4o-m=0.340 llama-2-=0.338 llama-2-=0.341 llama-3.=0.339 llama-3.=0.339 ministra=0.329 mistral-=0.342 mixtral-=0.343 o3-mini=0.333 qwen1.5-=0.339 text-bis=0.336 |
| 2026-04-13 10:20:32,136 INFO [Step 12/200] det=3.7279 para=0.0000 raw_rwd=0.3312±0.0164 rwd=0.3312 |
| 2026-04-13 10:20:32,136 INFO loss components: L_human=0.643 L_xm_original=0.545 L_t5_para=0.473 L_synonym_replacement=0.438 L_homoglyphs=0.428 L_article_deletion=0.459 L_misspelling=0.457 total=3.443 |
| 2026-04-13 10:20:32,136 INFO per-gen rewards: deepseek=0.330 falcon3-=0.325 gemini-1=0.340 gemini-2=0.339 gemini-p=0.340 gemini-p=0.307 gpt-3.5-=0.334 gpt-4-tu=0.296 gpt-4-tu=0.298 gpt-4.5-=0.341 gpt-4o=0.331 gpt-4o-m=0.329 llama-2-=0.338 llama-2-=0.335 llama-3.=0.332 llama-3.=0.319 ministra=0.331 mistral-=0.337 mixtral-=0.340 o3-mini=0.330 qwen1.5-=0.336 text-bis=0.341 |
| 2026-04-13 10:20:46,603 INFO [Step 13/200] det=skip para=-0.0293 raw_rwd=0.3091±0.0274 rwd=0.3091 |
| 2026-04-13 10:20:46,604 INFO per-gen rewards: deepseek=0.283 falcon3-=0.301 gemini-1=0.306 gemini-2=0.319 gemini-p=0.322 gemini-p=0.261 gpt-3.5-=0.319 gpt-4-tu=0.318 gpt-4-tu=0.319 gpt-4.5-=0.323 gpt-4o=0.320 gpt-4o-m=0.320 llama-2-=0.312 llama-2-=0.320 llama-3.=0.288 llama-3.=0.316 ministra=0.305 mistral-=0.318 mixtral-=0.318 o3-mini=0.316 qwen1.5-=0.251 text-bis=0.324 |
| 2026-04-13 10:21:26,810 INFO [Step 14/200] det=3.4187 para=-0.0442 raw_rwd=0.3110±0.0264 rwd=0.3110 |
| 2026-04-13 10:21:26,810 INFO loss components: L_human=0.466 L_xm_original=0.536 L_t5_para=0.483 L_synonym_replacement=0.449 L_homoglyphs=0.438 L_article_deletion=0.471 L_misspelling=0.451 total=3.294 |
| 2026-04-13 10:21:26,810 INFO per-gen rewards: deepseek=0.321 falcon3-=0.308 gemini-1=0.318 gemini-2=0.318 gemini-p=0.321 gemini-p=0.317 gpt-3.5-=0.281 gpt-4-tu=0.256 gpt-4-tu=0.319 gpt-4.5-=0.321 gpt-4o=0.317 gpt-4o-m=0.306 llama-2-=0.319 llama-2-=0.318 llama-3.=0.317 llama-3.=0.320 ministra=0.305 mistral-=0.319 mixtral-=0.318 o3-mini=0.318 qwen1.5-=0.315 text-bis=0.318 |
| 2026-04-13 10:21:41,526 INFO [Step 15/200] det=skip para=-0.0307 raw_rwd=0.2835±0.0418 rwd=0.2835 |
| 2026-04-13 10:21:41,526 INFO per-gen rewards: deepseek=0.300 falcon3-=0.271 gemini-1=0.258 gemini-2=0.262 gemini-p=0.304 gemini-p=0.294 gpt-3.5-=0.283 gpt-4-tu=0.308 gpt-4-tu=0.299 gpt-4.5-=0.289 gpt-4o=0.288 gpt-4o-m=0.280 llama-2-=0.304 llama-2-=0.291 llama-3.=0.301 llama-3.=0.296 ministra=0.261 mistral-=0.280 mixtral-=0.294 o3-mini=0.298 qwen1.5-=0.294 text-bis=0.305 |
| 2026-04-13 10:26:24,018 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 10:26:24,018 INFO │ MACRO_AVG 0.9307 ◄ |
| 2026-04-13 10:26:24,018 INFO │ deepseek-r1-distill-qwen-32b 0.9608 |
| 2026-04-13 10:26:24,018 INFO │ falcon3-10b-instruct 0.9834 |
| 2026-04-13 10:26:24,018 INFO │ gemini-1.5-pro 0.8948 |
| 2026-04-13 10:26:24,018 INFO │ gemini-2.0-flash 0.9442 |
| 2026-04-13 10:26:24,019 INFO │ gemini-pro 0.8394 |
| 2026-04-13 10:26:24,019 INFO │ gemini-pro-paraphrase 0.8759 |
| 2026-04-13 10:26:24,019 INFO │ gpt-3.5-turbo 0.9910 |
| 2026-04-13 10:26:24,019 INFO │ gpt-4-turbo 0.9544 |
| 2026-04-13 10:26:24,019 INFO │ gpt-4-turbo-paraphrase 0.9308 |
| 2026-04-13 10:26:24,019 INFO │ gpt-4.5-preview 0.9348 |
| 2026-04-13 10:26:24,019 INFO │ gpt-4o 0.9893 |
| 2026-04-13 10:26:24,019 INFO │ gpt-4o-mini 0.9899 |
| 2026-04-13 10:26:24,019 INFO │ llama-2-70b-chat 0.8703 |
| 2026-04-13 10:26:24,019 INFO │ llama-2-7b-chat 0.8655 |
| 2026-04-13 10:26:24,019 INFO │ llama-3.1-8b-instruct 0.9294 |
| 2026-04-13 10:26:24,019 INFO │ llama-3.3-70b-instruct 0.9798 |
| 2026-04-13 10:26:24,019 INFO │ ministral-8b-instruct-2410 0.9783 |
| 2026-04-13 10:26:24,019 INFO │ mistral-7b-instruct-v0.2 0.8875 |
| 2026-04-13 10:26:24,019 INFO │ mixtral-8x7b-instruct-v0.1 0.8637 |
| 2026-04-13 10:26:24,019 INFO │ o3-mini 0.9883 |
| 2026-04-13 10:26:24,019 INFO │ qwen1.5-72b-chat-8bit 0.9191 |
| 2026-04-13 10:26:24,019 INFO │ text-bison-002 0.9046 |
| 2026-04-13 10:26:24,019 INFO │ (prev best) 0.8495 |
| 2026-04-13 10:26:24,019 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 10:26:24,019 INFO │ article_deletion 0.9925 ~ |
| 2026-04-13 10:26:24,019 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 10:26:24,019 INFO │ misspelling 0.9957 ~ |
| 2026-04-13 10:26:24,019 INFO │ no_attack 0.9731 ~ |
| 2026-04-13 10:26:24,019 INFO │ synonym_replacement 0.9981 ~ |
| 2026-04-13 10:26:24,019 INFO │ t5_paraphrase 0.9800 ~ |
| 2026-04-13 10:26:24,019 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 10:26:28,637 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 10:26:30,752 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 10:26:30,752 INFO ✓ New best macro AUROC = 0.9307 — saved. |
| |
| 2026-04-13 10:26:30,752 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 10:26:31,169 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 10:26:31,395 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 10:26:31,396 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:26:31,628 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 10:26:31,629 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:26:31,630 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 10:26:31,844 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:26:32,996 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:26:33,175 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:26:33,325 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:34,669 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:34,804 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:35,596 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:35,730 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:36,385 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:36,539 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:37,532 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:37,533 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:27:37,533 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 10:27:37,647 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:38,271 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:38,433 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:38,563 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:52,893 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:27:52,894 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:27:52,894 INFO ── Hub push complete ── |
| |
| 2026-04-13 10:28:33,569 INFO [Step 16/200] det=3.3040 para=-0.0040 raw_rwd=0.2819±0.0352 rwd=0.2819 |
| 2026-04-13 10:28:33,569 INFO loss components: L_human=0.437 L_xm_original=0.484 L_t5_para=0.453 L_synonym_replacement=0.436 L_homoglyphs=0.433 L_article_deletion=0.436 L_misspelling=0.436 total=3.115 |
| 2026-04-13 10:28:33,569 INFO per-gen rewards: deepseek=0.289 falcon3-=0.264 gemini-1=0.261 gemini-2=0.298 gemini-p=0.222 gemini-p=0.300 gpt-3.5-=0.286 gpt-4-tu=0.304 gpt-4-tu=0.298 gpt-4.5-=0.295 gpt-4o=0.301 gpt-4o-m=0.251 llama-2-=0.299 llama-2-=0.221 llama-3.=0.279 llama-3.=0.299 ministra=0.297 mistral-=0.297 mixtral-=0.297 o3-mini=0.278 qwen1.5-=0.301 text-bis=0.300 |
| 2026-04-13 10:28:48,285 INFO [Step 17/200] det=skip para=-0.0038 raw_rwd=0.2548±0.0413 rwd=0.2548 |
| 2026-04-13 10:28:48,286 INFO per-gen rewards: deepseek=0.268 falcon3-=0.272 gemini-1=0.268 gemini-2=0.272 gemini-p=0.271 gemini-p=0.273 gpt-3.5-=0.246 gpt-4-tu=0.264 gpt-4-tu=0.268 gpt-4.5-=0.270 gpt-4o=0.270 gpt-4o-m=0.241 llama-2-=0.271 llama-2-=0.144 llama-3.=0.222 llama-3.=0.269 ministra=0.241 mistral-=0.148 mixtral-=0.272 o3-mini=0.270 qwen1.5-=0.279 text-bis=0.243 |
| 2026-04-13 10:29:28,249 INFO [Step 18/200] det=3.2222 para=-0.0115 raw_rwd=0.2549±0.0401 rwd=0.2549 |
| 2026-04-13 10:29:28,250 INFO loss components: L_human=0.436 L_xm_original=0.533 L_t5_para=0.449 L_synonym_replacement=0.470 L_homoglyphs=0.427 L_article_deletion=0.470 L_misspelling=0.445 total=3.231 |
| 2026-04-13 10:29:28,250 INFO per-gen rewards: deepseek=0.264 falcon3-=0.269 gemini-1=0.235 gemini-2=0.270 gemini-p=0.268 gemini-p=0.269 gpt-3.5-=0.225 gpt-4-tu=0.264 gpt-4-tu=0.258 gpt-4.5-=0.148 gpt-4o=0.247 gpt-4o-m=0.268 llama-2-=0.268 llama-2-=0.273 llama-3.=0.245 llama-3.=0.264 ministra=0.266 mistral-=0.267 mixtral-=0.271 o3-mini=0.262 qwen1.5-=0.263 text-bis=0.281 |
| 2026-04-13 10:29:42,913 INFO [Step 19/200] det=skip para=-0.0567 raw_rwd=0.2258±0.0337 rwd=0.2258 |
| 2026-04-13 10:29:42,913 INFO per-gen rewards: deepseek=0.230 falcon3-=0.224 gemini-1=0.229 gemini-2=0.232 gemini-p=0.229 gemini-p=0.228 gpt-3.5-=0.231 gpt-4-tu=0.223 gpt-4-tu=0.242 gpt-4.5-=0.068 gpt-4o=0.210 gpt-4o-m=0.228 llama-2-=0.246 llama-2-=0.236 llama-3.=0.240 llama-3.=0.238 ministra=0.209 mistral-=0.213 mixtral-=0.252 o3-mini=0.238 qwen1.5-=0.227 text-bis=0.247 |
| 2026-04-13 10:30:23,535 INFO [Step 20/200] det=3.1385 para=-0.0000 raw_rwd=0.2063±0.0539 rwd=0.2063 |
| 2026-04-13 10:30:23,535 INFO loss components: L_human=0.433 L_xm_original=0.512 L_t5_para=0.457 L_synonym_replacement=0.451 L_homoglyphs=0.430 L_article_deletion=0.445 L_misspelling=0.434 total=3.163 |
| 2026-04-13 10:30:23,535 INFO per-gen rewards: deepseek=0.204 falcon3-=0.167 gemini-1=0.207 gemini-2=0.233 gemini-p=0.212 gemini-p=0.246 gpt-3.5-=0.210 gpt-4-tu=0.237 gpt-4-tu=0.095 gpt-4.5-=0.225 gpt-4o=0.227 gpt-4o-m=0.207 llama-2-=0.213 llama-2-=0.236 llama-3.=0.203 llama-3.=0.156 ministra=0.240 mistral-=0.083 mixtral-=0.234 o3-mini=0.178 qwen1.5-=0.231 text-bis=0.231 |
| 2026-04-13 10:35:06,326 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 10:35:06,327 INFO │ MACRO_AVG 0.9875 ◄ |
| 2026-04-13 10:35:06,327 INFO │ deepseek-r1-distill-qwen-32b 0.9988 |
| 2026-04-13 10:35:06,327 INFO │ falcon3-10b-instruct 0.9995 |
| 2026-04-13 10:35:06,327 INFO │ gemini-1.5-pro 0.9606 |
| 2026-04-13 10:35:06,327 INFO │ gemini-2.0-flash 0.9988 |
| 2026-04-13 10:35:06,327 INFO │ gemini-pro 0.9650 |
| 2026-04-13 10:35:06,327 INFO │ gemini-pro-paraphrase 0.9663 |
| 2026-04-13 10:35:06,327 INFO │ gpt-3.5-turbo 0.9985 |
| 2026-04-13 10:35:06,327 INFO │ gpt-4-turbo 0.9945 |
| 2026-04-13 10:35:06,327 INFO │ gpt-4-turbo-paraphrase 0.9839 |
| 2026-04-13 10:35:06,327 INFO │ gpt-4.5-preview 0.9946 |
| 2026-04-13 10:35:06,327 INFO │ gpt-4o 0.9992 |
| 2026-04-13 10:35:06,327 INFO │ gpt-4o-mini 0.9995 |
| 2026-04-13 10:35:06,327 INFO │ llama-2-70b-chat 0.9804 |
| 2026-04-13 10:35:06,327 INFO │ llama-2-7b-chat 0.9761 |
| 2026-04-13 10:35:06,327 INFO │ llama-3.1-8b-instruct 0.9870 |
| 2026-04-13 10:35:06,327 INFO │ llama-3.3-70b-instruct 0.9966 |
| 2026-04-13 10:35:06,327 INFO │ ministral-8b-instruct-2410 0.9992 |
| 2026-04-13 10:35:06,327 INFO │ mistral-7b-instruct-v0.2 0.9784 |
| 2026-04-13 10:35:06,327 INFO │ mixtral-8x7b-instruct-v0.1 0.9759 |
| 2026-04-13 10:35:06,327 INFO │ o3-mini 0.9995 |
| 2026-04-13 10:35:06,327 INFO │ qwen1.5-72b-chat-8bit 0.9879 |
| 2026-04-13 10:35:06,327 INFO │ text-bison-002 0.9853 |
| 2026-04-13 10:35:06,327 INFO │ (prev best) 0.9307 |
| 2026-04-13 10:35:06,327 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 10:35:06,327 INFO │ article_deletion 0.9964 ~ |
| 2026-04-13 10:35:06,327 INFO │ homoglyphs 0.9992 ~ |
| 2026-04-13 10:35:06,327 INFO │ misspelling 0.9976 ~ |
| 2026-04-13 10:35:06,327 INFO │ no_attack 0.9948 ~ |
| 2026-04-13 10:35:06,327 INFO │ synonym_replacement 0.9961 ~ |
| 2026-04-13 10:35:06,327 INFO │ t5_paraphrase 0.9800 ~ |
| 2026-04-13 10:35:06,327 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 10:35:11,101 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 10:35:13,197 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 10:35:13,197 INFO ✓ New best macro AUROC = 0.9875 — saved. |
| |
| 2026-04-13 10:35:13,197 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 10:35:13,385 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 10:35:13,506 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 10:35:13,508 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:35:13,628 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 10:35:13,629 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:35:13,629 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 10:35:13,741 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:35:14,812 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:35:14,955 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:35:15,082 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:35:15,197 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:09,956 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:10,129 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:10,981 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:11,162 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:11,886 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:12,181 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:12,926 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:12,927 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:36:12,927 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 10:36:13,037 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:13,663 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:13,805 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:13,935 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:14,061 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:31,164 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:36:31,165 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:36:31,165 INFO ── Hub push complete ── |
| |
| 2026-04-13 10:36:46,070 INFO [Step 21/200] det=skip para=-0.0019 raw_rwd=0.1889±0.0406 rwd=0.1889 |
| 2026-04-13 10:36:46,070 INFO per-gen rewards: deepseek=0.177 falcon3-=0.202 gemini-1=0.164 gemini-2=0.176 gemini-p=0.144 gemini-p=0.195 gpt-3.5-=0.205 gpt-4-tu=0.164 gpt-4-tu=0.077 gpt-4.5-=0.224 gpt-4o=0.188 gpt-4o-m=0.172 llama-2-=0.163 llama-2-=0.205 llama-3.=0.204 llama-3.=0.213 ministra=0.204 mistral-=0.211 mixtral-=0.207 o3-mini=0.198 qwen1.5-=0.232 text-bis=0.200 |
| 2026-04-13 10:37:26,915 INFO [Step 22/200] det=3.1162 para=0.0000 raw_rwd=0.1821±0.0432 rwd=0.1821 |
| 2026-04-13 10:37:26,916 INFO loss components: L_human=0.486 L_xm_original=0.435 L_t5_para=0.446 L_synonym_replacement=0.439 L_homoglyphs=0.428 L_article_deletion=0.434 L_misspelling=0.433 total=3.101 |
| 2026-04-13 10:37:26,916 INFO per-gen rewards: deepseek=0.204 falcon3-=0.195 gemini-1=0.152 gemini-2=0.194 gemini-p=0.226 gemini-p=0.179 gpt-3.5-=0.160 gpt-4-tu=0.193 gpt-4-tu=0.075 gpt-4.5-=0.208 gpt-4o=0.208 gpt-4o-m=0.178 llama-2-=0.062 llama-2-=0.205 llama-3.=0.210 llama-3.=0.178 ministra=0.198 mistral-=0.190 mixtral-=0.174 o3-mini=0.176 qwen1.5-=0.199 text-bis=0.066 |
| 2026-04-13 10:37:41,623 INFO [Step 23/200] det=skip para=-0.0000 raw_rwd=0.1795±0.0224 rwd=0.1795 |
| 2026-04-13 10:37:41,623 INFO per-gen rewards: deepseek=0.188 falcon3-=0.189 gemini-1=0.173 gemini-2=0.179 gemini-p=0.176 gemini-p=0.203 gpt-3.5-=0.179 gpt-4-tu=0.157 gpt-4-tu=0.206 gpt-4.5-=0.198 gpt-4o=0.188 gpt-4o-m=0.187 llama-2-=0.191 llama-2-=0.199 llama-3.=0.169 llama-3.=0.185 ministra=0.169 mistral-=0.183 mixtral-=0.154 o3-mini=0.165 qwen1.5-=0.180 text-bis=0.162 |
| 2026-04-13 10:38:21,946 INFO [Step 24/200] det=3.1562 para=-0.0010 raw_rwd=0.1821±0.0233 rwd=0.1821 |
| 2026-04-13 10:38:21,946 INFO loss components: L_human=0.477 L_xm_original=0.504 L_t5_para=0.436 L_synonym_replacement=0.444 L_homoglyphs=0.433 L_article_deletion=0.466 L_misspelling=0.437 total=3.196 |
| 2026-04-13 10:38:21,946 INFO per-gen rewards: deepseek=0.174 falcon3-=0.191 gemini-1=0.192 gemini-2=0.173 gemini-p=0.199 gemini-p=0.169 gpt-3.5-=0.168 gpt-4-tu=0.165 gpt-4-tu=0.175 gpt-4.5-=0.194 gpt-4o=0.191 gpt-4o-m=0.189 llama-2-=0.184 llama-2-=0.147 llama-3.=0.193 llama-3.=0.151 ministra=0.193 mistral-=0.110 mixtral-=0.185 o3-mini=0.187 qwen1.5-=0.183 text-bis=0.201 |
| 2026-04-13 10:38:36,736 INFO [Step 25/200] det=skip para=-0.0000 raw_rwd=0.1658±0.0147 rwd=0.1658 |
| 2026-04-13 10:38:36,736 INFO per-gen rewards: deepseek=0.174 falcon3-=0.154 gemini-1=0.159 gemini-2=0.167 gemini-p=0.134 gemini-p=0.168 gpt-3.5-=0.169 gpt-4-tu=0.174 gpt-4-tu=0.173 gpt-4.5-=0.154 gpt-4o=0.163 gpt-4o-m=0.164 llama-2-=0.149 llama-2-=0.162 llama-3.=0.168 llama-3.=0.183 ministra=0.170 mistral-=0.167 mixtral-=0.174 o3-mini=0.170 qwen1.5-=0.180 text-bis=0.156 |
| 2026-04-13 10:43:19,473 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 10:43:19,473 INFO │ MACRO_AVG 0.9876 ◄ |
| 2026-04-13 10:43:19,473 INFO │ deepseek-r1-distill-qwen-32b 0.9964 |
| 2026-04-13 10:43:19,473 INFO │ falcon3-10b-instruct 0.9930 |
| 2026-04-13 10:43:19,473 INFO │ gemini-1.5-pro 0.9625 |
| 2026-04-13 10:43:19,473 INFO │ gemini-2.0-flash 0.9969 |
| 2026-04-13 10:43:19,473 INFO │ gemini-pro 0.9747 |
| 2026-04-13 10:43:19,473 INFO │ gemini-pro-paraphrase 0.9735 |
| 2026-04-13 10:43:19,473 INFO │ gpt-3.5-turbo 0.9964 |
| 2026-04-13 10:43:19,473 INFO │ gpt-4-turbo 0.9924 |
| 2026-04-13 10:43:19,473 INFO │ gpt-4-turbo-paraphrase 0.9851 |
| 2026-04-13 10:43:19,473 INFO │ gpt-4.5-preview 0.9906 |
| 2026-04-13 10:43:19,473 INFO │ gpt-4o 0.9980 |
| 2026-04-13 10:43:19,473 INFO │ gpt-4o-mini 0.9984 |
| 2026-04-13 10:43:19,473 INFO │ llama-2-70b-chat 0.9851 |
| 2026-04-13 10:43:19,473 INFO │ llama-2-7b-chat 0.9830 |
| 2026-04-13 10:43:19,473 INFO │ llama-3.1-8b-instruct 0.9819 |
| 2026-04-13 10:43:19,474 INFO │ llama-3.3-70b-instruct 0.9887 |
| 2026-04-13 10:43:19,474 INFO │ ministral-8b-instruct-2410 0.9955 |
| 2026-04-13 10:43:19,474 INFO │ mistral-7b-instruct-v0.2 0.9838 |
| 2026-04-13 10:43:19,474 INFO │ mixtral-8x7b-instruct-v0.1 0.9822 |
| 2026-04-13 10:43:19,474 INFO │ o3-mini 0.9967 |
| 2026-04-13 10:43:19,474 INFO │ qwen1.5-72b-chat-8bit 0.9866 |
| 2026-04-13 10:43:19,474 INFO │ text-bison-002 0.9853 |
| 2026-04-13 10:43:19,474 INFO │ (prev best) 0.9875 |
| 2026-04-13 10:43:19,474 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 10:43:19,474 INFO │ article_deletion 0.9963 ~ |
| 2026-04-13 10:43:19,474 INFO │ homoglyphs 0.9994 ~ |
| 2026-04-13 10:43:19,474 INFO │ misspelling 0.9970 ~ |
| 2026-04-13 10:43:19,474 INFO │ no_attack 0.9951 ~ |
| 2026-04-13 10:43:19,474 INFO │ synonym_replacement 0.9935 ~ |
| 2026-04-13 10:43:19,474 INFO │ t5_paraphrase 0.9800 ~ |
| 2026-04-13 10:43:19,474 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 10:43:24,030 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 10:43:26,148 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 10:43:26,148 INFO ✓ New best macro AUROC = 0.9876 — saved. |
| |
| 2026-04-13 10:43:26,148 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 10:43:26,340 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 10:43:26,461 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 10:43:26,462 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:43:26,579 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 10:43:26,580 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:43:26,580 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 10:43:26,695 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:43:27,788 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:43:27,946 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:43:28,078 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:27,996 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:28,138 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:28,861 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:28,995 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:29,742 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:29,873 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:30,698 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:30,699 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:44:30,699 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 10:44:30,810 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:31,439 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:31,582 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:31,712 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:43,808 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:44:43,809 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:44:43,809 INFO ── Hub push complete ── |
| |
| 2026-04-13 10:45:24,444 INFO [Step 26/200] det=3.0797 para=-0.0055 raw_rwd=0.1709±0.0137 rwd=0.1709 |
| 2026-04-13 10:45:24,444 INFO loss components: L_human=0.439 L_xm_original=0.448 L_t5_para=0.432 L_synonym_replacement=0.454 L_homoglyphs=0.428 L_article_deletion=0.439 L_misspelling=0.436 total=3.075 |
| 2026-04-13 10:45:24,444 INFO per-gen rewards: deepseek=0.178 falcon3-=0.162 gemini-1=0.168 gemini-2=0.164 gemini-p=0.187 gemini-p=0.161 gpt-3.5-=0.172 gpt-4-tu=0.167 gpt-4-tu=0.168 gpt-4.5-=0.152 gpt-4o=0.177 gpt-4o-m=0.169 llama-2-=0.159 llama-2-=0.148 llama-3.=0.177 llama-3.=0.196 ministra=0.173 mistral-=0.176 mixtral-=0.166 o3-mini=0.166 qwen1.5-=0.174 text-bis=0.175 |
| 2026-04-13 10:45:39,057 INFO [Step 27/200] det=skip para=0.0168 raw_rwd=0.1533±0.0292 rwd=0.1533 |
| 2026-04-13 10:45:39,058 INFO per-gen rewards: deepseek=0.146 falcon3-=0.151 gemini-1=0.169 gemini-2=0.169 gemini-p=0.143 gemini-p=0.144 gpt-3.5-=0.154 gpt-4-tu=0.116 gpt-4-tu=0.129 gpt-4.5-=0.130 gpt-4o=0.150 gpt-4o-m=0.146 llama-2-=0.129 llama-2-=0.146 llama-3.=0.158 llama-3.=0.123 ministra=0.162 mistral-=0.136 mixtral-=0.170 o3-mini=0.159 qwen1.5-=0.205 text-bis=0.143 |
| 2026-04-13 10:46:19,550 INFO [Step 28/200] det=3.1591 para=0.0315 raw_rwd=0.1581±0.0284 rwd=0.1581 |
| 2026-04-13 10:46:19,550 INFO loss components: L_human=0.479 L_xm_original=0.437 L_t5_para=0.431 L_synonym_replacement=0.433 L_homoglyphs=0.427 L_article_deletion=0.425 L_misspelling=0.433 total=3.065 |
| 2026-04-13 10:46:19,550 INFO per-gen rewards: deepseek=0.171 falcon3-=0.160 gemini-1=0.150 gemini-2=0.146 gemini-p=0.147 gemini-p=0.153 gpt-3.5-=0.153 gpt-4-tu=0.150 gpt-4-tu=0.230 gpt-4.5-=0.144 gpt-4o=0.138 gpt-4o-m=0.157 llama-2-=0.128 llama-2-=0.125 llama-3.=0.185 llama-3.=0.138 ministra=0.181 mistral-=0.149 mixtral-=0.165 o3-mini=0.151 qwen1.5-=0.178 text-bis=0.201 |
| 2026-04-13 10:46:34,141 INFO [Step 29/200] det=skip para=0.0000 raw_rwd=0.1577±0.0125 rwd=0.1577 |
| 2026-04-13 10:46:34,142 INFO per-gen rewards: deepseek=0.148 falcon3-=0.168 gemini-1=0.170 gemini-2=0.149 gemini-p=0.157 gemini-p=0.153 gpt-3.5-=0.157 gpt-4-tu=0.159 gpt-4-tu=0.177 gpt-4.5-=0.141 gpt-4o=0.157 gpt-4o-m=0.153 llama-2-=0.149 llama-2-=0.157 llama-3.=0.160 llama-3.=0.167 ministra=0.163 mistral-=0.152 mixtral-=0.143 o3-mini=0.159 qwen1.5-=0.138 text-bis=0.160 |
| 2026-04-13 10:47:14,419 INFO [Step 30/200] det=3.0753 para=0.0043 raw_rwd=0.1512±0.0123 rwd=0.1512 |
| 2026-04-13 10:47:14,419 INFO loss components: L_human=0.435 L_xm_original=0.432 L_t5_para=0.431 L_synonym_replacement=0.441 L_homoglyphs=0.424 L_article_deletion=0.428 L_misspelling=0.431 total=3.022 |
| 2026-04-13 10:47:14,419 INFO per-gen rewards: deepseek=0.143 falcon3-=0.150 gemini-1=0.155 gemini-2=0.149 gemini-p=0.154 gemini-p=0.158 gpt-3.5-=0.160 gpt-4-tu=0.166 gpt-4-tu=0.160 gpt-4.5-=0.145 gpt-4o=0.147 gpt-4o-m=0.151 llama-2-=0.142 llama-2-=0.159 llama-3.=0.146 llama-3.=0.144 ministra=0.157 mistral-=0.125 mixtral-=0.153 o3-mini=0.150 qwen1.5-=0.157 text-bis=0.158 |
| 2026-04-13 10:51:57,332 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 10:51:57,333 INFO │ MACRO_AVG 0.9933 ◄ |
| 2026-04-13 10:51:57,333 INFO │ deepseek-r1-distill-qwen-32b 0.9992 |
| 2026-04-13 10:51:57,333 INFO │ falcon3-10b-instruct 0.9994 |
| 2026-04-13 10:51:57,333 INFO │ gemini-1.5-pro 0.9621 |
| 2026-04-13 10:51:57,333 INFO │ gemini-2.0-flash 0.9994 |
| 2026-04-13 10:51:57,333 INFO │ gemini-pro 0.9799 |
| 2026-04-13 10:51:57,333 INFO │ gemini-pro-paraphrase 0.9831 |
| 2026-04-13 10:51:57,333 INFO │ gpt-3.5-turbo 0.9997 |
| 2026-04-13 10:51:57,333 INFO │ gpt-4-turbo 0.9995 |
| 2026-04-13 10:51:57,333 INFO │ gpt-4-turbo-paraphrase 0.9931 |
| 2026-04-13 10:51:57,333 INFO │ gpt-4.5-preview 0.9960 |
| 2026-04-13 10:51:57,333 INFO │ gpt-4o 0.9999 |
| 2026-04-13 10:51:57,333 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 10:51:57,333 INFO │ llama-2-70b-chat 0.9905 |
| 2026-04-13 10:51:57,333 INFO │ llama-2-7b-chat 0.9911 |
| 2026-04-13 10:51:57,333 INFO │ llama-3.1-8b-instruct 0.9897 |
| 2026-04-13 10:51:57,333 INFO │ llama-3.3-70b-instruct 0.9990 |
| 2026-04-13 10:51:57,333 INFO │ ministral-8b-instruct-2410 0.9995 |
| 2026-04-13 10:51:57,333 INFO │ mistral-7b-instruct-v0.2 0.9909 |
| 2026-04-13 10:51:57,333 INFO │ mixtral-8x7b-instruct-v0.1 0.9896 |
| 2026-04-13 10:51:57,333 INFO │ o3-mini 0.9997 |
| 2026-04-13 10:51:57,333 INFO │ qwen1.5-72b-chat-8bit 0.9972 |
| 2026-04-13 10:51:57,333 INFO │ text-bison-002 0.9945 |
| 2026-04-13 10:51:57,333 INFO │ (prev best) 0.9876 |
| 2026-04-13 10:51:57,333 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 10:51:57,333 INFO │ article_deletion 0.9974 ~ |
| 2026-04-13 10:51:57,333 INFO │ homoglyphs 0.9997 ~ |
| 2026-04-13 10:51:57,333 INFO │ misspelling 0.9985 ~ |
| 2026-04-13 10:51:57,333 INFO │ no_attack 0.9956 ~ |
| 2026-04-13 10:51:57,333 INFO │ synonym_replacement 0.9991 ~ |
| 2026-04-13 10:51:57,333 INFO │ t5_paraphrase 0.9800 ~ |
| 2026-04-13 10:51:57,333 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 10:52:02,074 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 10:52:04,212 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 10:52:04,213 INFO ✓ New best macro AUROC = 0.9933 — saved. |
| |
| 2026-04-13 10:52:04,213 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 10:52:04,421 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 10:52:04,552 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 10:52:04,553 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:52:04,667 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 10:52:04,668 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:52:04,669 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 10:52:04,778 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:52:05,882 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:52:06,023 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:52:06,162 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:52:06,295 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:04,186 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:04,320 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:05,259 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:05,391 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:06,229 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:06,361 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:07,379 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:07,380 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 10:53:07,380 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 10:53:07,490 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:08,120 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:08,255 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:08,385 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:08,498 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:14,631 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 10:53:14,632 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 10:53:14,632 INFO ── Hub push complete ── |
| |
| 2026-04-13 10:53:29,491 INFO [Step 31/200] det=skip para=0.0000 raw_rwd=0.1452±0.0198 rwd=0.1452 |
| 2026-04-13 10:53:29,491 INFO per-gen rewards: deepseek=0.155 falcon3-=0.142 gemini-1=0.165 gemini-2=0.148 gemini-p=0.155 gemini-p=0.129 gpt-3.5-=0.153 gpt-4-tu=0.127 gpt-4-tu=0.123 gpt-4.5-=0.151 gpt-4o=0.147 gpt-4o-m=0.138 llama-2-=0.138 llama-2-=0.177 llama-3.=0.137 llama-3.=0.149 ministra=0.128 mistral-=0.140 mixtral-=0.136 o3-mini=0.140 qwen1.5-=0.163 text-bis=0.148 |
| 2026-04-13 10:54:10,423 INFO [Step 32/200] det=3.0615 para=0.0240 raw_rwd=0.1455±0.0234 rwd=0.1455 |
| 2026-04-13 10:54:10,423 INFO loss components: L_human=0.447 L_xm_original=0.441 L_t5_para=0.428 L_synonym_replacement=0.434 L_homoglyphs=0.426 L_article_deletion=0.427 L_misspelling=0.442 total=3.047 |
| 2026-04-13 10:54:10,423 INFO per-gen rewards: deepseek=0.142 falcon3-=0.148 gemini-1=0.148 gemini-2=0.146 gemini-p=0.131 gemini-p=0.161 gpt-3.5-=0.141 gpt-4-tu=0.134 gpt-4-tu=0.118 gpt-4.5-=0.122 gpt-4o=0.149 gpt-4o-m=0.163 llama-2-=0.145 llama-2-=0.135 llama-3.=0.137 llama-3.=0.142 ministra=0.131 mistral-=0.148 mixtral-=0.134 o3-mini=0.165 qwen1.5-=0.122 text-bis=0.163 |
| 2026-04-13 10:54:25,296 INFO [Step 33/200] det=skip para=0.0000 raw_rwd=0.1339±0.0205 rwd=0.1339 |
| 2026-04-13 10:54:25,297 INFO per-gen rewards: deepseek=0.135 falcon3-=0.130 gemini-1=0.136 gemini-2=0.139 gemini-p=0.133 gemini-p=0.137 gpt-3.5-=0.146 gpt-4-tu=0.120 gpt-4-tu=0.173 gpt-4.5-=0.122 gpt-4o=0.118 gpt-4o-m=0.131 llama-2-=0.108 llama-2-=0.128 llama-3.=0.153 llama-3.=0.119 ministra=0.126 mistral-=0.128 mixtral-=0.184 o3-mini=0.124 qwen1.5-=0.134 text-bis=0.142 |
| 2026-04-13 10:55:06,256 INFO [Step 34/200] det=3.1308 para=-0.0000 raw_rwd=0.1332±0.0166 rwd=0.1332 |
| 2026-04-13 10:55:06,256 INFO loss components: L_human=0.435 L_xm_original=0.491 L_t5_para=0.426 L_synonym_replacement=0.442 L_homoglyphs=0.436 L_article_deletion=0.447 L_misspelling=0.443 total=3.120 |
| 2026-04-13 10:55:06,256 INFO per-gen rewards: deepseek=0.135 falcon3-=0.135 gemini-1=0.140 gemini-2=0.130 gemini-p=0.136 gemini-p=0.135 gpt-3.5-=0.133 gpt-4-tu=0.137 gpt-4-tu=0.131 gpt-4.5-=0.121 gpt-4o=0.141 gpt-4o-m=0.122 llama-2-=0.117 llama-2-=0.143 llama-3.=0.130 llama-3.=0.149 ministra=0.130 mistral-=0.142 mixtral-=0.131 o3-mini=0.137 qwen1.5-=0.108 text-bis=0.144 |
| 2026-04-13 10:55:20,904 INFO [Step 35/200] det=skip para=-0.0000 raw_rwd=0.1265±0.0132 rwd=0.1265 |
| 2026-04-13 10:55:20,905 INFO per-gen rewards: deepseek=0.124 falcon3-=0.122 gemini-1=0.124 gemini-2=0.132 gemini-p=0.118 gemini-p=0.124 gpt-3.5-=0.124 gpt-4-tu=0.115 gpt-4-tu=0.114 gpt-4.5-=0.110 gpt-4o=0.125 gpt-4o-m=0.130 llama-2-=0.117 llama-2-=0.132 llama-3.=0.127 llama-3.=0.156 ministra=0.121 mistral-=0.124 mixtral-=0.163 o3-mini=0.123 qwen1.5-=0.133 text-bis=0.143 |
| 2026-04-13 11:00:04,871 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:00:04,871 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:00:04,871 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:00:04,871 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:00:04,871 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:00:04,871 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:00:04,871 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:00:04,871 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:00:04,871 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:00:04,871 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:00:04,871 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:00:04,871 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:00:04,871 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:00:04,871 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:00:04,871 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:00:04,871 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:00:04,871 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:00:04,872 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:00:04,872 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:00:04,872 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:00:04,872 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:00:04,872 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:00:04,872 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:00:04,872 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:00:04,872 INFO │ (prev best) 0.9933 |
| 2026-04-13 11:00:04,872 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:00:04,872 INFO │ article_deletion 0.9982 ~ |
| 2026-04-13 11:00:04,872 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:00:04,872 INFO │ misspelling 0.9996 ~ |
| 2026-04-13 11:00:04,872 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:00:04,872 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 11:00:04,872 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:00:04,872 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:00:09,521 INFO Detector saved → ./adal_panclef/best_detector |
| 2026-04-13 11:00:11,625 INFO Paraphraser saved → ./adal_panclef/best_paraphraser |
| 2026-04-13 11:00:11,625 INFO ✓ New best macro AUROC = 0.9960 — saved. |
| |
| 2026-04-13 11:00:11,625 INFO |
| ── Pushing to HuggingFace Hub (trigger=best) ── |
| 2026-04-13 11:00:11,855 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 11:00:11,977 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 11:00:11,979 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 11:00:12,110 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 11:00:12,111 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 11:00:12,112 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 11:00:12,227 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 11:00:13,354 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 11:00:13,528 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:00:13,668 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:11,414 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:11,550 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:12,240 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:12,470 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:13,176 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:13,317 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:14,203 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:14,204 INFO ✓ Detector pushed → https://huggingface.co/Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 11:01:14,204 INFO Uploading paraphraser → Shushant/ADAL_PAN-t5-paraphraser … |
| 2026-04-13 11:01:14,336 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:14,965 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:15,142 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:15,263 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:22,028 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 11:01:22,029 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 11:01:22,029 INFO ── Hub push complete ── |
| |
| 2026-04-13 11:01:36,940 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:01:36,940 INFO [Step 36/200] det=skip para=0.0038 raw_rwd=0.1255±0.0119 rwd=0.1255 |
| 2026-04-13 11:01:36,940 INFO per-gen rewards: deepseek=0.128 falcon3-=0.123 gemini-1=0.121 gemini-2=0.125 gemini-p=0.133 gemini-p=0.123 gpt-3.5-=0.122 gpt-4-tu=0.122 gpt-4-tu=0.135 gpt-4.5-=0.108 gpt-4o=0.123 gpt-4o-m=0.130 llama-2-=0.121 llama-2-=0.141 llama-3.=0.125 llama-3.=0.122 ministra=0.128 mistral-=0.148 mixtral-=0.127 o3-mini=0.122 qwen1.5-=0.133 text-bis=0.127 |
| 2026-04-13 11:01:51,580 INFO [Step 37/200] det=skip para=0.0139 raw_rwd=0.1233±0.0110 rwd=0.1233 |
| 2026-04-13 11:01:51,581 INFO per-gen rewards: deepseek=0.137 falcon3-=0.119 gemini-1=0.120 gemini-2=0.129 gemini-p=0.133 gemini-p=0.120 gpt-3.5-=0.122 gpt-4-tu=0.112 gpt-4-tu=0.117 gpt-4.5-=0.117 gpt-4o=0.118 gpt-4o-m=0.123 llama-2-=0.138 llama-2-=0.118 llama-3.=0.121 llama-3.=0.138 ministra=0.123 mistral-=0.131 mixtral-=0.119 o3-mini=0.126 qwen1.5-=0.116 text-bis=0.104 |
| 2026-04-13 11:02:06,245 INFO [Step 38/200] det=skip para=0.0000 raw_rwd=0.1266±0.0127 rwd=0.1266 |
| 2026-04-13 11:02:06,245 INFO per-gen rewards: deepseek=0.115 falcon3-=0.118 gemini-1=0.127 gemini-2=0.126 gemini-p=0.160 gemini-p=0.114 gpt-3.5-=0.130 gpt-4-tu=0.131 gpt-4-tu=0.149 gpt-4.5-=0.128 gpt-4o=0.122 gpt-4o-m=0.134 llama-2-=0.138 llama-2-=0.137 llama-3.=0.122 llama-3.=0.129 ministra=0.121 mistral-=0.116 mixtral-=0.145 o3-mini=0.129 qwen1.5-=0.117 text-bis=0.146 |
| 2026-04-13 11:02:21,082 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:02:21,083 INFO [Step 39/200] det=skip para=0.0004 raw_rwd=0.1256±0.0122 rwd=0.1256 |
| 2026-04-13 11:02:21,083 INFO per-gen rewards: deepseek=0.135 falcon3-=0.129 gemini-1=0.124 gemini-2=0.124 gemini-p=0.111 gemini-p=0.142 gpt-3.5-=0.130 gpt-4-tu=0.130 gpt-4-tu=0.119 gpt-4.5-=0.108 gpt-4o=0.126 gpt-4o-m=0.125 llama-2-=0.119 llama-2-=0.133 llama-3.=0.128 llama-3.=0.128 ministra=0.122 mistral-=0.130 mixtral-=0.125 o3-mini=0.121 qwen1.5-=0.127 text-bis=0.110 |
| 2026-04-13 11:02:35,876 INFO [Step 40/200] det=skip para=0.0000 raw_rwd=0.1234±0.0104 rwd=0.1234 |
| 2026-04-13 11:02:35,876 INFO per-gen rewards: deepseek=0.122 falcon3-=0.122 gemini-1=0.126 gemini-2=0.128 gemini-p=0.133 gemini-p=0.140 gpt-3.5-=0.128 gpt-4-tu=0.112 gpt-4-tu=0.112 gpt-4.5-=0.118 gpt-4o=0.128 gpt-4o-m=0.121 llama-2-=0.132 llama-2-=0.120 llama-3.=0.113 llama-3.=0.130 ministra=0.114 mistral-=0.124 mixtral-=0.108 o3-mini=0.128 qwen1.5-=0.127 text-bis=0.132 |
| 2026-04-13 11:07:19,194 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:07:19,194 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:07:19,195 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:07:19,195 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:07:19,195 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:07:19,195 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:07:19,195 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:07:19,195 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:07:19,195 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:07:19,195 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:07:19,195 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:07:19,195 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:07:19,195 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:07:19,195 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:07:19,195 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:07:19,195 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:07:19,195 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:07:19,195 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:07:19,195 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:07:19,195 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:07:19,195 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:07:19,195 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:07:19,195 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:07:19,195 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:07:19,195 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:07:19,195 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:07:19,195 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 11:07:19,195 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:07:19,195 INFO │ misspelling 0.9995 ~ |
| 2026-04-13 11:07:19,195 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:07:19,195 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 11:07:19,195 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:07:19,195 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:07:19,195 INFO No improvement (1/25) best=0.9960 |
| |
| 2026-04-13 11:07:34,025 INFO [Step 41/200] det=skip para=-0.0000 raw_rwd=0.1254±0.0105 rwd=0.1254 |
| 2026-04-13 11:07:34,026 INFO per-gen rewards: deepseek=0.114 falcon3-=0.128 gemini-1=0.122 gemini-2=0.119 gemini-p=0.116 gemini-p=0.107 gpt-3.5-=0.129 gpt-4-tu=0.121 gpt-4-tu=0.120 gpt-4.5-=0.125 gpt-4o=0.125 gpt-4o-m=0.125 llama-2-=0.135 llama-2-=0.132 llama-3.=0.123 llama-3.=0.126 ministra=0.132 mistral-=0.116 mixtral-=0.122 o3-mini=0.136 qwen1.5-=0.149 text-bis=0.124 |
| 2026-04-13 11:07:48,634 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:07:48,634 INFO [Step 42/200] det=skip para=-0.0000 raw_rwd=0.1270±0.0102 rwd=0.1270 |
| 2026-04-13 11:07:48,634 INFO per-gen rewards: deepseek=0.126 falcon3-=0.118 gemini-1=0.125 gemini-2=0.126 gemini-p=0.114 gemini-p=0.149 gpt-3.5-=0.130 gpt-4-tu=0.134 gpt-4-tu=0.118 gpt-4.5-=0.137 gpt-4o=0.129 gpt-4o-m=0.133 llama-2-=0.124 llama-2-=0.122 llama-3.=0.122 llama-3.=0.125 ministra=0.126 mistral-=0.144 mixtral-=0.122 o3-mini=0.127 qwen1.5-=0.123 text-bis=0.135 |
| 2026-04-13 11:08:03,230 INFO [Step 43/200] det=skip para=0.0000 raw_rwd=0.1265±0.0115 rwd=0.1265 |
| 2026-04-13 11:08:03,230 INFO per-gen rewards: deepseek=0.117 falcon3-=0.125 gemini-1=0.124 gemini-2=0.121 gemini-p=0.124 gemini-p=0.122 gpt-3.5-=0.123 gpt-4-tu=0.107 gpt-4-tu=0.148 gpt-4.5-=0.160 gpt-4o=0.130 gpt-4o-m=0.128 llama-2-=0.121 llama-2-=0.143 llama-3.=0.124 llama-3.=0.128 ministra=0.128 mistral-=0.138 mixtral-=0.120 o3-mini=0.131 qwen1.5-=0.127 text-bis=0.132 |
| 2026-04-13 11:08:17,965 INFO [Step 44/200] det=skip para=0.0045 raw_rwd=0.1249±0.0103 rwd=0.1249 |
| 2026-04-13 11:08:17,965 INFO per-gen rewards: deepseek=0.123 falcon3-=0.117 gemini-1=0.123 gemini-2=0.123 gemini-p=0.124 gemini-p=0.115 gpt-3.5-=0.122 gpt-4-tu=0.136 gpt-4-tu=0.159 gpt-4.5-=0.130 gpt-4o=0.121 gpt-4o-m=0.129 llama-2-=0.133 llama-2-=0.135 llama-3.=0.129 llama-3.=0.130 ministra=0.124 mistral-=0.114 mixtral-=0.113 o3-mini=0.130 qwen1.5-=0.111 text-bis=0.121 |
| 2026-04-13 11:08:32,302 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:08:32,303 INFO [Step 45/200] det=skip para=0.0068 raw_rwd=0.1252±0.0107 rwd=0.1252 |
| 2026-04-13 11:08:32,303 INFO per-gen rewards: deepseek=0.122 falcon3-=0.120 gemini-1=0.128 gemini-2=0.127 gemini-p=0.135 gemini-p=0.132 gpt-3.5-=0.125 gpt-4-tu=0.110 gpt-4-tu=0.128 gpt-4.5-=0.122 gpt-4o=0.128 gpt-4o-m=0.123 llama-2-=0.132 llama-2-=0.126 llama-3.=0.128 llama-3.=0.130 ministra=0.122 mistral-=0.111 mixtral-=0.131 o3-mini=0.119 qwen1.5-=0.141 text-bis=0.140 |
| 2026-04-13 11:13:15,700 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:13:15,700 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:13:15,700 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:13:15,700 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:13:15,700 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:13:15,700 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:13:15,700 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:13:15,700 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:13:15,700 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:13:15,700 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:13:15,700 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:13:15,700 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:13:15,700 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:13:15,700 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:13:15,700 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:13:15,700 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:13:15,700 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:13:15,700 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:13:15,700 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:13:15,700 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:13:15,700 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:13:15,700 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:13:15,700 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:13:15,700 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:13:15,700 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:13:15,701 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:13:15,701 INFO │ article_deletion 0.9982 ~ |
| 2026-04-13 11:13:15,701 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:13:15,701 INFO │ misspelling 0.9997 ~ |
| 2026-04-13 11:13:15,701 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:13:15,701 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 11:13:15,701 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:13:15,701 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:13:15,701 INFO No improvement (2/25) best=0.9960 |
| |
| 2026-04-13 11:13:30,607 INFO [Step 46/200] det=skip para=-0.0000 raw_rwd=0.1272±0.0105 rwd=0.1272 |
| 2026-04-13 11:13:30,607 INFO per-gen rewards: deepseek=0.123 falcon3-=0.134 gemini-1=0.123 gemini-2=0.128 gemini-p=0.132 gemini-p=0.120 gpt-3.5-=0.127 gpt-4-tu=0.139 gpt-4-tu=0.125 gpt-4.5-=0.133 gpt-4o=0.130 gpt-4o-m=0.133 llama-2-=0.114 llama-2-=0.152 llama-3.=0.126 llama-3.=0.122 ministra=0.124 mistral-=0.113 mixtral-=0.126 o3-mini=0.125 qwen1.5-=0.126 text-bis=0.124 |
| 2026-04-13 11:13:45,484 INFO [Step 47/200] det=skip para=0.0566 raw_rwd=0.1274±0.0225 rwd=0.1274 |
| 2026-04-13 11:13:45,484 INFO per-gen rewards: deepseek=0.124 falcon3-=0.131 gemini-1=0.164 gemini-2=0.130 gemini-p=0.109 gemini-p=0.115 gpt-3.5-=0.124 gpt-4-tu=0.127 gpt-4-tu=0.123 gpt-4.5-=0.114 gpt-4o=0.117 gpt-4o-m=0.124 llama-2-=0.134 llama-2-=0.119 llama-3.=0.116 llama-3.=0.132 ministra=0.135 mistral-=0.125 mixtral-=0.140 o3-mini=0.125 qwen1.5-=0.122 text-bis=0.114 |
| 2026-04-13 11:14:00,097 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:14:00,098 INFO [Step 48/200] det=skip para=0.0044 raw_rwd=0.1268±0.0128 rwd=0.1268 |
| 2026-04-13 11:14:00,098 INFO per-gen rewards: deepseek=0.128 falcon3-=0.136 gemini-1=0.129 gemini-2=0.118 gemini-p=0.109 gemini-p=0.121 gpt-3.5-=0.132 gpt-4-tu=0.126 gpt-4-tu=0.151 gpt-4.5-=0.120 gpt-4o=0.127 gpt-4o-m=0.133 llama-2-=0.113 llama-2-=0.127 llama-3.=0.127 llama-3.=0.132 ministra=0.127 mistral-=0.119 mixtral-=0.113 o3-mini=0.121 qwen1.5-=0.125 text-bis=0.111 |
| 2026-04-13 11:14:14,564 INFO [Step 49/200] det=skip para=-0.0000 raw_rwd=0.1242±0.0082 rwd=0.1242 |
| 2026-04-13 11:14:14,565 INFO per-gen rewards: deepseek=0.127 falcon3-=0.128 gemini-1=0.123 gemini-2=0.121 gemini-p=0.145 gemini-p=0.110 gpt-3.5-=0.122 gpt-4-tu=0.114 gpt-4-tu=0.120 gpt-4.5-=0.119 gpt-4o=0.125 gpt-4o-m=0.125 llama-2-=0.124 llama-2-=0.134 llama-3.=0.125 llama-3.=0.126 ministra=0.127 mistral-=0.136 mixtral-=0.118 o3-mini=0.121 qwen1.5-=0.126 text-bis=0.115 |
| 2026-04-13 11:14:29,493 INFO [Step 50/200] det=skip para=0.0000 raw_rwd=0.1264±0.0129 rwd=0.1264 |
| 2026-04-13 11:14:29,493 INFO per-gen rewards: deepseek=0.118 falcon3-=0.125 gemini-1=0.125 gemini-2=0.127 gemini-p=0.122 gemini-p=0.135 gpt-3.5-=0.131 gpt-4-tu=0.114 gpt-4-tu=0.111 gpt-4.5-=0.136 gpt-4o=0.122 gpt-4o-m=0.126 llama-2-=0.132 llama-2-=0.098 llama-3.=0.125 llama-3.=0.125 ministra=0.134 mistral-=0.132 mixtral-=0.122 o3-mini=0.130 qwen1.5-=0.145 text-bis=0.141 |
| 2026-04-13 11:19:14,185 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:19:14,186 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:19:14,186 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:19:14,186 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:19:14,186 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:19:14,186 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:19:14,186 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:19:14,186 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:19:14,186 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:19:14,186 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:19:14,186 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:19:14,186 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:19:14,186 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:19:14,186 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:19:14,186 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:19:14,186 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:19:14,186 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:19:14,186 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:19:14,186 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:19:14,186 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:19:14,186 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:19:14,186 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:19:14,186 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:19:14,186 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:19:14,186 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:19:14,186 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:19:14,186 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 11:19:14,186 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:19:14,186 INFO │ misspelling 0.9996 ~ |
| 2026-04-13 11:19:14,186 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:19:14,186 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 11:19:14,186 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:19:14,186 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:19:14,186 INFO No improvement (3/25) best=0.9960 |
| |
| 2026-04-13 11:19:29,028 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:19:29,028 INFO [Step 51/200] det=skip para=0.0000 raw_rwd=0.1238±0.0109 rwd=0.1238 |
| 2026-04-13 11:19:29,028 INFO per-gen rewards: deepseek=0.113 falcon3-=0.130 gemini-1=0.128 gemini-2=0.120 gemini-p=0.116 gemini-p=0.129 gpt-3.5-=0.128 gpt-4-tu=0.122 gpt-4-tu=0.122 gpt-4.5-=0.125 gpt-4o=0.123 gpt-4o-m=0.117 llama-2-=0.134 llama-2-=0.117 llama-3.=0.119 llama-3.=0.143 ministra=0.123 mistral-=0.137 mixtral-=0.120 o3-mini=0.126 qwen1.5-=0.129 text-bis=0.115 |
| 2026-04-13 11:19:43,946 INFO [Step 52/200] det=skip para=-0.0000 raw_rwd=0.1271±0.0114 rwd=0.1271 |
| 2026-04-13 11:19:43,946 INFO per-gen rewards: deepseek=0.123 falcon3-=0.134 gemini-1=0.129 gemini-2=0.120 gemini-p=0.128 gemini-p=0.131 gpt-3.5-=0.129 gpt-4-tu=0.124 gpt-4-tu=0.134 gpt-4.5-=0.127 gpt-4o=0.126 gpt-4o-m=0.130 llama-2-=0.126 llama-2-=0.114 llama-3.=0.130 llama-3.=0.120 ministra=0.119 mistral-=0.142 mixtral-=0.127 o3-mini=0.135 qwen1.5-=0.120 text-bis=0.116 |
| 2026-04-13 11:19:59,048 INFO [Step 53/200] det=skip para=0.0031 raw_rwd=0.1221±0.0108 rwd=0.1221 |
| 2026-04-13 11:19:59,049 INFO per-gen rewards: deepseek=0.128 falcon3-=0.122 gemini-1=0.120 gemini-2=0.122 gemini-p=0.112 gemini-p=0.125 gpt-3.5-=0.122 gpt-4-tu=0.130 gpt-4-tu=0.120 gpt-4.5-=0.116 gpt-4o=0.119 gpt-4o-m=0.122 llama-2-=0.122 llama-2-=0.110 llama-3.=0.124 llama-3.=0.148 ministra=0.118 mistral-=0.115 mixtral-=0.128 o3-mini=0.123 qwen1.5-=0.123 text-bis=0.105 |
| 2026-04-13 11:20:13,787 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:20:13,788 INFO [Step 54/200] det=skip para=-0.0000 raw_rwd=0.1258±0.0101 rwd=0.1258 |
| 2026-04-13 11:20:13,788 INFO per-gen rewards: deepseek=0.135 falcon3-=0.130 gemini-1=0.118 gemini-2=0.117 gemini-p=0.115 gemini-p=0.132 gpt-3.5-=0.125 gpt-4-tu=0.146 gpt-4-tu=0.138 gpt-4.5-=0.133 gpt-4o=0.127 gpt-4o-m=0.124 llama-2-=0.118 llama-2-=0.156 llama-3.=0.122 llama-3.=0.121 ministra=0.131 mistral-=0.127 mixtral-=0.141 o3-mini=0.124 qwen1.5-=0.119 text-bis=0.113 |
| 2026-04-13 11:20:28,507 INFO [Step 55/200] det=skip para=0.0000 raw_rwd=0.1220±0.0097 rwd=0.1220 |
| 2026-04-13 11:20:28,507 INFO per-gen rewards: deepseek=0.121 falcon3-=0.135 gemini-1=0.118 gemini-2=0.121 gemini-p=0.115 gemini-p=0.114 gpt-3.5-=0.120 gpt-4-tu=0.128 gpt-4-tu=0.126 gpt-4.5-=0.111 gpt-4o=0.113 gpt-4o-m=0.128 llama-2-=0.123 llama-2-=0.115 llama-3.=0.122 llama-3.=0.138 ministra=0.119 mistral-=0.124 mixtral-=0.135 o3-mini=0.122 qwen1.5-=0.112 text-bis=0.129 |
| 2026-04-13 11:25:12,168 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:25:12,168 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:25:12,168 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:25:12,168 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:25:12,168 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:25:12,168 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:25:12,169 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:25:12,169 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:25:12,169 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:25:12,169 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:25:12,169 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:25:12,169 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:25:12,169 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:25:12,169 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:25:12,169 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:25:12,169 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:25:12,169 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:25:12,169 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:25:12,169 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:25:12,169 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:25:12,169 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:25:12,169 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:25:12,169 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:25:12,169 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:25:12,169 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:25:12,169 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:25:12,169 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 11:25:12,169 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:25:12,169 INFO │ misspelling 0.9995 ~ |
| 2026-04-13 11:25:12,169 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:25:12,169 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 11:25:12,169 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:25:12,169 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:25:12,169 INFO No improvement (4/25) best=0.9960 |
| |
| 2026-04-13 11:25:27,078 INFO [Step 56/200] det=skip para=0.0101 raw_rwd=0.1267±0.0132 rwd=0.1267 |
| 2026-04-13 11:25:27,078 INFO per-gen rewards: deepseek=0.130 falcon3-=0.141 gemini-1=0.124 gemini-2=0.132 gemini-p=0.123 gemini-p=0.117 gpt-3.5-=0.118 gpt-4-tu=0.124 gpt-4-tu=0.129 gpt-4.5-=0.135 gpt-4o=0.128 gpt-4o-m=0.121 llama-2-=0.107 llama-2-=0.149 llama-3.=0.125 llama-3.=0.128 ministra=0.125 mistral-=0.127 mixtral-=0.125 o3-mini=0.134 qwen1.5-=0.126 text-bis=0.110 |
| 2026-04-13 11:25:41,558 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:25:41,558 INFO [Step 57/200] det=skip para=0.0000 raw_rwd=0.1246±0.0103 rwd=0.1246 |
| 2026-04-13 11:25:41,559 INFO per-gen rewards: deepseek=0.124 falcon3-=0.122 gemini-1=0.121 gemini-2=0.124 gemini-p=0.138 gemini-p=0.133 gpt-3.5-=0.128 gpt-4-tu=0.131 gpt-4-tu=0.120 gpt-4.5-=0.129 gpt-4o=0.127 gpt-4o-m=0.125 llama-2-=0.119 llama-2-=0.108 llama-3.=0.126 llama-3.=0.122 ministra=0.117 mistral-=0.138 mixtral-=0.116 o3-mini=0.130 qwen1.5-=0.131 text-bis=0.113 |
| 2026-04-13 11:25:56,353 INFO [Step 58/200] det=skip para=0.0019 raw_rwd=0.1239±0.0110 rwd=0.1239 |
| 2026-04-13 11:25:56,354 INFO per-gen rewards: deepseek=0.122 falcon3-=0.131 gemini-1=0.132 gemini-2=0.125 gemini-p=0.127 gemini-p=0.122 gpt-3.5-=0.119 gpt-4-tu=0.114 gpt-4-tu=0.111 gpt-4.5-=0.131 gpt-4o=0.126 gpt-4o-m=0.119 llama-2-=0.118 llama-2-=0.138 llama-3.=0.126 llama-3.=0.124 ministra=0.121 mistral-=0.107 mixtral-=0.134 o3-mini=0.122 qwen1.5-=0.124 text-bis=0.131 |
| 2026-04-13 11:26:10,979 INFO [Step 59/200] det=skip para=0.0580 raw_rwd=0.1266±0.0198 rwd=0.1266 |
| 2026-04-13 11:26:10,979 INFO per-gen rewards: deepseek=0.124 falcon3-=0.129 gemini-1=0.125 gemini-2=0.123 gemini-p=0.121 gemini-p=0.162 gpt-3.5-=0.122 gpt-4-tu=0.102 gpt-4-tu=0.115 gpt-4.5-=0.119 gpt-4o=0.146 gpt-4o-m=0.121 llama-2-=0.125 llama-2-=0.122 llama-3.=0.119 llama-3.=0.127 ministra=0.135 mistral-=0.133 mixtral-=0.145 o3-mini=0.117 qwen1.5-=0.125 text-bis=0.134 |
| 2026-04-13 11:26:25,485 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:26:25,486 INFO [Step 60/200] det=skip para=-0.0000 raw_rwd=0.1239±0.0100 rwd=0.1239 |
| 2026-04-13 11:26:25,486 INFO per-gen rewards: deepseek=0.119 falcon3-=0.115 gemini-1=0.129 gemini-2=0.121 gemini-p=0.120 gemini-p=0.121 gpt-3.5-=0.122 gpt-4-tu=0.114 gpt-4-tu=0.136 gpt-4.5-=0.138 gpt-4o=0.123 gpt-4o-m=0.122 llama-2-=0.143 llama-2-=0.134 llama-3.=0.128 llama-3.=0.128 ministra=0.126 mistral-=0.121 mixtral-=0.122 o3-mini=0.120 qwen1.5-=0.119 text-bis=0.142 |
| 2026-04-13 11:31:09,371 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:31:09,371 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:31:09,371 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:31:09,371 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:31:09,371 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:31:09,371 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:31:09,371 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:31:09,371 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:31:09,371 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:31:09,371 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:31:09,371 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:31:09,371 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:31:09,371 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:31:09,371 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:31:09,372 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:31:09,372 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:31:09,372 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:31:09,372 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:31:09,372 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:31:09,372 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:31:09,372 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:31:09,372 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:31:09,372 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:31:09,372 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:31:09,372 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:31:09,372 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:31:09,372 INFO │ article_deletion 0.9980 ~ |
| 2026-04-13 11:31:09,372 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:31:09,372 INFO │ misspelling 0.9997 ~ |
| 2026-04-13 11:31:09,372 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:31:09,372 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 11:31:09,372 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:31:09,372 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:31:09,372 INFO No improvement (5/25) best=0.9960 |
| |
| 2026-04-13 11:31:24,107 INFO [Step 61/200] det=skip para=0.0089 raw_rwd=0.1257±0.0107 rwd=0.1257 |
| 2026-04-13 11:31:24,107 INFO per-gen rewards: deepseek=0.128 falcon3-=0.131 gemini-1=0.121 gemini-2=0.124 gemini-p=0.136 gemini-p=0.130 gpt-3.5-=0.131 gpt-4-tu=0.108 gpt-4-tu=0.125 gpt-4.5-=0.124 gpt-4o=0.128 gpt-4o-m=0.126 llama-2-=0.126 llama-2-=0.114 llama-3.=0.124 llama-3.=0.121 ministra=0.125 mistral-=0.130 mixtral-=0.128 o3-mini=0.120 qwen1.5-=0.117 text-bis=0.141 |
| 2026-04-13 11:31:38,560 INFO [Step 62/200] det=skip para=0.0007 raw_rwd=0.1243±0.0108 rwd=0.1243 |
| 2026-04-13 11:31:38,560 INFO per-gen rewards: deepseek=0.129 falcon3-=0.127 gemini-1=0.127 gemini-2=0.118 gemini-p=0.139 gemini-p=0.157 gpt-3.5-=0.125 gpt-4-tu=0.109 gpt-4-tu=0.116 gpt-4.5-=0.123 gpt-4o=0.126 gpt-4o-m=0.128 llama-2-=0.146 llama-2-=0.134 llama-3.=0.122 llama-3.=0.121 ministra=0.120 mistral-=0.121 mixtral-=0.131 o3-mini=0.118 qwen1.5-=0.111 text-bis=0.117 |
| 2026-04-13 11:31:53,063 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:31:53,064 INFO [Step 63/200] det=skip para=-0.0000 raw_rwd=0.1269±0.0113 rwd=0.1269 |
| 2026-04-13 11:31:53,064 INFO per-gen rewards: deepseek=0.129 falcon3-=0.130 gemini-1=0.128 gemini-2=0.125 gemini-p=0.114 gemini-p=0.140 gpt-3.5-=0.130 gpt-4-tu=0.109 gpt-4-tu=0.128 gpt-4.5-=0.121 gpt-4o=0.131 gpt-4o-m=0.123 llama-2-=0.128 llama-2-=0.127 llama-3.=0.133 llama-3.=0.121 ministra=0.129 mistral-=0.111 mixtral-=0.132 o3-mini=0.121 qwen1.5-=0.121 text-bis=0.123 |
| 2026-04-13 11:32:07,539 INFO [Step 64/200] det=skip para=0.0000 raw_rwd=0.1236±0.0116 rwd=0.1236 |
| 2026-04-13 11:32:07,539 INFO per-gen rewards: deepseek=0.134 falcon3-=0.123 gemini-1=0.118 gemini-2=0.132 gemini-p=0.122 gemini-p=0.117 gpt-3.5-=0.119 gpt-4-tu=0.125 gpt-4-tu=0.109 gpt-4.5-=0.110 gpt-4o=0.119 gpt-4o-m=0.124 llama-2-=0.146 llama-2-=0.123 llama-3.=0.121 llama-3.=0.114 ministra=0.128 mistral-=0.124 mixtral-=0.125 o3-mini=0.127 qwen1.5-=0.139 text-bis=0.104 |
| 2026-04-13 11:32:22,299 INFO [Step 65/200] det=skip para=0.0514 raw_rwd=0.1239±0.0192 rwd=0.1239 |
| 2026-04-13 11:32:22,299 INFO per-gen rewards: deepseek=0.121 falcon3-=0.121 gemini-1=0.123 gemini-2=0.114 gemini-p=0.143 gemini-p=0.127 gpt-3.5-=0.120 gpt-4-tu=0.108 gpt-4-tu=0.105 gpt-4.5-=0.113 gpt-4o=0.120 gpt-4o-m=0.130 llama-2-=0.111 llama-2-=0.136 llama-3.=0.125 llama-3.=0.107 ministra=0.149 mistral-=0.120 mixtral-=0.124 o3-mini=0.131 qwen1.5-=0.117 text-bis=0.118 |
| 2026-04-13 11:37:05,949 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:37:05,949 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:37:05,949 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:37:05,949 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:37:05,949 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:37:05,949 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:37:05,949 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:37:05,949 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:37:05,949 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:37:05,949 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:37:05,949 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:37:05,949 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:37:05,949 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:37:05,949 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:37:05,950 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:37:05,950 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:37:05,950 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:37:05,950 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:37:05,950 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:37:05,950 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:37:05,950 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:37:05,950 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:37:05,950 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:37:05,950 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:37:05,950 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:37:05,950 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:37:05,950 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 11:37:05,950 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:37:05,950 INFO │ misspelling 0.9997 ~ |
| 2026-04-13 11:37:05,950 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:37:05,950 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 11:37:05,950 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:37:05,950 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:37:05,950 INFO No improvement (6/25) best=0.9960 |
| |
| 2026-04-13 11:37:20,883 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:37:20,883 INFO [Step 66/200] det=skip para=-0.0000 raw_rwd=0.1258±0.0113 rwd=0.1258 |
| 2026-04-13 11:37:20,883 INFO per-gen rewards: deepseek=0.130 falcon3-=0.127 gemini-1=0.144 gemini-2=0.128 gemini-p=0.128 gemini-p=0.116 gpt-3.5-=0.121 gpt-4-tu=0.111 gpt-4-tu=0.113 gpt-4.5-=0.128 gpt-4o=0.126 gpt-4o-m=0.122 llama-2-=0.121 llama-2-=0.102 llama-3.=0.122 llama-3.=0.128 ministra=0.121 mistral-=0.118 mixtral-=0.129 o3-mini=0.130 qwen1.5-=0.140 text-bis=0.123 |
| 2026-04-13 11:37:35,515 INFO [Step 67/200] det=skip para=0.0101 raw_rwd=0.1255±0.0129 rwd=0.1255 |
| 2026-04-13 11:37:35,515 INFO per-gen rewards: deepseek=0.139 falcon3-=0.126 gemini-1=0.123 gemini-2=0.124 gemini-p=0.112 gemini-p=0.103 gpt-3.5-=0.133 gpt-4-tu=0.123 gpt-4-tu=0.134 gpt-4.5-=0.143 gpt-4o=0.126 gpt-4o-m=0.119 llama-2-=0.123 llama-2-=0.119 llama-3.=0.125 llama-3.=0.125 ministra=0.120 mistral-=0.119 mixtral-=0.120 o3-mini=0.128 qwen1.5-=0.130 text-bis=0.131 |
| 2026-04-13 11:37:50,185 INFO [Step 68/200] det=skip para=-0.0000 raw_rwd=0.1233±0.0095 rwd=0.1233 |
| 2026-04-13 11:37:50,186 INFO per-gen rewards: deepseek=0.129 falcon3-=0.129 gemini-1=0.122 gemini-2=0.116 gemini-p=0.132 gemini-p=0.135 gpt-3.5-=0.120 gpt-4-tu=0.122 gpt-4-tu=0.123 gpt-4.5-=0.122 gpt-4o=0.120 gpt-4o-m=0.133 llama-2-=0.115 llama-2-=0.134 llama-3.=0.122 llama-3.=0.127 ministra=0.126 mistral-=0.112 mixtral-=0.123 o3-mini=0.117 qwen1.5-=0.121 text-bis=0.113 |
| 2026-04-13 11:38:05,105 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:38:05,106 INFO [Step 69/200] det=skip para=-0.0000 raw_rwd=0.1244±0.0101 rwd=0.1244 |
| 2026-04-13 11:38:05,106 INFO per-gen rewards: deepseek=0.119 falcon3-=0.133 gemini-1=0.121 gemini-2=0.122 gemini-p=0.134 gemini-p=0.128 gpt-3.5-=0.130 gpt-4-tu=0.127 gpt-4-tu=0.118 gpt-4.5-=0.129 gpt-4o=0.127 gpt-4o-m=0.123 llama-2-=0.109 llama-2-=0.105 llama-3.=0.128 llama-3.=0.137 ministra=0.125 mistral-=0.112 mixtral-=0.122 o3-mini=0.116 qwen1.5-=0.133 text-bis=0.122 |
| 2026-04-13 11:38:19,747 INFO [Step 70/200] det=skip para=0.0005 raw_rwd=0.1252±0.0113 rwd=0.1252 |
| 2026-04-13 11:38:19,748 INFO per-gen rewards: deepseek=0.116 falcon3-=0.133 gemini-1=0.127 gemini-2=0.131 gemini-p=0.118 gemini-p=0.118 gpt-3.5-=0.124 gpt-4-tu=0.114 gpt-4-tu=0.133 gpt-4.5-=0.118 gpt-4o=0.121 gpt-4o-m=0.120 llama-2-=0.126 llama-2-=0.135 llama-3.=0.118 llama-3.=0.124 ministra=0.138 mistral-=0.132 mixtral-=0.120 o3-mini=0.129 qwen1.5-=0.132 text-bis=0.121 |
| 2026-04-13 11:43:03,652 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:43:03,652 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:43:03,652 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:43:03,652 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:43:03,652 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:43:03,652 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:43:03,652 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:43:03,652 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:43:03,652 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:43:03,652 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:43:03,652 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:43:03,653 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:43:03,653 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:43:03,653 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:43:03,653 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:43:03,653 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:43:03,653 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:43:03,653 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:43:03,653 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:43:03,653 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:43:03,653 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:43:03,653 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:43:03,653 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:43:03,653 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:43:03,653 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:43:03,653 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:43:03,653 INFO │ article_deletion 0.9983 ~ |
| 2026-04-13 11:43:03,653 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:43:03,653 INFO │ misspelling 0.9995 ~ |
| 2026-04-13 11:43:03,653 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:43:03,653 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 11:43:03,653 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:43:03,653 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:43:03,653 INFO No improvement (7/25) best=0.9960 |
| |
| 2026-04-13 11:43:18,416 INFO [Step 71/200] det=skip para=0.0000 raw_rwd=0.1227±0.0100 rwd=0.1227 |
| 2026-04-13 11:43:18,416 INFO per-gen rewards: deepseek=0.129 falcon3-=0.111 gemini-1=0.118 gemini-2=0.121 gemini-p=0.123 gemini-p=0.146 gpt-3.5-=0.124 gpt-4-tu=0.122 gpt-4-tu=0.127 gpt-4.5-=0.125 gpt-4o=0.128 gpt-4o-m=0.124 llama-2-=0.121 llama-2-=0.120 llama-3.=0.120 llama-3.=0.108 ministra=0.122 mistral-=0.115 mixtral-=0.122 o3-mini=0.122 qwen1.5-=0.146 text-bis=0.134 |
| 2026-04-13 11:43:32,826 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:43:32,826 INFO [Step 72/200] det=skip para=0.0050 raw_rwd=0.1232±0.0125 rwd=0.1232 |
| 2026-04-13 11:43:32,826 INFO per-gen rewards: deepseek=0.132 falcon3-=0.126 gemini-1=0.121 gemini-2=0.113 gemini-p=0.145 gemini-p=0.099 gpt-3.5-=0.130 gpt-4-tu=0.126 gpt-4-tu=0.129 gpt-4.5-=0.136 gpt-4o=0.128 gpt-4o-m=0.121 llama-2-=0.122 llama-2-=0.123 llama-3.=0.123 llama-3.=0.121 ministra=0.121 mistral-=0.111 mixtral-=0.134 o3-mini=0.116 qwen1.5-=0.115 text-bis=0.117 |
| 2026-04-13 11:43:47,386 INFO [Step 73/200] det=skip para=-0.0000 raw_rwd=0.1246±0.0098 rwd=0.1246 |
| 2026-04-13 11:43:47,386 INFO per-gen rewards: deepseek=0.117 falcon3-=0.126 gemini-1=0.127 gemini-2=0.126 gemini-p=0.124 gemini-p=0.134 gpt-3.5-=0.122 gpt-4-tu=0.116 gpt-4-tu=0.135 gpt-4.5-=0.126 gpt-4o=0.125 gpt-4o-m=0.126 llama-2-=0.118 llama-2-=0.134 llama-3.=0.128 llama-3.=0.126 ministra=0.123 mistral-=0.117 mixtral-=0.126 o3-mini=0.121 qwen1.5-=0.121 text-bis=0.132 |
| 2026-04-13 11:44:01,979 INFO [Step 74/200] det=skip para=0.0070 raw_rwd=0.1266±0.0136 rwd=0.1266 |
| 2026-04-13 11:44:01,979 INFO per-gen rewards: deepseek=0.130 falcon3-=0.118 gemini-1=0.127 gemini-2=0.120 gemini-p=0.139 gemini-p=0.120 gpt-3.5-=0.133 gpt-4-tu=0.129 gpt-4-tu=0.126 gpt-4.5-=0.114 gpt-4o=0.128 gpt-4o-m=0.125 llama-2-=0.112 llama-2-=0.118 llama-3.=0.129 llama-3.=0.127 ministra=0.132 mistral-=0.111 mixtral-=0.135 o3-mini=0.136 qwen1.5-=0.111 text-bis=0.106 |
| 2026-04-13 11:44:16,901 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:44:16,901 INFO [Step 75/200] det=skip para=0.0006 raw_rwd=0.1255±0.0129 rwd=0.1255 |
| 2026-04-13 11:44:16,901 INFO per-gen rewards: deepseek=0.122 falcon3-=0.122 gemini-1=0.120 gemini-2=0.120 gemini-p=0.141 gemini-p=0.120 gpt-3.5-=0.126 gpt-4-tu=0.139 gpt-4-tu=0.115 gpt-4.5-=0.127 gpt-4o=0.128 gpt-4o-m=0.124 llama-2-=0.120 llama-2-=0.141 llama-3.=0.130 llama-3.=0.125 ministra=0.118 mistral-=0.113 mixtral-=0.131 o3-mini=0.139 qwen1.5-=0.121 text-bis=0.132 |
| 2026-04-13 11:49:00,238 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:49:00,238 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:49:00,238 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:49:00,238 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:49:00,238 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:49:00,238 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:49:00,238 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:49:00,238 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:49:00,238 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:49:00,239 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:49:00,239 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:49:00,239 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:49:00,239 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:49:00,239 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:49:00,239 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:49:00,239 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:49:00,239 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:49:00,239 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:49:00,239 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:49:00,239 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:49:00,239 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:49:00,239 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:49:00,239 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:49:00,239 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:49:00,239 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:49:00,239 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:49:00,239 INFO │ article_deletion 0.9983 ~ |
| 2026-04-13 11:49:00,239 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:49:00,239 INFO │ misspelling 0.9998 ~ |
| 2026-04-13 11:49:00,239 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:49:00,239 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 11:49:00,239 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:49:00,239 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:49:00,239 INFO No improvement (8/25) best=0.9960 |
| |
| 2026-04-13 11:49:15,149 INFO [Step 76/200] det=skip para=0.0610 raw_rwd=0.1283±0.0226 rwd=0.1283 |
| 2026-04-13 11:49:15,150 INFO per-gen rewards: deepseek=0.126 falcon3-=0.116 gemini-1=0.124 gemini-2=0.116 gemini-p=0.128 gemini-p=0.129 gpt-3.5-=0.124 gpt-4-tu=0.126 gpt-4-tu=0.150 gpt-4.5-=0.126 gpt-4o=0.137 gpt-4o-m=0.124 llama-2-=0.123 llama-2-=0.121 llama-3.=0.124 llama-3.=0.129 ministra=0.157 mistral-=0.132 mixtral-=0.147 o3-mini=0.131 qwen1.5-=0.117 text-bis=0.122 |
| 2026-04-13 11:49:29,826 INFO [Step 77/200] det=skip para=0.0000 raw_rwd=0.1232±0.0108 rwd=0.1232 |
| 2026-04-13 11:49:29,827 INFO per-gen rewards: deepseek=0.122 falcon3-=0.120 gemini-1=0.121 gemini-2=0.128 gemini-p=0.131 gemini-p=0.132 gpt-3.5-=0.120 gpt-4-tu=0.122 gpt-4-tu=0.130 gpt-4.5-=0.114 gpt-4o=0.123 gpt-4o-m=0.116 llama-2-=0.132 llama-2-=0.152 llama-3.=0.126 llama-3.=0.129 ministra=0.125 mistral-=0.118 mixtral-=0.115 o3-mini=0.125 qwen1.5-=0.118 text-bis=0.124 |
| 2026-04-13 11:49:44,612 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:49:44,612 INFO [Step 78/200] det=skip para=-0.0000 raw_rwd=0.1236±0.0117 rwd=0.1236 |
| 2026-04-13 11:49:44,612 INFO per-gen rewards: deepseek=0.119 falcon3-=0.121 gemini-1=0.125 gemini-2=0.117 gemini-p=0.119 gemini-p=0.123 gpt-3.5-=0.125 gpt-4-tu=0.123 gpt-4-tu=0.138 gpt-4.5-=0.129 gpt-4o=0.125 gpt-4o-m=0.122 llama-2-=0.116 llama-2-=0.139 llama-3.=0.122 llama-3.=0.120 ministra=0.133 mistral-=0.098 mixtral-=0.130 o3-mini=0.122 qwen1.5-=0.138 text-bis=0.131 |
| 2026-04-13 11:49:59,234 INFO [Step 79/200] det=skip para=-0.0000 raw_rwd=0.1239±0.0111 rwd=0.1239 |
| 2026-04-13 11:49:59,234 INFO per-gen rewards: deepseek=0.128 falcon3-=0.123 gemini-1=0.125 gemini-2=0.115 gemini-p=0.118 gemini-p=0.126 gpt-3.5-=0.122 gpt-4-tu=0.128 gpt-4-tu=0.110 gpt-4.5-=0.110 gpt-4o=0.122 gpt-4o-m=0.135 llama-2-=0.132 llama-2-=0.128 llama-3.=0.126 llama-3.=0.111 ministra=0.128 mistral-=0.122 mixtral-=0.114 o3-mini=0.127 qwen1.5-=0.124 text-bis=0.109 |
| 2026-04-13 11:50:13,802 INFO [Step 80/200] det=skip para=0.0000 raw_rwd=0.1232±0.0112 rwd=0.1232 |
| 2026-04-13 11:50:13,803 INFO per-gen rewards: deepseek=0.123 falcon3-=0.119 gemini-1=0.125 gemini-2=0.120 gemini-p=0.124 gemini-p=0.141 gpt-3.5-=0.123 gpt-4-tu=0.133 gpt-4-tu=0.123 gpt-4.5-=0.112 gpt-4o=0.130 gpt-4o-m=0.124 llama-2-=0.124 llama-2-=0.104 llama-3.=0.121 llama-3.=0.130 ministra=0.121 mistral-=0.107 mixtral-=0.137 o3-mini=0.120 qwen1.5-=0.110 text-bis=0.139 |
| 2026-04-13 11:54:56,946 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 11:54:56,946 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 11:54:56,947 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 11:54:56,947 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 11:54:56,947 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 11:54:56,947 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 11:54:56,947 INFO │ gemini-pro 0.9851 |
| 2026-04-13 11:54:56,947 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 11:54:56,947 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 11:54:56,947 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 11:54:56,947 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 11:54:56,947 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 11:54:56,947 INFO │ gpt-4o 0.9999 |
| 2026-04-13 11:54:56,947 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 11:54:56,947 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 11:54:56,947 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 11:54:56,947 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 11:54:56,947 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 11:54:56,947 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 11:54:56,947 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 11:54:56,947 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 11:54:56,947 INFO │ o3-mini 0.9999 |
| 2026-04-13 11:54:56,947 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 11:54:56,947 INFO │ text-bison-002 0.9992 |
| 2026-04-13 11:54:56,947 INFO │ (prev best) 0.9960 |
| 2026-04-13 11:54:56,947 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 11:54:56,947 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 11:54:56,947 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 11:54:56,947 INFO │ misspelling 0.9998 ~ |
| 2026-04-13 11:54:56,947 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 11:54:56,947 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 11:54:56,947 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 11:54:56,947 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 11:54:56,947 INFO No improvement (9/25) best=0.9960 |
| |
| 2026-04-13 11:55:11,679 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:55:11,680 INFO [Step 81/200] det=skip para=0.0000 raw_rwd=0.1225±0.0109 rwd=0.1225 |
| 2026-04-13 11:55:11,680 INFO per-gen rewards: deepseek=0.124 falcon3-=0.120 gemini-1=0.120 gemini-2=0.127 gemini-p=0.152 gemini-p=0.121 gpt-3.5-=0.127 gpt-4-tu=0.131 gpt-4-tu=0.136 gpt-4.5-=0.109 gpt-4o=0.117 gpt-4o-m=0.119 llama-2-=0.111 llama-2-=0.132 llama-3.=0.118 llama-3.=0.116 ministra=0.128 mistral-=0.114 mixtral-=0.124 o3-mini=0.125 qwen1.5-=0.126 text-bis=0.113 |
| 2026-04-13 11:55:26,395 INFO [Step 82/200] det=skip para=-0.0000 raw_rwd=0.1243±0.0112 rwd=0.1243 |
| 2026-04-13 11:55:26,395 INFO per-gen rewards: deepseek=0.124 falcon3-=0.128 gemini-1=0.122 gemini-2=0.126 gemini-p=0.138 gemini-p=0.140 gpt-3.5-=0.128 gpt-4-tu=0.140 gpt-4-tu=0.115 gpt-4.5-=0.127 gpt-4o=0.121 gpt-4o-m=0.118 llama-2-=0.115 llama-2-=0.148 llama-3.=0.118 llama-3.=0.131 ministra=0.121 mistral-=0.121 mixtral-=0.126 o3-mini=0.125 qwen1.5-=0.120 text-bis=0.133 |
| 2026-04-13 11:55:40,857 INFO [Step 83/200] det=skip para=0.0000 raw_rwd=0.1228±0.0123 rwd=0.1228 |
| 2026-04-13 11:55:40,858 INFO per-gen rewards: deepseek=0.120 falcon3-=0.134 gemini-1=0.118 gemini-2=0.117 gemini-p=0.116 gemini-p=0.146 gpt-3.5-=0.123 gpt-4-tu=0.140 gpt-4-tu=0.131 gpt-4.5-=0.118 gpt-4o=0.118 gpt-4o-m=0.117 llama-2-=0.142 llama-2-=0.126 llama-3.=0.122 llama-3.=0.141 ministra=0.116 mistral-=0.134 mixtral-=0.115 o3-mini=0.124 qwen1.5-=0.119 text-bis=0.140 |
| 2026-04-13 11:55:55,609 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 11:55:55,609 INFO [Step 84/200] det=skip para=0.0606 raw_rwd=0.1280±0.0237 rwd=0.1280 |
| 2026-04-13 11:55:55,609 INFO per-gen rewards: deepseek=0.125 falcon3-=0.130 gemini-1=0.132 gemini-2=0.127 gemini-p=0.145 gemini-p=0.110 gpt-3.5-=0.128 gpt-4-tu=0.134 gpt-4-tu=0.132 gpt-4.5-=0.113 gpt-4o=0.120 gpt-4o-m=0.157 llama-2-=0.135 llama-2-=0.113 llama-3.=0.126 llama-3.=0.119 ministra=0.127 mistral-=0.122 mixtral-=0.102 o3-mini=0.119 qwen1.5-=0.128 text-bis=0.122 |
| 2026-04-13 11:56:10,223 INFO [Step 85/200] det=skip para=0.0056 raw_rwd=0.1250±0.0122 rwd=0.1250 |
| 2026-04-13 11:56:10,224 INFO per-gen rewards: deepseek=0.118 falcon3-=0.126 gemini-1=0.121 gemini-2=0.126 gemini-p=0.119 gemini-p=0.147 gpt-3.5-=0.125 gpt-4-tu=0.115 gpt-4-tu=0.123 gpt-4.5-=0.155 gpt-4o=0.129 gpt-4o-m=0.123 llama-2-=0.108 llama-2-=0.110 llama-3.=0.128 llama-3.=0.125 ministra=0.121 mistral-=0.141 mixtral-=0.126 o3-mini=0.132 qwen1.5-=0.108 text-bis=0.125 |
| 2026-04-13 12:00:55,330 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:00:55,330 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:00:55,330 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:00:55,330 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:00:55,330 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:00:55,330 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:00:55,330 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:00:55,330 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:00:55,330 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:00:55,330 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:00:55,330 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:00:55,330 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:00:55,330 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:00:55,330 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:00:55,330 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:00:55,330 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:00:55,330 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:00:55,330 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:00:55,331 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:00:55,331 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:00:55,331 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:00:55,331 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:00:55,331 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:00:55,331 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:00:55,331 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:00:55,331 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:00:55,331 INFO │ article_deletion 0.9982 ~ |
| 2026-04-13 12:00:55,331 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:00:55,331 INFO │ misspelling 0.9996 ~ |
| 2026-04-13 12:00:55,331 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:00:55,331 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:00:55,331 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:00:55,331 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:00:55,331 INFO No improvement (10/25) best=0.9960 |
| |
| 2026-04-13 12:01:10,468 INFO [Step 86/200] det=skip para=0.0186 raw_rwd=0.1236±0.0124 rwd=0.1236 |
| 2026-04-13 12:01:10,468 INFO per-gen rewards: deepseek=0.123 falcon3-=0.123 gemini-1=0.122 gemini-2=0.117 gemini-p=0.119 gemini-p=0.134 gpt-3.5-=0.118 gpt-4-tu=0.122 gpt-4-tu=0.148 gpt-4.5-=0.143 gpt-4o=0.121 gpt-4o-m=0.117 llama-2-=0.168 llama-2-=0.131 llama-3.=0.127 llama-3.=0.138 ministra=0.123 mistral-=0.124 mixtral-=0.137 o3-mini=0.121 qwen1.5-=0.130 text-bis=0.122 |
| 2026-04-13 12:01:25,285 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:01:25,286 INFO [Step 87/200] det=skip para=0.0057 raw_rwd=0.1254±0.0127 rwd=0.1254 |
| 2026-04-13 12:01:25,286 INFO per-gen rewards: deepseek=0.124 falcon3-=0.125 gemini-1=0.129 gemini-2=0.125 gemini-p=0.137 gemini-p=0.117 gpt-3.5-=0.118 gpt-4-tu=0.131 gpt-4-tu=0.142 gpt-4.5-=0.117 gpt-4o=0.122 gpt-4o-m=0.123 llama-2-=0.107 llama-2-=0.136 llama-3.=0.128 llama-3.=0.127 ministra=0.124 mistral-=0.125 mixtral-=0.150 o3-mini=0.130 qwen1.5-=0.142 text-bis=0.118 |
| 2026-04-13 12:01:40,180 INFO [Step 88/200] det=skip para=0.0021 raw_rwd=0.1250±0.0119 rwd=0.1250 |
| 2026-04-13 12:01:40,180 INFO per-gen rewards: deepseek=0.121 falcon3-=0.125 gemini-1=0.130 gemini-2=0.126 gemini-p=0.136 gemini-p=0.135 gpt-3.5-=0.119 gpt-4-tu=0.144 gpt-4-tu=0.123 gpt-4.5-=0.130 gpt-4o=0.121 gpt-4o-m=0.126 llama-2-=0.127 llama-2-=0.130 llama-3.=0.121 llama-3.=0.119 ministra=0.119 mistral-=0.140 mixtral-=0.135 o3-mini=0.126 qwen1.5-=0.116 text-bis=0.160 |
| 2026-04-13 12:01:55,001 INFO [Step 89/200] det=skip para=0.0000 raw_rwd=0.1281±0.0092 rwd=0.1281 |
| 2026-04-13 12:01:55,001 INFO per-gen rewards: deepseek=0.129 falcon3-=0.129 gemini-1=0.122 gemini-2=0.122 gemini-p=0.121 gemini-p=0.125 gpt-3.5-=0.132 gpt-4-tu=0.129 gpt-4-tu=0.147 gpt-4.5-=0.139 gpt-4o=0.125 gpt-4o-m=0.129 llama-2-=0.121 llama-2-=0.112 llama-3.=0.123 llama-3.=0.143 ministra=0.131 mistral-=0.128 mixtral-=0.132 o3-mini=0.130 qwen1.5-=0.142 text-bis=0.125 |
| 2026-04-13 12:02:10,222 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:02:10,223 INFO [Step 90/200] det=skip para=-0.0000 raw_rwd=0.1252±0.0119 rwd=0.1252 |
| 2026-04-13 12:02:10,223 INFO per-gen rewards: deepseek=0.127 falcon3-=0.133 gemini-1=0.132 gemini-2=0.130 gemini-p=0.139 gemini-p=0.144 gpt-3.5-=0.128 gpt-4-tu=0.117 gpt-4-tu=0.118 gpt-4.5-=0.113 gpt-4o=0.123 gpt-4o-m=0.121 llama-2-=0.123 llama-2-=0.129 llama-3.=0.124 llama-3.=0.113 ministra=0.114 mistral-=0.119 mixtral-=0.132 o3-mini=0.126 qwen1.5-=0.128 text-bis=0.132 |
| 2026-04-13 12:06:54,880 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:06:54,880 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:06:54,880 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:06:54,880 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:06:54,880 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:06:54,880 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:06:54,880 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:06:54,880 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:06:54,880 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:06:54,880 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:06:54,880 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:06:54,880 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:06:54,880 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:06:54,880 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:06:54,880 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:06:54,880 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:06:54,880 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:06:54,880 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:06:54,880 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:06:54,880 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:06:54,880 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:06:54,880 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:06:54,880 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:06:54,881 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:06:54,881 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:06:54,881 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:06:54,881 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 12:06:54,881 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:06:54,881 INFO │ misspelling 0.9998 ~ |
| 2026-04-13 12:06:54,881 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:06:54,881 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 12:06:54,881 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:06:54,881 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:06:54,881 INFO No improvement (11/25) best=0.9960 |
| |
| 2026-04-13 12:07:09,705 INFO [Step 91/200] det=skip para=0.0640 raw_rwd=0.1266±0.0253 rwd=0.1266 |
| 2026-04-13 12:07:09,705 INFO per-gen rewards: deepseek=0.120 falcon3-=0.119 gemini-1=0.123 gemini-2=0.126 gemini-p=0.307 gemini-p=0.121 gpt-3.5-=0.129 gpt-4-tu=0.136 gpt-4-tu=0.130 gpt-4.5-=0.129 gpt-4o=0.122 gpt-4o-m=0.122 llama-2-=0.128 llama-2-=0.120 llama-3.=0.121 llama-3.=0.119 ministra=0.133 mistral-=0.130 mixtral-=0.115 o3-mini=0.119 qwen1.5-=0.114 text-bis=0.130 |
| 2026-04-13 12:07:24,200 INFO [Step 92/200] det=skip para=0.0653 raw_rwd=0.1265±0.0240 rwd=0.1265 |
| 2026-04-13 12:07:24,200 INFO per-gen rewards: deepseek=0.127 falcon3-=0.120 gemini-1=0.122 gemini-2=0.123 gemini-p=0.121 gemini-p=0.116 gpt-3.5-=0.125 gpt-4-tu=0.125 gpt-4-tu=0.135 gpt-4.5-=0.124 gpt-4o=0.126 gpt-4o-m=0.124 llama-2-=0.123 llama-2-=0.114 llama-3.=0.125 llama-3.=0.118 ministra=0.126 mistral-=0.112 mixtral-=0.113 o3-mini=0.163 qwen1.5-=0.128 text-bis=0.118 |
| 2026-04-13 12:07:38,647 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:07:38,648 INFO [Step 93/200] det=skip para=0.0036 raw_rwd=0.1240±0.0113 rwd=0.1240 |
| 2026-04-13 12:07:38,648 INFO per-gen rewards: deepseek=0.114 falcon3-=0.129 gemini-1=0.120 gemini-2=0.124 gemini-p=0.131 gemini-p=0.116 gpt-3.5-=0.120 gpt-4-tu=0.119 gpt-4-tu=0.117 gpt-4.5-=0.116 gpt-4o=0.125 gpt-4o-m=0.128 llama-2-=0.126 llama-2-=0.131 llama-3.=0.126 llama-3.=0.116 ministra=0.131 mistral-=0.134 mixtral-=0.106 o3-mini=0.127 qwen1.5-=0.126 text-bis=0.136 |
| 2026-04-13 12:07:53,143 INFO [Step 94/200] det=skip para=0.0000 raw_rwd=0.1238±0.0114 rwd=0.1238 |
| 2026-04-13 12:07:53,143 INFO per-gen rewards: deepseek=0.131 falcon3-=0.128 gemini-1=0.132 gemini-2=0.117 gemini-p=0.127 gemini-p=0.127 gpt-3.5-=0.116 gpt-4-tu=0.110 gpt-4-tu=0.122 gpt-4.5-=0.104 gpt-4o=0.132 gpt-4o-m=0.128 llama-2-=0.126 llama-2-=0.111 llama-3.=0.127 llama-3.=0.115 ministra=0.115 mistral-=0.106 mixtral-=0.140 o3-mini=0.125 qwen1.5-=0.122 text-bis=0.127 |
| 2026-04-13 12:08:08,144 INFO [Step 95/200] det=skip para=0.0000 raw_rwd=0.1253±0.0117 rwd=0.1253 |
| 2026-04-13 12:08:08,145 INFO per-gen rewards: deepseek=0.118 falcon3-=0.122 gemini-1=0.120 gemini-2=0.120 gemini-p=0.132 gemini-p=0.142 gpt-3.5-=0.120 gpt-4-tu=0.129 gpt-4-tu=0.132 gpt-4.5-=0.122 gpt-4o=0.119 gpt-4o-m=0.120 llama-2-=0.125 llama-2-=0.129 llama-3.=0.136 llama-3.=0.124 ministra=0.130 mistral-=0.126 mixtral-=0.124 o3-mini=0.144 qwen1.5-=0.122 text-bis=0.126 |
| 2026-04-13 12:12:52,429 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:12:52,429 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:12:52,429 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:12:52,429 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:12:52,429 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:12:52,429 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:12:52,429 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:12:52,429 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:12:52,429 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:12:52,429 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:12:52,429 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:12:52,429 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:12:52,429 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:12:52,429 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:12:52,429 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:12:52,429 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:12:52,429 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:12:52,429 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:12:52,429 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:12:52,429 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:12:52,429 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:12:52,430 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:12:52,430 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:12:52,430 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:12:52,430 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:12:52,430 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:12:52,430 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 12:12:52,430 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:12:52,430 INFO │ misspelling 0.9997 ~ |
| 2026-04-13 12:12:52,430 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:12:52,430 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:12:52,430 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:12:52,430 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:12:52,430 INFO No improvement (12/25) best=0.9960 |
| |
| 2026-04-13 12:13:07,242 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:13:07,243 INFO [Step 96/200] det=skip para=0.0019 raw_rwd=0.1251±0.0110 rwd=0.1251 |
| 2026-04-13 12:13:07,243 INFO per-gen rewards: deepseek=0.121 falcon3-=0.137 gemini-1=0.123 gemini-2=0.130 gemini-p=0.115 gemini-p=0.128 gpt-3.5-=0.129 gpt-4-tu=0.130 gpt-4-tu=0.109 gpt-4.5-=0.115 gpt-4o=0.123 gpt-4o-m=0.121 llama-2-=0.107 llama-2-=0.128 llama-3.=0.120 llama-3.=0.115 ministra=0.132 mistral-=0.131 mixtral-=0.138 o3-mini=0.130 qwen1.5-=0.122 text-bis=0.111 |
| 2026-04-13 12:13:21,757 INFO [Step 97/200] det=skip para=-0.0000 raw_rwd=0.1266±0.0126 rwd=0.1266 |
| 2026-04-13 12:13:21,757 INFO per-gen rewards: deepseek=0.126 falcon3-=0.121 gemini-1=0.133 gemini-2=0.118 gemini-p=0.143 gemini-p=0.112 gpt-3.5-=0.128 gpt-4-tu=0.123 gpt-4-tu=0.126 gpt-4.5-=0.128 gpt-4o=0.129 gpt-4o-m=0.125 llama-2-=0.124 llama-2-=0.119 llama-3.=0.133 llama-3.=0.132 ministra=0.119 mistral-=0.121 mixtral-=0.133 o3-mini=0.125 qwen1.5-=0.153 text-bis=0.131 |
| 2026-04-13 12:13:36,314 INFO [Step 98/200] det=skip para=0.0624 raw_rwd=0.1302±0.0251 rwd=0.1302 |
| 2026-04-13 12:13:36,314 INFO per-gen rewards: deepseek=0.132 falcon3-=0.127 gemini-1=0.118 gemini-2=0.128 gemini-p=0.116 gemini-p=0.128 gpt-3.5-=0.156 gpt-4-tu=0.128 gpt-4-tu=0.121 gpt-4.5-=0.150 gpt-4o=0.133 gpt-4o-m=0.127 llama-2-=0.133 llama-2-=0.129 llama-3.=0.124 llama-3.=0.122 ministra=0.124 mistral-=0.143 mixtral-=0.141 o3-mini=0.131 qwen1.5-=0.109 text-bis=0.133 |
| 2026-04-13 12:13:50,828 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:13:50,828 INFO [Step 99/200] det=skip para=0.0009 raw_rwd=0.1236±0.0104 rwd=0.1236 |
| 2026-04-13 12:13:50,828 INFO per-gen rewards: deepseek=0.118 falcon3-=0.118 gemini-1=0.124 gemini-2=0.124 gemini-p=0.126 gemini-p=0.108 gpt-3.5-=0.126 gpt-4-tu=0.126 gpt-4-tu=0.120 gpt-4.5-=0.119 gpt-4o=0.121 gpt-4o-m=0.127 llama-2-=0.138 llama-2-=0.129 llama-3.=0.120 llama-3.=0.144 ministra=0.123 mistral-=0.110 mixtral-=0.134 o3-mini=0.126 qwen1.5-=0.116 text-bis=0.127 |
| 2026-04-13 12:14:05,147 INFO [Step 100/200] det=skip para=0.0006 raw_rwd=0.1251±0.0105 rwd=0.1251 |
| 2026-04-13 12:14:05,147 INFO per-gen rewards: deepseek=0.128 falcon3-=0.117 gemini-1=0.125 gemini-2=0.132 gemini-p=0.123 gemini-p=0.127 gpt-3.5-=0.120 gpt-4-tu=0.117 gpt-4-tu=0.119 gpt-4.5-=0.131 gpt-4o=0.123 gpt-4o-m=0.132 llama-2-=0.126 llama-2-=0.143 llama-3.=0.126 llama-3.=0.121 ministra=0.122 mistral-=0.121 mixtral-=0.123 o3-mini=0.130 qwen1.5-=0.115 text-bis=0.117 |
| 2026-04-13 12:18:48,453 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:18:48,453 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:18:48,453 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:18:48,453 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:18:48,453 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:18:48,453 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:18:48,453 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:18:48,453 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:18:48,453 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:18:48,453 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:18:48,453 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:18:48,453 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:18:48,453 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:18:48,453 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:18:48,453 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:18:48,453 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:18:48,454 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:18:48,454 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:18:48,454 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:18:48,454 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:18:48,454 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:18:48,454 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:18:48,454 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:18:48,454 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:18:48,454 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:18:48,454 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:18:48,454 INFO │ article_deletion 0.9984 ~ |
| 2026-04-13 12:18:48,454 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:18:48,454 INFO │ misspelling 0.9995 ~ |
| 2026-04-13 12:18:48,454 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:18:48,454 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:18:48,454 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:18:48,454 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:18:48,454 INFO No improvement (13/25) best=0.9960 |
| |
| 2026-04-13 12:19:03,261 INFO [Step 101/200] det=skip para=0.0028 raw_rwd=0.1272±0.0129 rwd=0.1272 |
| 2026-04-13 12:19:03,261 INFO per-gen rewards: deepseek=0.117 falcon3-=0.123 gemini-1=0.128 gemini-2=0.130 gemini-p=0.129 gemini-p=0.118 gpt-3.5-=0.126 gpt-4-tu=0.130 gpt-4-tu=0.122 gpt-4.5-=0.124 gpt-4o=0.122 gpt-4o-m=0.130 llama-2-=0.146 llama-2-=0.133 llama-3.=0.128 llama-3.=0.144 ministra=0.130 mistral-=0.115 mixtral-=0.121 o3-mini=0.130 qwen1.5-=0.148 text-bis=0.109 |
| 2026-04-13 12:19:17,941 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:19:17,942 INFO [Step 102/200] det=skip para=-0.0000 raw_rwd=0.1271±0.0110 rwd=0.1271 |
| 2026-04-13 12:19:17,942 INFO per-gen rewards: deepseek=0.123 falcon3-=0.126 gemini-1=0.132 gemini-2=0.123 gemini-p=0.100 gemini-p=0.145 gpt-3.5-=0.131 gpt-4-tu=0.131 gpt-4-tu=0.144 gpt-4.5-=0.122 gpt-4o=0.126 gpt-4o-m=0.135 llama-2-=0.141 llama-2-=0.129 llama-3.=0.126 llama-3.=0.136 ministra=0.124 mistral-=0.120 mixtral-=0.118 o3-mini=0.119 qwen1.5-=0.134 text-bis=0.125 |
| 2026-04-13 12:19:32,983 INFO [Step 103/200] det=skip para=-0.0000 raw_rwd=0.1235±0.0117 rwd=0.1235 |
| 2026-04-13 12:19:32,983 INFO per-gen rewards: deepseek=0.112 falcon3-=0.133 gemini-1=0.122 gemini-2=0.129 gemini-p=0.137 gemini-p=0.115 gpt-3.5-=0.121 gpt-4-tu=0.114 gpt-4-tu=0.138 gpt-4.5-=0.128 gpt-4o=0.121 gpt-4o-m=0.123 llama-2-=0.116 llama-2-=0.124 llama-3.=0.130 llama-3.=0.129 ministra=0.114 mistral-=0.134 mixtral-=0.143 o3-mini=0.122 qwen1.5-=0.124 text-bis=0.119 |
| 2026-04-13 12:19:48,619 INFO [Step 104/200] det=skip para=0.0034 raw_rwd=0.1270±0.0132 rwd=0.1270 |
| 2026-04-13 12:19:48,619 INFO per-gen rewards: deepseek=0.127 falcon3-=0.126 gemini-1=0.140 gemini-2=0.125 gemini-p=0.113 gemini-p=0.119 gpt-3.5-=0.124 gpt-4-tu=0.135 gpt-4-tu=0.107 gpt-4.5-=0.132 gpt-4o=0.126 gpt-4o-m=0.129 llama-2-=0.101 llama-2-=0.129 llama-3.=0.133 llama-3.=0.129 ministra=0.119 mistral-=0.140 mixtral-=0.142 o3-mini=0.126 qwen1.5-=0.135 text-bis=0.116 |
| 2026-04-13 12:20:03,223 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:20:03,223 INFO [Step 105/200] det=skip para=-0.0000 raw_rwd=0.1237±0.0099 rwd=0.1237 |
| 2026-04-13 12:20:03,223 INFO per-gen rewards: deepseek=0.124 falcon3-=0.125 gemini-1=0.126 gemini-2=0.127 gemini-p=0.120 gemini-p=0.129 gpt-3.5-=0.133 gpt-4-tu=0.110 gpt-4-tu=0.124 gpt-4.5-=0.129 gpt-4o=0.120 gpt-4o-m=0.123 llama-2-=0.116 llama-2-=0.123 llama-3.=0.121 llama-3.=0.113 ministra=0.131 mistral-=0.120 mixtral-=0.108 o3-mini=0.117 qwen1.5-=0.118 text-bis=0.138 |
| 2026-04-13 12:24:47,237 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:24:47,237 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:24:47,238 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:24:47,238 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:24:47,238 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:24:47,238 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:24:47,238 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:24:47,238 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:24:47,238 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:24:47,238 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:24:47,238 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:24:47,238 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:24:47,238 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:24:47,238 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:24:47,238 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:24:47,238 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:24:47,238 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:24:47,238 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:24:47,238 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:24:47,238 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:24:47,238 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:24:47,238 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:24:47,238 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:24:47,238 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:24:47,238 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:24:47,238 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:24:47,238 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 12:24:47,238 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:24:47,238 INFO │ misspelling 0.9996 ~ |
| 2026-04-13 12:24:47,238 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:24:47,238 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:24:47,238 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:24:47,238 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:24:47,238 INFO No improvement (14/25) best=0.9960 |
| |
| 2026-04-13 12:25:01,910 INFO [Step 106/200] det=skip para=0.0000 raw_rwd=0.1228±0.0080 rwd=0.1228 |
| 2026-04-13 12:25:01,910 INFO per-gen rewards: deepseek=0.127 falcon3-=0.124 gemini-1=0.126 gemini-2=0.124 gemini-p=0.122 gemini-p=0.120 gpt-3.5-=0.120 gpt-4-tu=0.128 gpt-4-tu=0.118 gpt-4.5-=0.124 gpt-4o=0.124 gpt-4o-m=0.124 llama-2-=0.129 llama-2-=0.124 llama-3.=0.116 llama-3.=0.127 ministra=0.126 mistral-=0.128 mixtral-=0.116 o3-mini=0.123 qwen1.5-=0.113 text-bis=0.105 |
| 2026-04-13 12:25:16,379 INFO [Step 107/200] det=skip para=-0.0000 raw_rwd=0.1242±0.0093 rwd=0.1242 |
| 2026-04-13 12:25:16,379 INFO per-gen rewards: deepseek=0.127 falcon3-=0.121 gemini-1=0.132 gemini-2=0.128 gemini-p=0.125 gemini-p=0.133 gpt-3.5-=0.120 gpt-4-tu=0.119 gpt-4-tu=0.124 gpt-4.5-=0.135 gpt-4o=0.119 gpt-4o-m=0.125 llama-2-=0.120 llama-2-=0.101 llama-3.=0.129 llama-3.=0.121 ministra=0.122 mistral-=0.137 mixtral-=0.117 o3-mini=0.124 qwen1.5-=0.120 text-bis=0.126 |
| 2026-04-13 12:25:30,912 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:25:30,913 INFO [Step 108/200] det=skip para=0.0000 raw_rwd=0.1275±0.0118 rwd=0.1275 |
| 2026-04-13 12:25:30,913 INFO per-gen rewards: deepseek=0.123 falcon3-=0.135 gemini-1=0.129 gemini-2=0.124 gemini-p=0.158 gemini-p=0.114 gpt-3.5-=0.127 gpt-4-tu=0.126 gpt-4-tu=0.129 gpt-4.5-=0.151 gpt-4o=0.124 gpt-4o-m=0.131 llama-2-=0.127 llama-2-=0.121 llama-3.=0.127 llama-3.=0.131 ministra=0.124 mistral-=0.122 mixtral-=0.133 o3-mini=0.125 qwen1.5-=0.098 text-bis=0.151 |
| 2026-04-13 12:25:45,652 INFO [Step 109/200] det=skip para=0.0021 raw_rwd=0.1263±0.0113 rwd=0.1263 |
| 2026-04-13 12:25:45,653 INFO per-gen rewards: deepseek=0.124 falcon3-=0.123 gemini-1=0.118 gemini-2=0.136 gemini-p=0.105 gemini-p=0.112 gpt-3.5-=0.126 gpt-4-tu=0.107 gpt-4-tu=0.122 gpt-4.5-=0.116 gpt-4o=0.134 gpt-4o-m=0.122 llama-2-=0.127 llama-2-=0.116 llama-3.=0.126 llama-3.=0.127 ministra=0.130 mistral-=0.120 mixtral-=0.127 o3-mini=0.134 qwen1.5-=0.141 text-bis=0.135 |
| 2026-04-13 12:26:00,422 INFO [Step 110/200] det=skip para=0.0008 raw_rwd=0.1253±0.0139 rwd=0.1253 |
| 2026-04-13 12:26:00,422 INFO per-gen rewards: deepseek=0.132 falcon3-=0.122 gemini-1=0.129 gemini-2=0.123 gemini-p=0.114 gemini-p=0.133 gpt-3.5-=0.127 gpt-4-tu=0.119 gpt-4-tu=0.115 gpt-4.5-=0.119 gpt-4o=0.123 gpt-4o-m=0.137 llama-2-=0.124 llama-2-=0.109 llama-3.=0.135 llama-3.=0.109 ministra=0.123 mistral-=0.127 mixtral-=0.119 o3-mini=0.115 qwen1.5-=0.127 text-bis=0.128 |
| 2026-04-13 12:30:42,979 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:30:42,979 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:30:42,979 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:30:42,979 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:30:42,979 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:30:42,979 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:30:42,979 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:30:42,979 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:30:42,979 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:30:42,979 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:30:42,979 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:30:42,979 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:30:42,979 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:30:42,979 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:30:42,979 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:30:42,979 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:30:42,980 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:30:42,980 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:30:42,980 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:30:42,980 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:30:42,980 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:30:42,980 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:30:42,980 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:30:42,980 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:30:42,980 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:30:42,980 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:30:42,980 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 12:30:42,980 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:30:42,980 INFO │ misspelling 0.9996 ~ |
| 2026-04-13 12:30:42,980 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:30:42,980 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:30:42,980 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:30:42,980 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:30:42,980 INFO No improvement (15/25) best=0.9960 |
| |
| 2026-04-13 12:30:57,941 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:30:57,942 INFO [Step 111/200] det=skip para=0.0000 raw_rwd=0.1246±0.0116 rwd=0.1246 |
| 2026-04-13 12:30:57,942 INFO per-gen rewards: deepseek=0.123 falcon3-=0.123 gemini-1=0.118 gemini-2=0.128 gemini-p=0.137 gemini-p=0.110 gpt-3.5-=0.121 gpt-4-tu=0.147 gpt-4-tu=0.132 gpt-4.5-=0.152 gpt-4o=0.127 gpt-4o-m=0.119 llama-2-=0.114 llama-2-=0.131 llama-3.=0.131 llama-3.=0.122 ministra=0.122 mistral-=0.110 mixtral-=0.140 o3-mini=0.130 qwen1.5-=0.107 text-bis=0.118 |
| 2026-04-13 12:31:12,864 INFO [Step 112/200] det=skip para=0.0000 raw_rwd=0.1264±0.0098 rwd=0.1264 |
| 2026-04-13 12:31:12,864 INFO per-gen rewards: deepseek=0.130 falcon3-=0.122 gemini-1=0.122 gemini-2=0.130 gemini-p=0.117 gemini-p=0.148 gpt-3.5-=0.126 gpt-4-tu=0.118 gpt-4-tu=0.133 gpt-4.5-=0.106 gpt-4o=0.124 gpt-4o-m=0.129 llama-2-=0.131 llama-2-=0.133 llama-3.=0.128 llama-3.=0.128 ministra=0.132 mistral-=0.127 mixtral-=0.110 o3-mini=0.123 qwen1.5-=0.121 text-bis=0.122 |
| 2026-04-13 12:31:27,747 INFO [Step 113/200] det=skip para=-0.0000 raw_rwd=0.1274±0.0100 rwd=0.1274 |
| 2026-04-13 12:31:27,747 INFO per-gen rewards: deepseek=0.127 falcon3-=0.126 gemini-1=0.130 gemini-2=0.127 gemini-p=0.130 gemini-p=0.131 gpt-3.5-=0.131 gpt-4-tu=0.118 gpt-4-tu=0.119 gpt-4.5-=0.123 gpt-4o=0.129 gpt-4o-m=0.125 llama-2-=0.136 llama-2-=0.129 llama-3.=0.131 llama-3.=0.119 ministra=0.119 mistral-=0.133 mixtral-=0.130 o3-mini=0.130 qwen1.5-=0.129 text-bis=0.133 |
| 2026-04-13 12:31:42,552 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:31:42,552 INFO [Step 114/200] det=skip para=0.0103 raw_rwd=0.1240±0.0104 rwd=0.1240 |
| 2026-04-13 12:31:42,552 INFO per-gen rewards: deepseek=0.138 falcon3-=0.120 gemini-1=0.120 gemini-2=0.122 gemini-p=0.129 gemini-p=0.132 gpt-3.5-=0.126 gpt-4-tu=0.132 gpt-4-tu=0.125 gpt-4.5-=0.124 gpt-4o=0.119 gpt-4o-m=0.126 llama-2-=0.138 llama-2-=0.141 llama-3.=0.121 llama-3.=0.116 ministra=0.112 mistral-=0.130 mixtral-=0.133 o3-mini=0.125 qwen1.5-=0.114 text-bis=0.137 |
| 2026-04-13 12:31:57,013 INFO [Step 115/200] det=skip para=0.0000 raw_rwd=0.1236±0.0120 rwd=0.1236 |
| 2026-04-13 12:31:57,013 INFO per-gen rewards: deepseek=0.123 falcon3-=0.117 gemini-1=0.125 gemini-2=0.118 gemini-p=0.128 gemini-p=0.102 gpt-3.5-=0.125 gpt-4-tu=0.140 gpt-4-tu=0.120 gpt-4.5-=0.103 gpt-4o=0.132 gpt-4o-m=0.117 llama-2-=0.122 llama-2-=0.122 llama-3.=0.116 llama-3.=0.131 ministra=0.131 mistral-=0.139 mixtral-=0.121 o3-mini=0.130 qwen1.5-=0.134 text-bis=0.113 |
| 2026-04-13 12:36:39,822 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:36:39,822 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:36:39,822 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:36:39,822 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:36:39,822 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:36:39,822 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:36:39,822 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:36:39,822 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:36:39,823 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:36:39,823 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:36:39,823 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:36:39,823 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:36:39,823 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:36:39,823 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:36:39,823 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:36:39,823 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:36:39,823 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:36:39,823 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:36:39,823 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:36:39,823 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:36:39,823 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:36:39,823 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:36:39,823 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:36:39,823 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:36:39,823 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:36:39,823 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:36:39,823 INFO │ article_deletion 0.9982 ~ |
| 2026-04-13 12:36:39,823 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:36:39,823 INFO │ misspelling 0.9997 ~ |
| 2026-04-13 12:36:39,823 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:36:39,823 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:36:39,823 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:36:39,823 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:36:39,823 INFO No improvement (16/25) best=0.9960 |
| |
| 2026-04-13 12:36:54,740 INFO [Step 116/200] det=skip para=-0.0000 raw_rwd=0.1244±0.0105 rwd=0.1244 |
| 2026-04-13 12:36:54,740 INFO per-gen rewards: deepseek=0.122 falcon3-=0.135 gemini-1=0.118 gemini-2=0.122 gemini-p=0.113 gemini-p=0.108 gpt-3.5-=0.130 gpt-4-tu=0.134 gpt-4-tu=0.122 gpt-4.5-=0.113 gpt-4o=0.125 gpt-4o-m=0.120 llama-2-=0.121 llama-2-=0.136 llama-3.=0.132 llama-3.=0.118 ministra=0.124 mistral-=0.124 mixtral-=0.147 o3-mini=0.121 qwen1.5-=0.123 text-bis=0.127 |
| 2026-04-13 12:37:09,286 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:37:09,287 INFO [Step 117/200] det=skip para=-0.0000 raw_rwd=0.1246±0.0102 rwd=0.1246 |
| 2026-04-13 12:37:09,287 INFO per-gen rewards: deepseek=0.127 falcon3-=0.123 gemini-1=0.121 gemini-2=0.127 gemini-p=0.110 gemini-p=0.116 gpt-3.5-=0.134 gpt-4-tu=0.118 gpt-4-tu=0.148 gpt-4.5-=0.126 gpt-4o=0.125 gpt-4o-m=0.125 llama-2-=0.138 llama-2-=0.110 llama-3.=0.123 llama-3.=0.119 ministra=0.124 mistral-=0.125 mixtral-=0.128 o3-mini=0.116 qwen1.5-=0.134 text-bis=0.124 |
| 2026-04-13 12:37:23,646 INFO [Step 118/200] det=skip para=0.0000 raw_rwd=0.1230±0.0088 rwd=0.1230 |
| 2026-04-13 12:37:23,646 INFO per-gen rewards: deepseek=0.121 falcon3-=0.134 gemini-1=0.118 gemini-2=0.120 gemini-p=0.129 gemini-p=0.129 gpt-3.5-=0.122 gpt-4-tu=0.107 gpt-4-tu=0.112 gpt-4.5-=0.120 gpt-4o=0.119 gpt-4o-m=0.120 llama-2-=0.138 llama-2-=0.130 llama-3.=0.130 llama-3.=0.121 ministra=0.124 mistral-=0.128 mixtral-=0.117 o3-mini=0.129 qwen1.5-=0.118 text-bis=0.126 |
| 2026-04-13 12:37:38,151 INFO [Step 119/200] det=skip para=-0.0000 raw_rwd=0.1266±0.0123 rwd=0.1266 |
| 2026-04-13 12:37:38,151 INFO per-gen rewards: deepseek=0.123 falcon3-=0.123 gemini-1=0.126 gemini-2=0.132 gemini-p=0.116 gemini-p=0.107 gpt-3.5-=0.134 gpt-4-tu=0.122 gpt-4-tu=0.114 gpt-4.5-=0.118 gpt-4o=0.129 gpt-4o-m=0.123 llama-2-=0.125 llama-2-=0.119 llama-3.=0.125 llama-3.=0.120 ministra=0.131 mistral-=0.138 mixtral-=0.116 o3-mini=0.127 qwen1.5-=0.140 text-bis=0.139 |
| 2026-04-13 12:37:53,091 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:37:53,091 INFO [Step 120/200] det=skip para=0.0000 raw_rwd=0.1255±0.0112 rwd=0.1255 |
| 2026-04-13 12:37:53,091 INFO per-gen rewards: deepseek=0.125 falcon3-=0.128 gemini-1=0.130 gemini-2=0.129 gemini-p=0.129 gemini-p=0.126 gpt-3.5-=0.124 gpt-4-tu=0.136 gpt-4-tu=0.118 gpt-4.5-=0.146 gpt-4o=0.127 gpt-4o-m=0.123 llama-2-=0.103 llama-2-=0.108 llama-3.=0.125 llama-3.=0.124 ministra=0.123 mistral-=0.118 mixtral-=0.125 o3-mini=0.127 qwen1.5-=0.125 text-bis=0.132 |
| 2026-04-13 12:42:37,843 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:42:37,844 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:42:37,844 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:42:37,844 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:42:37,844 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:42:37,844 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:42:37,844 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:42:37,844 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:42:37,844 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:42:37,844 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:42:37,844 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:42:37,844 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:42:37,844 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:42:37,844 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:42:37,844 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:42:37,844 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:42:37,844 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:42:37,844 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:42:37,844 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:42:37,844 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:42:37,844 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:42:37,844 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:42:37,844 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:42:37,844 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:42:37,844 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:42:37,844 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:42:37,844 INFO │ article_deletion 0.9982 ~ |
| 2026-04-13 12:42:37,844 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:42:37,844 INFO │ misspelling 0.9998 ~ |
| 2026-04-13 12:42:37,844 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:42:37,844 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:42:37,844 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:42:37,844 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:42:37,844 INFO No improvement (17/25) best=0.9960 |
| |
| 2026-04-13 12:42:52,836 INFO [Step 121/200] det=skip para=-0.0000 raw_rwd=0.1249±0.0116 rwd=0.1249 |
| 2026-04-13 12:42:52,836 INFO per-gen rewards: deepseek=0.124 falcon3-=0.117 gemini-1=0.125 gemini-2=0.132 gemini-p=0.111 gemini-p=0.117 gpt-3.5-=0.121 gpt-4-tu=0.137 gpt-4-tu=0.123 gpt-4.5-=0.128 gpt-4o=0.128 gpt-4o-m=0.134 llama-2-=0.142 llama-2-=0.126 llama-3.=0.117 llama-3.=0.112 ministra=0.121 mistral-=0.152 mixtral-=0.115 o3-mini=0.121 qwen1.5-=0.127 text-bis=0.142 |
| 2026-04-13 12:43:07,504 INFO [Step 122/200] det=skip para=0.0000 raw_rwd=0.1252±0.0103 rwd=0.1252 |
| 2026-04-13 12:43:07,504 INFO per-gen rewards: deepseek=0.130 falcon3-=0.123 gemini-1=0.123 gemini-2=0.125 gemini-p=0.124 gemini-p=0.122 gpt-3.5-=0.124 gpt-4-tu=0.144 gpt-4-tu=0.118 gpt-4.5-=0.120 gpt-4o=0.126 gpt-4o-m=0.124 llama-2-=0.122 llama-2-=0.113 llama-3.=0.121 llama-3.=0.131 ministra=0.131 mistral-=0.122 mixtral-=0.129 o3-mini=0.127 qwen1.5-=0.105 text-bis=0.137 |
| 2026-04-13 12:43:22,666 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:43:22,667 INFO [Step 123/200] det=skip para=-0.0000 raw_rwd=0.1235±0.0094 rwd=0.1235 |
| 2026-04-13 12:43:22,667 INFO per-gen rewards: deepseek=0.119 falcon3-=0.122 gemini-1=0.124 gemini-2=0.123 gemini-p=0.123 gemini-p=0.144 gpt-3.5-=0.121 gpt-4-tu=0.126 gpt-4-tu=0.117 gpt-4.5-=0.136 gpt-4o=0.126 gpt-4o-m=0.122 llama-2-=0.127 llama-2-=0.103 llama-3.=0.132 llama-3.=0.128 ministra=0.120 mistral-=0.114 mixtral-=0.139 o3-mini=0.119 qwen1.5-=0.137 text-bis=0.121 |
| 2026-04-13 12:43:37,255 INFO [Step 124/200] det=skip para=0.0007 raw_rwd=0.1254±0.0112 rwd=0.1254 |
| 2026-04-13 12:43:37,256 INFO per-gen rewards: deepseek=0.127 falcon3-=0.127 gemini-1=0.120 gemini-2=0.131 gemini-p=0.109 gemini-p=0.121 gpt-3.5-=0.124 gpt-4-tu=0.115 gpt-4-tu=0.103 gpt-4.5-=0.115 gpt-4o=0.133 gpt-4o-m=0.127 llama-2-=0.116 llama-2-=0.120 llama-3.=0.135 llama-3.=0.119 ministra=0.127 mistral-=0.115 mixtral-=0.122 o3-mini=0.115 qwen1.5-=0.132 text-bis=0.160 |
| 2026-04-13 12:43:52,579 INFO [Step 125/200] det=skip para=0.0138 raw_rwd=0.1233±0.0114 rwd=0.1233 |
| 2026-04-13 12:43:52,580 INFO per-gen rewards: deepseek=0.123 falcon3-=0.125 gemini-1=0.126 gemini-2=0.119 gemini-p=0.093 gemini-p=0.139 gpt-3.5-=0.123 gpt-4-tu=0.112 gpt-4-tu=0.113 gpt-4.5-=0.110 gpt-4o=0.131 gpt-4o-m=0.120 llama-2-=0.124 llama-2-=0.103 llama-3.=0.123 llama-3.=0.129 ministra=0.124 mistral-=0.136 mixtral-=0.127 o3-mini=0.125 qwen1.5-=0.126 text-bis=0.134 |
| 2026-04-13 12:48:36,372 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:48:36,372 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:48:36,372 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:48:36,372 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:48:36,372 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:48:36,372 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:48:36,372 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:48:36,372 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:48:36,372 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:48:36,372 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:48:36,372 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:48:36,372 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:48:36,372 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:48:36,372 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:48:36,372 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:48:36,372 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:48:36,372 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:48:36,372 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:48:36,372 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:48:36,372 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:48:36,372 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:48:36,372 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:48:36,372 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:48:36,372 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:48:36,372 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:48:36,372 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:48:36,373 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 12:48:36,373 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:48:36,373 INFO │ misspelling 0.9996 ~ |
| 2026-04-13 12:48:36,373 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:48:36,373 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:48:36,373 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:48:36,373 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:48:36,373 INFO No improvement (18/25) best=0.9960 |
| |
| 2026-04-13 12:48:51,288 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:48:51,288 INFO [Step 126/200] det=skip para=-0.0000 raw_rwd=0.1232±0.0092 rwd=0.1232 |
| 2026-04-13 12:48:51,288 INFO per-gen rewards: deepseek=0.122 falcon3-=0.119 gemini-1=0.125 gemini-2=0.121 gemini-p=0.114 gemini-p=0.119 gpt-3.5-=0.120 gpt-4-tu=0.124 gpt-4-tu=0.111 gpt-4.5-=0.111 gpt-4o=0.125 gpt-4o-m=0.128 llama-2-=0.139 llama-2-=0.149 llama-3.=0.122 llama-3.=0.121 ministra=0.119 mistral-=0.149 mixtral-=0.113 o3-mini=0.126 qwen1.5-=0.136 text-bis=0.112 |
| 2026-04-13 12:49:05,892 INFO [Step 127/200] det=skip para=-0.0000 raw_rwd=0.1248±0.0110 rwd=0.1248 |
| 2026-04-13 12:49:05,892 INFO per-gen rewards: deepseek=0.122 falcon3-=0.130 gemini-1=0.127 gemini-2=0.125 gemini-p=0.109 gemini-p=0.153 gpt-3.5-=0.126 gpt-4-tu=0.117 gpt-4-tu=0.117 gpt-4.5-=0.136 gpt-4o=0.125 gpt-4o-m=0.121 llama-2-=0.149 llama-2-=0.117 llama-3.=0.118 llama-3.=0.130 ministra=0.121 mistral-=0.115 mixtral-=0.116 o3-mini=0.127 qwen1.5-=0.152 text-bis=0.125 |
| 2026-04-13 12:49:20,488 INFO [Step 128/200] det=skip para=0.0122 raw_rwd=0.1260±0.0124 rwd=0.1260 |
| 2026-04-13 12:49:20,488 INFO per-gen rewards: deepseek=0.132 falcon3-=0.122 gemini-1=0.121 gemini-2=0.121 gemini-p=0.140 gemini-p=0.145 gpt-3.5-=0.125 gpt-4-tu=0.118 gpt-4-tu=0.133 gpt-4.5-=0.124 gpt-4o=0.120 gpt-4o-m=0.126 llama-2-=0.117 llama-2-=0.134 llama-3.=0.132 llama-3.=0.127 ministra=0.129 mistral-=0.122 mixtral-=0.173 o3-mini=0.125 qwen1.5-=0.106 text-bis=0.116 |
| 2026-04-13 12:49:34,979 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:49:34,980 INFO [Step 129/200] det=skip para=0.0035 raw_rwd=0.1252±0.0109 rwd=0.1252 |
| 2026-04-13 12:49:34,980 INFO per-gen rewards: deepseek=0.125 falcon3-=0.118 gemini-1=0.127 gemini-2=0.127 gemini-p=0.129 gemini-p=0.153 gpt-3.5-=0.124 gpt-4-tu=0.132 gpt-4-tu=0.114 gpt-4.5-=0.124 gpt-4o=0.128 gpt-4o-m=0.122 llama-2-=0.143 llama-2-=0.134 llama-3.=0.121 llama-3.=0.119 ministra=0.127 mistral-=0.138 mixtral-=0.111 o3-mini=0.121 qwen1.5-=0.133 text-bis=0.127 |
| 2026-04-13 12:49:49,936 INFO [Step 130/200] det=skip para=-0.0000 raw_rwd=0.1235±0.0107 rwd=0.1235 |
| 2026-04-13 12:49:49,936 INFO per-gen rewards: deepseek=0.126 falcon3-=0.129 gemini-1=0.133 gemini-2=0.121 gemini-p=0.140 gemini-p=0.112 gpt-3.5-=0.109 gpt-4-tu=0.145 gpt-4-tu=0.132 gpt-4.5-=0.122 gpt-4o=0.125 gpt-4o-m=0.122 llama-2-=0.137 llama-2-=0.122 llama-3.=0.122 llama-3.=0.125 ministra=0.121 mistral-=0.142 mixtral-=0.140 o3-mini=0.116 qwen1.5-=0.113 text-bis=0.126 |
| 2026-04-13 12:54:33,492 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 12:54:33,493 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 12:54:33,493 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 12:54:33,493 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 12:54:33,493 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 12:54:33,493 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 12:54:33,493 INFO │ gemini-pro 0.9851 |
| 2026-04-13 12:54:33,493 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 12:54:33,493 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 12:54:33,493 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 12:54:33,493 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 12:54:33,493 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 12:54:33,493 INFO │ gpt-4o 0.9999 |
| 2026-04-13 12:54:33,493 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 12:54:33,493 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 12:54:33,493 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 12:54:33,493 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 12:54:33,493 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 12:54:33,493 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 12:54:33,493 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 12:54:33,493 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 12:54:33,493 INFO │ o3-mini 0.9999 |
| 2026-04-13 12:54:33,493 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 12:54:33,493 INFO │ text-bison-002 0.9992 |
| 2026-04-13 12:54:33,493 INFO │ (prev best) 0.9960 |
| 2026-04-13 12:54:33,493 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 12:54:33,493 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 12:54:33,493 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 12:54:33,493 INFO │ misspelling 0.9997 ~ |
| 2026-04-13 12:54:33,493 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 12:54:33,493 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 12:54:33,493 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 12:54:33,493 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 12:54:33,493 INFO No improvement (19/25) best=0.9960 |
| |
| 2026-04-13 12:54:48,420 INFO [Step 131/200] det=skip para=0.0054 raw_rwd=0.1245±0.0115 rwd=0.1245 |
| 2026-04-13 12:54:48,420 INFO per-gen rewards: deepseek=0.115 falcon3-=0.119 gemini-1=0.119 gemini-2=0.124 gemini-p=0.104 gemini-p=0.152 gpt-3.5-=0.133 gpt-4-tu=0.104 gpt-4-tu=0.126 gpt-4.5-=0.134 gpt-4o=0.128 gpt-4o-m=0.129 llama-2-=0.137 llama-2-=0.135 llama-3.=0.123 llama-3.=0.123 ministra=0.114 mistral-=0.135 mixtral-=0.117 o3-mini=0.122 qwen1.5-=0.140 text-bis=0.156 |
| 2026-04-13 12:55:03,541 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:55:03,542 INFO [Step 132/200] det=skip para=0.0694 raw_rwd=0.1289±0.0277 rwd=0.1289 |
| 2026-04-13 12:55:03,542 INFO per-gen rewards: deepseek=0.133 falcon3-=0.159 gemini-1=0.160 gemini-2=0.126 gemini-p=0.135 gemini-p=0.120 gpt-3.5-=0.128 gpt-4-tu=0.103 gpt-4-tu=0.119 gpt-4.5-=0.127 gpt-4o=0.118 gpt-4o-m=0.121 llama-2-=0.122 llama-2-=0.115 llama-3.=0.122 llama-3.=0.119 ministra=0.130 mistral-=0.142 mixtral-=0.120 o3-mini=0.119 qwen1.5-=0.136 text-bis=0.116 |
| 2026-04-13 12:55:18,303 INFO [Step 133/200] det=skip para=0.0000 raw_rwd=0.1248±0.0117 rwd=0.1248 |
| 2026-04-13 12:55:18,303 INFO per-gen rewards: deepseek=0.118 falcon3-=0.129 gemini-1=0.128 gemini-2=0.133 gemini-p=0.109 gemini-p=0.109 gpt-3.5-=0.121 gpt-4-tu=0.134 gpt-4-tu=0.110 gpt-4.5-=0.130 gpt-4o=0.126 gpt-4o-m=0.127 llama-2-=0.133 llama-2-=0.109 llama-3.=0.127 llama-3.=0.137 ministra=0.126 mistral-=0.123 mixtral-=0.117 o3-mini=0.119 qwen1.5-=0.113 text-bis=0.125 |
| 2026-04-13 12:55:32,833 INFO [Step 134/200] det=skip para=0.0608 raw_rwd=0.1325±0.0215 rwd=0.1325 |
| 2026-04-13 12:55:32,834 INFO per-gen rewards: deepseek=0.132 falcon3-=0.132 gemini-1=0.126 gemini-2=0.132 gemini-p=0.135 gemini-p=0.122 gpt-3.5-=0.128 gpt-4-tu=0.117 gpt-4-tu=0.124 gpt-4.5-=0.132 gpt-4o=0.138 gpt-4o-m=0.125 llama-2-=0.128 llama-2-=0.130 llama-3.=0.126 llama-3.=0.135 ministra=0.129 mistral-=0.157 mixtral-=0.135 o3-mini=0.159 qwen1.5-=0.147 text-bis=0.121 |
| 2026-04-13 12:55:47,154 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 12:55:47,154 INFO [Step 135/200] det=skip para=0.0000 raw_rwd=0.1254±0.0108 rwd=0.1254 |
| 2026-04-13 12:55:47,154 INFO per-gen rewards: deepseek=0.130 falcon3-=0.127 gemini-1=0.123 gemini-2=0.120 gemini-p=0.119 gemini-p=0.121 gpt-3.5-=0.123 gpt-4-tu=0.123 gpt-4-tu=0.138 gpt-4.5-=0.127 gpt-4o=0.126 gpt-4o-m=0.131 llama-2-=0.123 llama-2-=0.143 llama-3.=0.120 llama-3.=0.127 ministra=0.124 mistral-=0.128 mixtral-=0.120 o3-mini=0.124 qwen1.5-=0.131 text-bis=0.129 |
| 2026-04-13 13:00:32,836 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 13:00:32,836 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 13:00:32,836 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 13:00:32,836 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 13:00:32,836 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 13:00:32,836 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 13:00:32,836 INFO │ gemini-pro 0.9851 |
| 2026-04-13 13:00:32,837 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 13:00:32,837 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 13:00:32,837 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 13:00:32,837 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 13:00:32,837 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 13:00:32,837 INFO │ gpt-4o 0.9999 |
| 2026-04-13 13:00:32,837 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 13:00:32,837 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 13:00:32,837 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 13:00:32,837 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 13:00:32,837 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 13:00:32,837 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 13:00:32,837 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 13:00:32,837 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 13:00:32,837 INFO │ o3-mini 0.9999 |
| 2026-04-13 13:00:32,837 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 13:00:32,837 INFO │ text-bison-002 0.9992 |
| 2026-04-13 13:00:32,837 INFO │ (prev best) 0.9960 |
| 2026-04-13 13:00:32,837 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 13:00:32,837 INFO │ article_deletion 0.9982 ~ |
| 2026-04-13 13:00:32,837 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 13:00:32,837 INFO │ misspelling 0.9998 ~ |
| 2026-04-13 13:00:32,837 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 13:00:32,837 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 13:00:32,837 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 13:00:32,837 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 13:00:32,837 INFO No improvement (20/25) best=0.9960 |
| |
| 2026-04-13 13:00:47,840 INFO [Step 136/200] det=skip para=0.0000 raw_rwd=0.1250±0.0110 rwd=0.1250 |
| 2026-04-13 13:00:47,840 INFO per-gen rewards: deepseek=0.127 falcon3-=0.128 gemini-1=0.125 gemini-2=0.126 gemini-p=0.120 gemini-p=0.140 gpt-3.5-=0.127 gpt-4-tu=0.125 gpt-4-tu=0.110 gpt-4.5-=0.129 gpt-4o=0.123 gpt-4o-m=0.124 llama-2-=0.125 llama-2-=0.127 llama-3.=0.124 llama-3.=0.135 ministra=0.126 mistral-=0.134 mixtral-=0.124 o3-mini=0.119 qwen1.5-=0.119 text-bis=0.112 |
| 2026-04-13 13:01:02,767 INFO [Step 137/200] det=skip para=0.0000 raw_rwd=0.1265±0.0102 rwd=0.1265 |
| 2026-04-13 13:01:02,767 INFO per-gen rewards: deepseek=0.122 falcon3-=0.127 gemini-1=0.126 gemini-2=0.127 gemini-p=0.126 gemini-p=0.117 gpt-3.5-=0.123 gpt-4-tu=0.126 gpt-4-tu=0.130 gpt-4.5-=0.141 gpt-4o=0.128 gpt-4o-m=0.129 llama-2-=0.113 llama-2-=0.128 llama-3.=0.121 llama-3.=0.124 ministra=0.132 mistral-=0.132 mixtral-=0.123 o3-mini=0.129 qwen1.5-=0.124 text-bis=0.137 |
| 2026-04-13 13:01:17,771 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:01:17,771 INFO [Step 138/200] det=skip para=0.0033 raw_rwd=0.1257±0.0128 rwd=0.1257 |
| 2026-04-13 13:01:17,771 INFO per-gen rewards: deepseek=0.122 falcon3-=0.124 gemini-1=0.133 gemini-2=0.120 gemini-p=0.125 gemini-p=0.112 gpt-3.5-=0.132 gpt-4-tu=0.140 gpt-4-tu=0.128 gpt-4.5-=0.117 gpt-4o=0.119 gpt-4o-m=0.137 llama-2-=0.122 llama-2-=0.116 llama-3.=0.127 llama-3.=0.123 ministra=0.122 mistral-=0.129 mixtral-=0.134 o3-mini=0.120 qwen1.5-=0.117 text-bis=0.137 |
| 2026-04-13 13:01:32,507 INFO [Step 139/200] det=skip para=-0.0000 raw_rwd=0.1250±0.0122 rwd=0.1250 |
| 2026-04-13 13:01:32,507 INFO per-gen rewards: deepseek=0.130 falcon3-=0.122 gemini-1=0.131 gemini-2=0.123 gemini-p=0.111 gemini-p=0.139 gpt-3.5-=0.122 gpt-4-tu=0.118 gpt-4-tu=0.131 gpt-4.5-=0.115 gpt-4o=0.126 gpt-4o-m=0.115 llama-2-=0.153 llama-2-=0.158 llama-3.=0.123 llama-3.=0.113 ministra=0.123 mistral-=0.137 mixtral-=0.124 o3-mini=0.132 qwen1.5-=0.127 text-bis=0.115 |
| 2026-04-13 13:01:47,114 INFO [Step 140/200] det=skip para=-0.0000 raw_rwd=0.1250±0.0110 rwd=0.1250 |
| 2026-04-13 13:01:47,115 INFO per-gen rewards: deepseek=0.119 falcon3-=0.125 gemini-1=0.117 gemini-2=0.131 gemini-p=0.116 gemini-p=0.132 gpt-3.5-=0.123 gpt-4-tu=0.127 gpt-4-tu=0.118 gpt-4.5-=0.109 gpt-4o=0.123 gpt-4o-m=0.126 llama-2-=0.125 llama-2-=0.105 llama-3.=0.130 llama-3.=0.137 ministra=0.132 mistral-=0.116 mixtral-=0.123 o3-mini=0.131 qwen1.5-=0.135 text-bis=0.101 |
| 2026-04-13 13:06:31,169 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 13:06:31,170 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 13:06:31,170 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 13:06:31,170 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 13:06:31,170 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 13:06:31,170 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 13:06:31,170 INFO │ gemini-pro 0.9851 |
| 2026-04-13 13:06:31,170 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 13:06:31,170 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 13:06:31,170 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 13:06:31,170 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 13:06:31,170 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 13:06:31,170 INFO │ gpt-4o 0.9999 |
| 2026-04-13 13:06:31,170 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 13:06:31,170 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 13:06:31,170 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 13:06:31,170 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 13:06:31,170 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 13:06:31,170 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 13:06:31,170 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 13:06:31,170 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 13:06:31,170 INFO │ o3-mini 0.9999 |
| 2026-04-13 13:06:31,170 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 13:06:31,170 INFO │ text-bison-002 0.9992 |
| 2026-04-13 13:06:31,170 INFO │ (prev best) 0.9960 |
| 2026-04-13 13:06:31,170 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 13:06:31,170 INFO │ article_deletion 0.9981 ~ |
| 2026-04-13 13:06:31,170 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 13:06:31,170 INFO │ misspelling 0.9995 ~ |
| 2026-04-13 13:06:31,170 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 13:06:31,170 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 13:06:31,170 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 13:06:31,170 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 13:06:31,170 INFO No improvement (21/25) best=0.9960 |
| |
| 2026-04-13 13:06:45,934 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:06:45,934 INFO [Step 141/200] det=skip para=0.0233 raw_rwd=0.1221±0.0108 rwd=0.1221 |
| 2026-04-13 13:06:45,934 INFO per-gen rewards: deepseek=0.118 falcon3-=0.117 gemini-1=0.126 gemini-2=0.129 gemini-p=0.123 gemini-p=0.124 gpt-3.5-=0.119 gpt-4-tu=0.117 gpt-4-tu=0.116 gpt-4.5-=0.116 gpt-4o=0.122 gpt-4o-m=0.119 llama-2-=0.124 llama-2-=0.116 llama-3.=0.126 llama-3.=0.116 ministra=0.127 mistral-=0.106 mixtral-=0.114 o3-mini=0.128 qwen1.5-=0.125 text-bis=0.121 |
| 2026-04-13 13:07:00,458 INFO [Step 142/200] det=skip para=-0.0000 raw_rwd=0.1269±0.0105 rwd=0.1269 |
| 2026-04-13 13:07:00,458 INFO per-gen rewards: deepseek=0.133 falcon3-=0.121 gemini-1=0.127 gemini-2=0.129 gemini-p=0.132 gemini-p=0.135 gpt-3.5-=0.127 gpt-4-tu=0.126 gpt-4-tu=0.123 gpt-4.5-=0.114 gpt-4o=0.123 gpt-4o-m=0.127 llama-2-=0.137 llama-2-=0.124 llama-3.=0.129 llama-3.=0.131 ministra=0.136 mistral-=0.115 mixtral-=0.138 o3-mini=0.120 qwen1.5-=0.113 text-bis=0.131 |
| 2026-04-13 13:07:15,134 INFO [Step 143/200] det=skip para=-0.0000 raw_rwd=0.1240±0.0104 rwd=0.1240 |
| 2026-04-13 13:07:15,134 INFO per-gen rewards: deepseek=0.116 falcon3-=0.127 gemini-1=0.121 gemini-2=0.122 gemini-p=0.119 gemini-p=0.120 gpt-3.5-=0.119 gpt-4-tu=0.125 gpt-4-tu=0.108 gpt-4.5-=0.127 gpt-4o=0.128 gpt-4o-m=0.127 llama-2-=0.124 llama-2-=0.122 llama-3.=0.133 llama-3.=0.109 ministra=0.122 mistral-=0.133 mixtral-=0.122 o3-mini=0.135 qwen1.5-=0.129 text-bis=0.116 |
| 2026-04-13 13:07:29,477 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:07:29,477 INFO [Step 144/200] det=skip para=0.0183 raw_rwd=0.1258±0.0132 rwd=0.1258 |
| 2026-04-13 13:07:29,477 INFO per-gen rewards: deepseek=0.115 falcon3-=0.125 gemini-1=0.130 gemini-2=0.137 gemini-p=0.153 gemini-p=0.143 gpt-3.5-=0.125 gpt-4-tu=0.124 gpt-4-tu=0.131 gpt-4.5-=0.113 gpt-4o=0.125 gpt-4o-m=0.127 llama-2-=0.114 llama-2-=0.131 llama-3.=0.122 llama-3.=0.121 ministra=0.123 mistral-=0.113 mixtral-=0.121 o3-mini=0.123 qwen1.5-=0.126 text-bis=0.136 |
| 2026-04-13 13:07:44,036 INFO [Step 145/200] det=skip para=0.0000 raw_rwd=0.1230±0.0090 rwd=0.1230 |
| 2026-04-13 13:07:44,036 INFO per-gen rewards: deepseek=0.126 falcon3-=0.115 gemini-1=0.123 gemini-2=0.125 gemini-p=0.116 gemini-p=0.134 gpt-3.5-=0.125 gpt-4-tu=0.123 gpt-4-tu=0.119 gpt-4.5-=0.111 gpt-4o=0.126 gpt-4o-m=0.121 llama-2-=0.116 llama-2-=0.126 llama-3.=0.124 llama-3.=0.125 ministra=0.123 mistral-=0.134 mixtral-=0.135 o3-mini=0.119 qwen1.5-=0.107 text-bis=0.143 |
| 2026-04-13 13:12:27,847 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 13:12:27,847 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 13:12:27,847 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 13:12:27,847 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 13:12:27,847 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 13:12:27,847 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 13:12:27,847 INFO │ gemini-pro 0.9851 |
| 2026-04-13 13:12:27,847 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 13:12:27,847 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 13:12:27,847 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 13:12:27,847 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 13:12:27,847 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 13:12:27,847 INFO │ gpt-4o 0.9999 |
| 2026-04-13 13:12:27,847 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 13:12:27,848 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 13:12:27,848 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 13:12:27,848 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 13:12:27,848 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 13:12:27,848 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 13:12:27,848 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 13:12:27,848 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 13:12:27,848 INFO │ o3-mini 0.9999 |
| 2026-04-13 13:12:27,848 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 13:12:27,848 INFO │ text-bison-002 0.9992 |
| 2026-04-13 13:12:27,848 INFO │ (prev best) 0.9960 |
| 2026-04-13 13:12:27,848 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 13:12:27,848 INFO │ article_deletion 0.9980 ~ |
| 2026-04-13 13:12:27,848 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 13:12:27,848 INFO │ misspelling 0.9998 ~ |
| 2026-04-13 13:12:27,848 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 13:12:27,848 INFO │ synonym_replacement 0.9998 ~ |
| 2026-04-13 13:12:27,848 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 13:12:27,848 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 13:12:27,848 INFO No improvement (22/25) best=0.9960 |
| |
| 2026-04-13 13:12:43,002 INFO [Step 146/200] det=skip para=-0.0000 raw_rwd=0.1263±0.0096 rwd=0.1263 |
| 2026-04-13 13:12:43,002 INFO per-gen rewards: deepseek=0.125 falcon3-=0.130 gemini-1=0.129 gemini-2=0.125 gemini-p=0.132 gemini-p=0.137 gpt-3.5-=0.124 gpt-4-tu=0.110 gpt-4-tu=0.123 gpt-4.5-=0.145 gpt-4o=0.124 gpt-4o-m=0.122 llama-2-=0.127 llama-2-=0.130 llama-3.=0.131 llama-3.=0.125 ministra=0.120 mistral-=0.135 mixtral-=0.116 o3-mini=0.127 qwen1.5-=0.127 text-bis=0.143 |
| 2026-04-13 13:12:57,724 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:12:57,725 INFO [Step 147/200] det=skip para=0.0011 raw_rwd=0.1238±0.0099 rwd=0.1238 |
| 2026-04-13 13:12:57,725 INFO per-gen rewards: deepseek=0.118 falcon3-=0.129 gemini-1=0.123 gemini-2=0.127 gemini-p=0.117 gemini-p=0.123 gpt-3.5-=0.123 gpt-4-tu=0.112 gpt-4-tu=0.114 gpt-4.5-=0.123 gpt-4o=0.121 gpt-4o-m=0.121 llama-2-=0.135 llama-2-=0.131 llama-3.=0.138 llama-3.=0.124 ministra=0.123 mistral-=0.132 mixtral-=0.127 o3-mini=0.114 qwen1.5-=0.144 text-bis=0.117 |
| 2026-04-13 13:13:12,265 INFO [Step 148/200] det=skip para=0.0022 raw_rwd=0.1247±0.0118 rwd=0.1247 |
| 2026-04-13 13:13:12,265 INFO per-gen rewards: deepseek=0.121 falcon3-=0.125 gemini-1=0.120 gemini-2=0.129 gemini-p=0.130 gemini-p=0.119 gpt-3.5-=0.127 gpt-4-tu=0.162 gpt-4-tu=0.128 gpt-4.5-=0.123 gpt-4o=0.121 gpt-4o-m=0.125 llama-2-=0.152 llama-2-=0.120 llama-3.=0.127 llama-3.=0.122 ministra=0.120 mistral-=0.110 mixtral-=0.119 o3-mini=0.128 qwen1.5-=0.121 text-bis=0.110 |
| 2026-04-13 13:13:26,646 INFO [Step 149/200] det=skip para=0.0071 raw_rwd=0.1245±0.0115 rwd=0.1245 |
| 2026-04-13 13:13:26,646 INFO per-gen rewards: deepseek=0.130 falcon3-=0.121 gemini-1=0.125 gemini-2=0.112 gemini-p=0.118 gemini-p=0.124 gpt-3.5-=0.123 gpt-4-tu=0.131 gpt-4-tu=0.129 gpt-4.5-=0.137 gpt-4o=0.125 gpt-4o-m=0.126 llama-2-=0.120 llama-2-=0.132 llama-3.=0.127 llama-3.=0.141 ministra=0.122 mistral-=0.130 mixtral-=0.116 o3-mini=0.119 qwen1.5-=0.113 text-bis=0.164 |
| 2026-04-13 13:13:41,501 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:13:41,502 INFO [Step 150/200] det=skip para=-0.0000 raw_rwd=0.1250±0.0130 rwd=0.1250 |
| 2026-04-13 13:13:41,502 INFO per-gen rewards: deepseek=0.122 falcon3-=0.132 gemini-1=0.132 gemini-2=0.132 gemini-p=0.126 gemini-p=0.127 gpt-3.5-=0.125 gpt-4-tu=0.111 gpt-4-tu=0.113 gpt-4.5-=0.123 gpt-4o=0.113 gpt-4o-m=0.127 llama-2-=0.123 llama-2-=0.123 llama-3.=0.123 llama-3.=0.125 ministra=0.123 mistral-=0.120 mixtral-=0.142 o3-mini=0.130 qwen1.5-=0.105 text-bis=0.125 |
| 2026-04-13 13:18:25,077 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 13:18:25,077 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 13:18:25,077 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 13:18:25,077 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 13:18:25,077 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 13:18:25,077 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 13:18:25,077 INFO │ gemini-pro 0.9851 |
| 2026-04-13 13:18:25,077 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 13:18:25,077 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 13:18:25,077 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 13:18:25,078 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 13:18:25,078 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 13:18:25,078 INFO │ gpt-4o 0.9999 |
| 2026-04-13 13:18:25,078 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 13:18:25,078 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 13:18:25,078 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 13:18:25,078 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 13:18:25,078 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 13:18:25,078 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 13:18:25,078 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 13:18:25,078 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 13:18:25,078 INFO │ o3-mini 0.9999 |
| 2026-04-13 13:18:25,078 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 13:18:25,078 INFO │ text-bison-002 0.9992 |
| 2026-04-13 13:18:25,078 INFO │ (prev best) 0.9960 |
| 2026-04-13 13:18:25,078 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 13:18:25,078 INFO │ article_deletion 0.9980 ~ |
| 2026-04-13 13:18:25,078 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 13:18:25,078 INFO │ misspelling 0.9995 ~ |
| 2026-04-13 13:18:25,078 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 13:18:25,078 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 13:18:25,078 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 13:18:25,078 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 13:18:25,078 INFO No improvement (23/25) best=0.9960 |
| |
| 2026-04-13 13:18:39,971 INFO [Step 151/200] det=skip para=0.0000 raw_rwd=0.1269±0.0113 rwd=0.1269 |
| 2026-04-13 13:18:39,971 INFO per-gen rewards: deepseek=0.128 falcon3-=0.122 gemini-1=0.122 gemini-2=0.124 gemini-p=0.133 gemini-p=0.152 gpt-3.5-=0.129 gpt-4-tu=0.115 gpt-4-tu=0.130 gpt-4.5-=0.123 gpt-4o=0.128 gpt-4o-m=0.128 llama-2-=0.113 llama-2-=0.139 llama-3.=0.121 llama-3.=0.134 ministra=0.128 mistral-=0.115 mixtral-=0.129 o3-mini=0.133 qwen1.5-=0.132 text-bis=0.124 |
| 2026-04-13 13:18:54,734 INFO [Step 152/200] det=skip para=0.0000 raw_rwd=0.1245±0.0099 rwd=0.1245 |
| 2026-04-13 13:18:54,734 INFO per-gen rewards: deepseek=0.127 falcon3-=0.127 gemini-1=0.124 gemini-2=0.132 gemini-p=0.122 gemini-p=0.116 gpt-3.5-=0.127 gpt-4-tu=0.103 gpt-4-tu=0.129 gpt-4.5-=0.120 gpt-4o=0.125 gpt-4o-m=0.121 llama-2-=0.108 llama-2-=0.126 llama-3.=0.119 llama-3.=0.117 ministra=0.125 mistral-=0.132 mixtral-=0.120 o3-mini=0.124 qwen1.5-=0.139 text-bis=0.147 |
| 2026-04-13 13:19:09,390 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:19:09,390 INFO [Step 153/200] det=skip para=0.0661 raw_rwd=0.1291±0.0295 rwd=0.1291 |
| 2026-04-13 13:19:09,391 INFO per-gen rewards: deepseek=0.124 falcon3-=0.120 gemini-1=0.121 gemini-2=0.120 gemini-p=0.131 gemini-p=0.124 gpt-3.5-=0.131 gpt-4-tu=0.344 gpt-4-tu=0.122 gpt-4.5-=0.117 gpt-4o=0.130 gpt-4o-m=0.136 llama-2-=0.122 llama-2-=0.116 llama-3.=0.117 llama-3.=0.143 ministra=0.124 mistral-=0.107 mixtral-=0.136 o3-mini=0.132 qwen1.5-=0.123 text-bis=0.112 |
| 2026-04-13 13:19:23,926 INFO [Step 154/200] det=skip para=0.0000 raw_rwd=0.1256±0.0112 rwd=0.1256 |
| 2026-04-13 13:19:23,926 INFO per-gen rewards: deepseek=0.119 falcon3-=0.125 gemini-1=0.120 gemini-2=0.125 gemini-p=0.136 gemini-p=0.112 gpt-3.5-=0.132 gpt-4-tu=0.135 gpt-4-tu=0.153 gpt-4.5-=0.134 gpt-4o=0.125 gpt-4o-m=0.124 llama-2-=0.110 llama-2-=0.133 llama-3.=0.116 llama-3.=0.117 ministra=0.130 mistral-=0.127 mixtral-=0.120 o3-mini=0.132 qwen1.5-=0.128 text-bis=0.136 |
| 2026-04-13 13:19:38,460 INFO [Step 155/200] det=skip para=0.0000 raw_rwd=0.1246±0.0099 rwd=0.1246 |
| 2026-04-13 13:19:38,460 INFO per-gen rewards: deepseek=0.131 falcon3-=0.124 gemini-1=0.127 gemini-2=0.127 gemini-p=0.123 gemini-p=0.113 gpt-3.5-=0.121 gpt-4-tu=0.127 gpt-4-tu=0.137 gpt-4.5-=0.119 gpt-4o=0.119 gpt-4o-m=0.120 llama-2-=0.113 llama-2-=0.143 llama-3.=0.132 llama-3.=0.122 ministra=0.121 mistral-=0.133 mixtral-=0.120 o3-mini=0.129 qwen1.5-=0.124 text-bis=0.121 |
| 2026-04-13 13:24:21,864 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 13:24:21,864 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 13:24:21,864 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 13:24:21,864 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 13:24:21,864 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 13:24:21,864 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 13:24:21,864 INFO │ gemini-pro 0.9851 |
| 2026-04-13 13:24:21,864 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 13:24:21,864 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 13:24:21,864 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 13:24:21,864 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 13:24:21,864 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 13:24:21,864 INFO │ gpt-4o 0.9999 |
| 2026-04-13 13:24:21,864 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 13:24:21,864 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 13:24:21,864 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 13:24:21,864 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 13:24:21,865 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 13:24:21,865 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 13:24:21,865 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 13:24:21,865 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 13:24:21,865 INFO │ o3-mini 0.9999 |
| 2026-04-13 13:24:21,865 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 13:24:21,865 INFO │ text-bison-002 0.9992 |
| 2026-04-13 13:24:21,865 INFO │ (prev best) 0.9960 |
| 2026-04-13 13:24:21,865 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 13:24:21,865 INFO │ article_deletion 0.9980 ~ |
| 2026-04-13 13:24:21,865 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 13:24:21,865 INFO │ misspelling 0.9994 ~ |
| 2026-04-13 13:24:21,865 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 13:24:21,865 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 13:24:21,865 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 13:24:21,865 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 13:24:21,865 INFO No improvement (24/25) best=0.9960 |
| |
| 2026-04-13 13:24:36,985 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:24:36,985 INFO [Step 156/200] det=skip para=0.0000 raw_rwd=0.1277±0.0131 rwd=0.1277 |
| 2026-04-13 13:24:36,985 INFO per-gen rewards: deepseek=0.117 falcon3-=0.123 gemini-1=0.127 gemini-2=0.121 gemini-p=0.131 gemini-p=0.140 gpt-3.5-=0.128 gpt-4-tu=0.112 gpt-4-tu=0.120 gpt-4.5-=0.152 gpt-4o=0.125 gpt-4o-m=0.135 llama-2-=0.127 llama-2-=0.113 llama-3.=0.126 llama-3.=0.131 ministra=0.140 mistral-=0.134 mixtral-=0.127 o3-mini=0.128 qwen1.5-=0.133 text-bis=0.122 |
| 2026-04-13 13:24:51,708 INFO [Step 157/200] det=skip para=0.0000 raw_rwd=0.1241±0.0104 rwd=0.1241 |
| 2026-04-13 13:24:51,708 INFO per-gen rewards: deepseek=0.126 falcon3-=0.126 gemini-1=0.125 gemini-2=0.123 gemini-p=0.118 gemini-p=0.117 gpt-3.5-=0.122 gpt-4-tu=0.118 gpt-4-tu=0.124 gpt-4.5-=0.118 gpt-4o=0.124 gpt-4o-m=0.125 llama-2-=0.113 llama-2-=0.114 llama-3.=0.125 llama-3.=0.139 ministra=0.121 mistral-=0.113 mixtral-=0.124 o3-mini=0.129 qwen1.5-=0.108 text-bis=0.151 |
| 2026-04-13 13:25:06,408 INFO [Step 158/200] det=skip para=0.0164 raw_rwd=0.1241±0.0099 rwd=0.1241 |
| 2026-04-13 13:25:06,409 INFO per-gen rewards: deepseek=0.125 falcon3-=0.126 gemini-1=0.118 gemini-2=0.125 gemini-p=0.131 gemini-p=0.119 gpt-3.5-=0.121 gpt-4-tu=0.130 gpt-4-tu=0.132 gpt-4.5-=0.120 gpt-4o=0.125 gpt-4o-m=0.132 llama-2-=0.115 llama-2-=0.128 llama-3.=0.124 llama-3.=0.123 ministra=0.118 mistral-=0.131 mixtral-=0.118 o3-mini=0.123 qwen1.5-=0.128 text-bis=0.131 |
| 2026-04-13 13:25:21,056 INFO ⚠ AUROC=0.9960 > threshold=0.995 → freezing detector for 3 steps |
| 2026-04-13 13:25:21,056 INFO [Step 159/200] det=skip para=-0.0000 raw_rwd=0.1241±0.0109 rwd=0.1241 |
| 2026-04-13 13:25:21,056 INFO per-gen rewards: deepseek=0.121 falcon3-=0.117 gemini-1=0.117 gemini-2=0.137 gemini-p=0.122 gemini-p=0.121 gpt-3.5-=0.122 gpt-4-tu=0.113 gpt-4-tu=0.137 gpt-4.5-=0.125 gpt-4o=0.126 gpt-4o-m=0.129 llama-2-=0.123 llama-2-=0.109 llama-3.=0.125 llama-3.=0.122 ministra=0.121 mistral-=0.137 mixtral-=0.121 o3-mini=0.121 qwen1.5-=0.135 text-bis=0.137 |
| 2026-04-13 13:25:35,780 INFO [Step 160/200] det=skip para=0.0632 raw_rwd=0.1274±0.0221 rwd=0.1274 |
| 2026-04-13 13:25:35,780 INFO per-gen rewards: deepseek=0.138 falcon3-=0.118 gemini-1=0.122 gemini-2=0.125 gemini-p=0.129 gemini-p=0.130 gpt-3.5-=0.155 gpt-4-tu=0.139 gpt-4-tu=0.137 gpt-4.5-=0.125 gpt-4o=0.122 gpt-4o-m=0.124 llama-2-=0.129 llama-2-=0.108 llama-3.=0.119 llama-3.=0.112 ministra=0.127 mistral-=0.139 mixtral-=0.142 o3-mini=0.122 qwen1.5-=0.118 text-bis=0.129 |
| 2026-04-13 13:30:19,706 INFO ┌─ Generator AUROC ────────────────────────────┐ |
| 2026-04-13 13:30:19,706 INFO │ MACRO_AVG 0.9960 ◄ |
| 2026-04-13 13:30:19,706 INFO │ deepseek-r1-distill-qwen-32b 0.9998 |
| 2026-04-13 13:30:19,706 INFO │ falcon3-10b-instruct 0.9992 |
| 2026-04-13 13:30:19,706 INFO │ gemini-1.5-pro 0.9689 |
| 2026-04-13 13:30:19,706 INFO │ gemini-2.0-flash 0.9998 |
| 2026-04-13 13:30:19,706 INFO │ gemini-pro 0.9851 |
| 2026-04-13 13:30:19,706 INFO │ gemini-pro-paraphrase 0.9884 |
| 2026-04-13 13:30:19,706 INFO │ gpt-3.5-turbo 0.9999 |
| 2026-04-13 13:30:19,706 INFO │ gpt-4-turbo 1.0000 |
| 2026-04-13 13:30:19,707 INFO │ gpt-4-turbo-paraphrase 0.9963 |
| 2026-04-13 13:30:19,707 INFO │ gpt-4.5-preview 0.9980 |
| 2026-04-13 13:30:19,707 INFO │ gpt-4o 0.9999 |
| 2026-04-13 13:30:19,707 INFO │ gpt-4o-mini 0.9999 |
| 2026-04-13 13:30:19,707 INFO │ llama-2-70b-chat 0.9974 |
| 2026-04-13 13:30:19,707 INFO │ llama-2-7b-chat 0.9967 |
| 2026-04-13 13:30:19,707 INFO │ llama-3.1-8b-instruct 0.9929 |
| 2026-04-13 13:30:19,707 INFO │ llama-3.3-70b-instruct 0.9993 |
| 2026-04-13 13:30:19,707 INFO │ ministral-8b-instruct-2410 0.9997 |
| 2026-04-13 13:30:19,707 INFO │ mistral-7b-instruct-v0.2 0.9965 |
| 2026-04-13 13:30:19,707 INFO │ mixtral-8x7b-instruct-v0.1 0.9947 |
| 2026-04-13 13:30:19,707 INFO │ o3-mini 0.9999 |
| 2026-04-13 13:30:19,707 INFO │ qwen1.5-72b-chat-8bit 0.9995 |
| 2026-04-13 13:30:19,707 INFO │ text-bison-002 0.9992 |
| 2026-04-13 13:30:19,707 INFO │ (prev best) 0.9960 |
| 2026-04-13 13:30:19,707 INFO ├─ Attack AUROC (robustness) ─────────────────┤ |
| 2026-04-13 13:30:19,707 INFO │ article_deletion 0.9980 ~ |
| 2026-04-13 13:30:19,707 INFO │ homoglyphs 1.0000 ~ |
| 2026-04-13 13:30:19,707 INFO │ misspelling 0.9995 ~ |
| 2026-04-13 13:30:19,707 INFO │ no_attack 0.9966 ~ |
| 2026-04-13 13:30:19,707 INFO │ synonym_replacement 0.9997 ~ |
| 2026-04-13 13:30:19,707 INFO │ t5_paraphrase 1.0000 ~ |
| 2026-04-13 13:30:19,707 INFO └─────────────────────────────────────────────┘ |
| 2026-04-13 13:30:19,707 INFO No improvement (25/25) best=0.9960 |
| |
| 2026-04-13 13:30:19,707 INFO Early stopping triggered. |
| |
| 2026-04-13 13:30:19,707 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 13:30:19,707 INFO Done. Best macro AUROC = 0.9960 |
| 2026-04-13 13:30:19,707 INFO Detector → ./adal_panclef/best_detector |
| 2026-04-13 13:30:19,707 INFO Paraphraser → ./adal_panclef/best_paraphraser |
| 2026-04-13 13:30:19,707 INFO Gen AUROC → ./adal_panclef/per_generator_auroc.tsv |
| 2026-04-13 13:30:19,707 INFO Atk AUROC → ./adal_panclef/per_attack_auroc.tsv |
| 2026-04-13 13:30:19,707 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 13:30:19,707 INFO |
| ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 13:30:19,707 INFO FINAL EVALUATION ON VALIDATION SET (best checkpoint) |
| 2026-04-13 13:30:19,707 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 13:30:19,707 INFO Loading detector 'roberta-large' … |
| 2026-04-13 13:30:19,912 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/tokenizer_config.json "HTTP/1.1 200 OK" |
| 2026-04-13 13:30:20,031 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 307 Temporary Redirect" |
| 2026-04-13 13:30:20,147 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found" |
| 2026-04-13 13:30:20,261 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 307 Temporary Redirect" |
| 2026-04-13 13:30:20,379 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK" |
| 2026-04-13 13:30:20,684 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/config.json "HTTP/1.1 200 OK" |
| 2026-04-13 13:30:20,823 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/model.safetensors "HTTP/1.1 302 Found" |
| 2026-04-13 13:30:21,809 INFO Running full validation evaluation ... |
| 2026-04-13 13:31:51,489 INFO |
| ╔════════════════════════════════════════════════════╗ |
| 2026-04-13 13:31:51,489 INFO ║ FULL VALIDATION METRICS (threshold=0.50) ║ |
| 2026-04-13 13:31:51,489 INFO ╠────────────────────────────────────────────────────╣ |
| 2026-04-13 13:31:51,489 INFO ║ Total human : 1,277 Total AI : 2,312 ║ |
| 2026-04-13 13:31:51,489 INFO ║ TP=2,227 TN=1,270 FP= 7 FN= 85 ║ |
| 2026-04-13 13:31:51,489 INFO ╠────────────────────────────────────────────────────╣ |
| 2026-04-13 13:31:51,489 INFO ║ Precision : 0.9969 ║ |
| 2026-04-13 13:31:51,489 INFO ║ Recall : 0.9632 ║ |
| 2026-04-13 13:31:51,489 INFO ║ F1-score : 0.9798 ║ |
| 2026-04-13 13:31:51,489 INFO ║ AUROC : 0.9969 ║ |
| 2026-04-13 13:31:51,489 INFO ╠────────────────────────────────────────────────────╣ |
| 2026-04-13 13:31:51,490 INFO ║ Per-generator AUROC: ║ |
| 2026-04-13 13:31:51,490 INFO ║ deepseek-r1-distill-qwen-32b 0.9998 ║ |
| 2026-04-13 13:31:51,490 INFO ║ falcon3-10b-instruct 0.9992 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gemini-1.5-pro 0.9689 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gemini-2.0-flash 0.9998 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gemini-pro 0.9851 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gemini-pro-paraphrase 0.9884 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gpt-3.5-turbo 0.9999 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gpt-4-turbo 1.0000 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gpt-4-turbo-paraphrase 0.9963 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gpt-4.5-preview 0.9980 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gpt-4o 0.9999 ║ |
| 2026-04-13 13:31:51,490 INFO ║ gpt-4o-mini 0.9999 ║ |
| 2026-04-13 13:31:51,490 INFO ║ llama-2-70b-chat 0.9974 ║ |
| 2026-04-13 13:31:51,490 INFO ║ llama-2-7b-chat 0.9967 ║ |
| 2026-04-13 13:31:51,490 INFO ║ llama-3.1-8b-instruct 0.9929 ║ |
| 2026-04-13 13:31:51,490 INFO ║ llama-3.3-70b-instruct 0.9993 ║ |
| 2026-04-13 13:31:51,490 INFO ║ ministral-8b-instruct-2410 0.9997 ║ |
| 2026-04-13 13:31:51,490 INFO ║ mistral-7b-instruct-v0.2 0.9965 ║ |
| 2026-04-13 13:31:51,490 INFO ║ mixtral-8x7b-instruct-v0.1 0.9947 ║ |
| 2026-04-13 13:31:51,490 INFO ║ o3-mini 0.9999 ║ |
| 2026-04-13 13:31:51,490 INFO ║ qwen1.5-72b-chat-8bit 0.9995 ║ |
| 2026-04-13 13:31:51,490 INFO ║ text-bison-002 0.9992 ║ |
| 2026-04-13 13:31:51,490 INFO ║ Macro avg AUROC : 0.9960 ║ |
| 2026-04-13 13:31:51,490 INFO ╚════════════════════════════════════════════════════╝ |
| |
| 2026-04-13 13:31:51,491 INFO Metrics saved → ./adal_panclef/validation_metrics.tsv |
| 2026-04-13 13:31:51,491 INFO ════════════════════════════════════════════════════════════════════════ |
| 2026-04-13 13:31:51,491 INFO |
| ── Pushing to HuggingFace Hub (trigger=final) ── |
| 2026-04-13 13:31:51,694 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:51,811 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:51,812 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF |
| 2026-04-13 13:31:51,951 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:51,952 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser |
| 2026-04-13 13:31:51,953 INFO Uploading detector → Shushant/ADAL-Detector-PANCLEF … |
| 2026-04-13 13:31:52,067 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:53,175 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:53,326 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:53,459 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:53,586 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:59,200 WARNING No files have been modified since last commit. Skipping to prevent empty commit. |
| 2026-04-13 13:31:59,524 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/revision/main "HTTP/1.1 200 OK" |
| 2026-04-13 13:31:59,689 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 13:32:01,144 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 13:32:01,284 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| 2026-04-13 13:32:01,985 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK" |
| 2026-04-13 13:32:02,113 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK" |
| |
