diff --git "a/training_logs/training.log" "b/training_logs/training.log" --- "a/training_logs/training.log" +++ "b/training_logs/training.log" @@ -2898,3 +2898,834 @@ 2026-05-07 01:51:30,159 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/preupload/main "HTTP/1.1 200 OK" 2026-05-07 01:51:30,878 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/commit/main "HTTP/1.1 200 OK" 2026-05-07 01:51:31,027 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/preupload/main "HTTP/1.1 200 OK" +2026-05-07 01:51:31,837 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/commit/main "HTTP/1.1 200 OK" +2026-05-07 01:51:31,838 INFO ✓ Detector pushed → https://huggingface.co/Shushant/adal_v5_raid +2026-05-07 01:51:31,838 INFO Uploading paraphraser → Shushant/adal_v5_raid-paraphraser … +2026-05-07 01:51:31,949 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" +2026-05-07 01:51:32,870 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" +2026-05-07 01:51:33,026 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid-paraphraser/preupload/main "HTTP/1.1 200 OK" +2026-05-07 01:51:33,149 INFO HTTP Request: POST https://huggingface.co/Shushant/adal_v5_raid-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK" +2026-05-07 01:51:33,266 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/adal_v5_raid-paraphraser/xet-write-token/main "HTTP/1.1 200 OK" +2026-05-07 01:51:36,975 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid-paraphraser/commit/main "HTTP/1.1 200 OK" +2026-05-07 01:51:36,976 INFO ✓ Paraphraser pushed → https://huggingface.co/Shushant/adal_v5_raid-paraphraser +2026-05-07 01:51:36,976 INFO ── Hub push complete ── + +2026-05-07 01:52:05,615 INFO [Step 151/200] det=skip para=0.0000 hum=0.0000 raw_rwd=0.7813±0.0174 rwd=0.7813 hum_rwd=0.2198±0.0175 (raw=0.2198) +2026-05-07 01:52:05,615 INFO per-gen rewards: chatgpt=0.776 cohere=0.785 gpt2=0.782 gpt3=0.786 llama-ch=0.785 mistral=0.782 mistral-=0.783 mpt=0.773 +2026-05-07 01:53:23,806 INFO [Step 152/200] det=9.1744 para=0.0000 hum=-0.0000 raw_rwd=0.7824±0.0136 rwd=0.7824 hum_rwd=0.2235±0.0178 (raw=0.2235) +2026-05-07 01:53:23,806 INFO loss components: L_human=0.376 L_aux_xh=0.497 L_xm_original=0.602 L_aux_xm=2.398 L_t5_para=1.346 L_xh_humanized=0.283 L_aux_hum=0.032 L_synonym_replacement=0.432 L_homoglyphs=0.430 L_article_deletion=0.735 L_misspelling=0.466 L_number_swap=0.779 L_whitespace_addition=0.434 L_upper_lower_swap=0.436 L_zero_width_space=0.428 L_insert_paragraphs=0.794 L_alternative_spelling=0.548 total=11.017 +2026-05-07 01:53:23,806 INFO per-gen rewards: chatgpt=0.785 cohere=0.775 gpt2=0.789 gpt3=0.788 llama-ch=0.789 mistral=0.774 mistral-=0.784 mpt=0.780 +2026-05-07 01:53:52,140 INFO [Step 153/200] det=skip para=0.0000 hum=-0.0000 raw_rwd=0.7806±0.0170 rwd=0.7806 hum_rwd=0.2178±0.0126 (raw=0.2178) +2026-05-07 01:53:52,140 INFO per-gen rewards: chatgpt=0.791 cohere=0.781 gpt2=0.788 gpt3=0.779 llama-ch=0.787 mistral=0.767 mistral-=0.774 mpt=0.782 +2026-05-07 01:55:10,830 INFO [Step 154/200] det=9.1594 para=-0.0000 hum=-0.0000 raw_rwd=0.7808±0.0142 rwd=0.7808 hum_rwd=0.2190±0.0148 (raw=0.2190) +2026-05-07 01:55:10,830 INFO loss components: L_human=0.160 L_aux_xh=0.104 L_xm_original=0.516 L_aux_xm=2.383 L_t5_para=1.486 L_xh_humanized=0.253 L_aux_hum=0.030 L_synonym_replacement=0.437 L_homoglyphs=0.434 L_article_deletion=0.456 L_misspelling=0.448 L_number_swap=0.446 L_whitespace_addition=0.452 L_upper_lower_swap=0.431 L_zero_width_space=0.434 L_insert_paragraphs=0.442 L_alternative_spelling=0.591 total=9.504 +2026-05-07 01:55:10,830 INFO per-gen rewards: chatgpt=0.773 cohere=0.782 gpt2=0.781 gpt3=0.788 llama-ch=0.779 mistral=0.785 mistral-=0.772 mpt=0.784 +2026-05-07 01:55:39,814 INFO [Step 155/200] det=skip para=-0.0000 hum=-0.0000 raw_rwd=0.8116±0.0108 rwd=0.8116 hum_rwd=0.1884±0.0103 (raw=0.1884) +2026-05-07 01:55:39,814 INFO per-gen rewards: chatgpt=0.814 cohere=0.807 gpt2=0.808 gpt3=0.812 llama-ch=0.813 mistral=0.814 mistral-=0.811 mpt=0.814 +2026-05-07 02:57:01,661 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 02:57:01,663 INFO │ MACRO_AVG AUROC=0.9638 TPR@1%FPR=0.5449 ◄ +2026-05-07 02:57:01,672 INFO │ chatgpt AUROC=0.9677 TPR@1%FPR=0.6687 +2026-05-07 02:57:01,672 INFO │ cohere AUROC=0.9509 TPR@1%FPR=0.5434 +2026-05-07 02:57:01,672 INFO │ cohere-chat AUROC=0.9707 TPR@1%FPR=0.4756 +2026-05-07 02:57:01,672 INFO │ gpt2 AUROC=0.9619 TPR@1%FPR=0.5992 +2026-05-07 02:57:01,672 INFO │ gpt3 AUROC=0.9633 TPR@1%FPR=0.5464 +2026-05-07 02:57:01,672 INFO │ gpt4 AUROC=0.9772 TPR@1%FPR=0.4079 +2026-05-07 02:57:01,672 INFO │ llama-chat AUROC=0.9649 TPR@1%FPR=0.5774 +2026-05-07 02:57:01,672 INFO │ mistral AUROC=0.9574 TPR@1%FPR=0.5872 +2026-05-07 02:57:01,672 INFO │ mistral-chat AUROC=0.9628 TPR@1%FPR=0.6242 +2026-05-07 02:57:01,672 INFO │ mpt AUROC=0.9555 TPR@1%FPR=0.4755 +2026-05-07 02:57:01,672 INFO │ mpt-chat AUROC=0.9693 TPR@1%FPR=0.4884 +2026-05-07 02:57:01,672 INFO │ (prev best) 0.9782 +2026-05-07 02:57:01,672 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.4704 +2026-05-07 02:57:01,672 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 02:57:01,672 INFO │ alternative_spelling 0.9681 ~ +2026-05-07 02:57:01,672 INFO │ article_deletion 0.9723 ~ +2026-05-07 02:57:01,672 INFO │ homoglyphs 0.9767 ~ +2026-05-07 02:57:01,672 INFO │ insert_paragraphs 0.9696 ~ +2026-05-07 02:57:01,672 INFO │ misspelling 0.9735 ~ +2026-05-07 02:57:01,672 INFO │ no_attack 0.9683 ~ +2026-05-07 02:57:01,672 INFO │ number_swap 0.9698 ~ +2026-05-07 02:57:01,672 INFO │ synonym_replacement 0.9752 ~ +2026-05-07 02:57:01,672 INFO │ t5_paraphrase 0.9000 ▼ +2026-05-07 02:57:01,672 INFO │ upper_lower_swap 0.9738 ~ +2026-05-07 02:57:01,672 INFO │ whitespace_addition 0.9739 ~ +2026-05-07 02:57:01,672 INFO │ zero_width_space 0.9751 ~ +2026-05-07 02:57:01,672 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 03:07:08,773 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 03:07:08,773 INFO │ abstracts AUROC=0.9978 TPR@1%FPR=0.9362 (h= 167 a= 2099) +2026-05-07 03:07:08,773 INFO │ books AUROC=0.9762 TPR@1%FPR=0.4291 (h= 172 a= 2011) +2026-05-07 03:07:08,773 INFO │ code AUROC=0.8920 TPR@1%FPR=0.0871 (h= 79 a= 666) +2026-05-07 03:07:08,773 INFO │ czech AUROC=0.9191 TPR@1%FPR=0.0193 (h= 183 a= 2230) +2026-05-07 03:07:08,773 INFO │ german AUROC=0.9680 TPR@1%FPR=0.3398 (h= 193 a= 2207) +2026-05-07 03:07:08,774 INFO │ news AUROC=0.9909 TPR@1%FPR=0.9178 (h= 200 a= 1994) +2026-05-07 03:07:08,774 INFO │ poetry AUROC=0.9806 TPR@1%FPR=0.1857 (h= 180 a= 2036) +2026-05-07 03:07:08,774 INFO │ recipes AUROC=0.9860 TPR@1%FPR=0.8578 (h= 183 a= 2081) +2026-05-07 03:07:08,774 INFO │ reddit AUROC=0.9797 TPR@1%FPR=0.8579 (h= 191 a= 2118) +2026-05-07 03:07:08,774 INFO │ reviews AUROC=0.9668 TPR@1%FPR=0.1498 (h= 88 a= 1155) +2026-05-07 03:07:08,774 INFO │ wiki AUROC=0.9411 TPR@1%FPR=0.1188 (h= 169 a= 2071) +2026-05-07 03:07:08,774 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 03:07:08,774 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 03:07:08,774 INFO │ alternative_spelling AUROC=0.9816 TPR@1%FPR=0.5318 (n= 1100) +2026-05-07 03:07:08,774 INFO │ article_deletion AUROC=0.9836 TPR@1%FPR=0.5100 (n= 1100) +2026-05-07 03:07:08,774 INFO │ homoglyph AUROC=0.9788 TPR@1%FPR=0.3082 (n= 1100) +2026-05-07 03:07:08,774 INFO │ insert_paragraphs AUROC=0.9835 TPR@1%FPR=0.3445 (n= 1100) +2026-05-07 03:07:08,774 INFO │ none AUROC=0.9836 TPR@1%FPR=0.5057 (n= 8568) +2026-05-07 03:07:08,774 INFO │ number AUROC=0.9834 TPR@1%FPR=0.5764 (n= 1100) +2026-05-07 03:07:08,774 INFO │ paraphrase AUROC=0.9066 TPR@1%FPR=0.2645 (n= 1100) +2026-05-07 03:07:08,774 INFO │ perplexity_misspelling AUROC=0.9838 TPR@1%FPR=0.5382 (n= 1100) +2026-05-07 03:07:08,774 INFO │ synonym AUROC=0.9769 TPR@1%FPR=0.5491 (n= 1100) +2026-05-07 03:07:08,774 INFO │ upper_lower AUROC=0.9829 TPR@1%FPR=0.6400 (n= 1100) +2026-05-07 03:07:08,774 INFO │ whitespace AUROC=0.9862 TPR@1%FPR=0.6373 (n= 1100) +2026-05-07 03:07:08,774 INFO │ zero_width_space AUROC=0.7324 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 03:07:08,774 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 03:07:08,774 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 03:07:08,774 INFO │ gpt4 AUROC=0.9772 TPR@1%FPR=0.4079 +2026-05-07 03:07:08,774 INFO │ cohere-chat AUROC=0.9707 TPR@1%FPR=0.4756 +2026-05-07 03:07:08,774 INFO │ mpt-chat AUROC=0.9693 TPR@1%FPR=0.4884 +2026-05-07 03:07:08,774 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 03:07:08,774 INFO [HardNeg] weights (high=more samples): mpt=1.334 cohere=1.097 gpt3=1.087 llama-chat=0.991 mistral=0.962 ... (range: 0.746–1.334) +2026-05-07 03:07:08,774 INFO [Worst-gen] gpt4 TPR@1%FPR=0.4079 +2026-05-07 03:07:08,774 INFO No improvement (1/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9638 cur_TPR@1%FPR=0.4704 worst-gen=0.4079 [gpt4] + +2026-05-07 03:08:28,500 INFO [Step 156/200] det=9.1254 para=-0.0000 hum=0.0000 raw_rwd=0.8119±0.0121 rwd=0.8119 hum_rwd=0.1880±0.0129 (raw=0.1880) +2026-05-07 03:08:28,500 INFO loss components: L_human=0.227 L_aux_xh=0.305 L_xm_original=0.608 L_aux_xm=2.120 L_t5_para=1.295 L_xh_humanized=0.331 L_aux_hum=0.037 L_synonym_replacement=0.430 L_homoglyphs=0.459 L_article_deletion=0.487 L_misspelling=0.428 L_number_swap=0.562 L_whitespace_addition=0.600 L_upper_lower_swap=0.446 L_zero_width_space=0.464 L_insert_paragraphs=0.709 L_alternative_spelling=0.595 total=10.104 +2026-05-07 03:08:28,500 INFO per-gen rewards: chatgpt=0.815 cohere=0.811 gpt2=0.814 gpt3=0.810 llama-ch=0.820 mistral=0.812 mistral-=0.809 mpt=0.808 +2026-05-07 03:08:57,233 INFO [Step 157/200] det=skip para=-0.0000 hum=0.0000 raw_rwd=0.7568±0.0156 rwd=0.7568 hum_rwd=0.2410±0.0175 (raw=0.2410) +2026-05-07 03:08:57,233 INFO per-gen rewards: chatgpt=0.752 cohere=0.756 gpt2=0.761 gpt3=0.754 llama-ch=0.763 mistral=0.761 mistral-=0.758 mpt=0.752 +2026-05-07 03:10:17,074 INFO [Step 158/200] det=9.1382 para=0.0000 hum=-0.0000 raw_rwd=0.7557±0.0128 rwd=0.7557 hum_rwd=0.2422±0.0155 (raw=0.2422) +2026-05-07 03:10:17,075 INFO loss components: L_human=0.112 L_aux_xh=0.055 L_xm_original=0.432 L_aux_xm=2.125 L_t5_para=1.372 L_xh_humanized=0.292 L_aux_hum=0.052 L_synonym_replacement=0.430 L_homoglyphs=0.425 L_article_deletion=0.448 L_misspelling=0.443 L_number_swap=0.428 L_whitespace_addition=0.429 L_upper_lower_swap=0.427 L_zero_width_space=0.436 L_insert_paragraphs=0.431 L_alternative_spelling=0.428 total=8.765 +2026-05-07 03:10:17,075 INFO per-gen rewards: chatgpt=0.764 cohere=0.762 gpt2=0.755 gpt3=0.752 llama-ch=0.751 mistral=0.752 mistral-=0.751 mpt=0.759 +2026-05-07 03:10:45,757 INFO [Step 159/200] det=skip para=0.0000 hum=-0.0000 raw_rwd=0.7948±0.0126 rwd=0.7948 hum_rwd=0.2055±0.0141 (raw=0.2055) +2026-05-07 03:10:45,757 INFO per-gen rewards: chatgpt=0.786 cohere=0.797 gpt2=0.789 gpt3=0.799 llama-ch=0.792 mistral=0.795 mistral-=0.799 mpt=0.798 +2026-05-07 03:12:04,714 INFO [Step 160/200] det=9.7511 para=0.0000 hum=0.0000 raw_rwd=0.7960±0.0145 rwd=0.7960 hum_rwd=0.2046±0.0119 (raw=0.2046) +2026-05-07 03:12:04,714 INFO loss components: L_human=0.279 L_aux_xh=0.326 L_xm_original=0.616 L_aux_xm=2.409 L_t5_para=1.425 L_xh_humanized=0.279 L_aux_hum=0.027 L_synonym_replacement=0.429 L_homoglyphs=0.426 L_article_deletion=0.754 L_misspelling=0.647 L_number_swap=0.669 L_whitespace_addition=0.428 L_upper_lower_swap=0.427 L_zero_width_space=0.425 L_insert_paragraphs=0.456 L_alternative_spelling=0.750 total=10.772 +2026-05-07 03:12:04,714 INFO per-gen rewards: chatgpt=0.803 cohere=0.788 gpt2=0.798 gpt3=0.794 llama-ch=0.796 mistral=0.804 mistral-=0.792 mpt=0.796 +2026-05-07 04:13:27,229 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 04:13:27,231 INFO │ MACRO_AVG AUROC=0.9627 TPR@1%FPR=0.3447 ◄ +2026-05-07 04:13:27,241 INFO │ chatgpt AUROC=0.9661 TPR@1%FPR=0.4106 +2026-05-07 04:13:27,241 INFO │ cohere AUROC=0.9506 TPR@1%FPR=0.3381 +2026-05-07 04:13:27,241 INFO │ cohere-chat AUROC=0.9707 TPR@1%FPR=0.3376 +2026-05-07 04:13:27,241 INFO │ gpt2 AUROC=0.9605 TPR@1%FPR=0.4023 +2026-05-07 04:13:27,241 INFO │ gpt3 AUROC=0.9618 TPR@1%FPR=0.2762 +2026-05-07 04:13:27,241 INFO │ gpt4 AUROC=0.9744 TPR@1%FPR=0.2229 +2026-05-07 04:13:27,241 INFO │ llama-chat AUROC=0.9629 TPR@1%FPR=0.2906 +2026-05-07 04:13:27,241 INFO │ mistral AUROC=0.9568 TPR@1%FPR=0.4174 +2026-05-07 04:13:27,241 INFO │ mistral-chat AUROC=0.9614 TPR@1%FPR=0.3479 +2026-05-07 04:13:27,241 INFO │ mpt AUROC=0.9551 TPR@1%FPR=0.3721 +2026-05-07 04:13:27,241 INFO │ mpt-chat AUROC=0.9694 TPR@1%FPR=0.3760 +2026-05-07 04:13:27,241 INFO │ (prev best) 0.9782 +2026-05-07 04:13:27,241 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.3351 +2026-05-07 04:13:27,241 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 04:13:27,241 INFO │ alternative_spelling 0.9668 ~ +2026-05-07 04:13:27,241 INFO │ article_deletion 0.9715 ~ +2026-05-07 04:13:27,241 INFO │ homoglyphs 0.9762 ~ +2026-05-07 04:13:27,241 INFO │ insert_paragraphs 0.9701 ~ +2026-05-07 04:13:27,241 INFO │ misspelling 0.9732 ~ +2026-05-07 04:13:27,241 INFO │ no_attack 0.9672 ~ +2026-05-07 04:13:27,241 INFO │ number_swap 0.9692 ~ +2026-05-07 04:13:27,241 INFO │ synonym_replacement 0.9764 ~ +2026-05-07 04:13:27,241 INFO │ t5_paraphrase 0.9000 ▼ +2026-05-07 04:13:27,241 INFO │ upper_lower_swap 0.9723 ~ +2026-05-07 04:13:27,241 INFO │ whitespace_addition 0.9745 ~ +2026-05-07 04:13:27,241 INFO │ zero_width_space 0.9742 ~ +2026-05-07 04:13:27,241 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 04:23:33,631 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 04:23:33,632 INFO │ abstracts AUROC=0.9968 TPR@1%FPR=0.9366 (h= 167 a= 2099) +2026-05-07 04:23:33,632 INFO │ books AUROC=0.9691 TPR@1%FPR=0.3729 (h= 172 a= 2011) +2026-05-07 04:23:33,632 INFO │ code AUROC=0.9053 TPR@1%FPR=0.0991 (h= 79 a= 666) +2026-05-07 04:23:33,632 INFO │ czech AUROC=0.9237 TPR@1%FPR=0.0215 (h= 183 a= 2230) +2026-05-07 04:23:33,632 INFO │ german AUROC=0.9808 TPR@1%FPR=0.6167 (h= 193 a= 2207) +2026-05-07 04:23:33,632 INFO │ news AUROC=0.9890 TPR@1%FPR=0.9152 (h= 200 a= 1994) +2026-05-07 04:23:33,632 INFO │ poetry AUROC=0.9808 TPR@1%FPR=0.1488 (h= 180 a= 2036) +2026-05-07 04:23:33,632 INFO │ recipes AUROC=0.9780 TPR@1%FPR=0.3349 (h= 183 a= 2081) +2026-05-07 04:23:33,632 INFO │ reddit AUROC=0.9758 TPR@1%FPR=0.5378 (h= 191 a= 2118) +2026-05-07 04:23:33,632 INFO │ reviews AUROC=0.9657 TPR@1%FPR=0.0606 (h= 88 a= 1155) +2026-05-07 04:23:33,632 INFO │ wiki AUROC=0.9255 TPR@1%FPR=0.1405 (h= 169 a= 2071) +2026-05-07 04:23:33,632 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 04:23:33,632 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 04:23:33,632 INFO │ alternative_spelling AUROC=0.9802 TPR@1%FPR=0.3800 (n= 1100) +2026-05-07 04:23:33,632 INFO │ article_deletion AUROC=0.9812 TPR@1%FPR=0.3200 (n= 1100) +2026-05-07 04:23:33,632 INFO │ homoglyph AUROC=0.9815 TPR@1%FPR=0.3064 (n= 1100) +2026-05-07 04:23:33,632 INFO │ insert_paragraphs AUROC=0.9822 TPR@1%FPR=0.2200 (n= 1100) +2026-05-07 04:23:33,632 INFO │ none AUROC=0.9819 TPR@1%FPR=0.3380 (n= 8568) +2026-05-07 04:23:33,632 INFO │ number AUROC=0.9813 TPR@1%FPR=0.3882 (n= 1100) +2026-05-07 04:23:33,632 INFO │ paraphrase AUROC=0.9107 TPR@1%FPR=0.2455 (n= 1100) +2026-05-07 04:23:33,632 INFO │ perplexity_misspelling AUROC=0.9819 TPR@1%FPR=0.3691 (n= 1100) +2026-05-07 04:23:33,632 INFO │ synonym AUROC=0.9757 TPR@1%FPR=0.3945 (n= 1100) +2026-05-07 04:23:33,632 INFO │ upper_lower AUROC=0.9812 TPR@1%FPR=0.4555 (n= 1100) +2026-05-07 04:23:33,632 INFO │ whitespace AUROC=0.9871 TPR@1%FPR=0.5845 (n= 1100) +2026-05-07 04:23:33,632 INFO │ zero_width_space AUROC=0.7349 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 04:23:33,632 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 04:23:33,632 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 04:23:33,632 INFO │ gpt4 AUROC=0.9744 TPR@1%FPR=0.2229 +2026-05-07 04:23:33,633 INFO │ cohere-chat AUROC=0.9707 TPR@1%FPR=0.3376 +2026-05-07 04:23:33,633 INFO │ mpt-chat AUROC=0.9694 TPR@1%FPR=0.3760 +2026-05-07 04:23:33,633 INFO └────────────────────────���────────────────────────────────┘ +2026-05-07 04:23:33,633 INFO [HardNeg] weights (high=more samples): gpt3=1.209 llama-chat=1.169 cohere=1.043 mistral-chat=1.018 mpt=0.958 ... (range: 0.851–1.209) +2026-05-07 04:23:33,633 INFO [Worst-gen] gpt4 TPR@1%FPR=0.2229 +2026-05-07 04:23:33,633 INFO No improvement (2/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9627 cur_TPR@1%FPR=0.3351 worst-gen=0.2229 [gpt4] + +2026-05-07 04:24:02,787 INFO [Step 161/200] det=skip para=0.0000 hum=-0.0000 raw_rwd=0.8092±0.0120 rwd=0.8092 hum_rwd=0.1915±0.0131 (raw=0.1915) +2026-05-07 04:24:02,787 INFO per-gen rewards: chatgpt=0.801 cohere=0.819 gpt2=0.810 gpt3=0.812 llama-ch=0.805 mistral=0.805 mistral-=0.806 mpt=0.815 +2026-05-07 04:25:22,397 INFO [Step 162/200] det=9.0791 para=0.0000 hum=-0.0000 raw_rwd=0.8084±0.0107 rwd=0.8084 hum_rwd=0.1910±0.0101 (raw=0.1910) +2026-05-07 04:25:22,398 INFO loss components: L_human=0.247 L_aux_xh=0.094 L_xm_original=0.423 L_aux_xm=2.014 L_t5_para=1.322 L_xh_humanized=0.295 L_aux_hum=0.025 L_synonym_replacement=0.440 L_homoglyphs=0.424 L_article_deletion=0.437 L_misspelling=0.430 L_number_swap=0.426 L_whitespace_addition=0.426 L_upper_lower_swap=0.427 L_zero_width_space=0.427 L_insert_paragraphs=0.441 L_alternative_spelling=0.427 total=8.727 +2026-05-07 04:25:22,398 INFO per-gen rewards: chatgpt=0.813 cohere=0.807 gpt2=0.812 gpt3=0.807 llama-ch=0.808 mistral=0.806 mistral-=0.812 mpt=0.804 +2026-05-07 04:25:51,129 INFO [Step 163/200] det=skip para=-0.0000 hum=0.0710 raw_rwd=0.7645±0.0159 rwd=0.7645 hum_rwd=0.2379±0.0523 (raw=0.2379) +2026-05-07 04:25:51,130 INFO per-gen rewards: chatgpt=0.773 cohere=0.764 gpt2=0.768 gpt3=0.760 llama-ch=0.760 mistral=0.771 mistral-=0.760 mpt=0.765 +2026-05-07 04:27:08,845 INFO [Step 164/200] det=8.9686 para=-0.0739 hum=0.0000 raw_rwd=0.7578±0.0694 rwd=0.7578 hum_rwd=0.2336±0.0148 (raw=0.2336) +2026-05-07 04:27:08,846 INFO loss components: L_human=0.265 L_aux_xh=0.188 L_xm_original=0.426 L_aux_xm=1.981 L_t5_para=1.414 L_xh_humanized=0.287 L_aux_hum=0.024 L_synonym_replacement=0.432 L_homoglyphs=0.426 L_article_deletion=0.431 L_misspelling=0.439 L_number_swap=0.428 L_whitespace_addition=0.430 L_upper_lower_swap=0.429 L_zero_width_space=0.430 L_insert_paragraphs=0.427 L_alternative_spelling=0.425 total=8.882 +2026-05-07 04:27:08,846 INFO per-gen rewards: chatgpt=0.764 cohere=0.775 gpt2=0.768 gpt3=0.768 llama-ch=0.764 mistral=0.760 mistral-=0.701 mpt=0.761 +2026-05-07 04:27:37,663 INFO [Step 165/200] det=skip para=0.0000 hum=-0.0030 raw_rwd=0.8052±0.0117 rwd=0.8052 hum_rwd=0.1931±0.0132 (raw=0.1931) +2026-05-07 04:27:37,664 INFO per-gen rewards: chatgpt=0.803 cohere=0.809 gpt2=0.803 gpt3=0.801 llama-ch=0.813 mistral=0.805 mistral-=0.803 mpt=0.805 +2026-05-07 05:28:58,666 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 05:28:58,667 INFO │ MACRO_AVG AUROC=0.9746 TPR@1%FPR=0.7490 ◄ +2026-05-07 05:28:58,667 INFO │ chatgpt AUROC=0.9791 TPR@1%FPR=0.7940 +2026-05-07 05:28:58,676 INFO │ cohere AUROC=0.9627 TPR@1%FPR=0.7253 +2026-05-07 05:28:58,676 INFO │ cohere-chat AUROC=0.9802 TPR@1%FPR=0.7616 +2026-05-07 05:28:58,676 INFO │ gpt2 AUROC=0.9723 TPR@1%FPR=0.7623 +2026-05-07 05:28:58,676 INFO │ gpt3 AUROC=0.9759 TPR@1%FPR=0.7555 +2026-05-07 05:28:58,676 INFO │ gpt4 AUROC=0.9843 TPR@1%FPR=0.7390 +2026-05-07 05:28:58,676 INFO │ llama-chat AUROC=0.9768 TPR@1%FPR=0.7970 +2026-05-07 05:28:58,676 INFO │ mistral AUROC=0.9674 TPR@1%FPR=0.7208 +2026-05-07 05:28:58,676 INFO │ mistral-chat AUROC=0.9743 TPR@1%FPR=0.7819 +2026-05-07 05:28:58,676 INFO │ mpt AUROC=0.9685 TPR@1%FPR=0.6694 +2026-05-07 05:28:58,676 INFO │ mpt-chat AUROC=0.9791 TPR@1%FPR=0.7321 +2026-05-07 05:28:58,676 INFO │ (prev best) 0.9782 +2026-05-07 05:28:58,676 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.7259 +2026-05-07 05:28:58,676 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 05:28:58,676 INFO │ alternative_spelling 0.9782 ~ +2026-05-07 05:28:58,676 INFO │ article_deletion 0.9828 ~ +2026-05-07 05:28:58,676 INFO │ homoglyphs 0.9872 ~ +2026-05-07 05:28:58,676 INFO │ insert_paragraphs 0.9800 ~ +2026-05-07 05:28:58,676 INFO │ misspelling 0.9844 ~ +2026-05-07 05:28:58,676 INFO │ no_attack 0.9785 ~ +2026-05-07 05:28:58,676 INFO │ number_swap 0.9798 ~ +2026-05-07 05:28:58,676 INFO │ synonym_replacement 0.9876 ~ +2026-05-07 05:28:58,676 INFO │ t5_paraphrase 0.9800 ~ +2026-05-07 05:28:58,676 INFO │ upper_lower_swap 0.9849 ~ +2026-05-07 05:28:58,676 INFO │ whitespace_addition 0.9850 ~ +2026-05-07 05:28:58,676 INFO │ zero_width_space 0.9858 ~ +2026-05-07 05:28:58,676 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 05:39:05,209 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 05:39:05,209 INFO │ abstracts AUROC=0.9998 TPR@1%FPR=0.9952 (h= 167 a= 2099) +2026-05-07 05:39:05,209 INFO │ books AUROC=0.9861 TPR@1%FPR=0.5932 (h= 172 a= 2011) +2026-05-07 05:39:05,209 INFO │ code AUROC=0.9091 TPR@1%FPR=0.0676 (h= 79 a= 666) +2026-05-07 05:39:05,209 INFO │ czech AUROC=0.9392 TPR@1%FPR=0.1179 (h= 183 a= 2230) +2026-05-07 05:39:05,209 INFO │ german AUROC=0.9889 TPR@1%FPR=0.8704 (h= 193 a= 2207) +2026-05-07 05:39:05,209 INFO │ news AUROC=0.9920 TPR@1%FPR=0.9188 (h= 200 a= 1994) +2026-05-07 05:39:05,209 INFO │ poetry AUROC=0.9835 TPR@1%FPR=0.2682 (h= 180 a= 2036) +2026-05-07 05:39:05,209 INFO │ recipes AUROC=0.9905 TPR@1%FPR=0.9005 (h= 183 a= 2081) +2026-05-07 05:39:05,209 INFO │ reddit AUROC=0.9856 TPR@1%FPR=0.7295 (h= 191 a= 2118) +2026-05-07 05:39:05,209 INFO │ reviews AUROC=0.9747 TPR@1%FPR=0.7792 (h= 88 a= 1155) +2026-05-07 05:39:05,209 INFO │ wiki AUROC=0.9567 TPR@1%FPR=0.4288 (h= 169 a= 2071) +2026-05-07 05:39:05,209 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 05:39:05,209 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 05:39:05,209 INFO │ alternative_spelling AUROC=0.9886 TPR@1%FPR=0.7764 (n= 1100) +2026-05-07 05:39:05,209 INFO │ article_deletion AUROC=0.9900 TPR@1%FPR=0.8082 (n= 1100) +2026-05-07 05:39:05,209 INFO │ homoglyph AUROC=0.9925 TPR@1%FPR=0.6891 (n= 1100) +2026-05-07 05:39:05,209 INFO │ insert_paragraphs AUROC=0.9916 TPR@1%FPR=0.7555 (n= 1100) +2026-05-07 05:39:05,209 INFO │ none AUROC=0.9884 TPR@1%FPR=0.7963 (n= 8568) +2026-05-07 05:39:05,209 INFO │ number AUROC=0.9895 TPR@1%FPR=0.8045 (n= 1100) +2026-05-07 05:39:05,209 INFO │ paraphrase AUROC=0.9028 TPR@1%FPR=0.3482 (n= 1100) +2026-05-07 05:39:05,209 INFO │ perplexity_misspelling AUROC=0.9904 TPR@1%FPR=0.7909 (n= 1100) +2026-05-07 05:39:05,209 INFO │ synonym AUROC=0.9828 TPR@1%FPR=0.7536 (n= 1100) +2026-05-07 05:39:05,209 INFO │ upper_lower AUROC=0.9885 TPR@1%FPR=0.8155 (n= 1100) +2026-05-07 05:39:05,210 INFO │ whitespace AUROC=0.9943 TPR@1%FPR=0.8945 (n= 1100) +2026-05-07 05:39:05,210 INFO │ zero_width_space AUROC=0.8234 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 05:39:05,210 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 05:39:05,210 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 05:39:05,210 INFO │ gpt4 AUROC=0.9843 TPR@1%FPR=0.7390 +2026-05-07 05:39:05,210 INFO │ cohere-chat AUROC=0.9802 TPR@1%FPR=0.7616 +2026-05-07 05:39:05,210 INFO │ mpt-chat AUROC=0.9791 TPR@1%FPR=0.7321 +2026-05-07 05:39:05,210 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 05:39:05,210 INFO [HardNeg] weights (high=more samples): mpt=1.278 mistral=1.087 cohere=1.071 gpt3=0.976 gpt2=0.956 ... (range: 0.862–1.278) +2026-05-07 05:39:05,210 INFO [Worst-gen] mpt TPR@1%FPR=0.6694 +2026-05-07 05:39:05,210 INFO No improvement (3/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9746 cur_TPR@1%FPR=0.7259 worst-gen=0.6694 [mpt] + +2026-05-07 05:40:24,300 INFO [Step 166/200] det=9.2231 para=-0.0000 hum=-0.0000 raw_rwd=0.8036±0.0105 rwd=0.8036 hum_rwd=0.1911±0.0126 (raw=0.1911) +2026-05-07 05:40:24,300 INFO loss components: L_human=0.124 L_aux_xh=0.086 L_xm_original=0.455 L_aux_xm=2.189 L_t5_para=1.410 L_xh_humanized=0.320 L_aux_hum=0.022 L_synonym_replacement=0.434 L_homoglyphs=0.438 L_article_deletion=0.519 L_misspelling=0.530 L_number_swap=0.503 L_whitespace_addition=0.560 L_upper_lower_swap=0.453 L_zero_width_space=0.435 L_insert_paragraphs=0.461 L_alternative_spelling=0.478 total=9.415 +2026-05-07 05:40:24,300 INFO per-gen rewards: chatgpt=0.804 cohere=0.806 gpt2=0.797 gpt3=0.804 llama-ch=0.801 mistral=0.804 mistral-=0.805 mpt=0.806 +2026-05-07 05:40:53,153 INFO [Step 167/200] det=skip para=0.0000 hum=-0.0004 raw_rwd=0.7825±0.0140 rwd=0.7825 hum_rwd=0.2185±0.0121 (raw=0.2185) +2026-05-07 05:40:53,153 INFO per-gen rewards: chatgpt=0.787 cohere=0.788 gpt2=0.782 gpt3=0.779 llama-ch=0.788 mistral=0.784 mistral-=0.776 mpt=0.777 +2026-05-07 05:42:12,475 INFO [Step 168/200] det=9.1253 para=0.0000 hum=-0.0000 raw_rwd=0.7832±0.0132 rwd=0.7832 hum_rwd=0.2146±0.0151 (raw=0.2146) +2026-05-07 05:42:12,475 INFO loss components: L_human=0.128 L_aux_xh=0.052 L_xm_original=0.436 L_aux_xm=2.102 L_t5_para=1.230 L_xh_humanized=0.279 L_aux_hum=0.025 L_synonym_replacement=0.427 L_homoglyphs=0.434 L_article_deletion=0.432 L_misspelling=0.428 L_number_swap=0.434 L_whitespace_addition=0.428 L_upper_lower_swap=0.426 L_zero_width_space=0.430 L_insert_paragraphs=0.443 L_alternative_spelling=0.453 total=8.589 +2026-05-07 05:42:12,475 INFO per-gen rewards: chatgpt=0.780 cohere=0.780 gpt2=0.777 gpt3=0.788 llama-ch=0.797 mistral=0.785 mistral-=0.778 mpt=0.783 +2026-05-07 05:42:41,417 INFO [Step 169/200] det=skip para=-0.0000 hum=0.0000 raw_rwd=0.7607±0.0159 rwd=0.7607 hum_rwd=0.2409±0.0138 (raw=0.2409) +2026-05-07 05:42:41,418 INFO per-gen rewards: chatgpt=0.764 cohere=0.761 gpt2=0.761 gpt3=0.755 llama-ch=0.770 mistral=0.758 mistral-=0.761 mpt=0.758 +2026-05-07 05:44:00,883 INFO [Step 170/200] det=9.1002 para=-0.0000 hum=0.0000 raw_rwd=0.7556±0.0151 rwd=0.7556 hum_rwd=0.2423±0.0143 (raw=0.2423) +2026-05-07 05:44:00,883 INFO loss components: L_human=0.223 L_aux_xh=0.155 L_xm_original=0.431 L_aux_xm=2.132 L_t5_para=1.334 L_xh_humanized=0.300 L_aux_hum=0.022 L_synonym_replacement=0.448 L_homoglyphs=0.426 L_article_deletion=0.435 L_misspelling=0.484 L_number_swap=0.429 L_whitespace_addition=0.425 L_upper_lower_swap=0.426 L_zero_width_space=0.427 L_insert_paragraphs=0.736 L_alternative_spelling=0.427 total=9.259 +2026-05-07 05:44:00,884 INFO per-gen rewards: chatgpt=0.758 cohere=0.764 gpt2=0.755 gpt3=0.750 llama-ch=0.749 mistral=0.753 mistral-=0.761 mpt=0.754 +2026-05-07 06:45:16,427 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 06:45:16,437 INFO │ MACRO_AVG AUROC=0.9649 TPR@1%FPR=0.6323 ◄ +2026-05-07 06:45:16,437 INFO │ chatgpt AUROC=0.9674 TPR@1%FPR=0.7011 +2026-05-07 06:45:16,437 INFO │ cohere AUROC=0.9541 TPR@1%FPR=0.6143 +2026-05-07 06:45:16,437 INFO │ cohere-chat AUROC=0.9744 TPR@1%FPR=0.6201 +2026-05-07 06:45:16,437 INFO │ gpt2 AUROC=0.9623 TPR@1%FPR=0.6664 +2026-05-07 06:45:16,437 INFO │ gpt3 AUROC=0.9623 TPR@1%FPR=0.6468 +2026-05-07 06:45:16,437 INFO │ gpt4 AUROC=0.9777 TPR@1%FPR=0.5003 +2026-05-07 06:45:16,437 INFO │ llama-chat AUROC=0.9657 TPR@1%FPR=0.6875 +2026-05-07 06:45:16,437 INFO │ mistral AUROC=0.9584 TPR@1%FPR=0.6400 +2026-05-07 06:45:16,437 INFO │ mistral-chat AUROC=0.9633 TPR@1%FPR=0.6928 +2026-05-07 06:45:16,437 INFO │ mpt AUROC=0.9569 TPR@1%FPR=0.5728 +2026-05-07 06:45:16,437 INFO │ mpt-chat AUROC=0.9718 TPR@1%FPR=0.6126 +2026-05-07 06:45:16,437 INFO │ (prev best) 0.9782 +2026-05-07 06:45:16,437 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.5749 +2026-05-07 06:45:16,437 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 06:45:16,438 INFO │ alternative_spelling 0.9693 ~ +2026-05-07 06:45:16,438 INFO │ article_deletion 0.9733 ~ +2026-05-07 06:45:16,438 INFO │ homoglyphs 0.9768 ~ +2026-05-07 06:45:16,438 INFO │ insert_paragraphs 0.9704 ~ +2026-05-07 06:45:16,438 INFO │ misspelling 0.9740 ~ +2026-05-07 06:45:16,438 INFO │ no_attack 0.9696 ~ +2026-05-07 06:45:16,438 INFO │ number_swap 0.9710 ~ +2026-05-07 06:45:16,438 INFO │ synonym_replacement 0.9775 ~ +2026-05-07 06:45:16,438 INFO │ t5_paraphrase 0.9200 ~ +2026-05-07 06:45:16,438 INFO │ upper_lower_swap 0.9736 ~ +2026-05-07 06:45:16,438 INFO │ whitespace_addition 0.9755 ~ +2026-05-07 06:45:16,438 INFO │ zero_width_space 0.9753 ~ +2026-05-07 06:45:16,438 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 06:55:21,440 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 06:55:21,440 INFO │ abstracts AUROC=0.9995 TPR@1%FPR=0.9971 (h= 167 a= 2099) +2026-05-07 06:55:21,441 INFO │ books AUROC=0.9626 TPR@1%FPR=0.3362 (h= 172 a= 2011) +2026-05-07 06:55:21,441 INFO │ code AUROC=0.9140 TPR@1%FPR=0.1051 (h= 79 a= 666) +2026-05-07 06:55:21,441 INFO │ czech AUROC=0.9389 TPR@1%FPR=0.0641 (h= 183 a= 2230) +2026-05-07 06:55:21,441 INFO │ german AUROC=0.9762 TPR@1%FPR=0.4875 (h= 193 a= 2207) +2026-05-07 06:55:21,441 INFO │ news AUROC=0.9880 TPR@1%FPR=0.9092 (h= 200 a= 1994) +2026-05-07 06:55:21,441 INFO │ poetry AUROC=0.9761 TPR@1%FPR=0.3011 (h= 180 a= 2036) +2026-05-07 06:55:21,441 INFO │ recipes AUROC=0.9912 TPR@1%FPR=0.8856 (h= 183 a= 2081) +2026-05-07 06:55:21,441 INFO │ reddit AUROC=0.9751 TPR@1%FPR=0.7332 (h= 191 a= 2118) +2026-05-07 06:55:21,441 INFO │ reviews AUROC=0.9657 TPR@1%FPR=0.1333 (h= 88 a= 1155) +2026-05-07 06:55:21,441 INFO │ wiki AUROC=0.9391 TPR@1%FPR=0.2796 (h= 169 a= 2071) +2026-05-07 06:55:21,441 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 06:55:21,441 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 06:55:21,441 INFO │ alternative_spelling AUROC=0.9848 TPR@1%FPR=0.6291 (n= 1100) +2026-05-07 06:55:21,441 INFO │ article_deletion AUROC=0.9861 TPR@1%FPR=0.6582 (n= 1100) +2026-05-07 06:55:21,441 INFO │ homoglyph AUROC=0.9803 TPR@1%FPR=0.2745 (n= 1100) +2026-05-07 06:55:21,441 INFO │ insert_paragraphs AUROC=0.9871 TPR@1%FPR=0.5664 (n= 1100) +2026-05-07 06:55:21,441 INFO │ none AUROC=0.9859 TPR@1%FPR=0.6349 (n= 8568) +2026-05-07 06:55:21,441 INFO │ number AUROC=0.9859 TPR@1%FPR=0.6782 (n= 1100) +2026-05-07 06:55:21,441 INFO │ paraphrase AUROC=0.9203 TPR@1%FPR=0.3009 (n= 1100) +2026-05-07 06:55:21,441 INFO │ perplexity_misspelling AUROC=0.9869 TPR@1%FPR=0.6409 (n= 1100) +2026-05-07 06:55:21,441 INFO │ synonym AUROC=0.9802 TPR@1%FPR=0.5909 (n= 1100) +2026-05-07 06:55:21,441 INFO │ upper_lower AUROC=0.9846 TPR@1%FPR=0.7082 (n= 1100) +2026-05-07 06:55:21,441 INFO │ whitespace AUROC=0.9901 TPR@1%FPR=0.8091 (n= 1100) +2026-05-07 06:55:21,441 INFO │ zero_width_space AUROC=0.7070 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 06:55:21,441 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 06:55:21,441 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 06:55:21,441 INFO │ gpt4 AUROC=0.9777 TPR@1%FPR=0.5003 +2026-05-07 06:55:21,441 INFO │ cohere-chat AUROC=0.9744 TPR@1%FPR=0.6201 +2026-05-07 06:55:21,441 INFO │ mpt-chat AUROC=0.9718 TPR@1%FPR=0.6126 +2026-05-07 06:55:21,441 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 06:55:21,441 INFO [HardNeg] weights (high=more samples): mpt=1.271 cohere=1.119 mistral=1.033 gpt3=1.011 gpt2=0.951 ... (range: 0.852–1.271) +2026-05-07 06:55:21,441 INFO [Worst-gen] gpt4 TPR@1%FPR=0.5003 +2026-05-07 06:55:21,441 INFO No improvement (4/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9649 cur_TPR@1%FPR=0.5749 worst-gen=0.5003 [gpt4] + +2026-05-07 06:55:50,604 INFO [Step 171/200] det=skip para=-0.0000 hum=-0.0000 raw_rwd=0.7827±0.0154 rwd=0.7827 hum_rwd=0.2165±0.0150 (raw=0.2165) +2026-05-07 06:55:50,604 INFO per-gen rewards: chatgpt=0.785 cohere=0.789 gpt2=0.777 gpt3=0.776 llama-ch=0.777 mistral=0.782 mistral-=0.792 mpt=0.782 +2026-05-07 06:57:11,679 INFO [Step 172/200] det=8.8172 para=0.0000 hum=0.0000 raw_rwd=0.7868±0.0147 rwd=0.7868 hum_rwd=0.2163±0.0150 (raw=0.2163) +2026-05-07 06:57:11,679 INFO loss components: L_human=0.105 L_aux_xh=0.032 L_xm_original=0.426 L_aux_xm=2.047 L_t5_para=1.418 L_xh_humanized=0.251 L_aux_hum=0.023 L_synonym_replacement=0.442 L_homoglyphs=0.429 L_article_deletion=0.453 L_misspelling=0.519 L_number_swap=0.428 L_whitespace_addition=0.433 L_upper_lower_swap=0.432 L_zero_width_space=0.425 L_insert_paragraphs=0.436 L_alternative_spelling=0.427 total=8.725 +2026-05-07 06:57:11,679 INFO per-gen rewards: chatgpt=0.780 cohere=0.791 gpt2=0.787 gpt3=0.789 llama-ch=0.784 mistral=0.796 mistral-=0.783 mpt=0.784 +2026-05-07 06:57:40,301 INFO [Step 173/200] det=skip para=0.0000 hum=-0.0000 raw_rwd=0.7986±0.0119 rwd=0.7986 hum_rwd=0.1970±0.0114 (raw=0.1970) +2026-05-07 06:57:40,301 INFO per-gen rewards: chatgpt=0.805 cohere=0.795 gpt2=0.801 gpt3=0.794 llama-ch=0.801 mistral=0.798 mistral-=0.795 mpt=0.800 +2026-05-07 06:59:00,579 INFO [Step 174/200] det=9.0491 para=0.0000 hum=-0.0000 raw_rwd=0.8005±0.0106 rwd=0.8005 hum_rwd=0.2017±0.0152 (raw=0.2017) +2026-05-07 06:59:00,580 INFO loss components: L_human=0.204 L_aux_xh=0.158 L_xm_original=0.434 L_aux_xm=2.095 L_t5_para=1.381 L_xh_humanized=0.310 L_aux_hum=0.020 L_synonym_replacement=0.431 L_homoglyphs=0.438 L_article_deletion=0.562 L_misspelling=0.456 L_number_swap=0.442 L_whitespace_addition=0.428 L_upper_lower_swap=0.428 L_zero_width_space=0.426 L_insert_paragraphs=0.700 L_alternative_spelling=0.427 total=9.340 +2026-05-07 06:59:00,580 INFO per-gen rewards: chatgpt=0.794 cohere=0.794 gpt2=0.805 gpt3=0.802 llama-ch=0.794 mistral=0.801 mistral-=0.807 mpt=0.805 +2026-05-07 06:59:29,664 INFO [Step 175/200] det=skip para=0.0000 hum=-0.0000 raw_rwd=0.7834±0.0137 rwd=0.7834 hum_rwd=0.2173±0.0125 (raw=0.2173) +2026-05-07 06:59:29,664 INFO per-gen rewards: chatgpt=0.787 cohere=0.789 gpt2=0.786 gpt3=0.781 llama-ch=0.783 mistral=0.779 mistral-=0.783 mpt=0.780 +2026-05-07 08:00:55,476 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 08:00:55,478 INFO │ MACRO_AVG AUROC=0.9546 TPR@1%FPR=0.3412 ◄ +2026-05-07 08:00:55,478 INFO │ chatgpt AUROC=0.9568 TPR@1%FPR=0.4008 +2026-05-07 08:00:55,487 INFO │ cohere AUROC=0.9414 TPR@1%FPR=0.3177 +2026-05-07 08:00:55,487 INFO │ cohere-chat AUROC=0.9663 TPR@1%FPR=0.3451 +2026-05-07 08:00:55,487 INFO │ gpt2 AUROC=0.9508 TPR@1%FPR=0.3894 +2026-05-07 08:00:55,487 INFO │ gpt3 AUROC=0.9512 TPR@1%FPR=0.3215 +2026-05-07 08:00:55,487 INFO │ gpt4 AUROC=0.9696 TPR@1%FPR=0.2309 +2026-05-07 08:00:55,487 INFO │ llama-chat AUROC=0.9538 TPR@1%FPR=0.2815 +2026-05-07 08:00:55,487 INFO │ mistral AUROC=0.9470 TPR@1%FPR=0.4098 +2026-05-07 08:00:55,487 INFO │ mistral-chat AUROC=0.9527 TPR@1%FPR=0.3630 +2026-05-07 08:00:55,487 INFO │ mpt AUROC=0.9447 TPR@1%FPR=0.3328 +2026-05-07 08:00:55,487 INFO │ mpt-chat AUROC=0.9660 TPR@1%FPR=0.3603 +2026-05-07 08:00:55,487 INFO │ (prev best) 0.9782 +2026-05-07 08:00:55,487 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.3331 +2026-05-07 08:00:55,487 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 08:00:55,487 INFO │ alternative_spelling 0.9596 ~ +2026-05-07 08:00:55,487 INFO │ article_deletion 0.9652 ~ +2026-05-07 08:00:55,487 INFO │ homoglyphs 0.9674 ~ +2026-05-07 08:00:55,487 INFO │ insert_paragraphs 0.9617 ~ +2026-05-07 08:00:55,487 INFO │ misspelling 0.9636 ~ +2026-05-07 08:00:55,487 INFO │ no_attack 0.9601 ~ +2026-05-07 08:00:55,487 INFO │ number_swap 0.9615 ~ +2026-05-07 08:00:55,487 INFO │ synonym_replacement 0.9687 ~ +2026-05-07 08:00:55,487 INFO │ t5_paraphrase 0.9200 ~ +2026-05-07 08:00:55,487 INFO │ upper_lower_swap 0.9615 ~ +2026-05-07 08:00:55,487 INFO │ whitespace_addition 0.9690 ~ +2026-05-07 08:00:55,487 INFO │ zero_width_space 0.9645 ~ +2026-05-07 08:00:55,487 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 08:11:02,713 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 08:11:02,713 INFO │ abstracts AUROC=0.9995 TPR@1%FPR=0.9948 (h= 167 a= 2099) +2026-05-07 08:11:02,713 INFO │ books AUROC=0.9500 TPR@1%FPR=0.2039 (h= 172 a= 2011) +2026-05-07 08:11:02,713 INFO │ code AUROC=0.9172 TPR@1%FPR=0.0946 (h= 79 a= 666) +2026-05-07 08:11:02,713 INFO │ czech AUROC=0.9131 TPR@1%FPR=0.0404 (h= 183 a= 2230) +2026-05-07 08:11:02,713 INFO │ german AUROC=0.9431 TPR@1%FPR=0.1763 (h= 193 a= 2207) +2026-05-07 08:11:02,713 INFO │ news AUROC=0.9811 TPR@1%FPR=0.8967 (h= 200 a= 1994) +2026-05-07 08:11:02,713 INFO │ poetry AUROC=0.9834 TPR@1%FPR=0.5697 (h= 180 a= 2036) +2026-05-07 08:11:02,713 INFO │ recipes AUROC=0.9880 TPR@1%FPR=0.8751 (h= 183 a= 2081) +2026-05-07 08:11:02,713 INFO │ reddit AUROC=0.9716 TPR@1%FPR=0.6256 (h= 191 a= 2118) +2026-05-07 08:11:02,713 INFO │ reviews AUROC=0.9623 TPR@1%FPR=0.0978 (h= 88 a= 1155) +2026-05-07 08:11:02,714 INFO │ wiki AUROC=0.9256 TPR@1%FPR=0.2772 (h= 169 a= 2071) +2026-05-07 08:11:02,714 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 08:11:02,714 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 08:11:02,714 INFO │ alternative_spelling AUROC=0.9785 TPR@1%FPR=0.3873 (n= 1100) +2026-05-07 08:11:02,714 INFO │ article_deletion AUROC=0.9791 TPR@1%FPR=0.3718 (n= 1100) +2026-05-07 08:11:02,714 INFO │ homoglyph AUROC=0.9695 TPR@1%FPR=0.1427 (n= 1100) +2026-05-07 08:11:02,714 INFO │ insert_paragraphs AUROC=0.9792 TPR@1%FPR=0.2536 (n= 1100) +2026-05-07 08:11:02,714 INFO │ none AUROC=0.9812 TPR@1%FPR=0.3496 (n= 8568) +2026-05-07 08:11:02,714 INFO │ number AUROC=0.9800 TPR@1%FPR=0.4145 (n= 1100) +2026-05-07 08:11:02,714 INFO │ paraphrase AUROC=0.9055 TPR@1%FPR=0.1745 (n= 1100) +2026-05-07 08:11:02,714 INFO │ perplexity_misspelling AUROC=0.9804 TPR@1%FPR=0.3591 (n= 1100) +2026-05-07 08:11:02,714 INFO │ synonym AUROC=0.9727 TPR@1%FPR=0.3391 (n= 1100) +2026-05-07 08:11:02,714 INFO │ upper_lower AUROC=0.9802 TPR@1%FPR=0.4609 (n= 1100) +2026-05-07 08:11:02,714 INFO │ whitespace AUROC=0.9867 TPR@1%FPR=0.6318 (n= 1100) +2026-05-07 08:11:02,714 INFO │ zero_width_space AUROC=0.6343 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 08:11:02,714 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 08:11:02,714 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 08:11:02,714 INFO │ gpt4 AUROC=0.9696 TPR@1%FPR=0.2309 +2026-05-07 08:11:02,714 INFO │ cohere-chat AUROC=0.9663 TPR@1%FPR=0.3451 +2026-05-07 08:11:02,714 INFO │ mpt-chat AUROC=0.9660 TPR@1%FPR=0.3603 +2026-05-07 08:11:02,714 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 08:11:02,714 INFO [HardNeg] weights (high=more samples): llama-chat=1.181 cohere=1.084 gpt3=1.074 mpt=1.045 mistral-chat=0.970 ... (range: 0.859–1.181) +2026-05-07 08:11:02,714 INFO [Worst-gen] gpt4 TPR@1%FPR=0.2309 +2026-05-07 08:11:02,714 INFO No improvement (5/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9546 cur_TPR@1%FPR=0.3331 worst-gen=0.2309 [gpt4] + +2026-05-07 08:12:20,473 INFO [Step 176/200] det=8.8789 para=-0.0740 hum=-0.0000 raw_rwd=0.7763±0.0675 rwd=0.7763 hum_rwd=0.2179±0.0126 (raw=0.2179) +2026-05-07 08:12:20,473 INFO loss components: L_human=0.170 L_aux_xh=0.056 L_xm_original=0.454 L_aux_xm=2.037 L_t5_para=1.349 L_xh_humanized=0.259 L_aux_hum=0.019 L_synonym_replacement=0.483 L_homoglyphs=0.426 L_article_deletion=0.709 L_misspelling=0.430 L_number_swap=0.434 L_whitespace_addition=0.430 L_upper_lower_swap=0.426 L_zero_width_space=0.425 L_insert_paragraphs=0.791 L_alternative_spelling=0.457 total=9.356 +2026-05-07 08:12:20,473 INFO per-gen rewards: chatgpt=0.786 cohere=0.784 gpt2=0.784 gpt3=0.780 llama-ch=0.788 mistral=0.789 mistral-=0.712 mpt=0.787 +2026-05-07 08:12:49,526 INFO [Step 177/200] det=skip para=-0.0000 hum=-0.0009 raw_rwd=0.8029±0.0115 rwd=0.8029 hum_rwd=0.2012±0.0111 (raw=0.2012) +2026-05-07 08:12:49,527 INFO per-gen rewards: chatgpt=0.798 cohere=0.810 gpt2=0.800 gpt3=0.802 llama-ch=0.804 mistral=0.807 mistral-=0.802 mpt=0.800 +2026-05-07 08:14:08,741 INFO [Step 178/200] det=9.3453 para=0.0000 hum=-0.0000 raw_rwd=0.8027±0.0101 rwd=0.8027 hum_rwd=0.1970±0.0117 (raw=0.1970) +2026-05-07 08:14:08,741 INFO loss components: L_human=0.102 L_aux_xh=0.039 L_xm_original=0.438 L_aux_xm=2.023 L_t5_para=1.253 L_xh_humanized=0.303 L_aux_hum=0.020 L_synonym_replacement=0.432 L_homoglyphs=0.432 L_article_deletion=0.449 L_misspelling=0.436 L_number_swap=0.433 L_whitespace_addition=0.470 L_upper_lower_swap=0.428 L_zero_width_space=0.425 L_insert_paragraphs=0.455 L_alternative_spelling=0.436 total=8.574 +2026-05-07 08:14:08,741 INFO per-gen rewards: chatgpt=0.807 cohere=0.803 gpt2=0.797 gpt3=0.798 llama-ch=0.807 mistral=0.803 mistral-=0.806 mpt=0.801 +2026-05-07 08:14:37,655 INFO [Step 179/200] det=skip para=0.0000 hum=0.0000 raw_rwd=0.7620±0.0129 rwd=0.7620 hum_rwd=0.2358±0.0133 (raw=0.2358) +2026-05-07 08:14:37,655 INFO per-gen rewards: chatgpt=0.764 cohere=0.760 gpt2=0.763 gpt3=0.761 llama-ch=0.760 mistral=0.759 mistral-=0.759 mpt=0.771 +2026-05-07 08:15:56,074 INFO [Step 180/200] det=9.2598 para=0.0256 hum=0.0721 raw_rwd=0.7661±0.0156 rwd=0.7661 hum_rwd=0.2482±0.0738 (raw=0.2482) +2026-05-07 08:15:56,074 INFO loss components: L_human=0.161 L_aux_xh=0.099 L_xm_original=0.433 L_aux_xm=2.035 L_t5_para=1.345 L_xh_humanized=0.290 L_aux_hum=0.021 L_synonym_replacement=0.426 L_homoglyphs=0.427 L_article_deletion=0.435 L_misspelling=0.432 L_number_swap=0.444 L_whitespace_addition=0.538 L_upper_lower_swap=0.431 L_zero_width_space=0.429 L_insert_paragraphs=0.665 L_alternative_spelling=0.428 total=9.038 +2026-05-07 08:15:56,074 INFO per-gen rewards: chatgpt=0.756 cohere=0.766 gpt2=0.774 gpt3=0.764 llama-ch=0.762 mistral=0.768 mistral-=0.770 mpt=0.770 +2026-05-07 09:17:30,687 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 09:17:30,697 INFO │ MACRO_AVG AUROC=0.9531 TPR@1%FPR=0.3768 ◄ +2026-05-07 09:17:30,697 INFO │ chatgpt AUROC=0.9553 TPR@1%FPR=0.4242 +2026-05-07 09:17:30,697 INFO │ cohere AUROC=0.9423 TPR@1%FPR=0.3472 +2026-05-07 09:17:30,697 INFO │ cohere-chat AUROC=0.9663 TPR@1%FPR=0.3880 +2026-05-07 09:17:30,697 INFO │ gpt2 AUROC=0.9486 TPR@1%FPR=0.4174 +2026-05-07 09:17:30,697 INFO │ gpt3 AUROC=0.9505 TPR@1%FPR=0.3796 +2026-05-07 09:17:30,697 INFO │ gpt4 AUROC=0.9652 TPR@1%FPR=0.2288 +2026-05-07 09:17:30,697 INFO │ llama-chat AUROC=0.9522 TPR@1%FPR=0.3109 +2026-05-07 09:17:30,697 INFO │ mistral AUROC=0.9469 TPR@1%FPR=0.4506 +2026-05-07 09:17:30,697 INFO │ mistral-chat AUROC=0.9506 TPR@1%FPR=0.4023 +2026-05-07 09:17:30,697 INFO │ mpt AUROC=0.9435 TPR@1%FPR=0.3804 +2026-05-07 09:17:30,697 INFO │ mpt-chat AUROC=0.9623 TPR@1%FPR=0.4154 +2026-05-07 09:17:30,697 INFO │ (prev best) 0.9782 +2026-05-07 09:17:30,697 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.3631 +2026-05-07 09:17:30,697 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 09:17:30,697 INFO │ alternative_spelling 0.9582 ~ +2026-05-07 09:17:30,697 INFO │ article_deletion 0.9638 ~ +2026-05-07 09:17:30,697 INFO │ homoglyphs 0.9664 ~ +2026-05-07 09:17:30,697 INFO │ insert_paragraphs 0.9613 ~ +2026-05-07 09:17:30,697 INFO │ misspelling 0.9636 ~ +2026-05-07 09:17:30,697 INFO │ no_attack 0.9587 ~ +2026-05-07 09:17:30,697 INFO │ number_swap 0.9604 ~ +2026-05-07 09:17:30,697 INFO │ synonym_replacement 0.9659 ~ +2026-05-07 09:17:30,697 INFO │ t5_paraphrase 0.8600 ▼ +2026-05-07 09:17:30,697 INFO │ upper_lower_swap 0.9621 ~ +2026-05-07 09:17:30,697 INFO │ whitespace_addition 0.9678 ~ +2026-05-07 09:17:30,697 INFO │ zero_width_space 0.9627 ~ +2026-05-07 09:17:30,697 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 09:27:38,325 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 09:27:38,326 INFO │ abstracts AUROC=0.9987 TPR@1%FPR=0.9362 (h= 167 a= 2099) +2026-05-07 09:27:38,326 INFO │ books AUROC=0.9277 TPR@1%FPR=0.0726 (h= 172 a= 2011) +2026-05-07 09:27:38,326 INFO │ code AUROC=0.9148 TPR@1%FPR=0.1637 (h= 79 a= 666) +2026-05-07 09:27:38,326 INFO │ czech AUROC=0.9311 TPR@1%FPR=0.0834 (h= 183 a= 2230) +2026-05-07 09:27:38,326 INFO │ german AUROC=0.9806 TPR@1%FPR=0.6656 (h= 193 a= 2207) +2026-05-07 09:27:38,326 INFO │ news AUROC=0.9791 TPR@1%FPR=0.8049 (h= 200 a= 1994) +2026-05-07 09:27:38,326 INFO │ poetry AUROC=0.9803 TPR@1%FPR=0.5447 (h= 180 a= 2036) +2026-05-07 09:27:38,326 INFO │ recipes AUROC=0.9825 TPR@1%FPR=0.5925 (h= 183 a= 2081) +2026-05-07 09:27:38,326 INFO │ reddit AUROC=0.9538 TPR@1%FPR=0.3418 (h= 191 a= 2118) +2026-05-07 09:27:38,326 INFO │ reviews AUROC=0.9495 TPR@1%FPR=0.0078 (h= 88 a= 1155) +2026-05-07 09:27:38,326 INFO │ wiki AUROC=0.9130 TPR@1%FPR=0.1733 (h= 169 a= 2071) +2026-05-07 09:27:38,326 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 09:27:38,326 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 09:27:38,326 INFO │ alternative_spelling AUROC=0.9757 TPR@1%FPR=0.4127 (n= 1100) +2026-05-07 09:27:38,326 INFO │ article_deletion AUROC=0.9758 TPR@1%FPR=0.3836 (n= 1100) +2026-05-07 09:27:38,326 INFO │ homoglyph AUROC=0.9561 TPR@1%FPR=0.1418 (n= 1100) +2026-05-07 09:27:38,326 INFO │ insert_paragraphs AUROC=0.9755 TPR@1%FPR=0.2827 (n= 1100) +2026-05-07 09:27:38,326 INFO │ none AUROC=0.9794 TPR@1%FPR=0.3853 (n= 8568) +2026-05-07 09:27:38,326 INFO │ number AUROC=0.9767 TPR@1%FPR=0.4264 (n= 1100) +2026-05-07 09:27:38,326 INFO │ paraphrase AUROC=0.9227 TPR@1%FPR=0.2918 (n= 1100) +2026-05-07 09:27:38,326 INFO │ perplexity_misspelling AUROC=0.9769 TPR@1%FPR=0.3955 (n= 1100) +2026-05-07 09:27:38,326 INFO │ synonym AUROC=0.9700 TPR@1%FPR=0.3573 (n= 1100) +2026-05-07 09:27:38,326 INFO │ upper_lower AUROC=0.9768 TPR@1%FPR=0.4664 (n= 1100) +2026-05-07 09:27:38,326 INFO │ whitespace AUROC=0.9853 TPR@1%FPR=0.6627 (n= 1100) +2026-05-07 09:27:38,326 INFO │ zero_width_space AUROC=0.6515 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 09:27:38,326 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 09:27:38,326 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 09:27:38,326 INFO │ gpt4 AUROC=0.9652 TPR@1%FPR=0.2288 +2026-05-07 09:27:38,326 INFO │ cohere-chat AUROC=0.9663 TPR@1%FPR=0.3880 +2026-05-07 09:27:38,326 INFO │ mpt-chat AUROC=0.9623 TPR@1%FPR=0.4154 +2026-05-07 09:27:38,326 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 09:27:38,327 INFO [HardNeg] weights (high=more samples): llama-chat=1.210 cohere=1.108 gpt3=1.021 mpt=1.019 mistral-chat=0.963 ... (range: 0.846–1.210) +2026-05-07 09:27:38,327 INFO [Worst-gen] gpt4 TPR@1%FPR=0.2288 +2026-05-07 09:27:38,327 INFO No improvement (6/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9531 cur_TPR@1%FPR=0.3631 worst-gen=0.2288 [gpt4] + +2026-05-07 09:28:07,531 INFO [Step 181/200] det=skip para=-0.0000 hum=0.0000 raw_rwd=0.7745±0.0080 rwd=0.7745 hum_rwd=0.2275±0.0125 (raw=0.2275) +2026-05-07 09:28:07,531 INFO per-gen rewards: chatgpt=0.775 cohere=0.774 gpt2=0.775 gpt3=0.775 llama-ch=0.777 mistral=0.774 mistral-=0.775 mpt=0.770 +2026-05-07 09:29:26,797 INFO [Step 182/200] det=9.0120 para=-0.0000 hum=-0.0000 raw_rwd=0.7726±0.0110 rwd=0.7726 hum_rwd=0.2280±0.0116 (raw=0.2280) +2026-05-07 09:29:26,797 INFO loss components: L_human=0.133 L_aux_xh=0.081 L_xm_original=0.677 L_aux_xm=2.339 L_t5_para=1.244 L_xh_humanized=0.307 L_aux_hum=0.022 L_synonym_replacement=0.431 L_homoglyphs=0.435 L_article_deletion=0.460 L_misspelling=0.527 L_number_swap=0.447 L_whitespace_addition=0.576 L_upper_lower_swap=0.427 L_zero_width_space=0.434 L_insert_paragraphs=0.468 L_alternative_spelling=0.562 total=9.570 +2026-05-07 09:29:26,797 INFO per-gen rewards: chatgpt=0.773 cohere=0.776 gpt2=0.782 gpt3=0.772 llama-ch=0.770 mistral=0.770 mistral-=0.765 mpt=0.773 +2026-05-07 09:29:55,845 INFO [Step 183/200] det=skip para=-0.0000 hum=0.0000 raw_rwd=0.7900±0.0113 rwd=0.7900 hum_rwd=0.2101±0.0106 (raw=0.2101) +2026-05-07 09:29:55,845 INFO per-gen rewards: chatgpt=0.787 cohere=0.793 gpt2=0.790 gpt3=0.788 llama-ch=0.792 mistral=0.783 mistral-=0.795 mpt=0.789 +2026-05-07 09:31:14,215 INFO [Step 184/200] det=9.2026 para=0.0000 hum=0.0000 raw_rwd=0.7901±0.0123 rwd=0.7901 hum_rwd=0.2089±0.0119 (raw=0.2089) +2026-05-07 09:31:14,216 INFO loss components: L_human=0.102 L_aux_xh=0.034 L_xm_original=0.512 L_aux_xm=2.149 L_t5_para=1.367 L_xh_humanized=0.293 L_aux_hum=0.020 L_synonym_replacement=0.441 L_homoglyphs=0.442 L_article_deletion=0.450 L_misspelling=0.447 L_number_swap=0.492 L_whitespace_addition=0.457 L_upper_lower_swap=0.481 L_zero_width_space=0.433 L_insert_paragraphs=0.582 L_alternative_spelling=0.504 total=9.205 +2026-05-07 09:31:14,216 INFO per-gen rewards: chatgpt=0.788 cohere=0.789 gpt2=0.795 gpt3=0.788 llama-ch=0.788 mistral=0.793 mistral-=0.795 mpt=0.786 +2026-05-07 09:31:42,978 INFO [Step 185/200] det=skip para=-0.0000 hum=-0.0000 raw_rwd=0.7791±0.0117 rwd=0.7791 hum_rwd=0.2205±0.0116 (raw=0.2205) +2026-05-07 09:31:42,978 INFO per-gen rewards: chatgpt=0.779 cohere=0.779 gpt2=0.783 gpt3=0.773 llama-ch=0.780 mistral=0.780 mistral-=0.778 mpt=0.781 +2026-05-07 10:33:37,246 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 10:33:37,258 INFO │ MACRO_AVG AUROC=0.9671 TPR@1%FPR=0.6382 ◄ +2026-05-07 10:33:37,258 INFO │ chatgpt AUROC=0.9717 TPR@1%FPR=0.7185 +2026-05-07 10:33:37,258 INFO │ cohere AUROC=0.9550 TPR@1%FPR=0.5842 +2026-05-07 10:33:37,258 INFO │ cohere-chat AUROC=0.9762 TPR@1%FPR=0.7023 +2026-05-07 10:33:37,258 INFO │ gpt2 AUROC=0.9623 TPR@1%FPR=0.5887 +2026-05-07 10:33:37,258 INFO │ gpt3 AUROC=0.9667 TPR@1%FPR=0.6158 +2026-05-07 10:33:37,258 INFO │ gpt4 AUROC=0.9818 TPR@1%FPR=0.7125 +2026-05-07 10:33:37,258 INFO │ llama-chat AUROC=0.9702 TPR@1%FPR=0.7208 +2026-05-07 10:33:37,258 INFO │ mistral AUROC=0.9571 TPR@1%FPR=0.5728 +2026-05-07 10:33:37,258 INFO │ mistral-chat AUROC=0.9675 TPR@1%FPR=0.6928 +2026-05-07 10:33:37,258 INFO │ mpt AUROC=0.9561 TPR@1%FPR=0.4702 +2026-05-07 10:33:37,258 INFO │ mpt-chat AUROC=0.9737 TPR@1%FPR=0.6415 +2026-05-07 10:33:37,258 INFO │ (prev best) 0.9782 +2026-05-07 10:33:37,258 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.6511 +2026-05-07 10:33:37,258 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 10:33:37,258 INFO │ alternative_spelling 0.9726 ~ +2026-05-07 10:33:37,258 INFO │ article_deletion 0.9764 ~ +2026-05-07 10:33:37,258 INFO │ homoglyphs 0.9800 ~ +2026-05-07 10:33:37,258 INFO │ insert_paragraphs 0.9728 ~ +2026-05-07 10:33:37,258 INFO │ misspelling 0.9774 ~ +2026-05-07 10:33:37,258 INFO │ no_attack 0.9729 ~ +2026-05-07 10:33:37,258 INFO │ number_swap 0.9742 ~ +2026-05-07 10:33:37,258 INFO │ synonym_replacement 0.9774 ~ +2026-05-07 10:33:37,258 INFO │ t5_paraphrase 0.9600 ~ +2026-05-07 10:33:37,258 INFO │ upper_lower_swap 0.9761 ~ +2026-05-07 10:33:37,258 INFO │ whitespace_addition 0.9784 ~ +2026-05-07 10:33:37,258 INFO │ zero_width_space 0.9763 ~ +2026-05-07 10:33:37,258 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 10:43:45,088 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 10:43:45,088 INFO │ abstracts AUROC=0.9995 TPR@1%FPR=0.9905 (h= 167 a= 2099) +2026-05-07 10:43:45,088 INFO │ books AUROC=0.9782 TPR@1%FPR=0.7374 (h= 172 a= 2011) +2026-05-07 10:43:45,088 INFO │ code AUROC=0.9186 TPR@1%FPR=0.1967 (h= 79 a= 666) +2026-05-07 10:43:45,088 INFO │ czech AUROC=0.9184 TPR@1%FPR=0.1251 (h= 183 a= 2230) +2026-05-07 10:43:45,088 INFO │ german AUROC=0.9718 TPR@1%FPR=0.3820 (h= 193 a= 2207) +2026-05-07 10:43:45,088 INFO │ news AUROC=0.9875 TPR@1%FPR=0.8842 (h= 200 a= 1994) +2026-05-07 10:43:45,088 INFO │ poetry AUROC=0.9885 TPR@1%FPR=0.8757 (h= 180 a= 2036) +2026-05-07 10:43:45,088 INFO │ recipes AUROC=0.9933 TPR@1%FPR=0.8635 (h= 183 a= 2081) +2026-05-07 10:43:45,088 INFO │ reddit AUROC=0.9813 TPR@1%FPR=0.4887 (h= 191 a= 2118) +2026-05-07 10:43:45,088 INFO │ reviews AUROC=0.9731 TPR@1%FPR=0.3887 (h= 88 a= 1155) +2026-05-07 10:43:45,088 INFO │ wiki AUROC=0.9520 TPR@1%FPR=0.6639 (h= 169 a= 2071) +2026-05-07 10:43:45,088 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 10:43:45,088 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 10:43:45,088 INFO │ alternative_spelling AUROC=0.9863 TPR@1%FPR=0.7255 (n= 1100) +2026-05-07 10:43:45,088 INFO │ article_deletion AUROC=0.9867 TPR@1%FPR=0.7491 (n= 1100) +2026-05-07 10:43:45,088 INFO │ homoglyph AUROC=0.9796 TPR@1%FPR=0.3245 (n= 1100) +2026-05-07 10:43:45,088 INFO │ insert_paragraphs AUROC=0.9872 TPR@1%FPR=0.6764 (n= 1100) +2026-05-07 10:43:45,088 INFO │ none AUROC=0.9870 TPR@1%FPR=0.7509 (n= 8568) +2026-05-07 10:43:45,088 INFO │ number AUROC=0.9867 TPR@1%FPR=0.7527 (n= 1100) +2026-05-07 10:43:45,088 INFO │ paraphrase AUROC=0.9015 TPR@1%FPR=0.2600 (n= 1100) +2026-05-07 10:43:45,088 INFO │ perplexity_misspelling AUROC=0.9874 TPR@1%FPR=0.7145 (n= 1100) +2026-05-07 10:43:45,088 INFO │ synonym AUROC=0.9790 TPR@1%FPR=0.6582 (n= 1100) +2026-05-07 10:43:45,088 INFO │ upper_lower AUROC=0.9851 TPR@1%FPR=0.7355 (n= 1100) +2026-05-07 10:43:45,088 INFO │ whitespace AUROC=0.9901 TPR@1%FPR=0.7873 (n= 1100) +2026-05-07 10:43:45,088 INFO │ zero_width_space AUROC=0.7508 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 10:43:45,088 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 10:43:45,088 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 10:43:45,089 INFO │ gpt4 AUROC=0.9818 TPR@1%FPR=0.7125 +2026-05-07 10:43:45,089 INFO │ cohere-chat AUROC=0.9762 TPR@1%FPR=0.7023 +2026-05-07 10:43:45,089 INFO │ mpt-chat AUROC=0.9737 TPR@1%FPR=0.6415 +2026-05-07 10:43:45,089 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 10:43:45,089 INFO [HardNeg] weights (high=more samples): mpt=1.519 mistral=1.127 cohere=1.089 gpt2=1.074 gpt3=0.988 ... (range: 0.710–1.519) +2026-05-07 10:43:45,089 INFO [Worst-gen] mpt TPR@1%FPR=0.4702 +2026-05-07 10:43:45,089 INFO No improvement (7/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9671 cur_TPR@1%FPR=0.6511 worst-gen=0.4702 [mpt] + +2026-05-07 10:45:06,000 INFO [Step 186/200] det=8.9882 para=0.0000 hum=-0.0006 raw_rwd=0.7799±0.0128 rwd=0.7799 hum_rwd=0.2191±0.0130 (raw=0.2191) +2026-05-07 10:45:06,001 INFO loss components: L_human=0.281 L_aux_xh=0.254 L_xm_original=0.433 L_aux_xm=1.967 L_t5_para=1.285 L_xh_humanized=0.280 L_aux_hum=0.019 L_synonym_replacement=0.434 L_homoglyphs=0.429 L_article_deletion=0.593 L_misspelling=0.432 L_number_swap=0.428 L_whitespace_addition=0.427 L_upper_lower_swap=0.427 L_zero_width_space=0.428 L_insert_paragraphs=0.426 L_alternative_spelling=0.439 total=8.984 +2026-05-07 10:45:06,001 INFO per-gen rewards: chatgpt=0.786 cohere=0.775 gpt2=0.777 gpt3=0.784 llama-ch=0.775 mistral=0.779 mistral-=0.788 mpt=0.779 +2026-05-07 10:45:35,135 INFO [Step 187/200] det=skip para=0.0037 hum=0.0000 raw_rwd=0.7671±0.0131 rwd=0.7671 hum_rwd=0.2332±0.0136 (raw=0.2332) +2026-05-07 10:45:35,136 INFO per-gen rewards: chatgpt=0.764 cohere=0.767 gpt2=0.763 gpt3=0.764 llama-ch=0.778 mistral=0.767 mistral-=0.770 mpt=0.767 +2026-05-07 10:47:05,571 INFO [Step 188/200] det=8.8602 para=0.0006 hum=-0.0000 raw_rwd=0.7697±0.0135 rwd=0.7697 hum_rwd=0.2315±0.0167 (raw=0.2315) +2026-05-07 10:47:05,573 INFO loss components: L_human=0.238 L_aux_xh=0.080 L_xm_original=0.443 L_aux_xm=2.133 L_t5_para=1.301 L_xh_humanized=0.262 L_aux_hum=0.017 L_synonym_replacement=0.434 L_homoglyphs=0.427 L_article_deletion=0.428 L_misspelling=0.425 L_number_swap=0.452 L_whitespace_addition=0.432 L_upper_lower_swap=0.425 L_zero_width_space=0.432 L_insert_paragraphs=0.431 L_alternative_spelling=0.435 total=8.795 +2026-05-07 10:47:05,573 INFO per-gen rewards: chatgpt=0.770 cohere=0.769 gpt2=0.769 gpt3=0.771 llama-ch=0.778 mistral=0.769 mistral-=0.767 mpt=0.769 +2026-05-07 10:47:39,448 INFO [Step 189/200] det=skip para=0.0215 hum=0.0000 raw_rwd=0.7846±0.0162 rwd=0.7846 hum_rwd=0.2144±0.0119 (raw=0.2144) +2026-05-07 10:47:39,448 INFO per-gen rewards: chatgpt=0.777 cohere=0.781 gpt2=0.786 gpt3=0.797 llama-ch=0.784 mistral=0.781 mistral-=0.785 mpt=0.784 +2026-05-07 10:49:10,388 INFO [Step 190/200] det=8.9614 para=0.0000 hum=-0.0050 raw_rwd=0.7857±0.0134 rwd=0.7857 hum_rwd=0.2151±0.0112 (raw=0.2151) +2026-05-07 10:49:10,388 INFO loss components: L_human=0.189 L_aux_xh=0.064 L_xm_original=0.471 L_aux_xm=2.258 L_t5_para=1.374 L_xh_humanized=0.281 L_aux_hum=0.018 L_synonym_replacement=0.431 L_homoglyphs=0.424 L_article_deletion=0.431 L_misspelling=0.426 L_number_swap=0.459 L_whitespace_addition=0.439 L_upper_lower_swap=0.426 L_zero_width_space=0.424 L_insert_paragraphs=0.449 L_alternative_spelling=0.489 total=9.054 +2026-05-07 10:49:10,388 INFO per-gen rewards: chatgpt=0.788 cohere=0.790 gpt2=0.778 gpt3=0.785 llama-ch=0.787 mistral=0.784 mistral-=0.781 mpt=0.791 +2026-05-07 11:50:47,693 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 11:50:47,694 INFO │ MACRO_AVG AUROC=0.9722 TPR@1%FPR=0.7409 ◄ +2026-05-07 11:50:47,703 INFO │ chatgpt AUROC=0.9753 TPR@1%FPR=0.7713 +2026-05-07 11:50:47,703 INFO │ cohere AUROC=0.9633 TPR@1%FPR=0.7245 +2026-05-07 11:50:47,703 INFO │ cohere-chat AUROC=0.9817 TPR@1%FPR=0.7869 +2026-05-07 11:50:47,703 INFO │ gpt2 AUROC=0.9688 TPR@1%FPR=0.7072 +2026-05-07 11:50:47,703 INFO │ gpt3 AUROC=0.9701 TPR@1%FPR=0.7358 +2026-05-07 11:50:47,703 INFO │ gpt4 AUROC=0.9840 TPR@1%FPR=0.8045 +2026-05-07 11:50:47,703 INFO │ llama-chat AUROC=0.9745 TPR@1%FPR=0.8121 +2026-05-07 11:50:47,703 INFO │ mistral AUROC=0.9652 TPR@1%FPR=0.6996 +2026-05-07 11:50:47,703 INFO │ mistral-chat AUROC=0.9706 TPR@1%FPR=0.7751 +2026-05-07 11:50:47,703 INFO │ mpt AUROC=0.9650 TPR@1%FPR=0.6196 +2026-05-07 11:50:47,703 INFO │ mpt-chat AUROC=0.9758 TPR@1%FPR=0.7128 +2026-05-07 11:50:47,703 INFO │ (prev best) 0.9782 +2026-05-07 11:50:47,703 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.7280 +2026-05-07 11:50:47,703 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 11:50:47,703 INFO │ alternative_spelling 0.9774 ~ +2026-05-07 11:50:47,703 INFO │ article_deletion 0.9797 ~ +2026-05-07 11:50:47,703 INFO │ homoglyphs 0.9856 ~ +2026-05-07 11:50:47,703 INFO │ insert_paragraphs 0.9777 ~ +2026-05-07 11:50:47,703 INFO │ misspelling 0.9814 ~ +2026-05-07 11:50:47,703 INFO │ no_attack 0.9775 ~ +2026-05-07 11:50:47,703 INFO │ number_swap 0.9782 ~ +2026-05-07 11:50:47,703 INFO │ synonym_replacement 0.9823 ~ +2026-05-07 11:50:47,703 INFO │ t5_paraphrase 0.9600 ~ +2026-05-07 11:50:47,703 INFO │ upper_lower_swap 0.9831 ~ +2026-05-07 11:50:47,703 INFO │ whitespace_addition 0.9825 ~ +2026-05-07 11:50:47,703 INFO │ zero_width_space 0.9842 ~ +2026-05-07 11:50:47,703 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 12:00:55,096 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 12:00:55,097 INFO │ abstracts AUROC=0.9987 TPR@1%FPR=0.9366 (h= 167 a= 2099) +2026-05-07 12:00:55,097 INFO │ books AUROC=0.9756 TPR@1%FPR=0.7121 (h= 172 a= 2011) +2026-05-07 12:00:55,097 INFO │ code AUROC=0.9282 TPR@1%FPR=0.2417 (h= 79 a= 666) +2026-05-07 12:00:55,097 INFO │ czech AUROC=0.9563 TPR@1%FPR=0.3507 (h= 183 a= 2230) +2026-05-07 12:00:55,097 INFO │ german AUROC=0.9916 TPR@1%FPR=0.8922 (h= 193 a= 2207) +2026-05-07 12:00:55,097 INFO │ news AUROC=0.9885 TPR@1%FPR=0.9042 (h= 200 a= 1994) +2026-05-07 12:00:55,097 INFO │ poetry AUROC=0.9852 TPR@1%FPR=0.8551 (h= 180 a= 2036) +2026-05-07 12:00:55,097 INFO │ recipes AUROC=0.9902 TPR@1%FPR=0.8602 (h= 183 a= 2081) +2026-05-07 12:00:55,097 INFO │ reddit AUROC=0.9825 TPR@1%FPR=0.7715 (h= 191 a= 2118) +2026-05-07 12:00:55,097 INFO │ reviews AUROC=0.9768 TPR@1%FPR=0.6909 (h= 88 a= 1155) +2026-05-07 12:00:55,097 INFO │ wiki AUROC=0.9512 TPR@1%FPR=0.5992 (h= 169 a= 2071) +2026-05-07 12:00:55,097 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 12:00:55,097 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 12:00:55,097 INFO │ alternative_spelling AUROC=0.9896 TPR@1%FPR=0.8055 (n= 1100) +2026-05-07 12:00:55,097 INFO │ article_deletion AUROC=0.9904 TPR@1%FPR=0.8318 (n= 1100) +2026-05-07 12:00:55,097 INFO │ homoglyph AUROC=0.9875 TPR@1%FPR=0.3773 (n= 1100) +2026-05-07 12:00:55,097 INFO │ insert_paragraphs AUROC=0.9901 TPR@1%FPR=0.8082 (n= 1100) +2026-05-07 12:00:55,097 INFO │ none AUROC=0.9897 TPR@1%FPR=0.8284 (n= 8568) +2026-05-07 12:00:55,097 INFO │ number AUROC=0.9901 TPR@1%FPR=0.8136 (n= 1100) +2026-05-07 12:00:55,097 INFO │ paraphrase AUROC=0.9223 TPR@1%FPR=0.3309 (n= 1100) +2026-05-07 12:00:55,097 INFO │ perplexity_misspelling AUROC=0.9915 TPR@1%FPR=0.8100 (n= 1100) +2026-05-07 12:00:55,097 INFO │ synonym AUROC=0.9844 TPR@1%FPR=0.7609 (n= 1100) +2026-05-07 12:00:55,097 INFO │ upper_lower AUROC=0.9874 TPR@1%FPR=0.8082 (n= 1100) +2026-05-07 12:00:55,097 INFO │ whitespace AUROC=0.9944 TPR@1%FPR=0.8791 (n= 1100) +2026-05-07 12:00:55,097 INFO │ zero_width_space AUROC=0.7729 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 12:00:55,097 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 12:00:55,098 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 12:00:55,098 INFO │ gpt4 AUROC=0.9840 TPR@1%FPR=0.8045 +2026-05-07 12:00:55,098 INFO │ cohere-chat AUROC=0.9817 TPR@1%FPR=0.7869 +2026-05-07 12:00:55,098 INFO │ mpt-chat AUROC=0.9758 TPR@1%FPR=0.7128 +2026-05-07 12:00:55,098 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 12:00:55,098 INFO [HardNeg] weights (high=more samples): mpt=1.394 mistral=1.084 gpt2=1.058 cohere=1.002 gpt3=0.967 ... (range: 0.771–1.394) +2026-05-07 12:00:55,098 INFO [Worst-gen] mpt TPR@1%FPR=0.6196 +2026-05-07 12:00:55,098 INFO No improvement (8/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9722 cur_TPR@1%FPR=0.7280 worst-gen=0.6196 [mpt] + +2026-05-07 12:01:23,847 INFO [Step 191/200] det=skip para=0.0000 hum=-0.0000 raw_rwd=0.7866±0.0131 rwd=0.7866 hum_rwd=0.2129±0.0136 (raw=0.2129) +2026-05-07 12:01:23,847 INFO per-gen rewards: chatgpt=0.786 cohere=0.785 gpt2=0.785 gpt3=0.788 llama-ch=0.783 mistral=0.784 mistral-=0.786 mpt=0.792 +2026-05-07 12:02:42,954 INFO [Step 192/200] det=9.2067 para=-0.0000 hum=0.0000 raw_rwd=0.7892±0.0141 rwd=0.7892 hum_rwd=0.2102±0.0134 (raw=0.2102) +2026-05-07 12:02:42,954 INFO loss components: L_human=0.100 L_aux_xh=0.028 L_xm_original=0.426 L_aux_xm=2.009 L_t5_para=1.277 L_xh_humanized=0.312 L_aux_hum=0.019 L_synonym_replacement=0.428 L_homoglyphs=0.428 L_article_deletion=0.428 L_misspelling=0.431 L_number_swap=0.428 L_whitespace_addition=0.432 L_upper_lower_swap=0.432 L_zero_width_space=0.425 L_insert_paragraphs=0.425 L_alternative_spelling=0.430 total=8.459 +2026-05-07 12:02:42,954 INFO per-gen rewards: chatgpt=0.791 cohere=0.791 gpt2=0.790 gpt3=0.785 llama-ch=0.797 mistral=0.790 mistral-=0.788 mpt=0.785 +2026-05-07 12:03:11,667 INFO [Step 193/200] det=skip para=-0.0000 hum=-0.0000 raw_rwd=0.7837±0.0138 rwd=0.7837 hum_rwd=0.2184±0.0130 (raw=0.2184) +2026-05-07 12:03:11,667 INFO per-gen rewards: chatgpt=0.782 cohere=0.779 gpt2=0.780 gpt3=0.794 llama-ch=0.780 mistral=0.785 mistral-=0.785 mpt=0.783 +2026-05-07 12:04:30,310 INFO [Step 194/200] det=9.0935 para=-0.0000 hum=0.0000 raw_rwd=0.7799±0.0155 rwd=0.7799 hum_rwd=0.2155±0.0148 (raw=0.2155) +2026-05-07 12:04:30,310 INFO loss components: L_human=0.357 L_aux_xh=0.269 L_xm_original=0.433 L_aux_xm=2.089 L_t5_para=1.386 L_xh_humanized=0.245 L_aux_hum=0.019 L_synonym_replacement=0.426 L_homoglyphs=0.427 L_article_deletion=0.433 L_misspelling=0.456 L_number_swap=0.435 L_whitespace_addition=0.425 L_upper_lower_swap=0.439 L_zero_width_space=0.429 L_insert_paragraphs=0.449 L_alternative_spelling=0.438 total=9.154 +2026-05-07 12:04:30,310 INFO per-gen rewards: chatgpt=0.772 cohere=0.783 gpt2=0.783 gpt3=0.779 llama-ch=0.775 mistral=0.785 mistral-=0.779 mpt=0.780 +2026-05-07 12:04:59,124 INFO [Step 195/200] det=skip para=-0.0000 hum=0.0000 raw_rwd=0.7904±0.0112 rwd=0.7904 hum_rwd=0.2100±0.0121 (raw=0.2100) +2026-05-07 12:04:59,124 INFO per-gen rewards: chatgpt=0.790 cohere=0.791 gpt2=0.793 gpt3=0.794 llama-ch=0.792 mistral=0.788 mistral-=0.791 mpt=0.787 +2026-05-07 13:06:23,423 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 13:06:23,432 INFO │ MACRO_AVG AUROC=0.9684 TPR@1%FPR=0.6603 ◄ +2026-05-07 13:06:23,432 INFO │ chatgpt AUROC=0.9703 TPR@1%FPR=0.7275 +2026-05-07 13:06:23,432 INFO │ cohere AUROC=0.9594 TPR@1%FPR=0.6498 +2026-05-07 13:06:23,432 INFO │ cohere-chat AUROC=0.9783 TPR@1%FPR=0.6803 +2026-05-07 13:06:23,432 INFO │ gpt2 AUROC=0.9661 TPR@1%FPR=0.6702 +2026-05-07 13:06:23,432 INFO │ gpt3 AUROC=0.9656 TPR@1%FPR=0.6792 +2026-05-07 13:06:23,432 INFO │ gpt4 AUROC=0.9785 TPR@1%FPR=0.5521 +2026-05-07 13:06:23,432 INFO │ llama-chat AUROC=0.9697 TPR@1%FPR=0.7275 +2026-05-07 13:06:23,432 INFO │ mistral AUROC=0.9627 TPR@1%FPR=0.6453 +2026-05-07 13:06:23,432 INFO │ mistral-chat AUROC=0.9659 TPR@1%FPR=0.7072 +2026-05-07 13:06:23,433 INFO │ mpt AUROC=0.9625 TPR@1%FPR=0.5985 +2026-05-07 13:06:23,433 INFO │ mpt-chat AUROC=0.9732 TPR@1%FPR=0.6254 +2026-05-07 13:06:23,433 INFO │ (prev best) 0.9782 +2026-05-07 13:06:23,433 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.6130 +2026-05-07 13:06:23,433 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 13:06:23,433 INFO │ alternative_spelling 0.9733 ~ +2026-05-07 13:06:23,433 INFO │ article_deletion 0.9781 ~ +2026-05-07 13:06:23,433 INFO │ homoglyphs 0.9824 ~ +2026-05-07 13:06:23,433 INFO │ insert_paragraphs 0.9749 ~ +2026-05-07 13:06:23,433 INFO │ misspelling 0.9790 ~ +2026-05-07 13:06:23,433 INFO │ no_attack 0.9735 ~ +2026-05-07 13:06:23,433 INFO │ number_swap 0.9747 ~ +2026-05-07 13:06:23,433 INFO │ synonym_replacement 0.9807 ~ +2026-05-07 13:06:23,433 INFO │ t5_paraphrase 0.9600 ~ +2026-05-07 13:06:23,433 INFO │ upper_lower_swap 0.9794 ~ +2026-05-07 13:06:23,433 INFO │ whitespace_addition 0.9789 ~ +2026-05-07 13:06:23,433 INFO │ zero_width_space 0.9801 ~ +2026-05-07 13:06:23,433 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 13:16:32,957 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 13:16:32,958 INFO │ abstracts AUROC=0.9987 TPR@1%FPR=0.9376 (h= 167 a= 2099) +2026-05-07 13:16:32,958 INFO │ books AUROC=0.9599 TPR@1%FPR=0.3665 (h= 172 a= 2011) +2026-05-07 13:16:32,958 INFO │ code AUROC=0.9277 TPR@1%FPR=0.2432 (h= 79 a= 666) +2026-05-07 13:16:32,958 INFO │ czech AUROC=0.9570 TPR@1%FPR=0.2543 (h= 183 a= 2230) +2026-05-07 13:16:32,958 INFO │ german AUROC=0.9929 TPR@1%FPR=0.9021 (h= 193 a= 2207) +2026-05-07 13:16:32,958 INFO │ news AUROC=0.9871 TPR@1%FPR=0.9107 (h= 200 a= 1994) +2026-05-07 13:16:32,958 INFO │ poetry AUROC=0.9863 TPR@1%FPR=0.8458 (h= 180 a= 2036) +2026-05-07 13:16:32,958 INFO │ recipes AUROC=0.9870 TPR@1%FPR=0.7775 (h= 183 a= 2081) +2026-05-07 13:16:32,958 INFO │ reddit AUROC=0.9762 TPR@1%FPR=0.6336 (h= 191 a= 2118) +2026-05-07 13:16:32,958 INFO │ reviews AUROC=0.9717 TPR@1%FPR=0.3801 (h= 88 a= 1155) +2026-05-07 13:16:32,958 INFO │ wiki AUROC=0.9373 TPR@1%FPR=0.4804 (h= 169 a= 2071) +2026-05-07 13:16:32,958 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 13:16:32,958 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 13:16:32,958 INFO │ alternative_spelling AUROC=0.9867 TPR@1%FPR=0.6855 (n= 1100) +2026-05-07 13:16:32,958 INFO │ article_deletion AUROC=0.9873 TPR@1%FPR=0.6709 (n= 1100) +2026-05-07 13:16:32,958 INFO │ homoglyph AUROC=0.9842 TPR@1%FPR=0.3136 (n= 1100) +2026-05-07 13:16:32,958 INFO │ insert_paragraphs AUROC=0.9853 TPR@1%FPR=0.5645 (n= 1100) +2026-05-07 13:16:32,958 INFO │ none AUROC=0.9872 TPR@1%FPR=0.6801 (n= 8568) +2026-05-07 13:16:32,958 INFO │ number AUROC=0.9877 TPR@1%FPR=0.7245 (n= 1100) +2026-05-07 13:16:32,958 INFO │ paraphrase AUROC=0.9322 TPR@1%FPR=0.3600 (n= 1100) +2026-05-07 13:16:32,958 INFO │ perplexity_misspelling AUROC=0.9887 TPR@1%FPR=0.6782 (n= 1100) +2026-05-07 13:16:32,958 INFO │ synonym AUROC=0.9826 TPR@1%FPR=0.6400 (n= 1100) +2026-05-07 13:16:32,959 INFO │ upper_lower AUROC=0.9861 TPR@1%FPR=0.7418 (n= 1100) +2026-05-07 13:16:32,959 INFO │ whitespace AUROC=0.9928 TPR@1%FPR=0.8418 (n= 1100) +2026-05-07 13:16:32,959 INFO │ zero_width_space AUROC=0.7369 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 13:16:32,959 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 13:16:32,959 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 13:16:32,959 INFO │ gpt4 AUROC=0.9785 TPR@1%FPR=0.5521 +2026-05-07 13:16:32,959 INFO │ cohere-chat AUROC=0.9783 TPR@1%FPR=0.6803 +2026-05-07 13:16:32,959 INFO │ mpt-chat AUROC=0.9732 TPR@1%FPR=0.6254 +2026-05-07 13:16:32,959 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 13:16:32,959 INFO [HardNeg] weights (high=more samples): mpt=1.262 mistral=1.091 cohere=1.076 gpt2=1.009 gpt3=0.980 ... (range: 0.842–1.262) +2026-05-07 13:16:32,959 INFO [Worst-gen] gpt4 TPR@1%FPR=0.5521 +2026-05-07 13:16:32,959 INFO No improvement (9/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9684 cur_TPR@1%FPR=0.6130 worst-gen=0.5521 [gpt4] + +2026-05-07 13:17:52,793 INFO [Step 196/200] det=8.9854 para=-0.0000 hum=-0.0000 raw_rwd=0.7884±0.0138 rwd=0.7884 hum_rwd=0.2084±0.0135 (raw=0.2084) +2026-05-07 13:17:52,793 INFO loss components: L_human=0.117 L_aux_xh=0.048 L_xm_original=0.431 L_aux_xm=2.078 L_t5_para=1.378 L_xh_humanized=0.262 L_aux_hum=0.017 L_synonym_replacement=0.437 L_homoglyphs=0.440 L_article_deletion=0.428 L_misspelling=0.429 L_number_swap=0.458 L_whitespace_addition=0.435 L_upper_lower_swap=0.471 L_zero_width_space=0.441 L_insert_paragraphs=0.468 L_alternative_spelling=0.469 total=8.807 +2026-05-07 13:17:52,793 INFO per-gen rewards: chatgpt=0.782 cohere=0.790 gpt2=0.794 gpt3=0.793 llama-ch=0.789 mistral=0.784 mistral-=0.791 mpt=0.786 +2026-05-07 13:18:21,561 INFO [Step 197/200] det=skip para=0.0120 hum=-0.0000 raw_rwd=0.7946±0.0108 rwd=0.7946 hum_rwd=0.2010±0.0139 (raw=0.2010) +2026-05-07 13:18:21,562 INFO per-gen rewards: chatgpt=0.797 cohere=0.796 gpt2=0.794 gpt3=0.795 llama-ch=0.797 mistral=0.792 mistral-=0.802 mpt=0.787 +2026-05-07 13:19:42,471 INFO [Step 198/200] det=9.0857 para=-0.0000 hum=0.0000 raw_rwd=0.7952±0.0123 rwd=0.7952 hum_rwd=0.2017±0.0152 (raw=0.2017) +2026-05-07 13:19:42,472 INFO loss components: L_human=0.118 L_aux_xh=0.037 L_xm_original=0.443 L_aux_xm=2.200 L_t5_para=1.312 L_xh_humanized=0.270 L_aux_hum=0.018 L_synonym_replacement=0.430 L_homoglyphs=0.428 L_article_deletion=0.446 L_misspelling=0.432 L_number_swap=0.460 L_whitespace_addition=0.443 L_upper_lower_swap=0.455 L_zero_width_space=0.426 L_insert_paragraphs=0.432 L_alternative_spelling=0.435 total=8.785 +2026-05-07 13:19:42,472 INFO per-gen rewards: chatgpt=0.787 cohere=0.798 gpt2=0.792 gpt3=0.797 llama-ch=0.791 mistral=0.802 mistral-=0.798 mpt=0.796 +2026-05-07 13:20:11,216 INFO [Step 199/200] det=skip para=0.0000 hum=-0.0000 raw_rwd=0.7821±0.0143 rwd=0.7821 hum_rwd=0.2167±0.0122 (raw=0.2167) +2026-05-07 13:20:11,216 INFO per-gen rewards: chatgpt=0.778 cohere=0.791 gpt2=0.785 gpt3=0.788 llama-ch=0.780 mistral=0.771 mistral-=0.778 mpt=0.784 +2026-05-07 13:21:30,204 INFO [Step 200/200] det=9.1081 para=-0.0000 hum=0.0000 raw_rwd=0.7846±0.0151 rwd=0.7846 hum_rwd=0.2182±0.0119 (raw=0.2182) +2026-05-07 13:21:30,204 INFO loss components: L_human=0.329 L_aux_xh=0.317 L_xm_original=0.425 L_aux_xm=2.130 L_t5_para=1.261 L_xh_humanized=0.294 L_aux_hum=0.015 L_synonym_replacement=0.433 L_homoglyphs=0.429 L_article_deletion=0.427 L_misspelling=0.425 L_number_swap=0.427 L_whitespace_addition=0.428 L_upper_lower_swap=0.429 L_zero_width_space=0.429 L_insert_paragraphs=0.546 L_alternative_spelling=0.480 total=9.225 +2026-05-07 13:21:30,204 INFO per-gen rewards: chatgpt=0.784 cohere=0.782 gpt2=0.778 gpt3=0.791 llama-ch=0.796 mistral=0.791 mistral-=0.778 mpt=0.778 +2026-05-07 14:23:04,200 INFO ┌─ Generator metrics (AUROC | TPR@1%FPR) ───────────────────┐ +2026-05-07 14:23:04,202 INFO │ MACRO_AVG AUROC=0.9724 TPR@1%FPR=0.6989 ◄ +2026-05-07 14:23:04,210 INFO │ chatgpt AUROC=0.9766 TPR@1%FPR=0.7638 +2026-05-07 14:23:04,210 INFO │ cohere AUROC=0.9601 TPR@1%FPR=0.6709 +2026-05-07 14:23:04,210 INFO │ cohere-chat AUROC=0.9793 TPR@1%FPR=0.7491 +2026-05-07 14:23:04,210 INFO │ gpt2 AUROC=0.9693 TPR@1%FPR=0.6589 +2026-05-07 14:23:04,210 INFO │ gpt3 AUROC=0.9716 TPR@1%FPR=0.6747 +2026-05-07 14:23:04,210 INFO │ gpt4 AUROC=0.9848 TPR@1%FPR=0.7539 +2026-05-07 14:23:04,210 INFO │ llama-chat AUROC=0.9745 TPR@1%FPR=0.7879 +2026-05-07 14:23:04,210 INFO │ mistral AUROC=0.9646 TPR@1%FPR=0.6355 +2026-05-07 14:23:04,210 INFO │ mistral-chat AUROC=0.9722 TPR@1%FPR=0.7411 +2026-05-07 14:23:04,210 INFO │ mpt AUROC=0.9656 TPR@1%FPR=0.5774 +2026-05-07 14:23:04,210 INFO │ mpt-chat AUROC=0.9778 TPR@1%FPR=0.6749 +2026-05-07 14:23:04,210 INFO │ (prev best) 0.9782 +2026-05-07 14:23:04,210 INFO │ 🎯 GLOBAL TPR@1%FPR (all generators pooled) 0.6943 +2026-05-07 14:23:04,210 INFO ├─ Attack AUROC (robustness) ──────────────────────────────┤ +2026-05-07 14:23:04,210 INFO │ alternative_spelling 0.9770 ~ +2026-05-07 14:23:04,210 INFO │ article_deletion 0.9800 ~ +2026-05-07 14:23:04,210 INFO │ homoglyphs 0.9846 ~ +2026-05-07 14:23:04,210 INFO │ insert_paragraphs 0.9786 ~ +2026-05-07 14:23:04,210 INFO │ misspelling 0.9810 ~ +2026-05-07 14:23:04,210 INFO │ no_attack 0.9772 ~ +2026-05-07 14:23:04,210 INFO │ number_swap 0.9785 ~ +2026-05-07 14:23:04,210 INFO │ synonym_replacement 0.9813 ~ +2026-05-07 14:23:04,210 INFO │ t5_paraphrase 0.9800 ~ +2026-05-07 14:23:04,210 INFO │ upper_lower_swap 0.9809 ~ +2026-05-07 14:23:04,210 INFO │ whitespace_addition 0.9830 ~ +2026-05-07 14:23:04,210 INFO │ zero_width_space 0.9828 ~ +2026-05-07 14:23:04,210 INFO └──────────────────────────────────────────────────────────┘ +2026-05-07 14:33:11,689 INFO ┌─ Per-domain val metrics (REAL data, not synthesised) ──┐ +2026-05-07 14:33:11,690 INFO │ abstracts AUROC=0.9986 TPR@1%FPR=0.9352 (h= 167 a= 2099) +2026-05-07 14:33:11,690 INFO │ books AUROC=0.9811 TPR@1%FPR=0.7006 (h= 172 a= 2011) +2026-05-07 14:33:11,690 INFO │ code AUROC=0.9338 TPR@1%FPR=0.3003 (h= 79 a= 666) +2026-05-07 14:33:11,690 INFO │ czech AUROC=0.9264 TPR@1%FPR=0.0789 (h= 183 a= 2230) +2026-05-07 14:33:11,690 INFO │ german AUROC=0.9890 TPR@1%FPR=0.8763 (h= 193 a= 2207) +2026-05-07 14:33:11,690 INFO │ news AUROC=0.9916 TPR@1%FPR=0.9142 (h= 200 a= 1994) +2026-05-07 14:33:11,690 INFO │ poetry AUROC=0.9875 TPR@1%FPR=0.8482 (h= 180 a= 2036) +2026-05-07 14:33:11,690 INFO │ recipes AUROC=0.9850 TPR@1%FPR=0.7626 (h= 183 a= 2081) +2026-05-07 14:33:11,690 INFO │ reddit AUROC=0.9841 TPR@1%FPR=0.4821 (h= 191 a= 2118) +2026-05-07 14:33:11,690 INFO │ reviews AUROC=0.9777 TPR@1%FPR=0.8779 (h= 88 a= 1155) +2026-05-07 14:33:11,690 INFO │ wiki AUROC=0.9602 TPR@1%FPR=0.4491 (h= 169 a= 2071) +2026-05-07 14:33:11,690 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 14:33:11,690 INFO ┌─ Per-attack val (REAL RAID adversarial data) ──────────┐ +2026-05-07 14:33:11,690 INFO │ alternative_spelling AUROC=0.9898 TPR@1%FPR=0.7736 (n= 1100) +2026-05-07 14:33:11,690 INFO │ article_deletion AUROC=0.9908 TPR@1%FPR=0.7436 (n= 1100) +2026-05-07 14:33:11,690 INFO │ homoglyph AUROC=0.9886 TPR@1%FPR=0.4200 (n= 1100) +2026-05-07 14:33:11,690 INFO │ insert_paragraphs AUROC=0.9926 TPR@1%FPR=0.7727 (n= 1100) +2026-05-07 14:33:11,690 INFO │ none AUROC=0.9894 TPR@1%FPR=0.7903 (n= 8568) +2026-05-07 14:33:11,690 INFO │ number AUROC=0.9908 TPR@1%FPR=0.7964 (n= 1100) +2026-05-07 14:33:11,690 INFO │ paraphrase AUROC=0.9025 TPR@1%FPR=0.2491 (n= 1100) +2026-05-07 14:33:11,690 INFO │ perplexity_misspelling AUROC=0.9915 TPR@1%FPR=0.7755 (n= 1100) +2026-05-07 14:33:11,690 INFO │ synonym AUROC=0.9836 TPR@1%FPR=0.7309 (n= 1100) +2026-05-07 14:33:11,690 INFO │ upper_lower AUROC=0.9900 TPR@1%FPR=0.7864 (n= 1100) +2026-05-07 14:33:11,690 INFO │ whitespace AUROC=0.9946 TPR@1%FPR=0.8418 (n= 1100) +2026-05-07 14:33:11,690 INFO │ zero_width_space AUROC=0.7788 TPR@1%FPR=0.0000 (n= 1100) ⚠ +2026-05-07 14:33:11,690 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 14:33:11,690 INFO ┌─ Held-out generators (NEVER seen during training) ─────┐ +2026-05-07 14:33:11,690 INFO │ gpt4 AUROC=0.9848 TPR@1%FPR=0.7539 +2026-05-07 14:33:11,690 INFO │ cohere-chat AUROC=0.9793 TPR@1%FPR=0.7491 +2026-05-07 14:33:11,690 INFO │ mpt-chat AUROC=0.9778 TPR@1%FPR=0.6749 +2026-05-07 14:33:11,690 INFO └─────────────────────────────────────────────────────────┘ +2026-05-07 14:33:11,691 INFO [HardNeg] weights (high=more samples): mpt=1.385 mistral=1.157 gpt2=1.075 cohere=1.035 gpt3=1.023 ... (range: 0.720–1.385) +2026-05-07 14:33:11,691 INFO [Worst-gen] mpt TPR@1%FPR=0.5774 +2026-05-07 14:33:11,691 INFO No improvement (10/25) best_worst-gen TPR@1%FPR=0.7819 cur_AUROC=0.9724 cur_TPR@1%FPR=0.6943 worst-gen=0.5774 [mpt] + +2026-05-07 14:33:11,691 INFO ════════════════════════════════════════════════════════════════════════ +2026-05-07 14:33:11,691 INFO Fitting isotonic calibrator on best checkpoint ... +2026-05-07 14:33:11,691 INFO Loading detector 'roberta-large' … +2026-05-07 14:33:11,984 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/tokenizer_config.json "HTTP/1.1 200 OK" +2026-05-07 14:33:12,129 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 307 Temporary Redirect" +2026-05-07 14:33:12,276 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found" +2026-05-07 14:33:12,425 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 307 Temporary Redirect" +2026-05-07 14:33:12,571 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK" +2026-05-07 14:33:13,001 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/config.json "HTTP/1.1 200 OK" +2026-05-07 14:33:13,148 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/model.safetensors "HTTP/1.1 302 Found" +2026-05-07 14:33:16,169 INFO Loading detector weights from ./adal_v5_raid/best_detector … +2026-05-07 14:38:34,497 INFO ✓ Isotonic calibrator saved → ./adal_v5_raid/best_detector/isotonic_calibrator.pkl +2026-05-07 14:43:49,959 INFO Before calibration: AUROC=0.9794 TPR@1%FPR=0.8165 +2026-05-07 14:43:49,960 INFO After calibration: AUROC=0.9812 TPR@1%FPR=0.8218 (Δ=+0.0052) +2026-05-07 14:43:49,991 INFO ════════════════════════════════════════════════════════════════════════ +2026-05-07 14:43:49,994 INFO Done. +2026-05-07 14:43:49,995 INFO Best macro AUROC = 0.9782 +2026-05-07 14:43:49,995 INFO Best TPR@1%FPR = 0.8165 +2026-05-07 14:43:49,995 INFO Selection metric = worst-gen TPR@1%FPR +2026-05-07 14:43:49,995 INFO Detector → ./adal_v5_raid/best_detector +2026-05-07 14:43:49,995 INFO Paraphraser → ./adal_v5_raid/best_paraphraser +2026-05-07 14:43:49,995 INFO Humanizer → ./adal_v5_raid/best_humanizer +2026-05-07 14:43:49,995 INFO Gen AUROC / TPR → ./adal_v5_raid/per_generator_auroc.tsv +2026-05-07 14:43:49,995 INFO Atk AUROC → ./adal_v5_raid/per_attack_auroc.tsv +2026-05-07 14:43:49,995 INFO ════════════════════════════════════════════════════════════════════════ +2026-05-07 14:43:49,995 INFO +── Pushing to HuggingFace Hub (trigger=final) ── +2026-05-07 14:43:50,281 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK" +2026-05-07 14:43:50,444 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/adal_v5_raid "HTTP/1.1 200 OK" +2026-05-07 14:43:50,446 INFO Repo exists: Shushant/adal_v5_raid +2026-05-07 14:43:50,592 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/adal_v5_raid-paraphraser "HTTP/1.1 200 OK" +2026-05-07 14:43:50,593 INFO Repo exists: Shushant/adal_v5_raid-paraphraser +2026-05-07 14:43:50,594 INFO Uploading detector → Shushant/adal_v5_raid … +2026-05-07 14:43:50,734 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" +2026-05-07 14:43:52,313 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK" +2026-05-07 14:43:52,499 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/preupload/main "HTTP/1.1 200 OK" +2026-05-07 14:43:52,669 INFO HTTP Request: POST https://huggingface.co/Shushant/adal_v5_raid.git/info/lfs/objects/batch "HTTP/1.1 200 OK" +2026-05-07 14:43:52,813 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/adal_v5_raid/xet-write-token/main "HTTP/1.1 200 OK" +2026-05-07 14:43:58,587 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/commit/main "HTTP/1.1 200 OK" +2026-05-07 14:43:58,768 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/preupload/main "HTTP/1.1 200 OK" +2026-05-07 14:43:59,706 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/commit/main "HTTP/1.1 200 OK" +2026-05-07 14:43:59,888 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/preupload/main "HTTP/1.1 200 OK" +2026-05-07 14:44:00,624 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/commit/main "HTTP/1.1 200 OK" +2026-05-07 14:44:00,795 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/adal_v5_raid/preupload/main "HTTP/1.1 200 OK"