File size: 231,799 Bytes
49ce71c 3951ba2 58f79c1 dae20d2 da834c3 bad0333 b7a197e 5f049d6 98e5a22 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 1388 1389 1390 1391 1392 1393 1394 1395 1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 1466 1467 1468 1469 1470 1471 1472 1473 1474 1475 1476 1477 1478 1479 1480 1481 1482 1483 1484 1485 1486 1487 1488 1489 1490 1491 1492 1493 1494 1495 1496 1497 1498 1499 1500 1501 1502 1503 1504 1505 1506 1507 1508 1509 1510 1511 1512 1513 1514 1515 1516 1517 1518 1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529 1530 1531 1532 1533 1534 1535 1536 1537 1538 1539 1540 1541 1542 1543 1544 1545 1546 1547 1548 1549 1550 1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567 1568 1569 1570 1571 1572 1573 1574 1575 1576 1577 1578 1579 1580 1581 1582 1583 1584 1585 1586 1587 1588 1589 1590 1591 1592 1593 1594 1595 1596 1597 1598 1599 1600 1601 1602 1603 1604 1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618 1619 1620 1621 1622 1623 1624 1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635 1636 1637 1638 1639 1640 1641 1642 1643 1644 1645 1646 1647 1648 1649 1650 1651 1652 1653 1654 1655 1656 1657 1658 1659 1660 1661 1662 1663 1664 1665 1666 1667 1668 1669 1670 1671 1672 1673 1674 1675 1676 1677 1678 1679 1680 1681 1682 1683 1684 1685 1686 1687 1688 1689 1690 1691 1692 1693 1694 1695 1696 1697 1698 1699 1700 1701 1702 1703 1704 1705 1706 1707 1708 1709 1710 1711 1712 1713 1714 1715 1716 1717 1718 1719 1720 1721 1722 1723 1724 1725 1726 1727 1728 1729 1730 1731 1732 1733 1734 1735 1736 1737 1738 1739 1740 1741 1742 1743 1744 1745 1746 1747 1748 1749 1750 1751 1752 1753 1754 1755 1756 1757 1758 1759 1760 1761 1762 1763 1764 1765 1766 1767 1768 1769 1770 1771 1772 1773 1774 1775 1776 1777 1778 1779 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803 1804 1805 1806 1807 1808 1809 1810 1811 1812 1813 1814 1815 1816 1817 1818 1819 1820 1821 1822 1823 1824 1825 1826 1827 1828 1829 1830 1831 1832 1833 1834 1835 1836 1837 1838 1839 1840 1841 1842 1843 1844 1845 1846 1847 1848 1849 1850 1851 1852 1853 1854 1855 1856 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1875 1876 1877 1878 1879 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1927 1928 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 1940 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 | 2026-04-13 09:50:51,623 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 09:50:51,623 INFO RADAR Γ RAID β Multi-Generator + Multi-Evasion
2026-04-13 09:50:51,623 INFO strategy=mixed human=None AI=None/gen
2026-04-13 09:50:51,623 INFO Active attacks: ['t5_paraphrase', 'synonym_replacement', 'homoglyphs', 'article_deletion', 'misspelling']
2026-04-13 09:50:51,623 INFO NLTK available: True
2026-04-13 09:50:51,623 INFO Fixes: ls=0.15 det_every=2 clip=[0.01,0.99] warmstart=0 kl=0.001
2026-04-13 09:50:51,623 INFO device=cuda
2026-04-13 09:50:51,623 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 09:50:51,623 INFO Loading custom JSONL dataset ...
2026-04-13 09:50:51,623 INFO Train: /home/shushanta/target_mining_deberta/adal/train.jsonl
2026-04-13 09:50:51,624 INFO Val : /home/shushanta/target_mining_deberta/adal/val.jsonl
2026-04-13 09:50:51,624 INFO Caps : human=None AI=None/gen
2026-04-13 09:50:51,624 INFO Loading /home/shushanta/target_mining_deberta/adal/train.jsonl ...
2026-04-13 09:55:40,685 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 09:55:40,685 INFO RADAR Γ RAID β Multi-Generator + Multi-Evasion
2026-04-13 09:55:40,685 INFO strategy=mixed human=None AI=None/gen
2026-04-13 09:55:40,685 INFO Active attacks: ['t5_paraphrase', 'synonym_replacement', 'homoglyphs', 'article_deletion', 'misspelling']
2026-04-13 09:55:40,685 INFO NLTK available: True
2026-04-13 09:55:40,685 INFO Fixes: ls=0.15 det_every=2 clip=[0.01,0.99] warmstart=0 kl=0.001
2026-04-13 09:55:40,685 INFO device=cuda
2026-04-13 09:55:40,685 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 09:55:40,685 INFO Loading custom JSONL dataset ...
2026-04-13 09:55:40,685 INFO Train: /home/shushanta/target_mining_deberta/adal/train.jsonl
2026-04-13 09:55:40,685 INFO Val : /home/shushanta/target_mining_deberta/adal/val.jsonl
2026-04-13 09:55:40,685 INFO Caps : human=None AI=None/gen
2026-04-13 09:55:40,685 INFO Loading /home/shushanta/target_mining_deberta/adal/train.jsonl ...
2026-04-13 09:56:40,467 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 09:56:40,468 INFO RADAR Γ RAID β Multi-Generator + Multi-Evasion
2026-04-13 09:56:40,468 INFO strategy=mixed human=None AI=None/gen
2026-04-13 09:56:40,468 INFO Active attacks: ['t5_paraphrase', 'synonym_replacement', 'homoglyphs', 'article_deletion', 'misspelling']
2026-04-13 09:56:40,468 INFO NLTK available: True
2026-04-13 09:56:40,468 INFO Fixes: ls=0.15 det_every=2 clip=[0.01,0.99] warmstart=0 kl=0.001
2026-04-13 09:56:40,468 INFO device=cuda
2026-04-13 09:56:40,468 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 09:56:40,468 INFO Loading custom JSONL dataset ...
2026-04-13 09:56:40,468 INFO Train: /home/shushanta/ADAL_AI_Detector/train.jsonl
2026-04-13 09:56:40,468 INFO Val : /home/shushanta/ADAL_AI_Detector/val.jsonl
2026-04-13 09:56:40,468 INFO Caps : human=None AI=None/gen
2026-04-13 09:56:40,468 INFO Loading /home/shushanta/ADAL_AI_Detector/train.jsonl ...
2026-04-13 09:56:41,462 INFO Human texts : 9,101
2026-04-13 09:56:41,462 INFO AI generators (22): ['deepseek-r1-distill-qwen-32b', 'falcon3-10b-instruct', 'gemini-1.5-pro', 'gemini-2.0-flash', 'gemini-pro', 'gemini-pro-paraphrase', 'gpt-3.5-turbo', 'gpt-4-turbo', 'gpt-4-turbo-paraphrase', 'gpt-4.5-preview', 'gpt-4o', 'gpt-4o-mini', 'llama-2-70b-chat', 'llama-2-7b-chat', 'llama-3.1-8b-instruct', 'llama-3.3-70b-instruct', 'ministral-8b-instruct-2410', 'mistral-7b-instruct-v0.2', 'mixtral-8x7b-instruct-v0.1', 'o3-mini', 'qwen1.5-72b-chat-8bit', 'text-bison-002']
2026-04-13 09:56:41,462 INFO deepseek-r1-distill-qwen-32b -> 901 texts
2026-04-13 09:56:41,462 INFO falcon3-10b-instruct -> 879 texts
2026-04-13 09:56:41,462 INFO gemini-1.5-pro -> 1,072 texts
2026-04-13 09:56:41,462 INFO gemini-2.0-flash -> 1,079 texts
2026-04-13 09:56:41,462 INFO gemini-pro -> 276 texts
2026-04-13 09:56:41,463 INFO gemini-pro-paraphrase -> 265 texts
2026-04-13 09:56:41,463 INFO gpt-3.5-turbo -> 1,374 texts
2026-04-13 09:56:41,463 INFO gpt-4-turbo -> 272 texts
2026-04-13 09:56:41,463 INFO gpt-4-turbo-paraphrase -> 276 texts
2026-04-13 09:56:41,463 INFO gpt-4.5-preview -> 278 texts
2026-04-13 09:56:41,463 INFO gpt-4o -> 1,336 texts
2026-04-13 09:56:41,463 INFO gpt-4o-mini -> 1,358 texts
2026-04-13 09:56:41,463 INFO llama-2-70b-chat -> 269 texts
2026-04-13 09:56:41,463 INFO llama-2-7b-chat -> 262 texts
2026-04-13 09:56:41,463 INFO llama-3.1-8b-instruct -> 1,063 texts
2026-04-13 09:56:41,463 INFO llama-3.3-70b-instruct -> 405 texts
2026-04-13 09:56:41,463 INFO ministral-8b-instruct-2410 -> 1,100 texts
2026-04-13 09:56:41,463 INFO mistral-7b-instruct-v0.2 -> 266 texts
2026-04-13 09:56:41,463 INFO mixtral-8x7b-instruct-v0.1 -> 264 texts
2026-04-13 09:56:41,463 INFO o3-mini -> 1,075 texts
2026-04-13 09:56:41,463 INFO qwen1.5-72b-chat-8bit -> 271 texts
2026-04-13 09:56:41,463 INFO text-bison-002 -> 265 texts
2026-04-13 09:56:41,463 INFO Total AI : 14,606
2026-04-13 09:56:41,463 INFO Loading /home/shushanta/ADAL_AI_Detector/val.jsonl ...
2026-04-13 09:56:41,603 INFO Human texts : 1,277
2026-04-13 09:56:41,603 INFO AI generators (22): ['deepseek-r1-distill-qwen-32b', 'falcon3-10b-instruct', 'gemini-1.5-pro', 'gemini-2.0-flash', 'gemini-pro', 'gemini-pro-paraphrase', 'gpt-3.5-turbo', 'gpt-4-turbo', 'gpt-4-turbo-paraphrase', 'gpt-4.5-preview', 'gpt-4o', 'gpt-4o-mini', 'llama-2-70b-chat', 'llama-2-7b-chat', 'llama-3.1-8b-instruct', 'llama-3.3-70b-instruct', 'ministral-8b-instruct-2410', 'mistral-7b-instruct-v0.2', 'mixtral-8x7b-instruct-v0.1', 'o3-mini', 'qwen1.5-72b-chat-8bit', 'text-bison-002']
2026-04-13 09:56:41,603 INFO deepseek-r1-distill-qwen-32b -> 106 texts
2026-04-13 09:56:41,603 INFO falcon3-10b-instruct -> 113 texts
2026-04-13 09:56:41,603 INFO gemini-1.5-pro -> 145 texts
2026-04-13 09:56:41,603 INFO gemini-2.0-flash -> 139 texts
2026-04-13 09:56:41,603 INFO gemini-pro -> 59 texts
2026-04-13 09:56:41,603 INFO gemini-pro-paraphrase -> 70 texts
2026-04-13 09:56:41,603 INFO gpt-3.5-turbo -> 200 texts
2026-04-13 09:56:41,603 INFO gpt-4-turbo -> 63 texts
2026-04-13 09:56:41,603 INFO gpt-4-turbo-paraphrase -> 59 texts
2026-04-13 09:56:41,603 INFO gpt-4.5-preview -> 45 texts
2026-04-13 09:56:41,603 INFO gpt-4o -> 209 texts
2026-04-13 09:56:41,603 INFO gpt-4o-mini -> 214 texts
2026-04-13 09:56:41,603 INFO llama-2-70b-chat -> 65 texts
2026-04-13 09:56:41,603 INFO llama-2-7b-chat -> 72 texts
2026-04-13 09:56:41,603 INFO llama-3.1-8b-instruct -> 158 texts
2026-04-13 09:56:41,603 INFO llama-3.3-70b-instruct -> 54 texts
2026-04-13 09:56:41,603 INFO ministral-8b-instruct-2410 -> 139 texts
2026-04-13 09:56:41,603 INFO mistral-7b-instruct-v0.2 -> 68 texts
2026-04-13 09:56:41,603 INFO mixtral-8x7b-instruct-v0.1 -> 70 texts
2026-04-13 09:56:41,603 INFO o3-mini -> 132 texts
2026-04-13 09:56:41,603 INFO qwen1.5-72b-chat-8bit -> 63 texts
2026-04-13 09:56:41,603 INFO text-bison-002 -> 69 texts
2026-04-13 09:56:41,603 INFO Total AI : 2,312
2026-04-13 09:56:41,603 INFO Train -> human=9,101 AI=14,606
2026-04-13 09:56:41,603 INFO Val -> human=1,277 AI=2,312
2026-04-13 09:56:41,603 INFO GeneratorScheduler: strategy='mixed' generators=['deepseek-r1-distill-qwen-32b', 'falcon3-10b-instruct', 'gemini-1.5-pro', 'gemini-2.0-flash', 'gemini-pro', 'gemini-pro-paraphrase', 'gpt-3.5-turbo', 'gpt-4-turbo', 'gpt-4-turbo-paraphrase', 'gpt-4.5-preview', 'gpt-4o', 'gpt-4o-mini', 'llama-2-70b-chat', 'llama-2-7b-chat', 'llama-3.1-8b-instruct', 'llama-3.3-70b-instruct', 'ministral-8b-instruct-2410', 'mistral-7b-instruct-v0.2', 'mixtral-8x7b-instruct-v0.1', 'o3-mini', 'qwen1.5-72b-chat-8bit', 'text-bison-002']
2026-04-13 09:56:41,603 INFO Loading paraphraser 'ramsrigouthamg/t5_paraphraser' β¦
2026-04-13 09:56:42,082 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
2026-04-13 09:56:42,277 INFO HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/ramsrigouthamg/t5_paraphraser/d78f7749656e21d8b6fdf372efb5c5d1dbce577f/tokenizer_config.json "HTTP/1.1 200 OK"
2026-04-13 09:56:42,452 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
2026-04-13 09:56:42,614 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
2026-04-13 09:56:42,866 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
2026-04-13 09:56:43,032 INFO HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/ramsrigouthamg/t5_paraphraser/d78f7749656e21d8b6fdf372efb5c5d1dbce577f/config.json "HTTP/1.1 200 OK"
2026-04-13 09:56:43,197 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/model.safetensors "HTTP/1.1 404 Not Found"
2026-04-13 09:56:43,386 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/model.safetensors.index.json "HTTP/1.1 404 Not Found"
2026-04-13 09:56:43,551 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/pytorch_model.bin "HTTP/1.1 302 Found"
2026-04-13 09:56:43,729 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/model.safetensors "HTTP/1.1 404 Not Found"
2026-04-13 09:56:43,928 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser "HTTP/1.1 200 OK"
2026-04-13 09:56:44,615 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/commits/main "HTTP/1.1 200 OK"
2026-04-13 09:56:44,911 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/discussions?p=0 "HTTP/1.1 200 OK"
2026-04-13 09:56:45,421 INFO HTTP Request: GET https://huggingface.co/api/models/ramsrigouthamg/t5_paraphraser/commits/refs%2Fpr%2F1 "HTTP/1.1 200 OK"
2026-04-13 09:56:45,595 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/refs%2Fpr%2F1/model.safetensors.index.json "HTTP/1.1 404 Not Found"
2026-04-13 09:56:45,798 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/refs%2Fpr%2F1/model.safetensors "HTTP/1.1 302 Found"
2026-04-13 09:56:46,078 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/generation_config.json "HTTP/1.1 404 Not Found"
2026-04-13 09:56:46,257 INFO HTTP Request: HEAD https://huggingface.co/ramsrigouthamg/t5_paraphraser/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
2026-04-13 09:56:46,350 INFO HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/ramsrigouthamg/t5_paraphraser/d78f7749656e21d8b6fdf372efb5c5d1dbce577f/config.json "HTTP/1.1 200 OK"
2026-04-13 09:56:46,681 INFO Loading detector 'roberta-large' β¦
2026-04-13 09:56:46,856 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/tokenizer_config.json "HTTP/1.1 200 OK"
2026-04-13 09:56:47,044 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 307 Temporary Redirect"
2026-04-13 09:56:47,260 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
2026-04-13 09:56:47,472 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 307 Temporary Redirect"
2026-04-13 09:56:47,675 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
2026-04-13 09:56:48,071 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/config.json "HTTP/1.1 200 OK"
2026-04-13 09:56:48,288 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/model.safetensors "HTTP/1.1 302 Found"
2026-04-13 09:56:51,621 INFO Starting adversarial training loop β¦
2026-04-13 09:57:10,442 INFO [Step 1/200] det=skip para=0.8223 raw_rwd=0.3132Β±0.0245 rwd=0.3132
2026-04-13 09:57:10,442 INFO per-gen rewards: deepseek=0.318 falcon3-=0.295 gemini-1=0.315 gemini-2=0.301 gemini-p=0.316 gemini-p=0.363 gpt-3.5-=0.313 gpt-4-tu=0.291 gpt-4-tu=0.289 gpt-4.5-=0.370 gpt-4o=0.315 gpt-4o-m=0.325 llama-2-=0.313 llama-2-=0.368 llama-3.=0.303 llama-3.=0.313 ministra=0.304 mistral-=0.316 mixtral-=0.301 o3-mini=0.314 qwen1.5-=0.319 text-bis=0.319
2026-04-13 10:01:51,397 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 10:01:51,397 INFO β MACRO_AVG 0.3406 β
2026-04-13 10:01:51,397 INFO β deepseek-r1-distill-qwen-32b 0.2805
2026-04-13 10:01:51,397 INFO β falcon3-10b-instruct 0.3570
2026-04-13 10:01:51,397 INFO β gemini-1.5-pro 0.3709
2026-04-13 10:01:51,397 INFO β gemini-2.0-flash 0.2720
2026-04-13 10:01:51,397 INFO β gemini-pro 0.3453
2026-04-13 10:01:51,397 INFO β gemini-pro-paraphrase 0.2916
2026-04-13 10:01:51,397 INFO β gpt-3.5-turbo 0.3571
2026-04-13 10:01:51,397 INFO β gpt-4-turbo 0.2368
2026-04-13 10:01:51,397 INFO β gpt-4-turbo-paraphrase 0.2468
2026-04-13 10:01:51,397 INFO β gpt-4.5-preview 0.5575
2026-04-13 10:01:51,397 INFO β gpt-4o 0.3554
2026-04-13 10:01:51,397 INFO β gpt-4o-mini 0.3077
2026-04-13 10:01:51,397 INFO β llama-2-70b-chat 0.4459
2026-04-13 10:01:51,397 INFO β llama-2-7b-chat 0.3627
2026-04-13 10:01:51,397 INFO β llama-3.1-8b-instruct 0.3680
2026-04-13 10:01:51,397 INFO β llama-3.3-70b-instruct 0.3066
2026-04-13 10:01:51,397 INFO β ministral-8b-instruct-2410 0.3903
2026-04-13 10:01:51,397 INFO β mistral-7b-instruct-v0.2 0.4420
2026-04-13 10:01:51,397 INFO β mixtral-8x7b-instruct-v0.1 0.3680
2026-04-13 10:01:51,397 INFO β o3-mini 0.2241
2026-04-13 10:01:51,397 INFO β qwen1.5-72b-chat-8bit 0.2817
2026-04-13 10:01:51,397 INFO β text-bison-002 0.3249
2026-04-13 10:01:51,397 INFO β (prev best) 0.0000
2026-04-13 10:01:51,397 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 10:01:51,398 INFO β article_deletion 0.4621 β²
2026-04-13 10:01:51,398 INFO β homoglyphs 0.1819 βΌ
2026-04-13 10:01:51,398 INFO β misspelling 0.4607 β²
2026-04-13 10:01:51,398 INFO β no_attack 0.3165 ~
2026-04-13 10:01:51,398 INFO β synonym_replacement 0.2741 ~
2026-04-13 10:01:51,398 INFO β t5_paraphrase 0.0000 βΌ
2026-04-13 10:01:51,398 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 10:01:53,735 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 10:01:54,769 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 10:01:54,769 INFO β New best macro AUROC = 0.3406 β saved.
2026-04-13 10:01:54,769 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 10:01:55,327 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 10:01:55,492 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 404 Not Found"
2026-04-13 10:02:00,845 INFO HTTP Request: POST https://huggingface.co/api/repos/create "HTTP/1.1 200 OK"
2026-04-13 10:02:00,846 INFO Created repo: Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:02:01,519 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 404 Not Found"
2026-04-13 10:02:07,859 INFO HTTP Request: POST https://huggingface.co/api/repos/create "HTTP/1.1 200 OK"
2026-04-13 10:02:07,860 INFO Created repo: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:02:07,860 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 10:02:08,019 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:02:09,160 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:02:09,362 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:02:09,668 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:02:09,882 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:02:22,697 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:02:22,884 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:02:23,976 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:02:24,191 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:02:25,025 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:02:25,219 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:02:26,299 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:02:26,300 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:02:26,300 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 10:02:26,469 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:02:27,144 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:02:27,354 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:02:27,551 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:02:27,773 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:02:44,603 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:02:44,604 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:02:44,604 INFO ββ Hub push complete ββ
2026-04-13 10:03:25,977 INFO [Step 2/200] det=4.1193 para=-0.0083 raw_rwd=0.3652Β±0.0120 rwd=0.3652
2026-04-13 10:03:25,977 INFO loss components: L_human=1.034 L_xm_original=0.519 L_t5_para=0.500 L_synonym_replacement=0.511 L_homoglyphs=0.524 L_article_deletion=0.522 L_misspelling=0.515 total=4.126
2026-04-13 10:03:25,977 INFO per-gen rewards: deepseek=0.370 falcon3-=0.359 gemini-1=0.369 gemini-2=0.371 gemini-p=0.370 gemini-p=0.370 gpt-3.5-=0.369 gpt-4-tu=0.369 gpt-4-tu=0.370 gpt-4.5-=0.371 gpt-4o=0.364 gpt-4o-m=0.370 llama-2-=0.371 llama-2-=0.368 llama-3.=0.356 llama-3.=0.354 ministra=0.359 mistral-=0.371 mixtral-=0.337 o3-mini=0.365 qwen1.5-=0.371 text-bis=0.370
2026-04-13 10:03:40,556 INFO [Step 3/200] det=skip para=-0.0203 raw_rwd=0.3662Β±0.0103 rwd=0.3662
2026-04-13 10:03:40,556 INFO per-gen rewards: deepseek=0.362 falcon3-=0.363 gemini-1=0.370 gemini-2=0.371 gemini-p=0.372 gemini-p=0.370 gpt-3.5-=0.370 gpt-4-tu=0.339 gpt-4-tu=0.371 gpt-4.5-=0.322 gpt-4o=0.365 gpt-4o-m=0.365 llama-2-=0.371 llama-2-=0.368 llama-3.=0.369 llama-3.=0.369 ministra=0.370 mistral-=0.368 mixtral-=0.366 o3-mini=0.363 qwen1.5-=0.370 text-bis=0.370
2026-04-13 10:04:20,359 INFO [Step 4/200] det=4.1805 para=-0.0030 raw_rwd=0.3650Β±0.0114 rwd=0.3650
2026-04-13 10:04:20,359 INFO loss components: L_human=0.876 L_xm_original=0.566 L_t5_para=0.595 L_synonym_replacement=0.563 L_homoglyphs=0.538 L_article_deletion=0.568 L_misspelling=0.535 total=4.241
2026-04-13 10:04:20,359 INFO per-gen rewards: deepseek=0.370 falcon3-=0.362 gemini-1=0.371 gemini-2=0.370 gemini-p=0.339 gemini-p=0.369 gpt-3.5-=0.370 gpt-4-tu=0.370 gpt-4-tu=0.369 gpt-4.5-=0.369 gpt-4o=0.371 gpt-4o-m=0.365 llama-2-=0.368 llama-2-=0.343 llama-3.=0.370 llama-3.=0.371 ministra=0.365 mistral-=0.339 mixtral-=0.369 o3-mini=0.345 qwen1.5-=0.366 text-bis=0.347
2026-04-13 10:04:34,901 INFO [Step 5/200] det=skip para=-0.0180 raw_rwd=0.3706Β±0.0049 rwd=0.3706
2026-04-13 10:04:34,901 INFO per-gen rewards: deepseek=0.367 falcon3-=0.374 gemini-1=0.372 gemini-2=0.372 gemini-p=0.375 gemini-p=0.373 gpt-3.5-=0.373 gpt-4-tu=0.371 gpt-4-tu=0.375 gpt-4.5-=0.372 gpt-4o=0.367 gpt-4o-m=0.368 llama-2-=0.370 llama-2-=0.373 llama-3.=0.371 llama-3.=0.364 ministra=0.371 mistral-=0.370 mixtral-=0.369 o3-mini=0.371 qwen1.5-=0.373 text-bis=0.373
2026-04-13 10:09:17,785 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 10:09:17,785 INFO β MACRO_AVG 0.5000 β
2026-04-13 10:09:17,785 INFO β deepseek-r1-distill-qwen-32b 0.6489
2026-04-13 10:09:17,785 INFO β falcon3-10b-instruct 0.6615
2026-04-13 10:09:17,785 INFO β gemini-1.5-pro 0.5179
2026-04-13 10:09:17,785 INFO β gemini-2.0-flash 0.5804
2026-04-13 10:09:17,785 INFO β gemini-pro 0.2950
2026-04-13 10:09:17,785 INFO β gemini-pro-paraphrase 0.2680
2026-04-13 10:09:17,786 INFO β gpt-3.5-turbo 0.4799
2026-04-13 10:09:17,786 INFO β gpt-4-turbo 0.4235
2026-04-13 10:09:17,786 INFO β gpt-4-turbo-paraphrase 0.2729
2026-04-13 10:09:17,786 INFO β gpt-4.5-preview 0.7521
2026-04-13 10:09:17,786 INFO β gpt-4o 0.6077
2026-04-13 10:09:17,786 INFO β gpt-4o-mini 0.6023
2026-04-13 10:09:17,786 INFO β llama-2-70b-chat 0.4436
2026-04-13 10:09:17,786 INFO β llama-2-7b-chat 0.2951
2026-04-13 10:09:17,786 INFO β llama-3.1-8b-instruct 0.6269
2026-04-13 10:09:17,786 INFO β llama-3.3-70b-instruct 0.7082
2026-04-13 10:09:17,786 INFO β ministral-8b-instruct-2410 0.6718
2026-04-13 10:09:17,786 INFO β mistral-7b-instruct-v0.2 0.4498
2026-04-13 10:09:17,786 INFO β mixtral-8x7b-instruct-v0.1 0.4014
2026-04-13 10:09:17,786 INFO β o3-mini 0.6222
2026-04-13 10:09:17,786 INFO β qwen1.5-72b-chat-8bit 0.3694
2026-04-13 10:09:17,786 INFO β text-bison-002 0.3020
2026-04-13 10:09:17,786 INFO β (prev best) 0.3406
2026-04-13 10:09:17,786 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 10:09:17,786 INFO β article_deletion 0.7343 β²
2026-04-13 10:09:17,786 INFO β homoglyphs 0.8720 β²
2026-04-13 10:09:17,786 INFO β misspelling 0.8829 β²
2026-04-13 10:09:17,786 INFO β no_attack 0.5960 ~
2026-04-13 10:09:17,786 INFO β synonym_replacement 0.8540 β²
2026-04-13 10:09:17,786 INFO β t5_paraphrase 0.8000 β²
2026-04-13 10:09:17,786 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 10:09:22,676 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 10:09:24,820 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 10:09:24,820 INFO β New best macro AUROC = 0.5000 β saved.
2026-04-13 10:09:24,820 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 10:09:25,239 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 10:09:25,445 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 10:09:25,446 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:09:25,647 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 10:09:25,648 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:09:25,649 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 10:09:25,832 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:09:27,000 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:09:27,241 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:09:27,456 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:10:34,627 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:10:34,760 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:10:35,635 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:10:35,775 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:10:36,652 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:10:36,817 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:10:37,446 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:10:37,447 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:10:37,447 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 10:10:37,558 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:10:38,175 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:10:38,317 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:10:38,451 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:10:54,451 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:10:54,452 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:10:54,452 INFO ββ Hub push complete ββ
2026-04-13 10:11:35,076 INFO [Step 6/200] det=4.2146 para=-0.0013 raw_rwd=0.3691Β±0.0063 rwd=0.3691
2026-04-13 10:11:35,076 INFO loss components: L_human=0.822 L_xm_original=0.617 L_t5_para=0.559 L_synonym_replacement=0.550 L_homoglyphs=0.571 L_article_deletion=0.595 L_misspelling=0.593 total=4.307
2026-04-13 10:11:35,076 INFO per-gen rewards: deepseek=0.368 falcon3-=0.370 gemini-1=0.369 gemini-2=0.369 gemini-p=0.372 gemini-p=0.370 gpt-3.5-=0.368 gpt-4-tu=0.371 gpt-4-tu=0.372 gpt-4.5-=0.373 gpt-4o=0.372 gpt-4o-m=0.372 llama-2-=0.368 llama-2-=0.370 llama-3.=0.363 llama-3.=0.368 ministra=0.368 mistral-=0.372 mixtral-=0.370 o3-mini=0.371 qwen1.5-=0.349 text-bis=0.370
2026-04-13 10:11:49,675 INFO [Step 7/200] det=skip para=-0.0121 raw_rwd=0.3680Β±0.0029 rwd=0.3680
2026-04-13 10:11:49,675 INFO per-gen rewards: deepseek=0.369 falcon3-=0.368 gemini-1=0.367 gemini-2=0.369 gemini-p=0.368 gemini-p=0.362 gpt-3.5-=0.369 gpt-4-tu=0.371 gpt-4-tu=0.370 gpt-4.5-=0.367 gpt-4o=0.368 gpt-4o-m=0.365 llama-2-=0.370 llama-2-=0.368 llama-3.=0.370 llama-3.=0.370 ministra=0.367 mistral-=0.368 mixtral-=0.365 o3-mini=0.368 qwen1.5-=0.368 text-bis=0.371
2026-04-13 10:12:30,038 INFO [Step 8/200] det=4.2973 para=-0.0002 raw_rwd=0.3678Β±0.0025 rwd=0.3678
2026-04-13 10:12:30,038 INFO loss components: L_human=0.682 L_xm_original=0.703 L_t5_para=0.534 L_synonym_replacement=0.525 L_homoglyphs=0.570 L_article_deletion=0.617 L_misspelling=0.599 total=4.230
2026-04-13 10:12:30,038 INFO per-gen rewards: deepseek=0.369 falcon3-=0.365 gemini-1=0.367 gemini-2=0.368 gemini-p=0.370 gemini-p=0.365 gpt-3.5-=0.368 gpt-4-tu=0.371 gpt-4-tu=0.368 gpt-4.5-=0.369 gpt-4o=0.369 gpt-4o-m=0.369 llama-2-=0.365 llama-2-=0.370 llama-3.=0.367 llama-3.=0.367 ministra=0.366 mistral-=0.367 mixtral-=0.370 o3-mini=0.368 qwen1.5-=0.366 text-bis=0.371
2026-04-13 10:12:44,582 INFO [Step 9/200] det=skip para=-0.0186 raw_rwd=0.3566Β±0.0038 rwd=0.3566
2026-04-13 10:12:44,582 INFO per-gen rewards: deepseek=0.356 falcon3-=0.356 gemini-1=0.354 gemini-2=0.358 gemini-p=0.359 gemini-p=0.348 gpt-3.5-=0.356 gpt-4-tu=0.357 gpt-4-tu=0.356 gpt-4.5-=0.357 gpt-4o=0.357 gpt-4o-m=0.358 llama-2-=0.358 llama-2-=0.356 llama-3.=0.356 llama-3.=0.359 ministra=0.358 mistral-=0.358 mixtral-=0.359 o3-mini=0.356 qwen1.5-=0.357 text-bis=0.357
2026-04-13 10:13:24,922 INFO [Step 10/200] det=4.0340 para=-0.0148 raw_rwd=0.3560Β±0.0047 rwd=0.3560
2026-04-13 10:13:24,922 INFO loss components: L_human=0.586 L_xm_original=0.575 L_t5_para=0.505 L_synonym_replacement=0.522 L_homoglyphs=0.471 L_article_deletion=0.618 L_misspelling=0.490 total=3.767
2026-04-13 10:13:24,922 INFO per-gen rewards: deepseek=0.358 falcon3-=0.357 gemini-1=0.359 gemini-2=0.353 gemini-p=0.355 gemini-p=0.360 gpt-3.5-=0.356 gpt-4-tu=0.358 gpt-4-tu=0.359 gpt-4.5-=0.358 gpt-4o=0.357 gpt-4o-m=0.356 llama-2-=0.349 llama-2-=0.345 llama-3.=0.357 llama-3.=0.354 ministra=0.354 mistral-=0.358 mixtral-=0.357 o3-mini=0.354 qwen1.5-=0.358 text-bis=0.357
2026-04-13 10:18:09,837 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 10:18:09,837 INFO β MACRO_AVG 0.8495 β
2026-04-13 10:18:09,837 INFO β deepseek-r1-distill-qwen-32b 0.8016
2026-04-13 10:18:09,837 INFO β falcon3-10b-instruct 0.8637
2026-04-13 10:18:09,837 INFO β gemini-1.5-pro 0.7614
2026-04-13 10:18:09,838 INFO β gemini-2.0-flash 0.8156
2026-04-13 10:18:09,838 INFO β gemini-pro 0.7949
2026-04-13 10:18:09,838 INFO β gemini-pro-paraphrase 0.8390
2026-04-13 10:18:09,838 INFO β gpt-3.5-turbo 0.9181
2026-04-13 10:18:09,838 INFO β gpt-4-turbo 0.8849
2026-04-13 10:18:09,838 INFO β gpt-4-turbo-paraphrase 0.8713
2026-04-13 10:18:09,838 INFO β gpt-4.5-preview 0.8622
2026-04-13 10:18:09,838 INFO β gpt-4o 0.9151
2026-04-13 10:18:09,838 INFO β gpt-4o-mini 0.9161
2026-04-13 10:18:09,838 INFO β llama-2-70b-chat 0.8170
2026-04-13 10:18:09,838 INFO β llama-2-7b-chat 0.8096
2026-04-13 10:18:09,838 INFO β llama-3.1-8b-instruct 0.8324
2026-04-13 10:18:09,838 INFO β llama-3.3-70b-instruct 0.8892
2026-04-13 10:18:09,838 INFO β ministral-8b-instruct-2410 0.8536
2026-04-13 10:18:09,838 INFO β mistral-7b-instruct-v0.2 0.8488
2026-04-13 10:18:09,838 INFO β mixtral-8x7b-instruct-v0.1 0.8051
2026-04-13 10:18:09,838 INFO β o3-mini 0.9089
2026-04-13 10:18:09,838 INFO β qwen1.5-72b-chat-8bit 0.8448
2026-04-13 10:18:09,838 INFO β text-bison-002 0.8355
2026-04-13 10:18:09,838 INFO β (prev best) 0.5000
2026-04-13 10:18:09,838 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 10:18:09,838 INFO β article_deletion 0.9445 β²
2026-04-13 10:18:09,838 INFO β homoglyphs 1.0000 β²
2026-04-13 10:18:09,838 INFO β misspelling 0.9736 β²
2026-04-13 10:18:09,838 INFO β no_attack 0.8791 ~
2026-04-13 10:18:09,838 INFO β synonym_replacement 0.9994 β²
2026-04-13 10:18:09,838 INFO β t5_paraphrase 0.9800 β²
2026-04-13 10:18:09,838 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 10:18:14,512 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 10:18:16,630 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 10:18:16,631 INFO β New best macro AUROC = 0.8495 β saved.
2026-04-13 10:18:16,631 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 10:18:16,885 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 10:18:17,008 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 10:18:17,010 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:18:17,131 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 10:18:17,131 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:18:17,132 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 10:18:17,246 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:18:18,637 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:18:18,785 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:18:18,952 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:18:19,084 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:19:16,802 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:19:16,985 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:19:17,698 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:19:17,850 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:19:18,740 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:19:18,881 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:19:19,644 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:19:19,644 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:19:19,644 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 10:19:19,755 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:19:20,376 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:19:20,520 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:19:20,654 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:19:20,765 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:19:36,740 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:19:36,741 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:19:36,741 INFO ββ Hub push complete ββ
2026-04-13 10:19:51,780 INFO [Step 11/200] det=skip para=-0.0066 raw_rwd=0.3342Β±0.0127 rwd=0.3342
2026-04-13 10:19:51,780 INFO per-gen rewards: deepseek=0.331 falcon3-=0.319 gemini-1=0.340 gemini-2=0.339 gemini-p=0.338 gemini-p=0.337 gpt-3.5-=0.340 gpt-4-tu=0.298 gpt-4-tu=0.338 gpt-4.5-=0.338 gpt-4o=0.325 gpt-4o-m=0.340 llama-2-=0.338 llama-2-=0.341 llama-3.=0.339 llama-3.=0.339 ministra=0.329 mistral-=0.342 mixtral-=0.343 o3-mini=0.333 qwen1.5-=0.339 text-bis=0.336
2026-04-13 10:20:32,136 INFO [Step 12/200] det=3.7279 para=0.0000 raw_rwd=0.3312Β±0.0164 rwd=0.3312
2026-04-13 10:20:32,136 INFO loss components: L_human=0.643 L_xm_original=0.545 L_t5_para=0.473 L_synonym_replacement=0.438 L_homoglyphs=0.428 L_article_deletion=0.459 L_misspelling=0.457 total=3.443
2026-04-13 10:20:32,136 INFO per-gen rewards: deepseek=0.330 falcon3-=0.325 gemini-1=0.340 gemini-2=0.339 gemini-p=0.340 gemini-p=0.307 gpt-3.5-=0.334 gpt-4-tu=0.296 gpt-4-tu=0.298 gpt-4.5-=0.341 gpt-4o=0.331 gpt-4o-m=0.329 llama-2-=0.338 llama-2-=0.335 llama-3.=0.332 llama-3.=0.319 ministra=0.331 mistral-=0.337 mixtral-=0.340 o3-mini=0.330 qwen1.5-=0.336 text-bis=0.341
2026-04-13 10:20:46,603 INFO [Step 13/200] det=skip para=-0.0293 raw_rwd=0.3091Β±0.0274 rwd=0.3091
2026-04-13 10:20:46,604 INFO per-gen rewards: deepseek=0.283 falcon3-=0.301 gemini-1=0.306 gemini-2=0.319 gemini-p=0.322 gemini-p=0.261 gpt-3.5-=0.319 gpt-4-tu=0.318 gpt-4-tu=0.319 gpt-4.5-=0.323 gpt-4o=0.320 gpt-4o-m=0.320 llama-2-=0.312 llama-2-=0.320 llama-3.=0.288 llama-3.=0.316 ministra=0.305 mistral-=0.318 mixtral-=0.318 o3-mini=0.316 qwen1.5-=0.251 text-bis=0.324
2026-04-13 10:21:26,810 INFO [Step 14/200] det=3.4187 para=-0.0442 raw_rwd=0.3110Β±0.0264 rwd=0.3110
2026-04-13 10:21:26,810 INFO loss components: L_human=0.466 L_xm_original=0.536 L_t5_para=0.483 L_synonym_replacement=0.449 L_homoglyphs=0.438 L_article_deletion=0.471 L_misspelling=0.451 total=3.294
2026-04-13 10:21:26,810 INFO per-gen rewards: deepseek=0.321 falcon3-=0.308 gemini-1=0.318 gemini-2=0.318 gemini-p=0.321 gemini-p=0.317 gpt-3.5-=0.281 gpt-4-tu=0.256 gpt-4-tu=0.319 gpt-4.5-=0.321 gpt-4o=0.317 gpt-4o-m=0.306 llama-2-=0.319 llama-2-=0.318 llama-3.=0.317 llama-3.=0.320 ministra=0.305 mistral-=0.319 mixtral-=0.318 o3-mini=0.318 qwen1.5-=0.315 text-bis=0.318
2026-04-13 10:21:41,526 INFO [Step 15/200] det=skip para=-0.0307 raw_rwd=0.2835Β±0.0418 rwd=0.2835
2026-04-13 10:21:41,526 INFO per-gen rewards: deepseek=0.300 falcon3-=0.271 gemini-1=0.258 gemini-2=0.262 gemini-p=0.304 gemini-p=0.294 gpt-3.5-=0.283 gpt-4-tu=0.308 gpt-4-tu=0.299 gpt-4.5-=0.289 gpt-4o=0.288 gpt-4o-m=0.280 llama-2-=0.304 llama-2-=0.291 llama-3.=0.301 llama-3.=0.296 ministra=0.261 mistral-=0.280 mixtral-=0.294 o3-mini=0.298 qwen1.5-=0.294 text-bis=0.305
2026-04-13 10:26:24,018 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 10:26:24,018 INFO β MACRO_AVG 0.9307 β
2026-04-13 10:26:24,018 INFO β deepseek-r1-distill-qwen-32b 0.9608
2026-04-13 10:26:24,018 INFO β falcon3-10b-instruct 0.9834
2026-04-13 10:26:24,018 INFO β gemini-1.5-pro 0.8948
2026-04-13 10:26:24,018 INFO β gemini-2.0-flash 0.9442
2026-04-13 10:26:24,019 INFO β gemini-pro 0.8394
2026-04-13 10:26:24,019 INFO β gemini-pro-paraphrase 0.8759
2026-04-13 10:26:24,019 INFO β gpt-3.5-turbo 0.9910
2026-04-13 10:26:24,019 INFO β gpt-4-turbo 0.9544
2026-04-13 10:26:24,019 INFO β gpt-4-turbo-paraphrase 0.9308
2026-04-13 10:26:24,019 INFO β gpt-4.5-preview 0.9348
2026-04-13 10:26:24,019 INFO β gpt-4o 0.9893
2026-04-13 10:26:24,019 INFO β gpt-4o-mini 0.9899
2026-04-13 10:26:24,019 INFO β llama-2-70b-chat 0.8703
2026-04-13 10:26:24,019 INFO β llama-2-7b-chat 0.8655
2026-04-13 10:26:24,019 INFO β llama-3.1-8b-instruct 0.9294
2026-04-13 10:26:24,019 INFO β llama-3.3-70b-instruct 0.9798
2026-04-13 10:26:24,019 INFO β ministral-8b-instruct-2410 0.9783
2026-04-13 10:26:24,019 INFO β mistral-7b-instruct-v0.2 0.8875
2026-04-13 10:26:24,019 INFO β mixtral-8x7b-instruct-v0.1 0.8637
2026-04-13 10:26:24,019 INFO β o3-mini 0.9883
2026-04-13 10:26:24,019 INFO β qwen1.5-72b-chat-8bit 0.9191
2026-04-13 10:26:24,019 INFO β text-bison-002 0.9046
2026-04-13 10:26:24,019 INFO β (prev best) 0.8495
2026-04-13 10:26:24,019 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 10:26:24,019 INFO β article_deletion 0.9925 ~
2026-04-13 10:26:24,019 INFO β homoglyphs 1.0000 ~
2026-04-13 10:26:24,019 INFO β misspelling 0.9957 ~
2026-04-13 10:26:24,019 INFO β no_attack 0.9731 ~
2026-04-13 10:26:24,019 INFO β synonym_replacement 0.9981 ~
2026-04-13 10:26:24,019 INFO β t5_paraphrase 0.9800 ~
2026-04-13 10:26:24,019 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 10:26:28,637 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 10:26:30,752 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 10:26:30,752 INFO β New best macro AUROC = 0.9307 β saved.
2026-04-13 10:26:30,752 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 10:26:31,169 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 10:26:31,395 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 10:26:31,396 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:26:31,628 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 10:26:31,629 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:26:31,630 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 10:26:31,844 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:26:32,996 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:26:33,175 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:26:33,325 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:27:34,669 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:27:34,804 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:27:35,596 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:27:35,730 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:27:36,385 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:27:36,539 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:27:37,532 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:27:37,533 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:27:37,533 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 10:27:37,647 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:27:38,271 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:27:38,433 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:27:38,563 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:27:52,893 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:27:52,894 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:27:52,894 INFO ββ Hub push complete ββ
2026-04-13 10:28:33,569 INFO [Step 16/200] det=3.3040 para=-0.0040 raw_rwd=0.2819Β±0.0352 rwd=0.2819
2026-04-13 10:28:33,569 INFO loss components: L_human=0.437 L_xm_original=0.484 L_t5_para=0.453 L_synonym_replacement=0.436 L_homoglyphs=0.433 L_article_deletion=0.436 L_misspelling=0.436 total=3.115
2026-04-13 10:28:33,569 INFO per-gen rewards: deepseek=0.289 falcon3-=0.264 gemini-1=0.261 gemini-2=0.298 gemini-p=0.222 gemini-p=0.300 gpt-3.5-=0.286 gpt-4-tu=0.304 gpt-4-tu=0.298 gpt-4.5-=0.295 gpt-4o=0.301 gpt-4o-m=0.251 llama-2-=0.299 llama-2-=0.221 llama-3.=0.279 llama-3.=0.299 ministra=0.297 mistral-=0.297 mixtral-=0.297 o3-mini=0.278 qwen1.5-=0.301 text-bis=0.300
2026-04-13 10:28:48,285 INFO [Step 17/200] det=skip para=-0.0038 raw_rwd=0.2548Β±0.0413 rwd=0.2548
2026-04-13 10:28:48,286 INFO per-gen rewards: deepseek=0.268 falcon3-=0.272 gemini-1=0.268 gemini-2=0.272 gemini-p=0.271 gemini-p=0.273 gpt-3.5-=0.246 gpt-4-tu=0.264 gpt-4-tu=0.268 gpt-4.5-=0.270 gpt-4o=0.270 gpt-4o-m=0.241 llama-2-=0.271 llama-2-=0.144 llama-3.=0.222 llama-3.=0.269 ministra=0.241 mistral-=0.148 mixtral-=0.272 o3-mini=0.270 qwen1.5-=0.279 text-bis=0.243
2026-04-13 10:29:28,249 INFO [Step 18/200] det=3.2222 para=-0.0115 raw_rwd=0.2549Β±0.0401 rwd=0.2549
2026-04-13 10:29:28,250 INFO loss components: L_human=0.436 L_xm_original=0.533 L_t5_para=0.449 L_synonym_replacement=0.470 L_homoglyphs=0.427 L_article_deletion=0.470 L_misspelling=0.445 total=3.231
2026-04-13 10:29:28,250 INFO per-gen rewards: deepseek=0.264 falcon3-=0.269 gemini-1=0.235 gemini-2=0.270 gemini-p=0.268 gemini-p=0.269 gpt-3.5-=0.225 gpt-4-tu=0.264 gpt-4-tu=0.258 gpt-4.5-=0.148 gpt-4o=0.247 gpt-4o-m=0.268 llama-2-=0.268 llama-2-=0.273 llama-3.=0.245 llama-3.=0.264 ministra=0.266 mistral-=0.267 mixtral-=0.271 o3-mini=0.262 qwen1.5-=0.263 text-bis=0.281
2026-04-13 10:29:42,913 INFO [Step 19/200] det=skip para=-0.0567 raw_rwd=0.2258Β±0.0337 rwd=0.2258
2026-04-13 10:29:42,913 INFO per-gen rewards: deepseek=0.230 falcon3-=0.224 gemini-1=0.229 gemini-2=0.232 gemini-p=0.229 gemini-p=0.228 gpt-3.5-=0.231 gpt-4-tu=0.223 gpt-4-tu=0.242 gpt-4.5-=0.068 gpt-4o=0.210 gpt-4o-m=0.228 llama-2-=0.246 llama-2-=0.236 llama-3.=0.240 llama-3.=0.238 ministra=0.209 mistral-=0.213 mixtral-=0.252 o3-mini=0.238 qwen1.5-=0.227 text-bis=0.247
2026-04-13 10:30:23,535 INFO [Step 20/200] det=3.1385 para=-0.0000 raw_rwd=0.2063Β±0.0539 rwd=0.2063
2026-04-13 10:30:23,535 INFO loss components: L_human=0.433 L_xm_original=0.512 L_t5_para=0.457 L_synonym_replacement=0.451 L_homoglyphs=0.430 L_article_deletion=0.445 L_misspelling=0.434 total=3.163
2026-04-13 10:30:23,535 INFO per-gen rewards: deepseek=0.204 falcon3-=0.167 gemini-1=0.207 gemini-2=0.233 gemini-p=0.212 gemini-p=0.246 gpt-3.5-=0.210 gpt-4-tu=0.237 gpt-4-tu=0.095 gpt-4.5-=0.225 gpt-4o=0.227 gpt-4o-m=0.207 llama-2-=0.213 llama-2-=0.236 llama-3.=0.203 llama-3.=0.156 ministra=0.240 mistral-=0.083 mixtral-=0.234 o3-mini=0.178 qwen1.5-=0.231 text-bis=0.231
2026-04-13 10:35:06,326 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 10:35:06,327 INFO β MACRO_AVG 0.9875 β
2026-04-13 10:35:06,327 INFO β deepseek-r1-distill-qwen-32b 0.9988
2026-04-13 10:35:06,327 INFO β falcon3-10b-instruct 0.9995
2026-04-13 10:35:06,327 INFO β gemini-1.5-pro 0.9606
2026-04-13 10:35:06,327 INFO β gemini-2.0-flash 0.9988
2026-04-13 10:35:06,327 INFO β gemini-pro 0.9650
2026-04-13 10:35:06,327 INFO β gemini-pro-paraphrase 0.9663
2026-04-13 10:35:06,327 INFO β gpt-3.5-turbo 0.9985
2026-04-13 10:35:06,327 INFO β gpt-4-turbo 0.9945
2026-04-13 10:35:06,327 INFO β gpt-4-turbo-paraphrase 0.9839
2026-04-13 10:35:06,327 INFO β gpt-4.5-preview 0.9946
2026-04-13 10:35:06,327 INFO β gpt-4o 0.9992
2026-04-13 10:35:06,327 INFO β gpt-4o-mini 0.9995
2026-04-13 10:35:06,327 INFO β llama-2-70b-chat 0.9804
2026-04-13 10:35:06,327 INFO β llama-2-7b-chat 0.9761
2026-04-13 10:35:06,327 INFO β llama-3.1-8b-instruct 0.9870
2026-04-13 10:35:06,327 INFO β llama-3.3-70b-instruct 0.9966
2026-04-13 10:35:06,327 INFO β ministral-8b-instruct-2410 0.9992
2026-04-13 10:35:06,327 INFO β mistral-7b-instruct-v0.2 0.9784
2026-04-13 10:35:06,327 INFO β mixtral-8x7b-instruct-v0.1 0.9759
2026-04-13 10:35:06,327 INFO β o3-mini 0.9995
2026-04-13 10:35:06,327 INFO β qwen1.5-72b-chat-8bit 0.9879
2026-04-13 10:35:06,327 INFO β text-bison-002 0.9853
2026-04-13 10:35:06,327 INFO β (prev best) 0.9307
2026-04-13 10:35:06,327 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 10:35:06,327 INFO β article_deletion 0.9964 ~
2026-04-13 10:35:06,327 INFO β homoglyphs 0.9992 ~
2026-04-13 10:35:06,327 INFO β misspelling 0.9976 ~
2026-04-13 10:35:06,327 INFO β no_attack 0.9948 ~
2026-04-13 10:35:06,327 INFO β synonym_replacement 0.9961 ~
2026-04-13 10:35:06,327 INFO β t5_paraphrase 0.9800 ~
2026-04-13 10:35:06,327 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 10:35:11,101 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 10:35:13,197 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 10:35:13,197 INFO β New best macro AUROC = 0.9875 β saved.
2026-04-13 10:35:13,197 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 10:35:13,385 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 10:35:13,506 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 10:35:13,508 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:35:13,628 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 10:35:13,629 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:35:13,629 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 10:35:13,741 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:35:14,812 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:35:14,955 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:35:15,082 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:35:15,197 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:36:09,956 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:36:10,129 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:36:10,981 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:36:11,162 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:36:11,886 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:36:12,181 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:36:12,926 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:36:12,927 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:36:12,927 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 10:36:13,037 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:36:13,663 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:36:13,805 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:36:13,935 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:36:14,061 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:36:31,164 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:36:31,165 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:36:31,165 INFO ββ Hub push complete ββ
2026-04-13 10:36:46,070 INFO [Step 21/200] det=skip para=-0.0019 raw_rwd=0.1889Β±0.0406 rwd=0.1889
2026-04-13 10:36:46,070 INFO per-gen rewards: deepseek=0.177 falcon3-=0.202 gemini-1=0.164 gemini-2=0.176 gemini-p=0.144 gemini-p=0.195 gpt-3.5-=0.205 gpt-4-tu=0.164 gpt-4-tu=0.077 gpt-4.5-=0.224 gpt-4o=0.188 gpt-4o-m=0.172 llama-2-=0.163 llama-2-=0.205 llama-3.=0.204 llama-3.=0.213 ministra=0.204 mistral-=0.211 mixtral-=0.207 o3-mini=0.198 qwen1.5-=0.232 text-bis=0.200
2026-04-13 10:37:26,915 INFO [Step 22/200] det=3.1162 para=0.0000 raw_rwd=0.1821Β±0.0432 rwd=0.1821
2026-04-13 10:37:26,916 INFO loss components: L_human=0.486 L_xm_original=0.435 L_t5_para=0.446 L_synonym_replacement=0.439 L_homoglyphs=0.428 L_article_deletion=0.434 L_misspelling=0.433 total=3.101
2026-04-13 10:37:26,916 INFO per-gen rewards: deepseek=0.204 falcon3-=0.195 gemini-1=0.152 gemini-2=0.194 gemini-p=0.226 gemini-p=0.179 gpt-3.5-=0.160 gpt-4-tu=0.193 gpt-4-tu=0.075 gpt-4.5-=0.208 gpt-4o=0.208 gpt-4o-m=0.178 llama-2-=0.062 llama-2-=0.205 llama-3.=0.210 llama-3.=0.178 ministra=0.198 mistral-=0.190 mixtral-=0.174 o3-mini=0.176 qwen1.5-=0.199 text-bis=0.066
2026-04-13 10:37:41,623 INFO [Step 23/200] det=skip para=-0.0000 raw_rwd=0.1795Β±0.0224 rwd=0.1795
2026-04-13 10:37:41,623 INFO per-gen rewards: deepseek=0.188 falcon3-=0.189 gemini-1=0.173 gemini-2=0.179 gemini-p=0.176 gemini-p=0.203 gpt-3.5-=0.179 gpt-4-tu=0.157 gpt-4-tu=0.206 gpt-4.5-=0.198 gpt-4o=0.188 gpt-4o-m=0.187 llama-2-=0.191 llama-2-=0.199 llama-3.=0.169 llama-3.=0.185 ministra=0.169 mistral-=0.183 mixtral-=0.154 o3-mini=0.165 qwen1.5-=0.180 text-bis=0.162
2026-04-13 10:38:21,946 INFO [Step 24/200] det=3.1562 para=-0.0010 raw_rwd=0.1821Β±0.0233 rwd=0.1821
2026-04-13 10:38:21,946 INFO loss components: L_human=0.477 L_xm_original=0.504 L_t5_para=0.436 L_synonym_replacement=0.444 L_homoglyphs=0.433 L_article_deletion=0.466 L_misspelling=0.437 total=3.196
2026-04-13 10:38:21,946 INFO per-gen rewards: deepseek=0.174 falcon3-=0.191 gemini-1=0.192 gemini-2=0.173 gemini-p=0.199 gemini-p=0.169 gpt-3.5-=0.168 gpt-4-tu=0.165 gpt-4-tu=0.175 gpt-4.5-=0.194 gpt-4o=0.191 gpt-4o-m=0.189 llama-2-=0.184 llama-2-=0.147 llama-3.=0.193 llama-3.=0.151 ministra=0.193 mistral-=0.110 mixtral-=0.185 o3-mini=0.187 qwen1.5-=0.183 text-bis=0.201
2026-04-13 10:38:36,736 INFO [Step 25/200] det=skip para=-0.0000 raw_rwd=0.1658Β±0.0147 rwd=0.1658
2026-04-13 10:38:36,736 INFO per-gen rewards: deepseek=0.174 falcon3-=0.154 gemini-1=0.159 gemini-2=0.167 gemini-p=0.134 gemini-p=0.168 gpt-3.5-=0.169 gpt-4-tu=0.174 gpt-4-tu=0.173 gpt-4.5-=0.154 gpt-4o=0.163 gpt-4o-m=0.164 llama-2-=0.149 llama-2-=0.162 llama-3.=0.168 llama-3.=0.183 ministra=0.170 mistral-=0.167 mixtral-=0.174 o3-mini=0.170 qwen1.5-=0.180 text-bis=0.156
2026-04-13 10:43:19,473 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 10:43:19,473 INFO β MACRO_AVG 0.9876 β
2026-04-13 10:43:19,473 INFO β deepseek-r1-distill-qwen-32b 0.9964
2026-04-13 10:43:19,473 INFO β falcon3-10b-instruct 0.9930
2026-04-13 10:43:19,473 INFO β gemini-1.5-pro 0.9625
2026-04-13 10:43:19,473 INFO β gemini-2.0-flash 0.9969
2026-04-13 10:43:19,473 INFO β gemini-pro 0.9747
2026-04-13 10:43:19,473 INFO β gemini-pro-paraphrase 0.9735
2026-04-13 10:43:19,473 INFO β gpt-3.5-turbo 0.9964
2026-04-13 10:43:19,473 INFO β gpt-4-turbo 0.9924
2026-04-13 10:43:19,473 INFO β gpt-4-turbo-paraphrase 0.9851
2026-04-13 10:43:19,473 INFO β gpt-4.5-preview 0.9906
2026-04-13 10:43:19,473 INFO β gpt-4o 0.9980
2026-04-13 10:43:19,473 INFO β gpt-4o-mini 0.9984
2026-04-13 10:43:19,473 INFO β llama-2-70b-chat 0.9851
2026-04-13 10:43:19,473 INFO β llama-2-7b-chat 0.9830
2026-04-13 10:43:19,473 INFO β llama-3.1-8b-instruct 0.9819
2026-04-13 10:43:19,474 INFO β llama-3.3-70b-instruct 0.9887
2026-04-13 10:43:19,474 INFO β ministral-8b-instruct-2410 0.9955
2026-04-13 10:43:19,474 INFO β mistral-7b-instruct-v0.2 0.9838
2026-04-13 10:43:19,474 INFO β mixtral-8x7b-instruct-v0.1 0.9822
2026-04-13 10:43:19,474 INFO β o3-mini 0.9967
2026-04-13 10:43:19,474 INFO β qwen1.5-72b-chat-8bit 0.9866
2026-04-13 10:43:19,474 INFO β text-bison-002 0.9853
2026-04-13 10:43:19,474 INFO β (prev best) 0.9875
2026-04-13 10:43:19,474 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 10:43:19,474 INFO β article_deletion 0.9963 ~
2026-04-13 10:43:19,474 INFO β homoglyphs 0.9994 ~
2026-04-13 10:43:19,474 INFO β misspelling 0.9970 ~
2026-04-13 10:43:19,474 INFO β no_attack 0.9951 ~
2026-04-13 10:43:19,474 INFO β synonym_replacement 0.9935 ~
2026-04-13 10:43:19,474 INFO β t5_paraphrase 0.9800 ~
2026-04-13 10:43:19,474 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 10:43:24,030 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 10:43:26,148 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 10:43:26,148 INFO β New best macro AUROC = 0.9876 β saved.
2026-04-13 10:43:26,148 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 10:43:26,340 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 10:43:26,461 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 10:43:26,462 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:43:26,579 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 10:43:26,580 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:43:26,580 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 10:43:26,695 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:43:27,788 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:43:27,946 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:43:28,078 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:44:27,996 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:44:28,138 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:44:28,861 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:44:28,995 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:44:29,742 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:44:29,873 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:44:30,698 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:44:30,699 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:44:30,699 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 10:44:30,810 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:44:31,439 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:44:31,582 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:44:31,712 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:44:43,808 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:44:43,809 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:44:43,809 INFO ββ Hub push complete ββ
2026-04-13 10:45:24,444 INFO [Step 26/200] det=3.0797 para=-0.0055 raw_rwd=0.1709Β±0.0137 rwd=0.1709
2026-04-13 10:45:24,444 INFO loss components: L_human=0.439 L_xm_original=0.448 L_t5_para=0.432 L_synonym_replacement=0.454 L_homoglyphs=0.428 L_article_deletion=0.439 L_misspelling=0.436 total=3.075
2026-04-13 10:45:24,444 INFO per-gen rewards: deepseek=0.178 falcon3-=0.162 gemini-1=0.168 gemini-2=0.164 gemini-p=0.187 gemini-p=0.161 gpt-3.5-=0.172 gpt-4-tu=0.167 gpt-4-tu=0.168 gpt-4.5-=0.152 gpt-4o=0.177 gpt-4o-m=0.169 llama-2-=0.159 llama-2-=0.148 llama-3.=0.177 llama-3.=0.196 ministra=0.173 mistral-=0.176 mixtral-=0.166 o3-mini=0.166 qwen1.5-=0.174 text-bis=0.175
2026-04-13 10:45:39,057 INFO [Step 27/200] det=skip para=0.0168 raw_rwd=0.1533Β±0.0292 rwd=0.1533
2026-04-13 10:45:39,058 INFO per-gen rewards: deepseek=0.146 falcon3-=0.151 gemini-1=0.169 gemini-2=0.169 gemini-p=0.143 gemini-p=0.144 gpt-3.5-=0.154 gpt-4-tu=0.116 gpt-4-tu=0.129 gpt-4.5-=0.130 gpt-4o=0.150 gpt-4o-m=0.146 llama-2-=0.129 llama-2-=0.146 llama-3.=0.158 llama-3.=0.123 ministra=0.162 mistral-=0.136 mixtral-=0.170 o3-mini=0.159 qwen1.5-=0.205 text-bis=0.143
2026-04-13 10:46:19,550 INFO [Step 28/200] det=3.1591 para=0.0315 raw_rwd=0.1581Β±0.0284 rwd=0.1581
2026-04-13 10:46:19,550 INFO loss components: L_human=0.479 L_xm_original=0.437 L_t5_para=0.431 L_synonym_replacement=0.433 L_homoglyphs=0.427 L_article_deletion=0.425 L_misspelling=0.433 total=3.065
2026-04-13 10:46:19,550 INFO per-gen rewards: deepseek=0.171 falcon3-=0.160 gemini-1=0.150 gemini-2=0.146 gemini-p=0.147 gemini-p=0.153 gpt-3.5-=0.153 gpt-4-tu=0.150 gpt-4-tu=0.230 gpt-4.5-=0.144 gpt-4o=0.138 gpt-4o-m=0.157 llama-2-=0.128 llama-2-=0.125 llama-3.=0.185 llama-3.=0.138 ministra=0.181 mistral-=0.149 mixtral-=0.165 o3-mini=0.151 qwen1.5-=0.178 text-bis=0.201
2026-04-13 10:46:34,141 INFO [Step 29/200] det=skip para=0.0000 raw_rwd=0.1577Β±0.0125 rwd=0.1577
2026-04-13 10:46:34,142 INFO per-gen rewards: deepseek=0.148 falcon3-=0.168 gemini-1=0.170 gemini-2=0.149 gemini-p=0.157 gemini-p=0.153 gpt-3.5-=0.157 gpt-4-tu=0.159 gpt-4-tu=0.177 gpt-4.5-=0.141 gpt-4o=0.157 gpt-4o-m=0.153 llama-2-=0.149 llama-2-=0.157 llama-3.=0.160 llama-3.=0.167 ministra=0.163 mistral-=0.152 mixtral-=0.143 o3-mini=0.159 qwen1.5-=0.138 text-bis=0.160
2026-04-13 10:47:14,419 INFO [Step 30/200] det=3.0753 para=0.0043 raw_rwd=0.1512Β±0.0123 rwd=0.1512
2026-04-13 10:47:14,419 INFO loss components: L_human=0.435 L_xm_original=0.432 L_t5_para=0.431 L_synonym_replacement=0.441 L_homoglyphs=0.424 L_article_deletion=0.428 L_misspelling=0.431 total=3.022
2026-04-13 10:47:14,419 INFO per-gen rewards: deepseek=0.143 falcon3-=0.150 gemini-1=0.155 gemini-2=0.149 gemini-p=0.154 gemini-p=0.158 gpt-3.5-=0.160 gpt-4-tu=0.166 gpt-4-tu=0.160 gpt-4.5-=0.145 gpt-4o=0.147 gpt-4o-m=0.151 llama-2-=0.142 llama-2-=0.159 llama-3.=0.146 llama-3.=0.144 ministra=0.157 mistral-=0.125 mixtral-=0.153 o3-mini=0.150 qwen1.5-=0.157 text-bis=0.158
2026-04-13 10:51:57,332 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 10:51:57,333 INFO β MACRO_AVG 0.9933 β
2026-04-13 10:51:57,333 INFO β deepseek-r1-distill-qwen-32b 0.9992
2026-04-13 10:51:57,333 INFO β falcon3-10b-instruct 0.9994
2026-04-13 10:51:57,333 INFO β gemini-1.5-pro 0.9621
2026-04-13 10:51:57,333 INFO β gemini-2.0-flash 0.9994
2026-04-13 10:51:57,333 INFO β gemini-pro 0.9799
2026-04-13 10:51:57,333 INFO β gemini-pro-paraphrase 0.9831
2026-04-13 10:51:57,333 INFO β gpt-3.5-turbo 0.9997
2026-04-13 10:51:57,333 INFO β gpt-4-turbo 0.9995
2026-04-13 10:51:57,333 INFO β gpt-4-turbo-paraphrase 0.9931
2026-04-13 10:51:57,333 INFO β gpt-4.5-preview 0.9960
2026-04-13 10:51:57,333 INFO β gpt-4o 0.9999
2026-04-13 10:51:57,333 INFO β gpt-4o-mini 0.9999
2026-04-13 10:51:57,333 INFO β llama-2-70b-chat 0.9905
2026-04-13 10:51:57,333 INFO β llama-2-7b-chat 0.9911
2026-04-13 10:51:57,333 INFO β llama-3.1-8b-instruct 0.9897
2026-04-13 10:51:57,333 INFO β llama-3.3-70b-instruct 0.9990
2026-04-13 10:51:57,333 INFO β ministral-8b-instruct-2410 0.9995
2026-04-13 10:51:57,333 INFO β mistral-7b-instruct-v0.2 0.9909
2026-04-13 10:51:57,333 INFO β mixtral-8x7b-instruct-v0.1 0.9896
2026-04-13 10:51:57,333 INFO β o3-mini 0.9997
2026-04-13 10:51:57,333 INFO β qwen1.5-72b-chat-8bit 0.9972
2026-04-13 10:51:57,333 INFO β text-bison-002 0.9945
2026-04-13 10:51:57,333 INFO β (prev best) 0.9876
2026-04-13 10:51:57,333 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 10:51:57,333 INFO β article_deletion 0.9974 ~
2026-04-13 10:51:57,333 INFO β homoglyphs 0.9997 ~
2026-04-13 10:51:57,333 INFO β misspelling 0.9985 ~
2026-04-13 10:51:57,333 INFO β no_attack 0.9956 ~
2026-04-13 10:51:57,333 INFO β synonym_replacement 0.9991 ~
2026-04-13 10:51:57,333 INFO β t5_paraphrase 0.9800 ~
2026-04-13 10:51:57,333 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 10:52:02,074 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 10:52:04,212 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 10:52:04,213 INFO β New best macro AUROC = 0.9933 β saved.
2026-04-13 10:52:04,213 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 10:52:04,421 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 10:52:04,552 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 10:52:04,553 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:52:04,667 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 10:52:04,668 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:52:04,669 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 10:52:04,778 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:52:05,882 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:52:06,023 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:52:06,162 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:52:06,295 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:53:04,186 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:53:04,320 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:53:05,259 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:53:05,391 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:53:06,229 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:53:06,361 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:53:07,379 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:53:07,380 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 10:53:07,380 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 10:53:07,490 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:53:08,120 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 10:53:08,255 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 10:53:08,385 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 10:53:08,498 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 10:53:14,631 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 10:53:14,632 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 10:53:14,632 INFO ββ Hub push complete ββ
2026-04-13 10:53:29,491 INFO [Step 31/200] det=skip para=0.0000 raw_rwd=0.1452Β±0.0198 rwd=0.1452
2026-04-13 10:53:29,491 INFO per-gen rewards: deepseek=0.155 falcon3-=0.142 gemini-1=0.165 gemini-2=0.148 gemini-p=0.155 gemini-p=0.129 gpt-3.5-=0.153 gpt-4-tu=0.127 gpt-4-tu=0.123 gpt-4.5-=0.151 gpt-4o=0.147 gpt-4o-m=0.138 llama-2-=0.138 llama-2-=0.177 llama-3.=0.137 llama-3.=0.149 ministra=0.128 mistral-=0.140 mixtral-=0.136 o3-mini=0.140 qwen1.5-=0.163 text-bis=0.148
2026-04-13 10:54:10,423 INFO [Step 32/200] det=3.0615 para=0.0240 raw_rwd=0.1455Β±0.0234 rwd=0.1455
2026-04-13 10:54:10,423 INFO loss components: L_human=0.447 L_xm_original=0.441 L_t5_para=0.428 L_synonym_replacement=0.434 L_homoglyphs=0.426 L_article_deletion=0.427 L_misspelling=0.442 total=3.047
2026-04-13 10:54:10,423 INFO per-gen rewards: deepseek=0.142 falcon3-=0.148 gemini-1=0.148 gemini-2=0.146 gemini-p=0.131 gemini-p=0.161 gpt-3.5-=0.141 gpt-4-tu=0.134 gpt-4-tu=0.118 gpt-4.5-=0.122 gpt-4o=0.149 gpt-4o-m=0.163 llama-2-=0.145 llama-2-=0.135 llama-3.=0.137 llama-3.=0.142 ministra=0.131 mistral-=0.148 mixtral-=0.134 o3-mini=0.165 qwen1.5-=0.122 text-bis=0.163
2026-04-13 10:54:25,296 INFO [Step 33/200] det=skip para=0.0000 raw_rwd=0.1339Β±0.0205 rwd=0.1339
2026-04-13 10:54:25,297 INFO per-gen rewards: deepseek=0.135 falcon3-=0.130 gemini-1=0.136 gemini-2=0.139 gemini-p=0.133 gemini-p=0.137 gpt-3.5-=0.146 gpt-4-tu=0.120 gpt-4-tu=0.173 gpt-4.5-=0.122 gpt-4o=0.118 gpt-4o-m=0.131 llama-2-=0.108 llama-2-=0.128 llama-3.=0.153 llama-3.=0.119 ministra=0.126 mistral-=0.128 mixtral-=0.184 o3-mini=0.124 qwen1.5-=0.134 text-bis=0.142
2026-04-13 10:55:06,256 INFO [Step 34/200] det=3.1308 para=-0.0000 raw_rwd=0.1332Β±0.0166 rwd=0.1332
2026-04-13 10:55:06,256 INFO loss components: L_human=0.435 L_xm_original=0.491 L_t5_para=0.426 L_synonym_replacement=0.442 L_homoglyphs=0.436 L_article_deletion=0.447 L_misspelling=0.443 total=3.120
2026-04-13 10:55:06,256 INFO per-gen rewards: deepseek=0.135 falcon3-=0.135 gemini-1=0.140 gemini-2=0.130 gemini-p=0.136 gemini-p=0.135 gpt-3.5-=0.133 gpt-4-tu=0.137 gpt-4-tu=0.131 gpt-4.5-=0.121 gpt-4o=0.141 gpt-4o-m=0.122 llama-2-=0.117 llama-2-=0.143 llama-3.=0.130 llama-3.=0.149 ministra=0.130 mistral-=0.142 mixtral-=0.131 o3-mini=0.137 qwen1.5-=0.108 text-bis=0.144
2026-04-13 10:55:20,904 INFO [Step 35/200] det=skip para=-0.0000 raw_rwd=0.1265Β±0.0132 rwd=0.1265
2026-04-13 10:55:20,905 INFO per-gen rewards: deepseek=0.124 falcon3-=0.122 gemini-1=0.124 gemini-2=0.132 gemini-p=0.118 gemini-p=0.124 gpt-3.5-=0.124 gpt-4-tu=0.115 gpt-4-tu=0.114 gpt-4.5-=0.110 gpt-4o=0.125 gpt-4o-m=0.130 llama-2-=0.117 llama-2-=0.132 llama-3.=0.127 llama-3.=0.156 ministra=0.121 mistral-=0.124 mixtral-=0.163 o3-mini=0.123 qwen1.5-=0.133 text-bis=0.143
2026-04-13 11:00:04,871 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:00:04,871 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:00:04,871 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:00:04,871 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:00:04,871 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:00:04,871 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:00:04,871 INFO β gemini-pro 0.9851
2026-04-13 11:00:04,871 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:00:04,871 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:00:04,871 INFO β gpt-4-turbo 1.0000
2026-04-13 11:00:04,871 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:00:04,871 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:00:04,871 INFO β gpt-4o 0.9999
2026-04-13 11:00:04,871 INFO β gpt-4o-mini 0.9999
2026-04-13 11:00:04,871 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:00:04,871 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:00:04,871 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:00:04,872 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:00:04,872 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:00:04,872 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:00:04,872 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:00:04,872 INFO β o3-mini 0.9999
2026-04-13 11:00:04,872 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:00:04,872 INFO β text-bison-002 0.9992
2026-04-13 11:00:04,872 INFO β (prev best) 0.9933
2026-04-13 11:00:04,872 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:00:04,872 INFO β article_deletion 0.9982 ~
2026-04-13 11:00:04,872 INFO β homoglyphs 1.0000 ~
2026-04-13 11:00:04,872 INFO β misspelling 0.9996 ~
2026-04-13 11:00:04,872 INFO β no_attack 0.9966 ~
2026-04-13 11:00:04,872 INFO β synonym_replacement 0.9998 ~
2026-04-13 11:00:04,872 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:00:04,872 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:00:09,521 INFO Detector saved β ./adal_panclef/best_detector
2026-04-13 11:00:11,625 INFO Paraphraser saved β ./adal_panclef/best_paraphraser
2026-04-13 11:00:11,625 INFO β New best macro AUROC = 0.9960 β saved.
2026-04-13 11:00:11,625 INFO
ββ Pushing to HuggingFace Hub (trigger=best) ββ
2026-04-13 11:00:11,855 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 11:00:11,977 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 11:00:11,979 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 11:00:12,110 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 11:00:12,111 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 11:00:12,112 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 11:00:12,227 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 11:00:13,354 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 11:00:13,528 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 11:00:13,668 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 11:01:11,414 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 11:01:11,550 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 11:01:12,240 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 11:01:12,470 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 11:01:13,176 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 11:01:13,317 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 11:01:14,203 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 11:01:14,204 INFO β Detector pushed β https://huggingface.co/Shushant/ADAL-Detector-PANCLEF
2026-04-13 11:01:14,204 INFO Uploading paraphraser β Shushant/ADAL_PAN-t5-paraphraser β¦
2026-04-13 11:01:14,336 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 11:01:14,965 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 11:01:15,142 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/preupload/main "HTTP/1.1 200 OK"
2026-04-13 11:01:15,263 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 11:01:22,028 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser/commit/main "HTTP/1.1 200 OK"
2026-04-13 11:01:22,029 INFO β Paraphraser pushed β https://huggingface.co/Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 11:01:22,029 INFO ββ Hub push complete ββ
2026-04-13 11:01:36,940 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:01:36,940 INFO [Step 36/200] det=skip para=0.0038 raw_rwd=0.1255Β±0.0119 rwd=0.1255
2026-04-13 11:01:36,940 INFO per-gen rewards: deepseek=0.128 falcon3-=0.123 gemini-1=0.121 gemini-2=0.125 gemini-p=0.133 gemini-p=0.123 gpt-3.5-=0.122 gpt-4-tu=0.122 gpt-4-tu=0.135 gpt-4.5-=0.108 gpt-4o=0.123 gpt-4o-m=0.130 llama-2-=0.121 llama-2-=0.141 llama-3.=0.125 llama-3.=0.122 ministra=0.128 mistral-=0.148 mixtral-=0.127 o3-mini=0.122 qwen1.5-=0.133 text-bis=0.127
2026-04-13 11:01:51,580 INFO [Step 37/200] det=skip para=0.0139 raw_rwd=0.1233Β±0.0110 rwd=0.1233
2026-04-13 11:01:51,581 INFO per-gen rewards: deepseek=0.137 falcon3-=0.119 gemini-1=0.120 gemini-2=0.129 gemini-p=0.133 gemini-p=0.120 gpt-3.5-=0.122 gpt-4-tu=0.112 gpt-4-tu=0.117 gpt-4.5-=0.117 gpt-4o=0.118 gpt-4o-m=0.123 llama-2-=0.138 llama-2-=0.118 llama-3.=0.121 llama-3.=0.138 ministra=0.123 mistral-=0.131 mixtral-=0.119 o3-mini=0.126 qwen1.5-=0.116 text-bis=0.104
2026-04-13 11:02:06,245 INFO [Step 38/200] det=skip para=0.0000 raw_rwd=0.1266Β±0.0127 rwd=0.1266
2026-04-13 11:02:06,245 INFO per-gen rewards: deepseek=0.115 falcon3-=0.118 gemini-1=0.127 gemini-2=0.126 gemini-p=0.160 gemini-p=0.114 gpt-3.5-=0.130 gpt-4-tu=0.131 gpt-4-tu=0.149 gpt-4.5-=0.128 gpt-4o=0.122 gpt-4o-m=0.134 llama-2-=0.138 llama-2-=0.137 llama-3.=0.122 llama-3.=0.129 ministra=0.121 mistral-=0.116 mixtral-=0.145 o3-mini=0.129 qwen1.5-=0.117 text-bis=0.146
2026-04-13 11:02:21,082 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:02:21,083 INFO [Step 39/200] det=skip para=0.0004 raw_rwd=0.1256Β±0.0122 rwd=0.1256
2026-04-13 11:02:21,083 INFO per-gen rewards: deepseek=0.135 falcon3-=0.129 gemini-1=0.124 gemini-2=0.124 gemini-p=0.111 gemini-p=0.142 gpt-3.5-=0.130 gpt-4-tu=0.130 gpt-4-tu=0.119 gpt-4.5-=0.108 gpt-4o=0.126 gpt-4o-m=0.125 llama-2-=0.119 llama-2-=0.133 llama-3.=0.128 llama-3.=0.128 ministra=0.122 mistral-=0.130 mixtral-=0.125 o3-mini=0.121 qwen1.5-=0.127 text-bis=0.110
2026-04-13 11:02:35,876 INFO [Step 40/200] det=skip para=0.0000 raw_rwd=0.1234Β±0.0104 rwd=0.1234
2026-04-13 11:02:35,876 INFO per-gen rewards: deepseek=0.122 falcon3-=0.122 gemini-1=0.126 gemini-2=0.128 gemini-p=0.133 gemini-p=0.140 gpt-3.5-=0.128 gpt-4-tu=0.112 gpt-4-tu=0.112 gpt-4.5-=0.118 gpt-4o=0.128 gpt-4o-m=0.121 llama-2-=0.132 llama-2-=0.120 llama-3.=0.113 llama-3.=0.130 ministra=0.114 mistral-=0.124 mixtral-=0.108 o3-mini=0.128 qwen1.5-=0.127 text-bis=0.132
2026-04-13 11:07:19,194 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:07:19,194 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:07:19,195 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:07:19,195 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:07:19,195 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:07:19,195 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:07:19,195 INFO β gemini-pro 0.9851
2026-04-13 11:07:19,195 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:07:19,195 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:07:19,195 INFO β gpt-4-turbo 1.0000
2026-04-13 11:07:19,195 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:07:19,195 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:07:19,195 INFO β gpt-4o 0.9999
2026-04-13 11:07:19,195 INFO β gpt-4o-mini 0.9999
2026-04-13 11:07:19,195 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:07:19,195 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:07:19,195 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:07:19,195 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:07:19,195 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:07:19,195 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:07:19,195 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:07:19,195 INFO β o3-mini 0.9999
2026-04-13 11:07:19,195 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:07:19,195 INFO β text-bison-002 0.9992
2026-04-13 11:07:19,195 INFO β (prev best) 0.9960
2026-04-13 11:07:19,195 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:07:19,195 INFO β article_deletion 0.9981 ~
2026-04-13 11:07:19,195 INFO β homoglyphs 1.0000 ~
2026-04-13 11:07:19,195 INFO β misspelling 0.9995 ~
2026-04-13 11:07:19,195 INFO β no_attack 0.9966 ~
2026-04-13 11:07:19,195 INFO β synonym_replacement 0.9998 ~
2026-04-13 11:07:19,195 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:07:19,195 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:07:19,195 INFO No improvement (1/25) best=0.9960
2026-04-13 11:07:34,025 INFO [Step 41/200] det=skip para=-0.0000 raw_rwd=0.1254Β±0.0105 rwd=0.1254
2026-04-13 11:07:34,026 INFO per-gen rewards: deepseek=0.114 falcon3-=0.128 gemini-1=0.122 gemini-2=0.119 gemini-p=0.116 gemini-p=0.107 gpt-3.5-=0.129 gpt-4-tu=0.121 gpt-4-tu=0.120 gpt-4.5-=0.125 gpt-4o=0.125 gpt-4o-m=0.125 llama-2-=0.135 llama-2-=0.132 llama-3.=0.123 llama-3.=0.126 ministra=0.132 mistral-=0.116 mixtral-=0.122 o3-mini=0.136 qwen1.5-=0.149 text-bis=0.124
2026-04-13 11:07:48,634 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:07:48,634 INFO [Step 42/200] det=skip para=-0.0000 raw_rwd=0.1270Β±0.0102 rwd=0.1270
2026-04-13 11:07:48,634 INFO per-gen rewards: deepseek=0.126 falcon3-=0.118 gemini-1=0.125 gemini-2=0.126 gemini-p=0.114 gemini-p=0.149 gpt-3.5-=0.130 gpt-4-tu=0.134 gpt-4-tu=0.118 gpt-4.5-=0.137 gpt-4o=0.129 gpt-4o-m=0.133 llama-2-=0.124 llama-2-=0.122 llama-3.=0.122 llama-3.=0.125 ministra=0.126 mistral-=0.144 mixtral-=0.122 o3-mini=0.127 qwen1.5-=0.123 text-bis=0.135
2026-04-13 11:08:03,230 INFO [Step 43/200] det=skip para=0.0000 raw_rwd=0.1265Β±0.0115 rwd=0.1265
2026-04-13 11:08:03,230 INFO per-gen rewards: deepseek=0.117 falcon3-=0.125 gemini-1=0.124 gemini-2=0.121 gemini-p=0.124 gemini-p=0.122 gpt-3.5-=0.123 gpt-4-tu=0.107 gpt-4-tu=0.148 gpt-4.5-=0.160 gpt-4o=0.130 gpt-4o-m=0.128 llama-2-=0.121 llama-2-=0.143 llama-3.=0.124 llama-3.=0.128 ministra=0.128 mistral-=0.138 mixtral-=0.120 o3-mini=0.131 qwen1.5-=0.127 text-bis=0.132
2026-04-13 11:08:17,965 INFO [Step 44/200] det=skip para=0.0045 raw_rwd=0.1249Β±0.0103 rwd=0.1249
2026-04-13 11:08:17,965 INFO per-gen rewards: deepseek=0.123 falcon3-=0.117 gemini-1=0.123 gemini-2=0.123 gemini-p=0.124 gemini-p=0.115 gpt-3.5-=0.122 gpt-4-tu=0.136 gpt-4-tu=0.159 gpt-4.5-=0.130 gpt-4o=0.121 gpt-4o-m=0.129 llama-2-=0.133 llama-2-=0.135 llama-3.=0.129 llama-3.=0.130 ministra=0.124 mistral-=0.114 mixtral-=0.113 o3-mini=0.130 qwen1.5-=0.111 text-bis=0.121
2026-04-13 11:08:32,302 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:08:32,303 INFO [Step 45/200] det=skip para=0.0068 raw_rwd=0.1252Β±0.0107 rwd=0.1252
2026-04-13 11:08:32,303 INFO per-gen rewards: deepseek=0.122 falcon3-=0.120 gemini-1=0.128 gemini-2=0.127 gemini-p=0.135 gemini-p=0.132 gpt-3.5-=0.125 gpt-4-tu=0.110 gpt-4-tu=0.128 gpt-4.5-=0.122 gpt-4o=0.128 gpt-4o-m=0.123 llama-2-=0.132 llama-2-=0.126 llama-3.=0.128 llama-3.=0.130 ministra=0.122 mistral-=0.111 mixtral-=0.131 o3-mini=0.119 qwen1.5-=0.141 text-bis=0.140
2026-04-13 11:13:15,700 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:13:15,700 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:13:15,700 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:13:15,700 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:13:15,700 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:13:15,700 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:13:15,700 INFO β gemini-pro 0.9851
2026-04-13 11:13:15,700 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:13:15,700 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:13:15,700 INFO β gpt-4-turbo 1.0000
2026-04-13 11:13:15,700 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:13:15,700 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:13:15,700 INFO β gpt-4o 0.9999
2026-04-13 11:13:15,700 INFO β gpt-4o-mini 0.9999
2026-04-13 11:13:15,700 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:13:15,700 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:13:15,700 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:13:15,700 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:13:15,700 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:13:15,700 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:13:15,700 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:13:15,700 INFO β o3-mini 0.9999
2026-04-13 11:13:15,700 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:13:15,700 INFO β text-bison-002 0.9992
2026-04-13 11:13:15,700 INFO β (prev best) 0.9960
2026-04-13 11:13:15,701 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:13:15,701 INFO β article_deletion 0.9982 ~
2026-04-13 11:13:15,701 INFO β homoglyphs 1.0000 ~
2026-04-13 11:13:15,701 INFO β misspelling 0.9997 ~
2026-04-13 11:13:15,701 INFO β no_attack 0.9966 ~
2026-04-13 11:13:15,701 INFO β synonym_replacement 0.9998 ~
2026-04-13 11:13:15,701 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:13:15,701 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:13:15,701 INFO No improvement (2/25) best=0.9960
2026-04-13 11:13:30,607 INFO [Step 46/200] det=skip para=-0.0000 raw_rwd=0.1272Β±0.0105 rwd=0.1272
2026-04-13 11:13:30,607 INFO per-gen rewards: deepseek=0.123 falcon3-=0.134 gemini-1=0.123 gemini-2=0.128 gemini-p=0.132 gemini-p=0.120 gpt-3.5-=0.127 gpt-4-tu=0.139 gpt-4-tu=0.125 gpt-4.5-=0.133 gpt-4o=0.130 gpt-4o-m=0.133 llama-2-=0.114 llama-2-=0.152 llama-3.=0.126 llama-3.=0.122 ministra=0.124 mistral-=0.113 mixtral-=0.126 o3-mini=0.125 qwen1.5-=0.126 text-bis=0.124
2026-04-13 11:13:45,484 INFO [Step 47/200] det=skip para=0.0566 raw_rwd=0.1274Β±0.0225 rwd=0.1274
2026-04-13 11:13:45,484 INFO per-gen rewards: deepseek=0.124 falcon3-=0.131 gemini-1=0.164 gemini-2=0.130 gemini-p=0.109 gemini-p=0.115 gpt-3.5-=0.124 gpt-4-tu=0.127 gpt-4-tu=0.123 gpt-4.5-=0.114 gpt-4o=0.117 gpt-4o-m=0.124 llama-2-=0.134 llama-2-=0.119 llama-3.=0.116 llama-3.=0.132 ministra=0.135 mistral-=0.125 mixtral-=0.140 o3-mini=0.125 qwen1.5-=0.122 text-bis=0.114
2026-04-13 11:14:00,097 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:14:00,098 INFO [Step 48/200] det=skip para=0.0044 raw_rwd=0.1268Β±0.0128 rwd=0.1268
2026-04-13 11:14:00,098 INFO per-gen rewards: deepseek=0.128 falcon3-=0.136 gemini-1=0.129 gemini-2=0.118 gemini-p=0.109 gemini-p=0.121 gpt-3.5-=0.132 gpt-4-tu=0.126 gpt-4-tu=0.151 gpt-4.5-=0.120 gpt-4o=0.127 gpt-4o-m=0.133 llama-2-=0.113 llama-2-=0.127 llama-3.=0.127 llama-3.=0.132 ministra=0.127 mistral-=0.119 mixtral-=0.113 o3-mini=0.121 qwen1.5-=0.125 text-bis=0.111
2026-04-13 11:14:14,564 INFO [Step 49/200] det=skip para=-0.0000 raw_rwd=0.1242Β±0.0082 rwd=0.1242
2026-04-13 11:14:14,565 INFO per-gen rewards: deepseek=0.127 falcon3-=0.128 gemini-1=0.123 gemini-2=0.121 gemini-p=0.145 gemini-p=0.110 gpt-3.5-=0.122 gpt-4-tu=0.114 gpt-4-tu=0.120 gpt-4.5-=0.119 gpt-4o=0.125 gpt-4o-m=0.125 llama-2-=0.124 llama-2-=0.134 llama-3.=0.125 llama-3.=0.126 ministra=0.127 mistral-=0.136 mixtral-=0.118 o3-mini=0.121 qwen1.5-=0.126 text-bis=0.115
2026-04-13 11:14:29,493 INFO [Step 50/200] det=skip para=0.0000 raw_rwd=0.1264Β±0.0129 rwd=0.1264
2026-04-13 11:14:29,493 INFO per-gen rewards: deepseek=0.118 falcon3-=0.125 gemini-1=0.125 gemini-2=0.127 gemini-p=0.122 gemini-p=0.135 gpt-3.5-=0.131 gpt-4-tu=0.114 gpt-4-tu=0.111 gpt-4.5-=0.136 gpt-4o=0.122 gpt-4o-m=0.126 llama-2-=0.132 llama-2-=0.098 llama-3.=0.125 llama-3.=0.125 ministra=0.134 mistral-=0.132 mixtral-=0.122 o3-mini=0.130 qwen1.5-=0.145 text-bis=0.141
2026-04-13 11:19:14,185 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:19:14,186 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:19:14,186 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:19:14,186 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:19:14,186 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:19:14,186 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:19:14,186 INFO β gemini-pro 0.9851
2026-04-13 11:19:14,186 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:19:14,186 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:19:14,186 INFO β gpt-4-turbo 1.0000
2026-04-13 11:19:14,186 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:19:14,186 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:19:14,186 INFO β gpt-4o 0.9999
2026-04-13 11:19:14,186 INFO β gpt-4o-mini 0.9999
2026-04-13 11:19:14,186 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:19:14,186 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:19:14,186 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:19:14,186 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:19:14,186 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:19:14,186 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:19:14,186 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:19:14,186 INFO β o3-mini 0.9999
2026-04-13 11:19:14,186 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:19:14,186 INFO β text-bison-002 0.9992
2026-04-13 11:19:14,186 INFO β (prev best) 0.9960
2026-04-13 11:19:14,186 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:19:14,186 INFO β article_deletion 0.9981 ~
2026-04-13 11:19:14,186 INFO β homoglyphs 1.0000 ~
2026-04-13 11:19:14,186 INFO β misspelling 0.9996 ~
2026-04-13 11:19:14,186 INFO β no_attack 0.9966 ~
2026-04-13 11:19:14,186 INFO β synonym_replacement 0.9997 ~
2026-04-13 11:19:14,186 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:19:14,186 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:19:14,186 INFO No improvement (3/25) best=0.9960
2026-04-13 11:19:29,028 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:19:29,028 INFO [Step 51/200] det=skip para=0.0000 raw_rwd=0.1238Β±0.0109 rwd=0.1238
2026-04-13 11:19:29,028 INFO per-gen rewards: deepseek=0.113 falcon3-=0.130 gemini-1=0.128 gemini-2=0.120 gemini-p=0.116 gemini-p=0.129 gpt-3.5-=0.128 gpt-4-tu=0.122 gpt-4-tu=0.122 gpt-4.5-=0.125 gpt-4o=0.123 gpt-4o-m=0.117 llama-2-=0.134 llama-2-=0.117 llama-3.=0.119 llama-3.=0.143 ministra=0.123 mistral-=0.137 mixtral-=0.120 o3-mini=0.126 qwen1.5-=0.129 text-bis=0.115
2026-04-13 11:19:43,946 INFO [Step 52/200] det=skip para=-0.0000 raw_rwd=0.1271Β±0.0114 rwd=0.1271
2026-04-13 11:19:43,946 INFO per-gen rewards: deepseek=0.123 falcon3-=0.134 gemini-1=0.129 gemini-2=0.120 gemini-p=0.128 gemini-p=0.131 gpt-3.5-=0.129 gpt-4-tu=0.124 gpt-4-tu=0.134 gpt-4.5-=0.127 gpt-4o=0.126 gpt-4o-m=0.130 llama-2-=0.126 llama-2-=0.114 llama-3.=0.130 llama-3.=0.120 ministra=0.119 mistral-=0.142 mixtral-=0.127 o3-mini=0.135 qwen1.5-=0.120 text-bis=0.116
2026-04-13 11:19:59,048 INFO [Step 53/200] det=skip para=0.0031 raw_rwd=0.1221Β±0.0108 rwd=0.1221
2026-04-13 11:19:59,049 INFO per-gen rewards: deepseek=0.128 falcon3-=0.122 gemini-1=0.120 gemini-2=0.122 gemini-p=0.112 gemini-p=0.125 gpt-3.5-=0.122 gpt-4-tu=0.130 gpt-4-tu=0.120 gpt-4.5-=0.116 gpt-4o=0.119 gpt-4o-m=0.122 llama-2-=0.122 llama-2-=0.110 llama-3.=0.124 llama-3.=0.148 ministra=0.118 mistral-=0.115 mixtral-=0.128 o3-mini=0.123 qwen1.5-=0.123 text-bis=0.105
2026-04-13 11:20:13,787 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:20:13,788 INFO [Step 54/200] det=skip para=-0.0000 raw_rwd=0.1258Β±0.0101 rwd=0.1258
2026-04-13 11:20:13,788 INFO per-gen rewards: deepseek=0.135 falcon3-=0.130 gemini-1=0.118 gemini-2=0.117 gemini-p=0.115 gemini-p=0.132 gpt-3.5-=0.125 gpt-4-tu=0.146 gpt-4-tu=0.138 gpt-4.5-=0.133 gpt-4o=0.127 gpt-4o-m=0.124 llama-2-=0.118 llama-2-=0.156 llama-3.=0.122 llama-3.=0.121 ministra=0.131 mistral-=0.127 mixtral-=0.141 o3-mini=0.124 qwen1.5-=0.119 text-bis=0.113
2026-04-13 11:20:28,507 INFO [Step 55/200] det=skip para=0.0000 raw_rwd=0.1220Β±0.0097 rwd=0.1220
2026-04-13 11:20:28,507 INFO per-gen rewards: deepseek=0.121 falcon3-=0.135 gemini-1=0.118 gemini-2=0.121 gemini-p=0.115 gemini-p=0.114 gpt-3.5-=0.120 gpt-4-tu=0.128 gpt-4-tu=0.126 gpt-4.5-=0.111 gpt-4o=0.113 gpt-4o-m=0.128 llama-2-=0.123 llama-2-=0.115 llama-3.=0.122 llama-3.=0.138 ministra=0.119 mistral-=0.124 mixtral-=0.135 o3-mini=0.122 qwen1.5-=0.112 text-bis=0.129
2026-04-13 11:25:12,168 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:25:12,168 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:25:12,168 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:25:12,168 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:25:12,168 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:25:12,168 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:25:12,169 INFO β gemini-pro 0.9851
2026-04-13 11:25:12,169 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:25:12,169 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:25:12,169 INFO β gpt-4-turbo 1.0000
2026-04-13 11:25:12,169 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:25:12,169 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:25:12,169 INFO β gpt-4o 0.9999
2026-04-13 11:25:12,169 INFO β gpt-4o-mini 0.9999
2026-04-13 11:25:12,169 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:25:12,169 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:25:12,169 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:25:12,169 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:25:12,169 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:25:12,169 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:25:12,169 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:25:12,169 INFO β o3-mini 0.9999
2026-04-13 11:25:12,169 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:25:12,169 INFO β text-bison-002 0.9992
2026-04-13 11:25:12,169 INFO β (prev best) 0.9960
2026-04-13 11:25:12,169 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:25:12,169 INFO β article_deletion 0.9981 ~
2026-04-13 11:25:12,169 INFO β homoglyphs 1.0000 ~
2026-04-13 11:25:12,169 INFO β misspelling 0.9995 ~
2026-04-13 11:25:12,169 INFO β no_attack 0.9966 ~
2026-04-13 11:25:12,169 INFO β synonym_replacement 0.9997 ~
2026-04-13 11:25:12,169 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:25:12,169 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:25:12,169 INFO No improvement (4/25) best=0.9960
2026-04-13 11:25:27,078 INFO [Step 56/200] det=skip para=0.0101 raw_rwd=0.1267Β±0.0132 rwd=0.1267
2026-04-13 11:25:27,078 INFO per-gen rewards: deepseek=0.130 falcon3-=0.141 gemini-1=0.124 gemini-2=0.132 gemini-p=0.123 gemini-p=0.117 gpt-3.5-=0.118 gpt-4-tu=0.124 gpt-4-tu=0.129 gpt-4.5-=0.135 gpt-4o=0.128 gpt-4o-m=0.121 llama-2-=0.107 llama-2-=0.149 llama-3.=0.125 llama-3.=0.128 ministra=0.125 mistral-=0.127 mixtral-=0.125 o3-mini=0.134 qwen1.5-=0.126 text-bis=0.110
2026-04-13 11:25:41,558 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:25:41,558 INFO [Step 57/200] det=skip para=0.0000 raw_rwd=0.1246Β±0.0103 rwd=0.1246
2026-04-13 11:25:41,559 INFO per-gen rewards: deepseek=0.124 falcon3-=0.122 gemini-1=0.121 gemini-2=0.124 gemini-p=0.138 gemini-p=0.133 gpt-3.5-=0.128 gpt-4-tu=0.131 gpt-4-tu=0.120 gpt-4.5-=0.129 gpt-4o=0.127 gpt-4o-m=0.125 llama-2-=0.119 llama-2-=0.108 llama-3.=0.126 llama-3.=0.122 ministra=0.117 mistral-=0.138 mixtral-=0.116 o3-mini=0.130 qwen1.5-=0.131 text-bis=0.113
2026-04-13 11:25:56,353 INFO [Step 58/200] det=skip para=0.0019 raw_rwd=0.1239Β±0.0110 rwd=0.1239
2026-04-13 11:25:56,354 INFO per-gen rewards: deepseek=0.122 falcon3-=0.131 gemini-1=0.132 gemini-2=0.125 gemini-p=0.127 gemini-p=0.122 gpt-3.5-=0.119 gpt-4-tu=0.114 gpt-4-tu=0.111 gpt-4.5-=0.131 gpt-4o=0.126 gpt-4o-m=0.119 llama-2-=0.118 llama-2-=0.138 llama-3.=0.126 llama-3.=0.124 ministra=0.121 mistral-=0.107 mixtral-=0.134 o3-mini=0.122 qwen1.5-=0.124 text-bis=0.131
2026-04-13 11:26:10,979 INFO [Step 59/200] det=skip para=0.0580 raw_rwd=0.1266Β±0.0198 rwd=0.1266
2026-04-13 11:26:10,979 INFO per-gen rewards: deepseek=0.124 falcon3-=0.129 gemini-1=0.125 gemini-2=0.123 gemini-p=0.121 gemini-p=0.162 gpt-3.5-=0.122 gpt-4-tu=0.102 gpt-4-tu=0.115 gpt-4.5-=0.119 gpt-4o=0.146 gpt-4o-m=0.121 llama-2-=0.125 llama-2-=0.122 llama-3.=0.119 llama-3.=0.127 ministra=0.135 mistral-=0.133 mixtral-=0.145 o3-mini=0.117 qwen1.5-=0.125 text-bis=0.134
2026-04-13 11:26:25,485 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:26:25,486 INFO [Step 60/200] det=skip para=-0.0000 raw_rwd=0.1239Β±0.0100 rwd=0.1239
2026-04-13 11:26:25,486 INFO per-gen rewards: deepseek=0.119 falcon3-=0.115 gemini-1=0.129 gemini-2=0.121 gemini-p=0.120 gemini-p=0.121 gpt-3.5-=0.122 gpt-4-tu=0.114 gpt-4-tu=0.136 gpt-4.5-=0.138 gpt-4o=0.123 gpt-4o-m=0.122 llama-2-=0.143 llama-2-=0.134 llama-3.=0.128 llama-3.=0.128 ministra=0.126 mistral-=0.121 mixtral-=0.122 o3-mini=0.120 qwen1.5-=0.119 text-bis=0.142
2026-04-13 11:31:09,371 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:31:09,371 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:31:09,371 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:31:09,371 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:31:09,371 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:31:09,371 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:31:09,371 INFO β gemini-pro 0.9851
2026-04-13 11:31:09,371 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:31:09,371 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:31:09,371 INFO β gpt-4-turbo 1.0000
2026-04-13 11:31:09,371 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:31:09,371 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:31:09,371 INFO β gpt-4o 0.9999
2026-04-13 11:31:09,371 INFO β gpt-4o-mini 0.9999
2026-04-13 11:31:09,372 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:31:09,372 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:31:09,372 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:31:09,372 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:31:09,372 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:31:09,372 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:31:09,372 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:31:09,372 INFO β o3-mini 0.9999
2026-04-13 11:31:09,372 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:31:09,372 INFO β text-bison-002 0.9992
2026-04-13 11:31:09,372 INFO β (prev best) 0.9960
2026-04-13 11:31:09,372 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:31:09,372 INFO β article_deletion 0.9980 ~
2026-04-13 11:31:09,372 INFO β homoglyphs 1.0000 ~
2026-04-13 11:31:09,372 INFO β misspelling 0.9997 ~
2026-04-13 11:31:09,372 INFO β no_attack 0.9966 ~
2026-04-13 11:31:09,372 INFO β synonym_replacement 0.9997 ~
2026-04-13 11:31:09,372 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:31:09,372 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:31:09,372 INFO No improvement (5/25) best=0.9960
2026-04-13 11:31:24,107 INFO [Step 61/200] det=skip para=0.0089 raw_rwd=0.1257Β±0.0107 rwd=0.1257
2026-04-13 11:31:24,107 INFO per-gen rewards: deepseek=0.128 falcon3-=0.131 gemini-1=0.121 gemini-2=0.124 gemini-p=0.136 gemini-p=0.130 gpt-3.5-=0.131 gpt-4-tu=0.108 gpt-4-tu=0.125 gpt-4.5-=0.124 gpt-4o=0.128 gpt-4o-m=0.126 llama-2-=0.126 llama-2-=0.114 llama-3.=0.124 llama-3.=0.121 ministra=0.125 mistral-=0.130 mixtral-=0.128 o3-mini=0.120 qwen1.5-=0.117 text-bis=0.141
2026-04-13 11:31:38,560 INFO [Step 62/200] det=skip para=0.0007 raw_rwd=0.1243Β±0.0108 rwd=0.1243
2026-04-13 11:31:38,560 INFO per-gen rewards: deepseek=0.129 falcon3-=0.127 gemini-1=0.127 gemini-2=0.118 gemini-p=0.139 gemini-p=0.157 gpt-3.5-=0.125 gpt-4-tu=0.109 gpt-4-tu=0.116 gpt-4.5-=0.123 gpt-4o=0.126 gpt-4o-m=0.128 llama-2-=0.146 llama-2-=0.134 llama-3.=0.122 llama-3.=0.121 ministra=0.120 mistral-=0.121 mixtral-=0.131 o3-mini=0.118 qwen1.5-=0.111 text-bis=0.117
2026-04-13 11:31:53,063 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:31:53,064 INFO [Step 63/200] det=skip para=-0.0000 raw_rwd=0.1269Β±0.0113 rwd=0.1269
2026-04-13 11:31:53,064 INFO per-gen rewards: deepseek=0.129 falcon3-=0.130 gemini-1=0.128 gemini-2=0.125 gemini-p=0.114 gemini-p=0.140 gpt-3.5-=0.130 gpt-4-tu=0.109 gpt-4-tu=0.128 gpt-4.5-=0.121 gpt-4o=0.131 gpt-4o-m=0.123 llama-2-=0.128 llama-2-=0.127 llama-3.=0.133 llama-3.=0.121 ministra=0.129 mistral-=0.111 mixtral-=0.132 o3-mini=0.121 qwen1.5-=0.121 text-bis=0.123
2026-04-13 11:32:07,539 INFO [Step 64/200] det=skip para=0.0000 raw_rwd=0.1236Β±0.0116 rwd=0.1236
2026-04-13 11:32:07,539 INFO per-gen rewards: deepseek=0.134 falcon3-=0.123 gemini-1=0.118 gemini-2=0.132 gemini-p=0.122 gemini-p=0.117 gpt-3.5-=0.119 gpt-4-tu=0.125 gpt-4-tu=0.109 gpt-4.5-=0.110 gpt-4o=0.119 gpt-4o-m=0.124 llama-2-=0.146 llama-2-=0.123 llama-3.=0.121 llama-3.=0.114 ministra=0.128 mistral-=0.124 mixtral-=0.125 o3-mini=0.127 qwen1.5-=0.139 text-bis=0.104
2026-04-13 11:32:22,299 INFO [Step 65/200] det=skip para=0.0514 raw_rwd=0.1239Β±0.0192 rwd=0.1239
2026-04-13 11:32:22,299 INFO per-gen rewards: deepseek=0.121 falcon3-=0.121 gemini-1=0.123 gemini-2=0.114 gemini-p=0.143 gemini-p=0.127 gpt-3.5-=0.120 gpt-4-tu=0.108 gpt-4-tu=0.105 gpt-4.5-=0.113 gpt-4o=0.120 gpt-4o-m=0.130 llama-2-=0.111 llama-2-=0.136 llama-3.=0.125 llama-3.=0.107 ministra=0.149 mistral-=0.120 mixtral-=0.124 o3-mini=0.131 qwen1.5-=0.117 text-bis=0.118
2026-04-13 11:37:05,949 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:37:05,949 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:37:05,949 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:37:05,949 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:37:05,949 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:37:05,949 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:37:05,949 INFO β gemini-pro 0.9851
2026-04-13 11:37:05,949 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:37:05,949 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:37:05,949 INFO β gpt-4-turbo 1.0000
2026-04-13 11:37:05,949 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:37:05,949 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:37:05,949 INFO β gpt-4o 0.9999
2026-04-13 11:37:05,949 INFO β gpt-4o-mini 0.9999
2026-04-13 11:37:05,950 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:37:05,950 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:37:05,950 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:37:05,950 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:37:05,950 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:37:05,950 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:37:05,950 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:37:05,950 INFO β o3-mini 0.9999
2026-04-13 11:37:05,950 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:37:05,950 INFO β text-bison-002 0.9992
2026-04-13 11:37:05,950 INFO β (prev best) 0.9960
2026-04-13 11:37:05,950 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:37:05,950 INFO β article_deletion 0.9981 ~
2026-04-13 11:37:05,950 INFO β homoglyphs 1.0000 ~
2026-04-13 11:37:05,950 INFO β misspelling 0.9997 ~
2026-04-13 11:37:05,950 INFO β no_attack 0.9966 ~
2026-04-13 11:37:05,950 INFO β synonym_replacement 0.9997 ~
2026-04-13 11:37:05,950 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:37:05,950 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:37:05,950 INFO No improvement (6/25) best=0.9960
2026-04-13 11:37:20,883 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:37:20,883 INFO [Step 66/200] det=skip para=-0.0000 raw_rwd=0.1258Β±0.0113 rwd=0.1258
2026-04-13 11:37:20,883 INFO per-gen rewards: deepseek=0.130 falcon3-=0.127 gemini-1=0.144 gemini-2=0.128 gemini-p=0.128 gemini-p=0.116 gpt-3.5-=0.121 gpt-4-tu=0.111 gpt-4-tu=0.113 gpt-4.5-=0.128 gpt-4o=0.126 gpt-4o-m=0.122 llama-2-=0.121 llama-2-=0.102 llama-3.=0.122 llama-3.=0.128 ministra=0.121 mistral-=0.118 mixtral-=0.129 o3-mini=0.130 qwen1.5-=0.140 text-bis=0.123
2026-04-13 11:37:35,515 INFO [Step 67/200] det=skip para=0.0101 raw_rwd=0.1255Β±0.0129 rwd=0.1255
2026-04-13 11:37:35,515 INFO per-gen rewards: deepseek=0.139 falcon3-=0.126 gemini-1=0.123 gemini-2=0.124 gemini-p=0.112 gemini-p=0.103 gpt-3.5-=0.133 gpt-4-tu=0.123 gpt-4-tu=0.134 gpt-4.5-=0.143 gpt-4o=0.126 gpt-4o-m=0.119 llama-2-=0.123 llama-2-=0.119 llama-3.=0.125 llama-3.=0.125 ministra=0.120 mistral-=0.119 mixtral-=0.120 o3-mini=0.128 qwen1.5-=0.130 text-bis=0.131
2026-04-13 11:37:50,185 INFO [Step 68/200] det=skip para=-0.0000 raw_rwd=0.1233Β±0.0095 rwd=0.1233
2026-04-13 11:37:50,186 INFO per-gen rewards: deepseek=0.129 falcon3-=0.129 gemini-1=0.122 gemini-2=0.116 gemini-p=0.132 gemini-p=0.135 gpt-3.5-=0.120 gpt-4-tu=0.122 gpt-4-tu=0.123 gpt-4.5-=0.122 gpt-4o=0.120 gpt-4o-m=0.133 llama-2-=0.115 llama-2-=0.134 llama-3.=0.122 llama-3.=0.127 ministra=0.126 mistral-=0.112 mixtral-=0.123 o3-mini=0.117 qwen1.5-=0.121 text-bis=0.113
2026-04-13 11:38:05,105 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:38:05,106 INFO [Step 69/200] det=skip para=-0.0000 raw_rwd=0.1244Β±0.0101 rwd=0.1244
2026-04-13 11:38:05,106 INFO per-gen rewards: deepseek=0.119 falcon3-=0.133 gemini-1=0.121 gemini-2=0.122 gemini-p=0.134 gemini-p=0.128 gpt-3.5-=0.130 gpt-4-tu=0.127 gpt-4-tu=0.118 gpt-4.5-=0.129 gpt-4o=0.127 gpt-4o-m=0.123 llama-2-=0.109 llama-2-=0.105 llama-3.=0.128 llama-3.=0.137 ministra=0.125 mistral-=0.112 mixtral-=0.122 o3-mini=0.116 qwen1.5-=0.133 text-bis=0.122
2026-04-13 11:38:19,747 INFO [Step 70/200] det=skip para=0.0005 raw_rwd=0.1252Β±0.0113 rwd=0.1252
2026-04-13 11:38:19,748 INFO per-gen rewards: deepseek=0.116 falcon3-=0.133 gemini-1=0.127 gemini-2=0.131 gemini-p=0.118 gemini-p=0.118 gpt-3.5-=0.124 gpt-4-tu=0.114 gpt-4-tu=0.133 gpt-4.5-=0.118 gpt-4o=0.121 gpt-4o-m=0.120 llama-2-=0.126 llama-2-=0.135 llama-3.=0.118 llama-3.=0.124 ministra=0.138 mistral-=0.132 mixtral-=0.120 o3-mini=0.129 qwen1.5-=0.132 text-bis=0.121
2026-04-13 11:43:03,652 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:43:03,652 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:43:03,652 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:43:03,652 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:43:03,652 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:43:03,652 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:43:03,652 INFO β gemini-pro 0.9851
2026-04-13 11:43:03,652 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:43:03,652 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:43:03,652 INFO β gpt-4-turbo 1.0000
2026-04-13 11:43:03,652 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:43:03,653 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:43:03,653 INFO β gpt-4o 0.9999
2026-04-13 11:43:03,653 INFO β gpt-4o-mini 0.9999
2026-04-13 11:43:03,653 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:43:03,653 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:43:03,653 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:43:03,653 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:43:03,653 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:43:03,653 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:43:03,653 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:43:03,653 INFO β o3-mini 0.9999
2026-04-13 11:43:03,653 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:43:03,653 INFO β text-bison-002 0.9992
2026-04-13 11:43:03,653 INFO β (prev best) 0.9960
2026-04-13 11:43:03,653 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:43:03,653 INFO β article_deletion 0.9983 ~
2026-04-13 11:43:03,653 INFO β homoglyphs 1.0000 ~
2026-04-13 11:43:03,653 INFO β misspelling 0.9995 ~
2026-04-13 11:43:03,653 INFO β no_attack 0.9966 ~
2026-04-13 11:43:03,653 INFO β synonym_replacement 0.9998 ~
2026-04-13 11:43:03,653 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:43:03,653 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:43:03,653 INFO No improvement (7/25) best=0.9960
2026-04-13 11:43:18,416 INFO [Step 71/200] det=skip para=0.0000 raw_rwd=0.1227Β±0.0100 rwd=0.1227
2026-04-13 11:43:18,416 INFO per-gen rewards: deepseek=0.129 falcon3-=0.111 gemini-1=0.118 gemini-2=0.121 gemini-p=0.123 gemini-p=0.146 gpt-3.5-=0.124 gpt-4-tu=0.122 gpt-4-tu=0.127 gpt-4.5-=0.125 gpt-4o=0.128 gpt-4o-m=0.124 llama-2-=0.121 llama-2-=0.120 llama-3.=0.120 llama-3.=0.108 ministra=0.122 mistral-=0.115 mixtral-=0.122 o3-mini=0.122 qwen1.5-=0.146 text-bis=0.134
2026-04-13 11:43:32,826 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:43:32,826 INFO [Step 72/200] det=skip para=0.0050 raw_rwd=0.1232Β±0.0125 rwd=0.1232
2026-04-13 11:43:32,826 INFO per-gen rewards: deepseek=0.132 falcon3-=0.126 gemini-1=0.121 gemini-2=0.113 gemini-p=0.145 gemini-p=0.099 gpt-3.5-=0.130 gpt-4-tu=0.126 gpt-4-tu=0.129 gpt-4.5-=0.136 gpt-4o=0.128 gpt-4o-m=0.121 llama-2-=0.122 llama-2-=0.123 llama-3.=0.123 llama-3.=0.121 ministra=0.121 mistral-=0.111 mixtral-=0.134 o3-mini=0.116 qwen1.5-=0.115 text-bis=0.117
2026-04-13 11:43:47,386 INFO [Step 73/200] det=skip para=-0.0000 raw_rwd=0.1246Β±0.0098 rwd=0.1246
2026-04-13 11:43:47,386 INFO per-gen rewards: deepseek=0.117 falcon3-=0.126 gemini-1=0.127 gemini-2=0.126 gemini-p=0.124 gemini-p=0.134 gpt-3.5-=0.122 gpt-4-tu=0.116 gpt-4-tu=0.135 gpt-4.5-=0.126 gpt-4o=0.125 gpt-4o-m=0.126 llama-2-=0.118 llama-2-=0.134 llama-3.=0.128 llama-3.=0.126 ministra=0.123 mistral-=0.117 mixtral-=0.126 o3-mini=0.121 qwen1.5-=0.121 text-bis=0.132
2026-04-13 11:44:01,979 INFO [Step 74/200] det=skip para=0.0070 raw_rwd=0.1266Β±0.0136 rwd=0.1266
2026-04-13 11:44:01,979 INFO per-gen rewards: deepseek=0.130 falcon3-=0.118 gemini-1=0.127 gemini-2=0.120 gemini-p=0.139 gemini-p=0.120 gpt-3.5-=0.133 gpt-4-tu=0.129 gpt-4-tu=0.126 gpt-4.5-=0.114 gpt-4o=0.128 gpt-4o-m=0.125 llama-2-=0.112 llama-2-=0.118 llama-3.=0.129 llama-3.=0.127 ministra=0.132 mistral-=0.111 mixtral-=0.135 o3-mini=0.136 qwen1.5-=0.111 text-bis=0.106
2026-04-13 11:44:16,901 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:44:16,901 INFO [Step 75/200] det=skip para=0.0006 raw_rwd=0.1255Β±0.0129 rwd=0.1255
2026-04-13 11:44:16,901 INFO per-gen rewards: deepseek=0.122 falcon3-=0.122 gemini-1=0.120 gemini-2=0.120 gemini-p=0.141 gemini-p=0.120 gpt-3.5-=0.126 gpt-4-tu=0.139 gpt-4-tu=0.115 gpt-4.5-=0.127 gpt-4o=0.128 gpt-4o-m=0.124 llama-2-=0.120 llama-2-=0.141 llama-3.=0.130 llama-3.=0.125 ministra=0.118 mistral-=0.113 mixtral-=0.131 o3-mini=0.139 qwen1.5-=0.121 text-bis=0.132
2026-04-13 11:49:00,238 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:49:00,238 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:49:00,238 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:49:00,238 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:49:00,238 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:49:00,238 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:49:00,238 INFO β gemini-pro 0.9851
2026-04-13 11:49:00,238 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:49:00,238 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:49:00,239 INFO β gpt-4-turbo 1.0000
2026-04-13 11:49:00,239 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:49:00,239 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:49:00,239 INFO β gpt-4o 0.9999
2026-04-13 11:49:00,239 INFO β gpt-4o-mini 0.9999
2026-04-13 11:49:00,239 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:49:00,239 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:49:00,239 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:49:00,239 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:49:00,239 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:49:00,239 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:49:00,239 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:49:00,239 INFO β o3-mini 0.9999
2026-04-13 11:49:00,239 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:49:00,239 INFO β text-bison-002 0.9992
2026-04-13 11:49:00,239 INFO β (prev best) 0.9960
2026-04-13 11:49:00,239 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:49:00,239 INFO β article_deletion 0.9983 ~
2026-04-13 11:49:00,239 INFO β homoglyphs 1.0000 ~
2026-04-13 11:49:00,239 INFO β misspelling 0.9998 ~
2026-04-13 11:49:00,239 INFO β no_attack 0.9966 ~
2026-04-13 11:49:00,239 INFO β synonym_replacement 0.9998 ~
2026-04-13 11:49:00,239 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:49:00,239 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:49:00,239 INFO No improvement (8/25) best=0.9960
2026-04-13 11:49:15,149 INFO [Step 76/200] det=skip para=0.0610 raw_rwd=0.1283Β±0.0226 rwd=0.1283
2026-04-13 11:49:15,150 INFO per-gen rewards: deepseek=0.126 falcon3-=0.116 gemini-1=0.124 gemini-2=0.116 gemini-p=0.128 gemini-p=0.129 gpt-3.5-=0.124 gpt-4-tu=0.126 gpt-4-tu=0.150 gpt-4.5-=0.126 gpt-4o=0.137 gpt-4o-m=0.124 llama-2-=0.123 llama-2-=0.121 llama-3.=0.124 llama-3.=0.129 ministra=0.157 mistral-=0.132 mixtral-=0.147 o3-mini=0.131 qwen1.5-=0.117 text-bis=0.122
2026-04-13 11:49:29,826 INFO [Step 77/200] det=skip para=0.0000 raw_rwd=0.1232Β±0.0108 rwd=0.1232
2026-04-13 11:49:29,827 INFO per-gen rewards: deepseek=0.122 falcon3-=0.120 gemini-1=0.121 gemini-2=0.128 gemini-p=0.131 gemini-p=0.132 gpt-3.5-=0.120 gpt-4-tu=0.122 gpt-4-tu=0.130 gpt-4.5-=0.114 gpt-4o=0.123 gpt-4o-m=0.116 llama-2-=0.132 llama-2-=0.152 llama-3.=0.126 llama-3.=0.129 ministra=0.125 mistral-=0.118 mixtral-=0.115 o3-mini=0.125 qwen1.5-=0.118 text-bis=0.124
2026-04-13 11:49:44,612 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:49:44,612 INFO [Step 78/200] det=skip para=-0.0000 raw_rwd=0.1236Β±0.0117 rwd=0.1236
2026-04-13 11:49:44,612 INFO per-gen rewards: deepseek=0.119 falcon3-=0.121 gemini-1=0.125 gemini-2=0.117 gemini-p=0.119 gemini-p=0.123 gpt-3.5-=0.125 gpt-4-tu=0.123 gpt-4-tu=0.138 gpt-4.5-=0.129 gpt-4o=0.125 gpt-4o-m=0.122 llama-2-=0.116 llama-2-=0.139 llama-3.=0.122 llama-3.=0.120 ministra=0.133 mistral-=0.098 mixtral-=0.130 o3-mini=0.122 qwen1.5-=0.138 text-bis=0.131
2026-04-13 11:49:59,234 INFO [Step 79/200] det=skip para=-0.0000 raw_rwd=0.1239Β±0.0111 rwd=0.1239
2026-04-13 11:49:59,234 INFO per-gen rewards: deepseek=0.128 falcon3-=0.123 gemini-1=0.125 gemini-2=0.115 gemini-p=0.118 gemini-p=0.126 gpt-3.5-=0.122 gpt-4-tu=0.128 gpt-4-tu=0.110 gpt-4.5-=0.110 gpt-4o=0.122 gpt-4o-m=0.135 llama-2-=0.132 llama-2-=0.128 llama-3.=0.126 llama-3.=0.111 ministra=0.128 mistral-=0.122 mixtral-=0.114 o3-mini=0.127 qwen1.5-=0.124 text-bis=0.109
2026-04-13 11:50:13,802 INFO [Step 80/200] det=skip para=0.0000 raw_rwd=0.1232Β±0.0112 rwd=0.1232
2026-04-13 11:50:13,803 INFO per-gen rewards: deepseek=0.123 falcon3-=0.119 gemini-1=0.125 gemini-2=0.120 gemini-p=0.124 gemini-p=0.141 gpt-3.5-=0.123 gpt-4-tu=0.133 gpt-4-tu=0.123 gpt-4.5-=0.112 gpt-4o=0.130 gpt-4o-m=0.124 llama-2-=0.124 llama-2-=0.104 llama-3.=0.121 llama-3.=0.130 ministra=0.121 mistral-=0.107 mixtral-=0.137 o3-mini=0.120 qwen1.5-=0.110 text-bis=0.139
2026-04-13 11:54:56,946 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 11:54:56,946 INFO β MACRO_AVG 0.9960 β
2026-04-13 11:54:56,947 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 11:54:56,947 INFO β falcon3-10b-instruct 0.9992
2026-04-13 11:54:56,947 INFO β gemini-1.5-pro 0.9689
2026-04-13 11:54:56,947 INFO β gemini-2.0-flash 0.9998
2026-04-13 11:54:56,947 INFO β gemini-pro 0.9851
2026-04-13 11:54:56,947 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 11:54:56,947 INFO β gpt-3.5-turbo 0.9999
2026-04-13 11:54:56,947 INFO β gpt-4-turbo 1.0000
2026-04-13 11:54:56,947 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 11:54:56,947 INFO β gpt-4.5-preview 0.9980
2026-04-13 11:54:56,947 INFO β gpt-4o 0.9999
2026-04-13 11:54:56,947 INFO β gpt-4o-mini 0.9999
2026-04-13 11:54:56,947 INFO β llama-2-70b-chat 0.9974
2026-04-13 11:54:56,947 INFO β llama-2-7b-chat 0.9967
2026-04-13 11:54:56,947 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 11:54:56,947 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 11:54:56,947 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 11:54:56,947 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 11:54:56,947 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 11:54:56,947 INFO β o3-mini 0.9999
2026-04-13 11:54:56,947 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 11:54:56,947 INFO β text-bison-002 0.9992
2026-04-13 11:54:56,947 INFO β (prev best) 0.9960
2026-04-13 11:54:56,947 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 11:54:56,947 INFO β article_deletion 0.9981 ~
2026-04-13 11:54:56,947 INFO β homoglyphs 1.0000 ~
2026-04-13 11:54:56,947 INFO β misspelling 0.9998 ~
2026-04-13 11:54:56,947 INFO β no_attack 0.9966 ~
2026-04-13 11:54:56,947 INFO β synonym_replacement 0.9998 ~
2026-04-13 11:54:56,947 INFO β t5_paraphrase 1.0000 ~
2026-04-13 11:54:56,947 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 11:54:56,947 INFO No improvement (9/25) best=0.9960
2026-04-13 11:55:11,679 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:55:11,680 INFO [Step 81/200] det=skip para=0.0000 raw_rwd=0.1225Β±0.0109 rwd=0.1225
2026-04-13 11:55:11,680 INFO per-gen rewards: deepseek=0.124 falcon3-=0.120 gemini-1=0.120 gemini-2=0.127 gemini-p=0.152 gemini-p=0.121 gpt-3.5-=0.127 gpt-4-tu=0.131 gpt-4-tu=0.136 gpt-4.5-=0.109 gpt-4o=0.117 gpt-4o-m=0.119 llama-2-=0.111 llama-2-=0.132 llama-3.=0.118 llama-3.=0.116 ministra=0.128 mistral-=0.114 mixtral-=0.124 o3-mini=0.125 qwen1.5-=0.126 text-bis=0.113
2026-04-13 11:55:26,395 INFO [Step 82/200] det=skip para=-0.0000 raw_rwd=0.1243Β±0.0112 rwd=0.1243
2026-04-13 11:55:26,395 INFO per-gen rewards: deepseek=0.124 falcon3-=0.128 gemini-1=0.122 gemini-2=0.126 gemini-p=0.138 gemini-p=0.140 gpt-3.5-=0.128 gpt-4-tu=0.140 gpt-4-tu=0.115 gpt-4.5-=0.127 gpt-4o=0.121 gpt-4o-m=0.118 llama-2-=0.115 llama-2-=0.148 llama-3.=0.118 llama-3.=0.131 ministra=0.121 mistral-=0.121 mixtral-=0.126 o3-mini=0.125 qwen1.5-=0.120 text-bis=0.133
2026-04-13 11:55:40,857 INFO [Step 83/200] det=skip para=0.0000 raw_rwd=0.1228Β±0.0123 rwd=0.1228
2026-04-13 11:55:40,858 INFO per-gen rewards: deepseek=0.120 falcon3-=0.134 gemini-1=0.118 gemini-2=0.117 gemini-p=0.116 gemini-p=0.146 gpt-3.5-=0.123 gpt-4-tu=0.140 gpt-4-tu=0.131 gpt-4.5-=0.118 gpt-4o=0.118 gpt-4o-m=0.117 llama-2-=0.142 llama-2-=0.126 llama-3.=0.122 llama-3.=0.141 ministra=0.116 mistral-=0.134 mixtral-=0.115 o3-mini=0.124 qwen1.5-=0.119 text-bis=0.140
2026-04-13 11:55:55,609 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 11:55:55,609 INFO [Step 84/200] det=skip para=0.0606 raw_rwd=0.1280Β±0.0237 rwd=0.1280
2026-04-13 11:55:55,609 INFO per-gen rewards: deepseek=0.125 falcon3-=0.130 gemini-1=0.132 gemini-2=0.127 gemini-p=0.145 gemini-p=0.110 gpt-3.5-=0.128 gpt-4-tu=0.134 gpt-4-tu=0.132 gpt-4.5-=0.113 gpt-4o=0.120 gpt-4o-m=0.157 llama-2-=0.135 llama-2-=0.113 llama-3.=0.126 llama-3.=0.119 ministra=0.127 mistral-=0.122 mixtral-=0.102 o3-mini=0.119 qwen1.5-=0.128 text-bis=0.122
2026-04-13 11:56:10,223 INFO [Step 85/200] det=skip para=0.0056 raw_rwd=0.1250Β±0.0122 rwd=0.1250
2026-04-13 11:56:10,224 INFO per-gen rewards: deepseek=0.118 falcon3-=0.126 gemini-1=0.121 gemini-2=0.126 gemini-p=0.119 gemini-p=0.147 gpt-3.5-=0.125 gpt-4-tu=0.115 gpt-4-tu=0.123 gpt-4.5-=0.155 gpt-4o=0.129 gpt-4o-m=0.123 llama-2-=0.108 llama-2-=0.110 llama-3.=0.128 llama-3.=0.125 ministra=0.121 mistral-=0.141 mixtral-=0.126 o3-mini=0.132 qwen1.5-=0.108 text-bis=0.125
2026-04-13 12:00:55,330 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:00:55,330 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:00:55,330 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:00:55,330 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:00:55,330 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:00:55,330 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:00:55,330 INFO β gemini-pro 0.9851
2026-04-13 12:00:55,330 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:00:55,330 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:00:55,330 INFO β gpt-4-turbo 1.0000
2026-04-13 12:00:55,330 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:00:55,330 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:00:55,330 INFO β gpt-4o 0.9999
2026-04-13 12:00:55,330 INFO β gpt-4o-mini 0.9999
2026-04-13 12:00:55,330 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:00:55,330 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:00:55,330 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:00:55,330 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:00:55,331 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:00:55,331 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:00:55,331 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:00:55,331 INFO β o3-mini 0.9999
2026-04-13 12:00:55,331 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:00:55,331 INFO β text-bison-002 0.9992
2026-04-13 12:00:55,331 INFO β (prev best) 0.9960
2026-04-13 12:00:55,331 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:00:55,331 INFO β article_deletion 0.9982 ~
2026-04-13 12:00:55,331 INFO β homoglyphs 1.0000 ~
2026-04-13 12:00:55,331 INFO β misspelling 0.9996 ~
2026-04-13 12:00:55,331 INFO β no_attack 0.9966 ~
2026-04-13 12:00:55,331 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:00:55,331 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:00:55,331 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:00:55,331 INFO No improvement (10/25) best=0.9960
2026-04-13 12:01:10,468 INFO [Step 86/200] det=skip para=0.0186 raw_rwd=0.1236Β±0.0124 rwd=0.1236
2026-04-13 12:01:10,468 INFO per-gen rewards: deepseek=0.123 falcon3-=0.123 gemini-1=0.122 gemini-2=0.117 gemini-p=0.119 gemini-p=0.134 gpt-3.5-=0.118 gpt-4-tu=0.122 gpt-4-tu=0.148 gpt-4.5-=0.143 gpt-4o=0.121 gpt-4o-m=0.117 llama-2-=0.168 llama-2-=0.131 llama-3.=0.127 llama-3.=0.138 ministra=0.123 mistral-=0.124 mixtral-=0.137 o3-mini=0.121 qwen1.5-=0.130 text-bis=0.122
2026-04-13 12:01:25,285 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:01:25,286 INFO [Step 87/200] det=skip para=0.0057 raw_rwd=0.1254Β±0.0127 rwd=0.1254
2026-04-13 12:01:25,286 INFO per-gen rewards: deepseek=0.124 falcon3-=0.125 gemini-1=0.129 gemini-2=0.125 gemini-p=0.137 gemini-p=0.117 gpt-3.5-=0.118 gpt-4-tu=0.131 gpt-4-tu=0.142 gpt-4.5-=0.117 gpt-4o=0.122 gpt-4o-m=0.123 llama-2-=0.107 llama-2-=0.136 llama-3.=0.128 llama-3.=0.127 ministra=0.124 mistral-=0.125 mixtral-=0.150 o3-mini=0.130 qwen1.5-=0.142 text-bis=0.118
2026-04-13 12:01:40,180 INFO [Step 88/200] det=skip para=0.0021 raw_rwd=0.1250Β±0.0119 rwd=0.1250
2026-04-13 12:01:40,180 INFO per-gen rewards: deepseek=0.121 falcon3-=0.125 gemini-1=0.130 gemini-2=0.126 gemini-p=0.136 gemini-p=0.135 gpt-3.5-=0.119 gpt-4-tu=0.144 gpt-4-tu=0.123 gpt-4.5-=0.130 gpt-4o=0.121 gpt-4o-m=0.126 llama-2-=0.127 llama-2-=0.130 llama-3.=0.121 llama-3.=0.119 ministra=0.119 mistral-=0.140 mixtral-=0.135 o3-mini=0.126 qwen1.5-=0.116 text-bis=0.160
2026-04-13 12:01:55,001 INFO [Step 89/200] det=skip para=0.0000 raw_rwd=0.1281Β±0.0092 rwd=0.1281
2026-04-13 12:01:55,001 INFO per-gen rewards: deepseek=0.129 falcon3-=0.129 gemini-1=0.122 gemini-2=0.122 gemini-p=0.121 gemini-p=0.125 gpt-3.5-=0.132 gpt-4-tu=0.129 gpt-4-tu=0.147 gpt-4.5-=0.139 gpt-4o=0.125 gpt-4o-m=0.129 llama-2-=0.121 llama-2-=0.112 llama-3.=0.123 llama-3.=0.143 ministra=0.131 mistral-=0.128 mixtral-=0.132 o3-mini=0.130 qwen1.5-=0.142 text-bis=0.125
2026-04-13 12:02:10,222 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:02:10,223 INFO [Step 90/200] det=skip para=-0.0000 raw_rwd=0.1252Β±0.0119 rwd=0.1252
2026-04-13 12:02:10,223 INFO per-gen rewards: deepseek=0.127 falcon3-=0.133 gemini-1=0.132 gemini-2=0.130 gemini-p=0.139 gemini-p=0.144 gpt-3.5-=0.128 gpt-4-tu=0.117 gpt-4-tu=0.118 gpt-4.5-=0.113 gpt-4o=0.123 gpt-4o-m=0.121 llama-2-=0.123 llama-2-=0.129 llama-3.=0.124 llama-3.=0.113 ministra=0.114 mistral-=0.119 mixtral-=0.132 o3-mini=0.126 qwen1.5-=0.128 text-bis=0.132
2026-04-13 12:06:54,880 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:06:54,880 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:06:54,880 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:06:54,880 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:06:54,880 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:06:54,880 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:06:54,880 INFO β gemini-pro 0.9851
2026-04-13 12:06:54,880 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:06:54,880 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:06:54,880 INFO β gpt-4-turbo 1.0000
2026-04-13 12:06:54,880 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:06:54,880 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:06:54,880 INFO β gpt-4o 0.9999
2026-04-13 12:06:54,880 INFO β gpt-4o-mini 0.9999
2026-04-13 12:06:54,880 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:06:54,880 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:06:54,880 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:06:54,880 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:06:54,880 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:06:54,880 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:06:54,880 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:06:54,880 INFO β o3-mini 0.9999
2026-04-13 12:06:54,880 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:06:54,881 INFO β text-bison-002 0.9992
2026-04-13 12:06:54,881 INFO β (prev best) 0.9960
2026-04-13 12:06:54,881 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:06:54,881 INFO β article_deletion 0.9981 ~
2026-04-13 12:06:54,881 INFO β homoglyphs 1.0000 ~
2026-04-13 12:06:54,881 INFO β misspelling 0.9998 ~
2026-04-13 12:06:54,881 INFO β no_attack 0.9966 ~
2026-04-13 12:06:54,881 INFO β synonym_replacement 0.9997 ~
2026-04-13 12:06:54,881 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:06:54,881 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:06:54,881 INFO No improvement (11/25) best=0.9960
2026-04-13 12:07:09,705 INFO [Step 91/200] det=skip para=0.0640 raw_rwd=0.1266Β±0.0253 rwd=0.1266
2026-04-13 12:07:09,705 INFO per-gen rewards: deepseek=0.120 falcon3-=0.119 gemini-1=0.123 gemini-2=0.126 gemini-p=0.307 gemini-p=0.121 gpt-3.5-=0.129 gpt-4-tu=0.136 gpt-4-tu=0.130 gpt-4.5-=0.129 gpt-4o=0.122 gpt-4o-m=0.122 llama-2-=0.128 llama-2-=0.120 llama-3.=0.121 llama-3.=0.119 ministra=0.133 mistral-=0.130 mixtral-=0.115 o3-mini=0.119 qwen1.5-=0.114 text-bis=0.130
2026-04-13 12:07:24,200 INFO [Step 92/200] det=skip para=0.0653 raw_rwd=0.1265Β±0.0240 rwd=0.1265
2026-04-13 12:07:24,200 INFO per-gen rewards: deepseek=0.127 falcon3-=0.120 gemini-1=0.122 gemini-2=0.123 gemini-p=0.121 gemini-p=0.116 gpt-3.5-=0.125 gpt-4-tu=0.125 gpt-4-tu=0.135 gpt-4.5-=0.124 gpt-4o=0.126 gpt-4o-m=0.124 llama-2-=0.123 llama-2-=0.114 llama-3.=0.125 llama-3.=0.118 ministra=0.126 mistral-=0.112 mixtral-=0.113 o3-mini=0.163 qwen1.5-=0.128 text-bis=0.118
2026-04-13 12:07:38,647 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:07:38,648 INFO [Step 93/200] det=skip para=0.0036 raw_rwd=0.1240Β±0.0113 rwd=0.1240
2026-04-13 12:07:38,648 INFO per-gen rewards: deepseek=0.114 falcon3-=0.129 gemini-1=0.120 gemini-2=0.124 gemini-p=0.131 gemini-p=0.116 gpt-3.5-=0.120 gpt-4-tu=0.119 gpt-4-tu=0.117 gpt-4.5-=0.116 gpt-4o=0.125 gpt-4o-m=0.128 llama-2-=0.126 llama-2-=0.131 llama-3.=0.126 llama-3.=0.116 ministra=0.131 mistral-=0.134 mixtral-=0.106 o3-mini=0.127 qwen1.5-=0.126 text-bis=0.136
2026-04-13 12:07:53,143 INFO [Step 94/200] det=skip para=0.0000 raw_rwd=0.1238Β±0.0114 rwd=0.1238
2026-04-13 12:07:53,143 INFO per-gen rewards: deepseek=0.131 falcon3-=0.128 gemini-1=0.132 gemini-2=0.117 gemini-p=0.127 gemini-p=0.127 gpt-3.5-=0.116 gpt-4-tu=0.110 gpt-4-tu=0.122 gpt-4.5-=0.104 gpt-4o=0.132 gpt-4o-m=0.128 llama-2-=0.126 llama-2-=0.111 llama-3.=0.127 llama-3.=0.115 ministra=0.115 mistral-=0.106 mixtral-=0.140 o3-mini=0.125 qwen1.5-=0.122 text-bis=0.127
2026-04-13 12:08:08,144 INFO [Step 95/200] det=skip para=0.0000 raw_rwd=0.1253Β±0.0117 rwd=0.1253
2026-04-13 12:08:08,145 INFO per-gen rewards: deepseek=0.118 falcon3-=0.122 gemini-1=0.120 gemini-2=0.120 gemini-p=0.132 gemini-p=0.142 gpt-3.5-=0.120 gpt-4-tu=0.129 gpt-4-tu=0.132 gpt-4.5-=0.122 gpt-4o=0.119 gpt-4o-m=0.120 llama-2-=0.125 llama-2-=0.129 llama-3.=0.136 llama-3.=0.124 ministra=0.130 mistral-=0.126 mixtral-=0.124 o3-mini=0.144 qwen1.5-=0.122 text-bis=0.126
2026-04-13 12:12:52,429 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:12:52,429 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:12:52,429 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:12:52,429 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:12:52,429 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:12:52,429 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:12:52,429 INFO β gemini-pro 0.9851
2026-04-13 12:12:52,429 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:12:52,429 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:12:52,429 INFO β gpt-4-turbo 1.0000
2026-04-13 12:12:52,429 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:12:52,429 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:12:52,429 INFO β gpt-4o 0.9999
2026-04-13 12:12:52,429 INFO β gpt-4o-mini 0.9999
2026-04-13 12:12:52,429 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:12:52,429 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:12:52,429 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:12:52,429 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:12:52,429 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:12:52,429 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:12:52,429 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:12:52,430 INFO β o3-mini 0.9999
2026-04-13 12:12:52,430 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:12:52,430 INFO β text-bison-002 0.9992
2026-04-13 12:12:52,430 INFO β (prev best) 0.9960
2026-04-13 12:12:52,430 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:12:52,430 INFO β article_deletion 0.9981 ~
2026-04-13 12:12:52,430 INFO β homoglyphs 1.0000 ~
2026-04-13 12:12:52,430 INFO β misspelling 0.9997 ~
2026-04-13 12:12:52,430 INFO β no_attack 0.9966 ~
2026-04-13 12:12:52,430 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:12:52,430 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:12:52,430 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:12:52,430 INFO No improvement (12/25) best=0.9960
2026-04-13 12:13:07,242 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:13:07,243 INFO [Step 96/200] det=skip para=0.0019 raw_rwd=0.1251Β±0.0110 rwd=0.1251
2026-04-13 12:13:07,243 INFO per-gen rewards: deepseek=0.121 falcon3-=0.137 gemini-1=0.123 gemini-2=0.130 gemini-p=0.115 gemini-p=0.128 gpt-3.5-=0.129 gpt-4-tu=0.130 gpt-4-tu=0.109 gpt-4.5-=0.115 gpt-4o=0.123 gpt-4o-m=0.121 llama-2-=0.107 llama-2-=0.128 llama-3.=0.120 llama-3.=0.115 ministra=0.132 mistral-=0.131 mixtral-=0.138 o3-mini=0.130 qwen1.5-=0.122 text-bis=0.111
2026-04-13 12:13:21,757 INFO [Step 97/200] det=skip para=-0.0000 raw_rwd=0.1266Β±0.0126 rwd=0.1266
2026-04-13 12:13:21,757 INFO per-gen rewards: deepseek=0.126 falcon3-=0.121 gemini-1=0.133 gemini-2=0.118 gemini-p=0.143 gemini-p=0.112 gpt-3.5-=0.128 gpt-4-tu=0.123 gpt-4-tu=0.126 gpt-4.5-=0.128 gpt-4o=0.129 gpt-4o-m=0.125 llama-2-=0.124 llama-2-=0.119 llama-3.=0.133 llama-3.=0.132 ministra=0.119 mistral-=0.121 mixtral-=0.133 o3-mini=0.125 qwen1.5-=0.153 text-bis=0.131
2026-04-13 12:13:36,314 INFO [Step 98/200] det=skip para=0.0624 raw_rwd=0.1302Β±0.0251 rwd=0.1302
2026-04-13 12:13:36,314 INFO per-gen rewards: deepseek=0.132 falcon3-=0.127 gemini-1=0.118 gemini-2=0.128 gemini-p=0.116 gemini-p=0.128 gpt-3.5-=0.156 gpt-4-tu=0.128 gpt-4-tu=0.121 gpt-4.5-=0.150 gpt-4o=0.133 gpt-4o-m=0.127 llama-2-=0.133 llama-2-=0.129 llama-3.=0.124 llama-3.=0.122 ministra=0.124 mistral-=0.143 mixtral-=0.141 o3-mini=0.131 qwen1.5-=0.109 text-bis=0.133
2026-04-13 12:13:50,828 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:13:50,828 INFO [Step 99/200] det=skip para=0.0009 raw_rwd=0.1236Β±0.0104 rwd=0.1236
2026-04-13 12:13:50,828 INFO per-gen rewards: deepseek=0.118 falcon3-=0.118 gemini-1=0.124 gemini-2=0.124 gemini-p=0.126 gemini-p=0.108 gpt-3.5-=0.126 gpt-4-tu=0.126 gpt-4-tu=0.120 gpt-4.5-=0.119 gpt-4o=0.121 gpt-4o-m=0.127 llama-2-=0.138 llama-2-=0.129 llama-3.=0.120 llama-3.=0.144 ministra=0.123 mistral-=0.110 mixtral-=0.134 o3-mini=0.126 qwen1.5-=0.116 text-bis=0.127
2026-04-13 12:14:05,147 INFO [Step 100/200] det=skip para=0.0006 raw_rwd=0.1251Β±0.0105 rwd=0.1251
2026-04-13 12:14:05,147 INFO per-gen rewards: deepseek=0.128 falcon3-=0.117 gemini-1=0.125 gemini-2=0.132 gemini-p=0.123 gemini-p=0.127 gpt-3.5-=0.120 gpt-4-tu=0.117 gpt-4-tu=0.119 gpt-4.5-=0.131 gpt-4o=0.123 gpt-4o-m=0.132 llama-2-=0.126 llama-2-=0.143 llama-3.=0.126 llama-3.=0.121 ministra=0.122 mistral-=0.121 mixtral-=0.123 o3-mini=0.130 qwen1.5-=0.115 text-bis=0.117
2026-04-13 12:18:48,453 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:18:48,453 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:18:48,453 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:18:48,453 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:18:48,453 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:18:48,453 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:18:48,453 INFO β gemini-pro 0.9851
2026-04-13 12:18:48,453 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:18:48,453 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:18:48,453 INFO β gpt-4-turbo 1.0000
2026-04-13 12:18:48,453 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:18:48,453 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:18:48,453 INFO β gpt-4o 0.9999
2026-04-13 12:18:48,453 INFO β gpt-4o-mini 0.9999
2026-04-13 12:18:48,453 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:18:48,453 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:18:48,454 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:18:48,454 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:18:48,454 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:18:48,454 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:18:48,454 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:18:48,454 INFO β o3-mini 0.9999
2026-04-13 12:18:48,454 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:18:48,454 INFO β text-bison-002 0.9992
2026-04-13 12:18:48,454 INFO β (prev best) 0.9960
2026-04-13 12:18:48,454 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:18:48,454 INFO β article_deletion 0.9984 ~
2026-04-13 12:18:48,454 INFO β homoglyphs 1.0000 ~
2026-04-13 12:18:48,454 INFO β misspelling 0.9995 ~
2026-04-13 12:18:48,454 INFO β no_attack 0.9966 ~
2026-04-13 12:18:48,454 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:18:48,454 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:18:48,454 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:18:48,454 INFO No improvement (13/25) best=0.9960
2026-04-13 12:19:03,261 INFO [Step 101/200] det=skip para=0.0028 raw_rwd=0.1272Β±0.0129 rwd=0.1272
2026-04-13 12:19:03,261 INFO per-gen rewards: deepseek=0.117 falcon3-=0.123 gemini-1=0.128 gemini-2=0.130 gemini-p=0.129 gemini-p=0.118 gpt-3.5-=0.126 gpt-4-tu=0.130 gpt-4-tu=0.122 gpt-4.5-=0.124 gpt-4o=0.122 gpt-4o-m=0.130 llama-2-=0.146 llama-2-=0.133 llama-3.=0.128 llama-3.=0.144 ministra=0.130 mistral-=0.115 mixtral-=0.121 o3-mini=0.130 qwen1.5-=0.148 text-bis=0.109
2026-04-13 12:19:17,941 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:19:17,942 INFO [Step 102/200] det=skip para=-0.0000 raw_rwd=0.1271Β±0.0110 rwd=0.1271
2026-04-13 12:19:17,942 INFO per-gen rewards: deepseek=0.123 falcon3-=0.126 gemini-1=0.132 gemini-2=0.123 gemini-p=0.100 gemini-p=0.145 gpt-3.5-=0.131 gpt-4-tu=0.131 gpt-4-tu=0.144 gpt-4.5-=0.122 gpt-4o=0.126 gpt-4o-m=0.135 llama-2-=0.141 llama-2-=0.129 llama-3.=0.126 llama-3.=0.136 ministra=0.124 mistral-=0.120 mixtral-=0.118 o3-mini=0.119 qwen1.5-=0.134 text-bis=0.125
2026-04-13 12:19:32,983 INFO [Step 103/200] det=skip para=-0.0000 raw_rwd=0.1235Β±0.0117 rwd=0.1235
2026-04-13 12:19:32,983 INFO per-gen rewards: deepseek=0.112 falcon3-=0.133 gemini-1=0.122 gemini-2=0.129 gemini-p=0.137 gemini-p=0.115 gpt-3.5-=0.121 gpt-4-tu=0.114 gpt-4-tu=0.138 gpt-4.5-=0.128 gpt-4o=0.121 gpt-4o-m=0.123 llama-2-=0.116 llama-2-=0.124 llama-3.=0.130 llama-3.=0.129 ministra=0.114 mistral-=0.134 mixtral-=0.143 o3-mini=0.122 qwen1.5-=0.124 text-bis=0.119
2026-04-13 12:19:48,619 INFO [Step 104/200] det=skip para=0.0034 raw_rwd=0.1270Β±0.0132 rwd=0.1270
2026-04-13 12:19:48,619 INFO per-gen rewards: deepseek=0.127 falcon3-=0.126 gemini-1=0.140 gemini-2=0.125 gemini-p=0.113 gemini-p=0.119 gpt-3.5-=0.124 gpt-4-tu=0.135 gpt-4-tu=0.107 gpt-4.5-=0.132 gpt-4o=0.126 gpt-4o-m=0.129 llama-2-=0.101 llama-2-=0.129 llama-3.=0.133 llama-3.=0.129 ministra=0.119 mistral-=0.140 mixtral-=0.142 o3-mini=0.126 qwen1.5-=0.135 text-bis=0.116
2026-04-13 12:20:03,223 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:20:03,223 INFO [Step 105/200] det=skip para=-0.0000 raw_rwd=0.1237Β±0.0099 rwd=0.1237
2026-04-13 12:20:03,223 INFO per-gen rewards: deepseek=0.124 falcon3-=0.125 gemini-1=0.126 gemini-2=0.127 gemini-p=0.120 gemini-p=0.129 gpt-3.5-=0.133 gpt-4-tu=0.110 gpt-4-tu=0.124 gpt-4.5-=0.129 gpt-4o=0.120 gpt-4o-m=0.123 llama-2-=0.116 llama-2-=0.123 llama-3.=0.121 llama-3.=0.113 ministra=0.131 mistral-=0.120 mixtral-=0.108 o3-mini=0.117 qwen1.5-=0.118 text-bis=0.138
2026-04-13 12:24:47,237 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:24:47,237 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:24:47,238 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:24:47,238 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:24:47,238 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:24:47,238 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:24:47,238 INFO β gemini-pro 0.9851
2026-04-13 12:24:47,238 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:24:47,238 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:24:47,238 INFO β gpt-4-turbo 1.0000
2026-04-13 12:24:47,238 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:24:47,238 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:24:47,238 INFO β gpt-4o 0.9999
2026-04-13 12:24:47,238 INFO β gpt-4o-mini 0.9999
2026-04-13 12:24:47,238 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:24:47,238 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:24:47,238 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:24:47,238 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:24:47,238 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:24:47,238 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:24:47,238 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:24:47,238 INFO β o3-mini 0.9999
2026-04-13 12:24:47,238 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:24:47,238 INFO β text-bison-002 0.9992
2026-04-13 12:24:47,238 INFO β (prev best) 0.9960
2026-04-13 12:24:47,238 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:24:47,238 INFO β article_deletion 0.9981 ~
2026-04-13 12:24:47,238 INFO β homoglyphs 1.0000 ~
2026-04-13 12:24:47,238 INFO β misspelling 0.9996 ~
2026-04-13 12:24:47,238 INFO β no_attack 0.9966 ~
2026-04-13 12:24:47,238 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:24:47,238 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:24:47,238 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:24:47,238 INFO No improvement (14/25) best=0.9960
2026-04-13 12:25:01,910 INFO [Step 106/200] det=skip para=0.0000 raw_rwd=0.1228Β±0.0080 rwd=0.1228
2026-04-13 12:25:01,910 INFO per-gen rewards: deepseek=0.127 falcon3-=0.124 gemini-1=0.126 gemini-2=0.124 gemini-p=0.122 gemini-p=0.120 gpt-3.5-=0.120 gpt-4-tu=0.128 gpt-4-tu=0.118 gpt-4.5-=0.124 gpt-4o=0.124 gpt-4o-m=0.124 llama-2-=0.129 llama-2-=0.124 llama-3.=0.116 llama-3.=0.127 ministra=0.126 mistral-=0.128 mixtral-=0.116 o3-mini=0.123 qwen1.5-=0.113 text-bis=0.105
2026-04-13 12:25:16,379 INFO [Step 107/200] det=skip para=-0.0000 raw_rwd=0.1242Β±0.0093 rwd=0.1242
2026-04-13 12:25:16,379 INFO per-gen rewards: deepseek=0.127 falcon3-=0.121 gemini-1=0.132 gemini-2=0.128 gemini-p=0.125 gemini-p=0.133 gpt-3.5-=0.120 gpt-4-tu=0.119 gpt-4-tu=0.124 gpt-4.5-=0.135 gpt-4o=0.119 gpt-4o-m=0.125 llama-2-=0.120 llama-2-=0.101 llama-3.=0.129 llama-3.=0.121 ministra=0.122 mistral-=0.137 mixtral-=0.117 o3-mini=0.124 qwen1.5-=0.120 text-bis=0.126
2026-04-13 12:25:30,912 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:25:30,913 INFO [Step 108/200] det=skip para=0.0000 raw_rwd=0.1275Β±0.0118 rwd=0.1275
2026-04-13 12:25:30,913 INFO per-gen rewards: deepseek=0.123 falcon3-=0.135 gemini-1=0.129 gemini-2=0.124 gemini-p=0.158 gemini-p=0.114 gpt-3.5-=0.127 gpt-4-tu=0.126 gpt-4-tu=0.129 gpt-4.5-=0.151 gpt-4o=0.124 gpt-4o-m=0.131 llama-2-=0.127 llama-2-=0.121 llama-3.=0.127 llama-3.=0.131 ministra=0.124 mistral-=0.122 mixtral-=0.133 o3-mini=0.125 qwen1.5-=0.098 text-bis=0.151
2026-04-13 12:25:45,652 INFO [Step 109/200] det=skip para=0.0021 raw_rwd=0.1263Β±0.0113 rwd=0.1263
2026-04-13 12:25:45,653 INFO per-gen rewards: deepseek=0.124 falcon3-=0.123 gemini-1=0.118 gemini-2=0.136 gemini-p=0.105 gemini-p=0.112 gpt-3.5-=0.126 gpt-4-tu=0.107 gpt-4-tu=0.122 gpt-4.5-=0.116 gpt-4o=0.134 gpt-4o-m=0.122 llama-2-=0.127 llama-2-=0.116 llama-3.=0.126 llama-3.=0.127 ministra=0.130 mistral-=0.120 mixtral-=0.127 o3-mini=0.134 qwen1.5-=0.141 text-bis=0.135
2026-04-13 12:26:00,422 INFO [Step 110/200] det=skip para=0.0008 raw_rwd=0.1253Β±0.0139 rwd=0.1253
2026-04-13 12:26:00,422 INFO per-gen rewards: deepseek=0.132 falcon3-=0.122 gemini-1=0.129 gemini-2=0.123 gemini-p=0.114 gemini-p=0.133 gpt-3.5-=0.127 gpt-4-tu=0.119 gpt-4-tu=0.115 gpt-4.5-=0.119 gpt-4o=0.123 gpt-4o-m=0.137 llama-2-=0.124 llama-2-=0.109 llama-3.=0.135 llama-3.=0.109 ministra=0.123 mistral-=0.127 mixtral-=0.119 o3-mini=0.115 qwen1.5-=0.127 text-bis=0.128
2026-04-13 12:30:42,979 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:30:42,979 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:30:42,979 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:30:42,979 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:30:42,979 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:30:42,979 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:30:42,979 INFO β gemini-pro 0.9851
2026-04-13 12:30:42,979 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:30:42,979 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:30:42,979 INFO β gpt-4-turbo 1.0000
2026-04-13 12:30:42,979 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:30:42,979 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:30:42,979 INFO β gpt-4o 0.9999
2026-04-13 12:30:42,979 INFO β gpt-4o-mini 0.9999
2026-04-13 12:30:42,979 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:30:42,979 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:30:42,980 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:30:42,980 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:30:42,980 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:30:42,980 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:30:42,980 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:30:42,980 INFO β o3-mini 0.9999
2026-04-13 12:30:42,980 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:30:42,980 INFO β text-bison-002 0.9992
2026-04-13 12:30:42,980 INFO β (prev best) 0.9960
2026-04-13 12:30:42,980 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:30:42,980 INFO β article_deletion 0.9981 ~
2026-04-13 12:30:42,980 INFO β homoglyphs 1.0000 ~
2026-04-13 12:30:42,980 INFO β misspelling 0.9996 ~
2026-04-13 12:30:42,980 INFO β no_attack 0.9966 ~
2026-04-13 12:30:42,980 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:30:42,980 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:30:42,980 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:30:42,980 INFO No improvement (15/25) best=0.9960
2026-04-13 12:30:57,941 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:30:57,942 INFO [Step 111/200] det=skip para=0.0000 raw_rwd=0.1246Β±0.0116 rwd=0.1246
2026-04-13 12:30:57,942 INFO per-gen rewards: deepseek=0.123 falcon3-=0.123 gemini-1=0.118 gemini-2=0.128 gemini-p=0.137 gemini-p=0.110 gpt-3.5-=0.121 gpt-4-tu=0.147 gpt-4-tu=0.132 gpt-4.5-=0.152 gpt-4o=0.127 gpt-4o-m=0.119 llama-2-=0.114 llama-2-=0.131 llama-3.=0.131 llama-3.=0.122 ministra=0.122 mistral-=0.110 mixtral-=0.140 o3-mini=0.130 qwen1.5-=0.107 text-bis=0.118
2026-04-13 12:31:12,864 INFO [Step 112/200] det=skip para=0.0000 raw_rwd=0.1264Β±0.0098 rwd=0.1264
2026-04-13 12:31:12,864 INFO per-gen rewards: deepseek=0.130 falcon3-=0.122 gemini-1=0.122 gemini-2=0.130 gemini-p=0.117 gemini-p=0.148 gpt-3.5-=0.126 gpt-4-tu=0.118 gpt-4-tu=0.133 gpt-4.5-=0.106 gpt-4o=0.124 gpt-4o-m=0.129 llama-2-=0.131 llama-2-=0.133 llama-3.=0.128 llama-3.=0.128 ministra=0.132 mistral-=0.127 mixtral-=0.110 o3-mini=0.123 qwen1.5-=0.121 text-bis=0.122
2026-04-13 12:31:27,747 INFO [Step 113/200] det=skip para=-0.0000 raw_rwd=0.1274Β±0.0100 rwd=0.1274
2026-04-13 12:31:27,747 INFO per-gen rewards: deepseek=0.127 falcon3-=0.126 gemini-1=0.130 gemini-2=0.127 gemini-p=0.130 gemini-p=0.131 gpt-3.5-=0.131 gpt-4-tu=0.118 gpt-4-tu=0.119 gpt-4.5-=0.123 gpt-4o=0.129 gpt-4o-m=0.125 llama-2-=0.136 llama-2-=0.129 llama-3.=0.131 llama-3.=0.119 ministra=0.119 mistral-=0.133 mixtral-=0.130 o3-mini=0.130 qwen1.5-=0.129 text-bis=0.133
2026-04-13 12:31:42,552 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:31:42,552 INFO [Step 114/200] det=skip para=0.0103 raw_rwd=0.1240Β±0.0104 rwd=0.1240
2026-04-13 12:31:42,552 INFO per-gen rewards: deepseek=0.138 falcon3-=0.120 gemini-1=0.120 gemini-2=0.122 gemini-p=0.129 gemini-p=0.132 gpt-3.5-=0.126 gpt-4-tu=0.132 gpt-4-tu=0.125 gpt-4.5-=0.124 gpt-4o=0.119 gpt-4o-m=0.126 llama-2-=0.138 llama-2-=0.141 llama-3.=0.121 llama-3.=0.116 ministra=0.112 mistral-=0.130 mixtral-=0.133 o3-mini=0.125 qwen1.5-=0.114 text-bis=0.137
2026-04-13 12:31:57,013 INFO [Step 115/200] det=skip para=0.0000 raw_rwd=0.1236Β±0.0120 rwd=0.1236
2026-04-13 12:31:57,013 INFO per-gen rewards: deepseek=0.123 falcon3-=0.117 gemini-1=0.125 gemini-2=0.118 gemini-p=0.128 gemini-p=0.102 gpt-3.5-=0.125 gpt-4-tu=0.140 gpt-4-tu=0.120 gpt-4.5-=0.103 gpt-4o=0.132 gpt-4o-m=0.117 llama-2-=0.122 llama-2-=0.122 llama-3.=0.116 llama-3.=0.131 ministra=0.131 mistral-=0.139 mixtral-=0.121 o3-mini=0.130 qwen1.5-=0.134 text-bis=0.113
2026-04-13 12:36:39,822 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:36:39,822 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:36:39,822 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:36:39,822 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:36:39,822 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:36:39,822 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:36:39,822 INFO β gemini-pro 0.9851
2026-04-13 12:36:39,822 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:36:39,823 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:36:39,823 INFO β gpt-4-turbo 1.0000
2026-04-13 12:36:39,823 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:36:39,823 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:36:39,823 INFO β gpt-4o 0.9999
2026-04-13 12:36:39,823 INFO β gpt-4o-mini 0.9999
2026-04-13 12:36:39,823 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:36:39,823 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:36:39,823 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:36:39,823 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:36:39,823 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:36:39,823 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:36:39,823 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:36:39,823 INFO β o3-mini 0.9999
2026-04-13 12:36:39,823 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:36:39,823 INFO β text-bison-002 0.9992
2026-04-13 12:36:39,823 INFO β (prev best) 0.9960
2026-04-13 12:36:39,823 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:36:39,823 INFO β article_deletion 0.9982 ~
2026-04-13 12:36:39,823 INFO β homoglyphs 1.0000 ~
2026-04-13 12:36:39,823 INFO β misspelling 0.9997 ~
2026-04-13 12:36:39,823 INFO β no_attack 0.9966 ~
2026-04-13 12:36:39,823 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:36:39,823 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:36:39,823 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:36:39,823 INFO No improvement (16/25) best=0.9960
2026-04-13 12:36:54,740 INFO [Step 116/200] det=skip para=-0.0000 raw_rwd=0.1244Β±0.0105 rwd=0.1244
2026-04-13 12:36:54,740 INFO per-gen rewards: deepseek=0.122 falcon3-=0.135 gemini-1=0.118 gemini-2=0.122 gemini-p=0.113 gemini-p=0.108 gpt-3.5-=0.130 gpt-4-tu=0.134 gpt-4-tu=0.122 gpt-4.5-=0.113 gpt-4o=0.125 gpt-4o-m=0.120 llama-2-=0.121 llama-2-=0.136 llama-3.=0.132 llama-3.=0.118 ministra=0.124 mistral-=0.124 mixtral-=0.147 o3-mini=0.121 qwen1.5-=0.123 text-bis=0.127
2026-04-13 12:37:09,286 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:37:09,287 INFO [Step 117/200] det=skip para=-0.0000 raw_rwd=0.1246Β±0.0102 rwd=0.1246
2026-04-13 12:37:09,287 INFO per-gen rewards: deepseek=0.127 falcon3-=0.123 gemini-1=0.121 gemini-2=0.127 gemini-p=0.110 gemini-p=0.116 gpt-3.5-=0.134 gpt-4-tu=0.118 gpt-4-tu=0.148 gpt-4.5-=0.126 gpt-4o=0.125 gpt-4o-m=0.125 llama-2-=0.138 llama-2-=0.110 llama-3.=0.123 llama-3.=0.119 ministra=0.124 mistral-=0.125 mixtral-=0.128 o3-mini=0.116 qwen1.5-=0.134 text-bis=0.124
2026-04-13 12:37:23,646 INFO [Step 118/200] det=skip para=0.0000 raw_rwd=0.1230Β±0.0088 rwd=0.1230
2026-04-13 12:37:23,646 INFO per-gen rewards: deepseek=0.121 falcon3-=0.134 gemini-1=0.118 gemini-2=0.120 gemini-p=0.129 gemini-p=0.129 gpt-3.5-=0.122 gpt-4-tu=0.107 gpt-4-tu=0.112 gpt-4.5-=0.120 gpt-4o=0.119 gpt-4o-m=0.120 llama-2-=0.138 llama-2-=0.130 llama-3.=0.130 llama-3.=0.121 ministra=0.124 mistral-=0.128 mixtral-=0.117 o3-mini=0.129 qwen1.5-=0.118 text-bis=0.126
2026-04-13 12:37:38,151 INFO [Step 119/200] det=skip para=-0.0000 raw_rwd=0.1266Β±0.0123 rwd=0.1266
2026-04-13 12:37:38,151 INFO per-gen rewards: deepseek=0.123 falcon3-=0.123 gemini-1=0.126 gemini-2=0.132 gemini-p=0.116 gemini-p=0.107 gpt-3.5-=0.134 gpt-4-tu=0.122 gpt-4-tu=0.114 gpt-4.5-=0.118 gpt-4o=0.129 gpt-4o-m=0.123 llama-2-=0.125 llama-2-=0.119 llama-3.=0.125 llama-3.=0.120 ministra=0.131 mistral-=0.138 mixtral-=0.116 o3-mini=0.127 qwen1.5-=0.140 text-bis=0.139
2026-04-13 12:37:53,091 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:37:53,091 INFO [Step 120/200] det=skip para=0.0000 raw_rwd=0.1255Β±0.0112 rwd=0.1255
2026-04-13 12:37:53,091 INFO per-gen rewards: deepseek=0.125 falcon3-=0.128 gemini-1=0.130 gemini-2=0.129 gemini-p=0.129 gemini-p=0.126 gpt-3.5-=0.124 gpt-4-tu=0.136 gpt-4-tu=0.118 gpt-4.5-=0.146 gpt-4o=0.127 gpt-4o-m=0.123 llama-2-=0.103 llama-2-=0.108 llama-3.=0.125 llama-3.=0.124 ministra=0.123 mistral-=0.118 mixtral-=0.125 o3-mini=0.127 qwen1.5-=0.125 text-bis=0.132
2026-04-13 12:42:37,843 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:42:37,844 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:42:37,844 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:42:37,844 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:42:37,844 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:42:37,844 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:42:37,844 INFO β gemini-pro 0.9851
2026-04-13 12:42:37,844 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:42:37,844 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:42:37,844 INFO β gpt-4-turbo 1.0000
2026-04-13 12:42:37,844 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:42:37,844 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:42:37,844 INFO β gpt-4o 0.9999
2026-04-13 12:42:37,844 INFO β gpt-4o-mini 0.9999
2026-04-13 12:42:37,844 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:42:37,844 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:42:37,844 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:42:37,844 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:42:37,844 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:42:37,844 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:42:37,844 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:42:37,844 INFO β o3-mini 0.9999
2026-04-13 12:42:37,844 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:42:37,844 INFO β text-bison-002 0.9992
2026-04-13 12:42:37,844 INFO β (prev best) 0.9960
2026-04-13 12:42:37,844 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:42:37,844 INFO β article_deletion 0.9982 ~
2026-04-13 12:42:37,844 INFO β homoglyphs 1.0000 ~
2026-04-13 12:42:37,844 INFO β misspelling 0.9998 ~
2026-04-13 12:42:37,844 INFO β no_attack 0.9966 ~
2026-04-13 12:42:37,844 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:42:37,844 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:42:37,844 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:42:37,844 INFO No improvement (17/25) best=0.9960
2026-04-13 12:42:52,836 INFO [Step 121/200] det=skip para=-0.0000 raw_rwd=0.1249Β±0.0116 rwd=0.1249
2026-04-13 12:42:52,836 INFO per-gen rewards: deepseek=0.124 falcon3-=0.117 gemini-1=0.125 gemini-2=0.132 gemini-p=0.111 gemini-p=0.117 gpt-3.5-=0.121 gpt-4-tu=0.137 gpt-4-tu=0.123 gpt-4.5-=0.128 gpt-4o=0.128 gpt-4o-m=0.134 llama-2-=0.142 llama-2-=0.126 llama-3.=0.117 llama-3.=0.112 ministra=0.121 mistral-=0.152 mixtral-=0.115 o3-mini=0.121 qwen1.5-=0.127 text-bis=0.142
2026-04-13 12:43:07,504 INFO [Step 122/200] det=skip para=0.0000 raw_rwd=0.1252Β±0.0103 rwd=0.1252
2026-04-13 12:43:07,504 INFO per-gen rewards: deepseek=0.130 falcon3-=0.123 gemini-1=0.123 gemini-2=0.125 gemini-p=0.124 gemini-p=0.122 gpt-3.5-=0.124 gpt-4-tu=0.144 gpt-4-tu=0.118 gpt-4.5-=0.120 gpt-4o=0.126 gpt-4o-m=0.124 llama-2-=0.122 llama-2-=0.113 llama-3.=0.121 llama-3.=0.131 ministra=0.131 mistral-=0.122 mixtral-=0.129 o3-mini=0.127 qwen1.5-=0.105 text-bis=0.137
2026-04-13 12:43:22,666 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:43:22,667 INFO [Step 123/200] det=skip para=-0.0000 raw_rwd=0.1235Β±0.0094 rwd=0.1235
2026-04-13 12:43:22,667 INFO per-gen rewards: deepseek=0.119 falcon3-=0.122 gemini-1=0.124 gemini-2=0.123 gemini-p=0.123 gemini-p=0.144 gpt-3.5-=0.121 gpt-4-tu=0.126 gpt-4-tu=0.117 gpt-4.5-=0.136 gpt-4o=0.126 gpt-4o-m=0.122 llama-2-=0.127 llama-2-=0.103 llama-3.=0.132 llama-3.=0.128 ministra=0.120 mistral-=0.114 mixtral-=0.139 o3-mini=0.119 qwen1.5-=0.137 text-bis=0.121
2026-04-13 12:43:37,255 INFO [Step 124/200] det=skip para=0.0007 raw_rwd=0.1254Β±0.0112 rwd=0.1254
2026-04-13 12:43:37,256 INFO per-gen rewards: deepseek=0.127 falcon3-=0.127 gemini-1=0.120 gemini-2=0.131 gemini-p=0.109 gemini-p=0.121 gpt-3.5-=0.124 gpt-4-tu=0.115 gpt-4-tu=0.103 gpt-4.5-=0.115 gpt-4o=0.133 gpt-4o-m=0.127 llama-2-=0.116 llama-2-=0.120 llama-3.=0.135 llama-3.=0.119 ministra=0.127 mistral-=0.115 mixtral-=0.122 o3-mini=0.115 qwen1.5-=0.132 text-bis=0.160
2026-04-13 12:43:52,579 INFO [Step 125/200] det=skip para=0.0138 raw_rwd=0.1233Β±0.0114 rwd=0.1233
2026-04-13 12:43:52,580 INFO per-gen rewards: deepseek=0.123 falcon3-=0.125 gemini-1=0.126 gemini-2=0.119 gemini-p=0.093 gemini-p=0.139 gpt-3.5-=0.123 gpt-4-tu=0.112 gpt-4-tu=0.113 gpt-4.5-=0.110 gpt-4o=0.131 gpt-4o-m=0.120 llama-2-=0.124 llama-2-=0.103 llama-3.=0.123 llama-3.=0.129 ministra=0.124 mistral-=0.136 mixtral-=0.127 o3-mini=0.125 qwen1.5-=0.126 text-bis=0.134
2026-04-13 12:48:36,372 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:48:36,372 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:48:36,372 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:48:36,372 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:48:36,372 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:48:36,372 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:48:36,372 INFO β gemini-pro 0.9851
2026-04-13 12:48:36,372 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:48:36,372 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:48:36,372 INFO β gpt-4-turbo 1.0000
2026-04-13 12:48:36,372 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:48:36,372 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:48:36,372 INFO β gpt-4o 0.9999
2026-04-13 12:48:36,372 INFO β gpt-4o-mini 0.9999
2026-04-13 12:48:36,372 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:48:36,372 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:48:36,372 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:48:36,372 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:48:36,372 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:48:36,372 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:48:36,372 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:48:36,372 INFO β o3-mini 0.9999
2026-04-13 12:48:36,372 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:48:36,372 INFO β text-bison-002 0.9992
2026-04-13 12:48:36,372 INFO β (prev best) 0.9960
2026-04-13 12:48:36,372 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:48:36,373 INFO β article_deletion 0.9981 ~
2026-04-13 12:48:36,373 INFO β homoglyphs 1.0000 ~
2026-04-13 12:48:36,373 INFO β misspelling 0.9996 ~
2026-04-13 12:48:36,373 INFO β no_attack 0.9966 ~
2026-04-13 12:48:36,373 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:48:36,373 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:48:36,373 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:48:36,373 INFO No improvement (18/25) best=0.9960
2026-04-13 12:48:51,288 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:48:51,288 INFO [Step 126/200] det=skip para=-0.0000 raw_rwd=0.1232Β±0.0092 rwd=0.1232
2026-04-13 12:48:51,288 INFO per-gen rewards: deepseek=0.122 falcon3-=0.119 gemini-1=0.125 gemini-2=0.121 gemini-p=0.114 gemini-p=0.119 gpt-3.5-=0.120 gpt-4-tu=0.124 gpt-4-tu=0.111 gpt-4.5-=0.111 gpt-4o=0.125 gpt-4o-m=0.128 llama-2-=0.139 llama-2-=0.149 llama-3.=0.122 llama-3.=0.121 ministra=0.119 mistral-=0.149 mixtral-=0.113 o3-mini=0.126 qwen1.5-=0.136 text-bis=0.112
2026-04-13 12:49:05,892 INFO [Step 127/200] det=skip para=-0.0000 raw_rwd=0.1248Β±0.0110 rwd=0.1248
2026-04-13 12:49:05,892 INFO per-gen rewards: deepseek=0.122 falcon3-=0.130 gemini-1=0.127 gemini-2=0.125 gemini-p=0.109 gemini-p=0.153 gpt-3.5-=0.126 gpt-4-tu=0.117 gpt-4-tu=0.117 gpt-4.5-=0.136 gpt-4o=0.125 gpt-4o-m=0.121 llama-2-=0.149 llama-2-=0.117 llama-3.=0.118 llama-3.=0.130 ministra=0.121 mistral-=0.115 mixtral-=0.116 o3-mini=0.127 qwen1.5-=0.152 text-bis=0.125
2026-04-13 12:49:20,488 INFO [Step 128/200] det=skip para=0.0122 raw_rwd=0.1260Β±0.0124 rwd=0.1260
2026-04-13 12:49:20,488 INFO per-gen rewards: deepseek=0.132 falcon3-=0.122 gemini-1=0.121 gemini-2=0.121 gemini-p=0.140 gemini-p=0.145 gpt-3.5-=0.125 gpt-4-tu=0.118 gpt-4-tu=0.133 gpt-4.5-=0.124 gpt-4o=0.120 gpt-4o-m=0.126 llama-2-=0.117 llama-2-=0.134 llama-3.=0.132 llama-3.=0.127 ministra=0.129 mistral-=0.122 mixtral-=0.173 o3-mini=0.125 qwen1.5-=0.106 text-bis=0.116
2026-04-13 12:49:34,979 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:49:34,980 INFO [Step 129/200] det=skip para=0.0035 raw_rwd=0.1252Β±0.0109 rwd=0.1252
2026-04-13 12:49:34,980 INFO per-gen rewards: deepseek=0.125 falcon3-=0.118 gemini-1=0.127 gemini-2=0.127 gemini-p=0.129 gemini-p=0.153 gpt-3.5-=0.124 gpt-4-tu=0.132 gpt-4-tu=0.114 gpt-4.5-=0.124 gpt-4o=0.128 gpt-4o-m=0.122 llama-2-=0.143 llama-2-=0.134 llama-3.=0.121 llama-3.=0.119 ministra=0.127 mistral-=0.138 mixtral-=0.111 o3-mini=0.121 qwen1.5-=0.133 text-bis=0.127
2026-04-13 12:49:49,936 INFO [Step 130/200] det=skip para=-0.0000 raw_rwd=0.1235Β±0.0107 rwd=0.1235
2026-04-13 12:49:49,936 INFO per-gen rewards: deepseek=0.126 falcon3-=0.129 gemini-1=0.133 gemini-2=0.121 gemini-p=0.140 gemini-p=0.112 gpt-3.5-=0.109 gpt-4-tu=0.145 gpt-4-tu=0.132 gpt-4.5-=0.122 gpt-4o=0.125 gpt-4o-m=0.122 llama-2-=0.137 llama-2-=0.122 llama-3.=0.122 llama-3.=0.125 ministra=0.121 mistral-=0.142 mixtral-=0.140 o3-mini=0.116 qwen1.5-=0.113 text-bis=0.126
2026-04-13 12:54:33,492 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 12:54:33,493 INFO β MACRO_AVG 0.9960 β
2026-04-13 12:54:33,493 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 12:54:33,493 INFO β falcon3-10b-instruct 0.9992
2026-04-13 12:54:33,493 INFO β gemini-1.5-pro 0.9689
2026-04-13 12:54:33,493 INFO β gemini-2.0-flash 0.9998
2026-04-13 12:54:33,493 INFO β gemini-pro 0.9851
2026-04-13 12:54:33,493 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 12:54:33,493 INFO β gpt-3.5-turbo 0.9999
2026-04-13 12:54:33,493 INFO β gpt-4-turbo 1.0000
2026-04-13 12:54:33,493 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 12:54:33,493 INFO β gpt-4.5-preview 0.9980
2026-04-13 12:54:33,493 INFO β gpt-4o 0.9999
2026-04-13 12:54:33,493 INFO β gpt-4o-mini 0.9999
2026-04-13 12:54:33,493 INFO β llama-2-70b-chat 0.9974
2026-04-13 12:54:33,493 INFO β llama-2-7b-chat 0.9967
2026-04-13 12:54:33,493 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 12:54:33,493 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 12:54:33,493 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 12:54:33,493 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 12:54:33,493 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 12:54:33,493 INFO β o3-mini 0.9999
2026-04-13 12:54:33,493 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 12:54:33,493 INFO β text-bison-002 0.9992
2026-04-13 12:54:33,493 INFO β (prev best) 0.9960
2026-04-13 12:54:33,493 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 12:54:33,493 INFO β article_deletion 0.9981 ~
2026-04-13 12:54:33,493 INFO β homoglyphs 1.0000 ~
2026-04-13 12:54:33,493 INFO β misspelling 0.9997 ~
2026-04-13 12:54:33,493 INFO β no_attack 0.9966 ~
2026-04-13 12:54:33,493 INFO β synonym_replacement 0.9998 ~
2026-04-13 12:54:33,493 INFO β t5_paraphrase 1.0000 ~
2026-04-13 12:54:33,493 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 12:54:33,493 INFO No improvement (19/25) best=0.9960
2026-04-13 12:54:48,420 INFO [Step 131/200] det=skip para=0.0054 raw_rwd=0.1245Β±0.0115 rwd=0.1245
2026-04-13 12:54:48,420 INFO per-gen rewards: deepseek=0.115 falcon3-=0.119 gemini-1=0.119 gemini-2=0.124 gemini-p=0.104 gemini-p=0.152 gpt-3.5-=0.133 gpt-4-tu=0.104 gpt-4-tu=0.126 gpt-4.5-=0.134 gpt-4o=0.128 gpt-4o-m=0.129 llama-2-=0.137 llama-2-=0.135 llama-3.=0.123 llama-3.=0.123 ministra=0.114 mistral-=0.135 mixtral-=0.117 o3-mini=0.122 qwen1.5-=0.140 text-bis=0.156
2026-04-13 12:55:03,541 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:55:03,542 INFO [Step 132/200] det=skip para=0.0694 raw_rwd=0.1289Β±0.0277 rwd=0.1289
2026-04-13 12:55:03,542 INFO per-gen rewards: deepseek=0.133 falcon3-=0.159 gemini-1=0.160 gemini-2=0.126 gemini-p=0.135 gemini-p=0.120 gpt-3.5-=0.128 gpt-4-tu=0.103 gpt-4-tu=0.119 gpt-4.5-=0.127 gpt-4o=0.118 gpt-4o-m=0.121 llama-2-=0.122 llama-2-=0.115 llama-3.=0.122 llama-3.=0.119 ministra=0.130 mistral-=0.142 mixtral-=0.120 o3-mini=0.119 qwen1.5-=0.136 text-bis=0.116
2026-04-13 12:55:18,303 INFO [Step 133/200] det=skip para=0.0000 raw_rwd=0.1248Β±0.0117 rwd=0.1248
2026-04-13 12:55:18,303 INFO per-gen rewards: deepseek=0.118 falcon3-=0.129 gemini-1=0.128 gemini-2=0.133 gemini-p=0.109 gemini-p=0.109 gpt-3.5-=0.121 gpt-4-tu=0.134 gpt-4-tu=0.110 gpt-4.5-=0.130 gpt-4o=0.126 gpt-4o-m=0.127 llama-2-=0.133 llama-2-=0.109 llama-3.=0.127 llama-3.=0.137 ministra=0.126 mistral-=0.123 mixtral-=0.117 o3-mini=0.119 qwen1.5-=0.113 text-bis=0.125
2026-04-13 12:55:32,833 INFO [Step 134/200] det=skip para=0.0608 raw_rwd=0.1325Β±0.0215 rwd=0.1325
2026-04-13 12:55:32,834 INFO per-gen rewards: deepseek=0.132 falcon3-=0.132 gemini-1=0.126 gemini-2=0.132 gemini-p=0.135 gemini-p=0.122 gpt-3.5-=0.128 gpt-4-tu=0.117 gpt-4-tu=0.124 gpt-4.5-=0.132 gpt-4o=0.138 gpt-4o-m=0.125 llama-2-=0.128 llama-2-=0.130 llama-3.=0.126 llama-3.=0.135 ministra=0.129 mistral-=0.157 mixtral-=0.135 o3-mini=0.159 qwen1.5-=0.147 text-bis=0.121
2026-04-13 12:55:47,154 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 12:55:47,154 INFO [Step 135/200] det=skip para=0.0000 raw_rwd=0.1254Β±0.0108 rwd=0.1254
2026-04-13 12:55:47,154 INFO per-gen rewards: deepseek=0.130 falcon3-=0.127 gemini-1=0.123 gemini-2=0.120 gemini-p=0.119 gemini-p=0.121 gpt-3.5-=0.123 gpt-4-tu=0.123 gpt-4-tu=0.138 gpt-4.5-=0.127 gpt-4o=0.126 gpt-4o-m=0.131 llama-2-=0.123 llama-2-=0.143 llama-3.=0.120 llama-3.=0.127 ministra=0.124 mistral-=0.128 mixtral-=0.120 o3-mini=0.124 qwen1.5-=0.131 text-bis=0.129
2026-04-13 13:00:32,836 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 13:00:32,836 INFO β MACRO_AVG 0.9960 β
2026-04-13 13:00:32,836 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 13:00:32,836 INFO β falcon3-10b-instruct 0.9992
2026-04-13 13:00:32,836 INFO β gemini-1.5-pro 0.9689
2026-04-13 13:00:32,836 INFO β gemini-2.0-flash 0.9998
2026-04-13 13:00:32,836 INFO β gemini-pro 0.9851
2026-04-13 13:00:32,837 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 13:00:32,837 INFO β gpt-3.5-turbo 0.9999
2026-04-13 13:00:32,837 INFO β gpt-4-turbo 1.0000
2026-04-13 13:00:32,837 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 13:00:32,837 INFO β gpt-4.5-preview 0.9980
2026-04-13 13:00:32,837 INFO β gpt-4o 0.9999
2026-04-13 13:00:32,837 INFO β gpt-4o-mini 0.9999
2026-04-13 13:00:32,837 INFO β llama-2-70b-chat 0.9974
2026-04-13 13:00:32,837 INFO β llama-2-7b-chat 0.9967
2026-04-13 13:00:32,837 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 13:00:32,837 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 13:00:32,837 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 13:00:32,837 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 13:00:32,837 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 13:00:32,837 INFO β o3-mini 0.9999
2026-04-13 13:00:32,837 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 13:00:32,837 INFO β text-bison-002 0.9992
2026-04-13 13:00:32,837 INFO β (prev best) 0.9960
2026-04-13 13:00:32,837 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 13:00:32,837 INFO β article_deletion 0.9982 ~
2026-04-13 13:00:32,837 INFO β homoglyphs 1.0000 ~
2026-04-13 13:00:32,837 INFO β misspelling 0.9998 ~
2026-04-13 13:00:32,837 INFO β no_attack 0.9966 ~
2026-04-13 13:00:32,837 INFO β synonym_replacement 0.9998 ~
2026-04-13 13:00:32,837 INFO β t5_paraphrase 1.0000 ~
2026-04-13 13:00:32,837 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:00:32,837 INFO No improvement (20/25) best=0.9960
2026-04-13 13:00:47,840 INFO [Step 136/200] det=skip para=0.0000 raw_rwd=0.1250Β±0.0110 rwd=0.1250
2026-04-13 13:00:47,840 INFO per-gen rewards: deepseek=0.127 falcon3-=0.128 gemini-1=0.125 gemini-2=0.126 gemini-p=0.120 gemini-p=0.140 gpt-3.5-=0.127 gpt-4-tu=0.125 gpt-4-tu=0.110 gpt-4.5-=0.129 gpt-4o=0.123 gpt-4o-m=0.124 llama-2-=0.125 llama-2-=0.127 llama-3.=0.124 llama-3.=0.135 ministra=0.126 mistral-=0.134 mixtral-=0.124 o3-mini=0.119 qwen1.5-=0.119 text-bis=0.112
2026-04-13 13:01:02,767 INFO [Step 137/200] det=skip para=0.0000 raw_rwd=0.1265Β±0.0102 rwd=0.1265
2026-04-13 13:01:02,767 INFO per-gen rewards: deepseek=0.122 falcon3-=0.127 gemini-1=0.126 gemini-2=0.127 gemini-p=0.126 gemini-p=0.117 gpt-3.5-=0.123 gpt-4-tu=0.126 gpt-4-tu=0.130 gpt-4.5-=0.141 gpt-4o=0.128 gpt-4o-m=0.129 llama-2-=0.113 llama-2-=0.128 llama-3.=0.121 llama-3.=0.124 ministra=0.132 mistral-=0.132 mixtral-=0.123 o3-mini=0.129 qwen1.5-=0.124 text-bis=0.137
2026-04-13 13:01:17,771 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:01:17,771 INFO [Step 138/200] det=skip para=0.0033 raw_rwd=0.1257Β±0.0128 rwd=0.1257
2026-04-13 13:01:17,771 INFO per-gen rewards: deepseek=0.122 falcon3-=0.124 gemini-1=0.133 gemini-2=0.120 gemini-p=0.125 gemini-p=0.112 gpt-3.5-=0.132 gpt-4-tu=0.140 gpt-4-tu=0.128 gpt-4.5-=0.117 gpt-4o=0.119 gpt-4o-m=0.137 llama-2-=0.122 llama-2-=0.116 llama-3.=0.127 llama-3.=0.123 ministra=0.122 mistral-=0.129 mixtral-=0.134 o3-mini=0.120 qwen1.5-=0.117 text-bis=0.137
2026-04-13 13:01:32,507 INFO [Step 139/200] det=skip para=-0.0000 raw_rwd=0.1250Β±0.0122 rwd=0.1250
2026-04-13 13:01:32,507 INFO per-gen rewards: deepseek=0.130 falcon3-=0.122 gemini-1=0.131 gemini-2=0.123 gemini-p=0.111 gemini-p=0.139 gpt-3.5-=0.122 gpt-4-tu=0.118 gpt-4-tu=0.131 gpt-4.5-=0.115 gpt-4o=0.126 gpt-4o-m=0.115 llama-2-=0.153 llama-2-=0.158 llama-3.=0.123 llama-3.=0.113 ministra=0.123 mistral-=0.137 mixtral-=0.124 o3-mini=0.132 qwen1.5-=0.127 text-bis=0.115
2026-04-13 13:01:47,114 INFO [Step 140/200] det=skip para=-0.0000 raw_rwd=0.1250Β±0.0110 rwd=0.1250
2026-04-13 13:01:47,115 INFO per-gen rewards: deepseek=0.119 falcon3-=0.125 gemini-1=0.117 gemini-2=0.131 gemini-p=0.116 gemini-p=0.132 gpt-3.5-=0.123 gpt-4-tu=0.127 gpt-4-tu=0.118 gpt-4.5-=0.109 gpt-4o=0.123 gpt-4o-m=0.126 llama-2-=0.125 llama-2-=0.105 llama-3.=0.130 llama-3.=0.137 ministra=0.132 mistral-=0.116 mixtral-=0.123 o3-mini=0.131 qwen1.5-=0.135 text-bis=0.101
2026-04-13 13:06:31,169 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 13:06:31,170 INFO β MACRO_AVG 0.9960 β
2026-04-13 13:06:31,170 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 13:06:31,170 INFO β falcon3-10b-instruct 0.9992
2026-04-13 13:06:31,170 INFO β gemini-1.5-pro 0.9689
2026-04-13 13:06:31,170 INFO β gemini-2.0-flash 0.9998
2026-04-13 13:06:31,170 INFO β gemini-pro 0.9851
2026-04-13 13:06:31,170 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 13:06:31,170 INFO β gpt-3.5-turbo 0.9999
2026-04-13 13:06:31,170 INFO β gpt-4-turbo 1.0000
2026-04-13 13:06:31,170 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 13:06:31,170 INFO β gpt-4.5-preview 0.9980
2026-04-13 13:06:31,170 INFO β gpt-4o 0.9999
2026-04-13 13:06:31,170 INFO β gpt-4o-mini 0.9999
2026-04-13 13:06:31,170 INFO β llama-2-70b-chat 0.9974
2026-04-13 13:06:31,170 INFO β llama-2-7b-chat 0.9967
2026-04-13 13:06:31,170 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 13:06:31,170 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 13:06:31,170 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 13:06:31,170 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 13:06:31,170 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 13:06:31,170 INFO β o3-mini 0.9999
2026-04-13 13:06:31,170 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 13:06:31,170 INFO β text-bison-002 0.9992
2026-04-13 13:06:31,170 INFO β (prev best) 0.9960
2026-04-13 13:06:31,170 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 13:06:31,170 INFO β article_deletion 0.9981 ~
2026-04-13 13:06:31,170 INFO β homoglyphs 1.0000 ~
2026-04-13 13:06:31,170 INFO β misspelling 0.9995 ~
2026-04-13 13:06:31,170 INFO β no_attack 0.9966 ~
2026-04-13 13:06:31,170 INFO β synonym_replacement 0.9998 ~
2026-04-13 13:06:31,170 INFO β t5_paraphrase 1.0000 ~
2026-04-13 13:06:31,170 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:06:31,170 INFO No improvement (21/25) best=0.9960
2026-04-13 13:06:45,934 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:06:45,934 INFO [Step 141/200] det=skip para=0.0233 raw_rwd=0.1221Β±0.0108 rwd=0.1221
2026-04-13 13:06:45,934 INFO per-gen rewards: deepseek=0.118 falcon3-=0.117 gemini-1=0.126 gemini-2=0.129 gemini-p=0.123 gemini-p=0.124 gpt-3.5-=0.119 gpt-4-tu=0.117 gpt-4-tu=0.116 gpt-4.5-=0.116 gpt-4o=0.122 gpt-4o-m=0.119 llama-2-=0.124 llama-2-=0.116 llama-3.=0.126 llama-3.=0.116 ministra=0.127 mistral-=0.106 mixtral-=0.114 o3-mini=0.128 qwen1.5-=0.125 text-bis=0.121
2026-04-13 13:07:00,458 INFO [Step 142/200] det=skip para=-0.0000 raw_rwd=0.1269Β±0.0105 rwd=0.1269
2026-04-13 13:07:00,458 INFO per-gen rewards: deepseek=0.133 falcon3-=0.121 gemini-1=0.127 gemini-2=0.129 gemini-p=0.132 gemini-p=0.135 gpt-3.5-=0.127 gpt-4-tu=0.126 gpt-4-tu=0.123 gpt-4.5-=0.114 gpt-4o=0.123 gpt-4o-m=0.127 llama-2-=0.137 llama-2-=0.124 llama-3.=0.129 llama-3.=0.131 ministra=0.136 mistral-=0.115 mixtral-=0.138 o3-mini=0.120 qwen1.5-=0.113 text-bis=0.131
2026-04-13 13:07:15,134 INFO [Step 143/200] det=skip para=-0.0000 raw_rwd=0.1240Β±0.0104 rwd=0.1240
2026-04-13 13:07:15,134 INFO per-gen rewards: deepseek=0.116 falcon3-=0.127 gemini-1=0.121 gemini-2=0.122 gemini-p=0.119 gemini-p=0.120 gpt-3.5-=0.119 gpt-4-tu=0.125 gpt-4-tu=0.108 gpt-4.5-=0.127 gpt-4o=0.128 gpt-4o-m=0.127 llama-2-=0.124 llama-2-=0.122 llama-3.=0.133 llama-3.=0.109 ministra=0.122 mistral-=0.133 mixtral-=0.122 o3-mini=0.135 qwen1.5-=0.129 text-bis=0.116
2026-04-13 13:07:29,477 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:07:29,477 INFO [Step 144/200] det=skip para=0.0183 raw_rwd=0.1258Β±0.0132 rwd=0.1258
2026-04-13 13:07:29,477 INFO per-gen rewards: deepseek=0.115 falcon3-=0.125 gemini-1=0.130 gemini-2=0.137 gemini-p=0.153 gemini-p=0.143 gpt-3.5-=0.125 gpt-4-tu=0.124 gpt-4-tu=0.131 gpt-4.5-=0.113 gpt-4o=0.125 gpt-4o-m=0.127 llama-2-=0.114 llama-2-=0.131 llama-3.=0.122 llama-3.=0.121 ministra=0.123 mistral-=0.113 mixtral-=0.121 o3-mini=0.123 qwen1.5-=0.126 text-bis=0.136
2026-04-13 13:07:44,036 INFO [Step 145/200] det=skip para=0.0000 raw_rwd=0.1230Β±0.0090 rwd=0.1230
2026-04-13 13:07:44,036 INFO per-gen rewards: deepseek=0.126 falcon3-=0.115 gemini-1=0.123 gemini-2=0.125 gemini-p=0.116 gemini-p=0.134 gpt-3.5-=0.125 gpt-4-tu=0.123 gpt-4-tu=0.119 gpt-4.5-=0.111 gpt-4o=0.126 gpt-4o-m=0.121 llama-2-=0.116 llama-2-=0.126 llama-3.=0.124 llama-3.=0.125 ministra=0.123 mistral-=0.134 mixtral-=0.135 o3-mini=0.119 qwen1.5-=0.107 text-bis=0.143
2026-04-13 13:12:27,847 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 13:12:27,847 INFO β MACRO_AVG 0.9960 β
2026-04-13 13:12:27,847 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 13:12:27,847 INFO β falcon3-10b-instruct 0.9992
2026-04-13 13:12:27,847 INFO β gemini-1.5-pro 0.9689
2026-04-13 13:12:27,847 INFO β gemini-2.0-flash 0.9998
2026-04-13 13:12:27,847 INFO β gemini-pro 0.9851
2026-04-13 13:12:27,847 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 13:12:27,847 INFO β gpt-3.5-turbo 0.9999
2026-04-13 13:12:27,847 INFO β gpt-4-turbo 1.0000
2026-04-13 13:12:27,847 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 13:12:27,847 INFO β gpt-4.5-preview 0.9980
2026-04-13 13:12:27,847 INFO β gpt-4o 0.9999
2026-04-13 13:12:27,847 INFO β gpt-4o-mini 0.9999
2026-04-13 13:12:27,848 INFO β llama-2-70b-chat 0.9974
2026-04-13 13:12:27,848 INFO β llama-2-7b-chat 0.9967
2026-04-13 13:12:27,848 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 13:12:27,848 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 13:12:27,848 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 13:12:27,848 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 13:12:27,848 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 13:12:27,848 INFO β o3-mini 0.9999
2026-04-13 13:12:27,848 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 13:12:27,848 INFO β text-bison-002 0.9992
2026-04-13 13:12:27,848 INFO β (prev best) 0.9960
2026-04-13 13:12:27,848 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 13:12:27,848 INFO β article_deletion 0.9980 ~
2026-04-13 13:12:27,848 INFO β homoglyphs 1.0000 ~
2026-04-13 13:12:27,848 INFO β misspelling 0.9998 ~
2026-04-13 13:12:27,848 INFO β no_attack 0.9966 ~
2026-04-13 13:12:27,848 INFO β synonym_replacement 0.9998 ~
2026-04-13 13:12:27,848 INFO β t5_paraphrase 1.0000 ~
2026-04-13 13:12:27,848 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:12:27,848 INFO No improvement (22/25) best=0.9960
2026-04-13 13:12:43,002 INFO [Step 146/200] det=skip para=-0.0000 raw_rwd=0.1263Β±0.0096 rwd=0.1263
2026-04-13 13:12:43,002 INFO per-gen rewards: deepseek=0.125 falcon3-=0.130 gemini-1=0.129 gemini-2=0.125 gemini-p=0.132 gemini-p=0.137 gpt-3.5-=0.124 gpt-4-tu=0.110 gpt-4-tu=0.123 gpt-4.5-=0.145 gpt-4o=0.124 gpt-4o-m=0.122 llama-2-=0.127 llama-2-=0.130 llama-3.=0.131 llama-3.=0.125 ministra=0.120 mistral-=0.135 mixtral-=0.116 o3-mini=0.127 qwen1.5-=0.127 text-bis=0.143
2026-04-13 13:12:57,724 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:12:57,725 INFO [Step 147/200] det=skip para=0.0011 raw_rwd=0.1238Β±0.0099 rwd=0.1238
2026-04-13 13:12:57,725 INFO per-gen rewards: deepseek=0.118 falcon3-=0.129 gemini-1=0.123 gemini-2=0.127 gemini-p=0.117 gemini-p=0.123 gpt-3.5-=0.123 gpt-4-tu=0.112 gpt-4-tu=0.114 gpt-4.5-=0.123 gpt-4o=0.121 gpt-4o-m=0.121 llama-2-=0.135 llama-2-=0.131 llama-3.=0.138 llama-3.=0.124 ministra=0.123 mistral-=0.132 mixtral-=0.127 o3-mini=0.114 qwen1.5-=0.144 text-bis=0.117
2026-04-13 13:13:12,265 INFO [Step 148/200] det=skip para=0.0022 raw_rwd=0.1247Β±0.0118 rwd=0.1247
2026-04-13 13:13:12,265 INFO per-gen rewards: deepseek=0.121 falcon3-=0.125 gemini-1=0.120 gemini-2=0.129 gemini-p=0.130 gemini-p=0.119 gpt-3.5-=0.127 gpt-4-tu=0.162 gpt-4-tu=0.128 gpt-4.5-=0.123 gpt-4o=0.121 gpt-4o-m=0.125 llama-2-=0.152 llama-2-=0.120 llama-3.=0.127 llama-3.=0.122 ministra=0.120 mistral-=0.110 mixtral-=0.119 o3-mini=0.128 qwen1.5-=0.121 text-bis=0.110
2026-04-13 13:13:26,646 INFO [Step 149/200] det=skip para=0.0071 raw_rwd=0.1245Β±0.0115 rwd=0.1245
2026-04-13 13:13:26,646 INFO per-gen rewards: deepseek=0.130 falcon3-=0.121 gemini-1=0.125 gemini-2=0.112 gemini-p=0.118 gemini-p=0.124 gpt-3.5-=0.123 gpt-4-tu=0.131 gpt-4-tu=0.129 gpt-4.5-=0.137 gpt-4o=0.125 gpt-4o-m=0.126 llama-2-=0.120 llama-2-=0.132 llama-3.=0.127 llama-3.=0.141 ministra=0.122 mistral-=0.130 mixtral-=0.116 o3-mini=0.119 qwen1.5-=0.113 text-bis=0.164
2026-04-13 13:13:41,501 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:13:41,502 INFO [Step 150/200] det=skip para=-0.0000 raw_rwd=0.1250Β±0.0130 rwd=0.1250
2026-04-13 13:13:41,502 INFO per-gen rewards: deepseek=0.122 falcon3-=0.132 gemini-1=0.132 gemini-2=0.132 gemini-p=0.126 gemini-p=0.127 gpt-3.5-=0.125 gpt-4-tu=0.111 gpt-4-tu=0.113 gpt-4.5-=0.123 gpt-4o=0.113 gpt-4o-m=0.127 llama-2-=0.123 llama-2-=0.123 llama-3.=0.123 llama-3.=0.125 ministra=0.123 mistral-=0.120 mixtral-=0.142 o3-mini=0.130 qwen1.5-=0.105 text-bis=0.125
2026-04-13 13:18:25,077 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 13:18:25,077 INFO β MACRO_AVG 0.9960 β
2026-04-13 13:18:25,077 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 13:18:25,077 INFO β falcon3-10b-instruct 0.9992
2026-04-13 13:18:25,077 INFO β gemini-1.5-pro 0.9689
2026-04-13 13:18:25,077 INFO β gemini-2.0-flash 0.9998
2026-04-13 13:18:25,077 INFO β gemini-pro 0.9851
2026-04-13 13:18:25,077 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 13:18:25,077 INFO β gpt-3.5-turbo 0.9999
2026-04-13 13:18:25,077 INFO β gpt-4-turbo 1.0000
2026-04-13 13:18:25,078 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 13:18:25,078 INFO β gpt-4.5-preview 0.9980
2026-04-13 13:18:25,078 INFO β gpt-4o 0.9999
2026-04-13 13:18:25,078 INFO β gpt-4o-mini 0.9999
2026-04-13 13:18:25,078 INFO β llama-2-70b-chat 0.9974
2026-04-13 13:18:25,078 INFO β llama-2-7b-chat 0.9967
2026-04-13 13:18:25,078 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 13:18:25,078 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 13:18:25,078 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 13:18:25,078 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 13:18:25,078 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 13:18:25,078 INFO β o3-mini 0.9999
2026-04-13 13:18:25,078 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 13:18:25,078 INFO β text-bison-002 0.9992
2026-04-13 13:18:25,078 INFO β (prev best) 0.9960
2026-04-13 13:18:25,078 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 13:18:25,078 INFO β article_deletion 0.9980 ~
2026-04-13 13:18:25,078 INFO β homoglyphs 1.0000 ~
2026-04-13 13:18:25,078 INFO β misspelling 0.9995 ~
2026-04-13 13:18:25,078 INFO β no_attack 0.9966 ~
2026-04-13 13:18:25,078 INFO β synonym_replacement 0.9997 ~
2026-04-13 13:18:25,078 INFO β t5_paraphrase 1.0000 ~
2026-04-13 13:18:25,078 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:18:25,078 INFO No improvement (23/25) best=0.9960
2026-04-13 13:18:39,971 INFO [Step 151/200] det=skip para=0.0000 raw_rwd=0.1269Β±0.0113 rwd=0.1269
2026-04-13 13:18:39,971 INFO per-gen rewards: deepseek=0.128 falcon3-=0.122 gemini-1=0.122 gemini-2=0.124 gemini-p=0.133 gemini-p=0.152 gpt-3.5-=0.129 gpt-4-tu=0.115 gpt-4-tu=0.130 gpt-4.5-=0.123 gpt-4o=0.128 gpt-4o-m=0.128 llama-2-=0.113 llama-2-=0.139 llama-3.=0.121 llama-3.=0.134 ministra=0.128 mistral-=0.115 mixtral-=0.129 o3-mini=0.133 qwen1.5-=0.132 text-bis=0.124
2026-04-13 13:18:54,734 INFO [Step 152/200] det=skip para=0.0000 raw_rwd=0.1245Β±0.0099 rwd=0.1245
2026-04-13 13:18:54,734 INFO per-gen rewards: deepseek=0.127 falcon3-=0.127 gemini-1=0.124 gemini-2=0.132 gemini-p=0.122 gemini-p=0.116 gpt-3.5-=0.127 gpt-4-tu=0.103 gpt-4-tu=0.129 gpt-4.5-=0.120 gpt-4o=0.125 gpt-4o-m=0.121 llama-2-=0.108 llama-2-=0.126 llama-3.=0.119 llama-3.=0.117 ministra=0.125 mistral-=0.132 mixtral-=0.120 o3-mini=0.124 qwen1.5-=0.139 text-bis=0.147
2026-04-13 13:19:09,390 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:19:09,390 INFO [Step 153/200] det=skip para=0.0661 raw_rwd=0.1291Β±0.0295 rwd=0.1291
2026-04-13 13:19:09,391 INFO per-gen rewards: deepseek=0.124 falcon3-=0.120 gemini-1=0.121 gemini-2=0.120 gemini-p=0.131 gemini-p=0.124 gpt-3.5-=0.131 gpt-4-tu=0.344 gpt-4-tu=0.122 gpt-4.5-=0.117 gpt-4o=0.130 gpt-4o-m=0.136 llama-2-=0.122 llama-2-=0.116 llama-3.=0.117 llama-3.=0.143 ministra=0.124 mistral-=0.107 mixtral-=0.136 o3-mini=0.132 qwen1.5-=0.123 text-bis=0.112
2026-04-13 13:19:23,926 INFO [Step 154/200] det=skip para=0.0000 raw_rwd=0.1256Β±0.0112 rwd=0.1256
2026-04-13 13:19:23,926 INFO per-gen rewards: deepseek=0.119 falcon3-=0.125 gemini-1=0.120 gemini-2=0.125 gemini-p=0.136 gemini-p=0.112 gpt-3.5-=0.132 gpt-4-tu=0.135 gpt-4-tu=0.153 gpt-4.5-=0.134 gpt-4o=0.125 gpt-4o-m=0.124 llama-2-=0.110 llama-2-=0.133 llama-3.=0.116 llama-3.=0.117 ministra=0.130 mistral-=0.127 mixtral-=0.120 o3-mini=0.132 qwen1.5-=0.128 text-bis=0.136
2026-04-13 13:19:38,460 INFO [Step 155/200] det=skip para=0.0000 raw_rwd=0.1246Β±0.0099 rwd=0.1246
2026-04-13 13:19:38,460 INFO per-gen rewards: deepseek=0.131 falcon3-=0.124 gemini-1=0.127 gemini-2=0.127 gemini-p=0.123 gemini-p=0.113 gpt-3.5-=0.121 gpt-4-tu=0.127 gpt-4-tu=0.137 gpt-4.5-=0.119 gpt-4o=0.119 gpt-4o-m=0.120 llama-2-=0.113 llama-2-=0.143 llama-3.=0.132 llama-3.=0.122 ministra=0.121 mistral-=0.133 mixtral-=0.120 o3-mini=0.129 qwen1.5-=0.124 text-bis=0.121
2026-04-13 13:24:21,864 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 13:24:21,864 INFO β MACRO_AVG 0.9960 β
2026-04-13 13:24:21,864 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 13:24:21,864 INFO β falcon3-10b-instruct 0.9992
2026-04-13 13:24:21,864 INFO β gemini-1.5-pro 0.9689
2026-04-13 13:24:21,864 INFO β gemini-2.0-flash 0.9998
2026-04-13 13:24:21,864 INFO β gemini-pro 0.9851
2026-04-13 13:24:21,864 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 13:24:21,864 INFO β gpt-3.5-turbo 0.9999
2026-04-13 13:24:21,864 INFO β gpt-4-turbo 1.0000
2026-04-13 13:24:21,864 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 13:24:21,864 INFO β gpt-4.5-preview 0.9980
2026-04-13 13:24:21,864 INFO β gpt-4o 0.9999
2026-04-13 13:24:21,864 INFO β gpt-4o-mini 0.9999
2026-04-13 13:24:21,864 INFO β llama-2-70b-chat 0.9974
2026-04-13 13:24:21,864 INFO β llama-2-7b-chat 0.9967
2026-04-13 13:24:21,864 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 13:24:21,865 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 13:24:21,865 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 13:24:21,865 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 13:24:21,865 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 13:24:21,865 INFO β o3-mini 0.9999
2026-04-13 13:24:21,865 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 13:24:21,865 INFO β text-bison-002 0.9992
2026-04-13 13:24:21,865 INFO β (prev best) 0.9960
2026-04-13 13:24:21,865 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 13:24:21,865 INFO β article_deletion 0.9980 ~
2026-04-13 13:24:21,865 INFO β homoglyphs 1.0000 ~
2026-04-13 13:24:21,865 INFO β misspelling 0.9994 ~
2026-04-13 13:24:21,865 INFO β no_attack 0.9966 ~
2026-04-13 13:24:21,865 INFO β synonym_replacement 0.9997 ~
2026-04-13 13:24:21,865 INFO β t5_paraphrase 1.0000 ~
2026-04-13 13:24:21,865 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:24:21,865 INFO No improvement (24/25) best=0.9960
2026-04-13 13:24:36,985 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:24:36,985 INFO [Step 156/200] det=skip para=0.0000 raw_rwd=0.1277Β±0.0131 rwd=0.1277
2026-04-13 13:24:36,985 INFO per-gen rewards: deepseek=0.117 falcon3-=0.123 gemini-1=0.127 gemini-2=0.121 gemini-p=0.131 gemini-p=0.140 gpt-3.5-=0.128 gpt-4-tu=0.112 gpt-4-tu=0.120 gpt-4.5-=0.152 gpt-4o=0.125 gpt-4o-m=0.135 llama-2-=0.127 llama-2-=0.113 llama-3.=0.126 llama-3.=0.131 ministra=0.140 mistral-=0.134 mixtral-=0.127 o3-mini=0.128 qwen1.5-=0.133 text-bis=0.122
2026-04-13 13:24:51,708 INFO [Step 157/200] det=skip para=0.0000 raw_rwd=0.1241Β±0.0104 rwd=0.1241
2026-04-13 13:24:51,708 INFO per-gen rewards: deepseek=0.126 falcon3-=0.126 gemini-1=0.125 gemini-2=0.123 gemini-p=0.118 gemini-p=0.117 gpt-3.5-=0.122 gpt-4-tu=0.118 gpt-4-tu=0.124 gpt-4.5-=0.118 gpt-4o=0.124 gpt-4o-m=0.125 llama-2-=0.113 llama-2-=0.114 llama-3.=0.125 llama-3.=0.139 ministra=0.121 mistral-=0.113 mixtral-=0.124 o3-mini=0.129 qwen1.5-=0.108 text-bis=0.151
2026-04-13 13:25:06,408 INFO [Step 158/200] det=skip para=0.0164 raw_rwd=0.1241Β±0.0099 rwd=0.1241
2026-04-13 13:25:06,409 INFO per-gen rewards: deepseek=0.125 falcon3-=0.126 gemini-1=0.118 gemini-2=0.125 gemini-p=0.131 gemini-p=0.119 gpt-3.5-=0.121 gpt-4-tu=0.130 gpt-4-tu=0.132 gpt-4.5-=0.120 gpt-4o=0.125 gpt-4o-m=0.132 llama-2-=0.115 llama-2-=0.128 llama-3.=0.124 llama-3.=0.123 ministra=0.118 mistral-=0.131 mixtral-=0.118 o3-mini=0.123 qwen1.5-=0.128 text-bis=0.131
2026-04-13 13:25:21,056 INFO β AUROC=0.9960 > threshold=0.995 β freezing detector for 3 steps
2026-04-13 13:25:21,056 INFO [Step 159/200] det=skip para=-0.0000 raw_rwd=0.1241Β±0.0109 rwd=0.1241
2026-04-13 13:25:21,056 INFO per-gen rewards: deepseek=0.121 falcon3-=0.117 gemini-1=0.117 gemini-2=0.137 gemini-p=0.122 gemini-p=0.121 gpt-3.5-=0.122 gpt-4-tu=0.113 gpt-4-tu=0.137 gpt-4.5-=0.125 gpt-4o=0.126 gpt-4o-m=0.129 llama-2-=0.123 llama-2-=0.109 llama-3.=0.125 llama-3.=0.122 ministra=0.121 mistral-=0.137 mixtral-=0.121 o3-mini=0.121 qwen1.5-=0.135 text-bis=0.137
2026-04-13 13:25:35,780 INFO [Step 160/200] det=skip para=0.0632 raw_rwd=0.1274Β±0.0221 rwd=0.1274
2026-04-13 13:25:35,780 INFO per-gen rewards: deepseek=0.138 falcon3-=0.118 gemini-1=0.122 gemini-2=0.125 gemini-p=0.129 gemini-p=0.130 gpt-3.5-=0.155 gpt-4-tu=0.139 gpt-4-tu=0.137 gpt-4.5-=0.125 gpt-4o=0.122 gpt-4o-m=0.124 llama-2-=0.129 llama-2-=0.108 llama-3.=0.119 llama-3.=0.112 ministra=0.127 mistral-=0.139 mixtral-=0.142 o3-mini=0.122 qwen1.5-=0.118 text-bis=0.129
2026-04-13 13:30:19,706 INFO ββ Generator AUROC βββββββββββββββββββββββββββββ
2026-04-13 13:30:19,706 INFO β MACRO_AVG 0.9960 β
2026-04-13 13:30:19,706 INFO β deepseek-r1-distill-qwen-32b 0.9998
2026-04-13 13:30:19,706 INFO β falcon3-10b-instruct 0.9992
2026-04-13 13:30:19,706 INFO β gemini-1.5-pro 0.9689
2026-04-13 13:30:19,706 INFO β gemini-2.0-flash 0.9998
2026-04-13 13:30:19,706 INFO β gemini-pro 0.9851
2026-04-13 13:30:19,706 INFO β gemini-pro-paraphrase 0.9884
2026-04-13 13:30:19,706 INFO β gpt-3.5-turbo 0.9999
2026-04-13 13:30:19,706 INFO β gpt-4-turbo 1.0000
2026-04-13 13:30:19,707 INFO β gpt-4-turbo-paraphrase 0.9963
2026-04-13 13:30:19,707 INFO β gpt-4.5-preview 0.9980
2026-04-13 13:30:19,707 INFO β gpt-4o 0.9999
2026-04-13 13:30:19,707 INFO β gpt-4o-mini 0.9999
2026-04-13 13:30:19,707 INFO β llama-2-70b-chat 0.9974
2026-04-13 13:30:19,707 INFO β llama-2-7b-chat 0.9967
2026-04-13 13:30:19,707 INFO β llama-3.1-8b-instruct 0.9929
2026-04-13 13:30:19,707 INFO β llama-3.3-70b-instruct 0.9993
2026-04-13 13:30:19,707 INFO β ministral-8b-instruct-2410 0.9997
2026-04-13 13:30:19,707 INFO β mistral-7b-instruct-v0.2 0.9965
2026-04-13 13:30:19,707 INFO β mixtral-8x7b-instruct-v0.1 0.9947
2026-04-13 13:30:19,707 INFO β o3-mini 0.9999
2026-04-13 13:30:19,707 INFO β qwen1.5-72b-chat-8bit 0.9995
2026-04-13 13:30:19,707 INFO β text-bison-002 0.9992
2026-04-13 13:30:19,707 INFO β (prev best) 0.9960
2026-04-13 13:30:19,707 INFO ββ Attack AUROC (robustness) ββββββββββββββββββ€
2026-04-13 13:30:19,707 INFO β article_deletion 0.9980 ~
2026-04-13 13:30:19,707 INFO β homoglyphs 1.0000 ~
2026-04-13 13:30:19,707 INFO β misspelling 0.9995 ~
2026-04-13 13:30:19,707 INFO β no_attack 0.9966 ~
2026-04-13 13:30:19,707 INFO β synonym_replacement 0.9997 ~
2026-04-13 13:30:19,707 INFO β t5_paraphrase 1.0000 ~
2026-04-13 13:30:19,707 INFO βββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:30:19,707 INFO No improvement (25/25) best=0.9960
2026-04-13 13:30:19,707 INFO Early stopping triggered.
2026-04-13 13:30:19,707 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:30:19,707 INFO Done. Best macro AUROC = 0.9960
2026-04-13 13:30:19,707 INFO Detector β ./adal_panclef/best_detector
2026-04-13 13:30:19,707 INFO Paraphraser β ./adal_panclef/best_paraphraser
2026-04-13 13:30:19,707 INFO Gen AUROC β ./adal_panclef/per_generator_auroc.tsv
2026-04-13 13:30:19,707 INFO Atk AUROC β ./adal_panclef/per_attack_auroc.tsv
2026-04-13 13:30:19,707 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:30:19,707 INFO
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:30:19,707 INFO FINAL EVALUATION ON VALIDATION SET (best checkpoint)
2026-04-13 13:30:19,707 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:30:19,707 INFO Loading detector 'roberta-large' β¦
2026-04-13 13:30:19,912 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/tokenizer_config.json "HTTP/1.1 200 OK"
2026-04-13 13:30:20,031 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 307 Temporary Redirect"
2026-04-13 13:30:20,147 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
2026-04-13 13:30:20,261 INFO HTTP Request: GET https://huggingface.co/api/models/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 307 Temporary Redirect"
2026-04-13 13:30:20,379 INFO HTTP Request: GET https://huggingface.co/api/models/FacebookAI/roberta-large/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
2026-04-13 13:30:20,684 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/config.json "HTTP/1.1 200 OK"
2026-04-13 13:30:20,823 INFO HTTP Request: HEAD https://huggingface.co/roberta-large/resolve/main/model.safetensors "HTTP/1.1 302 Found"
2026-04-13 13:30:21,809 INFO Running full validation evaluation ...
2026-04-13 13:31:51,489 INFO
ββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:31:51,489 INFO β FULL VALIDATION METRICS (threshold=0.50) β
2026-04-13 13:31:51,489 INFO β βββββββββββββββββββββββββββββββββββββββββββββββββββββ£
2026-04-13 13:31:51,489 INFO β Total human : 1,277 Total AI : 2,312 β
2026-04-13 13:31:51,489 INFO β TP=2,227 TN=1,270 FP= 7 FN= 85 β
2026-04-13 13:31:51,489 INFO β βββββββββββββββββββββββββββββββββββββββββββββββββββββ£
2026-04-13 13:31:51,489 INFO β Precision : 0.9969 β
2026-04-13 13:31:51,489 INFO β Recall : 0.9632 β
2026-04-13 13:31:51,489 INFO β F1-score : 0.9798 β
2026-04-13 13:31:51,489 INFO β AUROC : 0.9969 β
2026-04-13 13:31:51,489 INFO β βββββββββββββββββββββββββββββββββββββββββββββββββββββ£
2026-04-13 13:31:51,490 INFO β Per-generator AUROC: β
2026-04-13 13:31:51,490 INFO β deepseek-r1-distill-qwen-32b 0.9998 β
2026-04-13 13:31:51,490 INFO β falcon3-10b-instruct 0.9992 β
2026-04-13 13:31:51,490 INFO β gemini-1.5-pro 0.9689 β
2026-04-13 13:31:51,490 INFO β gemini-2.0-flash 0.9998 β
2026-04-13 13:31:51,490 INFO β gemini-pro 0.9851 β
2026-04-13 13:31:51,490 INFO β gemini-pro-paraphrase 0.9884 β
2026-04-13 13:31:51,490 INFO β gpt-3.5-turbo 0.9999 β
2026-04-13 13:31:51,490 INFO β gpt-4-turbo 1.0000 β
2026-04-13 13:31:51,490 INFO β gpt-4-turbo-paraphrase 0.9963 β
2026-04-13 13:31:51,490 INFO β gpt-4.5-preview 0.9980 β
2026-04-13 13:31:51,490 INFO β gpt-4o 0.9999 β
2026-04-13 13:31:51,490 INFO β gpt-4o-mini 0.9999 β
2026-04-13 13:31:51,490 INFO β llama-2-70b-chat 0.9974 β
2026-04-13 13:31:51,490 INFO β llama-2-7b-chat 0.9967 β
2026-04-13 13:31:51,490 INFO β llama-3.1-8b-instruct 0.9929 β
2026-04-13 13:31:51,490 INFO β llama-3.3-70b-instruct 0.9993 β
2026-04-13 13:31:51,490 INFO β ministral-8b-instruct-2410 0.9997 β
2026-04-13 13:31:51,490 INFO β mistral-7b-instruct-v0.2 0.9965 β
2026-04-13 13:31:51,490 INFO β mixtral-8x7b-instruct-v0.1 0.9947 β
2026-04-13 13:31:51,490 INFO β o3-mini 0.9999 β
2026-04-13 13:31:51,490 INFO β qwen1.5-72b-chat-8bit 0.9995 β
2026-04-13 13:31:51,490 INFO β text-bison-002 0.9992 β
2026-04-13 13:31:51,490 INFO β Macro avg AUROC : 0.9960 β
2026-04-13 13:31:51,490 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:31:51,491 INFO Metrics saved β ./adal_panclef/validation_metrics.tsv
2026-04-13 13:31:51,491 INFO ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
2026-04-13 13:31:51,491 INFO
ββ Pushing to HuggingFace Hub (trigger=final) ββ
2026-04-13 13:31:51,694 INFO HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
2026-04-13 13:31:51,811 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF "HTTP/1.1 200 OK"
2026-04-13 13:31:51,812 INFO Repo exists: Shushant/ADAL-Detector-PANCLEF
2026-04-13 13:31:51,951 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL_PAN-t5-paraphraser "HTTP/1.1 200 OK"
2026-04-13 13:31:51,952 INFO Repo exists: Shushant/ADAL_PAN-t5-paraphraser
2026-04-13 13:31:51,953 INFO Uploading detector β Shushant/ADAL-Detector-PANCLEF β¦
2026-04-13 13:31:52,067 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 13:31:53,175 INFO HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
2026-04-13 13:31:53,326 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 13:31:53,459 INFO HTTP Request: POST https://huggingface.co/Shushant/ADAL-Detector-PANCLEF.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
2026-04-13 13:31:53,586 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/xet-write-token/main "HTTP/1.1 200 OK"
2026-04-13 13:31:59,200 WARNING No files have been modified since last commit. Skipping to prevent empty commit.
2026-04-13 13:31:59,524 INFO HTTP Request: GET https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/revision/main "HTTP/1.1 200 OK"
2026-04-13 13:31:59,689 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 13:32:01,144 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 13:32:01,284 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
2026-04-13 13:32:01,985 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/commit/main "HTTP/1.1 200 OK"
2026-04-13 13:32:02,113 INFO HTTP Request: POST https://huggingface.co/api/models/Shushant/ADAL-Detector-PANCLEF/preupload/main "HTTP/1.1 200 OK"
|