diff --git "a/precomputed/example_visualization.html" "b/precomputed/example_visualization.html"
--- "a/precomputed/example_visualization.html"
+++ "b/precomputed/example_visualization.html"
@@ -279,11 +279,11 @@
     <div id="tooltip"></div>
         <div class="header">
             <div class="meta">
-                <div>Model A: RWKV7-G1D-1.5B</div>
+                <div>Model A: RWKV7-G1F-1.5B</div>
                 <div>Model B: RWKV7-G1D-0.4B</div>
-                <div>RWKV7-G1D-1.5B Compression: 9.34%</div>
+                <div>RWKV7-G1F-1.5B Compression: 9.32%</div>
                 <div>RWKV7-G1D-0.4B Compression: 10.29%</div>
-                <div style="color: #64ff64">Avg Delta: -0.95%</div>
+                <div style="color: #64ff64">Avg Delta: -0.98%</div>
             </div>
             <div class="legend">
                 <div class="legend-row">
@@ -316,7 +316,7 @@
         </div>
     
     <div class="content"></div>
-    <script id="render-model" type="application/json">{"text": "The Bitter Lesson\nRich Sutton\nMarch 13, 2019\nThe biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research project, massively more computation inevitably becomes available. Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation. These two need not run counter to each other, but in practice they tend to. Time spent on one is time not spent on the other. There are psychological commitments to investment in one approach or the other. And the human-knowledge approach tends to complicate methods in ways that make them less suited to taking advantage of general methods leveraging computation.  There were many examples of AI researchers' belated learning of this bitter lesson, and it is instructive to review some of the most prominent.\n\nIn computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search. At the time, this was looked upon with dismay by the majority of computer-chess researchers who had pursued methods that leveraged human understanding of the special structure of chess. When a simpler, search-based approach with special hardware and software proved vastly more effective, these human-knowledge-based chess researchers were not good losers. They said that ``brute force\" search may have won this time, but it was not a general strategy, and anyway it was not how people played chess. These researchers wanted methods based on human input to win and were disappointed when they did not.\n\nA similar pattern of research progress was seen in computer Go, only delayed by a further 20 years. Enormous initial efforts went into avoiding search by taking advantage of human knowledge, or of the special features of the game, but all those efforts proved irrelevant, or worse, once search was applied effectively at scale. Also important was the use of learning by self play to learn a value function (as it was in many other games and even in chess, although learning did not play a big role in the 1997 program that first beat a world champion). Learning by self play, and learning in general, is like search in that it enables massive computation to be brought to bear. Search and learning are the two most important classes of techniques for utilizing massive amounts of computation in AI research. In computer Go, as in computer chess, researchers' initial effort was directed towards utilizing human understanding (so that less search was needed) and only much later was much greater success had by embracing search and learning.\n\nIn speech recognition, there was an early competition, sponsored by DARPA, in the 1970s. Entrants included a host of special methods that took advantage of human knowledge---knowledge of words, of phonemes, of the human vocal tract, etc. On the other side were newer methods that were more statistical in nature and did much more computation, based on hidden Markov models (HMMs). Again, the statistical methods won out over the human-knowledge-based methods. This led to a major change in all of natural language processing, gradually over decades, where statistics and computation came to dominate the field. The recent rise of deep learning in speech recognition is the most recent step in this consistent direction. Deep learning methods rely even less on human knowledge, and use even more computation, together with learning on huge training sets, to produce dramatically better speech recognition systems. As in the games, researchers always tried to make systems that worked the way the researchers thought their own minds worked---they tried to put that knowledge in their systems---but it proved ultimately counterproductive, and a colossal waste of researcher's time, when, through Moore's law, massive computation became available and a means was found to put it to good use.\n\nIn computer vision, there has been a similar pattern. Early methods conceived of vision as searching for edges, or generalized cylinders, or in terms of SIFT features. But today all this is discarded. Modern deep-learning neural networks use only the notions of convolution and certain kinds of invariances, and perform much better.\n\nThis is a big lesson. As a field, we still have not thoroughly learned it, as we are continuing to make the same kind of mistakes. To see this, and to effectively resist it, we have to understand the appeal of these mistakes. We have to learn the bitter lesson that building in how we think we think does not work in the long run. The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhibits further progress, and 4) breakthrough progress eventually arrives by an opposing approach based on scaling computation by search and learning. The eventual success is tinged with bitterness, and often incompletely digested, because it is success over a favored, human-centric approach.\n\nOne thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.\n\nThe second general point to be learned from the bitter lesson is that the actual contents of minds are tremendously, irredeemably complex; we should stop trying to find simple ways to think about the contents of minds, such as simple ways to think about space, objects, multiple agents, or symmetries. All these are part of the arbitrary, intrinsically-complex, outside world. They are not what should be built in, as their complexity is endless; instead we should build in only the meta-methods that can find and capture this arbitrary complexity. Essential to these methods is that they can find good approximations, but the search for them should be by our methods, not by us. We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done.\n", "tokens": [{"byte_start": 0, "byte_end": 3, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 0, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"model_a": "19.16% 19.16% 19.16%", "model_b": "20.38% 20.38% 20.38%"}, "model_tokens": {"model_a": [[6699, "The", "normal", 0.04121053218841553]], "model_b": [[6699, "The", "normal", 0.03371196612715721]]}, "loss": {"model_a": 19.160793511806542, "model_b": 20.38182447089225}, "topk": {"model_a": [6699, 1, 0.04121053218841553, [[6699, 0.041211, "The", false], [24281, 0.037395, "User", false], [36, 0.035577, "#", false], [34579, 0.031296, "https", false], [1136, 0.024314, "In", false], [82, 0.022212, "Q", false], [520, 0.020419, "**", false], [6833, 0.017958, "You", false], [640, 0.014308, "20", false], [41, 0.013511, "(", false]]], "model_b": [6699, 2, 0.03371196612715721, [[24281, 0.036707, "User", false], [6699, 0.033712, "The", false], [36, 0.032265, "#", false], [34579, 0.031346, "https", false], [520, 0.021285, "**", false], [53648, 0.018388, "Question", false], [1136, 0.014396, "In", false], [5201, 0.014314, "###", false], [23672, 0.011537, "From", false], [82, 0.011417, "Q", false]]]}, "raw_delta": -0.06770833333333326, "tuned_delta": -0.014853389435133438}, {"byte_start": 3, "byte_end": 7, "display": {"text": " Bit", "kind": "normal"}, "is_word": true, "word_id": 1, "word_key": " bit", "bytes_hex": "20 42 69 74", "compression": {"model_a": "41.42% 41.42% 41.42% 41.42%", "model_b": "42.55% 42.55% 42.55% 42.55%"}, "model_tokens": {"model_a": [[19523, " Bit", "normal", 0.00010360294254496694]], "model_b": [[19523, " Bit", "normal", 8.066837472142652e-05]]}, "loss": {"model_a": 41.42112715052297, "model_b": 42.54823265121747}, "topk": {"model_a": [19523, 1622, 0.00010360294254496694, [[52569, 0.012556, " problem", false], [32355, 0.011763, " user", false], [45242, 0.008805, " author", false], [331, 0.008116, " `", false], [45010, 0.007984, " United", false], [269, 0.006239, " \"", false], [38499, 0.006146, " first", false], [57009, 0.006012, " question", false], [31894, 0.005713, " role", false], [51272, 0.005701, " concept", false]]], "model_b": [19523, 2250, 8.066837472142652e-05, [[331, 0.010424, " `", false], [32355, 0.008742, " user", false], [38499, 0.007124, " first", false], [44419, 0.006925, " Import", false], [269, 0.006826, " \"", false], [32224, 0.006172, " text", false], [32219, 0.005894, " term", false], [59725, 0.005804, " following", false], [29689, 0.005782, " Role", false], [52569, 0.005131, " problem", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 7, "byte_end": 10, "display": {"text": "ter", "kind": "normal"}, "is_word": true, "word_id": 2, "word_key": "ter", "bytes_hex": "74 65 72", "compression": {"model_a": "7.47% 7.47% 7.47%", "model_b": "8.78% 8.78% 8.78%"}, "model_tokens": {"model_a": [[8795, "ter", "normal", 0.28614088892936707]], "model_b": [[8795, "ter", "normal", 0.2319023162126541]]}, "loss": {"model_a": 7.467073942101079, "model_b": 8.782030359578}, "topk": {"model_a": [8795, 1, 0.28614088892936707, [[8795, 0.286141, "ter", false], [102, 0.159099, "e", false], [27135, 0.042617, "ters", false], [27133, 0.027938, "tern", false], [48761, 0.025752, "Torrent", false], [116, 0.023491, "s", false], [27491, 0.021255, "wise", false], [1791, 0.018055, "ch", false], [27302, 0.013643, "umin", false], [1858, 0.01238, "es", false]]], "model_b": [8795, 1, 0.2319023162126541, [[8795, 0.231902, "ter", false], [102, 0.09113, "e", false], [116, 0.046393, "s", false], [48761, 0.043744, "Torrent", false], [27135, 0.023984, "ters", false], [2206, 0.019373, "te", false], [7856, 0.018095, "ing", false], [4706, 0.017608, " of", false], [46, 0.015887, "-", false], [25038, 0.015283, "coin", false]]]}, "raw_delta": -0.07291666666666669, "tuned_delta": -0.020061722768466864}, {"byte_start": 10, "byte_end": 15, "display": {"text": " Less", "kind": "normal"}, "is_word": true, "word_id": 3, "word_key": " less", "bytes_hex": "20 4c 65 73 73", "compression": {"model_a": "20.74% 20.74% 20.74% 20.74% 20.74%", "model_b": "21.64% 21.64% 21.64% 21.64% 21.64%"}, "model_tokens": {"model_a": [[29273, " Less", "normal", 0.0032149008475244045]], "model_b": [[29273, " Less", "normal", 0.002490060869604349]]}, "loss": {"model_a": 20.738741212778844, "model_b": 21.640425613334447}, "topk": {"model_a": [29273, 29, 0.0032149008475244045, [[37496, 0.246803, " Truth", false], [29584, 0.100386, " Pill", false], [26939, 0.052462, "root", false], [19826, 0.030137, " End", false], [29694, 0.025204, " Root", false], [44502, 0.021864, " Legacy", false], [20979, 0.020562, " Tas", false], [44014, 0.017332, " Battle", false], [21265, 0.011802, " and", false], [37421, 0.011155, " Sweet", false]]], "model_b": [29273, 43, 0.002490060869604349, [[19826, 0.065806, " End", false], [37496, 0.060229, " Truth", false], [46, 0.022982, "-", false], [29694, 0.020777, " Root", false], [36711, 0.019261, " Fruit", false], [19898, 0.01685, " Fla", false], [61369, 0.016179, " Experience", false], [37421, 0.013073, " Sweet", false], [29863, 0.012863, " Tale", false], [21265, 0.011283, " and", false]]]}, "raw_delta": -0.050000000000000044, "tuned_delta": 0.002854943898199777}, {"byte_start": 15, "byte_end": 17, "display": {"text": "on", "kind": "normal"}, "is_word": true, "word_id": 4, "word_key": "on", "bytes_hex": "6f 6e", "compression": {"model_a": "1.02% 1.02%", "model_b": "0.28% 0.28%"}, "model_tokens": {"model_a": [[2098, "on", "normal", 0.8933794498443604]], "model_b": [[2098, "on", "normal", 0.9695522785186768]]}, "loss": {"model_a": 1.021439360004393, "model_b": 0.2784743082770597}, "topk": {"model_a": [2098, 1, 0.8933794498443604, [[2098, 0.893379, "on", false], [8371, 0.103474, "ons", false], [59, 0.000303, ":", false], [7874, 0.000244, "ion", false], [1853, 0.000193, "en", false], [11, 0.000177, "\n", false], [34326, 0.000143, "ening", false], [7856, 0.000143, "ing", false], [29888, 8.9e-05, " Than", false], [4600, 6.1e-05, " is", false]]], "model_b": [2098, 1, 0.9695522785186768, [[2098, 0.969552, "on", false], [8371, 0.030243, "ons", false], [7874, 2.5e-05, "ion", false], [7856, 2.4e-05, "ing", false], [36923, 8e-06, " Learn", false], [8373, 6e-06, "ony", false], [8363, 5e-06, "ona", false], [29888, 5e-06, " Than", false], [8366, 5e-06, "one", false], [1950, 4e-06, "in", false]]]}, "raw_delta": 0.04119873046875, "tuned_delta": 0.09405367436694982}, {"byte_start": 17, "byte_end": 18, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "31.84%", "model_b": "52.97%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.16939213871955872]], "model_b": [[11, "\n", "control", 0.053535096347332]]}, "loss": {"model_a": 31.840730394619698, "model_b": 52.97395853264162}, "topk": {"model_a": [11, 3, 0.16939213871955872, [[59, 0.312257, ":", false], [4706, 0.233828, " of", false], [11, 0.169392, "\n", false], [261, 0.050367, "\n\n", false], [4596, 0.019932, " in", false], [30917, 0.014304, " from", false], [275, 0.012285, " (", false], [21700, 0.011542, " for", false], [22897, 0.010455, " –", false], [280, 0.009315, " -", false]]], "model_b": [11, 3, 0.053535096347332, [[4706, 0.592784, " of", false], [59, 0.160058, ":", false], [11, 0.053535, "\n", false], [261, 0.035347, "\n\n", false], [275, 0.016666, " (", false], [4089, 0.009909, " Of", false], [4600, 0.007953, " is", false], [21265, 0.007183, " and", false], [45, 0.006672, ",", false], [4596, 0.004557, " in", false]]]}, "raw_delta": -1.171875, "tuned_delta": -1.1190200561018002}, {"byte_start": 18, "byte_end": 22, "display": {"text": "Rich", "kind": "normal"}, "is_word": true, "word_id": 5, "word_key": "rich", "bytes_hex": "52 69 63 68", "compression": {"model_a": "43.96% 43.96% 43.96% 43.96%", "model_b": "41.98% 41.98% 41.98% 41.98%"}, "model_tokens": {"model_a": [[24100, "Rich", "normal", 5.900553514948115e-05]], "model_b": [[24100, "Rich", "normal", 9.215204045176506e-05]]}, "loss": {"model_a": 43.9571145270856, "model_b": 41.98467990087022}, "topk": {"model_a": [24100, 1621, 5.900553514948115e-05, [[6699, 0.12258, "The", false], [1136, 0.043154, "In", false], [894, 0.040422, "By", false], [66, 0.034144, "A", false], [1782, 0.030002, "by", false], [24242, 0.019565, "This", false], [35, 0.014518, "\"", false], [24327, 0.013673, "When", false], [74, 0.012853, "I", false], [1141, 0.01171, "It", false]]], "model_b": [24100, 1208, 9.215204045176506e-05, [[6699, 0.102655, "The", false], [1136, 0.031903, "In", false], [894, 0.029661, "By", false], [66, 0.025294, "A", false], [74, 0.025139, "I", false], [1782, 0.021771, "by", false], [1141, 0.019034, "It", false], [1589, 0.017246, "We", false], [24327, 0.017022, "When", false], [35, 0.015403, "\"", false]]]}, "raw_delta": 0.109375, "tuned_delta": 0.16222994389819984}, {"byte_start": 22, "byte_end": 29, "display": {"text": " Sutton", "kind": "normal"}, "is_word": true, "word_id": 6, "word_key": " sutton", "bytes_hex": "20 53 75 74 74 6f 6e", "compression": {"model_a": "26.73% 26.73% 26.73% 26.73% 26.73% 26.73% 26.73%", "model_b": "20.05% 20.05% 20.05% 20.05% 20.05% 20.05% 20.05%"}, "model_tokens": {"model_a": [[44940, " Sutton", "normal", 3.066686986130662e-05]], "model_b": [[44940, " Sutton", "normal", 0.0004142566176597029]]}, "loss": {"model_a": 26.728501873612494, "model_b": 20.04637640520936}, "topk": {"model_a": [44940, 2572, 3.066686986130662e-05, [[26269, 0.096985, "mond", false], [4596, 0.063092, " in", false], [21265, 0.059195, " and", false], [1941, 0.044189, "ie", false], [45, 0.032253, ",", false], [46787, 0.031165, " people", false], [19712, 0.029253, " Dad", false], [2030, 0.017598, "ly", false], [1858, 0.016853, "es", false], [8795, 0.015833, "ter", false]]], "model_b": [44940, 196, 0.0004142566176597029, [[26269, 0.183218, "mond", false], [46787, 0.05846, " people", false], [45, 0.03947, ",", false], [21265, 0.039051, " and", false], [1858, 0.037005, "es", false], [1941, 0.026738, "ie", false], [8795, 0.018366, "ter", false], [4596, 0.015894, " in", false], [19712, 0.013771, " Dad", false], [7513, 0.010657, "est", false]]]}, "raw_delta": 0.3705357142857144, "tuned_delta": 0.42339065818391425}, {"byte_start": 29, "byte_end": 30, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "50.16%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.06104319170117378]], "model_b": [[11, "\n", "control", 0.2021895796060562]]}, "loss": {"model_a": 50.156194780905366, "model_b": 28.600302080123}, "topk": {"model_a": [11, 4, 0.06104319170117378, [[45, 0.226113, ",", false], [4600, 0.107195, " is", false], [460, 0.062042, "'s", false], [11, 0.061043, "\n", false], [21265, 0.05983, " and", false], [28309, 0.051197, "’s", false], [21800, 0.032388, " has", false], [22748, 0.026898, " was", false], [59, 0.02509, ":", false], [4706, 0.013552, " of", false]]], "model_b": [11, 2, 0.2021895796060562, [[45, 0.215921, ",", false], [11, 0.20219, "\n", false], [4600, 0.062694, " is", false], [460, 0.051548, "'s", false], [28309, 0.035716, "’s", false], [21265, 0.033008, " and", false], [261, 0.027343, "\n\n", false], [21800, 0.016091, " has", false], [275, 0.015733, " (", false], [47819, 0.013605, " writes", false]]]}, "raw_delta": 1.1953125, "tuned_delta": 1.2481674438981998}, {"byte_start": 30, "byte_end": 35, "display": {"text": "March", "kind": "normal"}, "is_word": true, "word_id": 7, "word_key": "march", "bytes_hex": "4d 61 72 63 68", "compression": {"model_a": "18.15% 18.15% 18.15% 18.15% 18.15%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[33258, "March", "normal", 0.006613485980778933]], "model_b": [[33258, "March", "normal", 0.006689136847853661]]}, "loss": {"model_a": 18.146398561181492, "model_b": 18.03368801111204}, "topk": {"model_a": [33258, 21, 0.006613485980778933, [[6699, 0.071124, "The", false], [66, 0.026327, "A", false], [1136, 0.02585, "In", false], [58067, 0.020608, "Published", false], [640, 0.018784, "20", false], [41, 0.015667, "(", false], [24242, 0.014126, "This", false], [35, 0.010582, "\"", false], [125, 0.010216, "|", false], [639, 0.00977, "19", false]]], "model_b": [33258, 21, 0.006689136847853661, [[6699, 0.080425, "The", false], [74, 0.021537, "I", false], [1136, 0.020863, "In", false], [66, 0.017205, "A", false], [35, 0.012378, "\"", false], [24100, 0.011415, "Rich", false], [24327, 0.011236, "When", false], [853, 0.010141, "As", false], [24242, 0.009833, "This", false], [1336, 0.009566, "On", false]]]}, "raw_delta": 0.006250000000000089, "tuned_delta": 0.05910494389819991}, {"byte_start": 35, "byte_end": 38, "display": {"text": " 13", "kind": "normal"}, "is_word": true, "word_id": 8, "word_key": " 13", "bytes_hex": "20 31 33", "compression": {"model_a": "22.35% 22.35% 22.35%", "model_b": "21.13% 21.13% 21.13%"}, "model_tokens": {"model_a": [[3486, " 13", "normal", 0.02427285723388195]], "model_b": [[3486, " 13", "normal", 0.029522651806473732]]}, "loss": {"model_a": 22.354259097107633, "model_b": 21.133228138021924}, "topk": {"model_a": [3486, 18, 0.02427285723388195, [[3493, 0.141099, " 20", false], [3492, 0.051897, " 19", false], [284, 0.047504, " 1", false], [3504, 0.029647, " 31", false], [3488, 0.027927, " 15", false], [3503, 0.027418, " 30", false], [3501, 0.027317, " 28", false], [3485, 0.026356, " 12", false], [286, 0.026137, " 3", false], [3487, 0.02606, " 14", false]]], "model_b": [3486, 13, 0.029522651806473732, [[3493, 0.070176, " 20", false], [284, 0.044874, " 1", false], [3488, 0.035085, " 15", false], [3492, 0.034471, " 19", false], [3494, 0.033572, " 21", false], [3485, 0.031079, " 12", false], [3501, 0.031073, " 28", false], [291, 0.030999, " 8", false], [3484, 0.030667, " 11", false], [3504, 0.030465, " 31", false]]]}, "raw_delta": 0.06770833333333326, "tuned_delta": 0.12056327723153308}, {"byte_start": 38, "byte_end": 39, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.38%", "model_b": "1.70%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9261689782142639]], "model_b": [[45, ",", "normal", 0.9101293087005615]]}, "loss": {"model_a": 1.3824653406956007, "model_b": 1.6994637627659297}, "topk": {"model_a": [45, 1, 0.9261689782142639, [[45, 0.926169, ",", false], [2209, 0.037057, "th", false], [3493, 0.009484, " 20", false], [11, 0.007212, "\n", false], [9815, 0.003922, "–", false], [46, 0.002842, "-", false], [22897, 0.001676, " –", false], [261, 0.001573, "\n\n", false], [280, 0.001572, " -", false], [273, 0.0007, " \u0026", false]]], "model_b": [45, 1, 0.9101293087005615, [[45, 0.910129, ",", false], [2209, 0.055964, "th", false], [11, 0.008816, "\n", false], [3493, 0.008088, " 20", false], [46, 0.002581, "-", false], [261, 0.001473, "\n\n", false], [280, 0.000877, " -", false], [4600, 0.000706, " is", false], [299, 0.000565, " @", false], [47, 0.000549, ".", false]]]}, "raw_delta": -0.017578125, "tuned_delta": 0.03527681889819982}, {"byte_start": 39, "byte_end": 42, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 9, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"model_a": "0.83% 0.83% 0.83%", "model_b": "0.11% 0.11% 0.11%"}, "model_tokens": {"model_a": [[3493, " 20", "normal", 0.8704513907432556]], "model_b": [[3493, " 20", "normal", 0.9814662933349609]]}, "loss": {"model_a": 0.8335884432219759, "model_b": 0.11153648183956014}, "topk": {"model_a": [3493, 1, 0.8704513907432556, [[3493, 0.870451, " 20", false], [3492, 0.119114, " 19", false], [3491, 0.005465, " 18", false], [3490, 0.000784, " 17", false], [11, 0.000624, "\n", false], [640, 0.000461, "20", false], [639, 0.000147, "19", false], [3489, 0.000144, " 16", false], [3485, 0.000121, " 12", false], [3488, 0.00012, " 15", false]]], "model_b": [3493, 1, 0.9814662933349609, [[3493, 0.981466, " 20", false], [3492, 0.013505, " 19", false], [640, 0.000691, "20", false], [3491, 0.000385, " 18", false], [285, 0.000217, " 2", false], [3494, 0.000209, " 21", false], [3490, 0.000179, " 17", false], [11, 0.000173, "\n", false], [3485, 0.000142, " 12", false], [3484, 0.000134, " 11", false]]]}, "raw_delta": 0.0400390625, "tuned_delta": 0.09289400639819982}, {"byte_start": 42, "byte_end": 44, "display": {"text": "19", "kind": "normal"}, "is_word": true, "word_id": 10, "word_key": "19", "bytes_hex": "31 39", "compression": {"model_a": "25.78% 25.78%", "model_b": "23.11% 23.11%"}, "model_tokens": {"model_a": [[639, "19", "normal", 0.05752173811197281]], "model_b": [[639, "19", "normal", 0.07687697559595108]]}, "loss": {"model_a": 25.782538328386746, "model_b": 23.1056627642373}, "topk": {"model_a": [639, 4, 0.05752173811197281, [[640, 0.06631, "20", false], [638, 0.057777, "18", false], [634, 0.057629, "14", false], [639, 0.057522, "19", false], [637, 0.056935, "17", false], [636, 0.056339, "16", false], [633, 0.055022, "13", false], [632, 0.054071, "12", false], [641, 0.052084, "21", false], [635, 0.051313, "15", false]]], "model_b": [639, 1, 0.07687697559595108, [[639, 0.076877, "19", false], [638, 0.073605, "18", false], [641, 0.072436, "21", false], [640, 0.069955, "20", false], [637, 0.069857, "17", false], [634, 0.060354, "14", false], [633, 0.058082, "13", false], [636, 0.054728, "16", false], [632, 0.053173, "12", false], [642, 0.052269, "22", false]]]}, "raw_delta": 0.1484375, "tuned_delta": 0.20129244389819984}, {"byte_start": 44, "byte_end": 45, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "10.07%", "model_b": "7.47%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.571814239025116]], "model_b": [[11, "\n", "control", 0.6637576222419739]]}, "loss": {"model_a": 10.073505412457116, "model_b": 7.467073942101079}, "topk": {"model_a": [11, 1, 0.571814239025116, [[11, 0.571814, "\n", false], [261, 0.269049, "\n\n", false], [45, 0.022059, ",", false], [359, 0.012099, " |", false], [280, 0.011396, " -", false], [4424, 0.010551, " at", false], [22907, 0.009347, " •", false], [4932, 0.0053, " ·", false], [22898, 0.00365, " —", false], [275, 0.003455, " (", false]]], "model_b": [11, 1, 0.6637576222419739, [[11, 0.663758, "\n", false], [261, 0.116362, "\n\n", false], [45, 0.037467, ",", false], [4424, 0.024256, " at", false], [359, 0.012481, " |", false], [22907, 0.009595, " •", false], [0, 0.008143, "[0]", false], [280, 0.007714, " -", false], [299, 0.003791, " @", false], [284, 0.003705, " 1", false]]]}, "raw_delta": 0.14453125, "tuned_delta": 0.19738619389819984}, {"byte_start": 45, "byte_end": 48, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 11, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"model_a": "14.46% 14.46% 14.46%", "model_b": "13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[6699, "The", "normal", 0.09010478109121323]], "model_b": [[6699, "The", "normal", 0.10210046172142029]]}, "loss": {"model_a": 14.464520592246117, "model_b": 13.713116925116447}, "topk": {"model_a": [6699, 1, 0.09010478109121323, [[6699, 0.090105, "The", false], [1136, 0.039257, "In", false], [66, 0.025966, "A", false], [74, 0.025273, "I", false], [24242, 0.017964, "This", false], [1141, 0.017594, "It", false], [35, 0.015829, "\"", false], [24327, 0.015664, "When", false], [33427, 0.014175, "Share", false], [853, 0.01296, "As", false]]], "model_b": [6699, 1, 0.10210046172142029, [[6699, 0.1021, "The", false], [1136, 0.041851, "In", false], [74, 0.027426, "I", false], [66, 0.027134, "A", false], [894, 0.018916, "By", false], [24327, 0.018687, "When", false], [1141, 0.016549, "It", false], [853, 0.015824, "As", false], [24242, 0.015213, "This", false], [33504, 0.014919, "There", false]]]}, "raw_delta": 0.04166666666666674, "tuned_delta": 0.09452161056486656}, {"byte_start": 48, "byte_end": 56, "display": {"text": " biggest", "kind": "normal"}, "is_word": true, "word_id": 12, "word_key": " biggest", "bytes_hex": "20 62 69 67 67 65 73 74", "compression": {"model_a": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "model_b": "14.79% 14.79% 14.79% 14.79% 14.79% 14.79% 14.79% 14.79%"}, "model_tokens": {"model_a": [[51039, " biggest", "normal", 0.001161403488367796]], "model_b": [[51039, " biggest", "normal", 0.0014241255121305585]]}, "loss": {"model_a": 15.215924259375784, "model_b": 14.793259696615346}, "topk": {"model_a": [51039, 93, 0.001161403488367796, [[19523, 0.102103, " Bit", false], [45315, 0.021365, " bitter", false], [39831, 0.013227, " story", false], [46430, 0.011284, " lesson", false], [31461, 0.011049, " most", false], [59725, 0.01025, " following", false], [47014, 0.007033, " recent", false], [40213, 0.006819, " world", false], [38499, 0.00663, " first", false], [320, 0.006065, " U", false]]], "model_b": [51039, 62, 0.0014241255121305585, [[19523, 0.220535, " Bit", false], [45315, 0.017632, " bitter", false], [31461, 0.012267, " most", false], [21365, 0.011996, " bit", false], [39831, 0.009362, " story", false], [46430, 0.009235, " lesson", false], [38499, 0.006573, " first", false], [22903, 0.006563, " “", false], [31254, 0.006416, " last", false], [47014, 0.006059, " recent", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07629244389819982}, {"byte_start": 56, "byte_end": 63, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 13, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%", "model_b": "4.27% 4.27% 4.27% 4.27% 4.27% 4.27% 4.27%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.3188975751399994]], "model_b": [[46430, " lesson", "normal", 0.1917613446712494]]}, "loss": {"model_a": 2.9586519393230692, "model_b": 4.26689939548633}, "topk": {"model_a": [46430, 1, 0.3188975751399994, [[46430, 0.318898, " lesson", false], [52569, 0.056575, " problem", false], [59281, 0.038406, " challenge", false], [52245, 0.031298, " mistake", false], [47009, 0.025335, " reason", false], [56739, 0.015289, " obstacle", false], [39941, 0.014743, " thing", false], [52127, 0.01308, " lessons", false], [31887, 0.012984, " risk", false], [47546, 0.010046, " threat", false]]], "model_b": [46430, 1, 0.1917613446712494, [[46430, 0.191761, " lesson", false], [52569, 0.063724, " problem", false], [52245, 0.04675, " mistake", false], [39941, 0.040969, " thing", false], [59281, 0.035323, " challenge", false], [47546, 0.020079, " threat", false], [38809, 0.015631, " issue", false], [31514, 0.013613, " news", false], [32187, 0.013201, " take", false], [21265, 0.011063, " and", false]]]}, "raw_delta": -0.07254464285714286, "tuned_delta": -0.01968969895894304}, {"byte_start": 63, "byte_end": 68, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 14, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "9.13% 9.13% 9.13% 9.13% 9.13%", "model_b": "9.30% 9.30% 9.30% 9.30% 9.30%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.07993438839912415]], "model_b": [[32227, " that", "normal", 0.07561083883047104]]}, "loss": {"model_a": 9.12955455562547, "model_b": 9.298620380729647}, "topk": {"model_a": [32227, 3, 0.07993438839912415, [[308, 0.337119, " I", false], [4706, 0.098685, " of", false], [32227, 0.079934, " that", false], [4858, 0.075109, " we", false], [30917, 0.058424, " from", false], [4811, 0.044791, " to", false], [4596, 0.040651, " in", false], [22799, 0.02782, " you", false], [52112, 0.02661, " learned", false], [21700, 0.019094, " for", false]]], "model_b": [32227, 5, 0.07561083883047104, [[308, 0.293648, " I", false], [4858, 0.120844, " we", false], [4706, 0.096622, " of", false], [30917, 0.077914, " from", false], [32227, 0.075611, " that", false], [4811, 0.037113, " to", false], [4596, 0.034125, " in", false], [4600, 0.024778, " is", false], [52112, 0.022758, " learned", false], [21700, 0.018998, " for", false]]]}, "raw_delta": -0.009375000000000022, "tuned_delta": 0.0434799438981998}, {"byte_start": 68, "byte_end": 72, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 15, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "13.31% 13.31% 13.31% 13.31%", "model_b": "17.33% 17.33% 17.33% 17.33%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.05263060703873634]], "model_b": [[21413, " can", "normal", 0.021276982501149178]]}, "loss": {"model_a": 13.313933726953811, "model_b": 17.329247073177978}, "topk": {"model_a": [21413, 4, 0.05263060703873634, [[308, 0.291346, " I", false], [22590, 0.074025, " the", false], [4858, 0.052769, " we", false], [21413, 0.052631, " can", false], [22799, 0.017396, " you", false], [332, 0.016364, " a", false], [21273, 0.014957, " any", false], [21800, 0.012189, " has", false], [4677, 0.012035, " my", false], [46787, 0.010691, " people", false]]], "model_b": [21413, 5, 0.021276982501149178, [[308, 0.394986, " I", false], [4858, 0.113293, " we", false], [22590, 0.042331, " the", false], [38087, 0.040097, " comes", false], [21413, 0.021277, " can", false], [31461, 0.018156, " most", false], [22799, 0.018035, " you", false], [46787, 0.012317, " people", false], [30383, 0.011895, " came", false], [45178, 0.008748, " anyone", false]]]}, "raw_delta": -0.22265625, "tuned_delta": -0.16980130610180016}, {"byte_start": 72, "byte_end": 75, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 16, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "0.75% 0.75% 0.75%", "model_b": "0.79% 0.79% 0.79%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.8826338052749634]], "model_b": [[4435, " be", "normal", 0.8764384388923645]]}, "loss": {"model_a": 0.7514036671296683, "model_b": 0.7866257140263715}, "topk": {"model_a": [4435, 1, 0.8826338052749634, [[4435, 0.882634, " be", false], [30482, 0.055028, " come", false], [30789, 0.008289, " ever", false], [39903, 0.007478, " teach", false], [31073, 0.006056, " help", false], [56896, 0.004466, " possibly", false], [28310, 0.002614, "’t", false], [461, 0.002549, "'t", false], [21265, 0.001868, " and", false], [45846, 0.001267, " emerge", false]]], "model_b": [4435, 1, 0.8764384388923645, [[4435, 0.876438, " be", false], [30482, 0.027921, " come", false], [39903, 0.012219, " teach", false], [30789, 0.010338, " ever", false], [28310, 0.006371, "’t", false], [31073, 0.003973, " help", false], [21265, 0.003401, " and", false], [46159, 0.003082, " happen", false], [47008, 0.002745, " really", false], [56896, 0.002634, " possibly", false]]]}, "raw_delta": -0.001953125, "tuned_delta": 0.05090181889819982}, {"byte_start": 75, "byte_end": 80, "display": {"text": " read", "kind": "normal"}, "is_word": true, "word_id": 17, "word_key": " read", "bytes_hex": "20 72 65 61 64", "compression": {"model_a": "27.73% 27.73% 27.73% 27.73% 27.73%", "model_b": "30.21% 30.21% 30.21% 30.21% 30.21%"}, "model_tokens": {"model_a": [[31834, " read", "normal", 0.0004577813087962568]], "model_b": [[31834, " read", "normal", 0.00022634358901996166]]}, "loss": {"model_a": 27.726795317084765, "model_b": 30.20642741861267}, "topk": {"model_a": [31834, 19, 0.0004577813087962568, [[52112, 0.729077, " learned", false], [38297, 0.091694, " drawn", false], [39887, 0.050446, " taken", false], [47512, 0.028853, " taught", false], [21762, 0.023683, " gle", false], [46418, 0.018075, " learnt", false], [51438, 0.0136, " derived", false], [59697, 0.010598, " extracted", false], [46071, 0.004611, " gained", false], [50937, 0.001465, " applied", false]]], "model_b": [31834, 56, 0.00022634358901996166, [[52112, 0.718347, " learned", false], [38297, 0.071769, " drawn", false], [47512, 0.035584, " taught", false], [39887, 0.034445, " taken", false], [46418, 0.028286, " learnt", false], [21762, 0.024337, " gle", false], [46071, 0.010733, " gained", false], [51438, 0.008607, " derived", false], [59697, 0.006532, " extracted", false], [50937, 0.004654, " applied", false]]]}, "raw_delta": -0.13749999999999996, "tuned_delta": -0.08464505610180013}, {"byte_start": 80, "byte_end": 85, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 18, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"model_a": "2.94% 2.94% 2.94% 2.94% 2.94%", "model_b": "1.20% 1.20% 1.20% 1.20% 1.20%"}, "model_tokens": {"model_a": [[30917, " from", "normal", 0.4441596567630768]], "model_b": [[30917, " from", "normal", 0.7149670720100403]]}, "loss": {"model_a": 2.944563120564388, "model_b": 1.2045940038672498}, "topk": {"model_a": [30917, 1, 0.4441596567630768, [[30917, 0.44416, " from", false], [31162, 0.387544, " into", false], [4596, 0.065291, " in", false], [51035, 0.039881, " between", false], [22249, 0.022987, " out", false], [4450, 0.004321, " by", false], [22218, 0.004134, " off", false], [4712, 0.002872, " on", false], [37598, 0.002398, " about", false], [4424, 0.00168, " at", false]]], "model_b": [30917, 1, 0.7149670720100403, [[30917, 0.714967, " from", false], [4596, 0.097086, " in", false], [31162, 0.037588, " into", false], [22249, 0.027044, " out", false], [37598, 0.024087, " about", false], [21265, 0.011847, " and", false], [4450, 0.009474, " by", false], [4712, 0.006235, " on", false], [53140, 0.005798, " through", false], [4600, 0.005277, " is", false]]]}, "raw_delta": 0.09648437499999998, "tuned_delta": 0.1493393188981998}, {"byte_start": 85, "byte_end": 88, "display": {"text": " 70", "kind": "normal"}, "is_word": true, "word_id": 19, "word_key": " 70", "bytes_hex": "20 37 30", "compression": {"model_a": "62.74% 62.74% 62.74%", "model_b": "66.12% 66.12% 66.12%"}, "model_tokens": {"model_a": [[3543, " 70", "normal", 2.8311646019574255e-05]], "model_b": [[3543, " 70", "normal", 1.7101432604249567e-05]]}, "loss": {"model_a": 62.74220620532731, "model_b": 66.12352270741081}, "topk": {"model_a": [3543, 1621, 2.8311646019574255e-05, [[22590, 0.495919, " the", false], [32234, 0.097747, " this", false], [332, 0.020217, " a", false], [51929, 0.008586, " history", false], [22248, 0.007422, " our", false], [39936, 0.006898, " these", false], [50018, 0.006786, " Bitcoin", false], [21256, 0.005979, " all", false], [28826, 0.005976, " Elon", false], [4677, 0.005804, " my", false]]], "model_b": [3543, 2400, 1.7101432604249567e-05, [[22590, 0.422966, " the", false], [32234, 0.122498, " this", false], [332, 0.028716, " a", false], [20996, 0.025583, " The", false], [51929, 0.023669, " history", false], [22903, 0.011191, " “", false], [22248, 0.00979, " our", false], [21273, 0.009624, " any", false], [57552, 0.008488, " watching", false], [21256, 0.008146, " all", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13464505610180016}, {"byte_start": 88, "byte_end": 94, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 20, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"model_a": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92%", "model_b": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"model_a": [[40237, " years", "normal", 0.737188458442688]], "model_b": [[40237, " years", "normal", 0.6282573938369751]]}, "loss": {"model_a": 0.9216435604637339, "model_b": 1.4206225581670293}, "topk": {"model_a": [40237, 1, 0.737188458442688, [[40237, 0.737188, " years", false], [49, 0.086995, "0", false], [46, 0.030434, "-", false], [44, 0.017851, "+", false], [38, 0.016737, "%", false], [45, 0.012636, ",", false], [620, 0.007046, "00", false], [116, 0.006838, "s", false], [37583, 0.006328, " Years", false], [52232, 0.006267, " million", false]]], "model_b": [40237, 1, 0.6282573938369751, [[40237, 0.628257, " years", false], [49, 0.109079, "0", false], [45, 0.024265, ",", false], [620, 0.022521, "00", false], [38, 0.019764, "%", false], [52232, 0.017159, " million", false], [46, 0.0166, "-", false], [37583, 0.013984, " Years", false], [52238, 0.009422, " minutes", false], [44, 0.008507, "+", false]]]}, "raw_delta": -0.02766927083333334, "tuned_delta": 0.025185673064866482}, {"byte_start": 94, "byte_end": 97, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 21, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.38% 0.38% 0.38%", "model_b": "0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9375355839729309]], "model_b": [[4706, " of", "normal", 0.9345970153808594]]}, "loss": {"model_a": 0.38450734528901, "model_b": 0.40798870988681213}, "topk": {"model_a": [4706, 1, 0.9375355839729309, [[4706, 0.937536, " of", false], [4596, 0.017684, " in", false], [21240, 0.01036, " ago", false], [39690, 0.002713, " since", false], [37634, 0.00254, " after", false], [9820, 0.002452, "’", false], [40218, 0.002421, " worth", false], [40, 0.001955, "'", false], [4712, 0.001774, " on", false], [21265, 0.00175, " and", false]]], "model_b": [4706, 1, 0.9345970153808594, [[4706, 0.934597, " of", false], [4596, 0.012373, " in", false], [21265, 0.005161, " and", false], [9820, 0.004905, "’", false], [40218, 0.004342, " worth", false], [4712, 0.00334, " on", false], [21240, 0.003203, " ago", false], [4600, 0.002566, " is", false], [37634, 0.00211, " after", false], [39690, 0.001953, " since", false]]]}, "raw_delta": -0.0013020833333333356, "tuned_delta": 0.051552860564866486}, {"byte_start": 97, "byte_end": 100, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 22, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "26.11% 26.11% 26.11%", "model_b": "47.71% 47.71% 47.71%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.013134406879544258]], "model_b": [[3609, " AI", "normal", 0.00035615393426269293]]}, "loss": {"model_a": 26.111277432755976, "model_b": 47.71413286273394}, "topk": {"model_a": [3609, 10, 0.013134406879544258, [[51929, 0.077017, " history", false], [22590, 0.054169, " the", false], [54830, 0.038788, " American", false], [320, 0.027472, " U", false], [4273, 0.022142, " US", false], [22747, 0.017623, " war", false], [57103, 0.016225, " research", false], [56077, 0.01568, " economic", false], [39750, 0.013301, " space", false], [3609, 0.013134, " AI", false]]], "model_b": [3609, 338, 0.00035615393426269293, [[57103, 0.059866, " research", false], [61979, 0.057594, " experience", false], [51929, 0.056688, " history", false], [22590, 0.042384, " the", false], [57396, 0.017133, " teaching", false], [31293, 0.014033, " life", false], [46946, 0.011315, " public", false], [57331, 0.011119, " studying", false], [54830, 0.010932, " American", false], [46456, 0.010306, " living", false]]]}, "raw_delta": -1.1979166666666667, "tuned_delta": -1.145061722768467}, {"byte_start": 100, "byte_end": 109, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 23, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89%", "model_b": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.3874472379684448]], "model_b": [[57103, " research", "normal", 0.21367034316062927]]}, "loss": {"model_a": 1.8941634108893723, "model_b": 3.099540126909882}, "topk": {"model_a": [57103, 1, 0.3874472379684448, [[57103, 0.387447, " research", false], [4600, 0.244654, " is", false], [63469, 0.083007, " development", false], [51929, 0.055617, " history", false], [56950, 0.048832, " progress", false], [21265, 0.010842, " and", false], [45, 0.010626, ",", false], [32499, 0.008372, " work", false], [47160, 0.005417, " safety", false], [4596, 0.004778, " in", false]]], "model_b": [57103, 1, 0.21367034316062927, [[57103, 0.21367, " research", false], [4600, 0.124507, " is", false], [63469, 0.068991, " development", false], [51929, 0.047575, " history", false], [21265, 0.035654, " and", false], [78, 0.030881, "M", false], [4596, 0.02689, " in", false], [45, 0.023199, ",", false], [61979, 0.017454, " experience", false], [85, 0.015811, "T", false]]]}, "raw_delta": -0.06684027777777778, "tuned_delta": -0.013985333879577955}, {"byte_start": 109, "byte_end": 112, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 24, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "1.31% 1.31% 1.31%", "model_b": "2.22% 2.22% 2.22%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.8063996434211731]], "model_b": [[4600, " is", "normal", 0.6907477378845215]]}, "loss": {"model_a": 1.309086076327469, "model_b": 2.218988954492302}, "topk": {"model_a": [4600, 1, 0.8063996434211731, [[4600, 0.8064, " is", false], [45, 0.048329, ",", false], [21265, 0.023863, " and", false], [59, 0.012272, ":", false], [4596, 0.007698, " in", false], [64, 0.006744, "?", false], [275, 0.006509, " (", false], [11, 0.005695, "\n", false], [22074, 0.005339, " may", false], [43273, 0.004042, "—and", false]]], "model_b": [4600, 1, 0.6907477378845215, [[4600, 0.690748, " is", false], [21265, 0.064368, " and", false], [45, 0.048913, ",", false], [4424, 0.019643, " at", false], [21800, 0.016062, " has", false], [4596, 0.013981, " in", false], [32227, 0.012919, " that", false], [275, 0.006553, " (", false], [59, 0.005268, ":", false], [64, 0.004992, "?", false]]]}, "raw_delta": -0.050455729166666664, "tuned_delta": 0.002399214731533157}, {"byte_start": 112, "byte_end": 117, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 25, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.80% 1.80% 1.80% 1.80% 1.80%", "model_b": "1.83% 1.83% 1.83% 1.83% 1.83%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.6123745441436768]], "model_b": [[32227, " that", "normal", 0.6009541749954224]]}, "loss": {"model_a": 1.7963243917318634, "model_b": 1.8315464386285667}, "topk": {"model_a": [32227, 1, 0.6123745441436768, [[32227, 0.612375, " that", false], [32234, 0.134196, " this", false], [22187, 0.043185, " not", false], [22590, 0.037584, " the", false], [59, 0.034723, ":", false], [332, 0.011083, " a", false], [4811, 0.010767, " to", false], [21835, 0.009836, " how", false], [45, 0.006818, ",", false], [22226, 0.006771, " one", false]]], "model_b": [32227, 1, 0.6009541749954224, [[32227, 0.600954, " that", false], [32234, 0.089134, " this", false], [22590, 0.063231, " the", false], [59, 0.045194, ":", false], [4811, 0.032695, " to", false], [22226, 0.015156, " one", false], [22187, 0.014742, " not", false], [22903, 0.013954, " “", false], [21835, 0.009658, " how", false], [45, 0.009101, ",", false]]]}, "raw_delta": -0.001953125, "tuned_delta": 0.05090181889819982}, {"byte_start": 117, "byte_end": 125, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 26, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.0012306030839681625]], "model_b": [[51832, " general", "normal", 0.0003328181046526879]]}, "loss": {"model_a": 15.075036071788972, "model_b": 18.03368801111204}, "topk": {"model_a": [51832, 89, 0.0012306030839681625, [[22590, 0.109695, " the", false], [4601, 0.090823, " it", false], [4858, 0.062206, " we", false], [3609, 0.04318, " AI", false], [39934, 0.039635, " there", false], [45, 0.028941, ",", false], [22799, 0.026261, " you", false], [4588, 0.019662, " if", false], [64452, 0.018409, " intelligence", false], [52167, 0.016605, " machine", false]]], "model_b": [51832, 244, 0.0003328181046526879, [[22590, 0.095881, " the", false], [4858, 0.090017, " we", false], [3609, 0.079867, " AI", false], [4601, 0.072226, " it", false], [39934, 0.031943, " there", false], [22799, 0.02897, " you", false], [22903, 0.019063, " “", false], [332, 0.016151, " a", false], [46227, 0.01607, " humans", false], [45, 0.014906, ",", false]]]}, "raw_delta": -0.1640625, "tuned_delta": -0.11120755610180018}, {"byte_start": 125, "byte_end": 133, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 27, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%", "model_b": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.002398804761469364]], "model_b": [[52224, " methods", "normal", 0.0010102905798703432]]}, "loss": {"model_a": 13.595710102127438, "model_b": 15.568144728342816}, "topk": {"model_a": [52224, 21, 0.002398804761469364, [[64452, 0.373298, " intelligence", false], [3609, 0.207784, " AI", false], [46, 0.10153, "-", false], [61594, 0.088554, " artificial", false], [52610, 0.037533, " purpose", false], [45, 0.025662, ",", false], [7919, 0.015649, "ist", false], [7933, 0.012159, "ity", false], [63659, 0.011632, " intelligent", false], [52569, 0.011178, " problem", false]]], "model_b": [52224, 42, 0.0010102905798703432, [[3609, 0.25423, " AI", false], [64452, 0.233024, " intelligence", false], [46, 0.082612, "-", false], [34932, 0.079748, "izing", false], [61594, 0.069661, " artificial", false], [52610, 0.067648, " purpose", false], [52167, 0.018234, " machine", false], [56537, 0.016246, " learning", false], [7933, 0.010727, "ity", false], [45, 0.007886, ",", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 133, "byte_end": 138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 28, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "11.78% 11.78% 11.78% 11.78% 11.78%", "model_b": "12.51% 12.51% 12.51% 12.51% 12.51%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.037954624742269516]], "model_b": [[32227, " that", "normal", 0.03054685704410076]]}, "loss": {"model_a": 11.778252482257551, "model_b": 12.510871057708977}, "topk": {"model_a": [32227, 7, 0.037954624742269516, [[21286, 0.16466, " are", false], [21700, 0.095833, " for", false], [4706, 0.068984, " of", false], [21265, 0.062194, " and", false], [21556, 0.048598, " don", false], [21413, 0.047104, " can", false], [32227, 0.037955, " that", false], [4491, 0.037125, " do", false], [32475, 0.034783, " will", false], [45, 0.03333, ",", false]]], "model_b": [32227, 7, 0.03054685704410076, [[21286, 0.209222, " are", false], [4706, 0.124202, " of", false], [21700, 0.118055, " for", false], [21413, 0.051991, " can", false], [32499, 0.040053, " work", false], [21265, 0.030913, " and", false], [32227, 0.030547, " that", false], [21556, 0.028471, " don", false], [4491, 0.026241, " do", false], [45, 0.026097, ",", false]]]}, "raw_delta": -0.04062500000000002, "tuned_delta": 0.0122299438981998}, {"byte_start": 138, "byte_end": 147, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 29, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"model_a": "14.40% 14.40% 14.40% 14.40% 14.40% 14.40% 14.40% 14.40% 14.40%", "model_b": "14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34%"}, "model_tokens": {"model_a": [[56540, " leverage", "normal", 0.0007558115175925195]], "model_b": [[56540, " leverage", "normal", 0.0007704097661189735]]}, "loss": {"model_a": 14.401903619985312, "model_b": 14.339286647724503}, "topk": {"model_a": [56540, 82, 0.0007558115175925195, [[32499, 0.436449, " work", false], [21286, 0.068103, " are", false], [31967, 0.041057, " seem", false], [31059, 0.026516, " have", false], [21413, 0.026309, " can", false], [31324, 0.023611, " look", false], [45185, 0.02278, " appear", false], [39740, 0.014965, " solve", false], [37730, 0.013661, " apply", false], [53051, 0.013076, " succeed", false]]], "model_b": [56540, 105, 0.0007704097661189735, [[32499, 0.313023, " work", false], [21286, 0.106157, " are", false], [31059, 0.048272, " have", false], [21413, 0.043895, " can", false], [31358, 0.017772, " make", false], [52573, 0.014921, " produce", false], [32462, 0.013889, " were", false], [39740, 0.013545, " solve", false], [21751, 0.011041, " get", false], [47812, 0.01085, " worked", false]]]}, "raw_delta": 0.003472222222222321, "tuned_delta": 0.05632716612042214}, {"byte_start": 147, "byte_end": 159, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 30, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83%", "model_b": "10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.0028083007782697678]], "model_b": [[63370, " computation", "normal", 0.0009243216481991112]]}, "loss": {"model_a": 8.828993088773602, "model_b": 10.519651339815356}, "topk": {"model_a": [63370, 59, 0.0028083007782697678, [[22590, 0.121059, " the", false], [30597, 0.049527, " deep", false], [63885, 0.035487, " statistical", false], [332, 0.033624, " a", false], [30579, 0.031524, " data", false], [52167, 0.027581, " machine", false], [38720, 0.02553, " human", false], [38864, 0.022884, " large", false], [52195, 0.018887, " massive", false], [55465, 0.018348, " advances", false]]], "model_b": [63370, 134, 0.0009243216481991112, [[22590, 0.111544, " the", false], [38864, 0.075627, " large", false], [332, 0.052737, " a", false], [30579, 0.030986, " data", false], [52167, 0.029087, " machine", false], [51832, 0.024394, " general", false], [30597, 0.024189, " deep", false], [38720, 0.022122, " human", false], [52195, 0.02185, " massive", false], [63885, 0.01586, " statistical", false]]]}, "raw_delta": -0.09375000000000004, "tuned_delta": -0.04089505610180022}, {"byte_start": 159, "byte_end": 163, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 31, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "10.00% 10.00% 10.00% 10.00%", "model_b": "9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.10807795077562332]], "model_b": [[21286, " are", "normal", 0.13138771057128906]]}, "loss": {"model_a": 10.00306131866371, "model_b": 9.157732193142833}, "topk": {"model_a": [21286, 3, 0.10807795077562332, [[21265, 0.157537, " and", false], [4811, 0.1322, " to", false], [21286, 0.108078, " are", false], [39339, 0.062954, " power", false], [45, 0.047468, ",", false], [4596, 0.039597, " in", false], [21413, 0.03843, " can", false], [32475, 0.033489, " will", false], [31059, 0.025633, " have", false], [4491, 0.01757, " do", false]]], "model_b": [21286, 3, 0.13138771057128906, [[4811, 0.193564, " to", false], [21265, 0.189561, " and", false], [21286, 0.131388, " are", false], [21413, 0.051587, " can", false], [45, 0.044893, ",", false], [21700, 0.030807, " for", false], [39339, 0.026555, " power", false], [4491, 0.022584, " do", false], [275, 0.021956, " (", false], [4712, 0.019071, " on", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.09972994389819982}, {"byte_start": 163, "byte_end": 174, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 32, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"model_a": "8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97%", "model_b": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84%"}, "model_tokens": {"model_a": [[62676, " ultimately", "normal", 0.004225963726639748]], "model_b": [[62676, " ultimately", "normal", 0.008340721018612385]]}, "loss": {"model_a": 8.965611937342633, "model_b": 7.838506436648131}, "topk": {"model_a": [62676, 45, 0.004225963726639748, [[22187, 0.103783, " not", false], [22590, 0.089257, " the", false], [31458, 0.04812, " more", false], [57492, 0.042825, " unlikely", false], [46439, 0.03466, " likely", false], [21660, 0.02919, " far", false], [31466, 0.028325, " much", false], [39171, 0.022499, " often", false], [45301, 0.02206, " better", false], [332, 0.021258, " a", false]]], "model_b": [62676, 25, 0.008340721018612385, [[22187, 0.217726, " not", false], [39171, 0.034031, " often", false], [332, 0.025979, " a", false], [64916, 0.022368, " fundamentally", false], [59758, 0.021077, " generally", false], [45301, 0.019983, " better", false], [31581, 0.019241, " only", false], [62117, 0.018877, " inherently", false], [4692, 0.017443, " no", false], [22590, 0.0165, " the", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 174, "byte_end": 178, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 33, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.43% 10.43% 10.43% 10.43%", "model_b": "19.30% 19.30% 19.30% 19.30%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09978649020195007]], "model_b": [[22590, " the", "normal", 0.013834351673722267]]}, "loss": {"model_a": 10.425725881424148, "model_b": 19.301681699393356}, "topk": {"model_a": [22590, 2, 0.09978649020195007, [[31458, 0.134943, " more", false], [22590, 0.099786, " the", false], [45781, 0.072104, " doomed", false], [45301, 0.052523, " better", false], [52140, 0.049737, " limited", false], [38606, 0.04429, " going", false], [31277, 0.041161, " less", false], [22187, 0.035865, " not", false], [31466, 0.026887, " much", false], [57350, 0.022708, " superior", false]]], "model_b": [22590, 17, 0.013834351673722267, [[22187, 0.115123, " not", false], [22525, 0.048876, " sub", false], [52140, 0.047028, " limited", false], [31277, 0.041075, " less", false], [45781, 0.031913, " doomed", false], [56445, 0.028525, " inferior", false], [31458, 0.027171, " more", false], [63631, 0.023184, " ineffective", false], [21325, 0.022757, " bad", false], [53247, 0.022537, " useless", false]]]}, "raw_delta": -0.4921875, "tuned_delta": -0.43933255610180016}, {"byte_start": 178, "byte_end": 183, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 34, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "3.25% 3.25% 3.25% 3.25% 3.25%", "model_b": "5.41% 5.41% 5.41% 5.41% 5.41%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.4079984426498413]], "model_b": [[31461, " most", "normal", 0.2244265377521515]]}, "loss": {"model_a": 3.2545171332553764, "model_b": 5.410106403333612}, "topk": {"model_a": [31461, 1, 0.4079984426498413, [[31461, 0.407998, " most", false], [30273, 0.142053, " best", false], [31581, 0.09945, " only", false], [22752, 0.075336, " way", false], [21952, 0.046729, " key", false], [31580, 0.029141, " ones", false], [31637, 0.021997, " path", false], [39523, 0.012034, " right", false], [38879, 0.009627, " least", false], [31209, 0.00684, " keys", false]]], "model_b": [31461, 1, 0.2244265377521515, [[31461, 0.224427, " most", false], [30273, 0.131602, " best", false], [40229, 0.101791, " wrong", false], [38879, 0.0547, " least", false], [31937, 0.052168, " same", false], [32449, 0.047363, " weak", false], [40217, 0.041684, " worst", false], [31581, 0.025357, " only", false], [22752, 0.015987, " way", false], [39523, 0.008448, " right", false]]]}, "raw_delta": -0.11953124999999998, "tuned_delta": -0.06667630610180016}, {"byte_start": 183, "byte_end": 193, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 35, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"model_a": "3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75%", "model_b": "3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32%"}, "model_tokens": {"model_a": [[59593, " effective", "normal", 0.12430167943239212]], "model_b": [[59593, " effective", "normal", 0.15985460579395294]]}, "loss": {"model_a": 3.7476257898092213, "model_b": 3.324961227048782}, "topk": {"model_a": [59593, 2, 0.12430167943239212, [[56900, 0.413213, " powerful", false], [59593, 0.124302, " effective", false], [59829, 0.098518, " important", false], [60274, 0.089289, " promising", false], [47687, 0.055439, " useful", false], [62603, 0.0374, " successful", false], [57516, 0.025429, " valuable", false], [56290, 0.020602, " fruitful", false], [59594, 0.013327, " efficient", false], [47129, 0.010969, " robust", false]]], "model_b": [59593, 2, 0.15985460579395294, [[56900, 0.254533, " powerful", false], [59593, 0.159855, " effective", false], [59594, 0.068102, " efficient", false], [59829, 0.055225, " important", false], [47687, 0.040186, " useful", false], [57516, 0.0271, " valuable", false], [62603, 0.026859, " successful", false], [60274, 0.022403, " promising", false], [59516, 0.016303, " difficult", false], [57075, 0.015805, " reliable", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07629244389819982}, {"byte_start": 193, "byte_end": 194, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "49.87%", "model_b": "53.26%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.06158022582530975]], "model_b": [[45, ",", "normal", 0.051931943744421005]]}, "loss": {"model_a": 49.87441840573174, "model_b": 53.255734907815246}, "topk": {"model_a": [45, 3, 0.06158022582530975, [[47, 0.351684, ".", false], [22752, 0.205939, " way", false], [45, 0.06158, ",", false], [21700, 0.0384, " for", false], [21265, 0.036802, " and", false], [55532, 0.034852, " approach", false], [31580, 0.028603, " ones", false], [4424, 0.027025, " at", false], [32448, 0.024331, " ways", false], [38989, 0.019759, " means", false]]], "model_b": [45, 3, 0.051931943744421005, [[22752, 0.250825, " way", false], [47, 0.238859, ".", false], [45, 0.051932, ",", false], [32448, 0.050986, " ways", false], [21265, 0.043598, " and", false], [21700, 0.04179, " for", false], [55532, 0.030406, " approach", false], [39979, 0.025233, " tools", false], [52224, 0.022046, " methods", false], [4596, 0.019013, " in", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13464505610180016}, {"byte_start": 194, "byte_end": 198, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 36, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "5.49% 5.49% 5.49% 5.49%", "model_b": "6.80% 6.80% 6.80% 6.80%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.29447421431541443]], "model_b": [[21265, " and", "normal", 0.2203141450881958]]}, "loss": {"model_a": 5.4946393158857, "model_b": 6.797855051063719}, "topk": {"model_a": [21265, 1, 0.29447421431541443, [[21265, 0.294474, " and", false], [21400, 0.134004, " but", false], [40187, 0.098236, " while", false], [30788, 0.069891, " even", false], [22187, 0.028177, " not", false], [53339, 0.023985, " whereas", false], [4423, 0.016691, " as", false], [62461, 0.015659, " regardless", false], [51018, 0.014714, " because", false], [61953, 0.014549, " especially", false]]], "model_b": [21265, 1, 0.2203141450881958, [[21265, 0.220314, " and", false], [21400, 0.117667, " but", false], [30788, 0.075319, " even", false], [40187, 0.04933, " while", false], [62461, 0.039453, " regardless", false], [22187, 0.038911, " not", false], [4423, 0.027971, " as", false], [4692, 0.026028, " no", false], [61953, 0.022519, " especially", false], [51018, 0.022118, " because", false]]]}, "raw_delta": -0.072265625, "tuned_delta": -0.01941068110180018}, {"byte_start": 198, "byte_end": 201, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 37, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "38.89% 38.89% 38.89%", "model_b": "39.45% 39.45% 39.45%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.001551977009512484]], "model_b": [[4450, " by", "normal", 0.001388857839629054]]}, "loss": {"model_a": 38.88513977396034, "model_b": 39.44869252430759}, "topk": {"model_a": [4450, 61, 0.001551977009512484, [[32227, 0.405854, " that", false], [22590, 0.074233, " the", false], [32232, 0.026007, " they", false], [4858, 0.016401, " we", false], [4601, 0.01391, " it", false], [4788, 0.010756, " so", false], [31461, 0.010344, " most", false], [39944, 0.009956, " those", false], [4596, 0.009781, " in", false], [32239, 0.009053, " thus", false]]], "model_b": [4450, 68, 0.001388857839629054, [[32227, 0.293956, " that", false], [22590, 0.123588, " the", false], [32232, 0.032504, " they", false], [21286, 0.024883, " are", false], [4858, 0.017577, " we", false], [21413, 0.015593, " can", false], [39934, 0.015364, " there", false], [39171, 0.014059, " often", false], [22187, 0.013068, " not", false], [47266, 0.013027, " should", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 201, "byte_end": 203, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 38, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "24.09% 24.09%", "model_b": "39.45% 39.45%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.06823011487722397]], "model_b": [[332, " a", "normal", 0.012435732409358025]]}, "loss": {"model_a": 24.091880077344992, "model_b": 39.44869252430759}, "topk": {"model_a": [332, 3, 0.06823011487722397, [[21660, 0.359787, " far", false], [59695, 0.084325, " extension", false], [332, 0.06823, " a", false], [55856, 0.028352, " contrast", false], [22590, 0.026242, " the", false], [21265, 0.024358, " and", false], [63617, 0.024227, " implication", false], [51832, 0.022478, " general", false], [32227, 0.02069, " that", false], [22190, 0.019128, " now", false]]], "model_b": [332, 10, 0.012435732409358025, [[59695, 0.444996, " extension", false], [21660, 0.117038, " far", false], [31461, 0.045813, " most", false], [4692, 0.032471, " no", false], [22590, 0.027286, " the", false], [45717, 0.016046, " design", false], [59856, 0.014158, " inference", false], [61822, 0.013947, " definition", false], [21256, 0.013116, " all", false], [332, 0.012436, " a", false]]]}, "raw_delta": -0.8515625, "tuned_delta": -0.7987075561018002}, {"byte_start": 203, "byte_end": 209, "display": {"text": " large", "kind": "normal"}, "is_word": true, "word_id": 39, "word_key": " large", "bytes_hex": "20 6c 61 72 67 65", "compression": {"model_a": "5.05% 5.05% 5.05% 5.05% 5.05% 5.05%", "model_b": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93%"}, "model_tokens": {"model_a": [[38864, " large", "normal", 0.1883333921432495]], "model_b": [[38864, " large", "normal", 0.19559744000434875]]}, "loss": {"model_a": 5.04849338852746, "model_b": 4.931086565538449}, "topk": {"model_a": [38864, 2, 0.1883333921432495, [[32470, 0.381072, " wide", false], [38864, 0.188333, " large", false], [31323, 0.090698, " long", false], [31118, 0.058908, " huge", false], [32386, 0.042384, " very", false], [63870, 0.038671, " significant", false], [22031, 0.025684, " lot", false], [64313, 0.021783, " considerable", false], [63893, 0.019983, " substantial", false], [21357, 0.017218, " big", false]]], "model_b": [38864, 2, 0.19559744000434875, [[31323, 0.23635, " long", false], [38864, 0.195597, " large", false], [32470, 0.13022, " wide", false], [63870, 0.063665, " significant", false], [22031, 0.057519, " lot", false], [32386, 0.055733, " very", false], [31118, 0.024442, " huge", false], [64313, 0.021317, " considerable", false], [45950, 0.019903, " factor", false], [45954, 0.014321, " fairly", false]]]}, "raw_delta": 0.006510416666666685, "tuned_delta": 0.05936536056486651}, {"byte_start": 209, "byte_end": 216, "display": {"text": " margin", "kind": "normal"}, "is_word": true, "word_id": 40, "word_key": " margin", "bytes_hex": "20 6d 61 72 67 69 6e", "compression": {"model_a": "0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18%", "model_b": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%"}, "model_tokens": {"model_a": [[46513, " margin", "normal", 0.9319722652435303]], "model_b": [[46513, " margin", "normal", 0.9432636499404907]]}, "loss": {"model_a": 0.18114195546875936, "model_b": 0.15032266443414405}, "topk": {"model_a": [46513, 1, 0.9319722652435303, [[46513, 0.931972, " margin", false], [45950, 0.014984, " factor", false], [39189, 0.011322, " order", false], [45157, 0.01066, " amount", false], [45690, 0.005419, " degree", false], [56024, 0.003767, " distance", false], [45865, 0.002853, " enough", false], [61863, 0.002431, " difference", false], [21732, 0.001644, " gap", false], [59977, 0.001481, " magnitude", false]]], "model_b": [46513, 1, 0.9432636499404907, [[46513, 0.943264, " margin", false], [45157, 0.015223, " amount", false], [45690, 0.009404, " degree", false], [45950, 0.004679, " factor", false], [45, 0.002988, ",", false], [52208, 0.002415, " measure", false], [45865, 0.002124, " enough", false], [45939, 0.001674, " extent", false], [56573, 0.00163, " majority", false], [52186, 0.001325, " margins", false]]]}, "raw_delta": 0.001708984375, "tuned_delta": 0.05456392827319982}, {"byte_start": 216, "byte_end": 217, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "2.68%", "model_b": "4.61%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8622329235076904]], "model_b": [[47, ".", "normal", 0.7725769281387329]]}, "loss": {"model_a": 2.6768755641494435, "model_b": 4.61408814346812}, "topk": {"model_a": [47, 1, 0.8622329235076904, [[47, 0.862233, ".", false], [45, 0.068679, ",", false], [59, 0.010867, ":", false], [22590, 0.006439, " the", false], [11, 0.006392, "\n", false], [275, 0.005129, " (", false], [60, 0.00486, ";", false], [261, 0.002899, "\n\n", false], [9816, 0.002847, "—", false], [31601, 0.002392, " over", false]]], "model_b": [47, 1, 0.7725769281387329, [[47, 0.772577, ".", false], [45, 0.163213, ",", false], [22590, 0.013378, " the", false], [59, 0.006773, ":", false], [22898, 0.002667, " —", false], [32227, 0.002532, " that", false], [60, 0.00243, ";", false], [275, 0.002342, " (", false], [11, 0.002097, "\n", false], [31601, 0.001863, " over", false]]]}, "raw_delta": -0.107421875, "tuned_delta": -0.05456693110180018}, {"byte_start": 217, "byte_end": 221, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 41, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55%", "model_b": "12.12% 12.12% 12.12% 12.12%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.07724101096391678]], "model_b": [[20996, " The", "normal", 0.06753067672252655]]}, "loss": {"model_a": 11.55283138211865, "model_b": 12.116384132465903}, "topk": {"model_a": [20996, 2, 0.07724101096391678, [[11, 0.245774, "\n", false], [20996, 0.077241, " The", false], [261, 0.076942, "\n\n", false], [29894, 0.057662, " This", false], [3913, 0.031484, " In", false], [19555, 0.02612, " But", false], [29889, 0.025226, " That", false], [3918, 0.019655, " It", false], [37451, 0.014028, " There", false], [3908, 0.011549, " If", false]]], "model_b": [20996, 3, 0.06753067672252655, [[11, 0.243319, "\n", false], [29894, 0.084448, " This", false], [20996, 0.067531, " The", false], [3913, 0.046246, " In", false], [261, 0.022813, "\n\n", false], [19555, 0.02069, " But", false], [29889, 0.019316, " That", false], [3609, 0.018169, " AI", false], [4331, 0.017245, " We", false], [3918, 0.015961, " It", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 221, "byte_end": 230, "display": {"text": " ultimate", "kind": "normal"}, "is_word": true, "word_id": 42, "word_key": " ultimate", "bytes_hex": "20 75 6c 74 69 6d 61 74 65", "compression": {"model_a": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "model_b": "13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21%"}, "model_tokens": {"model_a": [[57481, " ultimate", "normal", 0.000839363900013268]], "model_b": [[57481, " ultimate", "normal", 0.0013890094123780727]]}, "loss": {"model_a": 14.214052703202896, "model_b": 13.212181147030002}, "topk": {"model_a": [57481, 209, 0.000839363900013268, [[31461, 0.037045, " most", false], [39193, 0.029536, " other", false], [47205, 0.021271, " second", false], [3609, 0.019594, " AI", false], [31581, 0.015879, " only", false], [30273, 0.015863, " best", false], [47009, 0.014167, " reason", false], [38478, 0.011744, " field", false], [51039, 0.011219, " biggest", false], [51929, 0.011215, " history", false]]], "model_b": [57481, 120, 0.0013890094123780727, [[31461, 0.033931, " most", false], [31581, 0.023434, " only", false], [30273, 0.020756, " best", false], [47009, 0.018466, " reason", false], [52569, 0.016887, " problem", false], [3609, 0.016807, " AI", false], [31458, 0.014114, " more", false], [39193, 0.013615, " other", false], [38499, 0.011552, " first", false], [51039, 0.011156, " biggest", false]]]}, "raw_delta": 0.05555555555555558, "tuned_delta": 0.1084104994537554}, {"byte_start": 230, "byte_end": 237, "display": {"text": " reason", "kind": "normal"}, "is_word": true, "word_id": 43, "word_key": " reason", "bytes_hex": "20 72 65 61 73 6f 6e", "compression": {"model_a": "9.98% 9.98% 9.98% 9.98% 9.98% 9.98% 9.98%", "model_b": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"model_a": [[47009, " reason", "normal", 0.020904244855046272]], "model_b": [[47009, " reason", "normal", 0.013261908665299416]]}, "loss": {"model_a": 9.98293443472274, "model_b": 11.110039935417243}, "topk": {"model_a": [47009, 5, 0.020904244855046272, [[46430, 0.160292, " lesson", false], [30985, 0.082412, " goal", false], [32223, 0.032678, " test", false], [53052, 0.028102, " success", false], [47009, 0.020904, " reason", false], [39365, 0.020396, " proof", false], [57009, 0.019322, " question", false], [51668, 0.015807, " example", false], [51708, 0.012401, " failure", false], [3609, 0.012401, " AI", false]]], "model_b": [47009, 10, 0.013261908665299416, [[30985, 0.18847, " goal", false], [46430, 0.053679, " lesson", false], [53052, 0.027886, " success", false], [57009, 0.020206, " question", false], [40093, 0.019083, " value", false], [32223, 0.018961, " test", false], [39339, 0.018817, " power", false], [59281, 0.018468, " challenge", false], [52569, 0.014158, " problem", false], [47009, 0.013262, " reason", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 237, "byte_end": 241, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 44, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "5.74% 5.74% 5.74% 5.74%", "model_b": "3.03% 3.03% 3.03% 3.03%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.28307074308395386]], "model_b": [[21700, " for", "normal", 0.5107178092002869]]}, "loss": {"model_a": 5.741193644162623, "model_b": 3.029096033116476}, "topk": {"model_a": [21700, 1, 0.28307074308395386, [[21700, 0.283071, " for", false], [32227, 0.246567, " that", false], [22763, 0.126859, " why", false], [4600, 0.066469, " is", false], [4858, 0.051601, " we", false], [4811, 0.039463, " to", false], [3609, 0.032758, " AI", false], [22590, 0.018896, " the", false], [32234, 0.013857, " this", false], [45290, 0.011895, " behind", false]]], "model_b": [21700, 1, 0.5107178092002869, [[21700, 0.510718, " for", false], [4600, 0.205497, " is", false], [22763, 0.067882, " why", false], [32227, 0.053406, " that", false], [45290, 0.022385, " behind", false], [4811, 0.016073, " to", false], [32234, 0.014104, " this", false], [4858, 0.01114, " we", false], [45, 0.010105, ",", false], [3609, 0.00923, " AI", false]]]}, "raw_delta": 0.150390625, "tuned_delta": 0.20324556889819984}, {"byte_start": 241, "byte_end": 246, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 45, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "3.21% 3.21% 3.21% 3.21% 3.21%", "model_b": "0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.40920206904411316]], "model_b": [[32234, " this", "normal", 0.7727261185646057]]}, "loss": {"model_a": 3.212250676979332, "model_b": 0.9228176286936239}, "topk": {"model_a": [32234, 1, 0.40920206904411316, [[32234, 0.409202, " this", false], [22590, 0.27502, " the", false], [32227, 0.073391, " that", false], [3609, 0.039339, " AI", false], [53052, 0.018757, " success", false], [22248, 0.010515, " our", false], [21256, 0.006393, " all", false], [56950, 0.005797, " progress", false], [56768, 0.005666, " optimism", false], [51708, 0.005342, " failure", false]]], "model_b": [32234, 1, 0.7727261185646057, [[32234, 0.772726, " this", false], [32227, 0.059621, " that", false], [22590, 0.054127, " the", false], [3609, 0.008292, " AI", false], [39936, 0.007123, " these", false], [39931, 0.005956, " their", false], [53052, 0.005476, " success", false], [40085, 0.003288, " using", false], [22763, 0.00301, " why", false], [22248, 0.002843, " our", false]]]}, "raw_delta": 0.126953125, "tuned_delta": 0.17980806889819984}, {"byte_start": 246, "byte_end": 249, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 46, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "1.76% 1.76% 1.76%", "model_b": "2.28% 2.28% 2.28%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.7477954626083374]], "model_b": [[4600, " is", "normal", 0.680104672908783]]}, "loss": {"model_a": 1.7611023448351601, "model_b": 2.2776923659868076}, "topk": {"model_a": [4600, 1, 0.7477954626083374, [[4600, 0.747795, " is", false], [45, 0.028138, ",", false], [53052, 0.018775, " success", false], [31291, 0.012977, " lies", false], [46430, 0.011119, " lesson", false], [21800, 0.011027, " has", false], [61735, 0.008632, " conclusion", false], [22748, 0.008324, " was", false], [47092, 0.007668, " result", false], [30808, 0.006683, " fact", false]]], "model_b": [4600, 1, 0.680104672908783, [[4600, 0.680105, " is", false], [45, 0.027816, ",", false], [61735, 0.025626, " conclusion", false], [38087, 0.019373, " comes", false], [53052, 0.017097, " success", false], [31291, 0.013708, " lies", false], [21800, 0.009314, " has", false], [22748, 0.008702, " was", false], [21413, 0.006412, " can", false], [63729, 0.006337, " observation", false]]]}, "raw_delta": -0.028645833333333343, "tuned_delta": 0.02420911056486648}, {"byte_start": 249, "byte_end": 255, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 47, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"model_a": "20.29% 20.29% 20.29% 20.29% 20.29% 20.29%", "model_b": "25.55% 25.55% 25.55% 25.55% 25.55% 25.55%"}, "model_tokens": {"model_a": [[37045, " Moore", "normal", 0.0011644504265859723]], "model_b": [[37045, " Moore", "normal", 0.00020921749819535762]]}, "loss": {"model_a": 20.287899012501047, "model_b": 25.547724682408727}, "topk": {"model_a": [37045, 35, 0.0011644504265859723, [[32227, 0.626016, " that", false], [22590, 0.073757, " the", false], [51018, 0.038919, " because", false], [47284, 0.03383, " simple", false], [22187, 0.017466, " not", false], [47285, 0.015647, " simply", false], [332, 0.015521, " a", false], [45, 0.00764, ",", false], [4706, 0.006208, " of", false], [56937, 0.004935, " probably", false]]], "model_b": [37045, 146, 0.00020921749819535762, [[32227, 0.598319, " that", false], [22590, 0.113234, " the", false], [47284, 0.042415, " simple", false], [51018, 0.023947, " because", false], [22187, 0.016884, " not", false], [332, 0.015546, " a", false], [22638, 0.008627, " two", false], [47285, 0.007558, " simply", false], [62555, 0.005519, " simplicity", false], [21572, 0.005444, " due", false]]]}, "raw_delta": -0.29166666666666674, "tuned_delta": -0.2388117227684669}, {"byte_start": 255, "byte_end": 257, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 48, "word_key": "'s", "bytes_hex": "27 73", "compression": {"model_a": "7.64% 7.64%", "model_b": "10.07% 10.07%"}, "model_tokens": {"model_a": [[460, "'s", "normal", 0.4291766285896301]], "model_b": [[460, "'s", "normal", 0.3261600434780121]]}, "loss": {"model_a": 7.643184176584596, "model_b": 10.073505412457116}, "topk": {"model_a": [460, 2, 0.4291766285896301, [[28309, 0.560065, "’s", false], [460, 0.429177, "'s", false], [116, 0.006335, "s", false], [45, 0.000687, ",", false], [21265, 0.000549, " and", false], [9819, 0.000341, "‘", false], [47, 0.000247, ".", false], [46, 0.000225, "-", false], [2496, 0.000148, "â", false], [9222, 0.000132, "´s", false]]], "model_b": [460, 2, 0.3261600434780121, [[28309, 0.669668, "’s", false], [460, 0.32616, "'s", false], [116, 0.001549, "s", false], [9819, 0.000279, "‘", false], [46, 0.000256, "-", false], [45, 0.000179, ",", false], [2496, 0.000162, "â", false], [21265, 0.000144, " and", false], [9222, 0.000129, "´s", false], [9825, 7.3e-05, "‟", false]]]}, "raw_delta": -0.134765625, "tuned_delta": -0.08191068110180018}, {"byte_start": 257, "byte_end": 261, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 49, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"model_a": "4.79% 4.79% 4.79% 4.79%", "model_b": "5.14% 5.14% 5.14% 5.14%"}, "model_tokens": {"model_a": [[21988, " law", "normal", 0.34627750515937805]], "model_b": [[21988, " law", "normal", 0.31862205266952515]]}, "loss": {"model_a": 4.7901983779516355, "model_b": 5.142418846918668}, "topk": {"model_a": [21988, 2, 0.34627750515937805, [[20267, 0.6498, " Law", false], [21988, 0.346278, " law", false], [29262, 0.000347, " Laws", false], [21265, 0.000294, " and", false], [275, 0.000252, " (", false], [31259, 0.000249, " laws", false], [45958, 0.000248, " famous", false], [31907, 0.000135, " rule", false], [53127, 0.000131, " theorem", false], [47205, 0.000112, " second", false]]], "model_b": [21988, 2, 0.31862205266952515, [[20267, 0.654602, " Law", false], [21988, 0.318622, " law", false], [31907, 0.003081, " rule", false], [21265, 0.001755, " and", false], [47205, 0.001491, " second", false], [29701, 0.001256, " Rule", false], [55836, 0.001096, " constant", false], [29262, 0.000901, " Laws", false], [269, 0.000769, " \"", false], [44847, 0.000733, " Second", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03332369389819982}, {"byte_start": 261, "byte_end": 262, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "13.95%", "model_b": "13.74%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.4582744836807251]], "model_b": [[45, ",", "normal", 0.46106842160224915]]}, "loss": {"model_a": 13.947930571094469, "model_b": 13.73659828971425}, "topk": {"model_a": [45, 1, 0.4582744836807251, [[45, 0.458274, ",", false], [59, 0.193715, ":", false], [47, 0.150074, ".", false], [21265, 0.033727, " and", false], [275, 0.02117, " (", false], [9816, 0.019646, "—", false], [60, 0.01641, ";", false], [280, 0.015889, " -", false], [22898, 0.010803, " —", false], [43274, 0.010374, "—the", false]]], "model_b": [45, 1, 0.46106842160224915, [[45, 0.461068, ",", false], [47, 0.204318, ".", false], [59, 0.091937, ":", false], [21265, 0.049159, " and", false], [275, 0.023412, " (", false], [22898, 0.018618, " —", false], [9816, 0.018014, "—", false], [60, 0.016853, ";", false], [40186, 0.01568, " which", false], [22897, 0.010871, " –", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06457369389819982}, {"byte_start": 262, "byte_end": 265, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 50, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "28.37% 28.37% 28.37%", "model_b": "26.11% 26.11% 26.11%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.009043858386576176]], "model_b": [[4715, " or", "normal", 0.012737814337015152]]}, "loss": {"model_a": 28.365488434144982, "model_b": 26.111277432755976}, "topk": {"model_a": [4715, 7, 0.009043858386576176, [[40186, 0.607009, " which", false], [21400, 0.103849, " but", false], [21265, 0.070827, " and", false], [22590, 0.061795, " the", false], [332, 0.017519, " a", false], [32227, 0.01241, " that", false], [4715, 0.009044, " or", false], [4596, 0.008774, " in", false], [340, 0.007927, " i", false], [40185, 0.007017, " where", false]]], "model_b": [4715, 7, 0.012737814337015152, [[40186, 0.595431, " which", false], [22590, 0.087901, " the", false], [21265, 0.069982, " and", false], [332, 0.041623, " a", false], [21400, 0.021335, " but", false], [32227, 0.020823, " that", false], [4715, 0.012738, " or", false], [4596, 0.012053, " in", false], [40185, 0.009988, " where", false], [4423, 0.00856, " as", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17785494389819984}, {"byte_start": 265, "byte_end": 272, "display": {"text": " rather", "kind": "normal"}, "is_word": true, "word_id": 51, "word_key": " rather", "bytes_hex": "20 72 61 74 68 65 72", "compression": {"model_a": "5.72% 5.72% 5.72% 5.72% 5.72% 5.72% 5.72%", "model_b": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%"}, "model_tokens": {"model_a": [[47001, " rather", "normal", 0.10823953151702881]], "model_b": [[47001, " rather", "normal", 0.01163689699023962]]}, "loss": {"model_a": 5.716035039236404, "model_b": 11.512577614236704}, "topk": {"model_a": [47001, 4, 0.10823953151702881, [[22590, 0.226861, " the", false], [31458, 0.1827, " more", false], [4424, 0.113157, " at", false], [47001, 0.10824, " rather", false], [45, 0.042783, ",", false], [4596, 0.029902, " in", false], [332, 0.015563, " a", false], [52448, 0.015363, " perhaps", false], [32074, 0.01319, " some", false], [32227, 0.012687, " that", false]]], "model_b": [47001, 11, 0.01163689699023962, [[22590, 0.508008, " the", false], [37045, 0.06011, " Moore", false], [63563, 0.041474, " exponential", false], [21835, 0.034592, " how", false], [4424, 0.024096, " at", false], [31458, 0.023623, " more", false], [45, 0.016261, ",", false], [332, 0.016219, " a", false], [4596, 0.015859, " in", false], [32227, 0.015779, " that", false]]]}, "raw_delta": -0.32142857142857145, "tuned_delta": -0.2685736275303716}, {"byte_start": 272, "byte_end": 276, "display": {"text": " its", "kind": "normal"}, "is_word": true, "word_id": 52, "word_key": " its", "bytes_hex": "20 69 74 73", "compression": {"model_a": "10.00% 10.00% 10.00% 10.00%", "model_b": "10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"model_a": [[21902, " its", "normal", 0.10679490864276886]], "model_b": [[21902, " its", "normal", 0.08749260753393173]]}, "loss": {"model_a": 10.00306131866371, "model_b": 10.918834537977993}, "topk": {"model_a": [21902, 3, 0.10679490864276886, [[22590, 0.329043, " the", false], [45, 0.287878, ",", false], [21902, 0.106795, " its", false], [332, 0.046495, " a", false], [32227, 0.04548, " that", false], [37045, 0.02159, " Moore", false], [21835, 0.013469, " how", false], [31458, 0.010141, " more", false], [32464, 0.008609, " what", false], [4419, 0.007035, " an", false]]], "model_b": [21902, 3, 0.08749260753393173, [[22590, 0.307025, " the", false], [45, 0.296092, ",", false], [21902, 0.087493, " its", false], [37045, 0.066977, " Moore", false], [332, 0.029275, " a", false], [21835, 0.017293, " how", false], [32227, 0.011625, " that", false], [31458, 0.009777, " more", false], [32464, 0.009433, " what", false], [59, 0.009002, ":", false]]]}, "raw_delta": -0.05078125, "tuned_delta": 0.0020736938981998215}, {"byte_start": 276, "byte_end": 291, "display": {"text": " generalization", "kind": "normal"}, "is_word": true, "word_id": 53, "word_key": " generalization", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 61 74 69 6f 6e", "compression": {"model_a": "6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99%", "model_b": "5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"model_a": [[65135, " generalization", "normal", 0.0029486077837646008]], "model_b": [[65135, " generalization", "normal", 0.009007502347230911]]}, "loss": {"model_a": 6.988054104305918, "model_b": 5.673097686828995}, "topk": {"model_a": [65135, 57, 0.0029486077837646008, [[21458, 0.051642, " cor", false], [52046, 0.038359, " inverse", false], [60588, 0.034426, " successor", false], [45606, 0.028142, " cousin", false], [45828, 0.025015, " effect", false], [63774, 0.019086, " predecessor", false], [63563, 0.018661, " exponential", false], [61841, 0.014703, " derivative", false], [31458, 0.014301, " more", false], [63454, 0.012307, " derivatives", false]]], "model_b": [65135, 16, 0.009007502347230911, [[60588, 0.047284, " successor", false], [51708, 0.027823, " failure", false], [22525, 0.024198, " sub", false], [31237, 0.02372, " lack", false], [55500, 0.018704, " analogue", false], [52046, 0.01832, " inverse", false], [61952, 0.018125, " equivalent", false], [38059, 0.01809, " close", false], [59695, 0.012117, " extension", false], [63774, 0.011978, " predecessor", false]]]}, "raw_delta": 0.07291666666666671, "tuned_delta": 0.12577161056486652}, {"byte_start": 291, "byte_end": 294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 54, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "31.37% 31.37% 31.37%", "model_b": "22.07% 22.07% 22.07%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.005440823268145323]], "model_b": [[4706, " of", "normal", 0.025396397337317467]]}, "loss": {"model_a": 31.371103102663653, "model_b": 22.07248272193401}, "topk": {"model_a": [4706, 18, 0.005440823268145323, [[45, 0.225717, ",", false], [4811, 0.188418, " to", false], [116, 0.142579, "s", false], [59, 0.102158, ":", false], [47, 0.076374, ".", false], [32227, 0.066178, " that", false], [37045, 0.014779, " Moore", false], [4596, 0.012062, " in", false], [30917, 0.010933, " from", false], [31162, 0.010568, " into", false]]], "model_b": [4706, 8, 0.025396397337317467, [[47, 0.193045, ".", false], [45, 0.162158, ",", false], [116, 0.129079, "s", false], [59, 0.124979, ":", false], [4811, 0.088794, " to", false], [32227, 0.059209, " that", false], [4596, 0.025812, " in", false], [4706, 0.025396, " of", false], [30917, 0.021348, " from", false], [4423, 0.017172, " as", false]]]}, "raw_delta": 0.515625, "tuned_delta": 0.5684799438981998}, {"byte_start": 294, "byte_end": 304, "display": {"text": " continued", "kind": "normal"}, "is_word": true, "word_id": 55, "word_key": " continued", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65 64", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[59392, " continued", "normal", 0.0013883133651688695]], "model_b": [[59392, " continued", "normal", 6.133855640655383e-05]]}, "loss": {"model_a": 11.834607757292277, "model_b": 17.47013526076479}, "topk": {"model_a": [59392, 68, 0.0013883133651688695, [[22590, 0.203434, " the", false], [37045, 0.118493, " Moore", false], [269, 0.041593, " \"", false], [63563, 0.040099, " exponential", false], [332, 0.029872, " a", false], [32227, 0.029791, " that", false], [32234, 0.021437, " this", false], [52805, 0.013601, " scaling", false], [4601, 0.010948, " it", false], [62092, 0.01008, " increasing", false]]], "model_b": [59392, 867, 6.133855640655383e-05, [[22590, 0.267069, " the", false], [4601, 0.234722, " it", false], [37045, 0.093576, " Moore", false], [32227, 0.03739, " that", false], [32234, 0.016987, " this", false], [332, 0.016682, " a", false], [21118, 0.010851, " Von", false], [63563, 0.010276, " exponential", false], [269, 0.007642, " \"", false], [22723, 0.006295, " von", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.25964505610180016}, {"byte_start": 304, "byte_end": 318, "display": {"text": " exponentially", "kind": "normal"}, "is_word": true, "word_id": 56, "word_key": " exponentially", "bytes_hex": "20 65 78 70 6f 6e 65 6e 74 69 61 6c 6c 79", "compression": {"model_a": "8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53%", "model_b": "9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22%"}, "model_tokens": {"model_a": [[64911, " exponentially", "normal", 0.00134140660520643]], "model_b": [[64911, " exponentially", "normal", 0.0007888447144068778]]}, "loss": {"model_a": 8.53379879097266, "model_b": 9.218112844965754}, "topk": {"model_a": [64911, 41, 0.00134140660520643, [[63563, 0.533892, " exponential", false], [64423, 0.053977, " improvements", false], [46132, 0.049292, " growth", false], [63621, 0.041512, " improvement", false], [56950, 0.025725, " progress", false], [59847, 0.019737, " increases", false], [56045, 0.015297, " doubling", false], [52805, 0.014461, " scaling", false], [45, 0.012211, ",", false], [62329, 0.011885, " polynomial", false]]], "model_b": [64911, 99, 0.0007888447144068778, [[63563, 0.219346, " exponential", false], [46132, 0.089638, " growth", false], [56950, 0.078458, " progress", false], [63621, 0.050336, " improvement", false], [64423, 0.047048, " improvements", false], [37045, 0.017416, " Moore", false], [60348, 0.017393, " reduction", false], [59847, 0.01561, " increases", false], [65024, 0.015069, " technological", false], [39441, 0.013946, " rapid", false]]]}, "raw_delta": -0.0379464285714286, "tuned_delta": 0.014908515326771218}, {"byte_start": 318, "byte_end": 326, "display": {"text": " falling", "kind": "normal"}, "is_word": true, "word_id": 57, "word_key": " falling", "bytes_hex": "20 66 61 6c 6c 69 6e 67", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[51709, " falling", "normal", 0.00530181173235178]], "model_b": [[51709, " falling", "normal", 0.00042826199205592275]]}, "loss": {"model_a": 11.834607757292277, "model_b": 17.47013526076479}, "topk": {"model_a": [51709, 18, 0.00530181173235178, [[62092, 0.382384, " increasing", false], [46, 0.11616, "-", false], [51876, 0.09648, " growing", false], [61816, 0.07686, " decreasing", false], [45961, 0.035576, " faster", false], [64230, 0.02689, " accelerating", false], [59832, 0.025235, " improving", false], [47122, 0.022956, " rising", false], [46132, 0.020613, " growth", false], [52805, 0.016428, " scaling", false]]], "model_b": [51709, 90, 0.00042826199205592275, [[62092, 0.181275, " increasing", false], [46, 0.109521, "-", false], [52805, 0.086499, " scaling", false], [46132, 0.082512, " growth", false], [51876, 0.073124, " growing", false], [61816, 0.052311, " decreasing", false], [47122, 0.041588, " rising", false], [59832, 0.032673, " improving", false], [63621, 0.026424, " improvement", false], [56045, 0.026057, " doubling", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.25964505610180016}, {"byte_start": 326, "byte_end": 331, "display": {"text": " cost", "kind": "normal"}, "is_word": true, "word_id": 58, "word_key": " cost", "bytes_hex": "20 63 6f 73 74", "compression": {"model_a": "8.06% 8.06% 8.06% 8.06% 8.06%", "model_b": "9.35% 9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"model_a": [[30510, " cost", "normal", 0.10696844011545181]], "model_b": [[30510, " cost", "normal", 0.07550650835037231]]}, "loss": {"model_a": 8.058804329965694, "model_b": 9.354975655764372}, "topk": {"model_a": [30510, 2, 0.10696844011545181, [[38124, 0.47967, " costs", false], [30510, 0.106968, " cost", false], [45860, 0.039326, " energy", false], [56353, 0.033381, " hardware", false], [46900, 0.029881, " prices", false], [62659, 0.019805, " transistor", false], [39339, 0.018366, " power", false], [22278, 0.016944, " per", false], [32343, 0.015495, " unit", false], [30442, 0.015334, " chip", false]]], "model_b": [30510, 2, 0.07550650835037231, [[38124, 0.172323, " costs", false], [30510, 0.075507, " cost", false], [56353, 0.046071, " hardware", false], [46900, 0.042761, " prices", false], [62634, 0.030982, " technology", false], [63750, 0.030516, " performance", false], [64957, 0.03028, " manufacturing", false], [52805, 0.029751, " scaling", false], [39349, 0.023285, " price", false], [62382, 0.022026, " production", false]]]}, "raw_delta": -0.07187500000000002, "tuned_delta": -0.0190200561018002}, {"byte_start": 331, "byte_end": 335, "display": {"text": " per", "kind": "normal"}, "is_word": true, "word_id": 59, "word_key": " per", "bytes_hex": "20 70 65 72", "compression": {"model_a": "3.65% 3.65% 3.65% 3.65%", "model_b": "8.00% 8.00% 8.00% 8.00%"}, "model_tokens": {"model_a": [[22278, " per", "normal", 0.4464338421821594]], "model_b": [[22278, " per", "normal", 0.1713150441646576]]}, "loss": {"model_a": 3.6454818538087816, "model_b": 7.995404645551628}, "topk": {"model_a": [22278, 1, 0.4464338421821594, [[22278, 0.446434, " per", false], [4706, 0.112915, " of", false], [47, 0.099172, ".", false], [45, 0.0543, ",", false], [21700, 0.048796, " for", false], [46, 0.025555, "-", false], [21265, 0.025132, " and", false], [45644, 0.024696, " curves", false], [4811, 0.020444, " to", false], [48, 0.018441, "/", false]]], "model_b": [22278, 2, 0.1713150441646576, [[47, 0.274977, ".", false], [22278, 0.171315, " per", false], [4706, 0.151417, " of", false], [21265, 0.071516, " and", false], [45, 0.05656, ",", false], [21700, 0.039314, " for", false], [4596, 0.026064, " in", false], [59, 0.015774, ":", false], [4423, 0.014906, " as", false], [62450, 0.01302, " reductions", false]]]}, "raw_delta": -0.2412109375, "tuned_delta": -0.18835599360180016}, {"byte_start": 335, "byte_end": 340, "display": {"text": " unit", "kind": "normal"}, "is_word": true, "word_id": 60, "word_key": " unit", "bytes_hex": "20 75 6e 69 74", "compression": {"model_a": "4.20% 4.20% 4.20% 4.20% 4.20%", "model_b": "7.83% 7.83% 7.83% 7.83% 7.83%"}, "model_tokens": {"model_a": [[32343, " unit", "normal", 0.3136623799800873]], "model_b": [[32343, " unit", "normal", 0.1165042296051979]]}, "loss": {"model_a": 4.198467990087022, "model_b": 7.833383229826793}, "topk": {"model_a": [32343, 1, 0.3136623799800873, [[32343, 0.313662, " unit", false], [62659, 0.095338, " transistor", false], [63370, 0.093032, " computation", false], [21365, 0.059525, " bit", false], [3806, 0.043206, " FL", false], [64862, 0.0369, " computational", false], [60096, 0.036174, " operation", false], [59346, 0.026212, " computing", false], [51266, 0.021544, " compute", false], [63750, 0.01747, " performance", false]]], "model_b": [32343, 2, 0.1165042296051979, [[62659, 0.248872, " transistor", false], [32343, 0.116504, " unit", false], [30442, 0.070824, " chip", false], [21365, 0.056372, " bit", false], [60262, 0.054942, " processor", false], [62378, 0.035549, " processing", false], [39018, 0.030174, " micro", false], [19602, 0.018667, " CPU", false], [63370, 0.017128, " computation", false], [59346, 0.013348, " computing", false]]]}, "raw_delta": -0.2015625, "tuned_delta": -0.1487075561018002}, {"byte_start": 340, "byte_end": 343, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 61, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "3.15% 3.15% 3.15%", "model_b": "3.69% 3.69% 3.69%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.590901792049408]], "model_b": [[4706, " of", "normal", 0.538613498210907]]}, "loss": {"model_a": 3.146502856105486, "model_b": 3.6865742418549354}, "topk": {"model_a": [4706, 1, 0.590901792049408, [[4706, 0.590902, " of", false], [47, 0.089568, ".", false], [32251, 0.064605, " time", false], [45, 0.037328, ",", false], [63370, 0.031465, " computation", false], [59346, 0.01104, " computing", false], [63750, 0.009916, " performance", false], [275, 0.007623, " (", false], [55686, 0.007393, " capacity", false], [64862, 0.00677, " computational", false]]], "model_b": [4706, 1, 0.538613498210907, [[4706, 0.538613, " of", false], [47, 0.063815, ".", false], [63370, 0.048996, " computation", false], [32251, 0.044386, " time", false], [62378, 0.042578, " processing", false], [64862, 0.024995, " computational", false], [30173, 0.017314, " area", false], [46543, 0.01227, " memory", false], [45, 0.008986, ",", false], [63750, 0.008448, " performance", false]]]}, "raw_delta": -0.029947916666666685, "tuned_delta": 0.022907027231533136}, {"byte_start": 343, "byte_end": 355, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 62, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63%", "model_b": "2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.3352624475955963]], "model_b": [[63370, " computation", "normal", 0.22751452028751373]]}, "loss": {"model_a": 1.631954839547248, "model_b": 2.218988954492302}, "topk": {"model_a": [63370, 1, 0.3352624475955963, [[63370, 0.335262, " computation", false], [59346, 0.173968, " computing", false], [51266, 0.081661, " compute", false], [64862, 0.0574, " computational", false], [63750, 0.043529, " performance", false], [62378, 0.035916, " processing", false], [39339, 0.019597, " power", false], [63637, 0.017141, " information", false], [55686, 0.015188, " capacity", false], [61654, 0.013926, " capability", false]]], "model_b": [63370, 1, 0.22751452028751373, [[63370, 0.227515, " computation", false], [62378, 0.097376, " processing", false], [64862, 0.067754, " computational", false], [59346, 0.063572, " computing", false], [51266, 0.051858, " compute", false], [63750, 0.03558, " performance", false], [39339, 0.031426, " power", false], [52905, 0.030223, " silicon", false], [56353, 0.030027, " hardware", false], [32251, 0.026692, " time", false]]]}, "raw_delta": -0.03255208333333332, "tuned_delta": 0.0203028605648665}, {"byte_start": 355, "byte_end": 356, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "9.51%", "model_b": "8.70%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5903587937355042]], "model_b": [[47, ".", "normal", 0.6192847490310669]]}, "loss": {"model_a": 9.509952662109866, "model_b": 8.699845583485692}, "topk": {"model_a": [47, 1, 0.5903587937355042, [[47, 0.590359, ".", false], [45, 0.158084, ",", false], [275, 0.035531, " (", false], [31601, 0.029962, " over", false], [21265, 0.021302, " and", false], [59, 0.019519, ":", false], [39339, 0.013583, " power", false], [4811, 0.011429, " to", false], [4423, 0.008042, " as", false], [60, 0.007502, ";", false]]], "model_b": [47, 1, 0.6192847490310669, [[47, 0.619285, ".", false], [45, 0.086218, ",", false], [39339, 0.044029, " power", false], [275, 0.029323, " (", false], [59, 0.018836, ":", false], [22278, 0.018566, " per", false], [21265, 0.017655, " and", false], [32251, 0.01705, " time", false], [4423, 0.01474, " as", false], [32227, 0.012765, " that", false]]]}, "raw_delta": 0.044921875, "tuned_delta": 0.09777681889819982}, {"byte_start": 356, "byte_end": 361, "display": {"text": " Most", "kind": "normal"}, "is_word": true, "word_id": 63, "word_key": " most", "bytes_hex": "20 4d 6f 73 74", "compression": {"model_a": "21.75% 21.75% 21.75% 21.75% 21.75%", "model_b": "22.77% 22.77% 22.77% 22.77% 22.77%"}, "model_tokens": {"model_a": [[29425, " Most", "normal", 0.002402838319540024]], "model_b": [[29425, " Most", "normal", 0.001813532435335219]]}, "loss": {"model_a": 21.7531361634039, "model_b": 22.76753111402895}, "topk": {"model_a": [29425, 50, 0.002402838319540024, [[11, 0.156923, "\n", false], [20996, 0.102468, " The", false], [29894, 0.092229, " This", false], [261, 0.051479, "\n\n", false], [19555, 0.037603, " But", false], [3913, 0.034827, " In", false], [37045, 0.03449, " Moore", false], [3918, 0.026954, " It", false], [3641, 0.025934, " As", false], [3908, 0.023031, " If", false]]], "model_b": [29425, 60, 0.001813532435335219, [[11, 0.248197, "\n", false], [29894, 0.088336, " This", false], [20996, 0.079691, " The", false], [37045, 0.042153, " Moore", false], [3913, 0.038288, " In", false], [261, 0.037347, "\n\n", false], [3918, 0.021361, " It", false], [3641, 0.020984, " As", false], [37564, 0.014825, " While", false], [19555, 0.014556, " But", false]]]}, "raw_delta": -0.05624999999999991, "tuned_delta": -0.0033950561018000897}, {"byte_start": 361, "byte_end": 364, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 64, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "13.06% 13.06% 13.06%", "model_b": "13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.11309946328401566]], "model_b": [[3609, " AI", "normal", 0.10222864151000977]]}, "loss": {"model_a": 13.055638716377988, "model_b": 13.713116925116447}, "topk": {"model_a": [3609, 2, 0.11309946328401566, [[4706, 0.300896, " of", false], [3609, 0.113099, " AI", false], [46787, 0.065684, " people", false], [39193, 0.040574, " other", false], [52224, 0.027826, " methods", false], [57103, 0.022186, " research", false], [63843, 0.010703, " researchers", false], [52167, 0.010206, " machine", false], [63619, 0.008297, " importantly", false], [46588, 0.008013, " modern", false]]], "model_b": [3609, 2, 0.10222864151000977, [[4706, 0.256989, " of", false], [3609, 0.102229, " AI", false], [46787, 0.054001, " people", false], [39193, 0.043361, " other", false], [57103, 0.018363, " research", false], [51832, 0.013115, " general", false], [63843, 0.012691, " researchers", false], [52167, 0.011768, " machine", false], [47014, 0.010898, " recent", false], [2030, 0.009827, "ly", false]]]}, "raw_delta": -0.03645833333333326, "tuned_delta": 0.016396610564866562}, {"byte_start": 364, "byte_end": 373, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 65, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "model_b": "2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.23477506637573242]], "model_b": [[57103, " research", "normal", 0.23750528693199158]]}, "loss": {"model_a": 2.880380723997062, "model_b": 2.896034967062264}, "topk": {"model_a": [57103, 1, 0.23477506637573242, [[57103, 0.234775, " research", false], [63843, 0.205854, " researchers", false], [52224, 0.076775, " methods", false], [53087, 0.062929, " systems", false], [62633, 0.028286, " techniques", false], [32499, 0.025006, " work", false], [56950, 0.020673, " progress", false], [64251, 0.018293, " applications", false], [61559, 0.014075, " algorithms", false], [4600, 0.014028, " is", false]]], "model_b": [57103, 1, 0.23750528693199158, [[57103, 0.237505, " research", false], [63843, 0.142287, " researchers", false], [53087, 0.076786, " systems", false], [52224, 0.075276, " methods", false], [62633, 0.029192, " techniques", false], [61559, 0.025899, " algorithms", false], [4600, 0.025097, " is", false], [61590, 0.021385, " approaches", false], [46587, 0.015838, " models", false], [32499, 0.014671, " work", false]]]}, "raw_delta": -0.0008680555555555802, "tuned_delta": 0.05198688834264424}, {"byte_start": 373, "byte_end": 377, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 66, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"model_a": "7.26% 7.26% 7.26% 7.26%", "model_b": "7.54% 7.54% 7.54% 7.54%"}, "model_tokens": {"model_a": [[21800, " has", "normal", 0.19905588030815125]], "model_b": [[21800, " has", "normal", 0.18908379971981049]]}, "loss": {"model_a": 7.25574166072086, "model_b": 7.537518035894486}, "topk": {"model_a": [21800, 1, 0.19905588030815125, [[21800, 0.199056, " has", false], [4600, 0.110434, " is", false], [45, 0.048918, ",", false], [4596, 0.04218, " in", false], [39971, 0.037385, " today", false], [31601, 0.02671, " over", false], [32227, 0.026028, " that", false], [56952, 0.024967, " projects", false], [51566, 0.020464, " efforts", false], [39690, 0.015216, " since", false]]], "model_b": [21800, 1, 0.18908379971981049, [[21800, 0.189084, " has", false], [4600, 0.112842, " is", false], [39971, 0.045574, " today", false], [4596, 0.044151, " in", false], [45, 0.043948, ",", false], [51771, 0.022605, " focuses", false], [31601, 0.022531, " over", false], [32227, 0.016201, " that", false], [46750, 0.015786, " papers", false], [21265, 0.015578, " and", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 377, "byte_end": 382, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 67, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"model_a": "4.03% 4.03% 4.03% 4.03% 4.03%", "model_b": "4.68% 4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"model_a": [[30259, " been", "normal", 0.3273267447948456]], "model_b": [[30259, " been", "normal", 0.2724875509738922]]}, "loss": {"model_a": 4.029402164982847, "model_b": 4.677487827882186}, "topk": {"model_a": [30259, 1, 0.3273267447948456, [[30259, 0.327327, " been", false], [51770, 0.165536, " focused", false], [45953, 0.023937, " failed", false], [22187, 0.019842, " not", false], [40013, 0.018844, " tried", false], [39887, 0.017652, " taken", false], [56255, 0.014978, " followed", false], [64300, 0.012869, " concentrated", false], [51960, 0.010051, " ignored", false], [56500, 0.009962, " involved", false]]], "model_b": [30259, 1, 0.2724875509738922, [[30259, 0.272488, " been", false], [51770, 0.188777, " focused", false], [56255, 0.026269, " followed", false], [22187, 0.016309, " not", false], [47054, 0.013667, " relied", false], [45150, 0.013612, " always", false], [39887, 0.012542, " taken", false], [39071, 0.011197, " moved", false], [32354, 0.010605, " used", false], [30991, 0.009535, " gone", false]]]}, "raw_delta": -0.03593750000000001, "tuned_delta": 0.01691744389819981}, {"byte_start": 382, "byte_end": 392, "display": {"text": " conducted", "kind": "normal"}, "is_word": true, "word_id": 68, "word_key": " conducted", "bytes_hex": "20 63 6f 6e 64 75 63 74 65 64", "compression": {"model_a": "6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93%", "model_b": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%"}, "model_tokens": {"model_a": [[59355, " conducted", "normal", 0.021404659375548363]], "model_b": [[59355, " conducted", "normal", 0.010643674060702324]]}, "loss": {"model_a": 6.93169882927119, "model_b": 8.171514880035144}, "topk": {"model_a": [59355, 10, 0.021404659375548363, [[51770, 0.113657, " focused", false], [30666, 0.059338, " done", false], [45796, 0.034895, " driven", false], [51459, 0.032573, " devoted", false], [4712, 0.032464, " on", false], [37810, 0.031082, " based", false], [37598, 0.028814, " about", false], [4596, 0.026769, " in", false], [332, 0.025411, " a", false], [59355, 0.021405, " conducted", false]]], "model_b": [59355, 17, 0.010643674060702324, [[51770, 0.136989, " focused", false], [45796, 0.124348, " driven", false], [37598, 0.047849, " about", false], [37810, 0.030493, " based", false], [51459, 0.029887, " devoted", false], [30666, 0.026724, " done", false], [59349, 0.013962, " concerned", false], [4596, 0.013936, " in", false], [55706, 0.01344, " centered", false], [56002, 0.0128, " directed", false]]]}, "raw_delta": -0.06874999999999998, "tuned_delta": -0.015895056101800156}, {"byte_start": 392, "byte_end": 395, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 69, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "32.12% 32.12% 32.12%", "model_b": "21.79% 21.79% 21.79%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.004767954349517822]], "model_b": [[4423, " as", "normal", 0.02681073360145092]]}, "loss": {"model_a": 32.122506769793326, "model_b": 21.79070634676038}, "topk": {"model_a": [4423, 16, 0.004767954349517822, [[4712, 0.228413, " on", false], [4596, 0.221283, " in", false], [32487, 0.113329, " with", false], [40085, 0.09213, " using", false], [4450, 0.080245, " by", false], [47806, 0.044567, " within", false], [4424, 0.030896, " at", false], [40062, 0.030419, " under", false], [31601, 0.014079, " over", false], [4811, 0.010426, " to", false]]], "model_b": [4423, 10, 0.02681073360145092, [[4596, 0.215994, " in", false], [4712, 0.140479, " on", false], [32487, 0.101656, " with", false], [40085, 0.074271, " using", false], [4450, 0.059113, " by", false], [40062, 0.056369, " under", false], [4424, 0.052032, " at", false], [4811, 0.035761, " to", false], [47806, 0.027429, " within", false], [4423, 0.026811, " as", false]]]}, "raw_delta": 0.5729166666666667, "tuned_delta": 0.6257716105648665}, {"byte_start": 395, "byte_end": 398, "display": {"text": " if", "kind": "normal"}, "is_word": true, "word_id": 70, "word_key": " if", "bytes_hex": "20 69 66", "compression": {"model_a": "10.33% 10.33% 10.33%", "model_b": "18.50% 18.50% 18.50%"}, "model_tokens": {"model_a": [[4588, " if", "normal", 0.1799420863389969]], "model_b": [[4588, " if", "normal", 0.046107854694128036]]}, "loss": {"model_a": 10.33180042303294, "model_b": 18.503315303068085}, "topk": {"model_a": [4588, 2, 0.1799420863389969, [[332, 0.314913, " a", false], [4588, 0.179942, " if", false], [4419, 0.125067, " an", false], [31633, 0.060418, " part", false], [47544, 0.054061, " though", false], [22590, 0.018057, " the", false], [269, 0.012355, " \"", false], [50937, 0.00699, " applied", false], [63625, 0.006962, " incremental", false], [32074, 0.006714, " some", false]]], "model_b": [4588, 4, 0.046107854694128036, [[332, 0.412543, " a", false], [4419, 0.130427, " an", false], [31633, 0.118349, " part", false], [4588, 0.046108, " if", false], [22590, 0.019729, " the", false], [45833, 0.010648, " either", false], [51832, 0.006795, " general", false], [269, 0.006672, " \"", false], [63625, 0.00615, " incremental", false], [64498, 0.005087, " optimization", false]]]}, "raw_delta": -0.45312500000000017, "tuned_delta": -0.40027005610180033}, {"byte_start": 398, "byte_end": 402, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 71, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.89% 7.89% 7.89% 7.89%", "model_b": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.17593203485012054]], "model_b": [[22590, " the", "normal", 0.14814676344394684]]}, "loss": {"model_a": 7.889738504861517, "model_b": 8.594179442795582}, "topk": {"model_a": [22590, 1, 0.17593203485012054, [[22590, 0.175932, " the", false], [32234, 0.094406, " this", false], [4858, 0.084822, " we", false], [4601, 0.083783, " it", false], [39934, 0.07107, " there", false], [37045, 0.052927, " Moore", false], [3609, 0.033823, " AI", false], [22226, 0.023733, " one", false], [63370, 0.022286, " computation", false], [51832, 0.016034, " general", false]]], "model_b": [22590, 1, 0.14814676344394684, [[22590, 0.148147, " the", false], [37045, 0.098204, " Moore", false], [4601, 0.090299, " it", false], [4858, 0.087942, " we", false], [32234, 0.086118, " this", false], [63370, 0.058549, " computation", false], [39934, 0.037254, " there", false], [59346, 0.027911, " computing", false], [3609, 0.025707, " AI", false], [332, 0.02352, " a", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.013792443898199822}, {"byte_start": 402, "byte_end": 414, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 72, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95%", "model_b": "6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.009839637205004692]], "model_b": [[63370, " computation", "normal", 0.01650926284492016]]}, "loss": {"model_a": 6.9504839209494325, "model_b": 6.1521175246241615}, "topk": {"model_a": [63370, 15, 0.009839637205004692, [[30510, 0.172588, " cost", false], [31581, 0.049574, " only", false], [30985, 0.034634, " goal", false], [52569, 0.028658, " problem", false], [64862, 0.026054, " computational", false], [40213, 0.0241, " world", false], [57481, 0.015938, " ultimate", false], [56353, 0.014672, " hardware", false], [38124, 0.013456, " costs", false], [31356, 0.012289, " main", false]]], "model_b": [63370, 10, 0.01650926284492016, [[30510, 0.095202, " cost", false], [30985, 0.030291, " goal", false], [31581, 0.023738, " only", false], [37045, 0.023383, " Moore", false], [57481, 0.021478, " ultimate", false], [40213, 0.020808, " world", false], [51832, 0.019904, " general", false], [64862, 0.018084, " computational", false], [52167, 0.017948, " machine", false], [63370, 0.016509, " computation", false]]]}, "raw_delta": 0.04427083333333337, "tuned_delta": 0.09712577723153319}, {"byte_start": 414, "byte_end": 424, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 73, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02%", "model_b": "10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.020406221970915794]], "model_b": [[59206, " available", "normal", 0.0028407196514308453]]}, "loss": {"model_a": 7.016231741823279, "model_b": 10.594791706528326}, "topk": {"model_a": [59206, 10, 0.020406221970915794, [[22748, 0.22568, " was", false], [4600, 0.103583, " is", false], [32462, 0.088636, " were", false], [30510, 0.065532, " cost", false], [40219, 0.047903, " would", false], [38128, 0.032357, " could", false], [46342, 0.031699, " itself", false], [4706, 0.021215, " of", false], [52569, 0.020689, " problem", false], [59206, 0.020406, " available", false]]], "model_b": [59206, 53, 0.0028407196514308453, [[30510, 0.103272, " cost", false], [4600, 0.097031, " is", false], [38124, 0.064815, " costs", false], [22748, 0.055678, " was", false], [46, 0.042428, "-", false], [4706, 0.039195, " of", false], [46650, 0.0302, " needed", false], [39339, 0.028116, " power", false], [61643, 0.026583, " bottleneck", false], [32462, 0.015819, " were", false]]]}, "raw_delta": -0.19843750000000004, "tuned_delta": -0.1455825561018002}, {"byte_start": 424, "byte_end": 427, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 74, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "7.14% 7.14% 7.14%", "model_b": "7.94% 7.94% 7.94%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.30386364459991455]], "model_b": [[4811, " to", "normal", 0.26666611433029175]]}, "loss": {"model_a": 7.138334837731849, "model_b": 7.936701234057122}, "topk": {"model_a": [4811, 1, 0.30386364459991455, [[4811, 0.303864, " to", false], [22748, 0.147861, " was", false], [32462, 0.121029, " were", false], [4600, 0.094718, " is", false], [21700, 0.090032, " for", false], [40219, 0.033777, " would", false], [4596, 0.03114, " in", false], [39971, 0.024681, " today", false], [4712, 0.02147, " on", false], [4424, 0.014831, " at", false]]], "model_b": [4811, 1, 0.26666611433029175, [[4811, 0.266666, " to", false], [4600, 0.179903, " is", false], [39971, 0.175317, " today", false], [22748, 0.066229, " was", false], [21700, 0.050174, " for", false], [4424, 0.041636, " at", false], [4596, 0.031317, " in", false], [4712, 0.019694, " on", false], [32462, 0.01699, " were", false], [21800, 0.015286, " has", false]]]}, "raw_delta": -0.04427083333333337, "tuned_delta": 0.008584110564866451}, {"byte_start": 427, "byte_end": 431, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 75, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.27% 11.27% 11.27% 11.27%", "model_b": "8.77% 8.77% 8.77% 8.77%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.0834406390786171]], "model_b": [[22590, " the", "normal", 0.14242425560951233]]}, "loss": {"model_a": 11.271055006945026, "model_b": 8.770289677279099}, "topk": {"model_a": [22590, 4, 0.0834406390786171, [[63843, 0.189921, " researchers", false], [3609, 0.134564, " AI", false], [4835, 0.092733, " us", false], [22590, 0.083441, " the", false], [4601, 0.06669, " it", false], [39740, 0.050189, " solve", false], [332, 0.043008, " a", false], [46227, 0.031322, " humans", false], [4419, 0.023586, " an", false], [4491, 0.017823, " do", false]]], "model_b": [22590, 2, 0.14242425560951233, [[4835, 0.293193, " us", false], [22590, 0.142424, " the", false], [63843, 0.062914, " researchers", false], [332, 0.062103, " a", false], [3609, 0.051944, " AI", false], [4435, 0.032936, " be", false], [4419, 0.031147, " an", false], [4601, 0.020131, " it", false], [32229, 0.018733, " them", false], [22799, 0.015655, " you", false]]]}, "raw_delta": 0.138671875, "tuned_delta": 0.19152681889819984}, {"byte_start": 431, "byte_end": 437, "display": {"text": " agent", "kind": "normal"}, "is_word": true, "word_id": 76, "word_key": " agent", "bytes_hex": "20 61 67 65 6e 74", "compression": {"model_a": "14.75% 14.75% 14.75% 14.75% 14.75% 14.75%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[37636, " agent", "normal", 0.007329931017011404]], "model_b": [[37636, " agent", "normal", 0.0029966472648084164]]}, "loss": {"model_a": 14.746296967419742, "model_b": 17.47013526076479}, "topk": {"model_a": [37636, 15, 0.007329931017011404, [[3609, 0.237394, " AI", false], [62496, 0.201397, " researcher", false], [63843, 0.14845, " researchers", false], [57103, 0.039237, " research", false], [52569, 0.033937, " problem", false], [59113, 0.022737, " algorithm", false], [52581, 0.01908, " project", false], [47487, 0.017301, " system", false], [38478, 0.01629, " field", false], [40213, 0.012288, " world", false]]], "model_b": [37636, 37, 0.0029966472648084164, [[62496, 0.161237, " researcher", false], [63843, 0.13496, " researchers", false], [3609, 0.132122, " AI", false], [57103, 0.039921, " research", false], [32355, 0.036655, " user", false], [38720, 0.026195, " human", false], [52167, 0.023267, " machine", false], [60455, 0.020888, " scientist", false], [59324, 0.020833, " community", false], [39043, 0.016283, " model", false]]]}, "raw_delta": -0.15104166666666663, "tuned_delta": -0.09818672276846681}, {"byte_start": 437, "byte_end": 442, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 77, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "6.62% 6.62% 6.62% 6.62% 6.62%", "model_b": "14.99% 14.99% 14.99% 14.99% 14.99%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.15815630555152893]], "model_b": [[32462, " were", "normal", 0.015663277357816696]]}, "loss": {"model_a": 6.621744816580202, "model_b": 14.990503159236885}, "topk": {"model_a": [32462, 3, 0.15815630555152893, [[22748, 0.264146, " was", false], [4600, 0.212517, " is", false], [32462, 0.158156, " were", false], [40219, 0.067744, " would", false], [38128, 0.037015, " could", false], [4596, 0.016802, " in", false], [32475, 0.014482, " will", false], [275, 0.014213, " (", false], [21265, 0.013976, " and", false], [45, 0.011533, ",", false]]], "model_b": [32462, 7, 0.015663277357816696, [[4600, 0.481387, " is", false], [22748, 0.201778, " was", false], [275, 0.02305, " (", false], [32475, 0.020294, " will", false], [4596, 0.017475, " in", false], [21800, 0.01592, " has", false], [32462, 0.015663, " were", false], [40219, 0.012704, " would", false], [4715, 0.012014, " or", false], [21265, 0.011647, " and", false]]]}, "raw_delta": -0.4640625, "tuned_delta": -0.41120755610180015}, {"byte_start": 442, "byte_end": 451, "display": {"text": " constant", "kind": "normal"}, "is_word": true, "word_id": 78, "word_key": " constant", "bytes_hex": "20 63 6f 6e 73 74 61 6e 74", "compression": {"model_a": "7.11% 7.11% 7.11% 7.11% 7.11% 7.11% 7.11% 7.11% 7.11%", "model_b": "7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51%"}, "model_tokens": {"model_a": [[55836, " constant", "normal", 0.028594616800546646]], "model_b": [[55836, " constant", "normal", 0.02354644052684307]]}, "loss": {"model_a": 7.107026351601448, "model_b": 7.514036671296683}, "topk": {"model_a": [55836, 7, 0.028594616800546646, [[38501, 0.174632, " fixed", false], [56447, 0.121853, " infinite", false], [60706, 0.086399, " unlimited", false], [332, 0.049952, " a", false], [30911, 0.049789, " free", false], [22590, 0.035286, " the", false], [55836, 0.028595, " constant", false], [63507, 0.027384, " effectively", false], [52140, 0.022027, " limited", false], [22187, 0.018444, " not", false]]], "model_b": [55836, 9, 0.02354644052684307, [[56447, 0.045464, " infinite", false], [22590, 0.04208, " the", false], [38501, 0.041296, " fixed", false], [52140, 0.040936, " limited", false], [332, 0.036065, " a", false], [60706, 0.035398, " unlimited", false], [4811, 0.030699, " to", false], [52951, 0.027278, " somehow", false], [55836, 0.023546, " constant", false], [22187, 0.01572, " not", false]]]}, "raw_delta": -0.022569444444444475, "tuned_delta": 0.030285499453755346}, {"byte_start": 451, "byte_end": 453, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "30.71% 30.71%", "model_b": "30.43% 30.43%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.033619675785303116]], "model_b": [[275, " (", "normal", 0.034951068460941315]]}, "loss": {"model_a": 30.713624893925193, "model_b": 30.43184851875157}, "topk": {"model_a": [275, 5, 0.033619675785303116, [[45, 0.500555, ",", false], [47, 0.230461, ".", false], [60, 0.042696, ";", false], [4715, 0.036823, " or", false], [275, 0.03362, " (", false], [21265, 0.033529, " and", false], [31601, 0.025912, " over", false], [4596, 0.013984, " in", false], [59, 0.007075, ":", false], [21700, 0.006553, " for", false]]], "model_b": [275, 4, 0.034951068460941315, [[45, 0.391801, ",", false], [47, 0.196286, ".", false], [21265, 0.143474, " and", false], [275, 0.034951, " (", false], [4596, 0.026735, " in", false], [60, 0.019542, ";", false], [4715, 0.018244, " or", false], [9816, 0.016237, "—", false], [31601, 0.014301, " over", false], [62650, 0.010546, " throughout", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06847994389819982}, {"byte_start": 453, "byte_end": 455, "display": {"text": "in", "kind": "normal"}, "is_word": true, "word_id": 79, "word_key": "in", "bytes_hex": "69 6e", "compression": {"model_a": "27.75% 27.75%", "model_b": "31.84% 31.84%"}, "model_tokens": {"model_a": [[1950, "in", "normal", 0.04581916704773903]], "model_b": [[1950, "in", "normal", 0.02932688780128956]]}, "loss": {"model_a": 27.754972954602124, "model_b": 31.840730394619698}, "topk": {"model_a": [1950, 4, 0.04581916704773903, [[2101, 0.252587, "or", false], [7005, 0.064822, "and", false], [106, 0.04752, "i", false], [1950, 0.045819, "in", false], [36003, 0.032701, "which", false], [98, 0.030352, "a", false], [102, 0.028799, "e", false], [1751, 0.027844, "as", false], [8801, 0.022938, "the", false], [1752, 0.018011, "at", false]]], "model_b": [1950, 6, 0.02932688780128956, [[2101, 0.095155, "or", false], [102, 0.076019, "e", false], [106, 0.07488, "i", false], [7005, 0.059197, "and", false], [36003, 0.030445, "which", false], [1950, 0.029327, "in", false], [1751, 0.029039, "as", false], [8801, 0.025703, "the", false], [98, 0.024642, "a", false], [7579, 0.019254, "for", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17370755610180016}, {"byte_start": 455, "byte_end": 461, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 80, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"model_a": "16.62% 16.62% 16.62% 16.62% 16.62% 16.62%", "model_b": "14.28% 14.28% 14.28% 14.28% 14.28% 14.28%"}, "model_tokens": {"model_a": [[40186, " which", "normal", 0.003966955002397299]], "model_b": [[40186, " which", "normal", 0.008699914440512657]]}, "loss": {"model_a": 16.62480613524391, "model_b": 14.276669675463697}, "topk": {"model_a": [40186, 30, 0.003966955002397299, [[22590, 0.188415, " the", false], [39920, 0.088759, " terms", false], [30808, 0.062445, " fact", false], [62293, 0.056727, " particular", false], [32074, 0.050032, " some", false], [39193, 0.03897, " other", false], [332, 0.038454, " a", false], [32251, 0.036288, " time", false], [55856, 0.031495, " contrast", false], [56901, 0.02424, " practice", false]]], "model_b": [40186, 18, 0.008699914440512657, [[22590, 0.236591, " the", false], [55856, 0.054553, " contrast", false], [39920, 0.053101, " terms", false], [332, 0.049717, " a", false], [39193, 0.049438, " other", false], [56901, 0.047442, " practice", false], [30808, 0.043166, " fact", false], [32074, 0.03139, " some", false], [32251, 0.022732, " time", false], [32234, 0.015672, " this", false]]]}, "raw_delta": 0.13020833333333337, "tuned_delta": 0.1830632772315332}, {"byte_start": 461, "byte_end": 466, "display": {"text": " case", "kind": "normal"}, "is_word": true, "word_id": 81, "word_key": " case", "bytes_hex": "20 63 61 73 65", "compression": {"model_a": "0.20% 0.20% 0.20% 0.20% 0.20%", "model_b": "0.15% 0.15% 0.15% 0.15% 0.15%"}, "model_tokens": {"model_a": [[30405, " case", "normal", 0.9465376734733582]], "model_b": [[30405, " case", "normal", 0.9594584107398987]]}, "loss": {"model_a": 0.19812401379395553, "model_b": 0.1496936993109886}, "topk": {"model_a": [30405, 1, 0.9465376734733582, [[30405, 0.946538, " case", false], [22590, 0.008833, " the", false], [4601, 0.006827, " it", false], [4858, 0.003043, " we", false], [37045, 0.001988, " Moore", false], [37970, 0.001368, " cases", false], [39631, 0.001339, " sense", false], [332, 0.001233, " a", false], [39934, 0.001163, " there", false], [45, 0.001, ",", false]]], "model_b": [30405, 1, 0.9594584107398987, [[30405, 0.959458, " case", false], [22590, 0.008016, " the", false], [4601, 0.004906, " it", false], [37970, 0.004835, " cases", false], [4858, 0.002568, " we", false], [39934, 0.001635, " there", false], [45, 0.000939, ",", false], [4692, 0.000821, " no", false], [21256, 0.000795, " all", false], [60511, 0.00071, " situation", false]]]}, "raw_delta": 0.002685546875, "tuned_delta": 0.05554049077319982}, {"byte_start": 466, "byte_end": 472, "display": {"text": " lever", "kind": "normal"}, "is_word": true, "word_id": 82, "word_key": " lever", "bytes_hex": "20 6c 65 76 65 72", "compression": {"model_a": "24.80% 24.80% 24.80% 24.80% 24.80% 24.80%", "model_b": "30.24% 30.24% 30.24% 30.24% 30.24% 30.24%"}, "model_tokens": {"model_a": [[38888, " lever", "normal", 0.0002689224202185869]], "model_b": [[38888, " lever", "normal", 4.187525701127015e-05]]}, "loss": {"model_a": 24.796321015279055, "model_b": 30.243997601969152}, "topk": {"model_a": [38888, 200, 0.0002689224202185869, [[22590, 0.240017, " the", false], [45, 0.132559, ",", false], [4601, 0.111652, " it", false], [4858, 0.041021, " we", false], [39934, 0.038155, " there", false], [22799, 0.019503, " you", false], [332, 0.018341, " a", false], [22226, 0.014805, " one", false], [21273, 0.013244, " any", false], [3609, 0.012739, " AI", false]]], "model_b": [38888, 620, 4.187525701127015e-05, [[22590, 0.230122, " the", false], [45, 0.173445, ",", false], [4601, 0.112131, " it", false], [4858, 0.104617, " we", false], [39934, 0.028059, " there", false], [37045, 0.022133, " Moore", false], [3609, 0.019621, " AI", false], [22799, 0.015857, " you", false], [332, 0.015461, " a", false], [22226, 0.011441, " one", false]]]}, "raw_delta": -0.30208333333333326, "tuned_delta": -0.24922838943513342}, {"byte_start": 472, "byte_end": 477, "display": {"text": "aging", "kind": "normal"}, "is_word": true, "word_id": 83, "word_key": "aging", "bytes_hex": "61 67 69 6e 67", "compression": {"model_a": "0.05% 0.05% 0.05% 0.05% 0.05%", "model_b": "0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"model_a": [[33672, "aging", "normal", 0.9851014614105225]], "model_b": [[33672, "aging", "normal", 0.9968733191490173]]}, "loss": {"model_a": 0.05437403489678557, "model_b": 0.011282061896600245}, "topk": {"model_a": [33672, 1, 0.9851014614105225, [[33672, 0.985101, "aging", false], [7856, 0.007969, "ing", false], [116, 0.006306, "s", false], [46, 0.000127, "-", false], [1739, 5.2e-05, "ag", false], [1843, 3.5e-05, "ed", false], [25504, 3.3e-05, "ging", false], [33943, 2.8e-05, "ating", false], [6934, 1.4e-05, "aga", false], [24457, 8e-06, "agin", false]]], "model_b": [33672, 1, 0.9968733191490173, [[33672, 0.996873, "aging", false], [7856, 0.001115, "ing", false], [116, 0.00063, "s", false], [1843, 0.000451, "ed", false], [46, 7.5e-05, "-", false], [6935, 6.6e-05, "age", false], [24566, 2.9e-05, "ance", false], [25504, 2.5e-05, "ging", false], [21289, 2.4e-05, " arm", false], [24451, 2.2e-05, "aged", false]]]}, "raw_delta": 0.0023895263671875, "tuned_delta": 0.05524447026538732}, {"byte_start": 477, "byte_end": 483, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 84, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "16.53% 16.53% 16.53% 16.53% 16.53% 16.53%", "model_b": "23.48% 23.48% 23.48% 23.48% 23.48% 23.48%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.004078036639839411]], "model_b": [[38720, " human", "normal", 0.0003984128125011921]]}, "loss": {"model_a": 16.530880676852703, "model_b": 23.481364597802134}, "topk": {"model_a": [38720, 15, 0.004078036639839411, [[63370, 0.480906, " computation", false], [22590, 0.095968, " the", false], [4601, 0.039196, " it", false], [51832, 0.028084, " general", false], [31458, 0.026637, " more", false], [64862, 0.019428, " computational", false], [32227, 0.016298, " that", false], [32234, 0.010317, " this", false], [37045, 0.009936, " Moore", false], [3609, 0.009241, " AI", false]]], "model_b": [38720, 184, 0.0003984128125011921, [[51832, 0.20193, " general", false], [63370, 0.114776, " computation", false], [22590, 0.105769, " the", false], [4601, 0.040183, " it", false], [32234, 0.026748, " this", false], [332, 0.025327, " a", false], [59346, 0.020904, " computing", false], [37045, 0.020593, " Moore", false], [3609, 0.018556, " AI", false], [32227, 0.015117, " that", false]]]}, "raw_delta": -0.3854166666666666, "tuned_delta": -0.33256172276846674}, {"byte_start": 483, "byte_end": 493, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 85, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%", "model_b": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.05250487104058266]], "model_b": [[59943, " knowledge", "normal", 0.05314521864056587]]}, "loss": {"model_a": 5.297395853264163, "model_b": 5.297395853264163}, "topk": {"model_a": [59943, 4, 0.05250487104058266, [[64452, 0.179815, " intelligence", false], [46, 0.111071, "-", false], [63370, 0.060205, " computation", false], [59943, 0.052505, " knowledge", false], [38853, 0.045172, " labor", false], [59683, 0.026737, " expertise", false], [59917, 0.025148, " intuition", false], [59304, 0.023541, " cognition", false], [4715, 0.022247, " or", false], [61979, 0.017686, " experience", false]]], "model_b": [59943, 4, 0.05314521864056587, [[46, 0.216237, "-", false], [64452, 0.105285, " intelligence", false], [59683, 0.064382, " expertise", false], [59943, 0.053145, " knowledge", false], [59304, 0.043249, " cognition", false], [61979, 0.023957, " experience", false], [60323, 0.02315, " reasoning", false], [59917, 0.022394, " intuition", false], [63370, 0.022163, " computation", false], [4715, 0.017547, " or", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 493, "byte_end": 499, "display": {"text": " would", "kind": "normal"}, "is_word": true, "word_id": 86, "word_key": " would", "bytes_hex": "20 77 6f 75 6c 64", "compression": {"model_a": "7.94% 7.94% 7.94% 7.94% 7.94% 7.94%", "model_b": "4.53% 4.53% 4.53% 4.53% 4.53% 4.53%"}, "model_tokens": {"model_a": [[40219, " would", "normal", 0.071438729763031]], "model_b": [[40219, " would", "normal", 0.22177395224571228]]}, "loss": {"model_a": 7.936701234057122, "model_b": 4.531903367375812}, "topk": {"model_a": [40219, 3, 0.071438729763031, [[4600, 0.271447, " is", false], [21265, 0.135429, " and", false], [40219, 0.071439, " would", false], [4811, 0.05034, " to", false], [45, 0.03904, ",", false], [22748, 0.035162, " was", false], [4715, 0.030387, " or", false], [4706, 0.029274, " of", false], [4596, 0.025587, " in", false], [37598, 0.022679, " about", false]]], "model_b": [40219, 1, 0.22177395224571228, [[40219, 0.221774, " would", false], [21265, 0.162887, " and", false], [4600, 0.138199, " is", false], [4811, 0.047178, " to", false], [4715, 0.036995, " or", false], [45, 0.036742, ",", false], [4706, 0.024215, " of", false], [4423, 0.020496, " as", false], [21700, 0.01908, " for", false], [38128, 0.017879, " could", false]]]}, "raw_delta": 0.18880208333333337, "tuned_delta": 0.2416570272315332}, {"byte_start": 499, "byte_end": 502, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 87, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "2.38% 2.38% 2.38%", "model_b": "4.39% 4.39% 4.39%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.6688634157180786]], "model_b": [[4435, " be", "normal", 0.4763592779636383]]}, "loss": {"model_a": 2.383358506676917, "model_b": 4.391015179789}, "topk": {"model_a": [4435, 1, 0.6688634157180786, [[4435, 0.668863, " be", false], [31059, 0.079696, " have", false], [22187, 0.021012, " not", false], [39820, 0.014323, " still", false], [31358, 0.011701, " make", false], [45150, 0.009902, " always", false], [53056, 0.009712, " suffice", false], [31967, 0.00811, " seem", false], [31581, 0.007504, " only", false], [46439, 0.006341, " likely", false]]], "model_b": [4435, 1, 0.4763592779636383, [[4435, 0.476359, " be", false], [31059, 0.076468, " have", false], [31358, 0.043797, " make", false], [22187, 0.040431, " not", false], [39820, 0.018949, " still", false], [45150, 0.018423, " always", false], [53056, 0.01761, " suffice", false], [46439, 0.014728, " likely", false], [32499, 0.014215, " work", false], [40239, 0.011674, " yield", false]]]}, "raw_delta": -0.111328125, "tuned_delta": -0.05847318110180018}, {"byte_start": 502, "byte_end": 506, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 88, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"model_a": "27.19% 27.19% 27.19% 27.19%", "model_b": "31.56% 31.56% 31.56% 31.56%"}, "model_tokens": {"model_a": [[22226, " one", "normal", 0.0023958298843353987]], "model_b": [[22226, " one", "normal", 0.0009174319566227496]]}, "loss": {"model_a": 27.191420204254875, "model_b": 31.55895401944607}, "topk": {"model_a": [22226, 49, 0.0023958298843353987, [[22590, 0.303476, " the", false], [332, 0.088067, " a", false], [31458, 0.042659, " more", false], [62606, 0.032527, " sufficient", false], [31461, 0.028552, " most", false], [52371, 0.026684, " optimal", false], [4419, 0.019832, " an", false], [31466, 0.018192, " much", false], [4706, 0.01665, " of", false], [59829, 0.01661, " important", false]]], "model_b": [22226, 123, 0.0009174319566227496, [[22590, 0.220126, " the", false], [332, 0.079204, " a", false], [31458, 0.045096, " more", false], [62606, 0.025165, " sufficient", false], [4419, 0.018391, " an", false], [60186, 0.01702, " pointless", false], [52371, 0.016324, " optimal", false], [62082, 0.015004, " impossible", false], [31466, 0.014277, " much", false], [4706, 0.012141, " of", false]]]}, "raw_delta": -0.2421875, "tuned_delta": -0.18933255610180016}, {"byte_start": 506, "byte_end": 509, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 89, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "4.09% 4.09% 4.09%", "model_b": "9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.5052815079689026]], "model_b": [[4706, " of", "normal", 0.21685448288917542]]}, "loss": {"model_a": 4.085757440017572, "model_b": 9.157732193142833}, "topk": {"model_a": [4706, 1, 0.5052815079689026, [[4706, 0.505282, " of", false], [22752, 0.091911, " way", false], [39941, 0.068209, " thing", false], [55532, 0.038928, " approach", false], [460, 0.031263, "'s", false], [46713, 0.02028, " option", false], [56895, 0.019485, " possible", false], [46561, 0.015649, " method", false], [57260, 0.015398, " solution", false], [59593, 0.00825, " effective", false]]], "model_b": [4706, 1, 0.21685448288917542, [[4706, 0.216854, " of", false], [22752, 0.204437, " way", false], [46713, 0.062772, " option", false], [56895, 0.042045, " possible", false], [57260, 0.041434, " solution", false], [55532, 0.031019, " approach", false], [63770, 0.018349, " possibility", false], [39941, 0.016005, " thing", false], [47284, 0.012605, " simple", false], [46561, 0.011881, " method", false]]]}, "raw_delta": -0.28125, "tuned_delta": -0.22839505610180016}, {"byte_start": 509, "byte_end": 513, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 90, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.25% 0.25% 0.25% 0.25%", "model_b": "0.53% 0.53% 0.53% 0.53%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.9462407827377319]], "model_b": [[22590, " the", "normal", 0.8889596462249756]]}, "loss": {"model_a": 0.2487557062079664, "model_b": 0.5327334593126359}, "topk": {"model_a": [22590, 1, 0.9462407827377319, [[22590, 0.946241, " the", false], [21902, 0.007788, " its", false], [52869, 0.006369, " several", false], [31370, 0.005837, " many", false], [21674, 0.004015, " few", false], [22638, 0.003584, " two", false], [332, 0.003583, " a", false], [31581, 0.002997, " only", false], [45, 0.002779, ",", false], [32386, 0.002485, " very", false]]], "model_b": [22590, 1, 0.8889596462249756, [[22590, 0.88896, " the", false], [21902, 0.043021, " its", false], [31370, 0.02138, " many", false], [22248, 0.00864, " our", false], [52869, 0.007842, " several", false], [332, 0.004375, " a", false], [31581, 0.002479, " only", false], [32515, 0.001966, " your", false], [22638, 0.00189, " two", false], [37045, 0.001185, " Moore", false]]]}, "raw_delta": -0.0157470703125, "tuned_delta": 0.03710787358569982}, {"byte_start": 513, "byte_end": 518, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 91, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "12.85% 12.85% 12.85% 12.85% 12.85%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.02849949151277542]], "model_b": [[31581, " only", "normal", 0.02747766301035881]]}, "loss": {"model_a": 12.849002707917329, "model_b": 12.96171325798678}, "topk": {"model_a": [31581, 6, 0.02849949151277542, [[31461, 0.469319, " most", false], [30273, 0.090291, " best", false], [21674, 0.060397, " few", false], [51039, 0.040166, " biggest", false], [31458, 0.036302, " more", false], [31581, 0.028499, " only", false], [31356, 0.024635, " main", false], [51718, 0.016832, " fastest", false], [38879, 0.013931, " least", false], [52555, 0.012394, " primary", false]]], "model_b": [31581, 5, 0.02747766301035881, [[31461, 0.291003, " most", false], [30273, 0.195332, " best", false], [21674, 0.050891, " few", false], [51039, 0.041364, " biggest", false], [31581, 0.027478, " only", false], [31458, 0.022115, " more", false], [56331, 0.01852, " greatest", false], [31356, 0.018079, " main", false], [45301, 0.0172, " better", false], [32448, 0.015963, " ways", false]]]}, "raw_delta": -0.006249999999999978, "tuned_delta": 0.046604943898199844}, {"byte_start": 518, "byte_end": 523, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 92, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "3.63% 3.63% 3.63% 3.63% 3.63%", "model_b": "5.75% 5.75% 5.75% 5.75% 5.75%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.36133360862731934]], "model_b": [[32448, " ways", "normal", 0.20203453302383423]]}, "loss": {"model_a": 3.634915239739771, "model_b": 5.748238053541963}, "topk": {"model_a": [32448, 1, 0.36133360862731934, [[32448, 0.361334, " ways", false], [59593, 0.075305, " effective", false], [47539, 0.067385, " things", false], [52373, 0.06188, " options", false], [52224, 0.025765, " methods", false], [56895, 0.024011, " possible", false], [52957, 0.021215, " sources", false], [60376, 0.017387, " remaining", false], [47720, 0.017173, " viable", false], [56212, 0.01017, " feasible", false]]], "model_b": [32448, 1, 0.20203453302383423, [[32448, 0.202035, " ways", false], [47720, 0.113719, " viable", false], [52373, 0.073724, " options", false], [59593, 0.066909, " effective", false], [47539, 0.037817, " things", false], [60521, 0.029596, " solutions", false], [60212, 0.028567, " practical", false], [62431, 0.028522, " reasonable", false], [56895, 0.018644, " possible", false], [51185, 0.016201, " choices", false]]]}, "raw_delta": -0.11718749999999997, "tuned_delta": -0.06433255610180015}, {"byte_start": 523, "byte_end": 526, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 93, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.31% 1.31% 1.31%", "model_b": "1.50% 1.50% 1.50%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8043993711471558]], "model_b": [[4811, " to", "normal", 0.7791807651519775]]}, "loss": {"model_a": 1.3149564174769197, "model_b": 1.5028073342593367}, "topk": {"model_a": [4811, 1, 0.8043993711471558, [[4811, 0.804399, " to", false], [4706, 0.052756, " of", false], [21700, 0.049434, " for", false], [4596, 0.019183, " in", false], [32227, 0.013408, " that", false], [22590, 0.010879, " the", false], [51791, 0.006568, " forward", false], [22799, 0.004905, " you", false], [4601, 0.004623, " it", false], [22226, 0.003395, " one", false]]], "model_b": [4811, 1, 0.7791807651519775, [[4811, 0.779181, " to", false], [4706, 0.044776, " of", false], [51791, 0.044331, " forward", false], [21700, 0.022193, " for", false], [32227, 0.01524, " that", false], [499, 0.009438, ").", false], [4858, 0.009118, " we", false], [22249, 0.008284, " out", false], [22590, 0.007879, " the", false], [45202, 0.004898, " around", false]]]}, "raw_delta": -0.010416666666666657, "tuned_delta": 0.042438277231533164}, {"byte_start": 526, "byte_end": 534, "display": {"text": " improve", "kind": "normal"}, "is_word": true, "word_id": 94, "word_key": " improve", "bytes_hex": "20 69 6d 70 72 6f 76 65", "compression": {"model_a": "3.21% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21%", "model_b": "4.24% 4.24% 4.24% 4.24% 4.24% 4.24% 4.24% 4.24%"}, "model_tokens": {"model_a": [[51982, " improve", "normal", 0.239995539188385]], "model_b": [[51982, " improve", "normal", 0.1509026437997818]]}, "loss": {"model_a": 3.2052062675999915, "model_b": 4.244256651052736}, "topk": {"model_a": [51982, 1, 0.239995539188385, [[51982, 0.239996, " improve", false], [21751, 0.096764, " get", false], [31358, 0.077642, " make", false], [56433, 0.064536, " increase", false], [30938, 0.057972, " gain", false], [50848, 0.021004, " achieve", false], [37886, 0.019635, " boost", false], [39590, 0.018123, " scale", false], [46694, 0.013848, " obtain", false], [56950, 0.012106, " progress", false]]], "model_b": [51982, 1, 0.1509026437997818, [[51982, 0.150903, " improve", false], [21751, 0.101106, " get", false], [50848, 0.08956, " achieve", false], [31358, 0.051881, " make", false], [56433, 0.045323, " increase", false], [39740, 0.029983, " solve", false], [39590, 0.026553, " scale", false], [30938, 0.023184, " gain", false], [4491, 0.020356, " do", false], [47030, 0.019581, " reduce", false]]]}, "raw_delta": -0.0576171875, "tuned_delta": -0.0047622436018001785}, {"byte_start": 534, "byte_end": 546, "display": {"text": " performance", "kind": "normal"}, "is_word": true, "word_id": 95, "word_key": " performance", "bytes_hex": "20 70 65 72 66 6f 72 6d 61 6e 63 65", "compression": {"model_a": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "model_b": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"model_a": [[63750, " performance", "normal", 0.40172532200813293]], "model_b": [[63750, " performance", "normal", 0.4797111451625824]]}, "loss": {"model_a": 1.3795301701208758, "model_b": 1.1153648183956018}, "topk": {"model_a": [63750, 1, 0.40172532200813293, [[63750, 0.401725, " performance", false], [22590, 0.123543, " the", false], [499, 0.086506, ").", false], [497, 0.081763, "),", false], [37636, 0.030184, " agent", false], [21902, 0.025359, " its", false], [42, 0.02465, ")", false], [3609, 0.017918, " AI", false], [52738, 0.012741, " results", false], [4712, 0.01061, " on", false]]], "model_b": [63750, 1, 0.4797111451625824, [[63750, 0.479711, " performance", false], [22590, 0.152669, " the", false], [499, 0.030851, ").", false], [52738, 0.023203, " results", false], [61923, 0.016509, " efficiency", false], [4419, 0.014732, " an", false], [21902, 0.01388, " its", false], [32350, 0.012724, " upon", false], [3609, 0.012117, " AI", false], [497, 0.0118, "),", false]]]}, "raw_delta": 0.014648437499999998, "tuned_delta": 0.06750338139819982}, {"byte_start": 546, "byte_end": 547, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "52.13%", "model_b": "45.65%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.05563868209719658]], "model_b": [[42, ")", "normal", 0.08062120527029037]]}, "loss": {"model_a": 52.12862940712074, "model_b": 45.647772778127354}, "topk": {"model_a": [42, 3, 0.05563868209719658, [[499, 0.436501, ").", false], [497, 0.346914, "),", false], [42, 0.055639, ")", false], [45, 0.035656, ",", false], [502, 0.023759, ");", false], [580, 0.012966, ".)", false], [31601, 0.00637, " over", false], [4712, 0.005548, " on", false], [45302, 0.003878, " beyond", false], [4706, 0.003696, " of", false]]], "model_b": [42, 3, 0.08062120527029037, [[499, 0.460893, ").", false], [497, 0.289097, "),", false], [42, 0.080621, ")", false], [45, 0.029059, ",", false], [53356, 0.014699, " without", false], [31601, 0.010458, " over", false], [21265, 0.009615, " and", false], [4596, 0.00795, " in", false], [502, 0.007486, ");", false], [4712, 0.006267, " on", false]]]}, "raw_delta": 0.359375, "tuned_delta": 0.41222994389819984}, {"byte_start": 547, "byte_end": 551, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 96, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "7.29% 7.29% 7.29% 7.29%", "model_b": "7.15% 7.15% 7.15% 7.15%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.19607014954090118]], "model_b": [[21400, " but", "normal", 0.20521263778209686]]}, "loss": {"model_a": 7.290963707617563, "model_b": 7.15007552003075}, "topk": {"model_a": [21400, 3, 0.19607014954090118, [[4715, 0.280877, " or", false], [21265, 0.214771, " and", false], [21400, 0.19607, " but", false], [47001, 0.044338, " rather", false], [32465, 0.04011, " when", false], [40187, 0.028602, " while", false], [53339, 0.018469, " whereas", false], [4788, 0.015203, " so", false], [40186, 0.014444, " which", false], [280, 0.014012, " -", false]]], "model_b": [21400, 3, 0.20521263778209686, [[21265, 0.315356, " and", false], [4715, 0.271999, " or", false], [21400, 0.205213, " but", false], [47001, 0.025807, " rather", false], [40187, 0.023741, " while", false], [53339, 0.015101, " whereas", false], [22898, 0.009727, " —", false], [22897, 0.00962, " –", false], [3460, 0.009014, " --", false], [52028, 0.00779, " instead", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06066744389819982}, {"byte_start": 551, "byte_end": 552, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "72.70%", "model_b": "66.50%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.017884861677885056]], "model_b": [[45, ",", "normal", 0.025223104283213615]]}, "loss": {"model_a": 72.69830479479542, "model_b": 66.49922454097565}, "topk": {"model_a": [45, 9, 0.017884861677885056, [[4596, 0.15576, " in", false], [32234, 0.137253, " this", false], [22590, 0.133383, " the", false], [37045, 0.077004, " Moore", false], [32227, 0.063672, " that", false], [4601, 0.041985, " it", false], [4423, 0.034334, " as", false], [4858, 0.025061, " we", false], [45, 0.017885, ",", false], [39934, 0.011089, " there", false]]], "model_b": [45, 7, 0.025223104283213615, [[4596, 0.19518, " in", false], [32234, 0.122398, " this", false], [22590, 0.119, " the", false], [4601, 0.049701, " it", false], [4423, 0.044667, " as", false], [32227, 0.042026, " that", false], [45, 0.025223, ",", false], [4858, 0.017608, " we", false], [32487, 0.016267, " with", false], [37045, 0.015465, " Moore", false]]]}, "raw_delta": 0.34375, "tuned_delta": 0.39660494389819984}, {"byte_start": 552, "byte_end": 557, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 97, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "18.37% 18.37% 18.37% 18.37% 18.37%", "model_b": "17.81% 17.81% 17.81% 17.81% 17.81%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.006244035437703133]], "model_b": [[31601, " over", "normal", 0.007031806278973818]]}, "loss": {"model_a": 18.37181966132039, "model_b": 17.808266910973142}, "topk": {"model_a": [31601, 20, 0.006244035437703133, [[4423, 0.299683, " as", false], [4596, 0.284434, " in", false], [4706, 0.038182, " of", false], [32487, 0.020703, " with", false], [47532, 0.01803, " thanks", false], [21700, 0.0175, " for", false], [4588, 0.01441, " if", false], [4450, 0.010614, " by", false], [31296, 0.009788, " like", false], [31458, 0.009522, " more", false]]], "model_b": [31601, 18, 0.007031806278973818, [[4596, 0.351457, " in", false], [4423, 0.242373, " as", false], [4706, 0.015839, " of", false], [32487, 0.015109, " with", false], [4424, 0.013581, " at", false], [4588, 0.012681, " if", false], [21700, 0.012108, " for", false], [22590, 0.011567, " the", false], [38594, 0.010908, " given", false], [32465, 0.010246, " when", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 557, "byte_end": 559, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 98, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "40.29% 40.29%", "model_b": "41.14% 41.14%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.01135292649269104]], "model_b": [[332, " a", "normal", 0.01030950527638197]]}, "loss": {"model_a": 40.294021649828466, "model_b": 41.13935077534934}, "topk": {"model_a": [332, 5, 0.01135292649269104, [[22590, 0.622841, " the", false], [32251, 0.227246, " time", false], [3543, 0.029391, " 70", false], [51396, 0.014309, " decades", false], [332, 0.011353, " a", false], [32234, 0.010113, " this", false], [37045, 0.006754, " Moore", false], [21265, 0.006254, " and", false], [31370, 0.004884, " many", false], [21256, 0.004334, " all", false]]], "model_b": [332, 3, 0.01030950527638197, [[22590, 0.624184, " the", false], [32251, 0.28875, " time", false], [332, 0.01031, " a", false], [3543, 0.008533, " 70", false], [21265, 0.008254, " and", false], [47014, 0.007861, " recent", false], [51396, 0.006274, " decades", false], [31370, 0.00464, " many", false], [32234, 0.003786, " this", false], [39936, 0.002084, " these", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.0059799438981998215}, {"byte_start": 559, "byte_end": 568, "display": {"text": " slightly", "kind": "normal"}, "is_word": true, "word_id": 99, "word_key": " slightly", "bytes_hex": "20 73 6c 69 67 68 74 6c 79", "compression": {"model_a": "17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28%", "model_b": "18.53% 18.53% 18.53% 18.53% 18.53% 18.53% 18.53% 18.53% 18.53%"}, "model_tokens": {"model_a": [[57245, " slightly", "normal", 0.00018253736197948456]], "model_b": [[57245, " slightly", "normal", 9.719048830447719e-05]]}, "loss": {"model_a": 17.282284343982372, "model_b": 18.534623789198484}, "topk": {"model_a": [57245, 200, 0.00018253736197948456, [[3543, 0.300862, " 70", false], [46790, 0.105546, " period", false], [31323, 0.09544, " long", false], [32386, 0.036812, " very", false], [51158, 0.026744, " century", false], [32251, 0.026189, " time", false], [45674, 0.021718, " decade", false], [38864, 0.018308, " large", false], [46470, 0.016697, " longer", false], [21674, 0.015896, " few", false]]], "model_b": [57245, 296, 9.719048830447719e-05, [[46790, 0.189173, " period", false], [31323, 0.134184, " long", false], [38864, 0.056474, " large", false], [51158, 0.056362, " century", false], [45674, 0.049264, " decade", false], [46470, 0.042823, " longer", false], [32386, 0.026357, " very", false], [32470, 0.023927, " wide", false], [3543, 0.023562, " 70", false], [32091, 0.02303, " span", false]]]}, "raw_delta": -0.06944444444444431, "tuned_delta": -0.016589500546244487}, {"byte_start": 568, "byte_end": 575, "display": {"text": " longer", "kind": "normal"}, "is_word": true, "word_id": 100, "word_key": " longer", "bytes_hex": "20 6c 6f 6e 67 65 72", "compression": {"model_a": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68% 0.68%", "model_b": "1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22%"}, "model_tokens": {"model_a": [[46470, " longer", "normal", 0.7653277516365051]], "model_b": [[46470, " longer", "normal", 0.622844934463501]]}, "loss": {"model_a": 0.6843140539930908, "model_b": 1.2176764784288818}, "topk": {"model_a": [46470, 1, 0.7653277516365051, [[46470, 0.765328, " longer", false], [52888, 0.065395, " shorter", false], [46397, 0.043352, " larger", false], [31458, 0.028546, " more", false], [59513, 0.014313, " different", false], [40192, 0.01248, " wider", false], [31277, 0.011823, " less", false], [51093, 0.009529, " broader", false], [52932, 0.008377, " smaller", false], [56189, 0.006928, " extended", false]]], "model_b": [46470, 1, 0.622844934463501, [[46470, 0.622845, " longer", false], [52888, 0.081618, " shorter", false], [46397, 0.065655, " larger", false], [31458, 0.056163, " more", false], [59513, 0.022367, " different", false], [40192, 0.015843, " wider", false], [56189, 0.013212, " extended", false], [31277, 0.01243, " less", false], [52932, 0.011536, " smaller", false], [51093, 0.009459, " broader", false]]]}, "raw_delta": -0.029575892857142853, "tuned_delta": 0.02327905104105697}, {"byte_start": 575, "byte_end": 580, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 101, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "3.11% 3.11% 3.11% 3.11% 3.11%", "model_b": "3.41% 3.41% 3.41% 3.41% 3.41%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.4206095039844513]], "model_b": [[32251, " time", "normal", 0.3899119198322296]]}, "loss": {"model_a": 3.1136289456685633, "model_b": 3.40949413960087}, "topk": {"model_a": [32251, 1, 0.4206095039844513, [[32251, 0.42061, " time", false], [46790, 0.290725, " period", false], [39962, 0.124843, " times", false], [51940, 0.055261, " horizon", false], [57431, 0.013918, " timeline", false], [51929, 0.009873, " history", false], [32219, 0.008862, " term", false], [32091, 0.006827, " span", false], [62061, 0.005058, " historical", false], [46, 0.004165, "-", false]]], "model_b": [32251, 1, 0.3899119198322296, [[32251, 0.389912, " time", false], [46790, 0.206663, " period", false], [51940, 0.111585, " horizon", false], [39962, 0.066644, " times", false], [22418, 0.018283, " run", false], [57431, 0.018002, " timeline", false], [47797, 0.01551, " window", false], [51929, 0.015161, " history", false], [32219, 0.014328, " term", false], [39438, 0.014041, " range", false]]]}, "raw_delta": -0.016406249999999983, "tuned_delta": 0.03644869389819984}, {"byte_start": 580, "byte_end": 585, "display": {"text": " than", "kind": "normal"}, "is_word": true, "word_id": 102, "word_key": " than", "bytes_hex": "20 74 68 61 6e", "compression": {"model_a": "17.70% 17.70% 17.70% 17.70% 17.70%", "model_b": "21.53% 21.53% 21.53% 21.53% 21.53%"}, "model_tokens": {"model_a": [[32226, " than", "normal", 0.007359430659562349]], "model_b": [[32226, " than", "normal", 0.0025489346589893103]]}, "loss": {"model_a": 17.69555636090369, "model_b": 21.527715063265}, "topk": {"model_a": [32226, 9, 0.007359430659562349, [[51940, 0.27763, " horizon", false], [38549, 0.189149, " frame", false], [46790, 0.16146, " period", false], [39590, 0.115795, " scale", false], [34478, 0.092053, "frame", false], [32091, 0.054424, " span", false], [46, 0.053437, "-", false], [45, 0.01514, ",", false], [32226, 0.007359, " than", false], [56485, 0.006647, " interval", false]]], "model_b": [32226, 12, 0.0025489346589893103, [[51940, 0.231179, " horizon", false], [34478, 0.206717, "frame", false], [38549, 0.166634, " frame", false], [39590, 0.137143, " scale", false], [46790, 0.074921, " period", false], [32091, 0.068249, " span", false], [46, 0.053194, "-", false], [45, 0.018885, ",", false], [47797, 0.011668, " window", false], [39438, 0.005271, " range", false]]]}, "raw_delta": -0.21250000000000013, "tuned_delta": -0.1596450561018003}, {"byte_start": 585, "byte_end": 587, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 103, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "35.08% 35.08%", "model_b": "37.19% 37.19%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.02080506645143032]], "model_b": [[332, " a", "normal", 0.01650160364806652]]}, "loss": {"model_a": 35.081158709116394, "model_b": 37.194481522918586}, "topk": {"model_a": [332, 8, 0.02080506645143032, [[37045, 0.268005, " Moore", false], [22590, 0.204051, " the", false], [3543, 0.082391, " 70", false], [32227, 0.077544, " that", false], [4858, 0.038297, " we", false], [4601, 0.035759, " it", false], [32234, 0.023253, " this", false], [332, 0.020805, " a", false], [22799, 0.018278, " you", false], [22226, 0.015477, " one", false]]], "model_b": [332, 12, 0.01650160364806652, [[37045, 0.089588, " Moore", false], [32227, 0.088009, " that", false], [4858, 0.078353, " we", false], [22590, 0.076212, " the", false], [31461, 0.058427, " most", false], [32234, 0.053512, " this", false], [4600, 0.04992, " is", false], [3543, 0.029607, " 70", false], [56175, 0.029218, " expected", false], [46227, 0.022025, " humans", false]]]}, "raw_delta": -0.1171875, "tuned_delta": -0.06433255610180018}, {"byte_start": 587, "byte_end": 595, "display": {"text": " typical", "kind": "normal"}, "is_word": true, "word_id": 104, "word_key": " typical", "bytes_hex": "20 74 79 70 69 63 61 6c", "compression": {"model_a": "6.30% 6.30% 6.30% 6.30% 6.30% 6.30% 6.30% 6.30%", "model_b": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"model_a": [[53216, " typical", "normal", 0.06208483874797821]], "model_b": [[53216, " typical", "normal", 0.04979708790779114]]}, "loss": {"model_a": 6.304746394509873, "model_b": 6.762633004167015}, "topk": {"model_a": [53216, 6, 0.06208483874797821, [[38720, 0.194608, " human", false], [45674, 0.142557, " decade", false], [51158, 0.088215, " century", false], [3543, 0.062799, " 70", false], [47289, 0.062467, " single", false], [53216, 0.062085, " typical", false], [32512, 0.042873, " year", false], [62035, 0.035198, " generation", false], [21674, 0.023645, " few", false], [46795, 0.019157, " person", false]]], "model_b": [53216, 6, 0.04979708790779114, [[21674, 0.150948, " few", false], [38720, 0.14288, " human", false], [32512, 0.121647, " year", false], [45674, 0.116825, " decade", false], [47289, 0.064888, " single", false], [53216, 0.049797, " typical", false], [46677, 0.022993, " normal", false], [45602, 0.018266, " couple", false], [62035, 0.017435, " generation", false], [51158, 0.013141, " century", false]]]}, "raw_delta": -0.025390625, "tuned_delta": 0.02746431889819982}, {"byte_start": 595, "byte_end": 604, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 105, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60%", "model_b": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.10014776140451431]], "model_b": [[57103, " research", "normal", 0.08086008578538895]]}, "loss": {"model_a": 4.602347461169218, "model_b": 5.040666266994859}, "topk": {"model_a": [57103, 3, 0.10014776140451431, [[38720, 0.2407, " human", false], [3609, 0.118002, " AI", false], [57103, 0.100148, " research", false], [45418, 0.050959, " career", false], [56546, 0.029501, " lifetime", false], [46795, 0.026311, " person", false], [55427, 0.024988, " academic", false], [31293, 0.023495, " life", false], [37636, 0.013832, " agent", false], [56545, 0.013468, " lifespan", false]]], "model_b": [57103, 3, 0.08086008578538895, [[38720, 0.162298, " human", false], [3609, 0.103938, " AI", false], [57103, 0.08086, " research", false], [55809, 0.039197, " computer", false], [37045, 0.034223, " Moore", false], [46795, 0.024908, " person", false], [37636, 0.01892, " agent", false], [3543, 0.015191, " 70", false], [32512, 0.013258, " year", false], [62496, 0.012746, " researcher", false]]]}, "raw_delta": -0.02430555555555558, "tuned_delta": 0.02854938834264424}, {"byte_start": 604, "byte_end": 612, "display": {"text": " project", "kind": "normal"}, "is_word": true, "word_id": 106, "word_key": " project", "bytes_hex": "20 70 72 6f 6a 65 63 74", "compression": {"model_a": "6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73%", "model_b": "2.02% 2.02% 2.02% 2.02% 2.02% 2.02% 2.02% 2.02%"}, "model_tokens": {"model_a": [[52581, " project", "normal", 0.05062534660100937]], "model_b": [[52581, " project", "normal", 0.4112006425857544]]}, "loss": {"model_a": 6.727410957270312, "model_b": 2.0164621848362585}, "topk": {"model_a": [52581, 4, 0.05062534660100937, [[45418, 0.665753, " career", false], [38172, 0.057023, " cycle", false], [56546, 0.05467, " lifetime", false], [52581, 0.050625, " project", false], [46790, 0.024565, " period", false], [31293, 0.024176, " life", false], [39227, 0.018057, " paper", false], [52580, 0.009991, " program", false], [56545, 0.009035, " lifespan", false], [32251, 0.005437, " time", false]]], "model_b": [52581, 1, 0.4112006425857544, [[52581, 0.411201, " project", false], [46790, 0.08986, " period", false], [39227, 0.048813, " paper", false], [52580, 0.048518, " program", false], [45418, 0.041319, " career", false], [32512, 0.035189, " year", false], [31293, 0.029746, " life", false], [38172, 0.026944, " cycle", false], [51940, 0.016751, " horizon", false], [60455, 0.014366, " scientist", false]]]}, "raw_delta": 0.26123046875, "tuned_delta": 0.31408541264819984}, {"byte_start": 612, "byte_end": 613, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "4.83%", "model_b": "3.70%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.766708254814148]], "model_b": [[45, ",", "normal", 0.8142263889312744]]}, "loss": {"model_a": 4.825420424848339, "model_b": 3.6983149241538364}, "topk": {"model_a": [45, 1, 0.766708254814148, [[45, 0.766708, ",", false], [38867, 0.034144, " lasts", false], [40219, 0.02692, " would", false], [275, 0.020627, " (", false], [39751, 0.018768, " spans", false], [460, 0.009373, "'s", false], [4600, 0.008784, " is", false], [21413, 0.008738, " can", false], [39021, 0.007061, " might", false], [32091, 0.005655, " span", false]]], "model_b": [45, 1, 0.8142263889312744, [[45, 0.814226, ",", false], [275, 0.025381, " (", false], [40219, 0.019554, " would", false], [4596, 0.011509, " in", false], [39021, 0.00803, " might", false], [21413, 0.007948, " can", false], [4600, 0.007197, " is", false], [4706, 0.005356, " of", false], [21800, 0.005119, " has", false], [39971, 0.005085, " today", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 613, "byte_end": 623, "display": {"text": " massively", "kind": "normal"}, "is_word": true, "word_id": 107, "word_key": " massively", "bytes_hex": "20 6d 61 73 73 69 76 65 6c 79", "compression": {"model_a": "15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89%", "model_b": "15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55%"}, "model_tokens": {"model_a": [[59988, " massively", "normal", 0.0001499016652815044]], "model_b": [[59988, " massively", "normal", 0.00017751925042830408]]}, "loss": {"model_a": 15.892187559792484, "model_b": 15.554055909584136}, "topk": {"model_a": [59988, 243, 0.0001499016652815044, [[22590, 0.247101, " the", false], [63370, 0.117083, " computation", false], [37045, 0.090785, " Moore", false], [32234, 0.081544, " this", false], [4858, 0.065441, " we", false], [4601, 0.03113, " it", false], [32227, 0.029685, " that", false], [39934, 0.021945, " there", false], [59346, 0.02039, " computing", false], [3609, 0.010807, " AI", false]]], "model_b": [59988, 249, 0.00017751925042830408, [[22590, 0.256063, " the", false], [32234, 0.095693, " this", false], [4858, 0.086209, " we", false], [4601, 0.064041, " it", false], [37045, 0.049764, " Moore", false], [3609, 0.038718, " AI", false], [32227, 0.022909, " that", false], [31461, 0.015561, " most", false], [332, 0.015343, " a", false], [39934, 0.013068, " there", false]]]}, "raw_delta": 0.018749999999999933, "tuned_delta": 0.07160494389819975}, {"byte_start": 623, "byte_end": 628, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 108, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "5.27% 5.27% 5.27% 5.27% 5.27%", "model_b": "10.43% 10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.23026542365550995]], "model_b": [[31458, " more", "normal", 0.05581330135464668]]}, "loss": {"model_a": 5.2692182157467995, "model_b": 10.425725881424148}, "topk": {"model_a": [31458, 2, 0.23026542365550995, [[56812, 0.239709, " parallel", false], [31458, 0.230265, " more", false], [62092, 0.094518, " increasing", false], [59846, 0.060232, " increased", false], [56418, 0.052938, " improved", false], [51178, 0.033869, " cheaper", false], [56900, 0.019873, " powerful", false], [45301, 0.018152, " better", false], [45961, 0.017265, " faster", false], [51709, 0.016974, " falling", false]]], "model_b": [31458, 3, 0.05581330135464668, [[56812, 0.439301, " parallel", false], [59846, 0.076666, " increased", false], [31458, 0.055813, " more", false], [62092, 0.049708, " increasing", false], [56418, 0.037491, " improved", false], [47180, 0.034398, " scaled", false], [46, 0.024587, "-", false], [59847, 0.022329, " increases", false], [52805, 0.011684, " scaling", false], [57160, 0.010569, " scalable", false]]]}, "raw_delta": -0.2859375, "tuned_delta": -0.23308255610180018}, {"byte_start": 628, "byte_end": 640, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 109, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77%", "model_b": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.3055560886859894]], "model_b": [[63370, " computation", "normal", 0.30992835760116577]]}, "loss": {"model_a": 1.7728430271340614, "model_b": 1.7611023448351601}, "topk": {"model_a": [63370, 1, 0.3055560886859894, [[63370, 0.305556, " computation", false], [59346, 0.142826, " computing", false], [51266, 0.085277, " compute", false], [56900, 0.049415, " powerful", false], [64862, 0.046111, " computational", false], [60406, 0.032073, " resources", false], [21265, 0.018434, " and", false], [39339, 0.013736, " power", false], [59345, 0.013182, " computers", false], [59593, 0.011223, " effective", false]]], "model_b": [63370, 1, 0.30992835760116577, [[63370, 0.309928, " computation", false], [59346, 0.189154, " computing", false], [56900, 0.096591, " powerful", false], [64862, 0.090666, " computational", false], [51266, 0.034684, " compute", false], [21265, 0.022035, " and", false], [30579, 0.019527, " data", false], [59594, 0.016508, " efficient", false], [60406, 0.010071, " resources", false], [39339, 0.009971, " power", false]]]}, "raw_delta": 0.0006510416666666713, "tuned_delta": 0.05350598556486649}, {"byte_start": 640, "byte_end": 651, "display": {"text": " inevitably", "kind": "normal"}, "is_word": true, "word_id": 110, "word_key": " inevitably", "bytes_hex": "20 69 6e 65 76 69 74 61 62 6c 79", "compression": {"model_a": "19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47%", "model_b": "14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55%"}, "model_tokens": {"model_a": [[62110, " inevitably", "normal", 6.9300276663852856e-06]], "model_b": [[62110, " inevitably", "normal", 0.00013813683472108096]]}, "loss": {"model_a": 19.468185921086867, "model_b": 14.549907372601758}, "topk": {"model_a": [62110, 430, 6.9300276663852856e-06, [[21800, 0.431345, " has", false], [4600, 0.301842, " is", false], [45283, 0.049442, " became", false], [51019, 0.041637, " becomes", false], [21265, 0.028217, " and", false], [22748, 0.020679, " was", false], [32475, 0.016363, " will", false], [275, 0.012891, " (", false], [22278, 0.012822, " per", false], [21413, 0.011631, " can", false]]], "model_b": [62110, 132, 0.00013813683472108096, [[4600, 0.27901, " is", false], [21800, 0.19108, " has", false], [51019, 0.145703, " becomes", false], [21413, 0.081405, " can", false], [45283, 0.034499, " became", false], [32475, 0.031488, " will", false], [22748, 0.030319, " was", false], [21265, 0.018362, " and", false], [39339, 0.018093, " power", false], [30965, 0.014382, " gets", false]]]}, "raw_delta": 0.2727272727272729, "tuned_delta": 0.3255822166254727}, {"byte_start": 651, "byte_end": 659, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 111, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"model_a": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%", "model_b": "1.36% 1.36% 1.36% 1.36% 1.36% 1.36% 1.36% 1.36%"}, "model_tokens": {"model_a": [[51019, " becomes", "normal", 0.7341703176498413]], "model_b": [[51019, " becomes", "normal", 0.5490264892578125]]}, "loss": {"model_a": 0.7044409379340641, "model_b": 1.3560488055230733}, "topk": {"model_a": [51019, 1, 0.7341703176498413, [[51019, 0.73417, " becomes", false], [45283, 0.078943, " became", false], [38087, 0.027746, " comes", false], [50956, 0.025538, " arrives", false], [21800, 0.011826, " has", false], [45199, 0.010087, " arises", false], [30965, 0.008402, " gets", false], [4600, 0.007217, " is", false], [50935, 0.006631, " appears", false], [51586, 0.006175, " emerges", false]]], "model_b": [51019, 1, 0.5490264892578125, [[51019, 0.549026, " becomes", false], [38087, 0.064727, " comes", false], [45283, 0.057821, " became", false], [50956, 0.054065, " arrives", false], [30965, 0.033175, " gets", false], [51586, 0.019307, " emerges", false], [50935, 0.012908, " appears", false], [45871, 0.010969, " enters", false], [51775, 0.008913, " follows", false], [61525, 0.00721, " accumulate", false]]]}, "raw_delta": -0.0361328125, "tuned_delta": 0.01672213139819982}, {"byte_start": 659, "byte_end": 669, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 112, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "model_b": "0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.9360848069190979]], "model_b": [[59206, " available", "normal", 0.9495458602905273]]}, "loss": {"model_a": 0.11887440827637331, "model_b": 0.09201759751763713}, "topk": {"model_a": [59206, 1, 0.9360848069190979, [[59206, 0.936085, " available", false], [56895, 0.008095, " possible", false], [61551, 0.00751, " affordable", false], [38006, 0.007074, " cheap", false], [51178, 0.006446, " cheaper", false], [61519, 0.004771, " accessible", false], [56212, 0.00285, " feasible", false], [31458, 0.002673, " more", false], [30911, 0.00177, " free", false], [46042, 0.001525, " freely", false]]], "model_b": [59206, 1, 0.9495458602905273, [[59206, 0.949546, " available", false], [61519, 0.005374, " accessible", false], [31458, 0.005223, " more", false], [56895, 0.004086, " possible", false], [332, 0.002013, " a", false], [56212, 0.00187, " feasible", false], [51178, 0.001692, " cheaper", false], [22590, 0.001473, " the", false], [52648, 0.001212, " readily", false], [31633, 0.001148, " part", false]]]}, "raw_delta": 0.0014892578125000003, "tuned_delta": 0.05434420171069982}, {"byte_start": 669, "byte_end": 670, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "9.44%", "model_b": "11.27%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5892093777656555]], "model_b": [[47, ".", "normal", 0.5384531021118164]]}, "loss": {"model_a": 9.439508568316459, "model_b": 11.271055006945026}, "topk": {"model_a": [47, 1, 0.5892093777656555, [[47, 0.589209, ".", false], [45, 0.142907, ",", false], [4811, 0.068165, " to", false], [21265, 0.029715, " and", false], [275, 0.019829, " (", false], [4424, 0.017932, " at", false], [4423, 0.01607, " as", false], [21700, 0.012768, " for", false], [32226, 0.009827, " than", false], [4596, 0.006974, " in", false]]], "model_b": [47, 1, 0.5384531021118164, [[47, 0.538453, ".", false], [45, 0.083335, ",", false], [4811, 0.078304, " to", false], [21265, 0.048123, " and", false], [275, 0.044029, " (", false], [4423, 0.02396, " as", false], [21700, 0.015196, " for", false], [4424, 0.013816, " at", false], [21572, 0.011621, " due", false], [32226, 0.011207, " than", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 670, "byte_end": 675, "display": {"text": " Seek", "kind": "normal"}, "is_word": true, "word_id": 113, "word_key": " seek", "bytes_hex": "20 53 65 65 6b", "compression": {"model_a": "38.77% 38.77% 38.77% 38.77% 38.77%", "model_b": "39.90% 39.90% 39.90% 39.90% 39.90%"}, "model_tokens": {"model_a": [[29753, " Seek", "normal", 2.1366482542362064e-05]], "model_b": [[29753, " Seek", "normal", 1.5750472812214866e-05]]}, "loss": {"model_a": 38.77242922389089, "model_b": 39.899534724585386}, "topk": {"model_a": [29753, 891, 2.1366482542362064e-05, [[11, 0.247866, "\n", false], [29894, 0.100981, " This", false], [261, 0.094195, "\n\n", false], [20996, 0.088735, " The", false], [3913, 0.02941, " In", false], [3918, 0.021004, " It", false], [3641, 0.020238, " As", false], [19417, 0.016542, " And", false], [19907, 0.016326, " For", false], [29898, 0.015029, " Thus", false]]], "model_b": [29753, 1114, 1.5750472812214866e-05, [[11, 0.203931, "\n", false], [29894, 0.116088, " This", false], [20996, 0.099082, " The", false], [3913, 0.044174, " In", false], [261, 0.041504, "\n\n", false], [3641, 0.026683, " As", false], [19907, 0.017362, " For", false], [3918, 0.016623, " It", false], [3908, 0.014244, " If", false], [4217, 0.013712, " So", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 675, "byte_end": 678, "display": {"text": "ing", "kind": "normal"}, "is_word": true, "word_id": 114, "word_key": "ing", "bytes_hex": "69 6e 67", "compression": {"model_a": "0.30% 0.30% 0.30%", "model_b": "0.12% 0.12% 0.12%"}, "model_tokens": {"model_a": [[7856, "ing", "normal", 0.9518613219261169]], "model_b": [[7856, "ing", "normal", 0.9796226620674133]]}, "loss": {"model_a": 0.29645222804725196, "model_b": 0.12401095678214254}, "topk": {"model_a": [7856, 1, 0.9518613219261169, [[7856, 0.951861, "ing", false], [4811, 0.008683, " to", false], [22249, 0.008318, " out", false], [7500, 0.005808, "ers", false], [22590, 0.002159, " the", false], [332, 0.001303, " a", false], [21265, 0.001197, " and", false], [1857, 0.001058, "er", false], [21700, 0.0007, " for", false], [116, 0.000497, "s", false]]], "model_b": [7856, 1, 0.9796226620674133, [[7856, 0.979623, "ing", false], [22249, 0.004579, " out", false], [4811, 0.002479, " to", false], [7500, 0.001431, "ers", false], [22590, 0.001137, " the", false], [37634, 0.000821, " after", false], [31458, 0.000602, " more", false], [4601, 0.000564, " it", false], [21265, 0.000507, " and", false], [332, 0.000469, " a", false]]]}, "raw_delta": 0.009562174479166664, "tuned_delta": 0.062417118377366486}, {"byte_start": 678, "byte_end": 681, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 115, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"model_a": "27.43% 27.43% 27.43%", "model_b": "26.11% 26.11% 26.11%"}, "model_tokens": {"model_a": [[4419, " an", "normal", 0.010524781420826912]], "model_b": [[4419, " an", "normal", 0.012927494011819363]]}, "loss": {"model_a": 27.426233850232894, "model_b": 26.111277432755976}, "topk": {"model_a": [4419, 13, 0.010524781420826912, [[4811, 0.446342, " to", false], [22249, 0.057155, " out", false], [332, 0.046212, " a", false], [51832, 0.036204, " general", false], [22590, 0.034568, " the", false], [32448, 0.03139, " ways", false], [52224, 0.026279, " methods", false], [59943, 0.016851, " knowledge", false], [38720, 0.015143, " human", false], [31458, 0.014834, " more", false]]], "model_b": [4419, 9, 0.012927494011819363, [[4811, 0.492216, " to", false], [22590, 0.045277, " the", false], [332, 0.044369, " a", false], [22249, 0.035407, " out", false], [31458, 0.030987, " more", false], [32448, 0.021506, " ways", false], [32234, 0.021295, " this", false], [30789, 0.013811, " ever", false], [4419, 0.012927, " an", false], [45301, 0.012166, " better", false]]]}, "raw_delta": 0.07291666666666652, "tuned_delta": 0.12577161056486635}, {"byte_start": 681, "byte_end": 693, "display": {"text": " improvement", "kind": "normal"}, "is_word": true, "word_id": 116, "word_key": " improvement", "bytes_hex": "20 69 6d 70 72 6f 76 65 6d 65 6e 74", "compression": {"model_a": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60%", "model_b": "3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"model_a": [[63621, " improvement", "normal", 0.04658503830432892]], "model_b": [[63621, " improvement", "normal", 0.1079857274889946]]}, "loss": {"model_a": 4.602347461169219, "model_b": 3.3343537728879036}, "topk": {"model_a": [63621, 4, 0.04658503830432892, [[30729, 0.076863, " edge", false], [59093, 0.069208, " advantage", false], [63277, 0.048669, " alternative", false], [63621, 0.046585, " improvement", false], [3609, 0.04442, " AI", false], [52371, 0.032217, " optimal", false], [55532, 0.02862, " approach", false], [30789, 0.028553, " ever", false], [63560, 0.026882, " explanation", false], [40077, 0.025395, " upper", false]]], "model_b": [63621, 1, 0.1079857274889946, [[63621, 0.107986, " improvement", false], [30789, 0.084942, " ever", false], [63563, 0.047507, " exponential", false], [59594, 0.040879, " efficient", false], [63560, 0.036387, " explanation", false], [52371, 0.035341, " optimal", false], [56433, 0.029344, " increase", false], [59593, 0.025246, " effective", false], [59113, 0.021777, " algorithm", false], [30788, 0.019989, " even", false]]]}, "raw_delta": 0.07031249999999999, "tuned_delta": 0.12316744389819981}, {"byte_start": 693, "byte_end": 698, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 117, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "13.13% 13.13% 13.13% 13.13% 13.13%", "model_b": "11.38% 11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.026305479928851128]], "model_b": [[32227, " that", "normal", 0.043011624366045]]}, "loss": {"model_a": 13.130779083090955, "model_b": 11.383765557014476}, "topk": {"model_a": [32227, 5, 0.026305479928851128, [[4596, 0.49114, " in", false], [4450, 0.12489, " by", false], [4706, 0.124764, " of", false], [31601, 0.030287, " over", false], [32227, 0.026305, " that", false], [4811, 0.0256, " to", false], [4712, 0.019347, " on", false], [30917, 0.016626, " from", false], [32487, 0.011996, " with", false], [53140, 0.011436, " through", false]]], "model_b": [32227, 5, 0.043011624366045, [[4596, 0.466543, " in", false], [31601, 0.092325, " over", false], [4600, 0.066472, " is", false], [4712, 0.055311, " on", false], [32227, 0.043012, " that", false], [45, 0.03117, ",", false], [4706, 0.02306, " of", false], [4811, 0.020753, " to", false], [38989, 0.00787, " means", false], [4450, 0.00779, " by", false]]]}, "raw_delta": 0.09687500000000004, "tuned_delta": 0.14972994389819988}, {"byte_start": 698, "byte_end": 704, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 118, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"model_a": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "model_b": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"model_a": [[38964, " makes", "normal", 0.0063440874218940735]], "model_b": [[38964, " makes", "normal", 0.014538269490003586]]}, "loss": {"model_a": 15.215924259375784, "model_b": 12.679936882813154}, "topk": {"model_a": [38964, 23, 0.0063440874218940735, [[4600, 0.235056, " is", false], [57102, 0.073091, " requires", false], [56540, 0.069132, " leverage", false], [21413, 0.058403, " can", false], [40219, 0.040163, " would", false], [31581, 0.023398, " only", false], [22748, 0.023257, " was", false], [38278, 0.022887, " doesn", false], [38087, 0.0211, " comes", false], [30659, 0.02105, " does", false]]], "model_b": [38964, 12, 0.014538269490003586, [[4600, 0.145969, " is", false], [56540, 0.121731, " leverage", false], [21413, 0.064271, " can", false], [47181, 0.043312, " scales", false], [57102, 0.037699, " requires", false], [40219, 0.028408, " would", false], [38278, 0.026713, " doesn", false], [30659, 0.020343, " does", false], [32356, 0.02, " uses", false], [39888, 0.016898, " takes", false]]]}, "raw_delta": 0.140625, "tuned_delta": 0.19347994389819984}, {"byte_start": 704, "byte_end": 706, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 119, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "26.21% 26.21%", "model_b": "31.28% 31.28%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.05422629788517952]], "model_b": [[332, " a", "normal", 0.03094947524368763]]}, "loss": {"model_a": 26.205202891147184, "model_b": 31.277177644272445}, "topk": {"model_a": [332, 4, 0.05422629788517952, [[22681, 0.273443, " use", false], [22590, 0.131792, " the", false], [4692, 0.064343, " no", false], [332, 0.054226, " a", false], [45301, 0.026396, " better", false], [39631, 0.025542, " sense", false], [4601, 0.023307, " it", false], [4833, 0.020211, " up", false], [30992, 0.01893, " good", false], [4419, 0.015025, " an", false]]], "model_b": [332, 4, 0.03094947524368763, [[22681, 0.272129, " use", false], [22590, 0.231689, " the", false], [32234, 0.064964, " this", false], [332, 0.030949, " a", false], [4833, 0.025961, " up", false], [4601, 0.025811, " it", false], [30923, 0.022306, " full", false], [45301, 0.01727, " better", false], [63370, 0.016822, " computation", false], [31458, 0.01351, " more", false]]]}, "raw_delta": -0.28125, "tuned_delta": -0.22839505610180016}, {"byte_start": 706, "byte_end": 717, "display": {"text": " difference", "kind": "normal"}, "is_word": true, "word_id": 120, "word_key": " difference", "bytes_hex": "20 64 69 66 66 65 72 65 6e 63 65", "compression": {"model_a": "4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33%", "model_b": "3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41%"}, "model_tokens": {"model_a": [[61863, " difference", "normal", 0.07142824679613113]], "model_b": [[61863, " difference", "normal", 0.1263003945350647]]}, "loss": {"model_a": 4.329109764031157, "model_b": 3.406932536190201}, "topk": {"model_a": [61863, 1, 0.07142824679613113, [[61863, 0.071428, " difference", false], [38594, 0.048289, " given", false], [3483, 0.045238, " 10", false], [39720, 0.032887, " small", false], [52232, 0.027232, " million", false], [56587, 0.022971, " marginal", false], [38864, 0.021362, " large", false], [21357, 0.020284, " big", false], [284, 0.019764, " 1", false], [63870, 0.019147, " significant", false]]], "model_b": [61863, 1, 0.1263003945350647, [[61863, 0.1263, " difference", false], [63870, 0.056766, " significant", false], [39720, 0.036531, " small", false], [47289, 0.035455, " single", false], [63370, 0.02528, " computation", false], [38594, 0.024183, " given", false], [38864, 0.024181, " large", false], [52167, 0.019965, " machine", false], [21357, 0.016688, " big", false], [31458, 0.015196, " more", false]]]}, "raw_delta": 0.05113636363636364, "tuned_delta": 0.10399130753456345}, {"byte_start": 717, "byte_end": 720, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 121, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "10.57% 10.57% 10.57%", "model_b": "10.61% 10.61% 10.61%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.17373314499855042]], "model_b": [[4596, " in", "normal", 0.17110073566436768]]}, "loss": {"model_a": 10.566614069010962, "model_b": 10.613576798206566}, "topk": {"model_a": [4596, 1, 0.17373314499855042, [[4596, 0.173733, " in", false], [4811, 0.106199, " to", false], [4600, 0.077138, " is", false], [45, 0.064675, ",", false], [57102, 0.063702, " requires", false], [39971, 0.042596, " today", false], [4450, 0.039749, " by", false], [32475, 0.02406, " will", false], [31601, 0.022401, " over", false], [32487, 0.02149, " with", false]]], "model_b": [4596, 1, 0.17110073566436768, [[4596, 0.171101, " in", false], [4600, 0.108452, " is", false], [45, 0.05479, ",", false], [4712, 0.048443, " on", false], [57102, 0.046695, " requires", false], [31601, 0.041971, " over", false], [32487, 0.039053, " with", false], [4811, 0.034412, " to", false], [4424, 0.024666, " at", false], [32465, 0.020107, " when", false]]]}, "raw_delta": -0.0026041666666666297, "tuned_delta": 0.05025077723153319}, {"byte_start": 720, "byte_end": 724, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 122, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "4.79% 4.79% 4.79% 4.79%", "model_b": "6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.3486831486225128]], "model_b": [[22590, " the", "normal", 0.22262263298034668]]}, "loss": {"model_a": 4.7901983779516355, "model_b": 6.833077097960421}, "topk": {"model_a": [22590, 1, 0.3486831486225128, [[22590, 0.348683, " the", false], [332, 0.136279, " a", false], [39920, 0.051654, " terms", false], [32234, 0.045685, " this", false], [31835, 0.035525, " real", false], [56901, 0.019877, " practice", false], [63750, 0.019826, " performance", false], [4419, 0.019328, " an", false], [38720, 0.016056, " human", false], [3483, 0.011287, " 10", false]]], "model_b": [22590, 1, 0.22262263298034668, [[22590, 0.222623, " the", false], [332, 0.108459, " a", false], [32234, 0.084596, " this", false], [63750, 0.066647, " performance", false], [39920, 0.043111, " terms", false], [32227, 0.040515, " that", false], [63370, 0.027681, " computation", false], [4419, 0.024204, " an", false], [32251, 0.014177, " time", false], [30510, 0.011093, " cost", false]]]}, "raw_delta": -0.11328125, "tuned_delta": -0.06042630610180018}, {"byte_start": 724, "byte_end": 732, "display": {"text": " shorter", "kind": "normal"}, "is_word": true, "word_id": 123, "word_key": " shorter", "bytes_hex": "20 73 68 6f 72 74 65 72", "compression": {"model_a": "16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62%", "model_b": "19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"model_a": [[52888, " shorter", "normal", 0.0006355251534841955]], "model_b": [[52888, " shorter", "normal", 0.00021023189765401185]]}, "loss": {"model_a": 16.62480613524391, "model_b": 19.160793511806542}, "topk": {"model_a": [52888, 134, 0.0006355251534841955, [[31835, 0.19428, " real", false], [40213, 0.088118, " world", false], [31323, 0.069582, " long", false], [30807, 0.050246, " face", false], [39675, 0.041536, " short", false], [31515, 0.036005, " next", false], [32251, 0.029583, " time", false], [31503, 0.019971, " near", false], [46064, 0.01799, " future", false], [38621, 0.015178, " grand", false]]], "model_b": [52888, 439, 0.00021023189765401185, [[63370, 0.08135, " computation", false], [45157, 0.050776, " amount", false], [30510, 0.043752, " cost", false], [46685, 0.040027, " number", false], [31323, 0.034041, " long", false], [40213, 0.028839, " world", false], [63750, 0.020107, " performance", false], [39590, 0.01757, " scale", false], [32373, 0.0165, " vast", false], [51310, 0.015685, " context", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08777005610180018}, {"byte_start": 732, "byte_end": 737, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 124, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"model_a": "1.55% 1.55% 1.55% 1.55% 1.55%", "model_b": "1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"model_a": [[32219, " term", "normal", 0.6534224152565002]], "model_b": [[32219, " term", "normal", 0.6267225742340088]]}, "loss": {"model_a": 1.549770063454941, "model_b": 1.6977026604210945}, "topk": {"model_a": [32219, 1, 0.6534224152565002, [[32219, 0.653422, " term", false], [22418, 0.1405, " run", false], [32251, 0.086982, " time", false], [46, 0.057006, "-", false], [51940, 0.007935, " horizon", false], [39962, 0.005454, " times", false], [4715, 0.005118, " or", false], [21265, 0.003559, " and", false], [46064, 0.00324, " future", false], [39920, 0.003005, " terms", false]]], "model_b": [32219, 1, 0.6267225742340088, [[32219, 0.626723, " term", false], [32251, 0.109744, " time", false], [22418, 0.095135, " run", false], [46, 0.044843, "-", false], [39962, 0.015796, " times", false], [39438, 0.014662, " range", false], [39920, 0.009554, " terms", false], [45157, 0.008426, " amount", false], [45, 0.005743, ",", false], [46790, 0.005405, " period", false]]]}, "raw_delta": -0.008203125000000006, "tuned_delta": 0.044651818898199816}, {"byte_start": 737, "byte_end": 738, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "40.29%", "model_b": "41.98%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.10498012602329254]], "model_b": [[45, ",", "normal", 0.09833226352930069]]}, "loss": {"model_a": 40.294021649828466, "model_b": 41.98467990087022}, "topk": {"model_a": [45, 2, 0.10498012602329254, [[4600, 0.293702, " is", false], [45, 0.10498, ",", false], [275, 0.047777, " (", false], [57102, 0.038099, " requires", false], [32475, 0.03689, " will", false], [22074, 0.035225, " may", false], [21413, 0.032759, " can", false], [4450, 0.031965, " by", false], [53356, 0.01873, " without", false], [40219, 0.016737, " would", false]]], "model_b": [45, 2, 0.09833226352930069, [[4600, 0.343255, " is", false], [45, 0.098332, ",", false], [57102, 0.048077, " requires", false], [21413, 0.040561, " can", false], [275, 0.036537, " (", false], [32475, 0.029583, " will", false], [38989, 0.023944, " means", false], [21800, 0.022101, " has", false], [22074, 0.019614, " may", false], [51019, 0.016072, " becomes", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.04089505610180018}, {"byte_start": 738, "byte_end": 750, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 125, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%", "model_b": "4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.0376972034573555]], "model_b": [[63843, " researchers", "normal", 0.04390420392155647]]}, "loss": {"model_a": 4.931086565538449, "model_b": 4.6962729195604265}, "topk": {"model_a": [63843, 5, 0.0376972034573555, [[22590, 0.058891, " the", false], [4858, 0.056574, " we", false], [40187, 0.050609, " while", false], [21265, 0.047302, " and", false], [63843, 0.037697, " researchers", false], [21400, 0.030886, " but", false], [22226, 0.029276, " one", false], [53356, 0.028301, " without", false], [4450, 0.026598, " by", false], [4715, 0.026236, " or", false]]], "model_b": [63843, 4, 0.04390420392155647, [[22590, 0.131028, " the", false], [4858, 0.068622, " we", false], [3609, 0.068544, " AI", false], [63843, 0.043904, " researchers", false], [21265, 0.035981, " and", false], [332, 0.033678, " a", false], [4419, 0.032044, " an", false], [22226, 0.026515, " one", false], [31461, 0.023659, " most", false], [45124, 0.020433, " agents", false]]]}, "raw_delta": 0.013020833333333315, "tuned_delta": 0.06587577723153314}, {"byte_start": 750, "byte_end": 755, "display": {"text": " seek", "kind": "normal"}, "is_word": true, "word_id": 126, "word_key": " seek", "bytes_hex": "20 73 65 65 6b", "compression": {"model_a": "21.19% 21.19% 21.19% 21.19% 21.19%", "model_b": "16.79% 16.79% 16.79% 16.79% 16.79%"}, "model_tokens": {"model_a": [[31966, " seek", "normal", 0.0028180989902466536]], "model_b": [[31966, " seek", "normal", 0.009521298110485077]]}, "loss": {"model_a": 21.18958341305665, "model_b": 16.79387196034809}, "topk": {"model_a": [31966, 39, 0.0028180989902466536, [[31059, 0.204285, " have", false], [39171, 0.094283, " often", false], [32475, 0.068604, " will", false], [32216, 0.052431, " tend", false], [21286, 0.052156, " are", false], [21413, 0.025847, " can", false], [60687, 0.025119, " typically", false], [22074, 0.020277, " may", false], [47266, 0.015542, " should", false], [4596, 0.015538, " in", false]]], "model_b": [31966, 15, 0.009521298110485077, [[31059, 0.175198, " have", false], [39171, 0.069177, " often", false], [21286, 0.067641, " are", false], [32475, 0.055887, " will", false], [32216, 0.026889, " tend", false], [21413, 0.021828, " can", false], [60687, 0.019658, " typically", false], [32230, 0.017155, " then", false], [38530, 0.01567, " focus", false], [31475, 0.014021, " must", false]]]}, "raw_delta": 0.24375, "tuned_delta": 0.2966049438981998}, {"byte_start": 755, "byte_end": 758, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 127, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "6.43% 6.43% 6.43%", "model_b": "5.26% 5.26% 5.26%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.3439498543739319]], "model_b": [[4811, " to", "normal", 0.41991060972213745]]}, "loss": {"model_a": 6.433893899797785, "model_b": 5.259825669907679}, "topk": {"model_a": [4811, 1, 0.3439498543739319, [[4811, 0.34395, " to", false], [332, 0.088637, " a", false], [52224, 0.060815, " methods", false], [22249, 0.054364, " out", false], [32448, 0.034725, " ways", false], [4419, 0.029618, " an", false], [22590, 0.028553, " the", false], [64423, 0.026607, " improvements", false], [22168, 0.012943, " new", false], [31458, 0.011837, " more", false]]], "model_b": [4811, 1, 0.41991060972213745, [[4811, 0.419911, " to", false], [332, 0.068311, " a", false], [22249, 0.04502, " out", false], [22590, 0.037962, " the", false], [32448, 0.033553, " ways", false], [4419, 0.025449, " an", false], [51832, 0.020662, " general", false], [52224, 0.020035, " methods", false], [31458, 0.017561, " more", false], [60521, 0.010948, " solutions", false]]]}, "raw_delta": 0.06510416666666663, "tuned_delta": 0.11795911056486645}, {"byte_start": 758, "byte_end": 767, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 128, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"model_a": "4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20%", "model_b": "3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96%"}, "model_tokens": {"model_a": [[56540, " leverage", "normal", 0.12291303277015686]], "model_b": [[56540, " leverage", "normal", 0.1397588700056076]]}, "loss": {"model_a": 4.195337141473982, "model_b": 3.9605234954959605}, "topk": {"model_a": [56540, 2, 0.12291303277015686, [[51982, 0.141784, " improve", false], [56540, 0.122913, " leverage", false], [51690, 0.057226, " exploit", false], [30858, 0.038497, " find", false], [31358, 0.037455, " make", false], [22681, 0.032622, " use", false], [37730, 0.029026, " apply", false], [37923, 0.017015, " build", false], [4491, 0.016294, " do", false], [56433, 0.016195, " increase", false]]], "model_b": [56540, 1, 0.1397588700056076, [[56540, 0.139759, " leverage", false], [51982, 0.050235, " improve", false], [22681, 0.049306, " use", false], [30858, 0.047346, " find", false], [31358, 0.035336, " make", false], [51690, 0.026679, " exploit", false], [37730, 0.02595, " apply", false], [56769, 0.020028, " optimize", false], [56604, 0.019047, " maximize", false], [56433, 0.018653, " increase", false]]]}, "raw_delta": 0.013020833333333343, "tuned_delta": 0.06587577723153316}, {"byte_start": 767, "byte_end": 773, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 129, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "9.77% 9.77% 9.77% 9.77% 9.77% 9.77%", "model_b": "13.43% 13.43% 13.43% 13.43% 13.43% 13.43%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.03830163553357124]], "model_b": [[39931, " their", "normal", 0.011649243533611298]]}, "loss": {"model_a": 9.768247672685687, "model_b": 13.43134054994282}, "topk": {"model_a": [39931, 6, 0.03830163553357124, [[22590, 0.205276, " the", false], [38720, 0.116191, " human", false], [32234, 0.092419, " this", false], [32227, 0.060419, " that", false], [32464, 0.045077, " what", false], [39931, 0.038302, " their", false], [56173, 0.032576, " existing", false], [57564, 0.021259, " whatever", false], [59943, 0.020347, " knowledge", false], [63370, 0.020123, " computation", false]]], "model_b": [39931, 14, 0.011649243533611298, [[22590, 0.199124, " the", false], [32234, 0.105042, " this", false], [32227, 0.037533, " that", false], [332, 0.030904, " a", false], [31458, 0.02948, " more", false], [38720, 0.027725, " human", false], [63370, 0.027714, " computation", false], [56173, 0.027229, " existing", false], [4423, 0.021769, " as", false], [39936, 0.017476, " these", false]]]}, "raw_delta": -0.203125, "tuned_delta": -0.15027005610180016}, {"byte_start": 773, "byte_end": 779, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 130, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "9.44% 9.44% 9.44% 9.44% 9.44% 9.44%", "model_b": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.04337504506111145]], "model_b": [[38720, " human", "normal", 0.017653323709964752]]}, "loss": {"model_a": 9.439508568316459, "model_b": 12.116384132465903}, "topk": {"model_a": [38720, 6, 0.04337504506111145, [[52140, 0.12878, " limited", false], [59943, 0.100831, " knowledge", false], [51372, 0.072739, " current", false], [56173, 0.072297, " existing", false], [22251, 0.07091, " own", false], [38720, 0.043375, " human", false], [39720, 0.022704, " small", false], [59206, 0.019819, " available", false], [65034, 0.017831, " understanding", false], [22168, 0.013918, " new", false]]], "model_b": [38720, 10, 0.017653323709964752, [[51372, 0.088062, " current", false], [59943, 0.07964, " knowledge", false], [64862, 0.063871, " computational", false], [56173, 0.05605, " existing", false], [59206, 0.040655, " available", false], [52140, 0.035224, " limited", false], [63370, 0.025844, " computation", false], [59346, 0.024109, " computing", false], [60406, 0.020413, " resources", false], [38720, 0.017653, " human", false]]]}, "raw_delta": -0.1484375, "tuned_delta": -0.09558255610180018}, {"byte_start": 779, "byte_end": 789, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 131, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51%", "model_b": "0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.7540845274925232]], "model_b": [[59943, " knowledge", "normal", 0.6465831995010376]]}, "loss": {"model_a": 0.5142418846918667, "model_b": 0.7784072364171407}, "topk": {"model_a": [59943, 1, 0.7540845274925232, [[59943, 0.754085, " knowledge", false], [64452, 0.024133, " intelligence", false], [46, 0.022596, "-", false], [59683, 0.017896, " expertise", false], [65034, 0.015934, " understanding", false], [59917, 0.013366, " intuition", false], [59305, 0.007544, " cognitive", false], [45346, 0.006096, " brains", false], [21265, 0.005048, " and", false], [64340, 0.004618, " counterparts", false]]], "model_b": [59943, 1, 0.6465831995010376, [[59943, 0.646583, " knowledge", false], [59683, 0.048308, " expertise", false], [46, 0.047439, "-", false], [59917, 0.016071, " intuition", false], [60406, 0.015702, " resources", false], [65034, 0.015638, " understanding", false], [64452, 0.012009, " intelligence", false], [61979, 0.010952, " experience", false], [47297, 0.010292, " skills", false], [21265, 0.007444, " and", false]]]}, "raw_delta": -0.014648437500000003, "tuned_delta": 0.03820650639819982}, {"byte_start": 789, "byte_end": 792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 132, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "19.35% 19.35% 19.35%", "model_b": "20.48% 20.48% 20.48%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.03971828147768974]], "model_b": [[4706, " of", "normal", 0.033065322786569595]]}, "loss": {"model_a": 19.348644428588962, "model_b": 20.475749929283463}, "topk": {"model_a": [4706, 6, 0.03971828147768974, [[45, 0.185263, ",", false], [4811, 0.142993, " to", false], [47, 0.139115, ".", false], [21265, 0.101785, " and", false], [4596, 0.074085, " in", false], [4706, 0.039718, " of", false], [275, 0.031536, " (", false], [30243, 0.028269, " base", false], [4450, 0.026305, " by", false], [4423, 0.023799, " as", false]]], "model_b": [4706, 8, 0.033065322786569595, [[4811, 0.145731, " to", false], [4596, 0.125336, " in", false], [47, 0.115867, ".", false], [45, 0.106885, ",", false], [4423, 0.066701, " as", false], [21265, 0.057862, " and", false], [31458, 0.036554, " more", false], [4706, 0.033065, " of", false], [275, 0.026789, " (", false], [4450, 0.024859, " by", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 792, "byte_end": 796, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 133, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "3.17% 3.17% 3.17% 3.17%", "model_b": "2.52% 2.52% 2.52% 2.52%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.4997093081474304]], "model_b": [[22590, " the", "normal", 0.5733007192611694]]}, "loss": {"model_a": 3.1699842207032884, "model_b": 2.518376353114279}, "topk": {"model_a": [22590, 1, 0.4997093081474304, [[22590, 0.499709, " the", false], [21835, 0.098858, " how", false], [32464, 0.059666, " what", false], [332, 0.050073, " a", false], [40186, 0.010261, " which", false], [45, 0.007527, ",", false], [39931, 0.007518, " their", false], [32074, 0.007477, " some", false], [57564, 0.006917, " whatever", false], [4419, 0.006742, " an", false]]], "model_b": [22590, 1, 0.5733007192611694, [[22590, 0.573301, " the", false], [21835, 0.050713, " how", false], [332, 0.045431, " a", false], [32464, 0.030332, " what", false], [39931, 0.023992, " their", false], [4419, 0.008516, " an", false], [32227, 0.007881, " that", false], [32234, 0.006204, " this", false], [47539, 0.006111, " things", false], [62293, 0.005569, " particular", false]]]}, "raw_delta": 0.0361328125, "tuned_delta": 0.08898775639819982}, {"byte_start": 796, "byte_end": 803, "display": {"text": " domain", "kind": "normal"}, "is_word": true, "word_id": 134, "word_key": " domain", "bytes_hex": "20 64 6f 6d 61 69 6e", "compression": {"model_a": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03% 5.03%", "model_b": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"model_a": [[45775, " domain", "normal", 0.14286352694034576]], "model_b": [[45775, " domain", "normal", 0.014745749533176422]]}, "loss": {"model_a": 5.031720985243315, "model_b": 10.868517328125558}, "topk": {"model_a": [45775, 3, 0.14286352694034576, [[40213, 0.29963, " world", false], [52569, 0.204778, " problem", false], [45775, 0.142864, " domain", false], [32202, 0.076263, " task", false], [63536, 0.038653, " environment", false], [57074, 0.017546, " relevant", false], [60511, 0.012009, " situation", false], [47506, 0.010821, " target", false], [56939, 0.01058, " problems", false], [57271, 0.010262, " specific", false]]], "model_b": [45775, 7, 0.014745749533176422, [[40213, 0.37934, " world", false], [63536, 0.130995, " environment", false], [52569, 0.097011, " problem", false], [37636, 0.034627, " agent", false], [47487, 0.027117, " system", false], [32202, 0.025746, " task", false], [45775, 0.014746, " domain", false], [51372, 0.012662, " current", false], [31461, 0.009616, " most", false], [46064, 0.008883, " future", false]]]}, "raw_delta": -0.32366071428571425, "tuned_delta": -0.2708057703875144}, {"byte_start": 803, "byte_end": 804, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "28.60%", "model_b": "36.91%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.208240807056427]], "model_b": [[45, ",", "normal", 0.13006660342216492]]}, "loss": {"model_a": 28.600302080123, "model_b": 36.91270514774496}, "topk": {"model_a": [45, 1, 0.208240807056427, [[45, 0.208241, ",", false], [47, 0.186016, ".", false], [4596, 0.095621, " in", false], [4811, 0.094185, " to", false], [21265, 0.073866, " and", false], [32232, 0.047489, " they", false], [4706, 0.041489, " of", false], [275, 0.031251, " (", false], [60, 0.021387, ";", false], [4424, 0.017913, " at", false]]], "model_b": [45, 3, 0.13006660342216492, [[4811, 0.194306, " to", false], [47, 0.143957, ".", false], [45, 0.130067, ",", false], [4596, 0.098641, " in", false], [21265, 0.079383, " and", false], [4423, 0.037438, " as", false], [275, 0.03456, " (", false], [4715, 0.028791, " or", false], [4706, 0.020239, " of", false], [4450, 0.018189, " by", false]]]}, "raw_delta": -0.4609375, "tuned_delta": -0.40808255610180016}, {"byte_start": 804, "byte_end": 808, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 135, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "6.23% 6.23% 6.23% 6.23%", "model_b": "10.99% 10.99% 10.99% 10.99%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.251830130815506]], "model_b": [[21400, " but", "normal", 0.08774559944868088]]}, "loss": {"model_a": 6.234302300716467, "model_b": 10.9892786317714}, "topk": {"model_a": [21400, 1, 0.251830130815506, [[21400, 0.25183, " but", false], [21265, 0.13823, " and", false], [40186, 0.110941, " which", false], [40187, 0.042451, " while", false], [4715, 0.036846, " or", false], [4811, 0.019201, " to", false], [47001, 0.018512, " rather", false], [22590, 0.017393, " the", false], [4596, 0.015413, " in", false], [39171, 0.014352, " often", false]]], "model_b": [21400, 3, 0.08774559944868088, [[21265, 0.137566, " and", false], [40186, 0.094434, " which", false], [21400, 0.087746, " but", false], [4715, 0.0737, " or", false], [39931, 0.027892, " their", false], [22590, 0.024585, " the", false], [47001, 0.023902, " rather", false], [40187, 0.020141, " while", false], [30788, 0.019843, " even", false], [4423, 0.019134, " as", false]]]}, "raw_delta": -0.263671875, "tuned_delta": -0.21081693110180016}, {"byte_start": 808, "byte_end": 812, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 136, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.71% 10.71% 10.71% 10.71%", "model_b": "10.14% 10.14% 10.14% 10.14%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09366680681705475]], "model_b": [[22590, " the", "normal", 0.10498224198818207]]}, "loss": {"model_a": 10.707502256597774, "model_b": 10.143949506250523}, "topk": {"model_a": [22590, 3, 0.09366680681705475, [[32234, 0.115817, " this", false], [4596, 0.115752, " in", false], [22590, 0.093667, " the", false], [31601, 0.050396, " over", false], [32227, 0.049087, " that", false], [4423, 0.032681, " as", false], [4588, 0.026327, " if", false], [45, 0.024461, ",", false], [4601, 0.02399, " it", false], [32232, 0.022225, " they", false]]], "model_b": [22590, 1, 0.10498224198818207, [[22590, 0.104982, " the", false], [32234, 0.104047, " this", false], [4596, 0.066064, " in", false], [4423, 0.057097, " as", false], [32227, 0.031445, " that", false], [45, 0.02628, ",", false], [32232, 0.025373, " they", false], [4601, 0.022414, " it", false], [61959, 0.019917, " eventually", false], [62676, 0.018216, " ultimately", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 812, "byte_end": 817, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 137, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "12.45% 12.45% 12.45% 12.45% 12.45%", "model_b": "19.05% 19.05% 19.05% 19.05% 19.05%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.03149599954485893]], "model_b": [[31581, " only", "normal", 0.005107465200126171]]}, "loss": {"model_a": 12.454515782674253, "model_b": 19.04808296173709}, "topk": {"model_a": [31581, 4, 0.03149599954485893, [[46470, 0.074251, " longer", false], [31323, 0.064428, " long", false], [31461, 0.032997, " most", false], [31581, 0.031496, " only", false], [57481, 0.025686, " ultimate", false], [31458, 0.023001, " more", false], [31835, 0.021642, " real", false], [30510, 0.018201, " cost", false], [46397, 0.017979, " larger", false], [45305, 0.016338, " bigger", false]]], "model_b": [31581, 27, 0.005107465200126171, [[46470, 0.137408, " longer", false], [31458, 0.043496, " more", false], [38720, 0.031943, " human", false], [45775, 0.028748, " domain", false], [31323, 0.024188, " long", false], [30510, 0.018756, " cost", false], [47092, 0.013578, " result", false], [52569, 0.013305, " problem", false], [30808, 0.011456, " fact", false], [46397, 0.01132, " larger", false]]]}, "raw_delta": -0.36562499999999987, "tuned_delta": -0.31277005610180003}, {"byte_start": 817, "byte_end": 823, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 138, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"model_a": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%", "model_b": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%"}, "model_tokens": {"model_a": [[39941, " thing", "normal", 0.048600438982248306]], "model_b": [[39941, " thing", "normal", 0.04799336567521095]]}, "loss": {"model_a": 9.11076946394723, "model_b": 9.11076946394723}, "topk": {"model_a": [39941, 2, 0.048600438982248306, [[22752, 0.497402, " way", false], [39941, 0.0486, " thing", false], [31835, 0.02257, " real", false], [47009, 0.020523, " reason", false], [31323, 0.019892, " long", false], [59593, 0.018681, " effective", false], [51832, 0.012703, " general", false], [56540, 0.011773, " leverage", false], [57075, 0.009731, " reliable", false], [46561, 0.007627, " method", false]]], "model_b": [39941, 2, 0.04799336567521095, [[22752, 0.426255, " way", false], [39941, 0.047993, " thing", false], [32251, 0.026831, " time", false], [47009, 0.025694, " reason", false], [31835, 0.022928, " real", false], [59593, 0.01839, " effective", false], [38720, 0.014209, " human", false], [52569, 0.009684, " problem", false], [45775, 0.008708, " domain", false], [32313, 0.007953, " true", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 823, "byte_end": 828, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 139, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.58% 1.58% 1.58% 1.58% 1.58%", "model_b": "2.56% 2.56% 2.56% 2.56% 2.56%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.6426860094070435]], "model_b": [[32227, " that", "normal", 0.49834901094436646]]}, "loss": {"model_a": 1.5779477009723035, "model_b": 2.564165014079993}, "topk": {"model_a": [32227, 1, 0.6426860094070435, [[32227, 0.642686, " that", false], [32232, 0.093175, " they", false], [4858, 0.021197, " we", false], [32234, 0.018932, " this", false], [31458, 0.012871, " more", false], [59206, 0.010524, " available", false], [22799, 0.00951, " you", false], [4811, 0.009117, " to", false], [52072, 0.008687, " keeping", false], [62364, 0.00796, " preventing", false]]], "model_b": [32227, 1, 0.49834901094436646, [[32227, 0.498349, " that", false], [32232, 0.210379, " they", false], [4811, 0.026294, " to", false], [32234, 0.021366, " this", false], [4858, 0.016788, " we", false], [31458, 0.01215, " more", false], [22799, 0.011228, " you", false], [22590, 0.010246, " the", false], [46227, 0.00981, " humans", false], [31269, 0.009746, " left", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0018325561018001785}, {"byte_start": 828, "byte_end": 836, "display": {"text": " matters", "kind": "normal"}, "is_word": true, "word_id": 140, "word_key": " matters", "bytes_hex": "20 6d 61 74 74 65 72 73", "compression": {"model_a": "3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65%", "model_b": "7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15%"}, "model_tokens": {"model_a": [[52201, " matters", "normal", 0.2004719376564026]], "model_b": [[52201, " matters", "normal", 0.042006853967905045]]}, "loss": {"model_a": 3.6454818538087816, "model_b": 7.15007552003075}, "topk": {"model_a": [52201, 1, 0.2004719376564026, [[52201, 0.200472, " matters", false], [21413, 0.114818, " can", false], [4600, 0.064571, " is", false], [32475, 0.056278, " will", false], [38964, 0.047384, " makes", false], [47008, 0.033447, " really", false], [460, 0.032282, "'s", false], [56540, 0.018474, " leverage", false], [21800, 0.018424, " has", false], [56925, 0.016481, " prevents", false]]], "model_b": [52201, 4, 0.042006853967905045, [[21413, 0.317466, " can", false], [4600, 0.061082, " is", false], [32232, 0.060769, " they", false], [52201, 0.042007, " matters", false], [47008, 0.036688, " really", false], [38964, 0.033597, " makes", false], [32475, 0.030067, " will", false], [40024, 0.017198, " truly", false], [56419, 0.016773, " improves", false], [460, 0.012999, "'s", false]]]}, "raw_delta": -0.1943359375, "tuned_delta": -0.14148099360180016}, {"byte_start": 836, "byte_end": 839, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 141, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "3.05% 3.05% 3.05%", "model_b": "9.67% 9.67% 9.67%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.6060921549797058]], "model_b": [[4596, " in", "normal", 0.19967585802078247]]}, "loss": {"model_a": 3.052577397714278, "model_b": 9.674322214294481}, "topk": {"model_a": [4596, 1, 0.6060921549797058, [[4596, 0.606092, " in", false], [4600, 0.101898, " is", false], [21700, 0.082263, " for", false], [31601, 0.048016, " over", false], [31323, 0.045813, " long", false], [4811, 0.013915, " to", false], [4712, 0.008529, " on", false], [4424, 0.008273, " at", false], [32465, 0.007842, " when", false], [46470, 0.007599, " longer", false]]], "model_b": [4596, 2, 0.19967585802078247, [[4600, 0.452571, " is", false], [4596, 0.199676, " in", false], [21700, 0.05296, " for", false], [4811, 0.042076, " to", false], [31461, 0.025693, " most", false], [4424, 0.020049, " at", false], [21286, 0.019004, " are", false], [37598, 0.016087, " about", false], [32465, 0.014449, " when", false], [62676, 0.014143, " ultimately", false]]]}, "raw_delta": -0.3671875, "tuned_delta": -0.31433255610180016}, {"byte_start": 839, "byte_end": 843, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 142, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.17% 0.17% 0.17% 0.17%", "model_b": "1.29% 1.29% 1.29% 1.29%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.9638855457305908]], "model_b": [[22590, " the", "normal", 0.7525882124900818]]}, "loss": {"model_a": 0.16620403379381823, "model_b": 1.285604711729667}, "topk": {"model_a": [22590, 1, 0.9638855457305908, [[22590, 0.963886, " the", false], [332, 0.006474, " a", false], [39920, 0.003357, " terms", false], [56901, 0.003055, " practice", false], [32234, 0.002919, " this", false], [31323, 0.001549, " long", false], [32227, 0.001487, " that", false], [46470, 0.001411, " longer", false], [3609, 0.001314, " AI", false], [4419, 0.001299, " an", false]]], "model_b": [22590, 1, 0.7525882124900818, [[22590, 0.752588, " the", false], [32234, 0.037005, " this", false], [39920, 0.034409, " terms", false], [332, 0.025431, " a", false], [56901, 0.024137, " practice", false], [31323, 0.01567, " long", false], [32227, 0.012871, " that", false], [3609, 0.007868, " AI", false], [4419, 0.005413, " an", false], [39936, 0.004936, " these", false]]]}, "raw_delta": -0.06207275390625, "tuned_delta": -0.009217810008050178}, {"byte_start": 843, "byte_end": 848, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 143, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"model_a": "2.13% 2.13% 2.13% 2.13% 2.13%", "model_b": "0.94% 0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"model_a": [[31323, " long", "normal", 0.5550923943519592]], "model_b": [[31323, " long", "normal", 0.7691910266876221]]}, "loss": {"model_a": 2.1274116325608734, "model_b": 0.9439508568316459}, "topk": {"model_a": [31323, 1, 0.5550923943519592, [[31323, 0.555092, " long", false], [46470, 0.401848, " longer", false], [21616, 0.010697, " end", false], [32386, 0.003662, " very", false], [39675, 0.003292, " short", false], [52888, 0.002522, " shorter", false], [46536, 0.002027, " medium", false], [51310, 0.001605, " context", false], [46397, 0.001583, " larger", false], [46064, 0.001403, " future", false]]], "model_b": [31323, 1, 0.7691910266876221, [[31323, 0.769191, " long", false], [46470, 0.13437, " longer", false], [21616, 0.030921, " end", false], [39675, 0.011648, " short", false], [38491, 0.002543, " final", false], [32386, 0.002282, " very", false], [21357, 0.002238, " big", false], [51310, 0.001669, " context", false], [31503, 0.001624, " near", false], [46536, 0.001547, " medium", false]]]}, "raw_delta": 0.06562499999999999, "tuned_delta": 0.11847994389819981}, {"byte_start": 848, "byte_end": 852, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 144, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "3.12% 3.12% 3.12% 3.12%", "model_b": "4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.5008130669593811]], "model_b": [[22418, " run", "normal", 0.36995312571525574]]}, "loss": {"model_a": 3.1171511503582336, "model_b": 4.490810979329659}, "topk": {"model_a": [22418, 1, 0.5008130669593811, [[22418, 0.500813, " run", false], [32219, 0.46085, " term", false], [46, 0.026011, "-", false], [31057, 0.003534, " haul", false], [30941, 0.001865, " game", false], [27132, 0.00141, "term", false], [32398, 0.0004, " view", false], [32186, 0.000369, " tail", false], [8661, 0.00035, "run", false], [45, 0.000263, ",", false]]], "model_b": [22418, 2, 0.36995312571525574, [[32219, 0.585919, " term", false], [22418, 0.369953, " run", false], [46, 0.032094, "-", false], [31057, 0.001661, " haul", false], [39920, 0.00109, " terms", false], [27132, 0.000968, "term", false], [32186, 0.000541, " tail", false], [39438, 0.000536, " range", false], [32398, 0.000512, " view", false], [30941, 0.000436, " game", false]]]}, "raw_delta": -0.076171875, "tuned_delta": -0.02331693110180018}, {"byte_start": 852, "byte_end": 855, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 145, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "0.41% 0.41% 0.41%", "model_b": "0.71% 0.71% 0.71%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.9338439106941223]], "model_b": [[4600, " is", "normal", 0.8883108496665955]]}, "loss": {"model_a": 0.4109238804615374, "model_b": 0.7073761085087893}, "topk": {"model_a": [4600, 1, 0.9338439106941223, [[4600, 0.933844, " is", false], [21286, 0.024813, " are", false], [45, 0.015871, ",", false], [275, 0.005717, " (", false], [21700, 0.004262, " for", false], [4596, 0.002424, " in", false], [32475, 0.001577, " will", false], [37598, 0.000889, " about", false], [4601, 0.000624, " it", false], [4706, 0.000574, " of", false]]], "model_b": [4600, 1, 0.8883108496665955, [[4600, 0.888311, " is", false], [21286, 0.056527, " are", false], [45, 0.012721, ",", false], [21700, 0.008229, " for", false], [275, 0.005513, " (", false], [4596, 0.003003, " in", false], [32475, 0.001761, " will", false], [4811, 0.001747, " to", false], [32465, 0.001605, " when", false], [21265, 0.000941, " and", false]]]}, "raw_delta": -0.016438802083333332, "tuned_delta": 0.03641614181486649}, {"byte_start": 855, "byte_end": 859, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 146, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.49% 5.49% 5.49% 5.49%", "model_b": "5.49% 5.49% 5.49% 5.49%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.29750856757164]], "model_b": [[22590, " the", "normal", 0.302146852016449]]}, "loss": {"model_a": 5.4946393158857, "model_b": 5.4946393158857}, "topk": {"model_a": [22590, 1, 0.29750856757164, [[22590, 0.297509, " the", false], [21835, 0.162856, " how", false], [32227, 0.111396, " that", false], [53342, 0.071444, " whether", false], [32464, 0.040439, " what", false], [38888, 0.034863, " lever", false], [40186, 0.020081, " which", false], [332, 0.011432, " a", false], [63370, 0.010117, " computation", false], [37832, 0.00981, " being", false]]], "model_b": [22590, 1, 0.302146852016449, [[22590, 0.302147, " the", false], [21835, 0.15613, " how", false], [32227, 0.102641, " that", false], [32464, 0.054298, " what", false], [4811, 0.043874, " to", false], [53342, 0.041879, " whether", false], [332, 0.016319, " a", false], [51844, 0.014105, " getting", false], [59346, 0.013328, " computing", false], [63370, 0.011248, " computation", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 859, "byte_end": 865, "display": {"text": " lever", "kind": "normal"}, "is_word": true, "word_id": 147, "word_key": " lever", "bytes_hex": "20 6c 65 76 65 72", "compression": {"model_a": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03%", "model_b": "24.98% 24.98% 24.98% 24.98% 24.98% 24.98%"}, "model_tokens": {"model_a": [[38888, " lever", "normal", 0.006670437753200531]], "model_b": [[38888, " lever", "normal", 0.00024282241065520793]]}, "loss": {"model_a": 15.028073342593368, "model_b": 24.984171932061475}, "topk": {"model_a": [38888, 31, 0.006670437753200531, [[50836, 0.067179, " ability", false], [30510, 0.055712, " cost", false], [45157, 0.045241, " amount", false], [63621, 0.030324, " improvement", false], [39984, 0.021354, " total", false], [31830, 0.020858, " rate", false], [64264, 0.019319, " availability", false], [51832, 0.018484, " general", false], [63370, 0.018444, " computation", false], [56540, 0.018008, " leverage", false]]], "model_b": [38888, 392, 0.00024282241065520793, [[50836, 0.066566, " ability", false], [45157, 0.059078, " amount", false], [39759, 0.038038, " speed", false], [63621, 0.037719, " improvement", false], [30510, 0.031379, " cost", false], [63750, 0.020754, " performance", false], [63563, 0.020294, " exponential", false], [64862, 0.020226, " computational", false], [30808, 0.017376, " fact", false], [63370, 0.016973, " computation", false]]]}, "raw_delta": -0.5520833333333334, "tuned_delta": -0.49922838943513353}, {"byte_start": 865, "byte_end": 870, "display": {"text": "aging", "kind": "normal"}, "is_word": true, "word_id": 148, "word_key": "aging", "bytes_hex": "61 67 69 6e 67", "compression": {"model_a": "0.65% 0.65% 0.65% 0.65% 0.65%", "model_b": "0.50% 0.50% 0.50% 0.50% 0.50%"}, "model_tokens": {"model_a": [[33672, "aging", "normal", 0.8370016813278198]], "model_b": [[33672, "aging", "normal", 0.8712981939315796]]}, "loss": {"model_a": 0.6480856628993389, "model_b": 0.4966308612435152}, "topk": {"model_a": [33672, 1, 0.8370016813278198, [[33672, 0.837002, "aging", false], [32227, 0.050296, " that", false], [116, 0.030351, "s", false], [4706, 0.018461, " of", false], [32232, 0.007168, " they", false], [59206, 0.006025, " available", false], [7856, 0.006006, "ing", false], [22799, 0.005976, " you", false], [1843, 0.005552, "ed", false], [56976, 0.001744, " provided", false]]], "model_b": [33672, 1, 0.8712981939315796, [[33672, 0.871298, "aging", false], [7856, 0.030571, "ing", false], [1843, 0.025312, "ed", false], [32227, 0.018324, " that", false], [460, 0.005598, "'s", false], [116, 0.004414, "s", false], [4706, 0.004366, " of", false], [21289, 0.003716, " arm", false], [46, 0.00249, "-", false], [48811, 0.002273, "ability", false]]]}, "raw_delta": 0.008398437499999998, "tuned_delta": 0.061253381398199816}, {"byte_start": 870, "byte_end": 873, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 149, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.18% 0.18% 0.18%", "model_b": "0.80% 0.80% 0.80%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9696750044822693]], "model_b": [[4706, " of", "normal", 0.8750953674316406]]}, "loss": {"model_a": 0.18418195356401051, "model_b": 0.8042367374747231}, "topk": {"model_a": [4706, 1, 0.9696750044822693, [[4706, 0.969675, " of", false], [22590, 0.004793, " the", false], [32227, 0.004511, " that", false], [63370, 0.002537, " computation", false], [31458, 0.001477, " more", false], [59206, 0.001291, " available", false], [21265, 0.00084, " and", false], [39339, 0.00065, " power", false], [38720, 0.000465, " human", false], [51832, 0.000454, " general", false]]], "model_b": [4706, 1, 0.8750953674316406, [[4706, 0.875095, " of", false], [32227, 0.027318, " that", false], [45828, 0.016795, " effect", false], [39339, 0.008208, " power", false], [47, 0.005568, ".", false], [22590, 0.004437, " the", false], [4450, 0.003303, " by", false], [21265, 0.002359, " and", false], [4596, 0.001898, " in", false], [61923, 0.001857, " efficiency", false]]]}, "raw_delta": -0.03438313802083333, "tuned_delta": 0.018471805877366493}, {"byte_start": 873, "byte_end": 885, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 150, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76%", "model_b": "3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.3080097734928131]], "model_b": [[63370, " computation", "normal", 0.08924080431461334]]}, "loss": {"model_a": 1.7611023448351601, "model_b": 3.6161301480615293}, "topk": {"model_a": [63370, 1, 0.3080097734928131, [[63370, 0.30801, " computation", false], [22590, 0.137894, " the", false], [30789, 0.054023, " ever", false], [31458, 0.053865, " more", false], [64862, 0.024949, " computational", false], [52195, 0.022591, " massive", false], [59988, 0.021915, " massively", false], [51832, 0.021304, " general", false], [64430, 0.019532, " increasingly", false], [21256, 0.015355, " all", false]]], "model_b": [63370, 2, 0.08924080431461334, [[22590, 0.212819, " the", false], [63370, 0.089241, " computation", false], [64862, 0.061971, " computational", false], [31458, 0.052129, " more", false], [332, 0.037915, " a", false], [39931, 0.037331, " their", false], [59346, 0.033518, " computing", false], [38720, 0.029532, " human", false], [32227, 0.021172, " that", false], [64911, 0.020313, " exponentially", false]]]}, "raw_delta": -0.10286458333333333, "tuned_delta": -0.05000963943513351}, {"byte_start": 885, "byte_end": 886, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "6.97%", "model_b": "12.26%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6808716058731079]], "model_b": [[47, ".", "normal", 0.5058995485305786]]}, "loss": {"model_a": 6.9739652855472345, "model_b": 12.257272320052715}, "topk": {"model_a": [47, 1, 0.6808716058731079, [[47, 0.680872, ".", false], [45, 0.104497, ",", false], [32227, 0.028153, " that", false], [4811, 0.027379, " to", false], [21265, 0.020502, " and", false], [275, 0.014348, " (", false], [59206, 0.013714, " available", false], [46342, 0.011324, " itself", false], [4596, 0.010396, " in", false], [4423, 0.00735, " as", false]]], "model_b": [47, 1, 0.5058995485305786, [[47, 0.5059, ".", false], [45, 0.07046, ",", false], [32227, 0.069067, " that", false], [4811, 0.062494, " to", false], [21265, 0.028212, " and", false], [4450, 0.025956, " by", false], [4596, 0.02355, " in", false], [21700, 0.015127, " for", false], [59206, 0.014799, " available", false], [275, 0.013825, " (", false]]]}, "raw_delta": -0.29296875, "tuned_delta": -0.24011380610180016}, {"byte_start": 886, "byte_end": 892, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 151, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"model_a": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "model_b": "18.22% 18.22% 18.22% 18.22% 18.22% 18.22%"}, "model_tokens": {"model_a": [[37453, " These", "normal", 0.0006089022499509156]], "model_b": [[37453, " These", "normal", 0.002346208319067955]]}, "loss": {"model_a": 22.166408180325217, "model_b": 18.22153892789446}, "topk": {"model_a": [37453, 88, 0.0006089022499509156, [[11, 0.346385, "\n", false], [261, 0.145787, "\n\n", false], [20996, 0.072186, " The", false], [29894, 0.04926, " This", false], [3913, 0.023112, " In", false], [3908, 0.017988, " If", false], [3918, 0.017334, " It", false], [19417, 0.014145, " And", false], [3641, 0.013493, " As", false], [0, 0.013404, "[0]", false]]], "model_b": [37453, 32, 0.002346208319067955, [[11, 0.394843, "\n", false], [261, 0.082366, "\n\n", false], [29894, 0.069066, " This", false], [20996, 0.059172, " The", false], [3913, 0.029432, " In", false], [0, 0.019692, "[0]", false], [3908, 0.016345, " If", false], [3641, 0.012959, " As", false], [3918, 0.012793, " It", false], [29889, 0.01105, " That", false]]]}, "raw_delta": 0.21875, "tuned_delta": 0.27160494389819984}, {"byte_start": 892, "byte_end": 896, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 152, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"model_a": "10.07% 10.07% 10.07% 10.07%", "model_b": "13.81% 13.81% 13.81% 13.81%"}, "model_tokens": {"model_a": [[22638, " two", "normal", 0.1077016070485115]], "model_b": [[22638, " two", "normal", 0.04687315225601196]]}, "loss": {"model_a": 10.073505412457116, "model_b": 13.807042383507657}, "topk": {"model_a": [22638, 3, 0.1077016070485115, [[52127, 0.146012, " lessons", false], [21286, 0.122184, " are", false], [22638, 0.107702, " two", false], [30582, 0.057521, " days", false], [52738, 0.040241, " results", false], [64495, 0.024175, " observations", false], [56463, 0.022977, " insights", false], [47539, 0.021141, " things", false], [38735, 0.018038, " ideas", false], [51832, 0.01765, " general", false]]], "model_b": [22638, 4, 0.04687315225601196, [[21286, 0.120923, " are", false], [30582, 0.094749, " days", false], [52127, 0.054329, " lessons", false], [22638, 0.046873, " two", false], [52738, 0.027918, " results", false], [65135, 0.023512, " generalization", false], [52224, 0.022424, " methods", false], [51832, 0.021718, " general", false], [56237, 0.018321, " findings", false], [56463, 0.016093, " insights", false]]]}, "raw_delta": -0.20703125, "tuned_delta": -0.15417630610180016}, {"byte_start": 896, "byte_end": 901, "display": {"text": " need", "kind": "normal"}, "is_word": true, "word_id": 153, "word_key": " need", "bytes_hex": "20 6e 65 65 64", "compression": {"model_a": "39.45% 39.45% 39.45% 39.45% 39.45%", "model_b": "36.74% 36.74% 36.74% 36.74% 36.74%"}, "model_tokens": {"model_a": [[31506, " need", "normal", 1.74155538843479e-05]], "model_b": [[31506, " need", "normal", 3.747626760741696e-05]]}, "loss": {"model_a": 39.44869252430759, "model_b": 36.74363932264078}, "topk": {"model_a": [31506, 1077, 1.74155538843479e-05, [[52127, 0.174941, " lessons", false], [46853, 0.101062, " points", false], [38440, 0.085588, " facts", false], [51703, 0.055023, " factors", false], [47539, 0.051902, " things", false], [64495, 0.041187, " observations", false], [38735, 0.040776, " ideas", false], [62370, 0.025653, " principles", false], [56463, 0.023427, " insights", false], [47613, 0.02007, " trends", false]]], "model_b": [31506, 907, 3.747626760741696e-05, [[51703, 0.125693, " factors", false], [47539, 0.074349, " things", false], [38440, 0.045588, " facts", false], [52127, 0.039639, " lessons", false], [61590, 0.035251, " approaches", false], [46853, 0.034078, " points", false], [62370, 0.031727, " principles", false], [38604, 0.019714, " goals", false], [64495, 0.018267, " observations", false], [38735, 0.016521, " ideas", false]]]}, "raw_delta": 0.1499999999999999, "tuned_delta": 0.20285494389819975}, {"byte_start": 901, "byte_end": 905, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 154, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "1.66% 1.66% 1.66% 1.66%", "model_b": "4.28% 4.28% 4.28% 4.28%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.6915689706802368]], "model_b": [[22187, " not", "normal", 0.3872634768486023]]}, "loss": {"model_a": 1.6642417158692264, "model_b": 4.27947869794944}, "topk": {"model_a": [22187, 1, 0.6915689706802368, [[22187, 0.691569, " not", false], [4811, 0.235217, " to", false], [111, 0.041012, "n", false], [30719, 0.011426, " each", false], [122, 0.00359, "y", false], [4435, 0.001611, " be", false], [4692, 0.001215, " no", false], [39115, 0.001136, " never", false], [31581, 0.000939, " only", false], [46, 0.000854, "-", false]]], "model_b": [22187, 2, 0.3872634768486023, [[4811, 0.482854, " to", false], [22187, 0.387263, " not", false], [111, 0.036906, "n", false], [46, 0.035106, "-", false], [31581, 0.01077, " only", false], [30719, 0.006424, " each", false], [39115, 0.005812, " never", false], [4435, 0.00269, " be", false], [26151, 0.001523, "ling", false], [45150, 0.001457, " always", false]]]}, "raw_delta": -0.14501953125, "tuned_delta": -0.09216458735180018}, {"byte_start": 905, "byte_end": 909, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 155, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "28.88% 28.88% 28.88% 28.88%", "model_b": "29.16% 29.16% 29.16% 29.16%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.0016423269407823682]], "model_b": [[22418, " run", "normal", 0.0015667503466829658]]}, "loss": {"model_a": 28.88207845529663, "model_b": 29.163854830470253}, "topk": {"model_a": [22418, 22, 0.0016423269407823682, [[4435, 0.711506, " be", false], [55824, 0.079605, " conflict", false], [51255, 0.034128, " compete", false], [63717, 0.022092, " necessarily", false], [61779, 0.019742, " contradict", false], [4559, 0.018441, " go", false], [45150, 0.013224, " always", false], [30788, 0.0077, " even", false], [30482, 0.004462, " come", false], [55769, 0.003619, " coincide", false]]], "model_b": [22418, 25, 0.0015667503466829658, [[4435, 0.667069, " be", false], [55824, 0.065278, " conflict", false], [4559, 0.04693, " go", false], [61779, 0.040173, " contradict", false], [45150, 0.024797, " always", false], [63717, 0.012554, " necessarily", false], [4811, 0.007549, " to", false], [32499, 0.006716, " work", false], [21265, 0.006476, " and", false], [55769, 0.00611, " coincide", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 909, "byte_end": 917, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 156, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"model_a": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%", "model_b": "8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49%"}, "model_tokens": {"model_a": [[51336, " counter", "normal", 0.0456528440117836]], "model_b": [[51336, " counter", "normal", 0.023257697001099586]]}, "loss": {"model_a": 6.9739652855472345, "model_b": 8.488513302105472}, "topk": {"model_a": [51336, 5, 0.0456528440117836, [[4596, 0.649332, " in", false], [56812, 0.08121, " parallel", false], [57435, 0.058403, " together", false], [64301, 0.050189, " concurrently", false], [51336, 0.045653, " counter", false], [65167, 0.023828, " simultaneously", false], [4424, 0.009536, " at", false], [31162, 0.008869, " into", false], [56131, 0.00564, " entirely", false], [31044, 0.005572, " hand", false]]], "model_b": [51336, 6, 0.023257697001099586, [[4596, 0.631153, " in", false], [57435, 0.094611, " together", false], [56812, 0.050046, " parallel", false], [65167, 0.03942, " simultaneously", false], [4424, 0.023925, " at", false], [51336, 0.023258, " counter", false], [64301, 0.020477, " concurrently", false], [31162, 0.015543, " into", false], [64930, 0.012043, " independently", false], [32011, 0.007406, " side", false]]]}, "raw_delta": -0.083984375, "tuned_delta": -0.03112943110180018}, {"byte_start": 917, "byte_end": 920, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 157, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.48% 1.48% 1.48%", "model_b": "1.57% 1.57% 1.57%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7822018265724182]], "model_b": [[4811, " to", "normal", 0.7693809270858765]]}, "loss": {"model_a": 1.4793259696615346, "model_b": 1.573251428052743}, "topk": {"model_a": [4811, 1, 0.7822018265724182, [[4811, 0.782202, " to", false], [45, 0.083101, ",", false], [60, 0.02423, ";", false], [59, 0.022022, ":", false], [47, 0.021087, ".", false], [46, 0.017517, "-", false], [21400, 0.00491, " but", false], [30719, 0.003971, " each", false], [9816, 0.003615, "—", false], [4596, 0.002958, " in", false]]], "model_b": [4811, 1, 0.7693809270858765, [[4811, 0.769381, " to", false], [45, 0.078048, ",", false], [47, 0.034191, ".", false], [46, 0.026197, "-", false], [60, 0.018993, ";", false], [59, 0.015454, ":", false], [4596, 0.007048, " in", false], [21400, 0.006863, " but", false], [61076, 0.003584, "productive", false], [21265, 0.002609, " and", false]]]}, "raw_delta": -0.005208333333333329, "tuned_delta": 0.04764661056486649}, {"byte_start": 920, "byte_end": 925, "display": {"text": " each", "kind": "normal"}, "is_word": true, "word_id": 158, "word_key": " each", "bytes_hex": "20 65 61 63 68", "compression": {"model_a": "1.31% 1.31% 1.31% 1.31% 1.31%", "model_b": "1.27% 1.27% 1.27% 1.27% 1.27%"}, "model_tokens": {"model_a": [[30719, " each", "normal", 0.6956994533538818]], "model_b": [[30719, " each", "normal", 0.704334020614624]]}, "loss": {"model_a": 1.3102601445573594, "model_b": 1.2679936882813154}, "topk": {"model_a": [30719, 1, 0.6956994533538818, [[30719, 0.695699, " each", false], [22226, 0.298829, " one", false], [22590, 0.001742, " the", false], [332, 0.000639, " a", false], [21273, 0.000315, " any", false], [50919, 0.000278, " another", false], [39193, 0.000204, " other", false], [45, 0.000186, ",", false], [38720, 0.000176, " human", false], [4419, 0.000105, " an", false]]], "model_b": [30719, 1, 0.704334020614624, [[30719, 0.704334, " each", false], [22226, 0.286537, " one", false], [22590, 0.002126, " the", false], [332, 0.000734, " a", false], [4715, 0.000692, " or", false], [21273, 0.00052, " any", false], [32464, 0.000234, " what", false], [45, 0.000232, ",", false], [21265, 0.000163, " and", false], [4435, 0.000147, " be", false]]]}, "raw_delta": 0.0023437500000000056, "tuned_delta": 0.05519869389819983}, {"byte_start": 925, "byte_end": 931, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 159, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%", "model_b": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.995051920413971]], "model_b": [[39193, " other", "normal", 0.9922688603401184]]}, "loss": {"model_a": 0.014859301034546664, "model_b": 0.023206192356421643}, "topk": {"model_a": [39193, 1, 0.995051920413971, [[39193, 0.995052, " other", false], [46, 0.0013, "-", false], [35297, 0.001039, "other", false], [50919, 0.000662, " another", false], [46726, 0.000546, " others", false], [45, 0.000415, ",", false], [47, 0.000112, ".", false], [11, 7.1e-05, "\n", false], [4811, 5.3e-05, " to", false], [4596, 5.3e-05, " in", false]]], "model_b": [39193, 1, 0.9922688603401184, [[39193, 0.992269, " other", false], [46, 0.003447, "-", false], [50919, 0.001272, " another", false], [35297, 0.000786, "other", false], [46726, 0.000733, " others", false], [45, 0.000305, ",", false], [22590, 0.00025, " the", false], [11, 8.4e-05, "\n", false], [47, 8.4e-05, ".", false], [4717, 7.1e-05, " ot", false]]]}, "raw_delta": -0.0004628499348958332, "tuned_delta": 0.052392093963303986}, {"byte_start": 931, "byte_end": 932, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "17.12%", "model_b": "16.91%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.38150742650032043]], "model_b": [[45, ",", "normal", 0.393478661775589]]}, "loss": {"model_a": 17.11791479179776, "model_b": 16.90658251041754}, "topk": {"model_a": [45, 1, 0.38150742650032043, [[45, 0.381507, ",", false], [47, 0.189391, ".", false], [59, 0.120424, ":", false], [60, 0.111213, ";", false], [21400, 0.019748, " but", false], [280, 0.014641, " -", false], [4596, 0.014301, " in", false], [275, 0.014202, " (", false], [51018, 0.013625, " because", false], [4423, 0.011757, " as", false]]], "model_b": [45, 1, 0.393478661775589, [[45, 0.393479, ",", false], [47, 0.20308, ".", false], [59, 0.090557, ":", false], [60, 0.088143, ";", false], [21400, 0.042775, " but", false], [21265, 0.025263, " and", false], [4596, 0.018448, " in", false], [275, 0.014086, " (", false], [4423, 0.012189, " as", false], [280, 0.010152, " -", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06457369389819982}, {"byte_start": 932, "byte_end": 936, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 160, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "4.61% 4.61% 4.61% 4.61%", "model_b": "4.35% 4.35% 4.35% 4.35%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.3602905869483948]], "model_b": [[21400, " but", "normal", 0.3881939947605133]]}, "loss": {"model_a": 4.61408814346812, "model_b": 4.349922791742846}, "topk": {"model_a": [21400, 1, 0.3602905869483948, [[21400, 0.360291, " but", false], [4423, 0.145208, " as", false], [21265, 0.077879, " and", false], [51948, 0.058812, " however", false], [39690, 0.058614, " since", false], [47544, 0.047032, " though", false], [51018, 0.044716, " because", false], [4596, 0.035663, " in", false], [4706, 0.024838, " of", false], [21700, 0.014742, " for", false]]], "model_b": [21400, 1, 0.3881939947605133, [[21400, 0.388194, " but", false], [21265, 0.172627, " and", false], [4423, 0.082562, " as", false], [4596, 0.055798, " in", false], [32232, 0.031073, " they", false], [47544, 0.023466, " though", false], [22185, 0.019587, " nor", false], [51948, 0.017792, " however", false], [51018, 0.016075, " because", false], [39690, 0.010918, " since", false]]]}, "raw_delta": 0.0146484375, "tuned_delta": 0.06750338139819982}, {"byte_start": 936, "byte_end": 939, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 161, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "19.44% 19.44% 19.44%", "model_b": "18.79% 18.79% 18.79%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.03926531597971916]], "model_b": [[4596, " in", "normal", 0.04404280334711075]]}, "loss": {"model_a": 19.44256988698017, "model_b": 18.78509167824171}, "topk": {"model_a": [4596, 4, 0.03926531597971916, [[32232, 0.257525, " they", false], [4601, 0.09722, " it", false], [22590, 0.086384, " the", false], [4596, 0.039265, " in", false], [4588, 0.02383, " if", false], [39934, 0.021568, " there", false], [21286, 0.020547, " are", false], [21700, 0.017478, " for", false], [47001, 0.015481, " rather", false], [22226, 0.014887, " one", false]]], "model_b": [4596, 4, 0.04404280334711075, [[32232, 0.206448, " they", false], [47001, 0.094663, " rather", false], [22590, 0.077789, " the", false], [4596, 0.044043, " in", false], [4601, 0.040444, " it", false], [52028, 0.03116, " instead", false], [4588, 0.026886, " if", false], [32465, 0.023481, " when", false], [47266, 0.01938, " should", false], [21413, 0.016935, " can", false]]]}, "raw_delta": 0.03645833333333326, "tuned_delta": 0.08931327723153308}, {"byte_start": 939, "byte_end": 948, "display": {"text": " practice", "kind": "normal"}, "is_word": true, "word_id": 162, "word_key": " practice", "bytes_hex": "20 70 72 61 63 74 69 63 65", "compression": {"model_a": "2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43%", "model_b": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"model_a": [[56901, " practice", "normal", 0.3003268241882324]], "model_b": [[56901, " practice", "normal", 0.18307575583457947]]}, "loss": {"model_a": 2.4264076751062214, "model_b": 3.3813165020835076}, "topk": {"model_a": [56901, 2, 0.3003268241882324, [[22590, 0.315525, " the", false], [56901, 0.300327, " practice", false], [31370, 0.037434, " many", false], [30808, 0.036834, " fact", false], [31461, 0.034533, " most", false], [332, 0.022626, " a", false], [39189, 0.021526, " order", false], [51832, 0.019543, " general", false], [32074, 0.018971, " some", false], [32234, 0.013494, " this", false]]], "model_b": [56901, 2, 0.18307575583457947, [[22590, 0.201188, " the", false], [56901, 0.183076, " practice", false], [51832, 0.081298, " general", false], [30808, 0.057596, " fact", false], [31370, 0.048445, " many", false], [31461, 0.047674, " most", false], [332, 0.041524, " a", false], [39189, 0.024207, " order", false], [3609, 0.024037, " AI", false], [52652, 0.02341, " reality", false]]]}, "raw_delta": -0.052951388888888895, "tuned_delta": -9.644499068907353e-05}, {"byte_start": 948, "byte_end": 953, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 163, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"model_a": "3.66% 3.66% 3.66% 3.66% 3.66%", "model_b": "2.90% 2.90% 2.90% 2.90% 2.90%"}, "model_tokens": {"model_a": [[32232, " they", "normal", 0.3613346219062805]], "model_b": [[32232, " they", "normal", 0.44213178753852844]]}, "loss": {"model_a": 3.6630928772571334, "model_b": 2.902296664288344}, "topk": {"model_a": [32232, 1, 0.3613346219062805, [[32232, 0.361335, " they", false], [45, 0.129498, ",", false], [22590, 0.097437, " the", false], [4601, 0.067404, " it", false], [39934, 0.032399, " there", false], [32234, 0.025096, " this", false], [31461, 0.018627, " most", false], [63843, 0.016978, " researchers", false], [4858, 0.01596, " we", false], [31370, 0.013023, " many", false]]], "model_b": [32232, 1, 0.44213178753852844, [[32232, 0.442132, " they", false], [45, 0.159466, ",", false], [22590, 0.065786, " the", false], [4601, 0.027451, " it", false], [31461, 0.0227, " most", false], [32234, 0.021304, " this", false], [32216, 0.019507, " tend", false], [21286, 0.017535, " are", false], [39934, 0.012571, " there", false], [32227, 0.01229, " that", false]]]}, "raw_delta": 0.04218749999999999, "tuned_delta": 0.09504244389819981}, {"byte_start": 953, "byte_end": 958, "display": {"text": " tend", "kind": "normal"}, "is_word": true, "word_id": 164, "word_key": " tend", "bytes_hex": "20 74 65 6e 64", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99% 10.99%", "model_b": "9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[32216, " tend", "normal", 0.04663814976811409]], "model_b": [[32216, " tend", "normal", 0.07021617889404297]]}, "loss": {"model_a": 10.9892786317714, "model_b": 9.580396755903271}, "topk": {"model_a": [32216, 5, 0.04663814976811409, [[4491, 0.274393, " do", false], [31059, 0.185332, " have", false], [39171, 0.158644, " often", false], [21286, 0.087728, " are", false], [32216, 0.046638, " tend", false], [21413, 0.024764, " can", false], [31967, 0.021529, " seem", false], [60523, 0.018317, " sometimes", false], [53248, 0.014575, " usually", false], [45145, 0.010654, " almost", false]]], "model_b": [32216, 3, 0.07021617889404297, [[4491, 0.370085, " do", false], [39171, 0.204496, " often", false], [32216, 0.070216, " tend", false], [45145, 0.068245, " almost", false], [21286, 0.051925, " are", false], [45150, 0.024242, " always", false], [62024, 0.021901, " frequently", false], [53248, 0.017831, " usually", false], [21413, 0.015764, " can", false], [31059, 0.015614, " have", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13097994389819984}, {"byte_start": 958, "byte_end": 961, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 165, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.11% 0.11% 0.11%", "model_b": "0.16% 0.16% 0.16%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9813953042030334]], "model_b": [[4811, " to", "normal", 0.9732500910758972]]}, "loss": {"model_a": 0.11227027448324146, "model_b": 0.1629019668972523}, "topk": {"model_a": [4811, 1, 0.9813953042030334, [[4811, 0.981395, " to", false], [22187, 0.010584, " not", false], [47585, 0.001118, " toward", false], [53169, 0.000913, " towards", false], [4491, 0.000852, " do", false], [4596, 0.000531, " in", false], [21700, 0.000355, " for", false], [45, 0.000278, ",", false], [32227, 0.000243, " that", false], [22418, 0.00024, " run", false]]], "model_b": [4811, 1, 0.9732500910758972, [[4811, 0.97325, " to", false], [22187, 0.009809, " not", false], [47585, 0.004526, " toward", false], [53169, 0.003622, " towards", false], [4596, 0.000914, " in", false], [4491, 0.000824, " do", false], [31458, 0.000386, " more", false], [45, 0.000344, ",", false], [30322, 0.000303, " both", false], [32386, 0.00028, " very", false]]]}, "raw_delta": -0.0028076171875, "tuned_delta": 0.05004732671069982}, {"byte_start": 961, "byte_end": 962, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "27.19%", "model_b": "37.48%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.22389283776283264]], "model_b": [[47, ".", "normal", 0.12596148252487183]]}, "loss": {"model_a": 27.191420204254875, "model_b": 37.47625789809221}, "topk": {"model_a": [47, 1, 0.22389283776283264, [[47, 0.223893, ".", false], [4491, 0.178426, " do", false], [4435, 0.118649, " be", false], [22418, 0.059203, " run", false], [45, 0.05003, ",", false], [4559, 0.021842, " go", false], [51255, 0.021358, " compete", false], [59, 0.020446, ":", false], [55824, 0.017613, " conflict", false], [31059, 0.013936, " have", false]]], "model_b": [47, 2, 0.12596148252487183, [[4491, 0.288234, " do", false], [47, 0.125961, ".", false], [4435, 0.072639, " be", false], [22418, 0.065671, " run", false], [4559, 0.040625, " go", false], [45, 0.030292, ",", false], [56475, 0.0234, " interact", false], [51255, 0.011541, " compete", false], [59, 0.010395, ":", false], [51233, 0.010187, " collide", false]]]}, "raw_delta": -0.5703125, "tuned_delta": -0.5174575561018002}, {"byte_start": 962, "byte_end": 967, "display": {"text": " Time", "kind": "normal"}, "is_word": true, "word_id": 166, "word_key": " time", "bytes_hex": "20 54 69 6d 65", "compression": {"model_a": "30.66% 30.66% 30.66% 30.66% 30.66%", "model_b": "34.94% 34.94% 34.94% 34.94% 34.94%"}, "model_tokens": {"model_a": [[29904, " Time", "normal", 0.00020828412380069494]], "model_b": [[29904, " Time", "normal", 6.0473808844108135e-05]]}, "loss": {"model_a": 30.657269618890467, "model_b": 34.94027052152958}, "topk": {"model_a": [29904, 219, 0.00020828412380069494, [[11, 0.373229, "\n", false], [261, 0.148338, "\n\n", false], [20996, 0.073175, " The", false], [19907, 0.022584, " For", false], [3913, 0.021781, " In", false], [29894, 0.018647, " This", false], [3918, 0.017181, " It", false], [0, 0.013529, "[0]", false], [3908, 0.012511, " If", false], [300, 0.011899, " A", false]]], "model_b": [29904, 474, 6.0473808844108135e-05, [[11, 0.414235, "\n", false], [261, 0.095585, "\n\n", false], [20996, 0.065731, " The", false], [29894, 0.033232, " This", false], [3913, 0.027642, " In", false], [19907, 0.023054, " For", false], [0, 0.016162, "[0]", false], [3641, 0.012748, " As", false], [300, 0.010777, " A", false], [3918, 0.009055, " It", false]]]}, "raw_delta": -0.23750000000000004, "tuned_delta": -0.1846450561018002}, {"byte_start": 967, "byte_end": 973, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 167, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"model_a": "8.03% 8.03% 8.03% 8.03% 8.03% 8.03%", "model_b": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%"}, "model_tokens": {"model_a": [[39762, " spent", "normal", 0.06852001696825027]], "model_b": [[39762, " spent", "normal", 0.04816161096096039]]}, "loss": {"model_a": 8.030626692448331, "model_b": 9.11076946394723}, "topk": {"model_a": [39762, 4, 0.06852001696825027, [[21265, 0.262972, " and", false], [32475, 0.145997, " will", false], [4600, 0.117169, " is", false], [39762, 0.06852, " spent", false], [4811, 0.045507, " to", false], [62307, 0.036976, " permitting", false], [46, 0.036822, "-", false], [45, 0.020927, ",", false], [21800, 0.018456, " has", false], [21700, 0.015891, " for", false]]], "model_b": [39762, 4, 0.04816161096096039, [[4600, 0.224307, " is", false], [21265, 0.193488, " and", false], [4811, 0.076808, " to", false], [39762, 0.048162, " spent", false], [46, 0.035874, "-", false], [45, 0.030951, ",", false], [32475, 0.029982, " will", false], [21700, 0.028943, " for", false], [21800, 0.02319, " has", false], [2030, 0.021557, "ly", false]]]}, "raw_delta": -0.05989583333333337, "tuned_delta": -0.007040889435133549}, {"byte_start": 973, "byte_end": 976, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 168, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "9.30% 9.30% 9.30%", "model_b": "7.56% 7.56% 7.56%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.2109820395708084]], "model_b": [[4712, " on", "normal", 0.28450098633766174]]}, "loss": {"model_a": 9.298620380729647, "model_b": 7.560999400492288}, "topk": {"model_a": [4712, 1, 0.2109820395708084, [[4712, 0.210982, " on", false], [4596, 0.051402, " in", false], [47629, 0.042108, " trying", false], [52834, 0.03503, " seeking", false], [61857, 0.033262, " developing", false], [38888, 0.03225, " lever", false], [56537, 0.021335, " learning", false], [60463, 0.019026, " searching", false], [59832, 0.018682, " improving", false], [62271, 0.017027, " optimizing", false]]], "model_b": [4712, 1, 0.28450098633766174, [[4712, 0.284501, " on", false], [4596, 0.08565, " in", false], [56537, 0.03912, " learning", false], [62271, 0.027539, " optimizing", false], [38279, 0.027122, " doing", false], [38888, 0.019382, " lever", false], [63844, 0.017251, " researching", false], [60463, 0.016315, " searching", false], [4450, 0.015782, " by", false], [47629, 0.014967, " trying", false]]]}, "raw_delta": 0.09635416666666669, "tuned_delta": 0.14920911056486652}, {"byte_start": 976, "byte_end": 980, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 169, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"model_a": "21.56% 21.56% 21.56% 21.56%", "model_b": "26.35% 26.35% 26.35% 26.35%"}, "model_tokens": {"model_a": [[22226, " one", "normal", 0.00824460107833147]], "model_b": [[22226, " one", "normal", 0.002868288429453969]]}, "loss": {"model_a": 21.555892700782362, "model_b": 26.346091078734}, "topk": {"model_a": [22226, 15, 0.00824460107833147, [[22590, 0.097739, " the", false], [38720, 0.069893, " human", false], [332, 0.043735, " a", false], [57103, 0.030834, " research", false], [38888, 0.029943, " lever", false], [59832, 0.023211, " improving", false], [45775, 0.019221, " domain", false], [45490, 0.017193, " clever", false], [61857, 0.012943, " developing", false], [55666, 0.011315, " building", false]]], "model_b": [22226, 54, 0.002868288429453969, [[38720, 0.072529, " human", false], [332, 0.055935, " a", false], [22590, 0.055625, " the", false], [51832, 0.027165, " general", false], [57103, 0.021865, " research", false], [63370, 0.018895, " computation", false], [56537, 0.014635, " learning", false], [59832, 0.014526, " improving", false], [45775, 0.014243, " domain", false], [59346, 0.011403, " computing", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21277005610180016}, {"byte_start": 980, "byte_end": 983, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 170, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "11.74% 11.74% 11.74%", "model_b": "13.81% 13.81% 13.81%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.141598641872406]], "model_b": [[4600, " is", "normal", 0.10053083300590515]]}, "loss": {"model_a": 11.740682298901067, "model_b": 13.807042383507657}, "topk": {"model_a": [4600, 1, 0.141598641872406, [[4600, 0.141599, " is", false], [21413, 0.048834, " can", false], [4715, 0.032528, " or", false], [39914, 0.030102, " tends", false], [32475, 0.029054, " will", false], [39941, 0.025355, " thing", false], [30659, 0.024798, " does", false], [55532, 0.02252, " approach", false], [45214, 0.019393, " aspect", false], [22074, 0.018047, " may", false]]], "model_b": [4600, 1, 0.10053083300590515, [[4600, 0.100531, " is", false], [32202, 0.0642, " task", false], [21413, 0.038729, " can", false], [45775, 0.032313, " domain", false], [4706, 0.032044, " of", false], [39941, 0.029427, " thing", false], [32475, 0.029275, " will", false], [39914, 0.024312, " tends", false], [4715, 0.020168, " or", false], [30173, 0.01839, " area", false]]]}, "raw_delta": -0.11458333333333337, "tuned_delta": -0.06172838943513355}, {"byte_start": 983, "byte_end": 988, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 171, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "2.32% 2.32% 2.32% 2.32% 2.32%", "model_b": "7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.5230417847633362]], "model_b": [[32251, " time", "normal", 0.12457092106342316]]}, "loss": {"model_a": 2.3246550951824116, "model_b": 7.551606854653167}, "topk": {"model_a": [32251, 1, 0.5230417847633362, [[32251, 0.523042, " time", false], [62110, 0.094653, " inevitably", false], [39762, 0.033021, " spent", false], [332, 0.027941, " a", false], [39171, 0.022911, " often", false], [47768, 0.018195, " wasted", false], [63717, 0.017668, " necessarily", false], [46439, 0.014512, " likely", false], [31334, 0.013798, " lost", false], [22187, 0.011358, " not", false]]], "model_b": [32251, 3, 0.12457092106342316, [[39762, 0.167135, " spent", false], [39171, 0.12784, " often", false], [32251, 0.124571, " time", false], [22187, 0.036299, " not", false], [47768, 0.032974, " wasted", false], [53248, 0.023989, " usually", false], [31458, 0.018776, " more", false], [60687, 0.014959, " typically", false], [45150, 0.013011, " always", false], [32354, 0.012487, " used", false]]]}, "raw_delta": -0.28984375, "tuned_delta": -0.23698880610180018}, {"byte_start": 988, "byte_end": 992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 172, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "3.03% 3.03% 3.03% 3.03%", "model_b": "8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.5100496411323547]], "model_b": [[22187, " not", "normal", 0.16022205352783203]]}, "loss": {"model_a": 3.029096033116476, "model_b": 8.24195897382855}, "topk": {"model_a": [22187, 1, 0.5100496411323547, [[22187, 0.51005, " not", false], [39762, 0.153392, " spent", false], [31334, 0.11682, " lost", false], [32227, 0.056716, " that", false], [47768, 0.04543, " wasted", false], [30211, 0.028315, " away", false], [39887, 0.024288, " taken", false], [31277, 0.005486, " less", false], [63954, 0.004658, " unavailable", false], [57339, 0.002788, " subtract", false]]], "model_b": [22187, 2, 0.16022205352783203, [[39762, 0.311299, " spent", false], [22187, 0.160222, " not", false], [39586, 0.141841, " saved", false], [31334, 0.083017, " lost", false], [47768, 0.051624, " wasted", false], [38554, 0.035618, " freed", false], [32227, 0.033503, " that", false], [39887, 0.027904, " taken", false], [56495, 0.013306, " invested", false], [32458, 0.011497, " well", false]]]}, "raw_delta": -0.2890625, "tuned_delta": -0.23620755610180016}, {"byte_start": 992, "byte_end": 998, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 173, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "model_b": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"model_a": [[39762, " spent", "normal", 0.9594951272010803]], "model_b": [[39762, " spent", "normal", 0.9116665124893188]]}, "loss": {"model_a": 0.12327716413846121, "model_b": 0.27737361931153776}, "topk": {"model_a": [39762, 1, 0.9594951272010803, [[39762, 0.959495, " spent", false], [59206, 0.017641, " available", false], [4712, 0.005025, " on", false], [51459, 0.003691, " devoted", false], [56495, 0.002876, " invested", false], [32354, 0.00118, " used", false], [39761, 0.001047, " spend", false], [57278, 0.000714, " spending", false], [22339, 0.000603, " put", false], [38594, 0.00056, " given", false]]], "model_b": [39762, 1, 0.9116665124893188, [[39762, 0.911667, " spent", false], [47768, 0.013793, " wasted", false], [56495, 0.0105, " invested", false], [46650, 0.008741, " needed", false], [39887, 0.005418, " taken", false], [31334, 0.004739, " lost", false], [59206, 0.004041, " available", false], [32354, 0.003911, " used", false], [45927, 0.001898, " expend", false], [39761, 0.001812, " spend", false]]]}, "raw_delta": -0.008544921875, "tuned_delta": 0.04431002202319982}, {"byte_start": 998, "byte_end": 1001, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 174, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.20% 0.20% 0.20%", "model_b": "0.58% 0.58% 0.58%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9673864245414734]], "model_b": [[4712, " on", "normal", 0.908633291721344]]}, "loss": {"model_a": 0.19959159908131818, "model_b": 0.5752934326461523}, "topk": {"model_a": [4712, 1, 0.9673864245414734, [[4712, 0.967386, " on", false], [38888, 0.002285, " lever", false], [38279, 0.001832, " doing", false], [4596, 0.001812, " in", false], [61857, 0.001704, " developing", false], [22590, 0.001606, " the", false], [59608, 0.001414, " elsewhere", false], [59832, 0.001087, " improving", false], [32487, 0.000967, " with", false], [59686, 0.00089, " exploring", false]]], "model_b": [4712, 1, 0.908633291721344, [[4712, 0.908633, " on", false], [38279, 0.00833, " doing", false], [38888, 0.006853, " lever", false], [59346, 0.00628, " computing", false], [59608, 0.00627, " elsewhere", false], [59686, 0.00316, " exploring", false], [4596, 0.002668, " in", false], [21700, 0.002282, " for", false], [55666, 0.002193, " building", false], [59832, 0.001847, " improving", false]]]}, "raw_delta": -0.02083333333333333, "tuned_delta": 0.03202161056486649}, {"byte_start": 1001, "byte_end": 1005, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 175, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.13% 0.13% 0.13% 0.13%", "model_b": "0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.9721909761428833]], "model_b": [[22590, " the", "normal", 0.8157058358192444]]}, "loss": {"model_a": 0.12712957551778814, "model_b": 0.9245787310384591}, "topk": {"model_a": [22590, 1, 0.9721909761428833, [[22590, 0.972191, " the", false], [50919, 0.012999, " another", false], [39193, 0.001409, " other", false], [59832, 0.001343, " improving", false], [38888, 0.000959, " lever", false], [332, 0.000644, " a", false], [30322, 0.000496, " both", false], [31458, 0.000411, " more", false], [45833, 0.000382, " either", false], [60522, 0.000341, " something", false]]], "model_b": [22590, 1, 0.8157058358192444, [[22590, 0.815706, " the", false], [50919, 0.07644, " another", false], [39193, 0.029463, " other", false], [55521, 0.013846, " anything", false], [45833, 0.006978, " either", false], [21273, 0.006838, " any", false], [60522, 0.004438, " something", false], [332, 0.003753, " a", false], [59346, 0.00371, " computing", false], [46726, 0.002761, " others", false]]]}, "raw_delta": -0.044219970703125, "tuned_delta": 0.008634973195074822}, {"byte_start": 1005, "byte_end": 1011, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 176, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%", "model_b": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.9923527836799622]], "model_b": [[39193, " other", "normal", 0.9534317255020142]]}, "loss": {"model_a": 0.023022744195501314, "model_b": 0.14382335816153807}, "topk": {"model_a": [39193, 1, 0.9923527836799622, [[39193, 0.992353, " other", false], [31515, 0.001573, " next", false], [46726, 0.000718, " others", false], [45301, 0.000546, " better", false], [46405, 0.000525, " latter", false], [47205, 0.000512, " second", false], [31458, 0.000507, " more", false], [45961, 0.000186, " faster", false], [31323, 0.000143, " long", false], [46470, 0.000111, " longer", false]]], "model_b": [39193, 1, 0.9534317255020142, [[39193, 0.953432, " other", false], [31515, 0.012905, " next", false], [47205, 0.006461, " second", false], [31458, 0.00326, " more", false], [46405, 0.002393, " latter", false], [46470, 0.001864, " longer", false], [45301, 0.001515, " better", false], [38888, 0.000925, " lever", false], [46726, 0.00073, " others", false], [31277, 0.00071, " less", false]]]}, "raw_delta": -0.006698608398437499, "tuned_delta": 0.04615633549976232}, {"byte_start": 1011, "byte_end": 1012, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "7.40%", "model_b": "9.23%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.662509560585022]], "model_b": [[47, ".", "normal", 0.5966031551361084]]}, "loss": {"model_a": 7.396629848307673, "model_b": 9.22817628693624}, "topk": {"model_a": [47, 1, 0.662509560585022, [[47, 0.66251, ".", false], [45, 0.267916, ",", false], [60, 0.016903, ";", false], [21265, 0.015169, " and", false], [275, 0.010558, " (", false], [59, 0.003099, ":", false], [9816, 0.001964, "—", false], [280, 0.001594, " -", false], [34, 0.001506, "!", false], [4596, 0.001495, " in", false]]], "model_b": [47, 1, 0.5966031551361084, [[47, 0.596603, ".", false], [45, 0.269219, ",", false], [21265, 0.05112, " and", false], [60, 0.017549, ";", false], [275, 0.015881, " (", false], [59, 0.005404, ":", false], [9816, 0.00304, "—", false], [21400, 0.002372, " but", false], [4596, 0.002339, " in", false], [32227, 0.002286, " that", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 1012, "byte_end": 1018, "display": {"text": " There", "kind": "normal"}, "is_word": true, "word_id": 177, "word_key": " there", "bytes_hex": "20 54 68 65 72 65", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%"}, "model_tokens": {"model_a": [[37451, " There", "normal", 0.009242170490324497]], "model_b": [[37451, " There", "normal", 0.006199849769473076]]}, "loss": {"model_a": 14.088818758681281, "model_b": 15.309849717766994}, "topk": {"model_a": [37451, 14, 0.009242170490324497, [[11, 0.35978, "\n", false], [261, 0.12513, "\n\n", false], [20996, 0.071207, " The", false], [29894, 0.032017, " This", false], [3913, 0.02316, " In", false], [19555, 0.019774, " But", false], [19417, 0.017832, " And", false], [3918, 0.017051, " It", false], [3908, 0.014984, " If", false], [0, 0.011716, "[0]", false]]], "model_b": [37451, 17, 0.006199849769473076, [[11, 0.433917, "\n", false], [261, 0.0944, "\n\n", false], [20996, 0.055114, " The", false], [29894, 0.038743, " This", false], [0, 0.027041, "[0]", false], [3913, 0.024729, " In", false], [3908, 0.012997, " If", false], [3918, 0.012881, " It", false], [19907, 0.011934, " For", false], [19417, 0.010877, " And", false]]]}, "raw_delta": -0.06770833333333337, "tuned_delta": -0.014853389435133549}, {"byte_start": 1018, "byte_end": 1022, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 178, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "5.99% 5.99% 5.99% 5.99%", "model_b": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.26505884528160095]], "model_b": [[21286, " are", "normal", 0.3585837185382843]]}, "loss": {"model_a": 5.987747972439545, "model_b": 4.649310190364823}, "topk": {"model_a": [21286, 2, 0.26505884528160095, [[4600, 0.48111, " is", false], [21286, 0.265059, " are", false], [460, 0.11924, "'s", false], [32475, 0.021635, " will", false], [21800, 0.018267, " has", false], [31059, 0.018194, " have", false], [22074, 0.011503, " may", false], [22748, 0.006548, " was", false], [21413, 0.005934, " can", false], [21896, 0.003619, " isn", false]]], "model_b": [21286, 2, 0.3585837185382843, [[4600, 0.456135, " is", false], [21286, 0.358584, " are", false], [460, 0.054129, "'s", false], [32475, 0.022148, " will", false], [21800, 0.013455, " has", false], [31059, 0.013409, " have", false], [22074, 0.013024, " may", false], [22748, 0.008022, " was", false], [21413, 0.007783, " can", false], [1950, 0.004104, "in", false]]]}, "raw_delta": 0.07421875, "tuned_delta": 0.12707369389819984}, {"byte_start": 1022, "byte_end": 1036, "display": {"text": " psychological", "kind": "normal"}, "is_word": true, "word_id": 179, "word_key": " psychological", "bytes_hex": "20 70 73 79 63 68 6f 6c 6f 67 69 63 61 6c", "compression": {"model_a": "14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17%", "model_b": "13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77%"}, "model_tokens": {"model_a": [[64997, " psychological", "normal", 1.6758427591412328e-05]], "model_b": [[64997, " psychological", "normal", 2.266145202156622e-05]]}, "loss": {"model_a": 14.169326294445177, "model_b": 13.766788615625709}, "topk": {"model_a": [64997, 1285, 1.6758427591412328e-05, [[31370, 0.11797, " many", false], [332, 0.064457, " a", false], [32074, 0.058708, " some", false], [61963, 0.052498, " exceptions", false], [22638, 0.044137, " two", false], [45, 0.031984, ",", false], [39193, 0.026325, " other", false], [46844, 0.023928, " plenty", false], [4706, 0.022422, " of", false], [4692, 0.018762, " no", false]]], "model_b": [64997, 964, 2.266145202156622e-05, [[31370, 0.14531, " many", false], [332, 0.104148, " a", false], [22638, 0.072213, " two", false], [32074, 0.045251, " some", false], [39193, 0.039535, " other", false], [45, 0.030469, ",", false], [52869, 0.028285, " several", false], [30135, 0.026007, " also", false], [61963, 0.02345, " exceptions", false], [4692, 0.022523, " no", false]]]}, "raw_delta": 0.022321428571428603, "tuned_delta": 0.07517637246962842}, {"byte_start": 1036, "byte_end": 1048, "display": {"text": " commitments", "kind": "normal"}, "is_word": true, "word_id": 180, "word_key": " commitments", "bytes_hex": "20 63 6f 6d 6d 69 74 6d 65 6e 74 73", "compression": {"model_a": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "model_b": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%"}, "model_tokens": {"model_a": [[63351, " commitments", "normal", 0.0003166237147524953]], "model_b": [[63351, " commitments", "normal", 8.507529128110036e-05]]}, "loss": {"model_a": 12.116384132465903, "model_b": 14.088818758681281}, "topk": {"model_a": [63351, 97, 0.0003166237147524953, [[52654, 0.274881, " reasons", false], [21265, 0.226573, " and", false], [55600, 0.054519, " barriers", false], [45, 0.046649, ",", false], [51703, 0.040113, " factors", false], [45304, 0.033817, " biases", false], [2030, 0.023172, "ly", false], [38124, 0.017705, " costs", false], [51565, 0.016497, " effects", false], [62202, 0.016261, " mechanisms", false]]], "model_b": [63351, 302, 8.507529128110036e-05, [[52654, 0.349402, " reasons", false], [21265, 0.149205, " and", false], [51703, 0.047547, " factors", false], [55600, 0.041739, " barriers", false], [45, 0.028529, ",", false], [51565, 0.028508, " effects", false], [55621, 0.023061, " benefits", false], [2030, 0.020814, "ly", false], [50964, 0.017405, " aspects", false], [38124, 0.016043, " costs", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 1048, "byte_end": 1051, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 181, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "7.33% 7.33% 7.33%", "model_b": "5.52% 5.52% 5.52%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.2954440116882324]], "model_b": [[4811, " to", "normal", 0.4000721871852875]]}, "loss": {"model_a": 7.326185754514267, "model_b": 5.518120680483502}, "topk": {"model_a": [4811, 1, 0.2954440116882324, [[4811, 0.295444, " to", false], [32227, 0.284173, " that", false], [21265, 0.068668, " and", false], [45, 0.051922, ",", false], [56500, 0.043565, " involved", false], [4596, 0.022672, " in", false], [4712, 0.016787, " on", false], [4423, 0.016741, " as", false], [4424, 0.015267, " at", false], [31351, 0.0122, " made", false]]], "model_b": [4811, 1, 0.4000721871852875, [[4811, 0.400072, " to", false], [32227, 0.275099, " that", false], [45, 0.04289, ",", false], [21265, 0.034348, " and", false], [56500, 0.027074, " involved", false], [4596, 0.026636, " in", false], [275, 0.020389, " (", false], [61603, 0.012371, " associated", false], [4858, 0.008863, " we", false], [4706, 0.007347, " of", false]]]}, "raw_delta": 0.10026041666666669, "tuned_delta": 0.15311536056486652}, {"byte_start": 1051, "byte_end": 1062, "display": {"text": " investment", "kind": "normal"}, "is_word": true, "word_id": 182, "word_key": " investment", "bytes_hex": "20 69 6e 76 65 73 74 6d 65 6e 74", "compression": {"model_a": "13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22%", "model_b": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12%"}, "model_tokens": {"model_a": [[62157, " investment", "normal", 0.0003249699075240642]], "model_b": [[62157, " investment", "normal", 0.00033091893419623375]]}, "loss": {"model_a": 13.217873599053709, "model_b": 13.11540946262694}, "topk": {"model_a": [62157, 226, 0.0003249699075240642, [[22590, 0.137648, " the", false], [30322, 0.079073, " both", false], [22226, 0.054111, " one", false], [38720, 0.04535, " human", false], [30719, 0.035037, " each", false], [39936, 0.032024, " these", false], [332, 0.02854, " a", false], [32234, 0.02119, " this", false], [38279, 0.019833, " doing", false], [51161, 0.017086, " certain", false]]], "model_b": [62157, 334, 0.00033091893419623375, [[22590, 0.112738, " the", false], [4435, 0.044767, " be", false], [38720, 0.035428, " human", false], [332, 0.027608, " a", false], [38279, 0.024381, " doing", false], [30322, 0.020611, " both", false], [22187, 0.018012, " not", false], [32251, 0.015512, " time", false], [32234, 0.015455, " this", false], [31205, 0.012536, " keep", false]]]}, "raw_delta": 0.005681818181818121, "tuned_delta": 0.05853676208001794}, {"byte_start": 1062, "byte_end": 1065, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 183, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "3.31% 3.31% 3.31%", "model_b": "4.34% 4.34% 4.34%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.578748881816864]], "model_b": [[4596, " in", "normal", 0.4849129617214203]]}, "loss": {"model_a": 3.310872408290101, "model_b": 4.344052450593395}, "topk": {"model_a": [4596, 1, 0.578748881816864, [[4596, 0.578749, " in", false], [4706, 0.049789, " of", false], [32227, 0.042259, " that", false], [45, 0.034397, ",", false], [21265, 0.034355, " and", false], [56832, 0.033749, " patterns", false], [62581, 0.016967, " strategies", false], [59451, 0.011482, " decisions", false], [31162, 0.011475, " into", false], [4712, 0.01087, " on", false]]], "model_b": [4596, 1, 0.4849129617214203, [[4596, 0.484913, " in", false], [32227, 0.201911, " that", false], [45, 0.064838, ",", false], [4706, 0.037357, " of", false], [21265, 0.037154, " and", false], [275, 0.015381, " (", false], [31351, 0.010584, " made", false], [32251, 0.010006, " time", false], [40186, 0.009245, " which", false], [4712, 0.005257, " on", false]]]}, "raw_delta": -0.05729166666666666, "tuned_delta": -0.004436722768466836}, {"byte_start": 1065, "byte_end": 1069, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 184, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"model_a": "7.82% 7.82% 7.82% 7.82%", "model_b": "16.70% 16.70% 16.70% 16.70%"}, "model_tokens": {"model_a": [[22226, " one", "normal", 0.17677997052669525]], "model_b": [[22226, " one", "normal", 0.024661293253302574]]}, "loss": {"model_a": 7.819294411068111, "model_b": 16.69525022903732}, "topk": {"model_a": [22226, 2, 0.17677997052669525, [[22590, 0.181995, " the", false], [22226, 0.17678, " one", false], [38720, 0.072982, " human", false], [332, 0.042931, " a", false], [45833, 0.033019, " either", false], [57103, 0.030363, " research", false], [30322, 0.025476, " both", false], [59943, 0.022794, " knowledge", false], [30719, 0.022056, " each", false], [39675, 0.021613, " short", false]]], "model_b": [22226, 7, 0.024661293253302574, [[38720, 0.137014, " human", false], [22590, 0.125859, " the", false], [332, 0.068044, " a", false], [57103, 0.036614, " research", false], [32251, 0.036376, " time", false], [59943, 0.028372, " knowledge", false], [22226, 0.024661, " one", false], [3609, 0.024192, " AI", false], [51832, 0.017169, " general", false], [62293, 0.016306, " particular", false]]]}, "raw_delta": -0.4921875, "tuned_delta": -0.43933255610180016}, {"byte_start": 1069, "byte_end": 1078, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 185, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02%", "model_b": "7.73% 7.73% 7.73% 7.73% 7.73% 7.73% 7.73% 7.73% 7.73%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.0025353594683110714]], "model_b": [[55532, " approach", "normal", 0.020960550755262375]]}, "loss": {"model_a": 12.022458674074693, "model_b": 7.733196074209505}, "topk": {"model_a": [55532, 31, 0.0025353594683110714, [[4715, 0.424857, " or", false], [31601, 0.113159, " over", false], [47717, 0.058924, " versus", false], [32227, 0.056178, " that", false], [47001, 0.040839, " rather", false], [30173, 0.037704, " area", false], [45775, 0.032978, " domain", false], [21265, 0.021951, " and", false], [45, 0.021464, ",", false], [59526, 0.014929, " direction", false]]], "model_b": [55532, 13, 0.020960550755262375, [[4715, 0.145102, " or", false], [32227, 0.11461, " that", false], [45775, 0.086431, " domain", false], [31601, 0.070172, " over", false], [45, 0.057532, ",", false], [30173, 0.056003, " area", false], [21265, 0.02828, " and", false], [46561, 0.028149, " method", false], [4706, 0.026639, " of", false], [47717, 0.02533, " versus", false]]]}, "raw_delta": 0.23784722222222227, "tuned_delta": 0.2907021661204221}, {"byte_start": 1078, "byte_end": 1081, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 186, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "5.66% 5.66% 5.66%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.38778847455978394]], "model_b": [[4715, " or", "normal", 0.1124531552195549]]}, "loss": {"model_a": 5.659008868070314, "model_b": 13.243489633160404}, "topk": {"model_a": [4715, 1, 0.38778847455978394, [[4715, 0.387788, " or", false], [31601, 0.301755, " over", false], [47001, 0.05884, " rather", false], [32227, 0.050337, " that", false], [45, 0.039582, ",", false], [47717, 0.027719, " versus", false], [21265, 0.017528, " and", false], [4424, 0.012347, " at", false], [4811, 0.011177, " to", false], [47, 0.010148, ".", false]]], "model_b": [4715, 4, 0.1124531552195549, [[32227, 0.356004, " that", false], [31601, 0.135823, " over", false], [45, 0.13322, ",", false], [4715, 0.112453, " or", false], [21265, 0.038448, " and", false], [4811, 0.029506, " to", false], [275, 0.028057, " (", false], [47717, 0.019898, " versus", false], [4424, 0.013889, " at", false], [47, 0.01353, ".", false]]]}, "raw_delta": -0.4205729166666667, "tuned_delta": -0.36771797276846685}, {"byte_start": 1081, "byte_end": 1085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 187, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.92% 2.92% 2.92% 2.92%", "model_b": "2.31% 2.31% 2.31% 2.31%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.525206983089447]], "model_b": [[22590, " the", "normal", 0.6028627753257751]]}, "loss": {"model_a": 2.923429892426366, "model_b": 2.30704407173406}, "topk": {"model_a": [22590, 1, 0.525206983089447, [[22590, 0.525207, " the", false], [50919, 0.446133, " another", false], [39193, 0.008205, " other", false], [46561, 0.001941, " method", false], [4811, 0.001195, " to", false], [332, 0.001071, " a", false], [4596, 0.001041, " in", false], [57317, 0.00083, " strategy", false], [45775, 0.000573, " domain", false], [60624, 0.000529, " technique", false]]], "model_b": [22590, 1, 0.6028627753257751, [[22590, 0.602863, " the", false], [50919, 0.287989, " another", false], [39193, 0.030781, " other", false], [46561, 0.010589, " method", false], [62634, 0.006113, " technology", false], [60624, 0.003361, " technique", false], [57317, 0.003249, " strategy", false], [332, 0.002165, " a", false], [57103, 0.002022, " research", false], [4596, 0.00155, " in", false]]]}, "raw_delta": 0.0341796875, "tuned_delta": 0.08703463139819982}, {"byte_start": 1085, "byte_end": 1091, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 188, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "0.00% 0.00% 0.00% 0.00% 0.00% 0.00%", "model_b": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.9986311793327332]], "model_b": [[39193, " other", "normal", 0.9940897226333618]]}, "loss": {"model_a": 0.004127583620707407, "model_b": 0.017794471609271934}, "topk": {"model_a": [39193, 1, 0.9986311793327332, [[39193, 0.998631, " other", false], [31515, 0.000415, " next", false], [50919, 0.000212, " another", false], [46726, 0.000121, " others", false], [11, 3.3e-05, "\n", false], [22590, 2.6e-05, " the", false], [63469, 1.2e-05, " development", false], [22226, 1.1e-05, " one", false], [261, 1.1e-05, "\n\n", false], [46561, 1e-05, " method", false]]], "model_b": [39193, 1, 0.9940897226333618, [[39193, 0.99409, " other", false], [31515, 0.002627, " next", false], [46726, 0.000163, " others", false], [22681, 0.000132, " use", false], [63277, 0.000113, " alternative", false], [50919, 8.8e-05, " another", false], [31458, 6.7e-05, " more", false], [47205, 6.4e-05, " second", false], [22590, 5.9e-05, " the", false], [56767, 5.3e-05, " opposite", false]]]}, "raw_delta": -0.0007578531901041668, "tuned_delta": 0.05209709070809566}, {"byte_start": 1091, "byte_end": 1092, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "25.36%", "model_b": "36.07%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.2507374882698059]], "model_b": [[47, ".", "normal", 0.1336890161037445]]}, "loss": {"model_a": 25.359873765626308, "model_b": 36.06737602222408}, "topk": {"model_a": [47, 2, 0.2507374882698059, [[45, 0.450508, ",", false], [47, 0.250737, ".", false], [32227, 0.126618, " that", false], [275, 0.024009, " (", false], [21265, 0.021829, " and", false], [60, 0.021243, ";", false], [59, 0.012643, ":", false], [4423, 0.010254, " as", false], [40186, 0.008122, " which", false], [21400, 0.007854, " but", false]]], "model_b": [47, 3, 0.1336890161037445, [[45, 0.453795, ",", false], [32227, 0.230321, " that", false], [47, 0.133689, ".", false], [275, 0.033575, " (", false], [21265, 0.020763, " and", false], [60, 0.014921, ";", false], [21400, 0.014179, " but", false], [40186, 0.011754, " which", false], [59, 0.006687, ":", false], [4423, 0.005305, " as", false]]]}, "raw_delta": -0.59375, "tuned_delta": -0.5408950561018002}, {"byte_start": 1092, "byte_end": 1096, "display": {"text": " And", "kind": "normal"}, "is_word": true, "word_id": 189, "word_key": " and", "bytes_hex": "20 41 6e 64", "compression": {"model_a": "15.00% 15.00% 15.00% 15.00%", "model_b": "17.75% 17.75% 17.75% 17.75%"}, "model_tokens": {"model_a": [[19417, " And", "normal", 0.03591116890311241]], "model_b": [[19417, " And", "normal", 0.01955912448465824]]}, "loss": {"model_a": 15.004591977995565, "model_b": 17.751911635938416}, "topk": {"model_a": [19417, 6, 0.03591116890311241, [[11, 0.151776, "\n", false], [20996, 0.090496, " The", false], [37451, 0.079061, " There", false], [19555, 0.070882, " But", false], [261, 0.05359, "\n\n", false], [19417, 0.035911, " And", false], [3918, 0.027824, " It", false], [3913, 0.022463, " In", false], [29894, 0.018908, " This", false], [19907, 0.014213, " For", false]]], "model_b": [19417, 11, 0.01955912448465824, [[11, 0.147423, "\n", false], [20996, 0.078616, " The", false], [19555, 0.07064, " But", false], [3913, 0.039537, " In", false], [37451, 0.03309, " There", false], [261, 0.032273, "\n\n", false], [19907, 0.029687, " For", false], [29894, 0.025777, " This", false], [3908, 0.025272, " If", false], [3918, 0.023066, " It", false]]]}, "raw_delta": -0.15234375, "tuned_delta": -0.09948880610180018}, {"byte_start": 1096, "byte_end": 1100, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 190, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.69% 11.69% 11.69% 11.69%", "model_b": "11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.07428289949893951]], "model_b": [[22590, " the", "normal", 0.08263010531663895]]}, "loss": {"model_a": 11.693719569705465, "model_b": 11.271055006945026}, "topk": {"model_a": [22590, 3, 0.07428289949893951, [[39934, 0.185246, " there", false], [45, 0.109386, ",", false], [22590, 0.074283, " the", false], [4788, 0.053854, " so", false], [4601, 0.031136, " it", false], [4596, 0.029017, " in", false], [22797, 0.028349, " yet", false], [4706, 0.026189, " of", false], [30788, 0.016423, " even", false], [32230, 0.014364, " then", false]]], "model_b": [22590, 3, 0.08263010531663895, [[45, 0.127735, ",", false], [39934, 0.120414, " there", false], [22590, 0.08263, " the", false], [4423, 0.040806, " as", false], [4596, 0.038446, " in", false], [4588, 0.033255, " if", false], [40187, 0.028097, " while", false], [4788, 0.027251, " so", false], [30788, 0.022515, " even", false], [32465, 0.021056, " when", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07629244389819982}, {"byte_start": 1100, "byte_end": 1106, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 191, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "13.81% 13.81% 13.81% 13.81% 13.81% 13.81%", "model_b": "16.16% 16.16% 16.16% 16.16% 16.16% 16.16%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.010104949586093426]], "model_b": [[38720, " human", "normal", 0.004670261405408382]]}, "loss": {"model_a": 13.807042383507657, "model_b": 16.15517884328787}, "topk": {"model_a": [38720, 11, 0.010104949586093426, [[64997, 0.018251, " psychological", false], [30808, 0.013502, " fact", false], [22638, 0.013181, " two", false], [31461, 0.012426, " most", false], [30510, 0.011553, " cost", false], [62157, 0.011513, " investment", false], [32251, 0.010927, " time", false], [57103, 0.010553, " research", false], [31458, 0.0103, " more", false], [46470, 0.010141, " longer", false]]], "model_b": [38720, 33, 0.004670261405408382, [[31458, 0.042374, " more", false], [46470, 0.042034, " longer", false], [30510, 0.022442, " cost", false], [30808, 0.022108, " fact", false], [31581, 0.018765, " only", false], [38124, 0.015388, " costs", false], [62157, 0.01331, " investment", false], [47092, 0.013289, " result", false], [31461, 0.012936, " most", false], [22638, 0.011514, " two", false]]]}, "raw_delta": -0.13020833333333337, "tuned_delta": -0.07735338943513355}, {"byte_start": 1106, "byte_end": 1107, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "73.83%", "model_b": "67.34%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.016668841242790222]], "model_b": [[46, "-", "normal", 0.02362072467803955]]}, "loss": {"model_a": 73.82541029548992, "model_b": 67.34455366649652}, "topk": {"model_a": [46, 7, 0.016668841242790222, [[59943, 0.201704, " knowledge", false], [31427, 0.047724, " mind", false], [37898, 0.037034, " brain", false], [57404, 0.029673, " tendency", false], [45775, 0.022722, " domain", false], [34889, 0.018835, "ities", false], [46, 0.016669, "-", false], [32011, 0.014306, " side", false], [59324, 0.013369, " community", false], [31506, 0.013334, " need", false]]], "model_b": [46, 4, 0.02362072467803955, [[59943, 0.152599, " knowledge", false], [31427, 0.03866, " mind", false], [45950, 0.027186, " factor", false], [46, 0.023621, "-", false], [61701, 0.021899, " commitment", false], [37636, 0.017871, " agent", false], [30510, 0.015133, " cost", false], [59305, 0.014804, " cognitive", false], [37898, 0.014428, " brain", false], [62157, 0.014077, " investment", false]]]}, "raw_delta": 0.359375, "tuned_delta": 0.41222994389819984}, {"byte_start": 1107, "byte_end": 1116, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 192, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "model_b": "9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.23826813697814941]], "model_b": [[58313, "knowledge", "normal", 0.008780820295214653]]}, "loss": {"model_a": 2.8647264809318607, "model_b": 9.455162811381658}, "topk": {"model_a": [58313, 1, 0.23826813697814941, [[58313, 0.238268, "knowledge", false], [48948, 0.090872, "centric", false], [53865, 0.065055, "computer", false], [53835, 0.049816, "centered", false], [34991, 0.040478, "level", false], [1950, 0.032785, "in", false], [34011, 0.027622, "based", false], [49389, 0.019799, "machine", false], [820, 0.019519, "AI", false], [54208, 0.017387, "oriented", false]]], "model_b": [58313, 20, 0.008780820295214653, [[48948, 0.192143, "centric", false], [33665, 0.072227, "agent", false], [49389, 0.056216, "machine", false], [1950, 0.045567, "in", false], [53865, 0.042396, "computer", false], [820, 0.030673, "AI", false], [63039, 0.029267, "computation", false], [53835, 0.027876, "centered", false], [41273, 0.024625, "driven", false], [34011, 0.023993, "based", false]]]}, "raw_delta": -0.3654513888888889, "tuned_delta": -0.31259644499068906}, {"byte_start": 1116, "byte_end": 1125, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 193, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "1.99% 1.99% 1.99% 1.99% 1.99% 1.99% 1.99% 1.99% 1.99%", "model_b": "4.63% 4.63% 4.63% 4.63% 4.63% 4.63% 4.63% 4.63% 4.63%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.372172474861145]], "model_b": [[55532, " approach", "normal", 0.10029881447553635]]}, "loss": {"model_a": 1.9880888692805812, "model_b": 4.633655947299621}, "topk": {"model_a": [55532, 1, 0.372172474861145, [[55532, 0.372172, " approach", false], [46, 0.17449, "-", false], [38888, 0.037183, " lever", false], [61590, 0.033571, " approaches", false], [62157, 0.020121, " investment", false], [56540, 0.019535, " leverage", false], [37810, 0.016773, " based", false], [39552, 0.012702, " route", false], [46561, 0.012164, " method", false], [52224, 0.01184, " methods", false]]], "model_b": [55532, 2, 0.10029881447553635, [[46, 0.166462, "-", false], [55532, 0.100299, " approach", false], [62157, 0.059549, " investment", false], [61701, 0.031349, " commitment", false], [59339, 0.020269, " component", false], [63678, 0.016692, " investments", false], [30276, 0.015899, " bias", false], [31633, 0.014491, " part", false], [63351, 0.013684, " commitments", false], [45214, 0.011995, " aspect", false]]]}, "raw_delta": -0.14670138888888887, "tuned_delta": -0.09384644499068905}, {"byte_start": 1125, "byte_end": 1131, "display": {"text": " tends", "kind": "normal"}, "is_word": true, "word_id": 194, "word_key": " tends", "bytes_hex": "20 74 65 6e 64 73", "compression": {"model_a": "9.44% 9.44% 9.44% 9.44% 9.44% 9.44%", "model_b": "8.88% 8.88% 8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[39914, " tends", "normal", 0.043363772332668304]], "model_b": [[39914, " tends", "normal", 0.05175458639860153]]}, "loss": {"model_a": 9.439508568316459, "model_b": 8.875955817969208}, "topk": {"model_a": [39914, 4, 0.043363772332668304, [[4600, 0.357123, " is", false], [21800, 0.118874, " has", false], [21413, 0.064016, " can", false], [39914, 0.043364, " tends", false], [45, 0.041847, ",", false], [4811, 0.031759, " to", false], [39620, 0.019592, " seems", false], [30659, 0.018299, " does", false], [32475, 0.018119, " will", false], [22074, 0.0175, " may", false]]], "model_b": [39914, 3, 0.05175458639860153, [[4600, 0.320251, " is", false], [21800, 0.073541, " has", false], [39914, 0.051755, " tends", false], [21413, 0.047079, " can", false], [45, 0.045483, ",", false], [32475, 0.026921, " will", false], [22074, 0.024343, " may", false], [57102, 0.019651, " requires", false], [39171, 0.017537, " often", false], [45150, 0.013285, " always", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 1131, "byte_end": 1134, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 195, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.19% 0.19% 0.19%", "model_b": "0.15% 0.15% 0.15%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9693784117698669]], "model_b": [[4811, " to", "normal", 0.9758894443511963]]}, "loss": {"model_a": 0.18638333149505446, "model_b": 0.14675852873626336}, "topk": {"model_a": [4811, 1, 0.9693784117698669, [[4811, 0.969378, " to", false], [22187, 0.007403, " not", false], [47585, 0.005301, " toward", false], [45, 0.003122, ",", false], [53169, 0.002957, " towards", false], [31458, 0.002131, " more", false], [4596, 0.000895, " in", false], [4435, 0.000757, " be", false], [275, 0.000585, " (", false], [30135, 0.000561, " also", false]]], "model_b": [4811, 1, 0.9758894443511963, [[4811, 0.975889, " to", false], [22187, 0.005909, " not", false], [47585, 0.004297, " toward", false], [53169, 0.003056, " towards", false], [45, 0.001948, ",", false], [4435, 0.000787, " be", false], [4596, 0.000559, " in", false], [275, 0.000463, " (", false], [4424, 0.000348, " at", false], [31458, 0.000335, " more", false]]]}, "raw_delta": 0.002197265625, "tuned_delta": 0.05505220952319982}, {"byte_start": 1134, "byte_end": 1142, "display": {"text": " complic", "kind": "normal"}, "is_word": true, "word_id": 196, "word_key": " complic", "bytes_hex": "20 63 6f 6d 70 6c 69 63", "compression": {"model_a": "21.98% 21.98% 21.98% 21.98% 21.98% 21.98% 21.98% 21.98%", "model_b": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82%"}, "model_tokens": {"model_a": [[51259, " complic", "normal", 5.776841499027796e-05]], "model_b": [[51259, " complic", "normal", 4.071759758517146e-05]]}, "loss": {"model_a": 21.9785572635428, "model_b": 22.823886389063677}, "topk": {"model_a": [51259, 655, 5.776841499027796e-05, [[4435, 0.388601, " be", false], [31059, 0.053649, " have", false], [32499, 0.030203, " work", false], [56041, 0.023762, " dominate", false], [52724, 0.020926, " require", false], [32187, 0.018803, " take", false], [21751, 0.018684, " get", false], [22770, 0.017817, " win", false], [52573, 0.017649, " produce", false], [31358, 0.017335, " make", false]]], "model_b": [51259, 859, 4.071759758517146e-05, [[4435, 0.363719, " be", false], [31059, 0.057772, " have", false], [21751, 0.030766, " get", false], [47457, 0.024155, " suffer", false], [32499, 0.024111, " work", false], [32187, 0.016228, " take", false], [45284, 0.015914, " become", false], [22770, 0.013238, " win", false], [52724, 0.01323, " require", false], [40239, 0.012776, " yield", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.0059799438981998215}, {"byte_start": 1142, "byte_end": 1145, "display": {"text": "ate", "kind": "normal"}, "is_word": true, "word_id": 197, "word_key": "ate", "bytes_hex": "61 74 65", "compression": {"model_a": "0.00% 0.00% 0.00%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[7066, "ate", "normal", 0.9992092847824097]], "model_b": [[7066, "ate", "normal", 0.9969940185546875]]}, "loss": {"model_a": 0.004700859123583435, "model_b": 0.01816136793111259}, "topk": {"model_a": [7066, 1, 0.9992092847824097, [[7066, 0.999209, "ate", false], [24744, 0.000257, "ates", false], [7933, 0.000171, "ity", false], [1956, 0.00012, "it", false], [33943, 8.9e-05, "ating", false], [6910, 5.2e-05, "acy", false], [1752, 2.1e-05, "at", false], [7036, 1.8e-05, "are", false], [34881, 1.2e-05, "itate", false], [24566, 8e-06, "ance", false]]], "model_b": [7066, 1, 0.9969940185546875, [[7066, 0.996994, "ate", false], [24744, 0.00168, "ates", false], [33943, 0.000743, "ating", false], [7933, 0.00013, "ity", false], [1752, 0.000117, "at", false], [1956, 6.6e-05, "it", false], [7801, 6.6e-05, "ify", false], [25647, 1.8e-05, "iate", false], [7911, 1.5e-05, "ish", false], [48895, 1.2e-05, "atively", false]]]}, "raw_delta": -0.0007464090983072916, "tuned_delta": 0.05210853479989253}, {"byte_start": 1145, "byte_end": 1153, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 198, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%", "model_b": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.0023864831309765577]], "model_b": [[52224, " methods", "normal", 0.0006911751697771251]]}, "loss": {"model_a": 13.595710102127438, "model_b": 16.413473853863692}, "topk": {"model_a": [52224, 23, 0.0023864831309765577, [[22590, 0.355017, " the", false], [47539, 0.16304, " things", false], [52201, 0.145719, " matters", false], [21265, 0.050993, " and", false], [47001, 0.018624, " rather", false], [57103, 0.016483, " research", false], [332, 0.016335, " a", false], [3609, 0.015908, " AI", false], [45, 0.01119, ",", false], [32464, 0.00908, " what", false]]], "model_b": [52224, 86, 0.0006911751697771251, [[22590, 0.334815, " the", false], [47539, 0.253048, " things", false], [21265, 0.052121, " and", false], [52201, 0.04381, " matters", false], [3609, 0.027861, " AI", false], [332, 0.022062, " a", false], [45, 0.020448, ",", false], [4715, 0.013265, " or", false], [32464, 0.008643, " what", false], [56939, 0.007457, " problems", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 1153, "byte_end": 1156, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 199, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "18.50% 18.50% 18.50%", "model_b": "18.41% 18.41% 18.41%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.046075787395238876]], "model_b": [[4596, " in", "normal", 0.04660392552614212]]}, "loss": {"model_a": 18.503315303068085, "model_b": 18.409389844676873}, "topk": {"model_a": [4596, 5, 0.046075787395238876, [[45, 0.196107, ",", false], [32227, 0.164546, " that", false], [21265, 0.120361, " and", false], [47, 0.056569, ".", false], [4596, 0.046076, " in", false], [4811, 0.030052, " to", false], [31458, 0.025053, " more", false], [4450, 0.023437, " by", false], [4706, 0.022104, " of", false], [47001, 0.021964, " rather", false]]], "model_b": [4596, 5, 0.04660392552614212, [[32227, 0.221495, " that", false], [45, 0.092146, ",", false], [21265, 0.07709, " and", false], [4450, 0.059162, " by", false], [4596, 0.046604, " in", false], [47, 0.042386, ".", false], [31458, 0.038037, " more", false], [21700, 0.036254, " for", false], [32487, 0.027479, " with", false], [4706, 0.021451, " of", false]]]}, "raw_delta": 0.005208333333333481, "tuned_delta": 0.0580632772315333}, {"byte_start": 1156, "byte_end": 1161, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 200, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "2.58% 2.58% 2.58% 2.58% 2.58%", "model_b": "5.89% 5.89% 5.89% 5.89% 5.89%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.49242207407951355]], "model_b": [[32448, " ways", "normal", 0.19676271080970764]]}, "loss": {"model_a": 2.5782538328386746, "model_b": 5.889126241128776}, "topk": {"model_a": [32448, 1, 0.49242207407951355, [[32448, 0.492422, " ways", false], [332, 0.222644, " a", false], [32139, 0.037806, " such", false], [22590, 0.036475, " the", false], [4419, 0.014206, " an", false], [63667, 0.00911, " interesting", false], [39189, 0.008461, " order", false], [39193, 0.006104, " other", false], [22184, 0.005555, " non", false], [31458, 0.005343, " more", false]]], "model_b": [32448, 1, 0.19676271080970764, [[32448, 0.196763, " ways", false], [332, 0.169199, " a", false], [22590, 0.139006, " the", false], [39193, 0.034462, " other", false], [38458, 0.029306, " favor", false], [4419, 0.028862, " an", false], [51832, 0.022066, " general", false], [32139, 0.021996, " such", false], [32074, 0.020077, " some", false], [62688, 0.017884, " unexpected", false]]]}, "raw_delta": -0.18359374999999997, "tuned_delta": -0.13073880610180016}, {"byte_start": 1161, "byte_end": 1166, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 201, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "0.18% 0.18% 0.18% 0.18% 0.18%", "model_b": "0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.9502723217010498]], "model_b": [[32227, " that", "normal", 0.9009321331977844]]}, "loss": {"model_a": 0.18403519503527424, "model_b": 0.38039810648439465}, "topk": {"model_a": [32227, 1, 0.9502723217010498, [[32227, 0.950272, " that", false], [40186, 0.008509, " which", false], [22590, 0.006456, " the", false], [22187, 0.004018, " not", false], [40185, 0.00294, " where", false], [4811, 0.001744, " to", false], [275, 0.00139, " (", false], [32232, 0.001223, " they", false], [4596, 0.000899, " in", false], [31458, 0.000809, " more", false]]], "model_b": [32227, 1, 0.9009321331977844, [[32227, 0.900932, " that", false], [22590, 0.011024, " the", false], [22187, 0.009708, " not", false], [40186, 0.006872, " which", false], [32232, 0.006842, " they", false], [4601, 0.00654, " it", false], [4858, 0.003936, " we", false], [40185, 0.003704, " where", false], [4811, 0.001717, " to", false], [39193, 0.001711, " other", false]]]}, "raw_delta": -0.010888671875000002, "tuned_delta": 0.041966272023199816}, {"byte_start": 1166, "byte_end": 1171, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 202, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"model_a": "4.40% 4.40% 4.40% 4.40% 4.40%", "model_b": "8.40% 8.40% 8.40% 8.40% 8.40%"}, "model_tokens": {"model_a": [[31358, " make", "normal", 0.2986183166503906]], "model_b": [[31358, " make", "normal", 0.09795092791318893]]}, "loss": {"model_a": 4.39571145270856, "model_b": 8.396935980174044}, "topk": {"model_a": [31358, 1, 0.2986183166503906, [[31358, 0.298618, " make", false], [21286, 0.094077, " are", false], [22590, 0.040051, " the", false], [47030, 0.038869, " reduce", false], [21413, 0.024777, " can", false], [56433, 0.020624, " increase", false], [32053, 0.01843, " slow", false], [32216, 0.013875, " tend", false], [38900, 0.0136, " limit", false], [4491, 0.0128, " do", false]]], "model_b": [31358, 3, 0.09795092791318893, [[22590, 0.132565, " the", false], [21286, 0.119562, " are", false], [31358, 0.097951, " make", false], [21413, 0.037498, " can", false], [4491, 0.032475, " do", false], [47030, 0.016852, " reduce", false], [22074, 0.016064, " may", false], [32216, 0.015622, " tend", false], [21556, 0.014558, " don", false], [4601, 0.014059, " it", false]]]}, "raw_delta": -0.221875, "tuned_delta": -0.16902005610180015}, {"byte_start": 1171, "byte_end": 1176, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 203, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"model_a": "2.86% 2.86% 2.86% 2.86% 2.86%", "model_b": "2.72% 2.72% 2.72% 2.72% 2.72%"}, "model_tokens": {"model_a": [[32229, " them", "normal", 0.4544193148612976]], "model_b": [[32229, " them", "normal", 0.47060438990592957]]}, "loss": {"model_a": 2.8600302080123003, "model_b": 2.7191420204254877}, "topk": {"model_a": [32229, 1, 0.4544193148612976, [[32229, 0.454419, " them", false], [4601, 0.189278, " it", false], [22590, 0.057462, " the", false], [63370, 0.038965, " computation", false], [39931, 0.034191, " their", false], [38888, 0.01964, " lever", false], [332, 0.007406, " a", false], [51832, 0.005709, " general", false], [65135, 0.005196, " generalization", false], [31323, 0.004986, " long", false]]], "model_b": [32229, 1, 0.47060438990592957, [[32229, 0.470604, " them", false], [4601, 0.110801, " it", false], [22590, 0.102436, " the", false], [38888, 0.053952, " lever", false], [63370, 0.026163, " computation", false], [31458, 0.009561, " more", false], [39931, 0.009351, " their", false], [332, 0.009083, " a", false], [59346, 0.006652, " computing", false], [51832, 0.006036, " general", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06066744389819982}, {"byte_start": 1176, "byte_end": 1181, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 204, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"model_a": "3.92% 3.92% 3.92% 3.92% 3.92%", "model_b": "3.86% 3.86% 3.86% 3.86% 3.86%"}, "model_tokens": {"model_a": [[31277, " less", "normal", 0.3325381278991699]], "model_b": [[31277, " less", "normal", 0.3425598442554474]]}, "loss": {"model_a": 3.9166916149133963, "model_b": 3.860336339878671}, "topk": {"model_a": [31277, 1, 0.3325381278991699, [[31277, 0.332538, " less", false], [46162, 0.256747, " harder", false], [31458, 0.093874, " more", false], [31048, 0.040134, " hard", false], [59516, 0.028548, " difficult", false], [31466, 0.01387, " much", false], [40216, 0.010271, " worse", false], [47313, 0.009941, " slower", false], [62699, 0.00725, " unsuitable", false], [45819, 0.007038, " easier", false]]], "model_b": [31277, 1, 0.3425598442554474, [[31277, 0.34256, " less", false], [31458, 0.182984, " more", false], [46162, 0.171653, " harder", false], [31048, 0.018654, " hard", false], [45819, 0.014035, " easier", false], [59516, 0.013857, " difficult", false], [31466, 0.01358, " much", false], [47313, 0.011471, " slower", false], [30788, 0.008952, " even", false], [40216, 0.008743, " worse", false]]]}, "raw_delta": 0.0031250000000000167, "tuned_delta": 0.05597994389819984}, {"byte_start": 1181, "byte_end": 1188, "display": {"text": " suited", "kind": "normal"}, "is_word": true, "word_id": 205, "word_key": " suited", "bytes_hex": "20 73 75 69 74 65 64", "compression": {"model_a": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%", "model_b": "16.83% 16.83% 16.83% 16.83% 16.83% 16.83% 16.83%"}, "model_tokens": {"model_a": [[47460, " suited", "normal", 0.0026439959183335304]], "model_b": [[47460, " suited", "normal", 0.0014614103129133582]]}, "loss": {"model_a": 15.296431795139677, "model_b": 16.826074974653647}, "topk": {"model_a": [47460, 28, 0.0026439959183335304, [[30140, 0.244275, " amen", false], [59593, 0.205373, " effective", false], [51832, 0.098337, " general", false], [59594, 0.057628, " efficient", false], [46439, 0.027589, " likely", false], [47687, 0.024685, " useful", false], [47129, 0.020946, " robust", false], [57160, 0.020066, " scalable", false], [56248, 0.015411, " flexible", false], [64862, 0.01379, " computational", false]]], "model_b": [47460, 47, 0.0014614103129133582, [[59593, 0.336037, " effective", false], [59594, 0.099007, " efficient", false], [51832, 0.09054, " general", false], [56900, 0.035607, " powerful", false], [47687, 0.031282, " useful", false], [64862, 0.02882, " computational", false], [30140, 0.024905, " amen", false], [47129, 0.023587, " robust", false], [57160, 0.023386, " scalable", false], [61586, 0.021596, " applicable", false]]]}, "raw_delta": -0.0848214285714286, "tuned_delta": -0.03196648467322878}, {"byte_start": 1188, "byte_end": 1191, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 206, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.41% 1.41% 1.41%", "model_b": "2.57% 2.57% 2.57%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.791496992111206]], "model_b": [[4811, " to", "normal", 0.6521528363227844]]}, "loss": {"model_a": 1.4088818758681283, "model_b": 2.571209423459334}, "topk": {"model_a": [4811, 1, 0.791496992111206, [[4811, 0.791497, " to", false], [21700, 0.184726, " for", false], [32226, 0.005441, " than", false], [4423, 0.002805, " as", false], [4596, 0.002101, " in", false], [45, 0.001973, ",", false], [53169, 0.001522, " towards", false], [4715, 0.001194, " or", false], [275, 0.00109, " (", false], [21265, 0.001061, " and", false]]], "model_b": [4811, 1, 0.6521528363227844, [[4811, 0.652153, " to", false], [21700, 0.29872, " for", false], [32226, 0.010534, " than", false], [47, 0.009791, ".", false], [4596, 0.005642, " in", false], [4423, 0.00477, " as", false], [45, 0.004171, ",", false], [4715, 0.002669, " or", false], [21265, 0.001201, " and", false], [275, 0.001034, " (", false]]]}, "raw_delta": -0.064453125, "tuned_delta": -0.011598181101800178}, {"byte_start": 1191, "byte_end": 1198, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 207, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"model_a": "12.16% 12.16% 12.16% 12.16% 12.16% 12.16% 12.16%", "model_b": "21.09% 21.09% 21.09% 21.09% 21.09% 21.09% 21.09%"}, "model_tokens": {"model_a": [[47497, " taking", "normal", 0.008828354068100452]], "model_b": [[47497, " taking", "normal", 0.00027510279323905706]]}, "loss": {"model_a": 12.156637900347851, "model_b": 21.09297437013998}, "topk": {"model_a": [47497, 13, 0.008828354068100452, [[22590, 0.219742, " the", false], [38888, 0.088561, " lever", false], [52805, 0.036033, " scaling", false], [63370, 0.035005, " computation", false], [37832, 0.033528, " being", false], [51832, 0.030345, " general", false], [56540, 0.02944, " leverage", false], [31323, 0.027916, " long", false], [38864, 0.014215, " large", false], [332, 0.013337, " a", false]]], "model_b": [47497, 241, 0.00027510279323905706, [[22590, 0.384303, " the", false], [56540, 0.032083, " leverage", false], [38888, 0.02823, " lever", false], [51832, 0.026782, " general", false], [332, 0.022026, " a", false], [39931, 0.020339, " their", false], [63370, 0.018212, " computation", false], [3609, 0.01601, " AI", false], [52949, 0.01108, " solving", false], [51372, 0.010892, " current", false]]]}, "raw_delta": -0.49553571428571436, "tuned_delta": -0.4426807703875145}, {"byte_start": 1198, "byte_end": 1208, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 208, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"model_a": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%", "model_b": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"model_a": [[59093, " advantage", "normal", 0.7817210555076599]], "model_b": [[59093, " advantage", "normal", 0.8801361918449402]]}, "loss": {"model_a": 0.4437977908984603, "model_b": 0.23246550951824113}, "topk": {"model_a": [59093, 1, 0.7817210555076599, [[59093, 0.781721, " advantage", false], [30923, 0.186134, " full", false], [52204, 0.004355, " maximum", false], [22590, 0.003752, " the", false], [56540, 0.002693, " leverage", false], [52203, 0.002638, " maximal", false], [61544, 0.001528, " advantages", false], [30273, 0.000988, " best", false], [4712, 0.00072, " on", false], [332, 0.000663, " a", false]]], "model_b": [59093, 1, 0.8801361918449402, [[59093, 0.880136, " advantage", false], [30923, 0.034038, " full", false], [22590, 0.01863, " the", false], [332, 0.005103, " a", false], [4712, 0.004507, " on", false], [38864, 0.002684, " large", false], [32229, 0.002219, " them", false], [31601, 0.002187, " over", false], [45095, 0.001921, " action", false], [64862, 0.001657, " computational", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06457369389819982}, {"byte_start": 1208, "byte_end": 1211, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 209, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9978208541870117]], "model_b": [[4706, " of", "normal", 0.9959623217582703]]}, "loss": {"model_a": 0.013116543505803536, "model_b": 0.024215157241483452}, "topk": {"model_a": [4706, 1, 0.9978208541870117, [[4706, 0.997821, " of", false], [22590, 0.000467, " the", false], [45, 0.000131, ",", false], [4811, 0.0001, " to", false], [4715, 9.9e-05, " or", false], [275, 8.7e-05, " (", false], [21265, 8.4e-05, " and", false], [4596, 7.9e-05, " in", false], [47, 5.9e-05, ".", false], [30917, 3.9e-05, " from", false]]], "model_b": [4706, 1, 0.9959623217582703, [[4706, 0.995962, " of", false], [22590, 0.000717, " the", false], [47, 0.000361, ".", false], [4596, 0.000298, " in", false], [30917, 0.000192, " from", false], [45, 0.000183, ",", false], [64862, 0.000146, " computational", false], [4715, 9.1e-05, " or", false], [275, 8e-05, " (", false], [21265, 7.9e-05, " and", false]]]}, "raw_delta": -0.0006154378255208334, "tuned_delta": 0.052239506072678986}, {"byte_start": 1211, "byte_end": 1219, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 210, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07%", "model_b": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.011424032039940357]], "model_b": [[51832, " general", "normal", 0.01084891613572836]]}, "loss": {"model_a": 10.073505412457116, "model_b": 10.214393600043929}, "topk": {"model_a": [51832, 15, 0.011424032039940357, [[22590, 0.303405, " the", false], [63370, 0.157458, " computation", false], [30789, 0.027819, " ever", false], [59846, 0.02251, " increased", false], [37045, 0.022385, " Moore", false], [52195, 0.020302, " massive", false], [46064, 0.018045, " future", false], [22168, 0.017638, " new", false], [31458, 0.017612, " more", false], [64862, 0.017045, " computational", false]]], "model_b": [51832, 11, 0.01084891613572836, [[22590, 0.411892, " the", false], [63370, 0.088304, " computation", false], [64862, 0.037105, " computational", false], [59346, 0.033179, " computing", false], [38864, 0.017531, " large", false], [332, 0.017115, " a", false], [59206, 0.016722, " available", false], [31458, 0.014983, " more", false], [22168, 0.013022, " new", false], [52167, 0.01131, " machine", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04504244389819982}, {"byte_start": 1219, "byte_end": 1227, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 211, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "3.31% 3.31% 3.31% 3.31% 3.31% 3.31% 3.31% 3.31%", "model_b": "3.63% 3.63% 3.63% 3.63% 3.63% 3.63% 3.63% 3.63%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.23186956346035004]], "model_b": [[52224, " methods", "normal", 0.20070134103298187]]}, "loss": {"model_a": 3.310872408290101, "model_b": 3.62787083036043}, "topk": {"model_a": [52224, 2, 0.23186956346035004, [[63370, 0.4417, " computation", false], [52224, 0.23187, " methods", false], [46, 0.03256, "-", false], [64862, 0.030287, " computational", false], [61590, 0.028573, " approaches", false], [7933, 0.021709, "ity", false], [41729, 0.01786, "izable", false], [45, 0.01437, ",", false], [59346, 0.012275, " computing", false], [62633, 0.011489, " techniques", false]]], "model_b": [52224, 1, 0.20070134103298187, [[52224, 0.200701, " methods", false], [63370, 0.180506, " computation", false], [46, 0.120878, "-", false], [59346, 0.064932, " computing", false], [64862, 0.043198, " computational", false], [3609, 0.031633, " AI", false], [7933, 0.023324, "ity", false], [45, 0.020074, ",", false], [41729, 0.013917, "izable", false], [59943, 0.010161, " knowledge", false]]]}, "raw_delta": -0.017578125, "tuned_delta": 0.03527681889819982}, {"byte_start": 1227, "byte_end": 1233, "display": {"text": " lever", "kind": "normal"}, "is_word": true, "word_id": 212, "word_key": " lever", "bytes_hex": "20 6c 65 76 65 72", "compression": {"model_a": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46%", "model_b": "24.80% 24.80% 24.80% 24.80% 24.80% 24.80%"}, "model_tokens": {"model_a": [[38888, " lever", "normal", 0.007997123524546623]], "model_b": [[38888, " lever", "normal", 0.0002626448404043913]]}, "loss": {"model_a": 14.464520592246117, "model_b": 24.796321015279055}, "topk": {"model_a": [38888, 12, 0.007997123524546623, [[47, 0.564041, ".", false], [32227, 0.121789, " that", false], [45, 0.082142, ",", false], [21265, 0.028665, " and", false], [4706, 0.023123, " of", false], [21700, 0.020084, " for", false], [275, 0.017528, " (", false], [31296, 0.01184, " like", false], [37810, 0.010116, " based", false], [4596, 0.010013, " in", false]]], "model_b": [38888, 50, 0.0002626448404043913, [[47, 0.753823, ".", false], [45, 0.058042, ",", false], [21265, 0.033578, " and", false], [32227, 0.030786, " that", false], [4596, 0.019089, " in", false], [275, 0.011379, " (", false], [32226, 0.009054, " than", false], [21700, 0.006107, " for", false], [4423, 0.005164, " as", false], [4811, 0.004402, " to", false]]]}, "raw_delta": -0.5729166666666666, "tuned_delta": -0.5200617227684668}, {"byte_start": 1233, "byte_end": 1238, "display": {"text": "aging", "kind": "normal"}, "is_word": true, "word_id": 213, "word_key": "aging", "bytes_hex": "61 67 69 6e 67", "compression": {"model_a": "0.01% 0.01% 0.01% 0.01% 0.01%", "model_b": "0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"model_a": [[33672, "aging", "normal", 0.9960817694664001]], "model_b": [[33672, "aging", "normal", 0.9986432194709778]]}, "loss": {"model_a": 0.014088818758681282, "model_b": 0.004925583120710839}, "topk": {"model_a": [33672, 1, 0.9960817694664001, [[33672, 0.996082, "aging", false], [7856, 0.002575, "ing", false], [116, 0.000511, "s", false], [1843, 0.000294, "ed", false], [33943, 7.5e-05, "ating", false], [6934, 5.8e-05, "aga", false], [25504, 5.6e-05, "ging", false], [46, 5.3e-05, "-", false], [24381, 3.8e-05, "able", false], [1739, 2.6e-05, "ag", false]]], "model_b": [33672, 1, 0.9986432194709778, [[33672, 0.998643, "aging", false], [1843, 0.000564, "ed", false], [7856, 0.000454, "ing", false], [24451, 9.9e-05, "aged", false], [116, 1.9e-05, "s", false], [25504, 1.7e-05, "ging", false], [24738, 1.3e-05, "ated", false], [6935, 1.2e-05, "age", false], [33944, 1.1e-05, "ation", false], [33943, 1e-05, "ating", false]]]}, "raw_delta": 0.0005081176757812501, "tuned_delta": 0.053363061573981074}, {"byte_start": 1238, "byte_end": 1250, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 214, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18%", "model_b": "0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.8859444260597229]], "model_b": [[63370, " computation", "normal", 0.794298529624939]]}, "loss": {"model_a": 0.18124678298928526, "model_b": 0.34781771310494414}, "topk": {"model_a": [63370, 1, 0.8859444260597229, [[63370, 0.885944, " computation", false], [22590, 0.01314, " the", false], [52195, 0.006724, " massive", false], [64862, 0.005695, " computational", false], [31458, 0.003408, " more", false], [59846, 0.003176, " increased", false], [59346, 0.002973, " computing", false], [30789, 0.002966, " ever", false], [64298, 0.002932, " computations", false], [38864, 0.002575, " large", false]]], "model_b": [63370, 1, 0.794298529624939, [[63370, 0.794299, " computation", false], [22590, 0.036139, " the", false], [59346, 0.025173, " computing", false], [64862, 0.017863, " computational", false], [51266, 0.010191, " compute", false], [38720, 0.008984, " human", false], [332, 0.004789, " a", false], [51832, 0.004599, " general", false], [64298, 0.004095, " computations", false], [38864, 0.003231, " large", false]]]}, "raw_delta": -0.009236653645833332, "tuned_delta": 0.04361829025236649}, {"byte_start": 1250, "byte_end": 1251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "2.55%", "model_b": "2.11%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8681315779685974]], "model_b": [[47, ".", "normal", 0.889737606048584]]}, "loss": {"model_a": 2.553598400010982, "model_b": 2.1133228138021924}, "topk": {"model_a": [47, 1, 0.8681315779685974, [[47, 0.868132, ".", false], [45, 0.06411, ",", false], [275, 0.016747, " (", false], [32227, 0.004403, " that", false], [4596, 0.004052, " in", false], [4811, 0.003372, " to", false], [21265, 0.003167, " and", false], [60, 0.003072, ";", false], [4423, 0.001935, " as", false], [9816, 0.001897, "—", false]]], "model_b": [47, 1, 0.889737606048584, [[47, 0.889738, ".", false], [45, 0.035295, ",", false], [21265, 0.009378, " and", false], [275, 0.007412, " (", false], [4596, 0.006736, " in", false], [4811, 0.004848, " to", false], [4423, 0.00363, " as", false], [21700, 0.003303, " for", false], [31458, 0.002849, " more", false], [59, 0.002235, ":", false]]]}, "raw_delta": 0.0244140625, "tuned_delta": 0.07726900639819982}, {"byte_start": 1251, "byte_end": 1253, "display": {"text": "  ", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 20", "compression": {"model_a": "78.33% 78.33%", "model_b": "76.08% 76.08%"}, "model_tokens": {"model_a": [[267, "  ", "normal", 0.00017019797815009952]], "model_b": [[267, "  ", "normal", 0.00021564574853982776]]}, "loss": {"model_a": 78.33383229826792, "model_b": 76.07962129687893}, "topk": {"model_a": [267, 197, 0.00017019797815009952, [[11, 0.400473, "\n", false], [261, 0.118609, "\n\n", false], [20996, 0.067599, " The", false], [29894, 0.030724, " This", false], [19555, 0.028749, " But", false], [3913, 0.023361, " In", false], [3918, 0.020811, " It", false], [4217, 0.014991, " So", false], [37451, 0.012859, " There", false], [19907, 0.012382, " For", false]]], "model_b": [267, 189, 0.00021564574853982776, [[11, 0.384658, "\n", false], [261, 0.073524, "\n\n", false], [20996, 0.066031, " The", false], [29894, 0.044924, " This", false], [3913, 0.029411, " In", false], [0, 0.02102, "[0]", false], [19907, 0.018948, " For", false], [19555, 0.018587, " But", false], [3918, 0.014992, " It", false], [37451, 0.012185, " There", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17785494389819984}, {"byte_start": 1253, "byte_end": 1258, "display": {"text": "There", "kind": "normal"}, "is_word": true, "word_id": 215, "word_key": "there", "bytes_hex": "54 68 65 72 65", "compression": {"model_a": "11.67% 11.67% 11.67% 11.67% 11.67%", "model_b": "13.58% 13.58% 13.58% 13.58% 13.58%"}, "model_tokens": {"model_a": [[33504, "There", "normal", 0.03908878564834595]], "model_b": [[33504, "There", "normal", 0.022980013862252235]]}, "loss": {"model_a": 11.6655419321881, "model_b": 13.581621283368756}, "topk": {"model_a": [33504, 4, 0.03908878564834595, [[6699, 0.158678, "The", false], [1136, 0.055327, "In", false], [24242, 0.053352, "This", false], [33504, 0.039089, "There", false], [1141, 0.030504, "It", false], [5658, 0.029139, "But", false], [74, 0.02821, "I", false], [5936, 0.025037, "For", false], [66, 0.02373, "A", false], [1461, 0.017307, "So", false]]], "model_b": [33504, 5, 0.022980013862252235, [[6699, 0.156064, "The", false], [24242, 0.055964, "This", false], [1136, 0.043419, "In", false], [66, 0.027548, "A", false], [33504, 0.02298, "There", false], [5936, 0.022738, "For", false], [74, 0.015316, "I", false], [853, 0.01502, "As", false], [1141, 0.014948, "It", false], [5658, 0.014504, "But", false]]]}, "raw_delta": -0.10625000000000007, "tuned_delta": -0.053395056101800245}, {"byte_start": 1258, "byte_end": 1263, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 216, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "17.81% 17.81% 17.81% 17.81% 17.81%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.0070932237431406975]], "model_b": [[32462, " were", "normal", 0.006670194678008556]]}, "loss": {"model_a": 17.808266910973142, "model_b": 18.03368801111204}, "topk": {"model_a": [32462, 8, 0.0070932237431406975, [[21286, 0.494507, " are", false], [4600, 0.314811, " is", false], [460, 0.074907, "'s", false], [31059, 0.033032, " have", false], [21800, 0.020632, " has", false], [22748, 0.01004, " was", false], [22074, 0.007759, " may", false], [32462, 0.007093, " were", false], [32475, 0.00575, " will", false], [21413, 0.003, " can", false]]], "model_b": [32462, 9, 0.006670194678008556, [[21286, 0.495346, " are", false], [4600, 0.346104, " is", false], [460, 0.03151, "'s", false], [31059, 0.030757, " have", false], [21800, 0.020224, " has", false], [22748, 0.009235, " was", false], [22074, 0.009093, " may", false], [32475, 0.008064, " will", false], [32462, 0.00667, " were", false], [21413, 0.00636, " can", false]]]}, "raw_delta": -0.012499999999999956, "tuned_delta": 0.040354943898199866}, {"byte_start": 1263, "byte_end": 1268, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 217, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"model_a": "9.41% 9.41% 9.41% 9.41% 9.41%", "model_b": "7.89% 7.89% 7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[31370, " many", "normal", 0.07423875480890274]], "model_b": [[31370, " many", "normal", 0.11239338666200638]]}, "loss": {"model_a": 9.411330930799096, "model_b": 7.889738504861517}, "topk": {"model_a": [31370, 4, 0.07423875480890274, [[332, 0.11888, " a", false], [32074, 0.090574, " some", false], [22638, 0.085378, " two", false], [31370, 0.074239, " many", false], [52869, 0.048259, " several", false], [39193, 0.039918, " other", false], [61963, 0.029018, " exceptions", false], [39962, 0.026907, " times", false], [45, 0.02348, ",", false], [39946, 0.018904, " three", false]]], "model_b": [31370, 1, 0.11239338666200638, [[31370, 0.112393, " many", false], [332, 0.104141, " a", false], [22638, 0.088127, " two", false], [32074, 0.0705, " some", false], [52869, 0.053998, " several", false], [39946, 0.039192, " three", false], [30135, 0.023183, " also", false], [39193, 0.023123, " other", false], [45, 0.015044, ",", false], [4424, 0.012912, " at", false]]]}, "raw_delta": 0.08437499999999998, "tuned_delta": 0.1372299438981998}, {"byte_start": 1268, "byte_end": 1277, "display": {"text": " examples", "kind": "normal"}, "is_word": true, "word_id": 218, "word_key": " examples", "bytes_hex": "20 65 78 61 6d 70 6c 65 73", "compression": {"model_a": "5.76% 5.76% 5.76% 5.76% 5.76% 5.76% 5.76% 5.76% 5.76%", "model_b": "6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73%"}, "model_tokens": {"model_a": [[56162, " examples", "normal", 0.0561143197119236]], "model_b": [[56162, " examples", "normal", 0.03508375957608223]]}, "loss": {"model_a": 5.760761447994124, "model_b": 6.731324518036613}, "topk": {"model_a": [56162, 2, 0.0561143197119236, [[39193, 0.064558, " other", false], [56162, 0.056114, " examples", false], [3609, 0.031489, " AI", false], [52654, 0.030757, " reasons", false], [46787, 0.023954, " people", false], [30992, 0.023132, " good", false], [38328, 0.022827, " early", false], [55572, 0.020883, " attempts", false], [32448, 0.020377, " ways", false], [39962, 0.019316, " times", false]]], "model_b": [56162, 2, 0.03508375957608223, [[52654, 0.052049, " reasons", false], [56162, 0.035084, " examples", false], [32448, 0.029548, " ways", false], [39962, 0.028588, " times", false], [39193, 0.028536, " other", false], [30992, 0.026247, " good", false], [3609, 0.023048, " AI", false], [52127, 0.022912, " lessons", false], [40237, 0.022043, " years", false], [55572, 0.017795, " attempts", false]]]}, "raw_delta": -0.053819444444444475, "tuned_delta": -0.0009645005462446538}, {"byte_start": 1277, "byte_end": 1280, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 219, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "2.96% 2.96% 2.96%", "model_b": "3.57% 3.57% 3.57%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.61343914270401]], "model_b": [[4706, " of", "normal", 0.5572123527526855]]}, "loss": {"model_a": 2.9586519393230692, "model_b": 3.5691674188659244}, "topk": {"model_a": [4706, 1, 0.61343914270401, [[4706, 0.613439, " of", false], [4596, 0.168451, " in", false], [45805, 0.028667, " during", false], [31601, 0.024389, " over", false], [30917, 0.018995, " from", false], [32227, 0.018298, " that", false], [62650, 0.015974, " throughout", false], [40185, 0.015438, " where", false], [45, 0.012821, ",", false], [37678, 0.008415, " along", false]]], "model_b": [4706, 1, 0.5572123527526855, [[4706, 0.557212, " of", false], [4596, 0.200913, " in", false], [40185, 0.035925, " where", false], [30917, 0.023157, " from", false], [31601, 0.022502, " over", false], [45805, 0.020955, " during", false], [32227, 0.014674, " that", false], [45, 0.012694, ",", false], [62650, 0.011603, " throughout", false], [4811, 0.006159, " to", false]]]}, "raw_delta": -0.03385416666666666, "tuned_delta": 0.019000777231533164}, {"byte_start": 1280, "byte_end": 1283, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 220, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "20.19% 20.19% 20.19%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.03427301347255707]], "model_b": [[3609, " AI", "normal", 0.11160546541213989]]}, "loss": {"model_a": 20.19397355410984, "model_b": 13.243489633160404}, "topk": {"model_a": [3609, 3, 0.03427301347255707, [[32234, 0.494103, " this", false], [22590, 0.073582, " the", false], [3609, 0.034273, " AI", false], [57103, 0.021341, " research", false], [52224, 0.016555, " methods", false], [39936, 0.015279, " these", false], [63843, 0.014843, " researchers", false], [38720, 0.013557, " human", false], [51832, 0.012078, " general", false], [32139, 0.011971, " such", false]]], "model_b": [3609, 2, 0.11160546541213989, [[32234, 0.307972, " this", false], [3609, 0.111605, " AI", false], [22590, 0.052077, " the", false], [57103, 0.027958, " research", false], [39936, 0.026991, " these", false], [63843, 0.020431, " researchers", false], [21835, 0.019957, " how", false], [62603, 0.016559, " successful", false], [38720, 0.011214, " human", false], [51832, 0.009484, " general", false]]]}, "raw_delta": 0.38541666666666674, "tuned_delta": 0.4382716105648666}, {"byte_start": 1283, "byte_end": 1295, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 221, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80%", "model_b": "2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.0790698379278183]], "model_b": [[63843, " researchers", "normal", 0.1758067011833191]]}, "loss": {"model_a": 3.803981064843946, "model_b": 2.606431470356037}, "topk": {"model_a": [63843, 3, 0.0790698379278183, [[57103, 0.302787, " research", false], [53087, 0.086116, " systems", false], [63843, 0.07907, " researchers", false], [56952, 0.060216, " projects", false], [32227, 0.046042, " that", false], [52224, 0.04192, " methods", false], [61590, 0.025808, " approaches", false], [4596, 0.023636, " in", false], [45124, 0.0177, " agents", false], [60587, 0.0137, " successes", false]]], "model_b": [63843, 2, 0.1758067011833191, [[57103, 0.250349, " research", false], [63843, 0.175807, " researchers", false], [53087, 0.052367, " systems", false], [45124, 0.051031, " agents", false], [32227, 0.049704, " that", false], [52224, 0.036805, " methods", false], [61590, 0.036421, " approaches", false], [56952, 0.01953, " projects", false], [46, 0.010118, "-", false], [4596, 0.008713, " in", false]]]}, "raw_delta": 0.06640625, "tuned_delta": 0.11926119389819982}, {"byte_start": 1295, "byte_end": 1296, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"model_a": "89.60%", "model_b": "96.37%"}, "model_tokens": {"model_a": [[40, "'", "normal", 0.00689466018229723]], "model_b": [[40, "'", "normal", 0.004722745157778263]]}, "loss": {"model_a": 89.60488730521296, "model_b": 96.36752030937997}, "topk": {"model_a": [40, 27, 0.00689466018229723, [[22762, 0.219243, " who", false], [4596, 0.059549, " in", false], [46500, 0.036394, " making", false], [51709, 0.026463, " falling", false], [31601, 0.022415, " over", false], [51844, 0.020594, " getting", false], [47629, 0.018075, " trying", false], [32227, 0.017296, " that", false], [45, 0.016855, ",", false], [38279, 0.015547, " doing", false]]], "model_b": [40, 32, 0.004722745157778263, [[22762, 0.183326, " who", false], [47629, 0.040301, " trying", false], [46500, 0.032175, " making", false], [4596, 0.026912, " in", false], [47497, 0.026261, " taking", false], [32227, 0.025313, " that", false], [52834, 0.020424, " seeking", false], [45, 0.017465, ",", false], [40085, 0.016818, " using", false], [56996, 0.015974, " pursuing", false]]]}, "raw_delta": -0.375, "tuned_delta": -0.32214505610180016}, {"byte_start": 1296, "byte_end": 1300, "display": {"text": " bel", "kind": "normal"}, "is_word": true, "word_id": 222, "word_key": " bel", "bytes_hex": "20 62 65 6c", "compression": {"model_a": "41.70% 41.70% 41.70% 41.70%", "model_b": "40.86% 40.86% 40.86% 40.86%"}, "model_tokens": {"model_a": [[21344, " bel", "normal", 9.651881555328146e-05]], "model_b": [[21344, " bel", "normal", 0.00011332187568768859]]}, "loss": {"model_a": 41.70290352569659, "model_b": 40.857574400175714}, "topk": {"model_a": [21344, 899, 9.651881555328146e-05, [[51708, 0.059587, " failure", false], [61701, 0.042615, " commitment", false], [62157, 0.02999, " investment", false], [55572, 0.021724, " attempts", false], [59834, 0.021614, " inability", false], [31601, 0.015991, " over", false], [38530, 0.015452, " focus", false], [56652, 0.013955, " mistakes", false], [63678, 0.013449, " investments", false], [57404, 0.012401, " tendency", false]]], "model_b": [21344, 983, 0.00011332187568768859, [[55572, 0.126257, " attempts", false], [51566, 0.032488, " efforts", false], [51708, 0.01254, " failure", false], [47629, 0.011647, " trying", false], [31601, 0.01142, " over", false], [52612, 0.011207, " pursuit", false], [22681, 0.010406, " use", false], [62476, 0.008577, " reluctance", false], [39093, 0.008316, " naive", false], [45718, 0.007259, " desire", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.09972994389819982}, {"byte_start": 1300, "byte_end": 1304, "display": {"text": "ated", "kind": "normal"}, "is_word": true, "word_id": 223, "word_key": "ated", "bytes_hex": "61 74 65 64", "compression": {"model_a": "1.55% 1.55% 1.55% 1.55%", "model_b": "0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"model_a": [[24738, "ated", "normal", 0.7104941606521606]], "model_b": [[24738, "ated", "normal", 0.8028844594955444]]}, "loss": {"model_a": 1.549770063454941, "model_b": 0.9906200689697776}, "topk": {"model_a": [24738, 1, 0.7104941606521606, [[24738, 0.710494, "ated", false], [1840, 0.120446, "ea", false], [7931, 0.088189, "itt", false], [27525, 0.023769, "ying", false], [24385, 0.011716, "abor", false], [1848, 0.00722, "ei", false], [34907, 0.007218, "ittle", false], [33943, 0.003728, "ating", false], [34116, 0.002651, "ching", false], [1956, 0.001914, "it", false]]], "model_b": [24738, 1, 0.8028844594955444, [[24738, 0.802884, "ated", false], [7931, 0.076944, "itt", false], [24385, 0.04865, "abor", false], [34907, 0.018444, "ittle", false], [1840, 0.016778, "ea", false], [6896, 0.008241, "abo", false], [27525, 0.008204, "ying", false], [1848, 0.006698, "ei", false], [8862, 0.000826, "ubi", false], [34116, 0.000757, "ching", false]]]}, "raw_delta": 0.031005859375, "tuned_delta": 0.08386080327319982}, {"byte_start": 1304, "byte_end": 1313, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 224, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21%", "model_b": "9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.003671869868412614]], "model_b": [[56537, " learning", "normal", 0.008046160452067852]]}, "loss": {"model_a": 11.20843803468422, "model_b": 9.643013728164076}, "topk": {"model_a": [56537, 18, 0.003671869868412614, [[63821, 0.456058, " recognition", false], [63820, 0.235123, " realization", false], [59544, 0.049065, " discovery", false], [64253, 0.025682, " appreciation", false], [59209, 0.024355, " awareness", false], [65034, 0.021681, " understanding", false], [61518, 0.012078, " acceptance", false], [21265, 0.009162, " and", false], [55572, 0.008584, " attempts", false], [63257, 0.007496, " acknowledge", false]]], "model_b": [56537, 10, 0.008046160452067852, [[63820, 0.47518, " realization", false], [63821, 0.162285, " recognition", false], [2030, 0.095625, "ly", false], [59209, 0.0356, " awareness", false], [55572, 0.022115, " attempts", false], [65034, 0.018976, " understanding", false], [59544, 0.010833, " discovery", false], [61518, 0.009013, " acceptance", false], [64253, 0.008928, " appreciation", false], [56537, 0.008046, " learning", false]]]}, "raw_delta": 0.08680555555555558, "tuned_delta": 0.13966049945375542}, {"byte_start": 1313, "byte_end": 1316, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 225, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "2.64% 2.64% 2.64%", "model_b": "14.37% 14.37% 14.37%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.6419601440429688]], "model_b": [[4706, " of", "normal", 0.09134647250175476]]}, "loss": {"model_a": 2.6416535172527404, "model_b": 14.370595133854907}, "topk": {"model_a": [4706, 1, 0.6419601440429688, [[4706, 0.64196, " of", false], [32227, 0.093698, " that", false], [30917, 0.064453, " from", false], [37598, 0.051916, " about", false], [4811, 0.027651, " to", false], [116, 0.018768, "s", false], [32234, 0.017658, " this", false], [4596, 0.012471, " in", false], [22590, 0.012027, " the", false], [45, 0.009202, ",", false]]], "model_b": [4706, 5, 0.09134647250175476, [[30917, 0.184069, " from", false], [37598, 0.139141, " about", false], [116, 0.097601, "s", false], [32227, 0.097062, " that", false], [4706, 0.091346, " of", false], [4596, 0.051911, " in", false], [45, 0.046871, ",", false], [4811, 0.04584, " to", false], [47, 0.041537, ".", false], [32234, 0.031213, " this", false]]]}, "raw_delta": -0.650390625, "tuned_delta": -0.5975356811018002}, {"byte_start": 1316, "byte_end": 1321, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 226, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "2.90% 2.90% 2.90% 2.90% 2.90%", "model_b": "1.73% 1.73% 1.73% 1.73% 1.73%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.44505393505096436]], "model_b": [[32234, " this", "normal", 0.6114832162857056]]}, "loss": {"model_a": 2.902296664288344, "model_b": 1.7329247073177978}, "topk": {"model_a": [32234, 1, 0.44505393505096436, [[32234, 0.445054, " this", false], [22590, 0.340882, " the", false], [39936, 0.077245, " these", false], [51832, 0.018005, " general", false], [21835, 0.014844, " how", false], [32464, 0.010144, " what", false], [32227, 0.009772, " that", false], [37045, 0.009548, " Moore", false], [332, 0.007326, " a", false], [52127, 0.005772, " lessons", false]]], "model_b": [32234, 1, 0.6114832162857056, [[32234, 0.611483, " this", false], [22590, 0.211335, " the", false], [39936, 0.072739, " these", false], [32227, 0.020476, " that", false], [37045, 0.012146, " Moore", false], [21835, 0.008937, " how", false], [32464, 0.006899, " what", false], [332, 0.004769, " a", false], [39931, 0.004566, " their", false], [51832, 0.004029, " general", false]]]}, "raw_delta": 0.06484375, "tuned_delta": 0.11769869389819983}, {"byte_start": 1321, "byte_end": 1328, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 227, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19%", "model_b": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.0008620054577477276]], "model_b": [[45315, " bitter", "normal", 0.0002502522838767618]]}, "loss": {"model_a": 18.194703082639826, "model_b": 21.415004513195548}, "topk": {"model_a": [45315, 47, 0.0008620054577477276, [[46430, 0.586187, " lesson", false], [30808, 0.083532, " fact", false], [4596, 0.032103, " in", false], [45, 0.024598, ",", false], [47, 0.022076, ".", false], [45805, 0.02088, " during", false], [31601, 0.020035, " over", false], [40029, 0.01554, " truth", false], [63591, 0.01467, " fundamental", false], [51832, 0.012961, " general", false]]], "model_b": [45315, 157, 0.0002502522838767618, [[46430, 0.277033, " lesson", false], [47, 0.113436, ".", false], [45, 0.104094, ",", false], [30808, 0.072719, " fact", false], [40029, 0.038755, " truth", false], [4596, 0.037655, " in", false], [31601, 0.023546, " over", false], [60250, 0.018962, " principle", false], [21265, 0.012844, " and", false], [59, 0.012667, ":", false]]]}, "raw_delta": -0.1785714285714286, "tuned_delta": -0.12571648467322877}, {"byte_start": 1328, "byte_end": 1335, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 228, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.9634103775024414]], "model_b": [[46430, " lesson", "normal", 0.9192620515823364]]}, "loss": {"model_a": 0.095602698719623, "model_b": 0.21636400236546258}, "topk": {"model_a": [46430, 1, 0.9634103775024414, [[46430, 0.96341, " lesson", false], [40029, 0.014694, " truth", false], [30808, 0.00243, " fact", false], [45, 0.001943, ",", false], [21400, 0.001412, " but", false], [7513, 0.001314, "est", false], [21265, 0.001013, " and", false], [46454, 0.000934, " little", false], [31683, 0.000742, " pill", false], [52127, 0.00059, " lessons", false]]], "model_b": [46430, 1, 0.9192620515823364, [[46430, 0.919262, " lesson", false], [40029, 0.05253, " truth", false], [52652, 0.00327, " reality", false], [30808, 0.002847, " fact", false], [21988, 0.00216, " law", false], [45, 0.00185, ",", false], [46, 0.001722, "-", false], [31683, 0.001321, " pill", false], [39997, 0.000653, " trade", false], [21265, 0.000433, " and", false]]]}, "raw_delta": -0.006696428571428574, "tuned_delta": 0.046158515326771246}, {"byte_start": 1335, "byte_end": 1336, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "30.57%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.18239976465702057]], "model_b": [[45, ",", "normal", 0.20595824718475342]]}, "loss": {"model_a": 30.572736706338382, "model_b": 28.600302080123}, "topk": {"model_a": [45, 3, 0.18239976465702057, [[47, 0.287882, ".", false], [4596, 0.18818, " in", false], [45, 0.1824, ",", false], [31601, 0.066895, " over", false], [45805, 0.061286, " during", false], [59, 0.019234, ":", false], [32227, 0.017887, " that", false], [30917, 0.013504, " from", false], [62650, 0.012266, " throughout", false], [37634, 0.011038, " after", false]]], "model_b": [45, 2, 0.20595824718475342, [[47, 0.346671, ".", false], [45, 0.205958, ",", false], [4596, 0.099794, " in", false], [31601, 0.046459, " over", false], [30917, 0.038725, " from", false], [45805, 0.035916, " during", false], [59, 0.02211, ":", false], [21265, 0.017369, " and", false], [4423, 0.016289, " as", false], [275, 0.016143, " (", false]]]}, "raw_delta": 0.109375, "tuned_delta": 0.16222994389819984}, {"byte_start": 1336, "byte_end": 1340, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 229, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "8.59% 8.59% 8.59% 8.59%", "model_b": "8.63% 8.63% 8.63% 8.63%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.1504797339439392]], "model_b": [[21265, " and", "normal", 0.14588531851768494]]}, "loss": {"model_a": 8.594179442795582, "model_b": 8.629401489692285}, "topk": {"model_a": [21265, 2, 0.1504797339439392, [[21400, 0.353385, " but", false], [21265, 0.15048, " and", false], [59841, 0.0459, " including", false], [40186, 0.035547, " which", false], [4423, 0.024487, " as", false], [32139, 0.022184, " such", false], [4596, 0.021414, " in", false], [30917, 0.016931, " from", false], [22590, 0.014308, " the", false], [57295, 0.013829, " starting", false]]], "model_b": [21265, 2, 0.14588531851768494, [[21400, 0.222034, " but", false], [21265, 0.145885, " and", false], [59841, 0.068505, " including", false], [32139, 0.051139, " such", false], [4423, 0.037389, " as", false], [31461, 0.034961, " most", false], [30917, 0.029019, " from", false], [32074, 0.024645, " some", false], [40186, 0.022013, " which", false], [61953, 0.021878, " especially", false]]]}, "raw_delta": -0.001953125, "tuned_delta": 0.05090181889819982}, {"byte_start": 1340, "byte_end": 1343, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 230, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "16.44% 16.44% 16.44%", "model_b": "15.97% 15.97% 15.97%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.06486406177282333]], "model_b": [[4601, " it", "normal", 0.07039174437522888]]}, "loss": {"model_a": 16.436955218461495, "model_b": 15.967327926505453}, "topk": {"model_a": [4601, 3, 0.06486406177282333, [[22590, 0.109998, " the", false], [31370, 0.080386, " many", false], [4601, 0.064864, " it", false], [39934, 0.062625, " there", false], [308, 0.044103, " I", false], [32074, 0.040354, " some", false], [4706, 0.03066, " of", false], [32232, 0.029102, " they", false], [332, 0.028398, " a", false], [22226, 0.02774, " one", false]]], "model_b": [4601, 2, 0.07039174437522888, [[22590, 0.09253, " the", false], [4601, 0.070392, " it", false], [31370, 0.057673, " many", false], [308, 0.056016, " I", false], [4706, 0.047075, " of", false], [32232, 0.046044, " they", false], [32074, 0.03931, " some", false], [39934, 0.03817, " there", false], [32234, 0.03253, " this", false], [4596, 0.031787, " in", false]]]}, "raw_delta": 0.02604166666666674, "tuned_delta": 0.07889661056486656}, {"byte_start": 1343, "byte_end": 1346, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 231, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "8.22% 8.22% 8.22%", "model_b": "5.68% 5.68% 5.68%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.25524985790252686]], "model_b": [[4600, " is", "normal", 0.38704532384872437]]}, "loss": {"model_a": 8.218477609230748, "model_b": 5.682490232668117}, "topk": {"model_a": [4600, 1, 0.25524985790252686, [[4600, 0.25525, " is", false], [22748, 0.137, " was", false], [460, 0.133585, "'s", false], [32272, 0.078788, " took", false], [21800, 0.047001, " has", false], [40219, 0.021153, " would", false], [39620, 0.020439, " seems", false], [59393, 0.016272, " continues", false], [32475, 0.013923, " will", false], [39820, 0.013292, " still", false]]], "model_b": [4600, 1, 0.38704532384872437, [[4600, 0.387045, " is", false], [460, 0.098046, "'s", false], [22748, 0.097996, " was", false], [21800, 0.056861, " has", false], [39620, 0.020286, " seems", false], [21413, 0.018898, " can", false], [32272, 0.017005, " took", false], [22074, 0.012389, " may", false], [32475, 0.011137, " will", false], [47266, 0.010951, " should", false]]]}, "raw_delta": 0.140625, "tuned_delta": 0.19347994389819984}, {"byte_start": 1346, "byte_end": 1355, "display": {"text": " instruct", "kind": "normal"}, "is_word": true, "word_id": 232, "word_key": " instruct", "bytes_hex": "20 69 6e 73 74 72 75 63 74", "compression": {"model_a": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "model_b": "9.14% 9.14% 9.14% 9.14% 9.14% 9.14% 9.14% 9.14% 9.14%"}, "model_tokens": {"model_a": [[56469, " instruct", "normal", 0.01778090000152588]], "model_b": [[56469, " instruct", "normal", 0.010477041825652122]]}, "loss": {"model_a": 8.077589421643935, "model_b": 9.142077950077633}, "topk": {"model_a": [56469, 9, 0.01778090000152588, [[22187, 0.115775, " not", false], [332, 0.082044, " a", false], [39820, 0.065593, " still", false], [22226, 0.051031, " one", false], [40218, 0.042103, " worth", false], [31581, 0.0296, " only", false], [22590, 0.020627, " the", false], [31048, 0.019601, " hard", false], [56469, 0.017781, " instruct", false], [30724, 0.01616, " easy", false]]], "model_b": [56469, 22, 0.010477041825652122, [[332, 0.0788, " a", false], [22187, 0.059814, " not", false], [22226, 0.048038, " one", false], [40218, 0.046739, " worth", false], [59829, 0.031245, " important", false], [22590, 0.026903, " the", false], [46439, 0.025301, " likely", false], [4419, 0.024722, " an", false], [52448, 0.01807, " perhaps", false], [31581, 0.017865, " only", false]]]}, "raw_delta": -0.05902777777777773, "tuned_delta": -0.006172833879577906}, {"byte_start": 1355, "byte_end": 1358, "display": {"text": "ive", "kind": "normal"}, "is_word": true, "word_id": 233, "word_key": "ive", "bytes_hex": "69 76 65", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.00% 0.00% 0.00%"}, "model_tokens": {"model_a": [[7938, "ive", "normal", 0.9984034895896912]], "model_b": [[7938, "ive", "normal", 0.9992814660072327]]}, "loss": {"model_a": 0.009631028448317282, "model_b": 0.0043568938218578185}, "topk": {"model_a": [7938, 1, 0.9984034895896912, [[7938, 0.998403, "ive", false], [34918, 0.00098, "ively", false], [7856, 0.000432, "ing", false], [24381, 3.7e-05, "able", false], [4811, 2.5e-05, " to", false], [33948, 9e-06, "ative", false], [25656, 8e-06, "ible", false], [1958, 7e-06, "iv", false], [49338, 7e-06, "iveness", false], [2255, 4e-06, "ve", false]]], "model_b": [7938, 1, 0.9992814660072327, [[7938, 0.999281, "ive", false], [34918, 0.000485, "ively", false], [7856, 8.8e-05, "ing", false], [26018, 2.2e-05, "ives", false], [24381, 2.2e-05, "able", false], [49338, 2e-05, "iveness", false], [4811, 1.4e-05, " to", false], [1958, 1.2e-05, "iv", false], [26015, 8e-06, "ivel", false], [25656, 7e-06, "ible", false]]]}, "raw_delta": 0.00029246012369791663, "tuned_delta": 0.053147404021897736}, {"byte_start": 1358, "byte_end": 1361, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 234, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.95% 0.95% 0.95%", "model_b": "0.99% 0.99% 0.99%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8543063402175903]], "model_b": [[4811, " to", "normal", 0.8502980470657349]]}, "loss": {"model_a": 0.945124925061536, "model_b": 0.9862173131076897}, "topk": {"model_a": [4811, 1, 0.8543063402175903, [[4811, 0.854306, " to", false], [32227, 0.059943, " that", false], [21700, 0.015725, " for", false], [47, 0.014993, ".", false], [4596, 0.010182, " in", false], [21265, 0.006619, " and", false], [21835, 0.004622, " how", false], [45, 0.004382, ",", false], [31077, 0.003279, " here", false], [4423, 0.002962, " as", false]]], "model_b": [4811, 1, 0.8502980470657349, [[4811, 0.850298, " to", false], [47, 0.027792, ".", false], [32227, 0.027093, " that", false], [21700, 0.015625, " for", false], [4596, 0.013391, " in", false], [21265, 0.012833, " and", false], [31077, 0.009218, " here", false], [45, 0.007398, ",", false], [51018, 0.004006, " because", false], [4423, 0.003523, " as", false]]]}, "raw_delta": -0.0022786458333333356, "tuned_delta": 0.050576298064866486}, {"byte_start": 1361, "byte_end": 1368, "display": {"text": " review", "kind": "normal"}, "is_word": true, "word_id": 235, "word_key": " review", "bytes_hex": "20 72 65 76 69 65 77", "compression": {"model_a": "6.40% 6.40% 6.40% 6.40% 6.40% 6.40% 6.40%", "model_b": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"model_a": [[47108, " review", "normal", 0.083371102809906]], "model_b": [[47108, " review", "normal", 0.06417879462242126]]}, "loss": {"model_a": 6.400349093229498, "model_b": 7.084663147222587}, "topk": {"model_a": [47108, 3, 0.083371102809906, [[31324, 0.228605, " look", false], [22449, 0.093835, " see", false], [47108, 0.083371, " review", false], [55832, 0.07908, " consider", false], [51667, 0.050267, " examine", false], [52751, 0.031012, " revisit", false], [31834, 0.022021, " read", false], [52672, 0.018677, " reflect", false], [39942, 0.017824, " think", false], [4559, 0.01681, " go", false]]], "model_b": [47108, 4, 0.06417879462242126, [[31324, 0.204265, " look", false], [22449, 0.084451, " see", false], [55832, 0.077208, " consider", false], [47108, 0.064179, " review", false], [51667, 0.05149, " examine", false], [52672, 0.039112, " reflect", false], [31834, 0.038929, " read", false], [32187, 0.029281, " take", false], [52751, 0.021472, " revisit", false], [51250, 0.020735, " compare", false]]]}, "raw_delta": -0.03794642857142855, "tuned_delta": 0.014908515326771274}, {"byte_start": 1368, "byte_end": 1373, "display": {"text": " some", "kind": "normal"}, "is_word": true, "word_id": 236, "word_key": " some", "bytes_hex": "20 73 6f 6d 65", "compression": {"model_a": "3.78% 3.78% 3.78% 3.78% 3.78%", "model_b": "4.73% 4.73% 4.73% 4.73% 4.73%"}, "model_tokens": {"model_a": [[32074, " some", "normal", 0.3506676256656647]], "model_b": [[32074, " some", "normal", 0.2709016501903534]]}, "loss": {"model_a": 3.7758034273265837, "model_b": 4.733843102916911}, "topk": {"model_a": [32074, 1, 0.3506676256656647, [[32074, 0.350668, " some", false], [32229, 0.223376, " them", false], [332, 0.171608, " a", false], [22590, 0.071761, " the", false], [39936, 0.029968, " these", false], [39944, 0.021978, " those", false], [52869, 0.01404, " several", false], [31198, 0.012341, " just", false], [32464, 0.010032, " what", false], [22226, 0.00944, " one", false]]], "model_b": [32074, 1, 0.2709016501903534, [[32074, 0.270902, " some", false], [32229, 0.142643, " them", false], [22590, 0.131069, " the", false], [332, 0.098226, " a", false], [39936, 0.053076, " these", false], [32464, 0.035855, " what", false], [39931, 0.028361, " their", false], [21835, 0.023895, " how", false], [22226, 0.020591, " one", false], [39944, 0.016898, " those", false]]]}, "raw_delta": -0.053125, "tuned_delta": -0.0002700561018001771}, {"byte_start": 1373, "byte_end": 1376, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 237, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.10% 1.10% 1.10%", "model_b": "1.26% 1.26% 1.26%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8311388492584229]], "model_b": [[4706, " of", "normal", 0.8106138110160828]]}, "loss": {"model_a": 1.09775379494725, "model_b": 1.262123347131865}, "topk": {"model_a": [4706, 1, 0.8311388492584229, [[4706, 0.831139, " of", false], [47, 0.067199, ".", false], [56162, 0.022314, " examples", false], [32227, 0.007299, " that", false], [45, 0.00459, ",", false], [59, 0.00444, ":", false], [47014, 0.003807, " recent", false], [30917, 0.003069, " from", false], [37970, 0.002848, " cases", false], [4596, 0.001827, " in", false]]], "model_b": [4706, 1, 0.8106138110160828, [[4706, 0.810614, " of", false], [47, 0.049106, ".", false], [56162, 0.024453, " examples", false], [47014, 0.017803, " recent", false], [30917, 0.007244, " from", false], [32139, 0.005479, " such", false], [38328, 0.004706, " early", false], [4596, 0.003027, " in", false], [31636, 0.002567, " past", false], [32227, 0.00255, " that", false]]]}, "raw_delta": -0.009114583333333336, "tuned_delta": 0.043740360564866486}, {"byte_start": 1376, "byte_end": 1380, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 238, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.92% 7.92% 7.92% 7.92%", "model_b": "4.26% 4.26% 4.26% 4.26%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.1723017543554306]], "model_b": [[22590, " the", "normal", 0.3866804242134094]]}, "loss": {"model_a": 7.924960551758221, "model_b": 4.2618676745010875}, "topk": {"model_a": [22590, 2, 0.1723017543554306, [[32229, 0.620776, " them", false], [22590, 0.172302, " the", false], [39936, 0.135149, " these", false], [39944, 0.052931, " those", false], [39931, 0.011279, " their", false], [32234, 0.001238, " this", false], [32464, 0.001019, " what", false], [32227, 0.000812, " that", false], [4677, 0.000543, " my", false], [22248, 0.000517, " our", false]]], "model_b": [22590, 1, 0.3866804242134094, [[22590, 0.38668, " the", false], [32229, 0.284448, " them", false], [39936, 0.18363, " these", false], [39944, 0.064709, " those", false], [39931, 0.045848, " their", false], [32234, 0.010196, " this", false], [32464, 0.003534, " what", false], [22248, 0.003415, " our", false], [32227, 0.002303, " that", false], [4601, 0.002299, " it", false]]]}, "raw_delta": 0.203125, "tuned_delta": 0.25597994389819984}, {"byte_start": 1380, "byte_end": 1385, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 239, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "5.49% 5.49% 5.49% 5.49% 5.49%", "model_b": "6.17% 6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.21500150859355927]], "model_b": [[31461, " most", "normal", 0.1808624118566513]]}, "loss": {"model_a": 5.4946393158857, "model_b": 6.170902616302401}, "topk": {"model_a": [31461, 1, 0.21500150859355927, [[31461, 0.215002, " most", false], [31458, 0.078078, " more", false], [56162, 0.056937, " examples", false], [32448, 0.035712, " ways", false], [37970, 0.02767, " cases", false], [30273, 0.023474, " best", false], [38328, 0.018856, " early", false], [21952, 0.018518, " key", false], [31580, 0.017798, " ones", false], [56200, 0.017, " failures", false]]], "model_b": [31461, 1, 0.1808624118566513, [[31461, 0.180862, " most", false], [31458, 0.113926, " more", false], [38328, 0.054487, " early", false], [56162, 0.049368, " examples", false], [30273, 0.028548, " best", false], [32448, 0.024198, " ways", false], [52127, 0.020341, " lessons", false], [38961, 0.01979, " major", false], [21952, 0.019436, " key", false], [51551, 0.017796, " earlier", false]]]}, "raw_delta": -0.03749999999999998, "tuned_delta": 0.015354943898199844}, {"byte_start": 1385, "byte_end": 1395, "display": {"text": " prominent", "kind": "normal"}, "is_word": true, "word_id": 240, "word_key": " prominent", "bytes_hex": "20 70 72 6f 6d 69 6e 65 6e 74", "compression": {"model_a": "3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97%", "model_b": "3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94%"}, "model_tokens": {"model_a": [[60273, " prominent", "normal", 0.11204054206609726]], "model_b": [[60273, " prominent", "normal", 0.11150821298360825]]}, "loss": {"model_a": 3.973046889948121, "model_b": 3.9448692524307587}, "topk": {"model_a": [60273, 1, 0.11204054206609726, [[60273, 0.112041, " prominent", false], [52321, 0.090158, " notable", false], [45958, 0.089647, " famous", false], [59829, 0.075627, " important", false], [57323, 0.051954, " striking", false], [56056, 0.047452, " dramatic", false], [52796, 0.039792, " salient", false], [63870, 0.034335, " significant", false], [52346, 0.028489, " obvious", false], [47014, 0.026156, " recent", false]]], "model_b": [60273, 3, 0.11150821298360825, [[52321, 0.148189, " notable", false], [59829, 0.131886, " important", false], [60273, 0.111508, " prominent", false], [45958, 0.064921, " famous", false], [63636, 0.049034, " influential", false], [63870, 0.048621, " significant", false], [47014, 0.042967, " recent", false], [63667, 0.032033, " interesting", false], [45534, 0.027185, " common", false], [57074, 0.025394, " relevant", false]]]}, "raw_delta": 0.0015624999999999944, "tuned_delta": 0.054417443898199816}, {"byte_start": 1395, "byte_end": 1396, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "18.32%", "model_b": "29.16%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.3613024950027466]], "model_b": [[47, ".", "normal", 0.19882600009441376]]}, "loss": {"model_a": 18.315464386285665, "model_b": 29.163854830470253}, "topk": {"model_a": [47, 1, 0.3613024950027466, [[47, 0.361302, ".", false], [31580, 0.168972, " ones", false], [56162, 0.135224, " examples", false], [4706, 0.083775, " of", false], [37970, 0.050332, " cases", false], [21265, 0.031778, " and", false], [45, 0.024493, ",", false], [59, 0.021562, ":", false], [4596, 0.011399, " in", false], [56200, 0.008392, " failures", false]]], "model_b": [47, 2, 0.19882600009441376, [[31580, 0.226119, " ones", false], [47, 0.198826, ".", false], [56162, 0.184511, " examples", false], [4706, 0.072563, " of", false], [37970, 0.052022, " cases", false], [21265, 0.02409, " and", false], [3609, 0.021392, " AI", false], [4596, 0.01388, " in", false], [57103, 0.013826, " research", false], [45, 0.012538, ",", false]]]}, "raw_delta": -0.6015625, "tuned_delta": -0.5487075561018002}, {"byte_start": 1396, "byte_end": 1397, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "27.90%", "model_b": "21.98%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.04540111869573593]], "model_b": [[261, "\n\n", "control", 0.08607017993927002]]}, "loss": {"model_a": 27.895861142188938, "model_b": 21.9785572635428}, "topk": {"model_a": [261, 4, 0.04540111869573593, [[267, 0.270423, "  ", false], [11, 0.158195, "\n", false], [20996, 0.091044, " The", false], [261, 0.045401, "\n\n", false], [3913, 0.036204, " In", false], [20556, 0.025023, " One", false], [308, 0.014227, " I", false], [265, 0.013609, " \n", false], [19907, 0.012375, " For", false], [37453, 0.010242, " These", false]]], "model_b": [261, 2, 0.08607017993927002, [[11, 0.348245, "\n", false], [261, 0.08607, "\n\n", false], [267, 0.086048, "  ", false], [20996, 0.060173, " The", false], [20556, 0.041879, " One", false], [3913, 0.032476, " In", false], [300, 0.012269, " A", false], [265, 0.00966, " \n", false], [19907, 0.009561, " For", false], [308, 0.008237, " I", false]]]}, "raw_delta": 0.328125, "tuned_delta": 0.38097994389819984}, {"byte_start": 1397, "byte_end": 1398, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "27.90%", "model_b": "21.98%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.04540111869573593]], "model_b": [[261, "\n\n", "control", 0.08607017993927002]]}, "loss": {"model_a": 27.895861142188938, "model_b": 21.9785572635428}, "topk": {"model_a": [261, 4, 0.04540111869573593, [[267, 0.270423, "  ", false], [11, 0.158195, "\n", false], [20996, 0.091044, " The", false], [261, 0.045401, "\n\n", false], [3913, 0.036204, " In", false], [20556, 0.025023, " One", false], [308, 0.014227, " I", false], [265, 0.013609, " \n", false], [19907, 0.012375, " For", false], [37453, 0.010242, " These", false]]], "model_b": [261, 2, 0.08607017993927002, [[11, 0.348245, "\n", false], [261, 0.08607, "\n\n", false], [267, 0.086048, "  ", false], [20996, 0.060173, " The", false], [20556, 0.041879, " One", false], [3913, 0.032476, " In", false], [300, 0.012269, " A", false], [265, 0.00966, " \n", false], [19907, 0.009561, " For", false], [308, 0.008237, " I", false]]]}, "raw_delta": 0.328125, "tuned_delta": 0.38097994389819984}, {"byte_start": 1398, "byte_end": 1400, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 241, "word_key": "in", "bytes_hex": "49 6e", "compression": {"model_a": "31.28% 31.28%", "model_b": "34.52% 34.52%"}, "model_tokens": {"model_a": [[1136, "In", "normal", 0.030992809683084488]], "model_b": [[1136, "In", "normal", 0.021673619747161865]]}, "loss": {"model_a": 31.277177644272445, "model_b": 34.51760595876914}, "topk": {"model_a": [1136, 4, 0.030992809683084488, [[53648, 0.335636, "Question", false], [6699, 0.082598, "The", false], [66, 0.03101, "A", false], [1136, 0.030993, "In", false], [33161, 0.02246, "Human", false], [820, 0.018689, "AI", false], [6393, 0.017629, "One", false], [5585, 0.012256, "Ass", false], [50, 0.012169, "1", false], [36, 0.008044, "#", false]]], "model_b": [1136, 6, 0.021673619747161865, [[53648, 0.408776, "Question", false], [6699, 0.092527, "The", false], [36, 0.039016, "#", false], [66, 0.025269, "A", false], [820, 0.022187, "AI", false], [1136, 0.021674, "In", false], [6393, 0.014354, "One", false], [33161, 0.01107, "Human", false], [402, 0.011055, "##", false], [33106, 0.007559, "First", false]]]}, "raw_delta": -0.1796875, "tuned_delta": -0.12683255610180016}, {"byte_start": 1400, "byte_end": 1409, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 242, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21%", "model_b": "11.52% 11.52% 11.52% 11.52% 11.52% 11.52% 11.52% 11.52% 11.52%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.0038407498504966497]], "model_b": [[55809, " computer", "normal", 0.0031070788390934467]]}, "loss": {"model_a": 11.20843803468422, "model_b": 11.521522895988248}, "topk": {"model_a": [55809, 22, 0.0038407498504966497, [[22590, 0.40058, " the", false], [3492, 0.194823, " 19", false], [3493, 0.033186, " 20", false], [332, 0.030165, " a", false], [38328, 0.022916, " early", false], [21823, 0.014145, " his", false], [62293, 0.013164, " particular", false], [32234, 0.012904, " this", false], [31370, 0.012034, " many", false], [4677, 0.010389, " my", false]]], "model_b": [55809, 20, 0.0031070788390934467, [[22590, 0.416473, " the", false], [3492, 0.171354, " 19", false], [3493, 0.080219, " 20", false], [332, 0.034665, " a", false], [21823, 0.016028, " his", false], [22226, 0.012034, " one", false], [4677, 0.011654, " my", false], [4419, 0.01091, " an", false], [3609, 0.009634, " AI", false], [51832, 0.00926, " general", false]]]}, "raw_delta": -0.01736111111111105, "tuned_delta": 0.03549383278708877}, {"byte_start": 1409, "byte_end": 1415, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 243, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90%", "model_b": "16.06% 16.06% 16.06% 16.06% 16.06% 16.06%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.02678052894771099]], "model_b": [[38013, " chess", "normal", 0.004799254238605499]]}, "loss": {"model_a": 10.89535317338019, "model_b": 16.061253384896663}, "topk": {"model_a": [38013, 4, 0.02678052894771099, [[47732, 0.7331, " vision", false], [52814, 0.119229, " science", false], [56329, 0.041168, " graphics", false], [38013, 0.026781, " chess", false], [38576, 0.020042, " games", false], [46, 0.01298, "-", false], [63795, 0.004451, " programming", false], [46075, 0.003657, " gaming", false], [57181, 0.003153, " security", false], [30941, 0.001821, " game", false]]], "model_b": [38013, 7, 0.004799254238605499, [[47732, 0.618927, " vision", false], [52814, 0.235768, " science", false], [56329, 0.023387, " graphics", false], [63795, 0.015396, " programming", false], [46, 0.01334, "-", false], [64254, 0.012676, " architecture", false], [38013, 0.004799, " chess", false], [38576, 0.004787, " games", false], [53087, 0.003872, " systems", false], [63528, 0.003579, " engineering", false]]]}, "raw_delta": -0.2864583333333334, "tuned_delta": -0.2336033894351336}, {"byte_start": 1415, "byte_end": 1416, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.31%", "model_b": "5.42%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8331737518310547]], "model_b": [[45, ",", "normal", 0.7381832599639893]]}, "loss": {"model_a": 3.310872408290101, "model_b": 5.424195222092293}, "topk": {"model_a": [45, 1, 0.8331737518310547, [[45, 0.833174, ",", false], [22590, 0.016775, " the", false], [21265, 0.014909, " and", false], [4596, 0.01273, " in", false], [39934, 0.012584, " there", false], [275, 0.010477, " (", false], [4858, 0.008383, " we", false], [59, 0.005784, ":", false], [3609, 0.005103, " AI", false], [4601, 0.00481, " it", false]]], "model_b": [45, 1, 0.7381832599639893, [[45, 0.738183, ",", false], [57103, 0.053004, " research", false], [3609, 0.024496, " AI", false], [22590, 0.016857, " the", false], [275, 0.013437, " (", false], [4596, 0.012968, " in", false], [21265, 0.012216, " and", false], [39934, 0.007961, " there", false], [332, 0.004848, " a", false], [4601, 0.004611, " it", false]]]}, "raw_delta": -0.1171875, "tuned_delta": -0.06433255610180018}, {"byte_start": 1416, "byte_end": 1420, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 244, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "4.97% 4.97% 4.97% 4.97%", "model_b": "6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.3297352194786072]], "model_b": [[22590, " the", "normal", 0.21984124183654785]]}, "loss": {"model_a": 4.966308612435152, "model_b": 6.833077097960421}, "topk": {"model_a": [22590, 1, 0.3297352194786072, [[22590, 0.329735, " the", false], [21700, 0.071832, " for", false], [332, 0.042511, " a", false], [4601, 0.038076, " it", false], [39934, 0.029431, " there", false], [22226, 0.023152, " one", false], [4596, 0.0171, " in", false], [38328, 0.011894, " early", false], [63843, 0.010243, " researchers", false], [4858, 0.009744, " we", false]]], "model_b": [22590, 1, 0.21984124183654785, [[22590, 0.219841, " the", false], [332, 0.058144, " a", false], [22226, 0.029624, " one", false], [21700, 0.023144, " for", false], [39934, 0.022366, " there", false], [38013, 0.020814, " chess", false], [4601, 0.020665, " it", false], [3609, 0.020265, " AI", false], [4596, 0.016139, " in", false], [31370, 0.01258, " many", false]]]}, "raw_delta": -0.103515625, "tuned_delta": -0.05066068110180018}, {"byte_start": 1420, "byte_end": 1428, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 245, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "14.72% 14.72% 14.72% 14.72% 14.72% 14.72% 14.72% 14.72%", "model_b": "15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.0014621098525822163]], "model_b": [[52224, " methods", "normal", 0.0008645016350783408]]}, "loss": {"model_a": 14.722815602821939, "model_b": 15.920365197309849}, "topk": {"model_a": [52224, 101, 0.0014621098525822163, [[38499, 0.15102, " first", false], [31461, 0.046441, " most", false], [38328, 0.023978, " early", false], [30273, 0.021852, " best", false], [31581, 0.019396, " only", false], [31356, 0.016604, " main", false], [38720, 0.015297, " human", false], [39802, 0.013773, " state", false], [52013, 0.013427, " initial", false], [56075, 0.009821, " earliest", false]]], "model_b": [52224, 167, 0.0008645016350783408, [[30273, 0.054868, " best", false], [31461, 0.046248, " most", false], [38499, 0.036442, " first", false], [3609, 0.020043, " AI", false], [38720, 0.018688, " human", false], [38013, 0.014244, " chess", false], [30941, 0.01369, " game", false], [38328, 0.013671, " early", false], [51832, 0.011225, " general", false], [63933, 0.010899, " traditional", false]]]}, "raw_delta": -0.06640625, "tuned_delta": -0.013551306101800178}, {"byte_start": 1428, "byte_end": 1433, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 246, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.78% 3.78% 3.78% 3.78% 3.78%", "model_b": "4.85% 4.85% 4.85% 4.85% 4.85%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.35258957743644714]], "model_b": [[32227, " that", "normal", 0.25976991653442383]]}, "loss": {"model_a": 3.7758034273265837, "model_b": 4.846553652986361}, "topk": {"model_a": [32227, 1, 0.35258957743644714, [[32227, 0.35259, " that", false], [4706, 0.223543, " of", false], [32354, 0.035704, " used", false], [59506, 0.034674, " developed", false], [37810, 0.032013, " based", false], [21700, 0.031595, " for", false], [31461, 0.02932, " most", false], [32462, 0.017588, " were", false], [59206, 0.009571, " available", false], [59868, 0.009306, " initially", false]]], "model_b": [32227, 1, 0.25976991653442383, [[32227, 0.25977, " that", false], [4706, 0.174083, " of", false], [32354, 0.086761, " used", false], [59506, 0.065046, " developed", false], [31461, 0.052051, " most", false], [59206, 0.024306, " available", false], [21700, 0.024127, " for", false], [21265, 0.013148, " and", false], [56104, 0.012296, " employed", false], [4596, 0.012228, " in", false]]]}, "raw_delta": -0.059374999999999976, "tuned_delta": -0.006520056101800155}, {"byte_start": 1433, "byte_end": 1442, "display": {"text": " defeated", "kind": "normal"}, "is_word": true, "word_id": 247, "word_key": " defeated", "bytes_hex": "20 64 65 66 65 61 74 65 64", "compression": {"model_a": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%", "model_b": "14.59% 14.59% 14.59% 14.59% 14.59% 14.59% 14.59% 14.59% 14.59%"}, "model_tokens": {"model_a": [[55934, " defeated", "normal", 0.001210186630487442]], "model_b": [[55934, " defeated", "normal", 0.0006837809341959655]]}, "loss": {"model_a": 13.462649036073225, "model_b": 14.589754536767728}, "topk": {"model_a": [55934, 86, 0.001210186630487442, [[56540, 0.105166, " leverage", false], [32462, 0.093876, " were", false], [31059, 0.062672, " have", false], [22777, 0.044717, " won", false], [31351, 0.03763, " made", false], [21286, 0.033535, " are", false], [47812, 0.02916, " worked", false], [21795, 0.021707, " had", false], [46936, 0.019499, " proved", false], [32272, 0.016634, " took", false]]], "model_b": [55934, 149, 0.0006837809341959655, [[31059, 0.177182, " have", false], [32462, 0.10143, " were", false], [21286, 0.060737, " are", false], [59572, 0.033157, " dominated", false], [47812, 0.024079, " worked", false], [31461, 0.022663, " most", false], [21795, 0.018533, " had", false], [32499, 0.01632, " work", false], [56041, 0.015301, " dominate", false], [31351, 0.01401, " made", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 1442, "byte_end": 1446, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 248, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "3.66% 3.66% 3.66% 3.66%", "model_b": "6.41% 6.41% 6.41% 6.41%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.4459788501262665]], "model_b": [[22590, " the", "normal", 0.24196265637874603]]}, "loss": {"model_a": 3.6630928772571334, "model_b": 6.410412535199983}, "topk": {"model_a": [22590, 1, 0.4459788501262665, [[22590, 0.445979, " the", false], [38720, 0.107684, " human", false], [38013, 0.058026, " chess", false], [20184, 0.055435, " Kas", false], [46227, 0.043093, " humans", false], [40213, 0.043047, " world", false], [19948, 0.030642, " Gar", false], [38621, 0.029322, " grand", false], [332, 0.013454, " a", false], [28951, 0.011026, " Gary", false]]], "model_b": [22590, 1, 0.24196265637874603, [[22590, 0.241963, " the", false], [19948, 0.167502, " Gar", false], [38621, 0.051678, " grand", false], [40213, 0.049631, " world", false], [28951, 0.043079, " Gary", false], [332, 0.030095, " a", false], [22615, 0.029405, " top", false], [20077, 0.013971, " IBM", false], [38013, 0.013741, " chess", false], [56949, 0.01357, " programs", false]]]}, "raw_delta": -0.15234375, "tuned_delta": -0.09948880610180018}, {"byte_start": 1446, "byte_end": 1452, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 249, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"model_a": "2.42% 2.42% 2.42% 2.42% 2.42% 2.42%", "model_b": "3.59% 3.59% 3.59% 3.59% 3.59% 3.59%"}, "model_tokens": {"model_a": [[40213, " world", "normal", 0.44720733165740967]], "model_b": [[40213, " world", "normal", 0.3044684827327728]]}, "loss": {"model_a": 2.4185805535736202, "model_b": 3.592648783463727}, "topk": {"model_a": [40213, 1, 0.44720733165740967, [[40213, 0.447207, " world", false], [30273, 0.145508, " best", false], [38720, 0.083815, " human", false], [60571, 0.055241, " strongest", false], [22615, 0.039457, " top", false], [38621, 0.036869, " grand", false], [39471, 0.016173, " reign", false], [52196, 0.00868, " masters", false], [37576, 0.008287, " World", false], [31461, 0.007305, " most", false]]], "model_b": [40213, 1, 0.3044684827327728, [[40213, 0.304468, " world", false], [30273, 0.177897, " best", false], [22615, 0.060221, " top", false], [60571, 0.05935, " strongest", false], [39471, 0.03642, " reign", false], [38720, 0.019397, " human", false], [38621, 0.015451, " grand", false], [32230, 0.015239, " then", false], [55716, 0.013926, " champion", false], [38629, 0.012841, " great", false]]]}, "raw_delta": -0.06510416666666664, "tuned_delta": -0.012249222768466822}, {"byte_start": 1452, "byte_end": 1461, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 250, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"model_a": "1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17%", "model_b": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[55716, " champion", "normal", 0.5576945543289185]], "model_b": [[55716, " champion", "normal", 0.8178924918174744]]}, "loss": {"model_a": 1.1740682298901068, "model_b": 0.40701031969523704}, "topk": {"model_a": [55716, 1, 0.5576945543289185, [[55716, 0.557695, " champion", false], [59283, 0.2461, " champions", false], [460, 0.073844, "'s", false], [38013, 0.045878, " chess", false], [46, 0.01518, "-", false], [37996, 0.012199, " champ", false], [38621, 0.0098, " grand", false], [64275, 0.009065, " championship", false], [52196, 0.007237, " masters", false], [46526, 0.002918, " master", false]]], "model_b": [55716, 1, 0.8178924918174744, [[55716, 0.817892, " champion", false], [460, 0.062241, "'s", false], [59283, 0.057233, " champions", false], [38013, 0.01816, " chess", false], [46, 0.010976, "-", false], [37996, 0.007942, " champ", false], [28309, 0.002369, "’s", false], [47024, 0.002287, " record", false], [38621, 0.001955, " grand", false], [64275, 0.001424, " championship", false]]]}, "raw_delta": 0.04253472222222222, "tuned_delta": 0.09538966612042205}, {"byte_start": 1461, "byte_end": 1462, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "45.65%", "model_b": "31.70%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.08059445768594742]], "model_b": [[45, ",", "normal", 0.1725763976573944]]}, "loss": {"model_a": 45.647772778127354, "model_b": 31.699842207032884}, "topk": {"model_a": [45, 3, 0.08059445768594742, [[32462, 0.211825, " were", false], [4596, 0.198268, " in", false], [45, 0.080594, ",", false], [275, 0.037478, " (", false], [21286, 0.027403, " are", false], [36381, 0.021289, " Bobby", false], [28951, 0.021216, " Gary", false], [52628, 0.019219, " quickly", false], [21265, 0.016568, " and", false], [4450, 0.015073, " by", false]]], "model_b": [45, 2, 0.1725763976573944, [[4596, 0.264074, " in", false], [45, 0.172576, ",", false], [19948, 0.071276, " Gar", false], [32462, 0.030833, " were", false], [275, 0.029201, " (", false], [21700, 0.027604, " for", false], [28951, 0.0232, " Gary", false], [31601, 0.017404, " over", false], [21286, 0.014101, " are", false], [36381, 0.012277, " Bobby", false]]]}, "raw_delta": 0.7734375, "tuned_delta": 0.8262924438981998}, {"byte_start": 1462, "byte_end": 1466, "display": {"text": " Kas", "kind": "normal"}, "is_word": true, "word_id": 251, "word_key": " kas", "bytes_hex": "20 4b 61 73", "compression": {"model_a": "9.79% 9.79% 9.79% 9.79%", "model_b": "23.25% 23.25% 23.25% 23.25%"}, "model_tokens": {"model_a": [[20184, " Kas", "normal", 0.11462292075157166]], "model_b": [[20184, " Kas", "normal", 0.005837319418787956]]}, "loss": {"model_a": 9.79172903728349, "model_b": 23.246550951824116}, "topk": {"model_a": [20184, 1, 0.11462292075157166, [[20184, 0.114623, " Kas", false], [28753, 0.082309, " Deep", false], [21265, 0.078031, " and", false], [37404, 0.060041, " Stock", false], [19948, 0.04952, " Gar", false], [22590, 0.048999, " the", false], [32139, 0.040686, " such", false], [28951, 0.036372, " Gary", false], [50239, 0.023732, " Fischer", false], [4596, 0.015922, " in", false]]], "model_b": [20184, 13, 0.005837319418787956, [[19948, 0.522528, " Gar", false], [28951, 0.10435, " Gary", false], [28753, 0.028952, " Deep", false], [36381, 0.024636, " Bobby", false], [37404, 0.016631, " Stock", false], [28411, 0.016497, " Anat", false], [28397, 0.010775, " Alan", false], [3804, 0.010056, " FI", false], [36385, 0.008089, " Boris", false], [20077, 0.006561, " IBM", false]]]}, "raw_delta": -0.74609375, "tuned_delta": -0.6932388061018002}, {"byte_start": 1466, "byte_end": 1469, "display": {"text": "par", "kind": "normal"}, "is_word": true, "word_id": 252, "word_key": "par", "bytes_hex": "70 61 72", "compression": {"model_a": "0.09% 0.09% 0.09%", "model_b": "0.42% 0.42% 0.42%"}, "model_tokens": {"model_a": [[8469, "par", "normal", 0.985406756401062]], "model_b": [[8469, "par", "normal", 0.9324463605880737]]}, "loss": {"model_a": 0.08805511724175802, "model_b": 0.41679422161098795}, "topk": {"model_a": [8469, 1, 0.985406756401062, [[8469, 0.985407, "par", false], [113, 0.003105, "p", false], [8484, 0.001874, "per", false], [2184, 0.000893, "si", false], [46, 0.000576, "-", false], [2111, 0.000575, "pa", false], [2190, 0.000481, "so", false], [2124, 0.000424, "po", false], [8517, 0.000362, "por", false], [25823, 0.00036, "imir", false]]], "model_b": [8469, 1, 0.9324463605880737, [[8469, 0.932446, "par", false], [1737, 0.008076, "ae", false], [8641, 0.006971, "ros", false], [1741, 0.004755, "ai", false], [8590, 0.004378, "rep", false], [2170, 0.003446, "ru", false], [8529, 0.002758, "pro", false], [24541, 0.002738, "amat", false], [1949, 0.001592, "im", false], [1754, 0.001242, "av", false]]]}, "raw_delta": -0.018229166666666668, "tuned_delta": 0.03462577723153315}, {"byte_start": 1469, "byte_end": 1471, "display": {"text": "ov", "kind": "normal"}, "is_word": true, "word_id": 253, "word_key": "ov", "bytes_hex": "6f 76", "compression": {"model_a": "0.01% 0.01%", "model_b": "0.04% 0.04%"}, "model_tokens": {"model_a": [[2105, "ov", "normal", 0.9990443587303162]], "model_b": [[2105, "ov", "normal", 0.9958772659301758]]}, "loss": {"model_a": 0.00859913254314043, "model_b": 0.03659790810360567}, "topk": {"model_a": [2105, 1, 0.9990443587303162, [[2105, 0.999044, "ov", false], [2106, 0.000673, "ow", false], [8311, 7.2e-05, "off", false], [28017, 5.9e-05, "ов", false], [8443, 4.4e-05, "ova", false], [112, 2.3e-05, "o", false], [45, 1.3e-05, ",", false], [7745, 8e-06, "ian", false], [119, 7e-06, "v", false], [8444, 6e-06, "ove", false]]], "model_b": [2105, 1, 0.9958772659301758, [[2105, 0.995877, "ov", false], [2106, 0.000857, "ow", false], [8443, 0.000566, "ova", false], [7687, 0.000468, "hev", false], [119, 0.000197, "v", false], [20183, 0.000125, " Kar", false], [8311, 9.7e-05, "off", false], [2274, 9.5e-05, "wa", false], [29043, 8.5e-05, " Haus", false], [28017, 8.1e-05, "ов", false]]]}, "raw_delta": -0.001552581787109375, "tuned_delta": 0.051302362111090447}, {"byte_start": 1471, "byte_end": 1472, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.92%", "model_b": "1.20%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8989022374153137]], "model_b": [[45, ",", "normal", 0.9357492923736572]]}, "loss": {"model_a": 1.9196015558703245, "model_b": 1.1975495944879089}, "topk": {"model_a": [45, 1, 0.8989022374153137, [[45, 0.898902, ",", false], [4596, 0.040417, " in", false], [275, 0.039308, " (", false], [21265, 0.007526, " and", false], [460, 0.001377, "'s", false], [4424, 0.001179, " at", false], [32462, 0.000656, " were", false], [326, 0.00058, " [", false], [4450, 0.000424, " by", false], [9816, 0.000418, "—", false]]], "model_b": [45, 1, 0.9357492923736572, [[45, 0.935749, ",", false], [4596, 0.018782, " in", false], [275, 0.016163, " (", false], [460, 0.005727, "'s", false], [21265, 0.004072, " and", false], [50870, 0.001464, " against", false], [4851, 0.000738, " vs", false], [22748, 0.000684, " was", false], [32487, 0.000676, " with", false], [4424, 0.000609, " at", false]]]}, "raw_delta": 0.0400390625, "tuned_delta": 0.09289400639819982}, {"byte_start": 1472, "byte_end": 1475, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 254, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "7.28% 7.28% 7.28%", "model_b": "16.06% 16.06% 16.06%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.29931896924972534]], "model_b": [[4596, " in", "normal", 0.06993464380502701]]}, "loss": {"model_a": 7.279223025318662, "model_b": 16.061253384896663}, "topk": {"model_a": [4596, 2, 0.29931896924972534, [[32462, 0.325402, " were", false], [4596, 0.299319, " in", false], [21265, 0.04416, " and", false], [21286, 0.028597, " are", false], [32354, 0.013853, " used", false], [47054, 0.013424, " relied", false], [4450, 0.013053, " by", false], [4424, 0.009876, " at", false], [21532, 0.008928, " did", false], [21795, 0.008128, " had", false]]], "model_b": [4596, 2, 0.06993464380502701, [[32462, 0.34122, " were", false], [4596, 0.069935, " in", false], [32354, 0.041868, " used", false], [47054, 0.040953, " relied", false], [21286, 0.032116, " are", false], [21795, 0.025719, " had", false], [31059, 0.018703, " have", false], [21265, 0.012952, " and", false], [21256, 0.01231, " all", false], [21532, 0.011609, " did", false]]]}, "raw_delta": -0.4869791666666667, "tuned_delta": -0.43412422276846685}, {"byte_start": 1475, "byte_end": 1478, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 255, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"model_a": "5.47% 5.47% 5.47%", "model_b": "6.34% 6.34% 6.34%"}, "model_tokens": {"model_a": [[3492, " 19", "normal", 0.40221062302589417]], "model_b": [[3492, " 19", "normal", 0.35705965757369995]]}, "loss": {"model_a": 5.471157951287898, "model_b": 6.339968441406577}, "topk": {"model_a": [3492, 1, 0.40221062302589417, [[3492, 0.402211, " 19", false], [22590, 0.29502, " the", false], [3493, 0.161605, " 20", false], [332, 0.046352, " a", false], [31277, 0.005773, " less", false], [21823, 0.005666, " his", false], [31198, 0.005471, " just", false], [22638, 0.002772, " two", false], [38013, 0.00275, " chess", false], [37598, 0.002701, " about", false]]], "model_b": [3492, 2, 0.35705965757369995, [[22590, 0.501, " the", false], [3492, 0.35706, " 19", false], [332, 0.026175, " a", false], [3493, 0.022846, " 20", false], [21823, 0.017384, " his", false], [22226, 0.003811, " one", false], [4419, 0.003474, " an", false], [39931, 0.003323, " their", false], [31370, 0.002937, " many", false], [52869, 0.002605, " several", false]]]}, "raw_delta": -0.048177083333333315, "tuned_delta": 0.004677860564866507}, {"byte_start": 1478, "byte_end": 1480, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 256, "word_key": "97", "bytes_hex": "39 37", "compression": {"model_a": "2.48% 2.48%", "model_b": "2.50% 2.50%"}, "model_tokens": {"model_a": [[717, "97", "normal", 0.7598889470100403]], "model_b": [[717, "97", "normal", 0.755956768989563]]}, "loss": {"model_a": 2.483154306217576, "model_b": 2.5007653296659274}, "topk": {"model_a": [717, 1, 0.7598889470100403, [[717, 0.759889, "97", false], [716, 0.172356, "96", false], [719, 0.03698, "99", false], [718, 0.007953, "98", false], [710, 0.006689, "90", false], [715, 0.004646, "95", false], [709, 0.002977, "89", false], [713, 0.002428, "93", false], [714, 0.001502, "94", false], [705, 0.001084, "85", false]]], "model_b": [717, 1, 0.755956768989563, [[717, 0.755957, "97", false], [716, 0.072199, "96", false], [705, 0.058941, "85", false], [714, 0.033493, "94", false], [715, 0.012816, "95", false], [704, 0.011649, "84", false], [713, 0.008756, "93", false], [712, 0.007373, "92", false], [719, 0.006447, "99", false], [710, 0.006222, "90", false]]]}, "raw_delta": -0.0009765625, "tuned_delta": 0.05187838139819982}, {"byte_start": 1480, "byte_end": 1481, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "36.35%", "model_b": "32.12%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.13172271847724915]], "model_b": [[45, ",", "normal", 0.16738271713256836]]}, "loss": {"model_a": 36.34915239739771, "model_b": 32.122506769793326}, "topk": {"model_a": [45, 3, 0.13172271847724915, [[32462, 0.372542, " were", false], [21265, 0.212345, " and", false], [45, 0.131723, ",", false], [275, 0.04925, " (", false], [32354, 0.02472, " used", false], [21286, 0.017753, " are", false], [21795, 0.013238, " had", false], [56500, 0.009378, " involved", false], [21532, 0.008898, " did", false], [47054, 0.007967, " relied", false]]], "model_b": [45, 2, 0.16738271713256836, [[32462, 0.325394, " were", false], [45, 0.167383, ",", false], [32354, 0.071639, " used", false], [21265, 0.035658, " and", false], [21286, 0.034866, " are", false], [275, 0.021177, " (", false], [47054, 0.020709, " relied", false], [21795, 0.018075, " had", false], [46, 0.015069, "-", false], [21256, 0.013645, " all", false]]]}, "raw_delta": 0.234375, "tuned_delta": 0.28722994389819984}, {"byte_start": 1481, "byte_end": 1486, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 257, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "5.80% 5.80% 5.80% 5.80% 5.80%", "model_b": "3.03% 3.03% 3.03% 3.03% 3.03%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.19863517582416534]], "model_b": [[32462, " were", "normal", 0.43692895770072937]]}, "loss": {"model_a": 5.804593328576688, "model_b": 3.029096033116476}, "topk": {"model_a": [32462, 2, 0.19863517582416534, [[3493, 0.210868, " 20", false], [32462, 0.198635, " were", false], [21265, 0.13443, " and", false], [3492, 0.130007, " 19", false], [32354, 0.019197, " used", false], [21286, 0.016826, " are", false], [22590, 0.015092, " the", false], [21795, 0.009884, " had", false], [47054, 0.009432, " relied", false], [4596, 0.0091, " in", false]]], "model_b": [32462, 1, 0.43692895770072937, [[32462, 0.436929, " were", false], [32354, 0.048537, " used", false], [21795, 0.04824, " had", false], [47054, 0.043155, " relied", false], [21286, 0.024062, " are", false], [21265, 0.014756, " and", false], [21532, 0.012035, " did", false], [56500, 0.011159, " involved", false], [56540, 0.011073, " leverage", false], [32272, 0.010751, " took", false]]]}, "raw_delta": 0.15390625000000002, "tuned_delta": 0.20676119389819986}, {"byte_start": 1486, "byte_end": 1492, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 258, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95%", "model_b": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.09908859431743622]], "model_b": [[37810, " based", "normal", 0.09550129622220993]]}, "loss": {"model_a": 6.9504839209494325, "model_b": 7.044409379340641}, "topk": {"model_a": [37810, 1, 0.09908859431743622, [[37810, 0.099089, " based", false], [22187, 0.073979, " not", false], [22590, 0.05035, " the", false], [52094, 0.043374, " largely", false], [332, 0.039552, " a", false], [63541, 0.032907, " essentially", false], [52224, 0.030115, " methods", false], [39944, 0.025436, " those", false], [21256, 0.021113, " all", false], [32386, 0.012959, " very", false]]], "model_b": [37810, 1, 0.09550129622220993, [[37810, 0.095501, " based", false], [22590, 0.057008, " the", false], [22187, 0.04083, " not", false], [332, 0.032137, " a", false], [63541, 0.030383, " essentially", false], [21256, 0.029745, " all", false], [52094, 0.022757, " largely", false], [59506, 0.01999, " developed", false], [39944, 0.016565, " those", false], [56466, 0.014355, " inspired", false]]]}, "raw_delta": -0.005208333333333315, "tuned_delta": 0.04764661056486651}, {"byte_start": 1492, "byte_end": 1495, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 259, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "1.15% 1.15% 1.15%", "model_b": "1.38% 1.38% 1.38%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.8257889747619629]], "model_b": [[4712, " on", "normal", 0.7954027056694031]]}, "loss": {"model_a": 1.1505868652923046, "model_b": 1.3795301701208755}, "topk": {"model_a": [4712, 1, 0.8257889747619629, [[4712, 0.825789, " on", false], [56131, 0.020041, " entirely", false], [45145, 0.01592, " almost", false], [60247, 0.01544, " primarily", false], [4596, 0.015189, " in", false], [52094, 0.013975, " largely", false], [32350, 0.011241, " upon", false], [22187, 0.009883, " not", false], [51919, 0.007783, " heavily", false], [47330, 0.006069, " solely", false]]], "model_b": [4712, 1, 0.7954027056694031, [[4712, 0.795403, " on", false], [32350, 0.023548, " upon", false], [4596, 0.022088, " in", false], [45202, 0.020017, " around", false], [56131, 0.01834, " entirely", false], [45145, 0.017727, " almost", false], [60247, 0.017138, " primarily", false], [52094, 0.01276, " largely", false], [51919, 0.01014, " heavily", false], [56003, 0.004412, " directly", false]]]}, "raw_delta": -0.0126953125, "tuned_delta": 0.04015963139819982}, {"byte_start": 1495, "byte_end": 1503, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 260, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%", "model_b": "17.68% 17.68% 17.68% 17.68% 17.68% 17.68% 17.68% 17.68%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.008450211025774479]], "model_b": [[52195, " massive", "normal", 0.000389414606615901]]}, "loss": {"model_a": 10.777946350391181, "model_b": 17.681467542145008}, "topk": {"model_a": [52195, 16, 0.008450211025774479, [[332, 0.126157, " a", false], [22590, 0.109157, " the", false], [51832, 0.049681, " general", false], [52224, 0.028682, " methods", false], [30597, 0.02115, " deep", false], [52167, 0.019129, " machine", false], [46658, 0.01896, " neural", false], [56537, 0.017406, " learning", false], [4419, 0.012217, " an", false], [47284, 0.010632, " simple", false]]], "model_b": [52195, 258, 0.000389414606615901, [[332, 0.19171, " a", false], [22590, 0.125336, " the", false], [38720, 0.042785, " human", false], [4419, 0.03776, " an", false], [51832, 0.02884, " general", false], [59792, 0.022317, " heuristic", false], [30597, 0.01858, " deep", false], [52224, 0.011983, " methods", false], [21823, 0.010531, " his", false], [59943, 0.010023, " knowledge", false]]]}, "raw_delta": -0.3828125, "tuned_delta": -0.32995755610180016}, {"byte_start": 1503, "byte_end": 1504, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "80.02%", "model_b": "77.21%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.011884907260537148]], "model_b": [[45, ",", "normal", 0.013585684821009636]]}, "loss": {"model_a": 80.02449054930968, "model_b": 77.20672679757342}, "topk": {"model_a": [45, 15, 0.011884907260537148, [[63370, 0.142193, " computation", false], [50897, 0.126351, " amounts", false], [64423, 0.110214, " improvements", false], [22681, 0.042738, " use", false], [56812, 0.030253, " parallel", false], [38720, 0.019748, " human", false], [64862, 0.018973, " computational", false], [63621, 0.017687, " improvement", false], [59847, 0.016177, " increases", false], [59346, 0.015876, " computing", false]]], "model_b": [45, 10, 0.013585684821009636, [[50897, 0.160219, " amounts", false], [38720, 0.095432, " human", false], [37920, 0.037311, " brute", false], [56812, 0.034707, " parallel", false], [65135, 0.021651, " generalization", false], [63370, 0.021404, " computation", false], [64862, 0.01894, " computational", false], [64298, 0.018004, " computations", false], [22681, 0.013786, " use", false], [45, 0.013586, ",", false]]]}, "raw_delta": 0.15625, "tuned_delta": 0.20910494389819984}, {"byte_start": 1504, "byte_end": 1509, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 261, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"model_a": "15.78% 15.78% 15.78% 15.78% 15.78%", "model_b": "14.09% 14.09% 14.09% 14.09% 14.09%"}, "model_tokens": {"model_a": [[30597, " deep", "normal", 0.012478463351726532]], "model_b": [[30597, " deep", "normal", 0.020045988261699677]]}, "loss": {"model_a": 15.779477009723035, "model_b": 14.088818758681281}, "topk": {"model_a": [30597, 14, 0.012478463351726532, [[38720, 0.069331, " human", false], [51832, 0.052989, " general", false], [31044, 0.043828, " hand", false], [59988, 0.042053, " massively", false], [59262, 0.031456, " carefully", false], [21400, 0.024367, " but", false], [22323, 0.018564, " pre", false], [39802, 0.018469, " state", false], [56812, 0.016704, " parallel", false], [52195, 0.014567, " massive", false]]], "model_b": [30597, 6, 0.020045988261699677, [[38720, 0.043289, " human", false], [51832, 0.026297, " general", false], [37920, 0.024868, " brute", false], [62546, 0.022271, " sequential", false], [21265, 0.020969, " and", false], [30597, 0.020046, " deep", false], [21400, 0.018208, " but", false], [31082, 0.015992, " high", false], [22184, 0.01526, " non", false], [63495, 0.013108, " distributed", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14660494389819984}, {"byte_start": 1509, "byte_end": 1516, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 262, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "10.18% 10.18% 10.18% 10.18% 10.18% 10.18% 10.18%", "model_b": "8.61% 8.61% 8.61% 8.61% 8.61% 8.61% 8.61%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.018990609794855118]], "model_b": [[47202, " search", "normal", 0.0355411022901535]]}, "loss": {"model_a": 10.18420327413247, "model_b": 8.614306326736557}, "topk": {"model_a": [47202, 5, 0.018990609794855118, [[56537, 0.26494, " learning", false], [45, 0.174228, ",", false], [46658, 0.15646, " neural", false], [46, 0.038754, "-", false], [47202, 0.018991, " search", false], [56705, 0.017187, " networks", false], [63384, 0.013295, " connections", false], [32298, 0.012241, " tree", false], [63370, 0.009841, " computation", false], [51832, 0.009801, " general", false]]], "model_b": [47202, 5, 0.0355411022901535, [[56537, 0.172261, " learning", false], [46, 0.137712, "-", false], [45, 0.135397, ",", false], [46658, 0.062461, " neural", false], [47202, 0.035541, " search", false], [65003, 0.035335, " reinforcement", false], [59943, 0.034229, " knowledge", false], [57174, 0.018041, " searches", false], [63562, 0.015663, " exploration", false], [38720, 0.011622, " human", false]]]}, "raw_delta": 0.08705357142857147, "tuned_delta": 0.1399085153267713}, {"byte_start": 1516, "byte_end": 1517, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "33.81%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.15502455830574036]], "model_b": [[47, ".", "normal", 0.20554819703102112]]}, "loss": {"model_a": 33.81316502083508, "model_b": 28.600302080123}, "topk": {"model_a": [47, 2, 0.15502455830574036, [[45, 0.158469, ",", false], [47, 0.155025, ".", false], [21265, 0.086348, " and", false], [40085, 0.072374, " using", false], [4706, 0.052561, " of", false], [4596, 0.048629, " in", false], [32487, 0.045554, " with", false], [55780, 0.043031, " combined", false], [275, 0.035293, " (", false], [31601, 0.032924, " over", false]]], "model_b": [47, 1, 0.20554819703102112, [[47, 0.205548, ".", false], [45, 0.134562, ",", false], [4706, 0.066646, " of", false], [21265, 0.055897, " and", false], [40085, 0.046612, " using", false], [61559, 0.037406, " algorithms", false], [275, 0.036744, " (", false], [4596, 0.035687, " in", false], [32227, 0.030694, " that", false], [32487, 0.026447, " with", false]]]}, "raw_delta": 0.2890625, "tuned_delta": 0.34191744389819984}, {"byte_start": 1517, "byte_end": 1520, "display": {"text": " At", "kind": "normal"}, "is_word": true, "word_id": 263, "word_key": " at", "bytes_hex": "20 41 74", "compression": {"model_a": "28.74% 28.74% 28.74%", "model_b": "28.55% 28.55% 28.55%"}, "model_tokens": {"model_a": [[3642, " At", "normal", 0.008409584872424603]], "model_b": [[3642, " At", "normal", 0.008816681802272797]]}, "loss": {"model_a": 28.741190267709815, "model_b": 28.553339350927395}, "topk": {"model_a": [3642, 17, 0.008409584872424603, [[20996, 0.196119, " The", false], [3913, 0.089501, " In", false], [29894, 0.064125, " This", false], [28753, 0.031609, " Deep", false], [19555, 0.029305, " But", false], [20184, 0.0287, " Kas", false], [29893, 0.027915, " They", false], [267, 0.027069, "  ", false], [3918, 0.024974, " It", false], [29889, 0.022741, " That", false]]], "model_b": [3642, 19, 0.008816681802272797, [[20996, 0.125859, " The", false], [3913, 0.071229, " In", false], [29893, 0.066383, " They", false], [29894, 0.053881, " This", false], [37453, 0.044123, " These", false], [267, 0.044014, "  ", false], [28753, 0.043217, " Deep", false], [19555, 0.028208, " But", false], [20184, 0.028172, " Kas", false], [3918, 0.017223, " It", false]]]}, "raw_delta": 0.01041666666666674, "tuned_delta": 0.06327161056486656}, {"byte_start": 1520, "byte_end": 1524, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 264, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.98% 1.98% 1.98% 1.98%", "model_b": "2.25% 2.25% 2.25% 2.25%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.6441946029663086]], "model_b": [[22590, " the", "normal", 0.6123349666595459]]}, "loss": {"model_a": 1.9812401379395552, "model_b": 2.2454054896648294}, "topk": {"model_a": [22590, 1, 0.6441946029663086, [[22590, 0.644195, " the", false], [32227, 0.208498, " that", false], [332, 0.017823, " a", false], [38879, 0.017627, " least", false], [38499, 0.015834, " first", false], [37598, 0.010254, " about", false], [32234, 0.008121, " this", false], [32074, 0.007097, " some", false], [22226, 0.007068, " one", false], [21902, 0.005249, " its", false]]], "model_b": [22590, 1, 0.6123349666595459, [[22590, 0.612335, " the", false], [32227, 0.206117, " that", false], [21902, 0.023121, " its", false], [22226, 0.01889, " one", false], [38499, 0.017997, " first", false], [39931, 0.01437, " their", false], [32234, 0.012962, " this", false], [332, 0.012659, " a", false], [32074, 0.011834, " some", false], [38879, 0.007559, " least", false]]]}, "raw_delta": -0.0146484375, "tuned_delta": 0.03820650639819982}, {"byte_start": 1524, "byte_end": 1529, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 265, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "0.59% 0.59% 0.59% 0.59% 0.59%", "model_b": "0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.8512951731681824]], "model_b": [[32251, " time", "normal", 0.8882914781570435]]}, "loss": {"model_a": 0.5882081831749435, "model_b": 0.42266456276043846}, "topk": {"model_a": [32251, 1, 0.8512951731681824, [[32251, 0.851295, " time", false], [31937, 0.035279, " same", false], [21616, 0.030662, " end", false], [59220, 0.008421, " beginning", false], [38887, 0.007381, " level", false], [39801, 0.007043, " start", false], [22615, 0.004064, " top", false], [38676, 0.00393, " heart", false], [3492, 0.002393, " 19", false], [32321, 0.002162, " turn", false]]], "model_b": [32251, 1, 0.8882914781570435, [[32251, 0.888291, " time", false], [31937, 0.019808, " same", false], [21616, 0.013035, " end", false], [59220, 0.009571, " beginning", false], [39801, 0.009118, " start", false], [32321, 0.007707, " turn", false], [31640, 0.003487, " peak", false], [46734, 0.003197, " outset", false], [32386, 0.003116, " very", false], [38676, 0.002897, " heart", false]]]}, "raw_delta": 0.009179687499999999, "tuned_delta": 0.06203463139819982}, {"byte_start": 1529, "byte_end": 1530, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "5.81%", "model_b": "6.59%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.725545346736908]], "model_b": [[45, ",", "normal", 0.6933923363685608]]}, "loss": {"model_a": 5.811637737956029, "model_b": 6.5865227696835}, "topk": {"model_a": [45, 1, 0.725545346736908, [[45, 0.725545, ",", false], [4706, 0.080008, " of", false], [22590, 0.03385, " the", false], [32234, 0.0283, " this", false], [4601, 0.025524, " it", false], [32227, 0.015919, " that", false], [32232, 0.015049, " they", false], [39934, 0.01147, " there", false], [20184, 0.010874, " Kas", false], [39936, 0.005643, " these", false]]], "model_b": [45, 1, 0.6933923363685608, [[45, 0.693392, ",", false], [4706, 0.062876, " of", false], [4601, 0.036057, " it", false], [22590, 0.033171, " the", false], [32232, 0.02734, " they", false], [32234, 0.018614, " this", false], [39934, 0.014924, " there", false], [20184, 0.011597, " Kas", false], [39936, 0.007837, " these", false], [275, 0.007205, " (", false]]]}, "raw_delta": -0.04296875, "tuned_delta": 0.009886193898199822}, {"byte_start": 1530, "byte_end": 1535, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 266, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "7.95% 7.95% 7.95% 7.95% 7.95%", "model_b": "9.07% 9.07% 9.07% 9.07% 9.07%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.10871747136116028]], "model_b": [[32234, " this", "normal", 0.08076493442058563]]}, "loss": {"model_a": 7.946093779896243, "model_b": 9.073199280590746}, "topk": {"model_a": [32234, 2, 0.10871747136116028, [[22590, 0.226634, " the", false], [32234, 0.108717, " this", false], [4601, 0.086941, " it", false], [39934, 0.040709, " there", false], [32232, 0.037625, " they", false], [39936, 0.032501, " these", false], [4692, 0.023731, " no", false], [332, 0.020772, " a", false], [32227, 0.017063, " that", false], [38013, 0.016646, " chess", false]]], "model_b": [32234, 4, 0.08076493442058563, [[22590, 0.168605, " the", false], [30597, 0.089205, " deep", false], [4601, 0.086545, " it", false], [32234, 0.080765, " this", false], [39934, 0.04882, " there", false], [38013, 0.029614, " chess", false], [332, 0.025478, " a", false], [32232, 0.023934, " they", false], [39936, 0.022107, " these", false], [20184, 0.019071, " Kas", false]]]}, "raw_delta": -0.06250000000000006, "tuned_delta": -0.009645056101800234}, {"byte_start": 1535, "byte_end": 1539, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 267, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "2.52% 2.52% 2.52% 2.52%", "model_b": "2.45% 2.45% 2.45% 2.45%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.5746609568595886]], "model_b": [[22748, " was", "normal", 0.5848690867424011]]}, "loss": {"model_a": 2.518376353114279, "model_b": 2.4479322593208726}, "topk": {"model_a": [22748, 1, 0.5746609568595886, [[22748, 0.574661, " was", false], [47211, 0.056424, " seemed", false], [55532, 0.052585, " approach", false], [46561, 0.038547, " method", false], [47202, 0.016355, " search", false], [63841, 0.015321, " represented", false], [57101, 0.012581, " required", false], [21795, 0.011267, " had", false], [38990, 0.011147, " meant", false], [31351, 0.010582, " made", false]]], "model_b": [22748, 1, 0.5848690867424011, [[22748, 0.584869, " was", false], [47211, 0.074655, " seemed", false], [55532, 0.069503, " approach", false], [46561, 0.040694, " method", false], [38990, 0.025845, " meant", false], [57101, 0.011126, " required", false], [55526, 0.008592, " appeared", false], [56500, 0.008464, " involved", false], [21795, 0.007449, " had", false], [57317, 0.007054, " strategy", false]]]}, "raw_delta": 0.00390625, "tuned_delta": 0.05676119389819982}, {"byte_start": 1539, "byte_end": 1546, "display": {"text": " looked", "kind": "normal"}, "is_word": true, "word_id": 268, "word_key": " looked", "bytes_hex": "20 6c 6f 6f 6b 65 64", "compression": {"model_a": "22.38% 22.38% 22.38% 22.38% 22.38% 22.38% 22.38%", "model_b": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"model_a": [[46471, " looked", "normal", 0.00016469473484903574]], "model_b": [[46471, " looked", "normal", 0.000245631264988333]]}, "loss": {"model_a": 22.381094942362264, "model_b": 21.415004513195548}, "topk": {"model_a": [46471, 233, 0.00016469473484903574, [[22590, 0.265187, " the", false], [332, 0.135234, " a", false], [61755, 0.110696, " considered", false], [53137, 0.038112, " thought", false], [22187, 0.032455, " not", false], [31968, 0.03192, " seen", false], [4419, 0.030151, " an", false], [57059, 0.013828, " regarded", false], [39802, 0.011979, " state", false], [22226, 0.011517, " one", false]]], "model_b": [46471, 212, 0.000245631264988333, [[22590, 0.322581, " the", false], [61755, 0.118709, " considered", false], [332, 0.114969, " a", false], [22187, 0.043919, " not", false], [4419, 0.032908, " an", false], [31968, 0.027952, " seen", false], [53137, 0.018634, " thought", false], [39820, 0.017794, " still", false], [22226, 0.014862, " one", false], [57059, 0.012958, " regarded", false]]]}, "raw_delta": 0.0535714285714286, "tuned_delta": 0.10642637246962842}, {"byte_start": 1546, "byte_end": 1551, "display": {"text": " upon", "kind": "normal"}, "is_word": true, "word_id": 269, "word_key": " upon", "bytes_hex": "20 75 70 6f 6e", "compression": {"model_a": "3.10% 3.10% 3.10% 3.10% 3.10%", "model_b": "3.48% 3.48% 3.48% 3.48% 3.48%"}, "model_tokens": {"model_a": [[32350, " upon", "normal", 0.42306748032569885]], "model_b": [[32350, " upon", "normal", 0.3809601664543152]]}, "loss": {"model_a": 3.099540126909882, "model_b": 3.4799382333942765}, "topk": {"model_a": [32350, 1, 0.42306748032569885, [[32350, 0.423067, " upon", false], [4424, 0.270821, " at", false], [4712, 0.268243, " on", false], [30678, 0.014708, " down", false], [4811, 0.00771, " to", false], [4423, 0.003743, " as", false], [4833, 0.001497, " up", false], [21295, 0.001472, " ask", false], [4450, 0.001008, " by", false], [30218, 0.000938, " back", false]]], "model_b": [32350, 1, 0.3809601664543152, [[32350, 0.38096, " upon", false], [4424, 0.283228, " at", false], [4712, 0.194202, " on", false], [30678, 0.119559, " down", false], [4811, 0.007383, " to", false], [4423, 0.006153, " as", false], [4833, 0.001904, " up", false], [51791, 0.000624, " forward", false], [31296, 0.000575, " like", false], [30218, 0.000413, " back", false]]]}, "raw_delta": -0.021093749999999994, "tuned_delta": 0.03176119389819983}, {"byte_start": 1551, "byte_end": 1556, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 270, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "7.33% 7.33% 7.33% 7.33% 7.33%", "model_b": "12.74% 12.74% 12.74% 12.74% 12.74%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.13237915933132172]], "model_b": [[32487, " with", "normal", 0.029233908280730247]]}, "loss": {"model_a": 7.326185754514267, "model_b": 12.73629215784788}, "topk": {"model_a": [32487, 2, 0.13237915933132172, [[4423, 0.697396, " as", false], [32487, 0.132379, " with", false], [4450, 0.089892, " by", false], [60512, 0.028225, " skeptical", false], [4596, 0.006074, " in", false], [38458, 0.003928, " favor", false], [57263, 0.003034, " somewhat", false], [45, 0.002795, ",", false], [21295, 0.002741, " ask", false], [62624, 0.002031, " suspicious", false]]], "model_b": [32487, 2, 0.029233908280730247, [[4423, 0.928999, " as", false], [32487, 0.029234, " with", false], [4450, 0.016074, " by", false], [4596, 0.003217, " in", false], [45, 0.001906, ",", false], [45145, 0.001605, " almost", false], [60512, 0.001346, " skeptical", false], [31296, 0.001105, " like", false], [31458, 0.001053, " more", false], [38458, 0.000934, " favor", false]]]}, "raw_delta": -0.30000000000000004, "tuned_delta": -0.2471450561018002}, {"byte_start": 1556, "byte_end": 1563, "display": {"text": " dismay", "kind": "normal"}, "is_word": true, "word_id": 271, "word_key": " dismay", "bytes_hex": "20 64 69 73 6d 61 79", "compression": {"model_a": "13.28% 13.28% 13.28% 13.28% 13.28% 13.28% 13.28%", "model_b": "13.69% 13.69% 13.69% 13.69% 13.69% 13.69% 13.69%"}, "model_tokens": {"model_a": [[45756, " dismay", "normal", 0.005752681288868189]], "model_b": [[45756, " dismay", "normal", 0.004998579155653715]]}, "loss": {"model_a": 13.283743401042354, "model_b": 13.686281079861814}, "topk": {"model_a": [45756, 20, 0.005752681288868189, [[62561, 0.240901, " skepticism", false], [60609, 0.196995, " suspicion", false], [32074, 0.070455, " some", false], [21542, 0.060081, " dis", false], [332, 0.046316, " a", false], [46271, 0.030396, " incred", false], [38629, 0.029573, " great", false], [21523, 0.025235, " der", false], [39608, 0.022898, " scorn", false], [64313, 0.020014, " considerable", false]]], "model_b": [45756, 32, 0.004998579155653715, [[62561, 0.163547, " skepticism", false], [32074, 0.113671, " some", false], [60609, 0.107019, " suspicion", false], [38629, 0.092827, " great", false], [21542, 0.038367, " dis", false], [332, 0.037108, " a", false], [64313, 0.025357, " considerable", false], [46218, 0.014064, " horror", false], [21316, 0.011455, " awe", false], [55845, 0.010842, " contempt", false]]]}, "raw_delta": -0.022321428571428492, "tuned_delta": 0.03053351532677133}, {"byte_start": 1563, "byte_end": 1566, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 272, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "4.48% 4.48% 4.48%", "model_b": "8.27% 8.27% 8.27%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.47529152035713196]], "model_b": [[4450, " by", "normal", 0.2501745820045471]]}, "loss": {"model_a": 4.484940638180208, "model_b": 8.265440338426352}, "topk": {"model_a": [4450, 1, 0.47529152035713196, [[4450, 0.475292, " by", false], [45, 0.154973, ",", false], [4423, 0.139672, " as", false], [47, 0.0645, ".", false], [51018, 0.038305, " because", false], [21265, 0.031231, " and", false], [4596, 0.020537, " in", false], [59, 0.011885, ":", false], [37694, 0.009861, " among", false], [30917, 0.009172, " from", false]]], "model_b": [4450, 2, 0.2501745820045471, [[45, 0.256069, ",", false], [4450, 0.250175, " by", false], [47, 0.182905, ".", false], [4423, 0.096965, " as", false], [21265, 0.054841, " and", false], [51018, 0.045416, " because", false], [60, 0.024543, ";", false], [59, 0.019208, ":", false], [39690, 0.008086, " since", false], [4596, 0.008085, " in", false]]]}, "raw_delta": -0.20963541666666666, "tuned_delta": -0.15678047276846685}, {"byte_start": 1566, "byte_end": 1570, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 273, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.85% 7.85% 7.85% 7.85%", "model_b": "6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.1756531149148941]], "model_b": [[22590, " the", "normal", 0.22167043387889862]]}, "loss": {"model_a": 7.854516457964815, "model_b": 6.833077097960421}, "topk": {"model_a": [22590, 1, 0.1756531149148941, [[22590, 0.175653, " the", false], [31370, 0.168577, " many", false], [39944, 0.091417, " those", false], [32074, 0.079957, " some", false], [38720, 0.075896, " human", false], [38013, 0.071999, " chess", false], [31461, 0.026216, " most", false], [3609, 0.017833, " AI", false], [46787, 0.016414, " people", false], [20184, 0.016071, " Kas", false]]], "model_b": [22590, 2, 0.22167043387889862, [[31370, 0.238927, " many", false], [22590, 0.22167, " the", false], [31461, 0.050329, " most", false], [63843, 0.049521, " researchers", false], [55809, 0.041588, " computer", false], [39944, 0.03926, " those", false], [3609, 0.037528, " AI", false], [38013, 0.033535, " chess", false], [32074, 0.030523, " some", false], [39193, 0.021712, " other", false]]]}, "raw_delta": 0.056640625, "tuned_delta": 0.10949556889819982}, {"byte_start": 1570, "byte_end": 1579, "display": {"text": " majority", "kind": "normal"}, "is_word": true, "word_id": 274, "word_key": " majority", "bytes_hex": "20 6d 61 6a 6f 72 69 74 79", "compression": {"model_a": "10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77%", "model_b": "8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95%"}, "model_tokens": {"model_a": [[56573, " majority", "normal", 0.004614981822669506]], "model_b": [[56573, " majority", "normal", 0.01159416139125824]]}, "loss": {"model_a": 10.77011922885858, "model_b": 8.954227033295215}, "topk": {"model_a": [56573, 27, 0.004614981822669506, [[38720, 0.192614, " human", false], [38013, 0.120018, " chess", false], [38621, 0.097352, " grand", false], [55809, 0.037162, " computer", false], [51685, 0.031074, " experts", false], [40213, 0.030688, " world", false], [3609, 0.023445, " AI", false], [45929, 0.020343, " expert", false], [22615, 0.016196, " top", false], [63933, 0.014232, " traditional", false]]], "model_b": [56573, 12, 0.01159416139125824, [[38013, 0.179964, " chess", false], [3609, 0.111599, " AI", false], [51832, 0.069374, " general", false], [59324, 0.051628, " community", false], [57103, 0.028455, " research", false], [55809, 0.028226, " computer", false], [40213, 0.024895, " world", false], [38478, 0.024589, " field", false], [51093, 0.016281, " broader", false], [40192, 0.0127, " wider", false]]]}, "raw_delta": 0.10069444444444442, "tuned_delta": 0.15354938834264426}, {"byte_start": 1579, "byte_end": 1582, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 275, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.12% 0.12% 0.12%", "model_b": "0.11% 0.11% 0.11%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9809170961380005]], "model_b": [[4706, " of", "normal", 0.9813337922096252]]}, "loss": {"model_a": 0.11593923770164805, "model_b": 0.11373785977060409}, "topk": {"model_a": [4706, 1, 0.9809170961380005, [[4706, 0.980917, " of", false], [45, 0.004015, ",", false], [4596, 0.001874, " in", false], [22762, 0.001854, " who", false], [47, 0.001831, ".", false], [38013, 0.001064, " chess", false], [3609, 0.000967, " AI", false], [59324, 0.000728, " community", false], [275, 0.000652, " (", false], [52367, 0.000534, " opinion", false]]], "model_b": [4706, 1, 0.9813337922096252, [[4706, 0.981334, " of", false], [4596, 0.005802, " in", false], [45, 0.002662, ",", false], [47, 0.001357, ".", false], [47806, 0.000969, " within", false], [275, 0.000954, " (", false], [22762, 0.000922, " who", false], [3609, 0.00063, " AI", false], [55809, 0.000551, " computer", false], [38013, 0.000403, " chess", false]]]}, "raw_delta": 0.0001220703125, "tuned_delta": 0.05297701421069982}, {"byte_start": 1582, "byte_end": 1591, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 276, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "model_b": "4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.06905443221330643]], "model_b": [[55809, " computer", "normal", 0.1303100883960724]]}, "loss": {"model_a": 5.353751128298887, "model_b": 4.07010319695237}, "topk": {"model_a": [55809, 5, 0.06905443221330643, [[38013, 0.263274, " chess", false], [3609, 0.226674, " AI", false], [22590, 0.195946, " the", false], [63843, 0.083175, " researchers", false], [55809, 0.069054, " computer", false], [46787, 0.023975, " people", false], [51685, 0.020179, " experts", false], [38720, 0.015138, " human", false], [39944, 0.010044, " those", false], [52489, 0.008606, " players", false]]], "model_b": [55809, 4, 0.1303100883960724, [[22590, 0.201404, " the", false], [63843, 0.157741, " researchers", false], [3609, 0.143625, " AI", false], [55809, 0.13031, " computer", false], [38013, 0.120347, " chess", false], [52489, 0.035217, " players", false], [46787, 0.019959, " people", false], [64985, 0.009807, " practitioners", false], [51685, 0.009569, " experts", false], [30941, 0.008987, " game", false]]]}, "raw_delta": 0.07118055555555557, "tuned_delta": 0.12403549945375539}, {"byte_start": 1591, "byte_end": 1592, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "55.51%", "model_b": "81.15%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.04608757793903351]], "model_b": [[46, "-", "normal", 0.011165601201355457]]}, "loss": {"model_a": 55.50994590920425, "model_b": 81.15159605000419}, "topk": {"model_a": [46, 4, 0.04608757793903351, [[38013, 0.60557, " chess", false], [62532, 0.167592, " scientists", false], [51685, 0.048257, " experts", false], [46, 0.046088, "-", false], [52814, 0.026499, " science", false], [52489, 0.021772, " players", false], [63794, 0.015424, " programmers", false], [63843, 0.013914, " researchers", false], [3609, 0.006537, " AI", false], [47732, 0.005008, " vision", false]]], "model_b": [46, 7, 0.011165601201355457, [[62532, 0.389449, " scientists", false], [38013, 0.360814, " chess", false], [63843, 0.079742, " researchers", false], [52489, 0.040172, " players", false], [52814, 0.031204, " science", false], [63794, 0.011788, " programmers", false], [46, 0.011166, "-", false], [51685, 0.009555, " experts", false], [60455, 0.007517, " scientist", false], [30941, 0.00607, " game", false]]]}, "raw_delta": -1.421875, "tuned_delta": -1.3690200561018002}, {"byte_start": 1592, "byte_end": 1596, "display": {"text": "ches", "kind": "normal"}, "is_word": true, "word_id": 277, "word_key": "ches", "bytes_hex": "63 68 65 73", "compression": {"model_a": "8.59% 8.59% 8.59% 8.59%", "model_b": "15.00% 15.00% 15.00% 15.00%"}, "model_tokens": {"model_a": [[24991, "ches", "normal", 0.1493699848651886]], "model_b": [[24991, "ches", "normal", 0.03575974702835083]]}, "loss": {"model_a": 8.594179442795582, "model_b": 15.004591977995565}, "topk": {"model_a": [24991, 2, 0.1493699848651886, [[49551, 0.272454, "playing", false], [24991, 0.14937, "ches", false], [6954, 0.084131, "aid", false], [49685, 0.067093, "science", false], [41394, 0.060079, "expert", false], [25478, 0.03788, "game", false], [42227, 0.024386, "scient", false], [49589, 0.02309, "program", false], [34580, 0.021501, "human", false], [820, 0.021426, "AI", false]]], "model_b": [24991, 6, 0.03575974702835083, [[49685, 0.390986, "science", false], [49551, 0.181108, "playing", false], [42227, 0.074327, "scient", false], [25478, 0.040748, "game", false], [26697, 0.035996, "play", false], [24991, 0.03576, "ches", false], [54309, 0.025151, "research", false], [34011, 0.019083, "based", false], [34580, 0.013956, "human", false], [26679, 0.012147, "phil", false]]]}, "raw_delta": -0.35546875, "tuned_delta": -0.30261380610180016}, {"byte_start": 1596, "byte_end": 1597, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 278, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.04%", "model_b": "0.01%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9980239868164062]], "model_b": [[116, "s", "normal", 0.9993035793304443]]}, "loss": {"model_a": 0.0354972191380837, "model_b": 0.012520336982812467}, "topk": {"model_a": [116, 1, 0.9980239868164062, [[116, 0.998024, "s", false], [8739, 0.000773, "spl", false], [2177, 0.000271, "sb", false], [2194, 0.000246, "ss", false], [27027, 0.000184, "sing", false], [2188, 0.000162, "sm", false], [8741, 7.2e-05, "spr", false], [2182, 3.2e-05, "sg", false], [8705, 2.8e-05, "ses", false], [8737, 2.3e-05, "spe", false]]], "model_b": [116, 1, 0.9993035793304443, [[116, 0.999304, "s", false], [2188, 0.000229, "sm", false], [2177, 0.000126, "sb", false], [2182, 6.4e-05, "sg", false], [8741, 4e-05, "spr", false], [2194, 3.1e-05, "ss", false], [2187, 2.3e-05, "sl", false], [2180, 2.3e-05, "se", false], [8701, 1.6e-05, "sen", false], [8705, 1.4e-05, "ses", false]]]}, "raw_delta": 0.00127410888671875, "tuned_delta": 0.05412905278491857}, {"byte_start": 1597, "byte_end": 1609, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 279, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%", "model_b": "0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.7623742818832397]], "model_b": [[63843, " researchers", "normal", 0.5922250151634216]]}, "loss": {"model_a": 0.407988709886812, "model_b": 0.7924960551758221}, "topk": {"model_a": [63843, 1, 0.7623742818832397, [[63843, 0.762374, " researchers", false], [51685, 0.099354, " experts", false], [52489, 0.038574, " players", false], [63533, 0.016932, " enthusiasts", false], [64985, 0.008474, " practitioners", false], [46, 0.00782, "-", false], [57103, 0.006958, " research", false], [46787, 0.006531, " people", false], [63874, 0.006406, " specialists", false], [57166, 0.004386, " scholars", false]]], "model_b": [63843, 1, 0.5922250151634216, [[63843, 0.592225, " researchers", false], [52489, 0.169155, " players", false], [51685, 0.052896, " experts", false], [57103, 0.03933, " research", false], [64985, 0.021939, " practitioners", false], [63533, 0.016064, " enthusiasts", false], [63874, 0.008368, " specialists", false], [57166, 0.006502, " scholars", false], [62532, 0.006161, " scientists", false], [39933, 0.006021, " theor", false]]]}, "raw_delta": -0.02132161458333334, "tuned_delta": 0.03153332931486648}, {"byte_start": 1609, "byte_end": 1613, "display": {"text": " who", "kind": "normal"}, "is_word": true, "word_id": 280, "word_key": " who", "bytes_hex": "20 77 68 6f", "compression": {"model_a": "13.24% 13.24% 13.24% 13.24%", "model_b": "13.88% 13.88% 13.88% 13.88%"}, "model_tokens": {"model_a": [[22762, " who", "normal", 0.05310344323515892]], "model_b": [[22762, " who", "normal", 0.04473256319761276]]}, "loss": {"model_a": 13.243489633160404, "model_b": 13.877486477301062}, "topk": {"model_a": [22762, 4, 0.05310344323515892, [[45, 0.472392, ",", false], [47, 0.272927, ".", false], [4423, 0.056405, " as", false], [22762, 0.053103, " who", false], [51018, 0.046674, " because", false], [275, 0.019423, " (", false], [60, 0.015016, ";", false], [59, 0.014098, ":", false], [21265, 0.012627, " and", false], [4596, 0.006176, " in", false]]], "model_b": [22762, 4, 0.04473256319761276, [[45, 0.411418, ",", false], [47, 0.336056, ".", false], [51018, 0.052242, " because", false], [22762, 0.044733, " who", false], [21265, 0.035172, " and", false], [275, 0.024918, " (", false], [60, 0.014226, ";", false], [4423, 0.014027, " as", false], [59, 0.012054, ":", false], [4596, 0.00984, " in", false]]]}, "raw_delta": -0.03515625, "tuned_delta": 0.01769869389819982}, {"byte_start": 1613, "byte_end": 1617, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 281, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"model_a": "8.35% 8.35% 8.35% 8.35%", "model_b": "9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[21795, " had", "normal", 0.1566888839006424]], "model_b": [[21795, " had", "normal", 0.1189601868391037]]}, "loss": {"model_a": 8.34762511451866, "model_b": 9.580396755903271}, "topk": {"model_a": [21795, 1, 0.1566888839006424, [[21795, 0.156689, " had", false], [55616, 0.139689, " believed", false], [32462, 0.112534, " were", false], [53137, 0.104162, " thought", false], [30840, 0.0412, " felt", false], [22439, 0.027101, " saw", false], [39820, 0.024053, " still", false], [45, 0.023236, ",", false], [60227, 0.022341, " preferred", false], [56175, 0.015599, " expected", false]]], "model_b": [21795, 3, 0.1189601868391037, [[32462, 0.16967, " were", false], [55616, 0.128779, " believed", false], [21795, 0.11896, " had", false], [22439, 0.054735, " saw", false], [30840, 0.053712, " felt", false], [53137, 0.034973, " thought", false], [45196, 0.02776, " argued", false], [45, 0.026086, ",", false], [50970, 0.013834, " assumed", false], [31220, 0.012617, " knew", false]]]}, "raw_delta": -0.068359375, "tuned_delta": -0.015504431101800178}, {"byte_start": 1617, "byte_end": 1625, "display": {"text": " pursued", "kind": "normal"}, "is_word": true, "word_id": 282, "word_key": " pursued", "bytes_hex": "20 70 75 72 73 75 65 64", "compression": {"model_a": "13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10%", "model_b": "13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31%"}, "model_tokens": {"model_a": [[52611, " pursued", "normal", 0.0029854485765099525]], "model_b": [[52611, " pursued", "normal", 0.0026982815470546484]]}, "loss": {"model_a": 13.102601445573592, "model_b": 13.313933726953811}, "topk": {"model_a": [52611, 45, 0.0029854485765099525, [[30259, 0.252889, " been", false], [39762, 0.095071, " spent", false], [62367, 0.062336, " previously", false], [56495, 0.030823, " invested", false], [55616, 0.024418, " believed", false], [30482, 0.024284, " come", false], [53137, 0.022804, " thought", false], [47812, 0.022358, " worked", false], [51770, 0.017495, " focused", false], [22187, 0.017438, " not", false]]], "model_b": [52611, 51, 0.0026982815470546484, [[30259, 0.213605, " been", false], [39762, 0.058563, " spent", false], [22187, 0.043365, " not", false], [62367, 0.028677, " previously", false], [30482, 0.021782, " come", false], [56495, 0.018974, " invested", false], [47812, 0.018181, " worked", false], [4692, 0.018102, " no", false], [59506, 0.018033, " developed", false], [31323, 0.016603, " long", false]]]}, "raw_delta": -0.01171875, "tuned_delta": 0.04113619389819982}, {"byte_start": 1625, "byte_end": 1633, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 283, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "model_b": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.06921660155057907]], "model_b": [[52224, " methods", "normal", 0.050028473138809204]]}, "loss": {"model_a": 6.058192066232952, "model_b": 6.762633004167015}, "topk": {"model_a": [52224, 4, 0.06921660155057907, [[22590, 0.174211, " the", false], [332, 0.134013, " a", false], [39193, 0.089745, " other", false], [52224, 0.069217, " methods", false], [31458, 0.036255, " more", false], [63277, 0.035551, " alternative", false], [4419, 0.023579, " an", false], [38720, 0.017617, " human", false], [47202, 0.014963, " search", false], [53265, 0.014322, " various", false]]], "model_b": [52224, 6, 0.050028473138809204, [[22590, 0.125305, " the", false], [332, 0.076052, " a", false], [31458, 0.066069, " more", false], [51832, 0.065335, " general", false], [32234, 0.05527, " this", false], [52224, 0.050028, " methods", false], [30597, 0.034191, " deep", false], [39931, 0.030091, " their", false], [39193, 0.026121, " other", false], [52906, 0.015227, " similar", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.013792443898199822}, {"byte_start": 1633, "byte_end": 1638, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 284, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "5.38% 5.38% 5.38% 5.38% 5.38%", "model_b": "3.86% 3.86% 3.86% 3.86% 3.86%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.22712847590446472]], "model_b": [[32227, " that", "normal", 0.34694546461105347]]}, "loss": {"model_a": 5.38192876581625, "model_b": 3.860336339878671}, "topk": {"model_a": [32227, 2, 0.22712847590446472, [[37810, 0.418116, " based", false], [32227, 0.227128, " that", false], [4706, 0.056887, " of", false], [59927, 0.033228, " involving", false], [4596, 0.020792, " in", false], [38888, 0.019895, " lever", false], [52700, 0.019537, " relying", false], [31296, 0.017888, " like", false], [21700, 0.016594, " for", false], [32139, 0.014849, " such", false]]], "model_b": [32227, 1, 0.34694546461105347, [[32227, 0.346945, " that", false], [37810, 0.271595, " based", false], [4706, 0.056618, " of", false], [32487, 0.029409, " with", false], [4596, 0.019025, " in", false], [31458, 0.0179, " more", false], [21700, 0.01674, " for", false], [31296, 0.016564, " like", false], [40085, 0.012471, " using", false], [38888, 0.011837, " lever", false]]]}, "raw_delta": 0.08437500000000003, "tuned_delta": 0.13722994389819987}, {"byte_start": 1638, "byte_end": 1647, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 285, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"model_a": "4.10% 4.10% 4.10% 4.10% 4.10% 4.10% 4.10% 4.10% 4.10%", "model_b": "1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94%"}, "model_tokens": {"model_a": [[56540, " leverage", "normal", 0.12964870035648346]], "model_b": [[56540, " leverage", "normal", 0.3794272840023041]]}, "loss": {"model_a": 4.101411683082773, "model_b": 1.9411261400849762}, "topk": {"model_a": [56540, 2, 0.12964870035648346, [[32462, 0.131339, " were", false], [56540, 0.129649, " leverage", false], [47054, 0.068338, " relied", false], [32354, 0.062131, " used", false], [56500, 0.035729, " involved", false], [21532, 0.03314, " did", false], [59685, 0.030331, " exploited", false], [31351, 0.024942, " made", false], [47340, 0.021319, " sought", false], [40219, 0.018744, " would", false]]], "model_b": [56540, 1, 0.3794272840023041, [[56540, 0.379427, " leverage", false], [32462, 0.113895, " were", false], [47054, 0.10193, " relied", false], [32354, 0.043574, " used", false], [21532, 0.02552, " did", false], [32272, 0.018492, " took", false], [51770, 0.01579, " focused", false], [31351, 0.013913, " made", false], [21795, 0.009582, " had", false], [40219, 0.008678, " would", false]]]}, "raw_delta": 0.11979166666666664, "tuned_delta": 0.17264661056486647}, {"byte_start": 1647, "byte_end": 1648, "display": {"text": "d", "kind": "normal"}, "is_word": true, "word_id": 286, "word_key": "d", "bytes_hex": "64", "compression": {"model_a": "0.16%", "model_b": "0.46%"}, "model_tokens": {"model_a": [[101, "d", "normal", 0.9910750389099121]], "model_b": [[101, "d", "normal", 0.9749835133552551]]}, "loss": {"model_a": 0.1629019668972523, "model_b": 0.4556852317260977}, "topk": {"model_a": [101, 1, 0.9910750389099121, [[101, 0.991075, "d", false], [38720, 0.00437, " human", false], [22590, 0.001125, " the", false], [59943, 0.000511, " knowledge", false], [63370, 0.000327, " computation", false], [64862, 0.000138, " computational", false], [39931, 0.000123, " their", false], [55809, 0.000104, " computer", false], [51832, 6.3e-05, " general", false], [332, 6.2e-05, " a", false]]], "model_b": [101, 1, 0.9749835133552551, [[101, 0.974984, "d", false], [51832, 0.004531, " general", false], [63370, 0.002212, " computation", false], [22590, 0.001893, " the", false], [30597, 0.001431, " deep", false], [64862, 0.001376, " computational", false], [52167, 0.000691, " machine", false], [38720, 0.000458, " human", false], [63637, 0.000299, " information", false], [332, 0.00029, " a", false]]]}, "raw_delta": -0.0162353515625, "tuned_delta": 0.03661959233569982}, {"byte_start": 1648, "byte_end": 1654, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 287, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "model_b": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.6066601276397705]], "model_b": [[38720, " human", "normal", 0.05400249734520912]]}, "loss": {"model_a": 1.4675852873626334, "model_b": 8.735067630382394}, "topk": {"model_a": [38720, 1, 0.6066601276397705, [[38720, 0.60666, " human", false], [22590, 0.071049, " the", false], [59943, 0.065051, " knowledge", false], [39931, 0.048378, " their", false], [45775, 0.017868, " domain", false], [332, 0.012074, " a", false], [51832, 0.011673, " general", false], [38013, 0.01107, " chess", false], [55809, 0.008659, " computer", false], [59792, 0.008355, " heuristic", false]]], "model_b": [38720, 4, 0.05400249734520912, [[51832, 0.401834, " general", false], [22590, 0.057332, " the", false], [63370, 0.054984, " computation", false], [38720, 0.054002, " human", false], [52167, 0.027703, " machine", false], [65135, 0.019297, " generalization", false], [64862, 0.011803, " computational", false], [59943, 0.01075, " knowledge", false], [332, 0.010695, " a", false], [3609, 0.009757, " AI", false]]]}, "raw_delta": -0.4029947916666667, "tuned_delta": -0.35013984776846685}, {"byte_start": 1654, "byte_end": 1668, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 288, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"model_a": "6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48%", "model_b": "8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41%"}, "model_tokens": {"model_a": [[65034, " understanding", "normal", 0.006553909741342068]], "model_b": [[65034, " understanding", "normal", 0.0014373342273756862]]}, "loss": {"model_a": 6.48085662899339, "model_b": 8.41303748732682}, "topk": {"model_a": [65034, 5, 0.006553909741342068, [[59943, 0.85734, " knowledge", false], [59683, 0.029356, " expertise", false], [46, 0.024584, "-", false], [38013, 0.016232, " chess", false], [65034, 0.006554, " understanding", false], [62418, 0.004614, " psychology", false], [59917, 0.004117, " intuition", false], [64452, 0.002617, " intelligence", false], [45775, 0.00253, " domain", false], [52022, 0.002464, " insight", false]]], "model_b": [65034, 14, 0.0014373342273756862, [[59943, 0.816923, " knowledge", false], [46, 0.067215, "-", false], [59683, 0.014032, " expertise", false], [64452, 0.009651, " intelligence", false], [59917, 0.007247, " intuition", false], [63637, 0.004447, " information", false], [61979, 0.003726, " experience", false], [52022, 0.002728, " insight", false], [59304, 0.002613, " cognition", false], [56537, 0.002583, " learning", false]]]}, "raw_delta": -0.10714285714285719, "tuned_delta": -0.05428791324465737}, {"byte_start": 1668, "byte_end": 1671, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 289, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "2.98% 2.98% 2.98%", "model_b": "7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.610899806022644]], "model_b": [[4706, " of", "normal", 0.26915931701660156]]}, "loss": {"model_a": 2.9821333039208713, "model_b": 7.889738504861517}, "topk": {"model_a": [4706, 1, 0.610899806022644, [[4706, 0.6109, " of", false], [47, 0.184021, ".", false], [45, 0.06062, ",", false], [21265, 0.052372, " and", false], [275, 0.018815, " (", false], [4596, 0.014956, " in", false], [4811, 0.011062, " to", false], [4715, 0.004685, " or", false], [59, 0.003517, ":", false], [60, 0.002721, ";", false]]], "model_b": [4706, 2, 0.26915931701660156, [[47, 0.328782, ".", false], [4706, 0.269159, " of", false], [21265, 0.083946, " and", false], [45, 0.082692, ",", false], [275, 0.027502, " (", false], [4596, 0.025475, " in", false], [4811, 0.019659, " to", false], [4715, 0.018249, " or", false], [21700, 0.01557, " for", false], [4423, 0.01339, " as", false]]]}, "raw_delta": -0.27213541666666663, "tuned_delta": -0.2192804727684668}, {"byte_start": 1671, "byte_end": 1675, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 290, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.90% 1.90% 1.90% 1.90%", "model_b": "1.18% 1.18% 1.18% 1.18%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.653801679611206]], "model_b": [[22590, " the", "normal", 0.7714414000511169]]}, "loss": {"model_a": 1.901990532421973, "model_b": 1.1799385710395573}, "topk": {"model_a": [22590, 1, 0.653801679611206, [[22590, 0.653802, " the", false], [38013, 0.215117, " chess", false], [30941, 0.018497, " game", false], [38576, 0.010411, " games", false], [21835, 0.009089, " how", false], [57317, 0.006266, " strategy", false], [31702, 0.005739, " play", false], [32464, 0.004067, " what", false], [39072, 0.003732, " moves", false], [31464, 0.003405, " move", false]]], "model_b": [22590, 1, 0.7714414000511169, [[22590, 0.771441, " the", false], [38013, 0.046475, " chess", false], [30941, 0.020286, " game", false], [56893, 0.018627, " position", false], [57317, 0.012533, " strategy", false], [31702, 0.009473, " play", false], [38576, 0.009262, " games", false], [332, 0.006674, " a", false], [37876, 0.005909, " board", false], [39558, 0.005212, " rules", false]]]}, "raw_delta": 0.0400390625, "tuned_delta": 0.09289400639819982}, {"byte_start": 1675, "byte_end": 1683, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 291, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "22.12% 22.12% 22.12% 22.12% 22.12% 22.12% 22.12% 22.12%", "model_b": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 5.7143333833664656e-05]], "model_b": [[52964, " special", "normal", 2.5096107492572628e-05]]}, "loss": {"model_a": 22.11944545112961, "model_b": 23.810103702171368}, "topk": {"model_a": [52964, 193, 5.7143333833664656e-05, [[30941, 0.729372, " game", false], [45775, 0.142235, " domain", false], [38013, 0.020638, " chess", false], [56893, 0.008852, " position", false], [52569, 0.008164, " problem", false], [39558, 0.006798, " rules", false], [37876, 0.006435, " board", false], [46642, 0.004903, " nature", false], [32202, 0.003147, " task", false], [60572, 0.002767, " structure", false]]], "model_b": [52964, 436, 2.5096107492572628e-05, [[30941, 0.715762, " game", false], [37876, 0.066386, " board", false], [39558, 0.035551, " rules", false], [38013, 0.02766, " chess", false], [45775, 0.014098, " domain", false], [52569, 0.011543, " problem", false], [56893, 0.007312, " position", false], [40213, 0.005, " world", false], [46817, 0.003451, " pieces", false], [38576, 0.003092, " games", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.04089505610180018}, {"byte_start": 1683, "byte_end": 1693, "display": {"text": " structure", "kind": "normal"}, "is_word": true, "word_id": 292, "word_key": " structure", "bytes_hex": "20 73 74 72 75 63 74 75 72 65", "compression": {"model_a": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "model_b": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"model_a": [[60572, " structure", "normal", 0.09705828875303268]], "model_b": [[60572, " structure", "normal", 0.060184232890605927]]}, "loss": {"model_a": 4.226645627604385, "model_b": 5.0437971156079}, "topk": {"model_a": [60572, 3, 0.09705828875303268, [[56215, 0.171193, " features", false], [46642, 0.1053, " nature", false], [60572, 0.097058, " structure", false], [62404, 0.090629, " properties", false], [65258, 0.085195, " characteristics", false], [30405, 0.067743, " case", false], [50964, 0.03416, " aspects", false], [45775, 0.025181, " domain", false], [46, 0.024101, "-", false], [59943, 0.02066, " knowledge", false]]], "model_b": [60572, 4, 0.060184232890605927, [[62404, 0.11079, " properties", false], [34889, 0.077093, "ities", false], [46642, 0.062547, " nature", false], [60572, 0.060184, " structure", false], [39558, 0.059902, " rules", false], [56215, 0.047721, " features", false], [38013, 0.027587, " chess", false], [27161, 0.024018, "ties", false], [45775, 0.015063, " domain", false], [60310, 0.014582, " qualities", false]]]}, "raw_delta": -0.04531249999999998, "tuned_delta": 0.007542443898199844}, {"byte_start": 1693, "byte_end": 1696, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 293, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.47% 0.47% 0.47%", "model_b": "0.48% 0.48% 0.48%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9253952503204346]], "model_b": [[4706, " of", "normal", 0.923256516456604]]}, "loss": {"model_a": 0.46669212138131744, "model_b": 0.47843280368021857}, "topk": {"model_a": [4706, 1, 0.9253952503204346, [[4706, 0.925395, " of", false], [21265, 0.048445, " and", false], [32227, 0.005418, " that", false], [4596, 0.004927, " in", false], [45, 0.00313, ",", false], [275, 0.002026, " (", false], [4715, 0.000862, " or", false], [52544, 0.000839, " present", false], [56500, 0.00059, " involved", false], [56454, 0.000574, " inherent", false]]], "model_b": [4706, 1, 0.923256516456604, [[4706, 0.923257, " of", false], [21265, 0.036511, " and", false], [32227, 0.010164, " that", false], [4596, 0.002904, " in", false], [56454, 0.002826, " inherent", false], [45, 0.002201, ",", false], [275, 0.001743, " (", false], [22590, 0.001614, " the", false], [38013, 0.00106, " chess", false], [4715, 0.001009, " or", false]]]}, "raw_delta": -0.0006510416666666678, "tuned_delta": 0.05220390223153315}, {"byte_start": 1696, "byte_end": 1702, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 294, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "2.90% 2.90% 2.90% 2.90% 2.90% 2.90%", "model_b": "4.09% 4.09% 4.09% 4.09% 4.09% 4.09%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.37551337480545044]], "model_b": [[38013, " chess", "normal", 0.25466564297676086]]}, "loss": {"model_a": 2.8999485278285637, "model_b": 4.085757440017572}, "topk": {"model_a": [38013, 2, 0.37551337480545044, [[22590, 0.496908, " the", false], [38013, 0.375513, " chess", false], [37876, 0.015188, " board", false], [332, 0.015056, " a", false], [38576, 0.013702, " games", false], [32234, 0.010573, " this", false], [32227, 0.005655, " that", false], [60202, 0.004639, " positions", false], [30941, 0.003311, " game", false], [55809, 0.003146, " computer", false]]], "model_b": [38013, 2, 0.25466564297676086, [[22590, 0.56385, " the", false], [38013, 0.254666, " chess", false], [38576, 0.035104, " games", false], [332, 0.01491, " a", false], [37876, 0.011707, " board", false], [55809, 0.011664, " computer", false], [38720, 0.00731, " human", false], [30941, 0.006544, " game", false], [3609, 0.004476, " AI", false], [31702, 0.003471, " play", false]]]}, "raw_delta": -0.06575520833333336, "tuned_delta": -0.012900264435133535}, {"byte_start": 1702, "byte_end": 1703, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "18.46%", "model_b": "17.26%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.36210203170776367]], "model_b": [[47, ".", "normal", 0.38291752338409424]]}, "loss": {"model_a": 18.45635257387248, "model_b": 17.25880297938457}, "topk": {"model_a": [47, 1, 0.36210203170776367, [[47, 0.362102, ".", false], [60202, 0.128553, " positions", false], [45, 0.121647, ",", false], [21265, 0.053651, " and", false], [275, 0.049135, " (", false], [38576, 0.03564, " games", false], [4423, 0.028107, " as", false], [41111, 0.021506, "boards", false], [56939, 0.017484, " problems", false], [52616, 0.017119, " puzzles", false]]], "model_b": [47, 1, 0.38291752338409424, [[47, 0.382918, ".", false], [45, 0.076759, ",", false], [38576, 0.063028, " games", false], [56939, 0.043073, " problems", false], [21265, 0.033888, " and", false], [41111, 0.032912, "boards", false], [46817, 0.031298, " pieces", false], [45323, 0.027287, " boards", false], [60202, 0.026045, " positions", false], [275, 0.024962, " (", false]]]}, "raw_delta": 0.06640625, "tuned_delta": 0.11926119389819982}, {"byte_start": 1703, "byte_end": 1708, "display": {"text": " When", "kind": "normal"}, "is_word": true, "word_id": 295, "word_key": " when", "bytes_hex": "20 57 68 65 6e", "compression": {"model_a": "17.58% 17.58% 17.58% 17.58% 17.58%", "model_b": "17.02% 17.02% 17.02% 17.02% 17.02%"}, "model_tokens": {"model_a": [[30032, " When", "normal", 0.0075057134963572025]], "model_b": [[30032, " When", "normal", 0.009000157937407494]]}, "loss": {"model_a": 17.58284581083424, "model_b": 17.019293060486987}, "topk": {"model_a": [30032, 25, 0.0075057134963572025, [[20996, 0.151728, " The", false], [19555, 0.102088, " But", false], [3913, 0.058009, " In", false], [267, 0.041189, "  ", false], [3918, 0.034303, " It", false], [261, 0.031547, "\n\n", false], [29894, 0.031345, " This", false], [37453, 0.025237, " These", false], [50318, 0.025211, " However", false], [29893, 0.022564, " They", false]]], "model_b": [30032, 25, 0.009000157937407494, [[20996, 0.113969, " The", false], [3913, 0.065387, " In", false], [19555, 0.043658, " But", false], [267, 0.042033, "  ", false], [3918, 0.041936, " It", false], [37453, 0.034238, " These", false], [29894, 0.03365, " This", false], [50318, 0.031169, " However", false], [20184, 0.025309, " Kas", false], [28753, 0.024741, " Deep", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 1708, "byte_end": 1710, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 296, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "30.43% 30.43%", "model_b": "34.52% 34.52%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.033675067126750946]], "model_b": [[332, " a", "normal", 0.02141929417848587]]}, "loss": {"model_a": 30.43184851875157, "model_b": 34.51760595876914}, "topk": {"model_a": [332, 5, 0.033675067126750946, [[22590, 0.225349, " the", false], [20184, 0.094974, " Kas", false], [28753, 0.058784, " Deep", false], [4601, 0.046256, " it", false], [332, 0.033675, " a", false], [39936, 0.028527, " these", false], [36274, 0.026068, " Alpha", false], [20077, 0.022134, " IBM", false], [308, 0.020514, " I", false], [39944, 0.018339, " those", false]]], "model_b": [332, 8, 0.02141929417848587, [[20184, 0.277196, " Kas", false], [22590, 0.151481, " the", false], [30597, 0.041223, " deep", false], [4601, 0.037948, " it", false], [28753, 0.03538, " Deep", false], [45, 0.034691, ",", false], [32232, 0.029424, " they", false], [332, 0.021419, " a", false], [308, 0.014752, " I", false], [39936, 0.014356, " these", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17370755610180016}, {"byte_start": 1710, "byte_end": 1718, "display": {"text": " simpler", "kind": "normal"}, "is_word": true, "word_id": 297, "word_key": " simpler", "bytes_hex": "20 73 69 6d 70 6c 65 72", "compression": {"model_a": "14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37%", "model_b": "19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"model_a": [[52907, " simpler", "normal", 0.0017289828974753618]], "model_b": [[52907, " simpler", "normal", 0.00019978224008809775]]}, "loss": {"model_a": 14.370595133854907, "model_b": 19.160793511806542}, "topk": {"model_a": [52907, 62, 0.0017289828974753618, [[30597, 0.073992, " deep", false], [55809, 0.071242, " computer", false], [46561, 0.069926, " method", false], [52167, 0.060719, " machine", false], [38013, 0.060306, " chess", false], [38720, 0.054628, " human", false], [52580, 0.044414, " program", false], [51832, 0.042469, " general", false], [22168, 0.036157, " new", false], [47202, 0.025902, " search", false]]], "model_b": [52907, 396, 0.00019978224008809775, [[22168, 0.103321, " new", false], [55809, 0.099264, " computer", false], [30597, 0.056972, " deep", false], [46561, 0.045211, " method", false], [52167, 0.035499, " machine", false], [38013, 0.029512, " chess", false], [38720, 0.027306, " human", false], [31458, 0.019629, " more", false], [38961, 0.018938, " major", false], [51832, 0.017536, " general", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21277005610180016}, {"byte_start": 1718, "byte_end": 1719, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "34.09%", "model_b": "23.81%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.15095080435276031]], "model_b": [[45, ",", "normal", 0.26743805408477783]]}, "loss": {"model_a": 34.0949413960087, "model_b": 23.810103702171368}, "topk": {"model_a": [45, 2, 0.15095080435276031, [[46561, 0.470805, " method", false], [45, 0.150951, ",", false], [55532, 0.070964, " approach", false], [47202, 0.042612, " search", false], [21265, 0.029134, " and", false], [51832, 0.026085, " general", false], [53275, 0.015443, " version", false], [21400, 0.013708, " but", false], [47487, 0.011006, " system", false], [46, 0.009916, "-", false]]], "model_b": [45, 2, 0.26743805408477783, [[46561, 0.294779, " method", false], [45, 0.267438, ",", false], [55532, 0.112626, " approach", false], [21265, 0.048414, " and", false], [51832, 0.031431, " general", false], [21400, 0.021933, " but", false], [59113, 0.021109, " algorithm", false], [47202, 0.015975, " search", false], [275, 0.013305, " (", false], [57260, 0.011113, " solution", false]]]}, "raw_delta": 0.5703125, "tuned_delta": 0.6231674438981998}, {"byte_start": 1719, "byte_end": 1726, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 298, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "11.75% 11.75% 11.75% 11.75% 11.75% 11.75% 11.75%", "model_b": "19.89% 19.89% 19.89% 19.89% 19.89% 19.89% 19.89%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.010601676069200039]], "model_b": [[47202, " search", "normal", 0.00044600284309126437]]}, "loss": {"model_a": 11.754100221528384, "model_b": 19.88536133368158}, "topk": {"model_a": [47202, 13, 0.010601676069200039, [[31458, 0.19792, " more", false], [51832, 0.082319, " general", false], [38720, 0.079051, " human", false], [31277, 0.064862, " less", false], [21400, 0.06311, " but", false], [45961, 0.053792, " faster", false], [45683, 0.022779, " deeper", false], [45301, 0.020685, " better", false], [37920, 0.019007, " brute", false], [52873, 0.015728, " shallow", false]]], "model_b": [47202, 156, 0.00044600284309126437, [[31458, 0.317712, " more", false], [51832, 0.106312, " general", false], [31277, 0.059871, " less", false], [21400, 0.055849, " but", false], [45961, 0.04364, " faster", false], [21265, 0.026223, " and", false], [22797, 0.015498, " yet", false], [38720, 0.01088, " human", false], [59792, 0.008391, " heuristic", false], [45301, 0.008278, " better", false]]]}, "raw_delta": -0.45089285714285715, "tuned_delta": -0.3980379132446573}, {"byte_start": 1726, "byte_end": 1727, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "0.63%", "model_b": "1.57%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.965585470199585]], "model_b": [[46, "-", "normal", 0.9168814420700073]]}, "loss": {"model_a": 0.6295940882785698, "model_b": 1.5673810869032927}, "topk": {"model_a": [46, 1, 0.965585470199585, [[46, 0.965585, "-", false], [46561, 0.007734, " method", false], [37810, 0.00646, " based", false], [26127, 0.002765, "less", false], [35003, 0.001772, "light", false], [34011, 0.001384, "based", false], [45862, 0.00137, " engine", false], [55532, 0.001157, " approach", false], [24381, 0.001043, "able", false], [32298, 0.000818, " tree", false]]], "model_b": [46, 1, 0.9168814420700073, [[46, 0.916881, "-", false], [46561, 0.011624, " method", false], [37810, 0.011594, " based", false], [59113, 0.005844, " algorithm", false], [52224, 0.00497, " methods", false], [32227, 0.004775, " that", false], [55532, 0.00411, " approach", false], [24381, 0.002834, "able", false], [45862, 0.002399, " engine", false], [57317, 0.002092, " strategy", false]]]}, "raw_delta": -0.052001953125, "tuned_delta": 0.0008529907731998215}, {"byte_start": 1727, "byte_end": 1732, "display": {"text": "based", "kind": "normal"}, "is_word": true, "word_id": 299, "word_key": "based", "bytes_hex": "62 61 73 65 64", "compression": {"model_a": "0.53% 0.53% 0.53% 0.53% 0.53%", "model_b": "1.62% 1.62% 1.62% 1.62% 1.62%"}, "model_tokens": {"model_a": [[34011, "based", "normal", 0.8625272512435913]], "model_b": [[34011, "based", "normal", 0.6380438804626465]]}, "loss": {"model_a": 0.5318529081402184, "model_b": 1.6202141572483475}, "topk": {"model_a": [34011, 1, 0.8625272512435913, [[34011, 0.862527, "based", false], [25457, 0.027954, "free", false], [41273, 0.008849, "driven", false], [54208, 0.007374, "oriented", false], [26476, 0.007277, "only", false], [26127, 0.00706, "less", false], [63067, 0.006765, "independent", false], [35003, 0.00524, "light", false], [34547, 0.004589, "heavy", false], [49161, 0.003983, "focused", false]]], "model_b": [34011, 1, 0.6380438804626465, [[34011, 0.638044, "based", false], [54208, 0.063643, "oriented", false], [25457, 0.041241, "free", false], [26476, 0.026925, "only", false], [26148, 0.020739, "like", false], [63067, 0.013724, "independent", false], [41273, 0.012811, "driven", false], [26127, 0.009199, "less", false], [25885, 0.00899, "inte", false], [7005, 0.006184, "and", false]]]}, "raw_delta": -0.0603515625, "tuned_delta": -0.007496618601800176}, {"byte_start": 1732, "byte_end": 1741, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 300, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "3.22% 3.22% 3.22% 3.22% 3.22% 3.22% 3.22% 3.22% 3.22%", "model_b": "1.93% 1.93% 1.93% 1.93% 1.93% 1.93% 1.93% 1.93% 1.93%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.20019187033176422]], "model_b": [[55532, " approach", "normal", 0.3847121596336365]]}, "loss": {"model_a": 3.2247740714314936, "model_b": 1.9254718970197753}, "topk": {"model_a": [55532, 2, 0.20019187033176422, [[46561, 0.57882, " method", false], [55532, 0.200192, " approach", false], [47487, 0.032087, " system", false], [45, 0.027005, ",", false], [57260, 0.021796, " solution", false], [52580, 0.018966, " program", false], [38013, 0.014693, " chess", false], [55809, 0.012788, " computer", false], [3609, 0.012454, " AI", false], [59113, 0.005877, " algorithm", false]]], "model_b": [55532, 2, 0.3847121596336365, [[46561, 0.393174, " method", false], [55532, 0.384712, " approach", false], [57260, 0.038307, " solution", false], [59113, 0.036864, " algorithm", false], [45, 0.030598, ",", false], [57317, 0.016332, " strategy", false], [60624, 0.009455, " technique", false], [3609, 0.007399, " AI", false], [47487, 0.006233, " system", false], [37636, 0.003592, " agent", false]]]}, "raw_delta": 0.07204861111111112, "tuned_delta": 0.12490355500931094}, {"byte_start": 1741, "byte_end": 1746, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 301, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "20.40% 20.40% 20.40% 20.40% 20.40%", "model_b": "17.36% 17.36% 17.36% 17.36% 17.36%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.0034536058083176613]], "model_b": [[32487, " with", "normal", 0.00800991989672184]]}, "loss": {"model_a": 20.400609562570498, "model_b": 17.35742471069534}, "topk": {"model_a": [32487, 39, 0.0034536058083176613, [[22748, 0.162406, " was", false], [22777, 0.079652, " won", false], [30256, 0.079456, " beat", false], [55934, 0.072724, " defeated", false], [4811, 0.050523, " to", false], [45, 0.039458, ",", false], [51744, 0.039419, " finally", false], [61959, 0.036292, " eventually", false], [32227, 0.026896, " that", false], [30383, 0.017874, " came", false]]], "model_b": [32487, 16, 0.00800991989672184, [[22748, 0.262088, " was", false], [4811, 0.112621, " to", false], [51585, 0.054368, " emerged", false], [45, 0.046672, ",", false], [45283, 0.044148, " became", false], [32227, 0.041936, " that", false], [22777, 0.036684, " won", false], [275, 0.026816, " (", false], [55526, 0.022837, " appeared", false], [30383, 0.022727, " came", false]]]}, "raw_delta": 0.16875000000000007, "tuned_delta": 0.2216049438981999}, {"byte_start": 1746, "byte_end": 1754, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 302, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "16.20% 16.20% 16.20% 16.20% 16.20% 16.20% 16.20% 16.20%", "model_b": "17.82% 17.82% 17.82% 17.82% 17.82% 17.82% 17.82% 17.82%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 0.0007525916444137692]], "model_b": [[52964, " special", "normal", 0.00037118809996172786]]}, "loss": {"model_a": 16.202141572483473, "model_b": 17.82235572973182}, "topk": {"model_a": [52964, 141, 0.0007525916444137692, [[332, 0.197732, " a", false], [22590, 0.044761, " the", false], [30597, 0.043978, " deep", false], [31277, 0.037738, " less", false], [38720, 0.028309, " human", false], [31466, 0.025724, " much", false], [52906, 0.025454, " similar", false], [4692, 0.019758, " no", false], [38475, 0.019744, " fewer", false], [31458, 0.019387, " more", false]]], "model_b": [52964, 184, 0.00037118809996172786, [[332, 0.159359, " a", false], [38475, 0.086012, " fewer", false], [31277, 0.052147, " less", false], [4692, 0.051379, " no", false], [22590, 0.050115, " the", false], [45301, 0.035831, " better", false], [31466, 0.031467, " much", false], [52906, 0.02818, " similar", false], [31458, 0.020756, " more", false], [38940, 0.01794, " lower", false]]]}, "raw_delta": -0.08984375, "tuned_delta": -0.03698880610180018}, {"byte_start": 1754, "byte_end": 1763, "display": {"text": " hardware", "kind": "normal"}, "is_word": true, "word_id": 303, "word_key": " hardware", "bytes_hex": "20 68 61 72 64 77 61 72 65", "compression": {"model_a": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58%", "model_b": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90%"}, "model_tokens": {"model_a": [[56353, " hardware", "normal", 0.013823731802403927]], "model_b": [[56353, " hardware", "normal", 0.0043007913045585155]]}, "loss": {"model_a": 8.578525199730382, "model_b": 10.89535317338019}, "topk": {"model_a": [56353, 12, 0.013823731802403927, [[46, 0.182535, "-", false], [62586, 0.063041, " structures", false], [60572, 0.061316, " structure", false], [52224, 0.055758, " methods", false], [59943, 0.050734, " knowledge", false], [39558, 0.032187, " rules", false], [59792, 0.031583, " heuristic", false], [62633, 0.026017, " techniques", false], [56215, 0.021656, " features", false], [61559, 0.014752, " algorithms", false]]], "model_b": [56353, 31, 0.0043007913045585155, [[60572, 0.171321, " structure", false], [62586, 0.087438, " structures", false], [52224, 0.057636, " methods", false], [46, 0.050602, "-", false], [38530, 0.023692, " focus", false], [59943, 0.021365, " knowledge", false], [47202, 0.018668, " search", false], [59193, 0.018073, " attention", false], [62633, 0.016228, " techniques", false], [38013, 0.014433, " chess", false]]]}, "raw_delta": -0.1284722222222222, "tuned_delta": -0.07561727832402239}, {"byte_start": 1763, "byte_end": 1767, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 304, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "15.00% 15.00% 15.00% 15.00%", "model_b": "15.29% 15.29% 15.29% 15.29%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.035736218094825745]], "model_b": [[21265, " and", "normal", 0.03388107940554619]]}, "loss": {"model_a": 15.004591977995565, "model_b": 15.286368353169191}, "topk": {"model_a": [21265, 7, 0.035736218094825745, [[22748, 0.166658, " was", false], [22777, 0.155209, " won", false], [55934, 0.084613, " defeated", false], [275, 0.045936, " (", false], [45, 0.044431, ",", false], [51744, 0.03621, " finally", false], [21265, 0.035736, " and", false], [30256, 0.026896, " beat", false], [61959, 0.024916, " eventually", false], [4811, 0.018971, " to", false]]], "model_b": [21265, 5, 0.03388107940554619, [[22748, 0.28274, " was", false], [275, 0.044154, " (", false], [4811, 0.040128, " to", false], [45283, 0.035154, " became", false], [21265, 0.033881, " and", false], [46, 0.033335, "-", false], [53061, 0.031648, " support", false], [45, 0.025696, ",", false], [21700, 0.019143, " for", false], [46936, 0.014153, " proved", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 1767, "byte_end": 1776, "display": {"text": " software", "kind": "normal"}, "is_word": true, "word_id": 305, "word_key": " software", "bytes_hex": "20 73 6f 66 74 77 61 72 65", "compression": {"model_a": "3.90% 3.90% 3.90% 3.90% 3.90% 3.90% 3.90% 3.90% 3.90%", "model_b": "4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07%"}, "model_tokens": {"model_a": [[57257, " software", "normal", 0.1439296007156372]], "model_b": [[57257, " software", "normal", 0.13186407089233398]]}, "loss": {"model_a": 3.897906523235154, "model_b": 4.07010319695237}, "topk": {"model_a": [57257, 1, 0.1439296007156372, [[57257, 0.14393, " software", false], [332, 0.094777, " a", false], [52195, 0.04578, " massive", false], [38720, 0.027167, " human", false], [52964, 0.021364, " special", false], [59988, 0.020274, " massively", false], [4419, 0.016993, " an", false], [30597, 0.01431, " deep", false], [57453, 0.012993, " training", false], [31044, 0.012632, " hand", false]]], "model_b": [57257, 1, 0.13186407089233398, [[57257, 0.131864, " software", false], [332, 0.066141, " a", false], [61559, 0.030557, " algorithms", false], [57453, 0.028081, " training", false], [59792, 0.020743, " heuristic", false], [52964, 0.02005, " special", false], [48, 0.019917, "/", false], [46543, 0.016586, " memory", false], [4419, 0.016197, " an", false], [31277, 0.016106, " less", false]]]}, "raw_delta": -0.009548611111111105, "tuned_delta": 0.04330633278708872}, {"byte_start": 1776, "byte_end": 1783, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 306, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"model_a": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "model_b": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"model_a": [[46936, " proved", "normal", 0.006560480687767267]], "model_b": [[46936, " proved", "normal", 0.012738101184368134]]}, "loss": {"model_a": 12.96171325798678, "model_b": 11.271055006945026}, "topk": {"model_a": [46936, 22, 0.006560480687767267, [[22748, 0.189994, " was", false], [22777, 0.128222, " won", false], [55934, 0.081535, " defeated", false], [45, 0.048328, ",", false], [30256, 0.034962, " beat", false], [275, 0.034174, " (", false], [32227, 0.033626, " that", false], [51744, 0.025537, " finally", false], [61959, 0.022438, " eventually", false], [45283, 0.017992, " became", false]]], "model_b": [46936, 11, 0.012738101184368134, [[22748, 0.354254, " was", false], [45283, 0.046469, " became", false], [4811, 0.032448, " to", false], [275, 0.028201, " (", false], [39979, 0.026726, " tools", false], [45, 0.02208, ",", false], [32227, 0.017431, " that", false], [55526, 0.017131, " appeared", false], [51585, 0.015257, " emerged", false], [53061, 0.014258, " support", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14660494389819984}, {"byte_start": 1783, "byte_end": 1790, "display": {"text": " vastly", "kind": "normal"}, "is_word": true, "word_id": 307, "word_key": " vastly", "bytes_hex": "20 76 61 73 74 6c 79", "compression": {"model_a": "12.08% 12.08% 12.08% 12.08% 12.08% 12.08% 12.08%", "model_b": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%"}, "model_tokens": {"model_a": [[47708, " vastly", "normal", 0.009170375764369965]], "model_b": [[47708, " vastly", "normal", 0.004485932644456625]]}, "loss": {"model_a": 12.076130364583953, "model_b": 13.927803687153498}, "topk": {"model_a": [47708, 18, 0.009170375764369965, [[4811, 0.283178, " to", false], [57350, 0.102654, " superior", false], [51127, 0.055229, " capable", false], [31458, 0.047023, " more", false], [62603, 0.04064, " successful", false], [32227, 0.037056, " that", false], [59593, 0.027314, " effective", false], [32393, 0.024783, " vict", false], [46342, 0.024625, " itself", false], [30093, 0.019693, " able", false]]], "model_b": [47708, 30, 0.004485932644456625, [[4811, 0.282824, " to", false], [57350, 0.133951, " superior", false], [31458, 0.054105, " more", false], [62603, 0.043361, " successful", false], [59593, 0.038328, " effective", false], [63362, 0.032364, " competitive", false], [46342, 0.03008, " itself", false], [45301, 0.018392, " better", false], [31466, 0.013856, " much", false], [21660, 0.011682, " far", false]]]}, "raw_delta": -0.10267857142857151, "tuned_delta": -0.049823627530371686}, {"byte_start": 1790, "byte_end": 1795, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 308, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "3.49% 3.49% 3.49% 3.49% 3.49%", "model_b": "4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.38035309314727783]], "model_b": [[31458, " more", "normal", 0.25460779666900635]]}, "loss": {"model_a": 3.494027052152958, "model_b": 4.959264203055811}, "topk": {"model_a": [31458, 2, 0.38035309314727783, [[57350, 0.443022, " superior", false], [31458, 0.380353, " more", false], [45301, 0.1049, " better", false], [45961, 0.023988, " faster", false], [57326, 0.012291, " stronger", false], [22249, 0.005137, " out", false], [59593, 0.004061, " effective", false], [62603, 0.002644, " successful", false], [56445, 0.001992, " inferior", false], [31277, 0.001528, " less", false]]], "model_b": [31458, 2, 0.25460779666900635, [[57350, 0.627075, " superior", false], [31458, 0.254608, " more", false], [45301, 0.041448, " better", false], [45961, 0.022155, " faster", false], [56445, 0.018065, " inferior", false], [31277, 0.006526, " less", false], [45819, 0.004167, " easier", false], [22249, 0.003186, " out", false], [62603, 0.003038, " successful", false], [59593, 0.001678, " effective", false]]]}, "raw_delta": -0.08125000000000002, "tuned_delta": -0.028395056101800195}, {"byte_start": 1795, "byte_end": 1805, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 309, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"model_a": "1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26%", "model_b": "1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03%"}, "model_tokens": {"model_a": [[59593, " effective", "normal", 0.49625787138938904]], "model_b": [[59593, " effective", "normal", 0.5633891224861145]]}, "loss": {"model_a": 1.260949278901975, "model_b": 1.0284837693837334}, "topk": {"model_a": [59593, 1, 0.49625787138938904, [[59593, 0.496258, " effective", false], [56900, 0.264037, " powerful", false], [62603, 0.088721, " successful", false], [51127, 0.045243, " capable", false], [59594, 0.034338, " efficient", false], [63362, 0.008855, " competitive", false], [47129, 0.006128, " robust", false], [55435, 0.005984, " accurate", false], [46876, 0.004087, " potent", false], [59330, 0.003486, " competent", false]]], "model_b": [59593, 1, 0.5633891224861145, [[59593, 0.563389, " effective", false], [56900, 0.168002, " powerful", false], [59594, 0.105435, " efficient", false], [62603, 0.047855, " successful", false], [51127, 0.016481, " capable", false], [60274, 0.012893, " promising", false], [63362, 0.010467, " competitive", false], [47687, 0.003955, " useful", false], [60212, 0.003923, " practical", false], [64862, 0.003827, " computational", false]]]}, "raw_delta": 0.012890624999999992, "tuned_delta": 0.06574556889819981}, {"byte_start": 1805, "byte_end": 1806, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "14.16%", "model_b": "6.66%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.4507598280906677]], "model_b": [[45, ",", "normal", 0.6937479972839355]]}, "loss": {"model_a": 14.159262852474688, "model_b": 6.656966863476906}, "topk": {"model_a": [45, 1, 0.4507598280906677, [[45, 0.45076, ",", false], [32226, 0.355843, " than", false], [4596, 0.073934, " in", false], [4424, 0.037503, " at", false], [275, 0.014372, " (", false], [50870, 0.013329, " against", false], [21265, 0.008108, " and", false], [21700, 0.006374, " for", false], [4712, 0.00494, " on", false], [32227, 0.004001, " that", false]]], "model_b": [45, 1, 0.6937479972839355, [[45, 0.693748, ",", false], [4596, 0.098073, " in", false], [32226, 0.04286, " than", false], [4424, 0.028521, " at", false], [275, 0.02546, " (", false], [50870, 0.019577, " against", false], [21265, 0.019316, " and", false], [21700, 0.00614, " for", false], [332, 0.00529, " a", false], [4712, 0.004795, " on", false]]]}, "raw_delta": 0.416015625, "tuned_delta": 0.46887056889819984}, {"byte_start": 1806, "byte_end": 1812, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 310, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72%", "model_b": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.039762143045663834]], "model_b": [[39936, " these", "normal", 0.03961408883333206]]}, "loss": {"model_a": 9.721284943490085, "model_b": 9.721284943490085}, "topk": {"model_a": [39936, 6, 0.039762143045663834, [[22590, 0.289744, " the", false], [4601, 0.125181, " it", false], [31370, 0.055867, " many", false], [39934, 0.0436, " there", false], [32232, 0.042891, " they", false], [39936, 0.039762, " these", false], [32234, 0.036736, " this", false], [39944, 0.035561, " those", false], [332, 0.025154, " a", false], [32074, 0.021639, " some", false]]], "model_b": [39936, 4, 0.03961408883333206, [[22590, 0.25007, " the", false], [4601, 0.133875, " it", false], [31370, 0.072151, " many", false], [39936, 0.039614, " these", false], [39934, 0.037539, " there", false], [32234, 0.034635, " this", false], [31461, 0.033444, " most", false], [20184, 0.028804, " Kas", false], [32232, 0.02692, " they", false], [32074, 0.024456, " some", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 1812, "byte_end": 1818, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 311, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "11.74% 11.74% 11.74% 11.74% 11.74% 11.74%", "model_b": "17.85% 17.85% 17.85% 17.85% 17.85% 17.85%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.020059790462255478]], "model_b": [[38720, " human", "normal", 0.002575174206867814]]}, "loss": {"model_a": 11.740682298901067, "model_b": 17.845837094329625}, "topk": {"model_a": [38720, 5, 0.020059790462255478, [[63843, 0.3559, " researchers", false], [52224, 0.207911, " methods", false], [61590, 0.033713, " approaches", false], [31937, 0.031906, " same", false], [38720, 0.02006, " human", false], [46787, 0.014991, " people", false], [39193, 0.013989, " other", false], [32462, 0.012697, " were", false], [51551, 0.011838, " earlier", false], [47202, 0.010468, " search", false]]], "model_b": [38720, 30, 0.002575174206867814, [[52224, 0.294994, " methods", false], [63843, 0.230355, " researchers", false], [30597, 0.043903, " deep", false], [61590, 0.040176, " approaches", false], [46787, 0.027628, " people", false], [55809, 0.015556, " computer", false], [38013, 0.011606, " chess", false], [38328, 0.011196, " early", false], [32462, 0.009702, " were", false], [3609, 0.009312, " AI", false]]]}, "raw_delta": -0.33854166666666674, "tuned_delta": -0.2856867227684669}, {"byte_start": 1818, "byte_end": 1819, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "3.54%", "model_b": "8.45%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.8196974992752075]], "model_b": [[46, "-", "normal", 0.6294569373130798]]}, "loss": {"model_a": 3.539815713118672, "model_b": 8.45329125520877}, "topk": {"model_a": [46, 1, 0.8196974992752075, [[46, 0.819697, "-", false], [38013, 0.032698, " chess", false], [25971, 0.022212, "ists", false], [52224, 0.021739, " methods", false], [51685, 0.020463, " experts", false], [61590, 0.010254, " approaches", false], [63843, 0.007661, " researchers", false], [47202, 0.006432, " search", false], [7919, 0.005843, "ist", false], [59943, 0.005747, " knowledge", false]]], "model_b": [46, 1, 0.6294569373130798, [[46, 0.629457, "-", false], [25971, 0.142219, "ists", false], [38013, 0.032485, " chess", false], [59943, 0.021338, " knowledge", false], [63843, 0.01812, " researchers", false], [7919, 0.016074, "ist", false], [61590, 0.010422, " approaches", false], [52224, 0.009925, " methods", false], [65034, 0.008619, " understanding", false], [51685, 0.008555, " experts", false]]]}, "raw_delta": -0.2724609375, "tuned_delta": -0.21960599360180016}, {"byte_start": 1819, "byte_end": 1828, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 312, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98%", "model_b": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.6092947721481323]], "model_b": [[58313, "knowledge", "normal", 0.7668314576148987]]}, "loss": {"model_a": 0.9823037523413893, "model_b": 0.5322442642168485}, "topk": {"model_a": [58313, 1, 0.6092947721481323, [[58313, 0.609295, "knowledge", false], [24991, 0.111216, "ches", false], [42430, 0.04676, "unders", false], [34011, 0.03368, "based", false], [54208, 0.025854, "oriented", false], [48948, 0.01613, "centric", false], [49161, 0.01145, "focused", false], [41394, 0.01106, "expert", false], [42233, 0.010383, "search", false], [53835, 0.00817, "centered", false]]], "model_b": [58313, 1, 0.7668314576148987, [[58313, 0.766831, "knowledge", false], [34011, 0.041142, "based", false], [26085, 0.023295, "know", false], [48948, 0.01716, "centric", false], [42430, 0.009332, "unders", false], [54208, 0.00607, "oriented", false], [26249, 0.005736, "mind", false], [25116, 0.004976, "deep", false], [42233, 0.004694, "search", false], [49161, 0.004595, "focused", false]]]}, "raw_delta": 0.024956597222222224, "tuned_delta": 0.07781154112042205}, {"byte_start": 1828, "byte_end": 1829, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "29.59%", "model_b": "35.22%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.19292104244232178]], "model_b": [[46, "-", "normal", 0.1419229507446289]]}, "loss": {"model_a": 29.58651939323069, "model_b": 35.222046896703205}, "topk": {"model_a": [46, 3, 0.19292104244232178, [[52224, 0.277321, " methods", false], [61590, 0.22435, " approaches", false], [46, 0.192921, "-", false], [63843, 0.142646, " researchers", false], [37810, 0.054862, " based", false], [56777, 0.009565, " oriented", false], [38013, 0.008441, " chess", false], [51685, 0.006303, " experts", false], [63533, 0.003975, " enthusiasts", false], [59099, 0.003356, " advocates", false]]], "model_b": [46, 3, 0.1419229507446289, [[61590, 0.257604, " approaches", false], [52224, 0.167675, " methods", false], [46, 0.141923, "-", false], [37810, 0.111287, " based", false], [63843, 0.079599, " researchers", false], [38677, 0.015488, " heavy", false], [30597, 0.013888, " deep", false], [55532, 0.011655, " approach", false], [56777, 0.010638, " oriented", false], [52489, 0.007347, " players", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.25964505610180016}, {"byte_start": 1829, "byte_end": 1834, "display": {"text": "based", "kind": "normal"}, "is_word": true, "word_id": 313, "word_key": "based", "bytes_hex": "62 61 73 65 64", "compression": {"model_a": "1.58% 1.58% 1.58% 1.58% 1.58%", "model_b": "1.32% 1.32% 1.32% 1.32% 1.32%"}, "model_tokens": {"model_a": [[34011, "based", "normal", 0.6487024426460266]], "model_b": [[34011, "based", "normal", 0.6929730772972107]]}, "loss": {"model_a": 1.5779477009723035, "model_b": 1.3173045539366999}, "topk": {"model_a": [34011, 1, 0.6487024426460266, [[34011, 0.648702, "based", false], [54208, 0.091615, "oriented", false], [8080, 0.038559, "lev", false], [49161, 0.030374, "focused", false], [58213, 0.021635, "dependent", false], [33841, 0.017907, "appro", false], [41273, 0.013152, "driven", false], [26996, 0.006479, "seek", false], [8067, 0.00646, "led", false], [35926, 0.004507, "using", false]]], "model_b": [34011, 1, 0.6929730772972107, [[34011, 0.692973, "based", false], [54208, 0.074928, "oriented", false], [41273, 0.03485, "driven", false], [34547, 0.030014, "heavy", false], [49161, 0.019685, "focused", false], [48948, 0.009336, "centric", false], [34048, 0.005276, "bound", false], [25885, 0.004887, "inte", false], [54087, 0.004764, "inspired", false], [8287, 0.003383, "obs", false]]]}, "raw_delta": 0.014453124999999997, "tuned_delta": 0.06730806889819982}, {"byte_start": 1834, "byte_end": 1840, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 314, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%", "model_b": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.029647238552570343]], "model_b": [[38013, " chess", "normal", 0.02617591992020607]]}, "loss": {"model_a": 10.613576798206566, "model_b": 10.9892786317714}, "topk": {"model_a": [38013, 4, 0.029647238552570343, [[52224, 0.408024, " methods", false], [63843, 0.271433, " researchers", false], [61590, 0.197577, " approaches", false], [38013, 0.029647, " chess", false], [47202, 0.006844, " search", false], [55809, 0.005887, " computer", false], [57103, 0.005309, " research", false], [51685, 0.005099, " experts", false], [3609, 0.004379, " AI", false], [51566, 0.003511, " efforts", false]]], "model_b": [38013, 4, 0.02617591992020607, [[52224, 0.485095, " methods", false], [61590, 0.257207, " approaches", false], [63843, 0.067374, " researchers", false], [38013, 0.026176, " chess", false], [52489, 0.016462, " players", false], [62633, 0.010713, " techniques", false], [30597, 0.009821, " deep", false], [3609, 0.008671, " AI", false], [53087, 0.008155, " systems", false], [57103, 0.007313, " research", false]]]}, "raw_delta": -0.02083333333333337, "tuned_delta": 0.03202161056486645}, {"byte_start": 1840, "byte_end": 1852, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 315, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%", "model_b": "2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.678986668586731]], "model_b": [[63843, " researchers", "normal", 0.23710738122463226]]}, "loss": {"model_a": 0.5840989443703283, "model_b": 2.172026225296697}, "topk": {"model_a": [63843, 1, 0.678986668586731, [[63843, 0.678987, " researchers", false], [52224, 0.089169, " methods", false], [51685, 0.050594, " experts", false], [46, 0.041831, "-", false], [61590, 0.02322, " approaches", false], [52489, 0.016024, " players", false], [3609, 0.015904, " AI", false], [56949, 0.013566, " programs", false], [57103, 0.008387, " research", false], [63874, 0.004643, " specialists", false]]], "model_b": [63843, 1, 0.23710738122463226, [[63843, 0.237107, " researchers", false], [52489, 0.171122, " players", false], [52224, 0.131196, " methods", false], [46, 0.050691, "-", false], [51685, 0.046105, " experts", false], [51616, 0.038815, " engines", false], [57103, 0.024134, " research", false], [56949, 0.023432, " programs", false], [59283, 0.01467, " champions", false], [61559, 0.013536, " algorithms", false]]]}, "raw_delta": -0.08805338541666664, "tuned_delta": -0.03519844151846682}, {"byte_start": 1852, "byte_end": 1857, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 316, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "4.82% 4.82% 4.82% 4.82% 4.82%", "model_b": "4.62% 4.62% 4.62% 4.62% 4.62%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.26230260729789734]], "model_b": [[32462, " were", "normal", 0.27910637855529785]]}, "loss": {"model_a": 4.818376015468999, "model_b": 4.62113255284746}, "topk": {"model_a": [32462, 1, 0.26230260729789734, [[32462, 0.262303, " were", false], [21795, 0.049061, " had", false], [45, 0.024452, ",", false], [21532, 0.020609, " did", false], [38547, 0.019982, " found", false], [30840, 0.017043, " felt", false], [31334, 0.016069, " lost", false], [40, 0.013418, "'", false], [60419, 0.012279, " retreated", false], [46471, 0.01164, " looked", false]]], "model_b": [32462, 1, 0.27910637855529785, [[32462, 0.279106, " were", false], [45283, 0.037378, " became", false], [45, 0.026684, ",", false], [30840, 0.023213, " felt", false], [37828, 0.02265, " began", false], [21795, 0.021619, " had", false], [38547, 0.020005, " found", false], [47638, 0.016447, " turned", false], [52628, 0.016357, " quickly", false], [22439, 0.010692, " saw", false]]]}, "raw_delta": 0.010937500000000044, "tuned_delta": 0.06379244389819987}, {"byte_start": 1857, "byte_end": 1861, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 317, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "14.72% 14.72% 14.72% 14.72%", "model_b": "18.60% 18.60% 18.60% 18.60%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.03844701126217842]], "model_b": [[22187, " not", "normal", 0.016034794971346855]]}, "loss": {"model_a": 14.722815602821939, "model_b": 18.597240761459293}, "topk": {"model_a": [22187, 4, 0.03844701126217842, [[32053, 0.115585, " slow", false], [46021, 0.061815, " forced", false], [31269, 0.058035, " left", false], [22187, 0.038447, " not", false], [47650, 0.019068, " unable", false], [62683, 0.018966, " understand", false], [39418, 0.018857, " quick", false], [45, 0.017145, ",", false], [37694, 0.012344, " among", false], [60601, 0.012065, " surprised", false]]], "model_b": [22187, 8, 0.016034794971346855, [[31269, 0.065372, " left", false], [45756, 0.063213, " dismay", false], [52885, 0.043112, " shocked", false], [64362, 0.028211, " disappointed", false], [53039, 0.025339, " stunned", false], [60601, 0.023566, " surprised", false], [52390, 0.016073, " outrage", false], [22187, 0.016035, " not", false], [61855, 0.015629, " devastated", false], [39171, 0.015253, " often", false]]]}, "raw_delta": -0.21484375, "tuned_delta": -0.16198880610180016}, {"byte_start": 1861, "byte_end": 1866, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 318, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"model_a": "30.66% 30.66% 30.66% 30.66% 30.66%", "model_b": "33.14% 33.14% 33.14% 33.14% 33.14%"}, "model_tokens": {"model_a": [[30992, " good", "normal", 0.0002091236092383042]], "model_b": [[30992, " good", "normal", 0.0001058305351762101]]}, "loss": {"model_a": 30.657269618890467, "model_b": 33.13690172041837}, "topk": {"model_a": [30992, 300, 0.0002091236092383042, [[31581, 0.078475, " only", false], [39418, 0.074228, " quick", false], [30093, 0.058538, " able", false], [56914, 0.056739, " prepared", false], [53350, 0.045678, " willing", false], [32053, 0.036148, " slow", false], [60601, 0.032818, " surprised", false], [39449, 0.024514, " ready", false], [56426, 0.020271, " inclined", false], [4424, 0.020194, " at", false]]], "model_b": [30992, 425, 0.0001058305351762101, [[31581, 0.098295, " only", false], [38664, 0.095491, " happy", false], [60601, 0.075429, " surprised", false], [56914, 0.04055, " prepared", false], [4788, 0.033065, " so", false], [52494, 0.032881, " pleased", false], [63613, 0.023801, " immediately", false], [59831, 0.020393, " impressed", false], [45159, 0.020384, " amused", false], [52047, 0.020302, " invited", false]]]}, "raw_delta": -0.13749999999999996, "tuned_delta": -0.08464505610180013}, {"byte_start": 1866, "byte_end": 1872, "display": {"text": " loser", "kind": "normal"}, "is_word": true, "word_id": 319, "word_key": " loser", "bytes_hex": "20 6c 6f 73 65 72", "compression": {"model_a": "19.35% 19.35% 19.35% 19.35% 19.35% 19.35%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[38935, " loser", "normal", 0.0016296644462272525]], "model_b": [[38935, " loser", "normal", 0.0029632030054926872]]}, "loss": {"model_a": 19.348644428588962, "model_b": 17.47013526076479}, "topk": {"model_a": [38935, 16, 0.0016296644462272525, [[4424, 0.551741, " at", false], [45865, 0.286928, " enough", false], [37598, 0.039555, " about", false], [46, 0.016016, "-", false], [32487, 0.013266, " with", false], [61653, 0.007463, " candidates", false], [4811, 0.007277, " to", false], [57330, 0.006346, " students", false], [21700, 0.003933, " for", false], [4596, 0.003172, " in", false]]], "model_b": [38935, 22, 0.0029632030054926872, [[45865, 0.510216, " enough", false], [4424, 0.122771, " at", false], [21700, 0.036248, " for", false], [46787, 0.026197, " people", false], [4811, 0.020372, " to", false], [61653, 0.020359, " candidates", false], [38010, 0.019988, " cheer", false], [32487, 0.016404, " with", false], [51803, 0.015743, " friends", false], [51249, 0.010041, " company", false]]]}, "raw_delta": 0.10416666666666674, "tuned_delta": 0.15702161056486658}, {"byte_start": 1872, "byte_end": 1873, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 320, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.00%", "model_b": "0.03%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9997296929359436]], "model_b": [[116, "s", "normal", 0.9984013438224792]]}, "loss": {"model_a": 0.004884307284503764, "model_b": 0.0287554992242616}, "topk": {"model_a": [116, 1, 0.9997296929359436, [[116, 0.99973, "s", false], [46, 4.2e-05, "-", false], [47, 4.1e-05, ".", false], [45, 2.3e-05, ",", false], [460, 1.5e-05, "'s", false], [1858, 9e-06, "es", false], [57330, 7e-06, " students", false], [21265, 6e-06, " and", false], [26983, 4e-06, "sand", false], [52489, 4e-06, " players", false]]], "model_b": [116, 1, 0.9984013438224792, [[116, 0.998401, "s", false], [47, 0.000427, ".", false], [45, 0.000154, ",", false], [4596, 7.1e-05, " in", false], [21265, 6.1e-05, " and", false], [460, 3.4e-05, "'s", false], [46, 2.9e-05, "-", false], [45865, 2.6e-05, " enough", false], [60, 2.5e-05, ";", false], [4811, 2.2e-05, " to", false]]]}, "raw_delta": -0.001323699951171875, "tuned_delta": 0.051531243947027947}, {"byte_start": 1873, "byte_end": 1874, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.11%", "model_b": "10.71%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.750744640827179]], "model_b": [[47, ".", "normal", 0.5480251908302307]]}, "loss": {"model_a": 5.107196800021964, "model_b": 10.707502256597774}, "topk": {"model_a": [47, 1, 0.750744640827179, [[47, 0.750745, ".", false], [45, 0.12418, ",", false], [21265, 0.02849, " and", false], [60, 0.01825, ";", false], [59, 0.010957, ":", false], [4596, 0.008942, " in", false], [275, 0.008228, " (", false], [4424, 0.007992, " at", false], [21400, 0.006351, " but", false], [4450, 0.003153, " by", false]]], "model_b": [47, 1, 0.5480251908302307, [[47, 0.548025, ".", false], [45, 0.151271, ",", false], [21265, 0.060734, " and", false], [4596, 0.0556, " in", false], [4424, 0.018045, " at", false], [60, 0.016765, ";", false], [21400, 0.016395, " but", false], [4811, 0.014776, " to", false], [275, 0.010684, " (", false], [59, 0.01032, ":", false]]]}, "raw_delta": -0.310546875, "tuned_delta": -0.25769193110180016}, {"byte_start": 1874, "byte_end": 1879, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 321, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"model_a": "7.83% 7.83% 7.83% 7.83% 7.83%", "model_b": "8.51% 8.51% 8.51% 8.51% 8.51%"}, "model_tokens": {"model_a": [[29893, " They", "normal", 0.11327960342168808]], "model_b": [[29893, " They", "normal", 0.09539249539375305]]}, "loss": {"model_a": 7.833383229826793, "model_b": 8.509646530243494}, "topk": {"model_a": [29893, 2, 0.11327960342168808, [[261, 0.265244, "\n\n", false], [29893, 0.11328, " They", false], [20996, 0.068138, " The", false], [267, 0.058135, "  ", false], [19555, 0.047465, " But", false], [3913, 0.034531, " In", false], [37449, 0.028259, " Their", false], [3918, 0.020147, " It", false], [19417, 0.013162, " And", false], [300, 0.011927, " A", false]]], "model_b": [29893, 2, 0.09539249539375305, [[261, 0.121605, "\n\n", false], [29893, 0.095392, " They", false], [20996, 0.079071, " The", false], [267, 0.063849, "  ", false], [3913, 0.059656, " In", false], [29894, 0.038987, " This", false], [11, 0.031004, "\n", false], [3918, 0.027647, " It", false], [19555, 0.023157, " But", false], [37449, 0.0206, " Their", false]]]}, "raw_delta": -0.03749999999999998, "tuned_delta": 0.015354943898199844}, {"byte_start": 1879, "byte_end": 1884, "display": {"text": " said", "kind": "normal"}, "is_word": true, "word_id": 322, "word_key": " said", "bytes_hex": "20 73 61 69 64", "compression": {"model_a": "22.99% 22.99% 22.99% 22.99% 22.99%", "model_b": "23.67% 23.67% 23.67% 23.67% 23.67%"}, "model_tokens": {"model_a": [[31929, " said", "normal", 0.001689327065832913]], "model_b": [[31929, " said", "normal", 0.0014281454496085644]]}, "loss": {"model_a": 22.99295221416785, "model_b": 23.669215514584554}, "topk": {"model_a": [31929, 96, 0.001689327065832913, [[32462, 0.122848, " were", false], [21795, 0.105217, " had", false], [21532, 0.055999, " did", false], [59392, 0.030125, " continued", false], [38128, 0.018687, " could", false], [39820, 0.017825, " still", false], [40013, 0.017681, " tried", false], [39762, 0.017126, " spent", false], [31334, 0.015271, " lost", false], [60158, 0.013023, " persisted", false]]], "model_b": [31929, 94, 0.0014281454496085644, [[32462, 0.177929, " were", false], [21795, 0.12276, " had", false], [21532, 0.028037, " did", false], [31059, 0.020356, " have", false], [59392, 0.018789, " continued", false], [31334, 0.017631, " lost", false], [38128, 0.014874, " could", false], [39820, 0.014375, " still", false], [21286, 0.013806, " are", false], [47285, 0.012494, " simply", false]]]}, "raw_delta": -0.03750000000000009, "tuned_delta": 0.015354943898199733}, {"byte_start": 1884, "byte_end": 1889, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 323, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "4.06% 4.06% 4.06% 4.06% 4.06%", "model_b": "6.45% 6.45% 6.45% 6.45% 6.45%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.321382611989975]], "model_b": [[32227, " that", "normal", 0.16712068021297455]]}, "loss": {"model_a": 4.057579802500209, "model_b": 6.452678991476026}, "topk": {"model_a": [32227, 1, 0.321382611989975, [[32227, 0.321383, " that", false], [45, 0.111687, ",", false], [32232, 0.108608, " they", false], [22590, 0.093631, " the", false], [4601, 0.04436, " it", false], [47539, 0.0393, " things", false], [39931, 0.031534, " their", false], [269, 0.027369, " \"", false], [4788, 0.015758, " so", false], [38013, 0.01351, " chess", false]]], "model_b": [32227, 2, 0.16712068021297455, [[45, 0.268442, ",", false], [32227, 0.167121, " that", false], [4811, 0.073732, " to", false], [32232, 0.056641, " they", false], [59, 0.05018, ":", false], [269, 0.047021, " \"", false], [4601, 0.038424, " it", false], [22590, 0.030969, " the", false], [47539, 0.024706, " things", false], [32234, 0.020005, " this", false]]]}, "raw_delta": -0.13281249999999997, "tuned_delta": -0.07995755610180015}, {"byte_start": 1889, "byte_end": 1892, "display": {"text": " ``", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 60 60", "compression": {"model_a": "65.00% 65.00% 65.00%", "model_b": "58.61% 58.61% 58.61%"}, "model_tokens": {"model_a": [[4404, " ``", "normal", 1.9605748093454167e-05]], "model_b": [[4404, " ``", "normal", 5.867650543223135e-05]]}, "loss": {"model_a": 64.99641720671632, "model_b": 58.609486036114134}, "topk": {"model_a": [4404, 745, 1.9605748093454167e-05, [[22590, 0.304712, " the", false], [39931, 0.111965, " their", false], [32232, 0.095369, " they", false], [47202, 0.066325, " search", false], [4601, 0.034731, " it", false], [32234, 0.03161, " this", false], [332, 0.024907, " a", false], [30597, 0.020345, " deep", false], [45, 0.018288, ",", false], [39934, 0.017122, " there", false]]], "model_b": [4404, 380, 5.867650543223135e-05, [[32232, 0.212075, " they", false], [22590, 0.192067, " the", false], [39931, 0.1185, " their", false], [32234, 0.051301, " this", false], [4601, 0.046165, " it", false], [4588, 0.023838, " if", false], [45, 0.023506, ",", false], [269, 0.018449, " \"", false], [39934, 0.017319, " there", false], [30597, 0.013244, " deep", false]]]}, "raw_delta": 0.3541666666666665, "tuned_delta": 0.40702161056486635}, {"byte_start": 1892, "byte_end": 1895, "display": {"text": "bru", "kind": "normal"}, "is_word": true, "word_id": 324, "word_key": "bru", "bytes_hex": "62 72 75", "compression": {"model_a": "46.02% 46.02% 46.02%", "model_b": "53.73% 53.73% 53.73%"}, "model_tokens": {"model_a": [[7184, "bru", "normal", 0.0004696889081969857]], "model_b": [[7184, "bru", "normal", 0.00013019150355830789]]}, "loss": {"model_a": 46.02347461169219, "model_b": 53.72536219977128}, "topk": {"model_a": [7184, 194, 0.0004696889081969857, [[8801, 0.135322, "the", false], [25116, 0.074247, "deep", false], [34580, 0.047243, "human", false], [42233, 0.044004, "search", false], [24991, 0.027492, "ches", false], [2278, 0.023764, "we", false], [53865, 0.021072, "computer", false], [35755, 0.020009, "there", false], [2073, 0.019322, "no", false], [1956, 0.01864, "it", false]]], "model_b": [7184, 548, 0.00013019150355830789, [[8801, 0.139817, "the", false], [2278, 0.05224, "we", false], [1942, 0.031592, "if", false], [1956, 0.030958, "it", false], [25116, 0.030151, "deep", false], [34580, 0.030021, "human", false], [35755, 0.026264, "there", false], [1589, 0.020793, "We", false], [53865, 0.018463, "computer", false], [74, 0.017074, "I", false]]]}, "raw_delta": -0.42708333333333304, "tuned_delta": -0.3742283894351332}, {"byte_start": 1895, "byte_end": 1897, "display": {"text": "te", "kind": "normal"}, "is_word": true, "word_id": 325, "word_key": "te", "bytes_hex": "74 65", "compression": {"model_a": "0.02% 0.02%", "model_b": "1.08% 1.08%"}, "model_tokens": {"model_a": [[2206, "te", "normal", 0.9980928301811218]], "model_b": [[2206, "te", "normal", 0.886979341506958]]}, "loss": {"model_a": 0.01719826508628086, "model_b": 1.0830779420736236}, "topk": {"model_a": [2206, 1, 0.9980928301811218, [[2206, 0.998093, "te", false], [8776, 0.000897, "tal", false], [8817, 0.000484, "tis", false], [8796, 0.00033, "tes", false], [42351, 4.4e-05, "teness", false], [117, 2.1e-05, "t", false], [8788, 9e-06, "tec", false], [2210, 7e-06, "ti", false], [8789, 6e-06, "ted", false], [2077, 6e-06, "nt", false]]], "model_b": [2206, 1, 0.886979341506958, [[2206, 0.886979, "te", false], [8776, 0.095044, "tal", false], [8796, 0.00683, "tes", false], [8817, 0.001657, "tis", false], [105, 0.001057, "h", false], [34841, 0.001008, "ising", false], [2077, 0.000829, "nt", false], [2061, 0.000619, "nc", false], [8744, 0.000571, "squ", false], [117, 0.000443, "t", false]]]}, "raw_delta": -0.05910491943359375, "tuned_delta": -0.0062499755353939285}, {"byte_start": 1897, "byte_end": 1903, "display": {"text": " force", "kind": "normal"}, "is_word": true, "word_id": 326, "word_key": " force", "bytes_hex": "20 66 6f 72 63 65", "compression": {"model_a": "1.15% 1.15% 1.15% 1.15% 1.15% 1.15%", "model_b": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"model_a": [[38536, " force", "normal", 0.6817542314529419]], "model_b": [[38536, " force", "normal", 0.6831681132316589]]}, "loss": {"model_a": 1.1505868652923046, "model_b": 1.144716524142854}, "topk": {"model_a": [38536, 1, 0.6817542314529419, [[38536, 0.681754, " force", false], [46, 0.275447, "-", false], [57319, 0.005979, " strength", false], [439, 0.004454, "''", false], [59346, 0.004219, " computing", false], [47202, 0.003735, " search", false], [63370, 0.002892, " computation", false], [39339, 0.002578, " power", false], [51779, 0.002002, " forcing", false], [34470, 0.00184, "force", false]]], "model_b": [38536, 1, 0.6831681132316589, [[38536, 0.683168, " force", false], [46, 0.263826, "-", false], [39339, 0.005934, " power", false], [46022, 0.004559, " forces", false], [439, 0.003753, "''", false], [37920, 0.003037, " brute", false], [59346, 0.002948, " computing", false], [34470, 0.002894, "force", false], [45829, 0.002452, " effort", false], [51779, 0.002339, " forcing", false]]]}, "raw_delta": 0.0003255208333333287, "tuned_delta": 0.05318046473153315}, {"byte_start": 1903, "byte_end": 1904, "display": {"text": "\"", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "22", "compression": {"model_a": "69.04%", "model_b": "48.75%"}, "model_tokens": {"model_a": [[35, "\"", "normal", 0.021721690893173218]], "model_b": [[35, "\"", "normal", 0.06597781926393509]]}, "loss": {"model_a": 69.03521191753828, "model_b": 48.747312905037234}, "topk": {"model_a": [35, 3, 0.021721690893173218, [[439, 0.702859, "''", false], [4600, 0.06262, " is", false], [35, 0.021722, "\"", false], [22748, 0.015737, " was", false], [47202, 0.014293, " search", false], [32475, 0.01262, " will", false], [5341, 0.011799, ",''", false], [32481, 0.010871, " wins", false], [40, 0.010127, "'", false], [1732, 0.007694, "``", false]]], "model_b": [35, 3, 0.06597781926393509, [[439, 0.386313, "''", false], [4600, 0.080882, " is", false], [35, 0.065978, "\"", false], [47202, 0.049762, " search", false], [22748, 0.038648, " was", false], [45, 0.02683, ",", false], [5341, 0.018986, ",''", false], [1732, 0.018624, "``", false], [52224, 0.016414, " methods", false], [21265, 0.013334, " and", false]]]}, "raw_delta": 1.125, "tuned_delta": 1.1778549438981998}, {"byte_start": 1904, "byte_end": 1911, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 327, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.69% 7.69% 7.69% 7.69% 7.69% 7.69% 7.69%", "model_b": "6.64% 6.64% 6.64% 6.64% 6.64% 6.64% 6.64%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.05003240332007408]], "model_b": [[47202, " search", "normal", 0.0762103945016861]]}, "loss": {"model_a": 7.688469665451784, "model_b": 6.641871700521177}, "topk": {"model_a": [47202, 5, 0.05003240332007408, [[22748, 0.278192, " was", false], [52224, 0.161743, " methods", false], [40219, 0.096457, " would", false], [21795, 0.051671, " had", false], [47202, 0.050032, " search", false], [4600, 0.034837, " is", false], [38128, 0.027567, " could", false], [61590, 0.027405, " approaches", false], [275, 0.016912, " (", false], [21265, 0.011785, " and", false]]], "model_b": [47202, 3, 0.0762103945016861, [[22748, 0.21166, " was", false], [52224, 0.100026, " methods", false], [47202, 0.07621, " search", false], [275, 0.065044, " (", false], [4600, 0.054754, " is", false], [40219, 0.043398, " would", false], [61590, 0.03276, " approaches", false], [21795, 0.030473, " had", false], [4715, 0.026859, " or", false], [21265, 0.022788, " and", false]]]}, "raw_delta": 0.058035714285714246, "tuned_delta": 0.11089065818391407}, {"byte_start": 1911, "byte_end": 1915, "display": {"text": " may", "kind": "normal"}, "is_word": true, "word_id": 328, "word_key": " may", "bytes_hex": "20 6d 61 79", "compression": {"model_a": "37.48% 37.48% 37.48% 37.48%", "model_b": "28.18% 28.18% 28.18% 28.18%"}, "model_tokens": {"model_a": [[22074, " may", "normal", 0.00024583944468759]], "model_b": [[22074, " may", "normal", 0.001948247547261417]]}, "loss": {"model_a": 37.47625789809221, "model_b": 28.177637517362562}, "topk": {"model_a": [22074, 124, 0.00024583944468759, [[22748, 0.407429, " was", false], [40219, 0.096179, " would", false], [21795, 0.067765, " had", false], [52224, 0.058271, " methods", false], [38128, 0.052859, " could", false], [4600, 0.045826, " is", false], [45, 0.020378, ",", false], [21532, 0.016121, " did", false], [47285, 0.00948, " simply", false], [275, 0.008168, " (", false]]], "model_b": [22074, 40, 0.001948247547261417, [[22748, 0.359617, " was", false], [45, 0.083062, ",", false], [4600, 0.061796, " is", false], [21795, 0.053923, " had", false], [40219, 0.041583, " would", false], [52224, 0.035108, " methods", false], [275, 0.027478, " (", false], [21265, 0.022928, " and", false], [4596, 0.021153, " in", false], [32487, 0.020187, " with", false]]]}, "raw_delta": 0.515625, "tuned_delta": 0.5684799438981998}, {"byte_start": 1915, "byte_end": 1920, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 329, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "4.28% 4.28% 4.28% 4.28% 4.28%", "model_b": "5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.30517929792404175]], "model_b": [[31059, " have", "normal", 0.2358183115720749]]}, "loss": {"model_a": 4.28300090263911, "model_b": 5.297395853264162}, "topk": {"model_a": [31059, 2, 0.30517929792404175, [[4435, 0.346597, " be", false], [31059, 0.305179, " have", false], [32499, 0.111617, " work", false], [22187, 0.033479, " not", false], [22770, 0.025282, " win", false], [32458, 0.019102, " well", false], [61959, 0.016036, " eventually", false], [30256, 0.015691, " beat", false], [46272, 0.007777, " indeed", false], [45685, 0.005528, " defeat", false]]], "model_b": [31059, 2, 0.2358183115720749, [[4435, 0.356053, " be", false], [31059, 0.235818, " have", false], [22187, 0.081663, " not", false], [31967, 0.032731, " seem", false], [32499, 0.031346, " work", false], [39115, 0.027954, " never", false], [32458, 0.020105, " well", false], [39820, 0.013041, " still", false], [46272, 0.007733, " indeed", false], [22770, 0.006825, " win", false]]]}, "raw_delta": -0.05625000000000002, "tuned_delta": -0.0033950561018002007}, {"byte_start": 1920, "byte_end": 1924, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 330, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"model_a": "8.45% 8.45% 8.45% 8.45%", "model_b": "13.88% 13.88% 13.88% 13.88%"}, "model_tokens": {"model_a": [[22777, " won", "normal", 0.15451325476169586]], "model_b": [[22777, " won", "normal", 0.04570045694708824]]}, "loss": {"model_a": 8.45329125520877, "model_b": 13.877486477301062}, "topk": {"model_a": [22777, 3, 0.15451325476169586, [[30259, 0.314318, " been", false], [47812, 0.162782, " worked", false], [22777, 0.154513, " won", false], [55934, 0.063907, " defeated", false], [45281, 0.035243, " beaten", false], [61959, 0.015295, " eventually", false], [47333, 0.012838, " solved", false], [30256, 0.012007, " beat", false], [332, 0.01081, " a", false], [60586, 0.010657, " succeeded", false]]], "model_b": [22777, 3, 0.04570045694708824, [[30259, 0.466232, " been", false], [47812, 0.052019, " worked", false], [22777, 0.0457, " won", false], [21795, 0.025709, " had", false], [332, 0.020011, " a", false], [31351, 0.019928, " made", false], [47211, 0.012853, " seemed", false], [60586, 0.011009, " succeeded", false], [45284, 0.010004, " become", false], [47333, 0.00865, " solved", false]]]}, "raw_delta": -0.30078125, "tuned_delta": -0.24792630610180016}, {"byte_start": 1924, "byte_end": 1929, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 331, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "16.79% 16.79% 16.79% 16.79% 16.79%", "model_b": "18.26% 18.26% 18.26% 18.26% 18.26%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.009346220642328262]], "model_b": [[32234, " this", "normal", 0.006272817496210337]]}, "loss": {"model_a": 16.79387196034809, "model_b": 18.25910911125094}, "topk": {"model_a": [32234, 12, 0.009346220642328262, [[22590, 0.506178, " the", false], [45, 0.138587, ",", false], [50870, 0.066034, " against", false], [4712, 0.050993, " on", false], [4596, 0.047675, " in", false], [32229, 0.027905, " them", false], [332, 0.018049, " a", false], [21400, 0.014775, " but", false], [21700, 0.012965, " for", false], [4424, 0.011868, " at", false]]], "model_b": [32234, 19, 0.006272817496210337, [[22590, 0.284089, " the", false], [45, 0.143603, ",", false], [4596, 0.075107, " in", false], [332, 0.056761, " a", false], [32074, 0.046639, " some", false], [32229, 0.033281, " them", false], [38013, 0.031659, " chess", false], [50870, 0.0279, " against", false], [21700, 0.022783, " for", false], [4424, 0.022645, " at", false]]]}, "raw_delta": -0.08124999999999993, "tuned_delta": -0.028395056101800112}, {"byte_start": 1929, "byte_end": 1934, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 332, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "6.00% 6.00% 6.00% 6.00% 6.00%", "model_b": "6.79% 6.79% 6.79% 6.79% 6.79%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.19099120795726776]], "model_b": [[32251, " time", "normal", 0.15286463499069214]]}, "loss": {"model_a": 6.001836791198226, "model_b": 6.790810641684378}, "topk": {"model_a": [32251, 2, 0.19099120795726776, [[62293, 0.221423, " particular", false], [32251, 0.190991, " time", false], [39551, 0.11412, " round", false], [30941, 0.088748, " game", false], [38981, 0.067855, " match", false], [45278, 0.05144, " battle", false], [22226, 0.035552, " one", false], [38013, 0.028165, " chess", false], [57271, 0.027475, " specific", false], [62653, 0.023894, " tournament", false]]], "model_b": [32251, 2, 0.15286463499069214, [[30941, 0.303059, " game", false], [32251, 0.152865, " time", false], [38013, 0.075128, " chess", false], [62293, 0.053138, " particular", false], [45278, 0.043279, " battle", false], [38981, 0.032759, " match", false], [22226, 0.027868, " one", false], [62653, 0.021793, " tournament", false], [31813, 0.015498, " race", false], [63361, 0.015308, " competition", false]]]}, "raw_delta": -0.04375000000000001, "tuned_delta": 0.00910494389819981}, {"byte_start": 1934, "byte_end": 1935, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.38%", "model_b": "4.79%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8763938546180725]], "model_b": [[45, ",", "normal", 0.7683281898498535]]}, "loss": {"model_a": 2.3774881655274664, "model_b": 4.7901983779516355}, "topk": {"model_a": [45, 1, 0.8763938546180725, [[45, 0.876394, ",", false], [21400, 0.054141, " but", false], [275, 0.014545, " (", false], [45202, 0.01356, " around", false], [51018, 0.009226, " because", false], [50870, 0.004833, " against", false], [21265, 0.003069, " and", false], [47, 0.002756, ".", false], [4596, 0.002124, " in", false], [4450, 0.001848, " by", false]]], "model_b": [45, 1, 0.7683281898498535, [[45, 0.768328, ",", false], [21400, 0.082393, " but", false], [47, 0.026133, ".", false], [51018, 0.017856, " because", false], [45202, 0.012856, " around", false], [275, 0.012106, " (", false], [50870, 0.009971, " against", false], [21265, 0.007982, " and", false], [4450, 0.007785, " by", false], [4596, 0.006426, " in", false]]]}, "raw_delta": -0.1337890625, "tuned_delta": -0.08093411860180018}, {"byte_start": 1935, "byte_end": 1939, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 333, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "0.13% 0.13% 0.13% 0.13%", "model_b": "0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.971335768699646]], "model_b": [[21400, " but", "normal", 0.9340184330940247]]}, "loss": {"model_a": 0.13153233137987602, "model_b": 0.30819291034615304}, "topk": {"model_a": [21400, 1, 0.971335768699646, [[21400, 0.971336, " but", false], [21265, 0.012572, " and", false], [51018, 0.002946, " because", false], [4596, 0.000849, " in", false], [4423, 0.000716, " as", false], [32227, 0.000674, " that", false], [21700, 0.000618, " for", false], [4715, 0.000606, " or", false], [4601, 0.000515, " it", false], [39690, 0.000414, " since", false]]], "model_b": [21400, 1, 0.9340184330940247, [[21400, 0.934018, " but", false], [21265, 0.024587, " and", false], [32227, 0.002178, " that", false], [51018, 0.002152, " because", false], [4423, 0.001799, " as", false], [4715, 0.001647, " or", false], [4596, 0.00157, " in", false], [4601, 0.001422, " it", false], [32232, 0.001369, " they", false], [4424, 0.00117, " at", false]]]}, "raw_delta": -0.009796142578125, "tuned_delta": 0.04305880132007482}, {"byte_start": 1939, "byte_end": 1942, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 334, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "5.85% 5.85% 5.85%", "model_b": "10.24% 10.24% 10.24%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.3802494704723358]], "model_b": [[4601, " it", "normal", 0.18370026350021362]]}, "loss": {"model_a": 5.846859784852732, "model_b": 10.237874964641732}, "topk": {"model_a": [4601, 1, 0.3802494704723358, [[4601, 0.380249, " it", false], [32227, 0.120324, " that", false], [22590, 0.049006, " the", false], [32232, 0.047984, " they", false], [4596, 0.043935, " in", false], [40219, 0.03708, " would", false], [37920, 0.032546, " brute", false], [39934, 0.017977, " there", false], [4404, 0.014236, " ``", false], [32234, 0.01294, " this", false]]], "model_b": [4601, 1, 0.18370026350021362, [[4601, 0.1837, " it", false], [22590, 0.103578, " the", false], [32232, 0.089445, " they", false], [32227, 0.08636, " that", false], [4404, 0.063047, " ``", false], [22187, 0.062354, " not", false], [4596, 0.047763, " in", false], [31581, 0.019614, " only", false], [32234, 0.018727, " this", false], [30597, 0.016505, " deep", false]]]}, "raw_delta": -0.24348958333333337, "tuned_delta": -0.19063463943513353}, {"byte_start": 1942, "byte_end": 1946, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 335, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "9.16% 9.16% 9.16% 9.16%", "model_b": "5.07% 5.07% 5.07% 5.07%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.13307714462280273]], "model_b": [[22748, " was", "normal", 0.32803913950920105]]}, "loss": {"model_a": 9.157732193142833, "model_b": 5.071974753125262}, "topk": {"model_a": [22748, 3, 0.13307714462280273, [[40219, 0.338368, " would", false], [32475, 0.146674, " will", false], [22748, 0.133077, " was", false], [4600, 0.066446, " is", false], [38128, 0.052382, " could", false], [22777, 0.052064, " won", false], [47816, 0.043443, " wouldn", false], [45599, 0.017773, " couldn", false], [21795, 0.016517, " had", false], [32445, 0.01399, " wasn", false]]], "model_b": [22748, 1, 0.32803913950920105, [[22748, 0.328039, " was", false], [40219, 0.090167, " would", false], [21795, 0.082457, " had", false], [4600, 0.045245, " is", false], [32445, 0.040379, " wasn", false], [21532, 0.031238, " did", false], [22074, 0.029579, " may", false], [32272, 0.028042, " took", false], [30633, 0.022282, " didn", false], [38128, 0.021146, " could", false]]]}, "raw_delta": 0.2265625, "tuned_delta": 0.27941744389819984}, {"byte_start": 1946, "byte_end": 1950, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 336, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "6.23% 6.23% 6.23% 6.23%", "model_b": "7.57% 7.57% 7.57% 7.57%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.24669300019741058]], "model_b": [[22187, " not", "normal", 0.18477612733840942]]}, "loss": {"model_a": 6.234302300716467, "model_b": 7.572740082791189}, "topk": {"model_a": [22187, 1, 0.24669300019741058, [[22187, 0.246693, " not", false], [332, 0.140015, " a", false], [31581, 0.056063, " only", false], [22590, 0.044186, " the", false], [4692, 0.038048, " no", false], [4419, 0.031014, " an", false], [57492, 0.021912, " unlikely", false], [31198, 0.020682, " just", false], [4404, 0.017342, " ``", false], [45781, 0.015636, " doomed", false]]], "model_b": [22187, 1, 0.18477612733840942, [[22187, 0.184776, " not", false], [332, 0.109358, " a", false], [22590, 0.044319, " the", false], [39115, 0.034657, " never", false], [4404, 0.032019, " ``", false], [39820, 0.030124, " still", false], [22614, 0.029906, " too", false], [31581, 0.028014, " only", false], [4692, 0.024736, " no", false], [31198, 0.018871, " just", false]]]}, "raw_delta": -0.07421875, "tuned_delta": -0.02136380610180018}, {"byte_start": 1950, "byte_end": 1952, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 337, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "11.62% 11.62%", "model_b": "18.32% 18.32%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.2752308249473572]], "model_b": [[332, " a", "normal", 0.1309400051832199]]}, "loss": {"model_a": 11.623275475912058, "model_b": 18.315464386285665}, "topk": {"model_a": [332, 1, 0.2752308249473572, [[332, 0.275231, " a", false], [22590, 0.163763, " the", false], [38606, 0.11521, " going", false], [4419, 0.046154, " an", false], [46439, 0.028494, " likely", false], [51832, 0.027988, " general", false], [30992, 0.02088, " good", false], [47008, 0.019274, " really", false], [32464, 0.012122, " what", false], [4404, 0.010592, " ``", false]]], "model_b": [332, 2, 0.1309400051832199, [[22590, 0.274482, " the", false], [332, 0.13094, " a", false], [30992, 0.03294, " good", false], [51018, 0.031183, " because", false], [4404, 0.022644, " ``", false], [38606, 0.020037, " going", false], [4423, 0.018593, " as", false], [4419, 0.018186, " an", false], [32464, 0.012755, " what", false], [40218, 0.012726, " worth", false]]]}, "raw_delta": -0.37109375, "tuned_delta": -0.31823880610180016}, {"byte_start": 1952, "byte_end": 1960, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 338, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "3.84% 3.84% 3.84% 3.84% 3.84% 3.84% 3.84% 3.84%", "model_b": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.18141528964042664]], "model_b": [[51832, " general", "normal", 0.04023819416761398]]}, "loss": {"model_a": 3.839203111740649, "model_b": 7.25574166072086}, "topk": {"model_a": [51832, 1, 0.18141528964042664, [[51832, 0.181415, " general", false], [30992, 0.09993, " good", false], [46561, 0.072371, " method", false], [30811, 0.048113, " fair", false], [31835, 0.032848, " real", false], [4404, 0.030497, " ``", false], [53283, 0.027436, " victory", false], [40091, 0.026735, " valid", false], [32313, 0.026552, " true", false], [53354, 0.024331, " winning", false]]], "model_b": [51832, 2, 0.04023819416761398, [[30992, 0.137531, " good", false], [51832, 0.040238, " general", false], [53354, 0.040082, " winning", false], [45301, 0.028232, " better", false], [32313, 0.023684, " true", false], [4404, 0.023037, " ``", false], [46430, 0.021228, " lesson", false], [22770, 0.01627, " win", false], [46561, 0.015864, " method", false], [30811, 0.014917, " fair", false]]]}, "raw_delta": -0.189453125, "tuned_delta": -0.13659818110180016}, {"byte_start": 1960, "byte_end": 1969, "display": {"text": " strategy", "kind": "normal"}, "is_word": true, "word_id": 339, "word_key": " strategy", "bytes_hex": "20 73 74 72 61 74 65 67 79", "compression": {"model_a": "8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33%", "model_b": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39%"}, "model_tokens": {"model_a": [[57317, " strategy", "normal", 0.01569780707359314]], "model_b": [[57317, " strategy", "normal", 0.02484375797212124]]}, "loss": {"model_a": 8.328057310687155, "model_b": 7.388802726775073}, "topk": {"model_a": [57317, 6, 0.01569780707359314, [[46561, 0.515984, " method", false], [55532, 0.187459, " approach", false], [57260, 0.080377, " solution", false], [41729, 0.071523, "izable", false], [22752, 0.023617, " way", false], [57317, 0.015698, " strategy", false], [46, 0.01415, "-", false], [60250, 0.012662, " principle", false], [45, 0.007885, ",", false], [60624, 0.006416, " technique", false]]], "model_b": [57317, 7, 0.02484375797212124, [[46561, 0.373543, " method", false], [46, 0.196512, "-", false], [55532, 0.092046, " approach", false], [47202, 0.041826, " search", false], [41729, 0.032965, "izable", false], [60250, 0.029431, " principle", false], [57317, 0.024844, " strategy", false], [57260, 0.020576, " solution", false], [45, 0.009354, ",", false], [59113, 0.006931, " algorithm", false]]]}, "raw_delta": 0.05208333333333337, "tuned_delta": 0.10493827723153319}, {"byte_start": 1969, "byte_end": 1970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "34.24%", "model_b": "40.86%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1478322297334671]], "model_b": [[45, ",", "normal", 0.10325170308351517]]}, "loss": {"model_a": 34.23582958359552, "model_b": 40.857574400175714}, "topk": {"model_a": [45, 3, 0.1478322297334671, [[47, 0.360468, ".", false], [21700, 0.190099, " for", false], [45, 0.147832, ",", false], [32227, 0.129187, " that", false], [21265, 0.068768, " and", false], [60, 0.020001, ";", false], [4811, 0.011991, " to", false], [275, 0.008957, " (", false], [61586, 0.007828, " applicable", false], [59, 0.004899, ":", false]]], "model_b": [45, 4, 0.10325170308351517, [[47, 0.329965, ".", false], [32227, 0.183408, " that", false], [21700, 0.111932, " for", false], [45, 0.103252, ",", false], [21265, 0.050731, " and", false], [4811, 0.048047, " to", false], [4596, 0.032129, " in", false], [60, 0.012202, ";", false], [4715, 0.01194, " or", false], [4706, 0.010654, " of", false]]]}, "raw_delta": -0.3671875, "tuned_delta": -0.31433255610180016}, {"byte_start": 1970, "byte_end": 1974, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 340, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "0.98% 0.98% 0.98% 0.98%", "model_b": "1.59% 1.59% 1.59% 1.59%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.8041521310806274]], "model_b": [[21265, " and", "normal", 0.6996076107025146]]}, "loss": {"model_a": 0.9774118013835139, "model_b": 1.59379762207582}, "topk": {"model_a": [21265, 1, 0.8041521310806274, [[21265, 0.804152, " and", false], [4601, 0.033862, " it", false], [4788, 0.022992, " so", false], [22185, 0.017838, " nor", false], [32227, 0.007959, " that", false], [22187, 0.007808, " not", false], [40186, 0.007174, " which", false], [51018, 0.006987, " because", false], [4715, 0.006676, " or", false], [53339, 0.006482, " whereas", false]]], "model_b": [21265, 1, 0.6996076107025146, [[21265, 0.699608, " and", false], [4601, 0.039372, " it", false], [22185, 0.023399, " nor", false], [21400, 0.020069, " but", false], [40186, 0.017451, " which", false], [4423, 0.016733, " as", false], [4715, 0.014257, " or", false], [4788, 0.012262, " so", false], [32227, 0.011997, " that", false], [22187, 0.010444, " not", false]]]}, "raw_delta": -0.0341796875, "tuned_delta": 0.01867525639819982}, {"byte_start": 1974, "byte_end": 1981, "display": {"text": " anyway", "kind": "normal"}, "is_word": true, "word_id": 341, "word_key": " anyway", "bytes_hex": "20 61 6e 79 77 61 79", "compression": {"model_a": "17.95% 17.95% 17.95% 17.95% 17.95% 17.95% 17.95%", "model_b": "25.28% 25.28% 25.28% 25.28% 25.28% 25.28% 25.28%"}, "model_tokens": {"model_a": [[45179, " anyway", "normal", 0.0009522438049316406]], "model_b": [[45179, " anyway", "normal", 5.476904334500432e-05]]}, "loss": {"model_a": 17.953180475348148, "model_b": 25.279366229862408}, "topk": {"model_a": [45179, 86, 0.0009522438049316406, [[4601, 0.175157, " it", false], [32232, 0.095536, " they", false], [40219, 0.08627, " would", false], [22590, 0.069498, " the", false], [32227, 0.069164, " that", false], [4596, 0.029288, " in", false], [39934, 0.025243, " there", false], [60645, 0.01988, " therefore", false], [4788, 0.019584, " so", false], [32239, 0.016024, " thus", false]]], "model_b": [45179, 587, 5.476904334500432e-05, [[4601, 0.160745, " it", false], [22590, 0.124201, " the", false], [32232, 0.09059, " they", false], [32227, 0.053054, " that", false], [39934, 0.026065, " there", false], [4596, 0.024392, " in", false], [22748, 0.01929, " was", false], [4788, 0.016118, " so", false], [332, 0.015308, " a", false], [32234, 0.014614, " this", false]]]}, "raw_delta": -0.40624999999999994, "tuned_delta": -0.3533950561018001}, {"byte_start": 1981, "byte_end": 1984, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 342, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "11.41% 11.41% 11.41%", "model_b": "12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.14992888271808624]], "model_b": [[4601, " it", "normal", 0.11806605756282806]]}, "loss": {"model_a": 11.411943194531839, "model_b": 12.96171325798678}, "topk": {"model_a": [4601, 2, 0.14992888271808624, [[45, 0.260864, ",", false], [4601, 0.149929, " it", false], [32232, 0.111213, " they", false], [22590, 0.098566, " the", false], [37920, 0.035451, " brute", false], [39934, 0.024524, " there", false], [39931, 0.01487, " their", false], [20184, 0.014433, " Kas", false], [38013, 0.013939, " chess", false], [22748, 0.013499, " was", false]]], "model_b": [4601, 2, 0.11806605756282806, [[45, 0.430459, ",", false], [4601, 0.118066, " it", false], [22590, 0.096193, " the", false], [32232, 0.068282, " they", false], [39934, 0.027871, " there", false], [116, 0.01295, "s", false], [32234, 0.012657, " this", false], [4404, 0.009835, " ``", false], [37920, 0.009743, " brute", false], [39931, 0.00822, " their", false]]]}, "raw_delta": -0.0859375, "tuned_delta": -0.03308255610180018}, {"byte_start": 1984, "byte_end": 1988, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 343, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "4.12% 4.12% 4.12% 4.12%", "model_b": "3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.40044859051704407]], "model_b": [[22748, " was", "normal", 0.4991486370563507]]}, "loss": {"model_a": 4.120979486914275, "model_b": 3.1171511503582336}, "topk": {"model_a": [22748, 1, 0.40044859051704407, [[22748, 0.400449, " was", false], [40219, 0.094344, " would", false], [21795, 0.073877, " had", false], [21532, 0.045244, " did", false], [57101, 0.036518, " required", false], [38128, 0.035038, " could", false], [4600, 0.030002, " is", false], [32272, 0.026945, " took", false], [30633, 0.016612, " didn", false], [32445, 0.013249, " wasn", false]]], "model_b": [22748, 1, 0.4991486370563507, [[22748, 0.499149, " was", false], [21795, 0.07986, " had", false], [40219, 0.045283, " would", false], [32272, 0.043589, " took", false], [21532, 0.03967, " did", false], [57101, 0.021615, " required", false], [4600, 0.020339, " is", false], [38128, 0.019212, " could", false], [31581, 0.012458, " only", false], [32445, 0.010334, " wasn", false]]]}, "raw_delta": 0.0556640625, "tuned_delta": 0.10851900639819982}, {"byte_start": 1988, "byte_end": 1992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 344, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "6.48% 6.48% 6.48% 6.48%", "model_b": "9.09% 9.09% 9.09% 9.09%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.23639720678329468]], "model_b": [[22187, " not", "normal", 0.1334061175584793]]}, "loss": {"model_a": 6.48085662899339, "model_b": 9.087288099349427}, "topk": {"model_a": [22187, 1, 0.23639720678329468, [[22187, 0.236397, " not", false], [22614, 0.066059, " too", false], [332, 0.055896, " a", false], [31581, 0.033237, " only", false], [55725, 0.02647, " cheating", false], [4404, 0.024352, " ``", false], [31198, 0.020228, " just", false], [4788, 0.015796, " so", false], [4692, 0.013287, " no", false], [4419, 0.012479, " an", false]]], "model_b": [22187, 1, 0.1334061175584793, [[22187, 0.133406, " not", false], [22614, 0.080381, " too", false], [332, 0.076979, " a", false], [31198, 0.029655, " just", false], [31581, 0.021596, " only", false], [4788, 0.018288, " so", false], [4419, 0.017084, " an", false], [22590, 0.01643, " the", false], [4404, 0.013578, " ``", false], [39820, 0.013323, " still", false]]]}, "raw_delta": -0.14453125, "tuned_delta": -0.09167630610180018}, {"byte_start": 1992, "byte_end": 1996, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 345, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"model_a": "20.57% 20.57% 20.57% 20.57%", "model_b": "28.04% 28.04% 28.04% 28.04%"}, "model_tokens": {"model_a": [[21835, " how", "normal", 0.010352861136198044]], "model_b": [[21835, " how", "normal", 0.002005617367103696]]}, "loss": {"model_a": 20.56967538767467, "model_b": 28.036749329775752}, "topk": {"model_a": [21835, 16, 0.010352861136198044, [[332, 0.108725, " a", false], [22590, 0.059874, " the", false], [30992, 0.045532, " good", false], [32386, 0.043513, " very", false], [47008, 0.040074, " really", false], [30788, 0.036511, " even", false], [4404, 0.03413, " ``", false], [4423, 0.033186, " as", false], [32464, 0.032125, " what", false], [38606, 0.023324, " going", false]]], "model_b": [21835, 76, 0.002005617367103696, [[332, 0.118247, " a", false], [22590, 0.103395, " the", false], [56895, 0.032115, " possible", false], [4423, 0.02839, " as", false], [30788, 0.02287, " even", false], [4419, 0.020538, " an", false], [38606, 0.016804, " going", false], [4404, 0.015741, " ``", false], [39931, 0.015521, " their", false], [37810, 0.014085, " based", false]]]}, "raw_delta": -0.4140625, "tuned_delta": -0.36120755610180016}, {"byte_start": 1996, "byte_end": 2003, "display": {"text": " people", "kind": "normal"}, "is_word": true, "word_id": 346, "word_key": " people", "bytes_hex": "20 70 65 6f 70 6c 65", "compression": {"model_a": "7.85% 7.85% 7.85% 7.85% 7.85% 7.85% 7.85%", "model_b": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"model_a": [[46787, " people", "normal", 0.0481235571205616]], "model_b": [[46787, " people", "normal", 0.01079116016626358]]}, "loss": {"model_a": 7.849484736979571, "model_b": 11.673592685764493}, "topk": {"model_a": [46787, 6, 0.0481235571205616, [[32232, 0.244676, " they", false], [46227, 0.240237, " humans", false], [38720, 0.064251, " human", false], [38013, 0.063049, " chess", false], [22590, 0.056909, " the", false], [46787, 0.048124, " people", false], [332, 0.04004, " a", false], [4858, 0.029868, " we", false], [22226, 0.028949, " one", false], [59345, 0.028204, " computers", false]]], "model_b": [46787, 16, 0.01079116016626358, [[32232, 0.289992, " they", false], [22590, 0.179383, " the", false], [38013, 0.062245, " chess", false], [4858, 0.04422, " we", false], [46227, 0.039858, " humans", false], [59345, 0.035711, " computers", false], [20184, 0.03064, " Kas", false], [4811, 0.021322, " to", false], [332, 0.020576, " a", false], [31461, 0.017949, " most", false]]]}, "raw_delta": -0.21205357142857142, "tuned_delta": -0.15919862753037162}, {"byte_start": 2003, "byte_end": 2010, "display": {"text": " played", "kind": "normal"}, "is_word": true, "word_id": 347, "word_key": " played", "bytes_hex": "20 70 6c 61 79 65 64", "compression": {"model_a": "2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78%", "model_b": "4.55% 4.55% 4.55% 4.55% 4.55% 4.55% 4.55%"}, "model_tokens": {"model_a": [[46840, " played", "normal", 0.3398122191429138]], "model_b": [[46840, " played", "normal", 0.17108111083507538]]}, "loss": {"model_a": 2.7775099838543107, "model_b": 4.5486757706599565}, "topk": {"model_a": [46840, 1, 0.3398122191429138, [[46840, 0.339812, " played", false], [31702, 0.243607, " play", false], [55448, 0.061848, " actually", false], [39942, 0.04563, " think", false], [56714, 0.037026, " normally", false], [53137, 0.036649, " thought", false], [47008, 0.034827, " really", false], [40219, 0.030374, " would", false], [47333, 0.017763, " solved", false], [53248, 0.009824, " usually", false]]], "model_b": [46840, 2, 0.17108111083507538, [[31702, 0.199884, " play", false], [46840, 0.171081, " played", false], [32462, 0.060422, " were", false], [40219, 0.055806, " would", false], [21795, 0.052672, " had", false], [55448, 0.036247, " actually", false], [53137, 0.030561, " thought", false], [53248, 0.019501, " usually", false], [4596, 0.015636, " in", false], [60687, 0.015509, " typically", false]]]}, "raw_delta": -0.0982142857142857, "tuned_delta": -0.04535934181608588}, {"byte_start": 2010, "byte_end": 2016, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 348, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12%", "model_b": "1.55% 1.55% 1.55% 1.55% 1.55% 1.55%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.6849300861358643]], "model_b": [[38013, " chess", "normal", 0.5911086797714233]]}, "loss": {"model_a": 1.121235159545052, "model_b": 1.549770063454941}, "topk": {"model_a": [38013, 1, 0.6849300861358643, [[38013, 0.68493, " chess", false], [47, 0.168942, ".", false], [22590, 0.071832, " the", false], [45, 0.025891, ",", false], [275, 0.006708, " (", false], [4715, 0.00549, " or", false], [21265, 0.005037, " and", false], [4596, 0.003733, " in", false], [60, 0.003067, ";", false], [38576, 0.002303, " games", false]]], "model_b": [38013, 1, 0.5911086797714233, [[38013, 0.591109, " chess", false], [47, 0.158089, ".", false], [22590, 0.105069, " the", false], [4601, 0.02168, " it", false], [45, 0.018217, ",", false], [4596, 0.013606, " in", false], [39931, 0.008092, " their", false], [4424, 0.005561, " at", false], [55809, 0.004729, " computer", false], [38576, 0.004521, " games", false]]]}, "raw_delta": -0.02376302083333334, "tuned_delta": 0.029091923064866482}, {"byte_start": 2016, "byte_end": 2017, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "4.93%", "model_b": "8.56%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7621021866798401]], "model_b": [[47, ".", "normal", 0.6236730813980103]]}, "loss": {"model_a": 4.931086565538449, "model_b": 8.55895739589888}, "topk": {"model_a": [47, 1, 0.7621021866798401, [[47, 0.762102, ".", false], [45, 0.102764, ",", false], [275, 0.026121, " (", false], [45179, 0.015512, " anyway", false], [34, 0.012853, "!", false], [4596, 0.012293, " in", false], [21265, 0.010729, " and", false], [60, 0.009357, ";", false], [4715, 0.004538, " or", false], [4424, 0.003494, " at", false]]], "model_b": [47, 1, 0.6236730813980103, [[47, 0.623673, ".", false], [45, 0.080792, ",", false], [4596, 0.051386, " in", false], [50931, 0.023277, " anymore", false], [45179, 0.019447, " anyway", false], [34, 0.017498, "!", false], [4424, 0.014355, " at", false], [275, 0.012267, " (", false], [21700, 0.011709, " for", false], [60, 0.009394, ";", false]]]}, "raw_delta": -0.201171875, "tuned_delta": -0.14831693110180016}, {"byte_start": 2017, "byte_end": 2023, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 349, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"model_a": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15%", "model_b": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"model_a": [[37453, " These", "normal", 0.012398803606629372]], "model_b": [[37453, " These", "normal", 0.015510297380387783]]}, "loss": {"model_a": 13.149564174769196, "model_b": 12.492085966030738}, "topk": {"model_a": [37453, 13, 0.012398803606629372, [[261, 0.204068, "\n\n", false], [29893, 0.090572, " They", false], [267, 0.08416, "  ", false], [20996, 0.066793, " The", false], [19555, 0.042464, " But", false], [29894, 0.036606, " This", false], [3913, 0.032488, " In", false], [3918, 0.025622, " It", false], [275, 0.02133, " (", false], [19417, 0.017193, " And", false]]], "model_b": [37453, 11, 0.015510297380387783, [[261, 0.106931, "\n\n", false], [20996, 0.087469, " The", false], [29893, 0.086363, " They", false], [267, 0.078928, "  ", false], [3913, 0.04852, " In", false], [3918, 0.038553, " It", false], [11, 0.035409, "\n", false], [29894, 0.035352, " This", false], [19417, 0.027121, " And", false], [19555, 0.015753, " But", false]]]}, "raw_delta": 0.03645833333333326, "tuned_delta": 0.08931327723153308}, {"byte_start": 2023, "byte_end": 2035, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 350, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40%", "model_b": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.20519065856933594]], "model_b": [[63843, " researchers", "normal", 0.14784522354602814]]}, "loss": {"model_a": 2.3950991889758177, "model_b": 2.8764671632307612}, "topk": {"model_a": [63843, 1, 0.20519065856933594, [[63843, 0.205191, " researchers", false], [46787, 0.130875, " people", false], [32462, 0.089287, " were", false], [38720, 0.063876, " human", false], [38013, 0.029856, " chess", false], [31937, 0.02641, " same", false], [21286, 0.020829, " are", false], [59165, 0.020126, " arguments", false], [40119, 0.012151, " views", false], [45484, 0.010526, " claims", false]]], "model_b": [63843, 1, 0.14784522354602814, [[63843, 0.147845, " researchers", false], [38720, 0.094914, " human", false], [46787, 0.087448, " people", false], [38013, 0.06465, " chess", false], [32462, 0.043961, " were", false], [52224, 0.043885, " methods", false], [21286, 0.033083, " are", false], [22638, 0.019777, " two", false], [55809, 0.019599, " computer", false], [52489, 0.017868, " players", false]]]}, "raw_delta": -0.026692708333333343, "tuned_delta": 0.02616223556486648}, {"byte_start": 2035, "byte_end": 2042, "display": {"text": " wanted", "kind": "normal"}, "is_word": true, "word_id": 351, "word_key": " wanted", "bytes_hex": "20 77 61 6e 74 65 64", "compression": {"model_a": "15.05% 15.05% 15.05% 15.05% 15.05% 15.05% 15.05%", "model_b": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65%"}, "model_tokens": {"model_a": [[47763, " wanted", "normal", 0.0028634225018322468]], "model_b": [[47763, " wanted", "normal", 0.003409898141399026]]}, "loss": {"model_a": 15.054909187848, "model_b": 14.652371509028534}, "topk": {"model_a": [47763, 47, 0.0028634225018322468, [[32462, 0.203473, " were", false], [21795, 0.096339, " had", false], [40, 0.051387, "'", false], [21532, 0.047541, " did", false], [45, 0.036152, ",", false], [31059, 0.019407, " have", false], [21286, 0.017547, " are", false], [40219, 0.017518, " would", false], [30135, 0.016229, " also", false], [38128, 0.014155, " could", false]]], "model_b": [47763, 48, 0.003409898141399026, [[32462, 0.197857, " were", false], [21795, 0.06933, " had", false], [45, 0.048457, ",", false], [21532, 0.030827, " did", false], [30135, 0.023736, " also", false], [21286, 0.01953, " are", false], [31059, 0.016885, " have", false], [55616, 0.016637, " believed", false], [31220, 0.01416, " knew", false], [22439, 0.013713, " saw", false]]]}, "raw_delta": 0.022321428571428603, "tuned_delta": 0.07517637246962842}, {"byte_start": 2042, "byte_end": 2050, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 352, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "9.86% 9.86% 9.86% 9.86% 9.86% 9.86% 9.86% 9.86%", "model_b": "13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.012568442150950432]], "model_b": [[52224, " methods", "normal", 0.002716091461479664]]}, "loss": {"model_a": 9.862173131076897, "model_b": 13.313933726953811}, "topk": {"model_a": [52224, 6, 0.012568442150950432, [[4811, 0.65451, " to", false], [332, 0.067261, " a", false], [39931, 0.056689, " their", false], [22590, 0.032257, " the", false], [38013, 0.017936, " chess", false], [52224, 0.012568, " methods", false], [4419, 0.012363, " an", false], [31458, 0.012235, " more", false], [38720, 0.009168, " human", false], [46787, 0.009115, " people", false]]], "model_b": [52224, 19, 0.002716091461479664, [[4811, 0.633568, " to", false], [332, 0.082228, " a", false], [22590, 0.052206, " the", false], [39931, 0.033106, " their", false], [4404, 0.013824, " ``", false], [4419, 0.012182, " an", false], [31458, 0.010221, " more", false], [60522, 0.010023, " something", false], [38013, 0.007925, " chess", false], [38720, 0.007883, " human", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13855130610180016}, {"byte_start": 2050, "byte_end": 2056, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 353, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%", "model_b": "9.25% 9.25% 9.25% 9.25% 9.25% 9.25%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.04862090200185776]], "model_b": [[37810, " based", "normal", 0.046119190752506256]]}, "loss": {"model_a": 9.11076946394723, "model_b": 9.251657651534043}, "topk": {"model_a": [37810, 3, 0.04862090200185776, [[32227, 0.77345, " that", false], [4811, 0.064983, " to", false], [37810, 0.048621, " based", false], [21700, 0.024841, " for", false], [4706, 0.011451, " of", false], [32232, 0.008478, " they", false], [32487, 0.006753, " with", false], [31458, 0.005156, " more", false], [45, 0.004879, ",", false], [4596, 0.00486, " in", false]]], "model_b": [37810, 3, 0.046119190752506256, [[32227, 0.771056, " that", false], [4811, 0.061495, " to", false], [37810, 0.046119, " based", false], [32487, 0.01205, " with", false], [21700, 0.011619, " for", false], [4596, 0.009592, " in", false], [4706, 0.006764, " of", false], [31296, 0.0047, " like", false], [40186, 0.00389, " which", false], [45, 0.003656, ",", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04504244389819982}, {"byte_start": 2056, "byte_end": 2059, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 354, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.19% 0.19% 0.19%", "model_b": "0.45% 0.45% 0.45%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.968268632888794]], "model_b": [[4712, " on", "normal", 0.9278945922851562]]}, "loss": {"model_a": 0.19372125793186762, "model_b": 0.44908109793296586}, "topk": {"model_a": [4712, 1, 0.968268632888794, [[4712, 0.968269, " on", false], [32350, 0.006686, " upon", false], [31458, 0.005703, " more", false], [4596, 0.004556, " in", false], [22187, 0.003418, " not", false], [56003, 0.000828, " directly", false], [45, 0.000809, ",", false], [31581, 0.000791, " only", false], [46957, 0.000704, " purely", false], [4423, 0.000629, " as", false]]], "model_b": [4712, 1, 0.9278945922851562, [[4712, 0.927895, " on", false], [32350, 0.017534, " upon", false], [47330, 0.011441, " solely", false], [4596, 0.0083, " in", false], [45202, 0.005005, " around", false], [46957, 0.003843, " purely", false], [31581, 0.003676, " only", false], [31458, 0.003253, " more", false], [22187, 0.001871, " not", false], [56003, 0.001682, " directly", false]]]}, "raw_delta": -0.01416015625, "tuned_delta": 0.03869478764819982}, {"byte_start": 2059, "byte_end": 2065, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 355, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "3.62% 3.62% 3.62% 3.62% 3.62% 3.62%", "model_b": "8.27% 8.27% 8.27% 8.27% 8.27% 8.27%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.3018374443054199]], "model_b": [[38720, " human", "normal", 0.0626552477478981]]}, "loss": {"model_a": 3.6161301480615293, "model_b": 8.265440338426352}, "topk": {"model_a": [38720, 1, 0.3018374443054199, [[38720, 0.301837, " human", false], [39931, 0.094784, " their", false], [22590, 0.084485, " the", false], [65034, 0.04697, " understanding", false], [51832, 0.041414, " general", false], [30597, 0.033947, " deep", false], [38013, 0.032251, " chess", false], [332, 0.029831, " a", false], [59943, 0.020443, " knowledge", false], [32464, 0.015261, " what", false]]], "model_b": [38720, 3, 0.0626552477478981, [[51832, 0.178868, " general", false], [30597, 0.165952, " deep", false], [38720, 0.062655, " human", false], [22590, 0.054619, " the", false], [52195, 0.029506, " massive", false], [37920, 0.026978, " brute", false], [332, 0.025243, " a", false], [38888, 0.018927, " lever", false], [4404, 0.017547, " ``", false], [47202, 0.014349, " search", false]]]}, "raw_delta": -0.2578125, "tuned_delta": -0.20495755610180016}, {"byte_start": 2065, "byte_end": 2071, "display": {"text": " input", "kind": "normal"}, "is_word": true, "word_id": 356, "word_key": " input", "bytes_hex": "20 69 6e 70 75 74", "compression": {"model_a": "25.55% 25.55% 25.55% 25.55% 25.55% 25.55%", "model_b": "22.35% 22.35% 22.35% 22.35% 22.35% 22.35%"}, "model_tokens": {"model_a": [[38786, " input", "normal", 0.00019754479581024498]], "model_b": [[38786, " input", "normal", 0.0005947783356532454]]}, "loss": {"model_a": 25.547724682408727, "model_b": 22.354259097107633}, "topk": {"model_a": [38786, 89, 0.00019754479581024498, [[59943, 0.390049, " knowledge", false], [65034, 0.322511, " understanding", false], [59683, 0.048261, " expertise", false], [46, 0.039702, "-", false], [38013, 0.039517, " chess", false], [31702, 0.016451, " play", false], [62418, 0.013408, " psychology", false], [59917, 0.012565, " intuition", false], [60323, 0.008795, " reasoning", false], [61979, 0.007701, " experience", false]]], "model_b": [38786, 44, 0.0005947783356532454, [[59943, 0.538765, " knowledge", false], [65034, 0.214749, " understanding", false], [46, 0.097981, "-", false], [59917, 0.013525, " intuition", false], [64452, 0.00829, " intelligence", false], [52022, 0.007257, " insight", false], [56537, 0.00677, " learning", false], [59683, 0.006533, " expertise", false], [59304, 0.005362, " cognition", false], [47802, 0.004984, " wisdom", false]]]}, "raw_delta": 0.17708333333333348, "tuned_delta": 0.22993827723153332}, {"byte_start": 2071, "byte_end": 2074, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 357, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "15.03% 15.03% 15.03%", "model_b": "9.53% 9.53% 9.53%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.08181919157505035]], "model_b": [[4811, " to", "normal", 0.20497405529022217]]}, "loss": {"model_a": 15.028073342593368, "model_b": 9.533434026707669}, "topk": {"model_a": [4811, 4, 0.08181919157505035, [[45, 0.300712, ",", false], [21265, 0.173088, " and", false], [47, 0.130697, ".", false], [4811, 0.081819, " to", false], [32227, 0.077531, " that", false], [31162, 0.046377, " into", false], [4706, 0.04507, " of", false], [60, 0.013199, ";", false], [275, 0.012908, " (", false], [47001, 0.012686, " rather", false]]], "model_b": [4811, 2, 0.20497405529022217, [[45, 0.209931, ",", false], [4811, 0.204974, " to", false], [32227, 0.109403, " that", false], [47, 0.109395, ".", false], [21265, 0.103822, " and", false], [31162, 0.02818, " into", false], [4596, 0.016012, " in", false], [47001, 0.014765, " rather", false], [275, 0.013453, " (", false], [4706, 0.012859, " of", false]]]}, "raw_delta": 0.3046875, "tuned_delta": 0.35754244389819984}, {"byte_start": 2074, "byte_end": 2078, "display": {"text": " win", "kind": "normal"}, "is_word": true, "word_id": 358, "word_key": " win", "bytes_hex": "20 77 69 6e", "compression": {"model_a": "13.10% 13.10% 13.10% 13.10%", "model_b": "14.72% 14.72% 14.72% 14.72%"}, "model_tokens": {"model_a": [[22770, " win", "normal", 0.05493321642279625]], "model_b": [[22770, " win", "normal", 0.03799634799361229]]}, "loss": {"model_a": 13.102601445573592, "model_b": 14.722815602821939}, "topk": {"model_a": [22770, 3, 0.05493321642279625, [[4435, 0.212132, " be", false], [22590, 0.107361, " the", false], [22770, 0.054933, " win", false], [38013, 0.040736, " chess", false], [30256, 0.02615, " beat", false], [31702, 0.021312, " play", false], [47059, 0.01973, " remain", false], [55851, 0.018291, " continue", false], [39931, 0.017495, " their", false], [51982, 0.016325, " improve", false]]], "model_b": [22770, 2, 0.03799634799361229, [[4435, 0.277594, " be", false], [22770, 0.037996, " win", false], [22590, 0.031214, " the", false], [56540, 0.031115, " leverage", false], [31059, 0.028381, " have", false], [31358, 0.02589, " make", false], [31702, 0.024583, " play", false], [47059, 0.02383, " remain", false], [51982, 0.02245, " improve", false], [32499, 0.018856, " work", false]]]}, "raw_delta": -0.08984375, "tuned_delta": -0.03698880610180018}, {"byte_start": 2078, "byte_end": 2082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 359, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "24.23% 24.23% 24.23% 24.23%", "model_b": "19.87% 19.87% 19.87% 19.87%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.0047121369279921055]], "model_b": [[21265, " and", "normal", 0.012039311230182648]]}, "loss": {"model_a": 24.232768264931806, "model_b": 19.86523444974061}, "topk": {"model_a": [21265, 18, 0.0047121369279921055, [[45, 0.211643, ",", false], [22590, 0.168732, " the", false], [4596, 0.114145, " in", false], [47, 0.095814, ".", false], [37635, 0.091331, " again", false], [38013, 0.077859, " chess", false], [50870, 0.02339, " against", false], [46064, 0.0204, " future", false], [4424, 0.012697, " at", false], [4712, 0.010882, " on", false]]], "model_b": [21265, 14, 0.012039311230182648, [[45, 0.182991, ",", false], [47, 0.176139, ".", false], [22590, 0.10716, " the", false], [38013, 0.059687, " chess", false], [4596, 0.056955, " in", false], [50870, 0.055918, " against", false], [38576, 0.019201, " games", false], [31458, 0.017787, " more", false], [31601, 0.016975, " over", false], [332, 0.015638, " a", false]]]}, "raw_delta": 0.2421875, "tuned_delta": 0.29504244389819984}, {"byte_start": 2082, "byte_end": 2087, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 360, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "9.86% 9.86% 9.86% 9.86% 9.86%", "model_b": "10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.0650070309638977]], "model_b": [[32462, " were", "normal", 0.059402503073215485]]}, "loss": {"model_a": 9.862173131076897, "model_b": 10.200304781285249}, "topk": {"model_a": [32462, 3, 0.0650070309638977, [[32232, 0.123059, " they", false], [45, 0.069184, ",", false], [32462, 0.065007, " were", false], [4811, 0.043769, " to", false], [4788, 0.034006, " so", false], [22187, 0.032885, " not", false], [21795, 0.027544, " had", false], [21532, 0.025145, " did", false], [22777, 0.020722, " won", false], [22590, 0.020685, " the", false]]], "model_b": [32462, 2, 0.059402503073215485, [[32232, 0.094017, " they", false], [32462, 0.059403, " were", false], [22187, 0.055454, " not", false], [4811, 0.049565, " to", false], [45, 0.031681, ",", false], [21532, 0.018652, " did", false], [21795, 0.017254, " had", false], [22590, 0.016905, " the", false], [47763, 0.014397, " wanted", false], [40219, 0.01386, " would", false]]]}, "raw_delta": -0.018750000000000044, "tuned_delta": 0.03410494389819978}, {"byte_start": 2087, "byte_end": 2100, "display": {"text": " disappointed", "kind": "normal"}, "is_word": true, "word_id": 361, "word_key": " disappointed", "bytes_hex": "20 64 69 73 61 70 70 6f 69 6e 74 65 64", "compression": {"model_a": "4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47%", "model_b": "3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51%"}, "model_tokens": {"model_a": [[64362, " disappointed", "normal", 0.03956648334860802]], "model_b": [[64362, " disappointed", "normal", 0.07878207415342331]]}, "loss": {"model_a": 4.465071791212836, "model_b": 3.511367136779027}, "topk": {"model_a": [64362, 3, 0.03956648334860802, [[22187, 0.205338, " not", false], [60713, 0.050075, " unwilling", false], [64362, 0.039566, " disappointed", false], [32239, 0.030003, " thus", false], [53350, 0.02633, " willing", false], [62028, 0.023138, " frustrated", false], [47650, 0.013431, " unable", false], [45756, 0.013333, " dismay", false], [60645, 0.012927, " therefore", false], [60374, 0.01234, " reluctant", false]]], "model_b": [64362, 2, 0.07878207415342331, [[22187, 0.147246, " not", false], [64362, 0.078782, " disappointed", false], [53350, 0.043523, " willing", false], [60713, 0.0307, " unwilling", false], [62028, 0.022422, " frustrated", false], [45756, 0.020629, " dismay", false], [60601, 0.016312, " surprised", false], [40229, 0.015052, " wrong", false], [60645, 0.014324, " therefore", false], [38664, 0.013193, " happy", false]]]}, "raw_delta": 0.05288461538461541, "tuned_delta": 0.10573955928281523}, {"byte_start": 2100, "byte_end": 2105, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 362, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"model_a": "4.09% 4.09% 4.09% 4.09% 4.09%", "model_b": "3.78% 3.78% 3.78% 3.78% 3.78%"}, "model_tokens": {"model_a": [[32465, " when", "normal", 0.322946697473526]], "model_b": [[32465, " when", "normal", 0.35188373923301697]]}, "loss": {"model_a": 4.085757440017572, "model_b": 3.7758034273265837}, "topk": {"model_a": [32465, 1, 0.322946697473526, [[32465, 0.322947, " when", false], [32227, 0.251197, " that", false], [47, 0.089479, ".", false], [4811, 0.087533, " to", false], [4450, 0.077957, " by", false], [4424, 0.029682, " at", false], [4596, 0.029172, " in", false], [32487, 0.023368, " with", false], [45, 0.020234, ",", false], [21265, 0.016676, " and", false]]], "model_b": [32465, 1, 0.35188373923301697, [[32465, 0.351884, " when", false], [32227, 0.181129, " that", false], [4811, 0.129919, " to", false], [4450, 0.11098, " by", false], [47, 0.096264, ".", false], [32487, 0.042757, " with", false], [4596, 0.021586, " in", false], [45, 0.011407, ",", false], [4424, 0.010594, " at", false], [21265, 0.007729, " and", false]]]}, "raw_delta": 0.017187499999999994, "tuned_delta": 0.07004244389819982}, {"byte_start": 2105, "byte_end": 2110, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 363, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"model_a": "4.31% 4.31% 4.31% 4.31% 4.31%", "model_b": "4.09% 4.09% 4.09% 4.09% 4.09%"}, "model_tokens": {"model_a": [[32232, " they", "normal", 0.3016994893550873]], "model_b": [[32232, " they", "normal", 0.32408860325813293]]}, "loss": {"model_a": 4.311178540156472, "model_b": 4.085757440017572}, "topk": {"model_a": [32232, 1, 0.3016994893550873, [[32232, 0.301699, " they", false], [22590, 0.127508, " the", false], [37920, 0.11673, " brute", false], [4601, 0.062519, " it", false], [39931, 0.061611, " their", false], [332, 0.040609, " a", false], [52224, 0.028608, " methods", false], [32234, 0.027365, " this", false], [32227, 0.022751, " that", false], [47202, 0.021632, " search", false]]], "model_b": [32232, 1, 0.32408860325813293, [[32232, 0.324089, " they", false], [22590, 0.122936, " the", false], [32234, 0.062629, " this", false], [32227, 0.048083, " that", false], [39931, 0.042469, " their", false], [4601, 0.042464, " it", false], [39936, 0.03038, " these", false], [39944, 0.026643, " those", false], [332, 0.023241, " a", false], [38720, 0.023109, " human", false]]]}, "raw_delta": 0.012500000000000011, "tuned_delta": 0.06535494389819983}, {"byte_start": 2110, "byte_end": 2114, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 364, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"model_a": "4.24% 4.24% 4.24% 4.24%", "model_b": "8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"model_a": [[21532, " did", "normal", 0.3936825394630432]], "model_b": [[21532, " did", "normal", 0.15639647841453552]]}, "loss": {"model_a": 4.244256651052736, "model_b": 8.418069208312065}, "topk": {"model_a": [21532, 1, 0.3936825394630432, [[21532, 0.393683, " did", false], [30633, 0.160342, " didn", false], [45953, 0.123574, " failed", false], [31334, 0.096012, " lost", false], [32462, 0.057858, " were", false], [38128, 0.0177, " could", false], [38547, 0.01111, " found", false], [30383, 0.009448, " came", false], [46936, 0.00913, " proved", false], [45599, 0.006965, " couldn", false]]], "model_b": [21532, 2, 0.15639647841453552, [[32462, 0.158099, " were", false], [21532, 0.156396, " did", false], [38128, 0.087932, " could", false], [38547, 0.084503, " found", false], [45953, 0.071662, " failed", false], [31334, 0.062573, " lost", false], [22439, 0.061866, " saw", false], [21795, 0.043287, " had", false], [30633, 0.036449, " didn", false], [45599, 0.033806, " couldn", false]]]}, "raw_delta": -0.2314453125, "tuned_delta": -0.17859036860180016}, {"byte_start": 2114, "byte_end": 2118, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 365, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "0.05% 0.05% 0.05% 0.05%", "model_b": "0.86% 0.86% 0.86% 0.86%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.9891003966331482]], "model_b": [[22187, " not", "normal", 0.8271129727363586]]}, "loss": {"model_a": 0.049255831207108386, "model_b": 0.8585373931071406}, "topk": {"model_a": [22187, 1, 0.9891003966331482, [[22187, 0.9891, " not", false], [47, 0.005667, ".", false], [4788, 0.001933, " so", false], [45, 0.000799, ",", false], [22770, 0.000373, " win", false], [45301, 0.00012, " better", false], [4692, 9.6e-05, " no", false], [275, 9.1e-05, " (", false], [22590, 8.4e-05, " the", false], [31332, 7.8e-05, " lose", false]]], "model_b": [22187, 1, 0.8271129727363586, [[22187, 0.827113, " not", false], [47, 0.114031, ".", false], [4788, 0.019375, " so", false], [45, 0.009983, ",", false], [22770, 0.00574, " win", false], [31332, 0.001779, " lose", false], [46866, 0.001636, " poorly", false], [21265, 0.001167, " and", false], [21751, 0.001119, " get", false], [30858, 0.001007, " find", false]]]}, "raw_delta": -0.0448760986328125, "tuned_delta": 0.007978845265387322}, {"byte_start": 2118, "byte_end": 2119, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "2.71%", "model_b": "16.20%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8607010245323181]], "model_b": [[47, ".", "normal", 0.409647136926651]]}, "loss": {"model_a": 2.7120976110461466, "model_b": 16.202141572483473}, "topk": {"model_a": [47, 1, 0.8607010245323181, [[47, 0.860701, ".", false], [45, 0.04268, ",", false], [22770, 0.02441, " win", false], [32499, 0.016643, " work", false], [275, 0.005055, " (", false], [60, 0.004693, ";", false], [4491, 0.004473, " do", false], [53051, 0.00368, " succeed", false], [4596, 0.002741, " in", false], [30256, 0.001929, " beat", false]]], "model_b": [47, 1, 0.409647136926651, [[47, 0.409647, ".", false], [21751, 0.190958, " get", false], [22770, 0.094346, " win", false], [50848, 0.043843, " achieve", false], [53051, 0.030814, " succeed", false], [31059, 0.029234, " have", false], [4491, 0.024147, " do", false], [22449, 0.016898, " see", false], [30858, 0.016705, " find", false], [45, 0.016302, ",", false]]]}, "raw_delta": -0.748046875, "tuned_delta": -0.6951919311018002}, {"byte_start": 2119, "byte_end": 2120, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "7.92%", "model_b": "12.61%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.4140413999557495]], "model_b": [[261, "\n\n", "control", 0.24868327379226685]]}, "loss": {"model_a": 7.924960551758221, "model_b": 12.609492789019747}, "topk": {"model_a": [261, 1, 0.4140413999557495, [[261, 0.414041, "\n\n", false], [267, 0.081954, "  ", false], [29893, 0.061329, " They", false], [20996, 0.04255, " The", false], [19555, 0.034074, " But", false], [29894, 0.031064, " This", false], [3913, 0.025355, " In", false], [3918, 0.019383, " It", false], [3336, 0.013782, " \n\n", false], [37449, 0.011653, " Their", false]]], "model_b": [261, 1, 0.24868327379226685, [[261, 0.248683, "\n\n", false], [267, 0.075584, "  ", false], [29893, 0.072627, " They", false], [20996, 0.057864, " The", false], [29894, 0.05394, " This", false], [11, 0.053058, "\n", false], [3913, 0.042999, " In", false], [3918, 0.023796, " It", false], [37449, 0.014655, " Their", false], [3336, 0.013712, " \n\n", false]]]}, "raw_delta": -0.259765625, "tuned_delta": -0.20691068110180016}, {"byte_start": 2120, "byte_end": 2121, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "7.92%", "model_b": "12.61%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.4140413999557495]], "model_b": [[261, "\n\n", "control", 0.24868327379226685]]}, "loss": {"model_a": 7.924960551758221, "model_b": 12.609492789019747}, "topk": {"model_a": [261, 1, 0.4140413999557495, [[261, 0.414041, "\n\n", false], [267, 0.081954, "  ", false], [29893, 0.061329, " They", false], [20996, 0.04255, " The", false], [19555, 0.034074, " But", false], [29894, 0.031064, " This", false], [3913, 0.025355, " In", false], [3918, 0.019383, " It", false], [3336, 0.013782, " \n\n", false], [37449, 0.011653, " Their", false]]], "model_b": [261, 1, 0.24868327379226685, [[261, 0.248683, "\n\n", false], [267, 0.075584, "  ", false], [29893, 0.072627, " They", false], [20996, 0.057864, " The", false], [29894, 0.05394, " This", false], [11, 0.053058, "\n", false], [3913, 0.042999, " In", false], [3918, 0.023796, " It", false], [37449, 0.014655, " Their", false], [3336, 0.013712, " \n\n", false]]]}, "raw_delta": -0.259765625, "tuned_delta": -0.20691068110180016}, {"byte_start": 2121, "byte_end": 2122, "display": {"text": "A", "kind": "normal"}, "is_word": true, "word_id": 366, "word_key": "a", "bytes_hex": "41", "compression": {"model_a": "52.97%", "model_b": "62.55%"}, "model_tokens": {"model_a": [[66, "A", "normal", 0.05255685746669769]], "model_b": [[66, "A", "normal", 0.03149300813674927]]}, "loss": {"model_a": 52.97395853264162, "model_b": 62.55435528854489}, "topk": {"model_a": [66, 3, 0.05255685746669769, [[1136, 0.330548, "In", false], [6699, 0.159281, "The", false], [66, 0.052557, "A", false], [58094, 0.0449, "Similarly", false], [24242, 0.027452, "This", false], [33504, 0.021264, "There", false], [1141, 0.016584, "It", false], [24327, 0.016567, "When", false], [23560, 0.01256, "Deep", false], [48358, 0.010411, "Another", false]]], "model_b": [66, 4, 0.03149300813674927, [[1136, 0.264268, "In", false], [6699, 0.134055, "The", false], [24242, 0.053097, "This", false], [66, 0.031493, "A", false], [24327, 0.016594, "When", false], [33504, 0.015093, "There", false], [6393, 0.014883, "One", false], [1141, 0.012094, "It", false], [58094, 0.011883, "Similarly", false], [853, 0.01, "As", false]]]}, "raw_delta": -0.53125, "tuned_delta": -0.47839505610180016}, {"byte_start": 2122, "byte_end": 2130, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 367, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"model_a": "1.58% 1.58% 1.58% 1.58% 1.58% 1.58% 1.58% 1.58%", "model_b": "3.79% 3.79% 3.79% 3.79% 3.79% 3.79% 3.79% 3.79%"}, "model_tokens": {"model_a": [[52906, " similar", "normal", 0.49130916595458984]], "model_b": [[52906, " similar", "normal", 0.18641811609268188]]}, "loss": {"model_a": 1.5849921103516442, "model_b": 3.7863700413955943}, "topk": {"model_a": [52906, 1, 0.49130916595458984, [[52906, 0.491309, " similar", false], [31458, 0.041211, " more", false], [21674, 0.034366, " few", false], [52693, 0.031682, " related", false], [47205, 0.025441, " second", false], [32386, 0.016325, " very", false], [30992, 0.016127, " good", false], [45674, 0.013372, " decade", false], [59513, 0.01303, " different", false], [57263, 0.01258, " somewhat", false]]], "model_b": [52906, 1, 0.18641811609268188, [[52906, 0.186418, " similar", false], [21674, 0.063715, " few", false], [31458, 0.062477, " more", false], [59513, 0.033032, " different", false], [47205, 0.032641, " second", false], [45674, 0.027455, " decade", false], [52693, 0.027333, " related", false], [38961, 0.017504, " major", false], [32386, 0.012634, " very", false], [45301, 0.012354, " better", false]]]}, "raw_delta": -0.1220703125, "tuned_delta": -0.06921536860180018}, {"byte_start": 2130, "byte_end": 2138, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 368, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"model_a": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%", "model_b": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%"}, "model_tokens": {"model_a": [[52427, " pattern", "normal", 0.05514274165034294]], "model_b": [[52427, " pattern", "normal", 0.07108903676271439]]}, "loss": {"model_a": 6.516078675890093, "model_b": 5.952525925542842}, "topk": {"model_a": [52427, 4, 0.05514274165034294, [[39831, 0.211977, " story", false], [45315, 0.099972, " bitter", false], [60511, 0.094377, " situation", false], [52427, 0.055143, " pattern", false], [65126, 0.051618, " disappointment", false], [46430, 0.043731, " lesson", false], [30405, 0.023768, " case", false], [51668, 0.019863, " example", false], [45, 0.018499, ",", false], [22459, 0.017042, " set", false]]], "model_b": [52427, 5, 0.07108903676271439, [[46430, 0.130792, " lesson", false], [39831, 0.122112, " story", false], [60511, 0.097622, " situation", false], [51668, 0.072365, " example", false], [52427, 0.071089, " pattern", false], [62315, 0.031761, " phenomenon", false], [61979, 0.02422, " experience", false], [55574, 0.020656, " attitude", false], [30405, 0.017524, " case", false], [65126, 0.01501, " disappointment", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 2138, "byte_end": 2141, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 369, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "16.72% 16.72% 16.72%", "model_b": "16.72% 16.72% 16.72%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.061711300164461136]], "model_b": [[4706, " of", "normal", 0.061589132994413376]]}, "loss": {"model_a": 16.718731593635123, "model_b": 16.718731593635123}, "topk": {"model_a": [4706, 6, 0.061711300164461136, [[56745, 0.133771, " occurred", false], [4600, 0.119927, " is", false], [22748, 0.11512, " was", false], [21413, 0.093714, " can", false], [46840, 0.067173, " played", false], [4706, 0.061711, " of", false], [51585, 0.055689, " emerged", false], [21800, 0.035938, " has", false], [57093, 0.028849, " repeated", false], [51586, 0.028626, " emerges", false]]], "model_b": [4706, 4, 0.061589132994413376, [[21413, 0.167653, " can", false], [4600, 0.147674, " is", false], [22748, 0.082444, " was", false], [4706, 0.061589, " of", false], [45921, 0.052079, " exists", false], [56745, 0.048586, " occurred", false], [46697, 0.047575, " occurs", false], [21800, 0.047157, " has", false], [51585, 0.045753, " emerged", false], [46840, 0.043084, " played", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 2141, "byte_end": 2150, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 370, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%", "model_b": "6.98% 6.98% 6.98% 6.98% 6.98% 6.98% 6.98% 6.98% 6.98%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.0061441510915756226]], "model_b": [[57103, " research", "normal", 0.030826685950160027]]}, "loss": {"model_a": 10.206566478511329, "model_b": 6.981792407079834}, "topk": {"model_a": [57103, 18, 0.0061441510915756226, [[45315, 0.333407, " bitter", false], [65126, 0.107253, " disappointment", false], [61640, 0.037202, " bitterness", false], [51708, 0.035005, " failure", false], [38720, 0.027782, " human", false], [45685, 0.016555, " defeat", false], [62500, 0.01553, " resistance", false], [55615, 0.012756, " behavior", false], [45294, 0.012221, " belief", false], [45909, 0.010515, " events", false]]], "model_b": [57103, 4, 0.030826685950160027, [[55615, 0.082904, " behavior", false], [65126, 0.064598, " disappointment", false], [51708, 0.034261, " failure", false], [57103, 0.030827, " research", false], [45315, 0.025562, " bitter", false], [3609, 0.023152, " AI", false], [56537, 0.022165, " learning", false], [62500, 0.019321, " resistance", false], [60363, 0.019092, " rejection", false], [38720, 0.015971, " human", false]]]}, "raw_delta": 0.17881944444444442, "tuned_delta": 0.23167438834264426}, {"byte_start": 2150, "byte_end": 2159, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 371, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"model_a": "12.46% 12.46% 12.46% 12.46% 12.46% 12.46% 12.46% 12.46% 12.46%", "model_b": "16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66%"}, "model_tokens": {"model_a": [[56950, " progress", "normal", 0.00199777795933187]], "model_b": [[56950, " progress", "normal", 0.0002521340502426028]]}, "loss": {"model_a": 12.460777479900333, "model_b": 16.65611462137431}, "topk": {"model_a": [56950, 54, 0.00199777795933187, [[51708, 0.134063, " failure", false], [22748, 0.072728, " was", false], [4600, 0.05929, " is", false], [65126, 0.056187, " disappointment", false], [21413, 0.051231, " can", false], [21265, 0.035001, " and", false], [4596, 0.032864, " in", false], [56745, 0.030861, " occurred", false], [21800, 0.030583, " has", false], [46, 0.026723, "-", false]]], "model_b": [56950, 263, 0.0002521340502426028, [[4600, 0.103452, " is", false], [22748, 0.086536, " was", false], [21413, 0.072379, " can", false], [21800, 0.059078, " has", false], [4596, 0.036967, " in", false], [45921, 0.035202, " exists", false], [56745, 0.02645, " occurred", false], [21265, 0.025689, " and", false], [51585, 0.023867, " emerged", false], [4712, 0.023555, " on", false]]]}, "raw_delta": -0.2326388888888889, "tuned_delta": -0.17978394499068906}, {"byte_start": 2159, "byte_end": 2163, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 372, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "8.91% 8.91% 8.91% 8.91%", "model_b": "9.86% 9.86% 9.86% 9.86%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.13758288323879242]], "model_b": [[22748, " was", "normal", 0.11206827312707901]]}, "loss": {"model_a": 8.91117786486591, "model_b": 9.862173131076897}, "topk": {"model_a": [22748, 1, 0.13758288323879242, [[22748, 0.137583, " was", false], [4596, 0.131443, " in", false], [21413, 0.121519, " can", false], [4600, 0.118101, " is", false], [56745, 0.08715, " occurred", false], [21800, 0.053751, " has", false], [21265, 0.040225, " and", false], [45, 0.023538, ",", false], [46840, 0.017392, " played", false], [51585, 0.017186, " emerged", false]]], "model_b": [22748, 2, 0.11206827312707901, [[4600, 0.130396, " is", false], [22748, 0.112068, " was", false], [21413, 0.106051, " can", false], [56745, 0.067367, " occurred", false], [21800, 0.065746, " has", false], [21265, 0.049793, " and", false], [4596, 0.042238, " in", false], [45, 0.03027, ",", false], [56255, 0.028702, " followed", false], [45921, 0.021559, " exists", false]]]}, "raw_delta": -0.052734375, "tuned_delta": 0.00012056889819982153}, {"byte_start": 2163, "byte_end": 2168, "display": {"text": " seen", "kind": "normal"}, "is_word": true, "word_id": 373, "word_key": " seen", "bytes_hex": "20 73 65 65 6e", "compression": {"model_a": "3.14% 3.14% 3.14% 3.14% 3.14%", "model_b": "5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"model_a": [[31968, " seen", "normal", 0.4186335802078247]], "model_b": [[31968, " seen", "normal", 0.24821822345256805]]}, "loss": {"model_a": 3.141806583185926, "model_b": 5.043797115607899}, "topk": {"model_a": [31968, 1, 0.4186335802078247, [[31968, 0.418634, " seen", false], [51661, 0.125233, " evident", false], [56734, 0.091303, " observed", false], [57093, 0.054551, " repeated", false], [56255, 0.048041, " followed", false], [38547, 0.035393, " found", false], [53296, 0.026607, " visible", false], [55524, 0.025388, " apparent", false], [59676, 0.009283, " exhibited", false], [22590, 0.007211, " the", false]]], "model_b": [31968, 2, 0.24821822345256805, [[56734, 0.270738, " observed", false], [31968, 0.248218, " seen", false], [51661, 0.091382, " evident", false], [38547, 0.036643, " found", false], [55524, 0.021574, " apparent", false], [30135, 0.017256, " also", false], [39140, 0.016477, " noted", false], [56255, 0.015938, " followed", false], [53296, 0.01318, " visible", false], [22590, 0.011978, " the", false]]]}, "raw_delta": -0.10546874999999997, "tuned_delta": -0.05261380610180015}, {"byte_start": 2168, "byte_end": 2171, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 374, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "0.74% 0.74% 0.74%", "model_b": "1.36% 1.36% 1.36%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.8835338354110718]], "model_b": [[4596, " in", "normal", 0.7961896061897278]]}, "loss": {"model_a": 0.7396629848307673, "model_b": 1.3560488055230733}, "topk": {"model_a": [4596, 1, 0.8835338354110718, [[4596, 0.883534, " in", false], [32487, 0.043043, " with", false], [32465, 0.011884, " when", false], [21700, 0.008378, " for", false], [45, 0.005761, ",", false], [45805, 0.004462, " during", false], [4424, 0.003692, " at", false], [31601, 0.002604, " over", false], [45202, 0.002392, " around", false], [4712, 0.002093, " on", false]]], "model_b": [4596, 1, 0.7961896061897278, [[4596, 0.79619, " in", false], [32487, 0.087676, " with", false], [32465, 0.018634, " when", false], [21700, 0.009946, " for", false], [4424, 0.006633, " at", false], [37634, 0.00648, " after", false], [37694, 0.005969, " among", false], [45805, 0.00564, " during", false], [45093, 0.005557, " across", false], [31601, 0.004665, " over", false]]]}, "raw_delta": -0.0341796875, "tuned_delta": 0.01867525639819982}, {"byte_start": 2171, "byte_end": 2180, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 375, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.10315738618373871]], "model_b": [[55809, " computer", "normal", 0.04509180411696434]]}, "loss": {"model_a": 4.539730488908413, "model_b": 6.199080253819764}, "topk": {"model_a": [55809, 2, 0.10315738618373871, [[22590, 0.291755, " the", false], [55809, 0.103157, " computer", false], [38328, 0.055753, " early", false], [52299, 0.035754, " natural", false], [52167, 0.033924, " machine", false], [3609, 0.028548, " AI", false], [3851, 0.028047, " Go", false], [45929, 0.023011, " expert", false], [61594, 0.019222, " artificial", false], [38013, 0.014862, " chess", false]]], "model_b": [55809, 4, 0.04509180411696434, [[22590, 0.200719, " the", false], [65003, 0.108099, " reinforcement", false], [39193, 0.05891, " other", false], [55809, 0.045092, " computer", false], [3609, 0.039075, " AI", false], [52167, 0.038428, " machine", false], [52299, 0.032573, " natural", false], [38744, 0.02676, " image", false], [31370, 0.016008, " many", false], [61594, 0.015422, " artificial", false]]]}, "raw_delta": -0.0920138888888889, "tuned_delta": -0.039158944990689074}, {"byte_start": 2180, "byte_end": 2183, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 376, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"model_a": "5.47% 5.47% 5.47%", "model_b": "32.50% 32.50% 32.50%"}, "model_tokens": {"model_a": [[3851, " Go", "normal", 0.4003258943557739]], "model_b": [[3851, " Go", "normal", 0.004526057746261358]]}, "loss": {"model_a": 5.471157951287898, "model_b": 32.49820860335816}, "topk": {"model_a": [3851, 1, 0.4003258943557739, [[3851, 0.400326, " Go", false], [52814, 0.078316, " science", false], [46, 0.068309, "-", false], [39311, 0.047114, " poker", false], [47732, 0.03738, " vision", false], [38576, 0.030898, " games", false], [4559, 0.024256, " go", false], [47350, 0.023706, " speech", false], [56529, 0.022703, " language", false], [31044, 0.02121, " hand", false]]], "model_b": [3851, 27, 0.004526057746261358, [[47350, 0.124153, " speech", false], [46, 0.103143, "-", false], [47732, 0.082612, " vision", false], [56529, 0.050559, " language", false], [38576, 0.049769, " games", false], [52814, 0.034479, " science", false], [52491, 0.031029, " playing", false], [47202, 0.030155, " search", false], [39082, 0.029577, " music", false], [30941, 0.028603, " game", false]]]}, "raw_delta": -1.4986979166666667, "tuned_delta": -1.445842972768467}, {"byte_start": 2183, "byte_end": 2184, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "20.99%", "model_b": "24.94%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.3140634298324585]], "model_b": [[45, ",", "normal", 0.2501910924911499]]}, "loss": {"model_a": 20.99233995043511, "model_b": 24.93720920286587}, "topk": {"model_a": [45, 2, 0.3140634298324585, [[47, 0.512348, ".", false], [45, 0.314063, ",", false], [4596, 0.054341, " in", false], [275, 0.017628, " (", false], [21265, 0.017024, " and", false], [59, 0.013558, ":", false], [31601, 0.006679, " over", false], [30917, 0.005319, " from", false], [332, 0.00452, " a", false], [4424, 0.002949, " at", false]]], "model_b": [45, 2, 0.2501910924911499, [[47, 0.620214, ".", false], [45, 0.250191, ",", false], [4596, 0.022606, " in", false], [21265, 0.017995, " and", false], [275, 0.015996, " (", false], [59, 0.009818, ":", false], [4423, 0.004668, " as", false], [32465, 0.004363, " when", false], [4424, 0.00425, " at", false], [40185, 0.003801, " where", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16589505610180016}, {"byte_start": 2184, "byte_end": 2189, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 377, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "26.60% 26.60% 26.60% 26.60% 26.60%", "model_b": "28.85% 28.85% 28.85% 28.85% 28.85%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.000615722790826112]], "model_b": [[31581, " only", "normal", 0.0003290027379989624]]}, "loss": {"model_a": 26.599689816390264, "model_b": 28.853900817779266}, "topk": {"model_a": [31581, 59, 0.000615722790826112, [[40185, 0.436021, " where", false], [40186, 0.099996, " which", false], [22590, 0.054603, " the", false], [4596, 0.048806, " in", false], [21265, 0.041304, " and", false], [32487, 0.034222, " with", false], [332, 0.030197, " a", false], [32465, 0.019826, " when", false], [55495, 0.017408, " although", false], [50919, 0.016711, " another", false]]], "model_b": [31581, 114, 0.0003290027379989624, [[40185, 0.353599, " where", false], [40186, 0.105564, " which", false], [21265, 0.06975, " and", false], [332, 0.039648, " a", false], [32487, 0.039273, " with", false], [4596, 0.037782, " in", false], [22590, 0.035803, " the", false], [21400, 0.023658, " but", false], [4423, 0.014449, " as", false], [32465, 0.012168, " when", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 2189, "byte_end": 2197, "display": {"text": " delayed", "kind": "normal"}, "is_word": true, "word_id": 378, "word_key": " delayed", "bytes_hex": "20 64 65 6c 61 79 65 64", "compression": {"model_a": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%", "model_b": "17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54%"}, "model_tokens": {"model_a": [[51419, " delayed", "normal", 0.0009985610377043486]], "model_b": [[51419, " delayed", "normal", 0.0004149079031776637]]}, "loss": {"model_a": 15.568144728342816, "model_b": 17.540579354558197}, "topk": {"model_a": [51419, 68, 0.0009985610377043486, [[31458, 0.103107, " more", false], [332, 0.09764, " a", false], [31466, 0.084316, " much", false], [32487, 0.068627, " with", false], [38869, 0.054411, " later", false], [57245, 0.037554, " slightly", false], [4601, 0.036191, " it", false], [4596, 0.035639, " in", false], [57263, 0.035586, " somewhat", false], [32234, 0.035539, " this", false]]], "model_b": [51419, 104, 0.0004149079031776637, [[32487, 0.146821, " with", false], [32234, 0.117647, " this", false], [4596, 0.074352, " in", false], [31277, 0.052209, " less", false], [31466, 0.049385, " much", false], [332, 0.043766, " a", false], [22590, 0.042992, " the", false], [22190, 0.036107, " now", false], [31458, 0.033763, " more", false], [32227, 0.03188, " that", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 2197, "byte_end": 2200, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 379, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "3.05% 3.05% 3.05%", "model_b": "6.29% 6.29% 6.29%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.6046222448348999]], "model_b": [[4450, " by", "normal", 0.3499545454978943]]}, "loss": {"model_a": 3.052577397714278, "model_b": 6.293005712210972}, "topk": {"model_a": [4450, 1, 0.6046222448348999, [[4450, 0.604622, " by", false], [332, 0.071658, " a", false], [57263, 0.049368, " somewhat", false], [21700, 0.036908, " for", false], [57245, 0.025594, " slightly", false], [51018, 0.024588, " because", false], [40076, 0.024008, " until", false], [47, 0.023905, ".", false], [21265, 0.02015, " and", false], [37598, 0.012601, " about", false]]], "model_b": [4450, 1, 0.3499545454978943, [[4450, 0.349955, " by", false], [332, 0.08109, " a", false], [21700, 0.079952, " for", false], [40076, 0.073053, " until", false], [47, 0.051827, ".", false], [4811, 0.032457, " to", false], [21265, 0.031238, " and", false], [4596, 0.029526, " in", false], [57263, 0.0249, " somewhat", false], [45, 0.016473, ",", false]]]}, "raw_delta": -0.17968749999999997, "tuned_delta": -0.12683255610180016}, {"byte_start": 2200, "byte_end": 2202, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 380, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "11.62% 11.62%", "model_b": "17.47% 17.47%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.2733345031738281]], "model_b": [[332, " a", "normal", 0.1437380462884903]]}, "loss": {"model_a": 11.623275475912058, "model_b": 17.47013526076479}, "topk": {"model_a": [332, 1, 0.2733345031738281, [[332, 0.273335, " a", false], [37598, 0.163303, " about", false], [52869, 0.090072, " several", false], [22590, 0.058603, " the", false], [3483, 0.032514, " 10", false], [22638, 0.031864, " two", false], [31370, 0.030215, " many", false], [31458, 0.026873, " more", false], [32074, 0.019449, " some", false], [30869, 0.018279, " five", false]]], "model_b": [332, 2, 0.1437380462884903, [[22590, 0.297971, " the", false], [332, 0.143738, " a", false], [51396, 0.058055, " decades", false], [37598, 0.031181, " about", false], [31458, 0.028781, " more", false], [52869, 0.022096, " several", false], [40237, 0.019516, " years", false], [31370, 0.019008, " many", false], [22638, 0.01868, " two", false], [31601, 0.015907, " over", false]]]}, "raw_delta": -0.32421875, "tuned_delta": -0.27136380610180016}, {"byte_start": 2202, "byte_end": 2210, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 381, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"model_a": "13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95%", "model_b": "10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"model_a": [[51816, " further", "normal", 0.002088395180180669]], "model_b": [[51816, " further", "normal", 0.007771448232233524]]}, "loss": {"model_a": 13.947930571094469, "model_b": 10.918834537977993}, "topk": {"model_a": [51816, 14, 0.002088395180180669, [[21674, 0.401154, " few", false], [45674, 0.329602, " decade", false], [45602, 0.11188, " couple", false], [32512, 0.038871, " year", false], [62035, 0.022812, " generation", false], [45950, 0.013889, " factor", false], [21365, 0.012133, " bit", false], [46685, 0.007511, " number", false], [46454, 0.006821, " little", false], [31040, 0.003239, " half", false]]], "model_b": [51816, 13, 0.007771448232233524, [[45674, 0.384253, " decade", false], [21674, 0.192576, " few", false], [62035, 0.090725, " generation", false], [45602, 0.054211, " couple", false], [51158, 0.03168, " century", false], [21365, 0.014244, " bit", false], [32512, 0.013721, " year", false], [31323, 0.011277, " long", false], [46685, 0.010254, " number", false], [46454, 0.009832, " little", false]]]}, "raw_delta": 0.16796875, "tuned_delta": 0.22082369389819984}, {"byte_start": 2210, "byte_end": 2213, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 382, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"model_a": "20.57% 20.57% 20.57%", "model_b": "15.78% 15.78% 15.78%"}, "model_tokens": {"model_a": [[3493, " 20", "normal", 0.03232622146606445]], "model_b": [[3493, " 20", "normal", 0.07343742251396179]]}, "loss": {"model_a": 20.56967538767467, "model_b": 15.779477009723035}, "topk": {"model_a": [3493, 9, 0.03232622146606445, [[45674, 0.237946, " decade", false], [3483, 0.102525, " 10", false], [30869, 0.074982, " five", false], [22638, 0.054564, " two", false], [22583, 0.052025, " ten", false], [3488, 0.049272, " 15", false], [30905, 0.037443, " four", false], [39644, 0.03725, " seven", false], [3493, 0.032326, " 20", false], [39946, 0.030975, " three", false]]], "model_b": [3493, 2, 0.07343742251396179, [[45674, 0.332488, " decade", false], [3493, 0.073437, " 20", false], [3503, 0.06305, " 30", false], [3483, 0.051979, " 10", false], [3543, 0.039776, " 70", false], [3513, 0.036991, " 40", false], [3523, 0.035895, " 50", false], [22583, 0.024358, " ten", false], [3488, 0.023878, " 15", false], [22638, 0.023789, " two", false]]]}, "raw_delta": 0.265625, "tuned_delta": 0.31847994389819984}, {"byte_start": 2213, "byte_end": 2219, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 383, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"model_a": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14%", "model_b": "0.51% 0.51% 0.51% 0.51% 0.51% 0.51%"}, "model_tokens": {"model_a": [[40237, " years", "normal", 0.9537624716758728]], "model_b": [[40237, " years", "normal", 0.8429040312767029]]}, "loss": {"model_a": 0.14235577287417547, "model_b": 0.5107196800021965}, "topk": {"model_a": [40237, 1, 0.9537624716758728, [[40237, 0.953762, " years", false], [4715, 0.014782, " or", false], [46, 0.011682, "-", false], [44, 0.006092, "+", false], [49, 0.001893, "0", false], [4811, 0.001795, " to", false], [620, 0.001349, "00", false], [32512, 0.000838, " year", false], [46596, 0.000794, " months", false], [38, 0.000632, "%", false]]], "model_b": [40237, 1, 0.8429040312767029, [[40237, 0.842904, " years", false], [46, 0.048949, "-", false], [4715, 0.039465, " or", false], [4811, 0.026624, " to", false], [44, 0.02154, "+", false], [49, 0.004687, "0", false], [9815, 0.002466, "–", false], [32512, 0.002176, " year", false], [31709, 0.00204, " plus", false], [45, 0.001178, ",", false]]]}, "raw_delta": -0.02042643229166666, "tuned_delta": 0.032428511606533164}, {"byte_start": 2219, "byte_end": 2220, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.35%", "model_b": "9.37%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7437606453895569]], "model_b": [[47, ".", "normal", 0.5940296649932861]]}, "loss": {"model_a": 5.353751128298887, "model_b": 9.369064474523052}, "topk": {"model_a": [47, 1, 0.7437606453895569, [[47, 0.743761, ".", false], [45, 0.082853, ",", false], [4715, 0.042741, " or", false], [21265, 0.026759, " and", false], [51018, 0.016204, " because", false], [275, 0.013843, " (", false], [59, 0.013139, ":", false], [21572, 0.011861, " due", false], [4706, 0.00625, " of", false], [37634, 0.005491, " after", false]]], "model_b": [47, 1, 0.5940296649932861, [[47, 0.59403, ".", false], [45, 0.090487, ",", false], [4715, 0.053563, " or", false], [40076, 0.034775, " until", false], [21265, 0.031182, " and", false], [21572, 0.02804, " due", false], [275, 0.022606, " (", false], [51018, 0.019256, " because", false], [32465, 0.013423, " when", false], [37634, 0.009314, " after", false]]]}, "raw_delta": -0.22265625, "tuned_delta": -0.16980130610180016}, {"byte_start": 2220, "byte_end": 2223, "display": {"text": " En", "kind": "normal"}, "is_word": true, "word_id": 384, "word_key": " en", "bytes_hex": "20 45 6e", "compression": {"model_a": "63.49% 63.49% 63.49%", "model_b": "60.86% 60.86% 60.86%"}, "model_tokens": {"model_a": [[3785, " En", "normal", 2.6273775802110322e-05]], "model_b": [[3785, " En", "normal", 4.110014924663119e-05]]}, "loss": {"model_a": 63.49360987245698, "model_b": 60.86369703750314}, "topk": {"model_a": [3785, 822, 2.6273775802110322e-05, [[20996, 0.194399, " The", false], [3913, 0.133609, " In", false], [37451, 0.033058, " There", false], [261, 0.030011, "\n\n", false], [30032, 0.027889, " When", false], [28753, 0.026108, " Deep", false], [267, 0.024632, "  ", false], [29894, 0.024508, " This", false], [29059, 0.024433, " Here", false], [300, 0.022151, " A", false]]], "model_b": [3785, 716, 4.110014924663119e-05, [[3913, 0.168972, " In", false], [20996, 0.12202, " The", false], [3851, 0.107151, " Go", false], [267, 0.02962, "  ", false], [29894, 0.022398, " This", false], [3918, 0.021629, " It", false], [30032, 0.02022, " When", false], [37451, 0.019091, " There", false], [300, 0.018932, " A", false], [3642, 0.017813, " At", false]]]}, "raw_delta": 0.14583333333333348, "tuned_delta": 0.19868827723153332}, {"byte_start": 2223, "byte_end": 2226, "display": {"text": "orm", "kind": "normal"}, "is_word": true, "word_id": 385, "word_key": "orm", "bytes_hex": "6f 72 6d", "compression": {"model_a": "10.90% 10.90% 10.90%", "model_b": "21.79% 21.79% 21.79%"}, "model_tokens": {"model_a": [[8404, "orm", "normal", 0.1636972725391388]], "model_b": [[8404, "orm", "normal", 0.02686510607600212]]}, "loss": {"model_a": 10.89535317338019, "model_b": 21.79070634676038}, "topk": {"model_a": [8404, 2, 0.1636972725391388, [[26596, 0.452748, "ough", false], [8404, 0.163697, "orm", false], [35003, 0.117841, "light", false], [27567, 0.03702, "zyme", false], [39552, 0.031765, " route", false], [34698, 0.030725, "igmat", false], [40885, 0.030457, "abling", false], [9163, 0.009534, "zig", false], [26883, 0.009153, "rico", false], [7460, 0.008367, "emy", false]]], "model_b": [8404, 6, 0.02686510607600212, [[26883, 0.3439, "rico", false], [2356, 0.104485, "zo", false], [34698, 0.075443, "igmat", false], [46, 0.058524, "-", false], [7460, 0.028802, "emy", false], [8404, 0.026865, "orm", false], [112, 0.024956, "o", false], [35003, 0.021814, "light", false], [25758, 0.021072, "igma", false], [26596, 0.01688, "ough", false]]]}, "raw_delta": -0.6041666666666666, "tuned_delta": -0.5513117227684668}, {"byte_start": 2226, "byte_end": 2229, "display": {"text": "ous", "kind": "normal"}, "is_word": true, "word_id": 386, "word_key": "ous", "bytes_hex": "6f 75 73", "compression": {"model_a": "0.42% 0.42% 0.42%", "model_b": "0.64% 0.64% 0.64%"}, "model_tokens": {"model_a": [[8439, "ous", "normal", 0.9326043128967285]], "model_b": [[8439, "ous", "normal", 0.8984516859054565]]}, "loss": {"model_a": 0.41972939218571315, "model_b": 0.6369320147153829}, "topk": {"model_a": [8439, 1, 0.9326043128967285, [[8439, 0.932604, "ous", false], [35323, 0.066431, "ously", false], [27340, 0.00015, "uous", false], [2243, 0.000118, "us", false], [25902, 9.9e-05, "ious", false], [8435, 4.8e-05, "oul", false], [7933, 4.8e-05, "ity", false], [7450, 3.6e-05, "ely", false], [2102, 3.5e-05, "os", false], [8440, 3e-05, "out", false]]], "model_b": [8439, 1, 0.8984516859054565, [[8439, 0.898452, "ous", false], [35323, 0.097101, "ously", false], [34889, 0.0021, "ities", false], [26610, 0.000287, "oust", false], [7933, 0.000223, "ity", false], [116, 0.000218, "s", false], [2104, 0.000206, "ou", false], [8415, 0.000149, "ose", false], [2243, 9.7e-05, "us", false], [2102, 7.8e-05, "os", false]]]}, "raw_delta": -0.012044270833333334, "tuned_delta": 0.040810673064866486}, {"byte_start": 2229, "byte_end": 2237, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 387, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"model_a": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64%", "model_b": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91% 16.91% 16.91%"}, "model_tokens": {"model_a": [[52013, " initial", "normal", 0.0009623137884773314]], "model_b": [[52013, " initial", "normal", 0.0005470130708999932]]}, "loss": {"model_a": 15.638588822136223, "model_b": 16.90658251041754}, "topk": {"model_a": [52013, 66, 0.0009623137884773314, [[56950, 0.331239, " progress", false], [64423, 0.126566, " improvements", false], [51566, 0.036245, " efforts", false], [55465, 0.036221, " advances", false], [50897, 0.034089, " amounts", false], [63621, 0.030865, " improvement", false], [45829, 0.028776, " effort", false], [57103, 0.023368, " research", false], [45, 0.022004, ",", false], [47202, 0.017118, " search", false]]], "model_b": [52013, 103, 0.0005470130708999932, [[50897, 0.167788, " amounts", false], [55465, 0.109535, " advances", false], [45829, 0.063238, " effort", false], [56950, 0.061321, " progress", false], [51566, 0.060479, " efforts", false], [57103, 0.038806, " research", false], [64862, 0.037797, " computational", false], [64423, 0.032261, " improvements", false], [60406, 0.021763, " resources", false], [55809, 0.017081, " computer", false]]]}, "raw_delta": -0.0703125, "tuned_delta": -0.01745755610180018}, {"byte_start": 2237, "byte_end": 2245, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 388, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"model_a": "6.90% 6.90% 6.90% 6.90% 6.90% 6.90% 6.90% 6.90%", "model_b": "5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"model_a": [[51566, " efforts", "normal", 0.046972520649433136]], "model_b": [[51566, " efforts", "normal", 0.07790109515190125]]}, "loss": {"model_a": 6.903521191753828, "model_b": 5.741193644162623}, "topk": {"model_a": [51566, 5, 0.046972520649433136, [[56950, 0.343629, " progress", false], [62157, 0.133092, " investment", false], [63678, 0.087827, " investments", false], [53052, 0.071165, " success", false], [51566, 0.046973, " efforts", false], [57103, 0.043113, " research", false], [45829, 0.039016, " effort", false], [60587, 0.028184, " successes", false], [55465, 0.027802, " advances", false], [38575, 0.018011, " gains", false]]], "model_b": [51566, 4, 0.07790109515190125, [[55465, 0.102642, " advances", false], [56950, 0.100263, " progress", false], [45829, 0.097663, " effort", false], [51566, 0.077901, " efforts", false], [57103, 0.06897, " research", false], [62157, 0.063888, " investment", false], [38575, 0.048853, " gains", false], [61947, 0.045165, " enthusiasm", false], [63678, 0.037747, " investments", false], [64862, 0.019756, " computational", false]]]}, "raw_delta": 0.064453125, "tuned_delta": 0.11730806889819982}, {"byte_start": 2245, "byte_end": 2250, "display": {"text": " went", "kind": "normal"}, "is_word": true, "word_id": 389, "word_key": " went", "bytes_hex": "20 77 65 6e 74", "compression": {"model_a": "13.98% 13.98% 13.98% 13.98% 13.98%", "model_b": "19.27% 19.27% 19.27% 19.27% 19.27%"}, "model_tokens": {"model_a": [[32460, " went", "normal", 0.020899198949337006]], "model_b": [[32460, " went", "normal", 0.004818818066269159]]}, "loss": {"model_a": 13.976108208611832, "model_b": 19.273504061875997}, "topk": {"model_a": [32460, 9, 0.020899198949337006, [[4811, 0.237796, " to", false], [32462, 0.224705, " were", false], [4596, 0.096955, " in", false], [4450, 0.064416, " by", false], [4424, 0.058863, " at", false], [51770, 0.036334, " focused", false], [4712, 0.023021, " on", false], [45, 0.022696, ",", false], [32460, 0.020899, " went", false], [37810, 0.017758, " based", false]]], "model_b": [32460, 18, 0.004818818066269159, [[32462, 0.291657, " were", false], [4811, 0.273431, " to", false], [4596, 0.091051, " in", false], [4450, 0.059213, " by", false], [45, 0.02661, ",", false], [4424, 0.023108, " at", false], [21795, 0.019218, " had", false], [51770, 0.017275, " focused", false], [4712, 0.016932, " on", false], [32227, 0.009843, " that", false]]]}, "raw_delta": -0.29375000000000007, "tuned_delta": -0.24089505610180023}, {"byte_start": 2250, "byte_end": 2255, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 390, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"model_a": "0.55% 0.55% 0.55% 0.55% 0.55%", "model_b": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"model_a": [[31162, " into", "normal", 0.8601644039154053]], "model_b": [[31162, " into", "normal", 0.824995756149292]]}, "loss": {"model_a": 0.5459417268988996, "model_b": 0.6973965285547234}, "topk": {"model_a": [31162, 1, 0.8601644039154053, [[31162, 0.860164, " into", false], [4811, 0.075848, " to", false], [47585, 0.02569, " toward", false], [4596, 0.015513, " in", false], [53169, 0.011535, " towards", false], [4712, 0.002807, " on", false], [56003, 0.000718, " directly", false], [52028, 0.000529, " instead", false], [45, 0.000518, ",", false], [38543, 0.000493, " forth", false]]], "model_b": [31162, 1, 0.824995756149292, [[31162, 0.824996, " into", false], [4811, 0.080152, " to", false], [47585, 0.04737, " toward", false], [53169, 0.02292, " towards", false], [37634, 0.004733, " after", false], [4596, 0.004642, " in", false], [4712, 0.002392, " on", false], [45302, 0.000819, " beyond", false], [56003, 0.000788, " directly", false], [4450, 0.000686, " by", false]]]}, "raw_delta": -0.008398437500000001, "tuned_delta": 0.04445650639819982}, {"byte_start": 2255, "byte_end": 2264, "display": {"text": " avoiding", "kind": "normal"}, "is_word": true, "word_id": 391, "word_key": " avoiding", "bytes_hex": "20 61 76 6f 69 64 69 6e 67", "compression": {"model_a": "19.29% 19.29% 19.29% 19.29% 19.29% 19.29% 19.29% 19.29% 19.29%", "model_b": "18.66% 18.66% 18.66% 18.66% 18.66% 18.66% 18.66% 18.66% 18.66%"}, "model_tokens": {"model_a": [[55586, " avoiding", "normal", 6.820954877184704e-05]], "model_b": [[55586, " avoiding", "normal", 8.848893776303157e-05]]}, "loss": {"model_a": 19.286027456328153, "model_b": 18.6598577337201}, "topk": {"model_a": [55586, 617, 6.820954877184704e-05, [[52224, 0.109243, " methods", false], [22590, 0.080172, " the", false], [61857, 0.077266, " developing", false], [38720, 0.063262, " human", false], [47202, 0.027701, " search", false], [55882, 0.026596, " creating", false], [47629, 0.024944, " trying", false], [55666, 0.023747, " building", false], [59832, 0.019443, " improving", false], [57103, 0.01843, " research", false]]], "model_b": [55586, 707, 8.848893776303157e-05, [[61857, 0.070464, " developing", false], [22590, 0.053191, " the", false], [30597, 0.04802, " deep", false], [52224, 0.034547, " methods", false], [47202, 0.03135, " search", false], [332, 0.030546, " a", false], [55666, 0.03052, " building", false], [60463, 0.026458, " searching", false], [59832, 0.024467, " improving", false], [51746, 0.024054, " finding", false]]]}, "raw_delta": 0.0347222222222221, "tuned_delta": 0.08757716612042192}, {"byte_start": 2264, "byte_end": 2271, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 392, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.21% 7.21% 7.21% 7.21% 7.21% 7.21% 7.21%", "model_b": "11.43% 11.43% 11.43% 11.43% 11.43% 11.43% 11.43%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.05990307405591011]], "model_b": [[47202, " search", "normal", 0.011659345589578152]]}, "loss": {"model_a": 7.205424450868429, "model_b": 11.432070078472808}, "topk": {"model_a": [47202, 3, 0.05990307405591011, [[22590, 0.363314, " the", false], [37920, 0.171771, " brute", false], [47202, 0.059903, " search", false], [38720, 0.030309, " human", false], [30597, 0.027414, " deep", false], [332, 0.020735, " a", false], [4404, 0.0148, " ``", false], [63370, 0.00994, " computation", false], [21273, 0.007938, " any", false], [51832, 0.0078, " general", false]]], "model_b": [47202, 9, 0.011659345589578152, [[22590, 0.329557, " the", false], [37920, 0.043191, " brute", false], [38720, 0.041353, " human", false], [30597, 0.040075, " deep", false], [332, 0.038384, " a", false], [51832, 0.0316, " general", false], [4404, 0.020033, " ``", false], [65135, 0.01581, " generalization", false], [47202, 0.011659, " search", false], [32234, 0.010131, " this", false]]]}, "raw_delta": -0.23437499999999997, "tuned_delta": -0.18152005610180016}, {"byte_start": 2271, "byte_end": 2274, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 393, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "14.28% 14.28% 14.28%", "model_b": "16.81% 16.81% 16.81%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.09386609494686127]], "model_b": [[4450, " by", "normal", 0.061145003885030746]]}, "loss": {"model_a": 14.276669675463697, "model_b": 16.812657052026328}, "topk": {"model_a": [4450, 3, 0.09386609494686127, [[45, 0.205587, ",", false], [21265, 0.120165, " and", false], [4450, 0.093866, " by", false], [61566, 0.079639, " altogether", false], [46, 0.078035, "-", false], [47, 0.063316, ".", false], [52224, 0.051303, " methods", false], [4596, 0.033076, " in", false], [4424, 0.032295, " at", false], [56131, 0.029959, " entirely", false]]], "model_b": [4450, 4, 0.061145003885030746, [[46, 0.337535, "-", false], [45, 0.106264, ",", false], [21265, 0.068668, " and", false], [4450, 0.061145, " by", false], [52224, 0.05129, " methods", false], [4596, 0.05024, " in", false], [37810, 0.020702, " based", false], [61559, 0.018526, " algorithms", false], [47, 0.01845, ".", false], [62581, 0.017435, " strategies", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08777005610180018}, {"byte_start": 2274, "byte_end": 2281, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 394, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"model_a": "14.57% 14.57% 14.57% 14.57% 14.57% 14.57% 14.57%", "model_b": "14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25%"}, "model_tokens": {"model_a": [[47497, " taking", "normal", 0.003462399123236537]], "model_b": [[47497, " taking", "normal", 0.003944364842027426]]}, "loss": {"model_a": 14.571863973264641, "model_b": 14.249833830209065}, "topk": {"model_a": [47497, 52, 0.003462399123236537, [[40085, 0.082163, " using", false], [38720, 0.076843, " human", false], [38888, 0.047545, " lever", false], [31044, 0.04487, " hand", false], [46227, 0.031016, " humans", false], [38989, 0.027069, " means", false], [61857, 0.024385, " developing", false], [61984, 0.021108, " exploiting", false], [56537, 0.020513, " learning", false], [47629, 0.019095, " trying", false]]], "model_b": [47497, 38, 0.003944364842027426, [[37920, 0.156618, " brute", false], [30597, 0.065576, " deep", false], [38720, 0.051642, " human", false], [332, 0.030006, " a", false], [46227, 0.027536, " humans", false], [22590, 0.024722, " the", false], [31044, 0.019228, " hand", false], [38888, 0.018142, " lever", false], [40085, 0.017994, " using", false], [52167, 0.011705, " machine", false]]]}, "raw_delta": 0.017857142857142905, "tuned_delta": 0.07071208675534273}, {"byte_start": 2281, "byte_end": 2291, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 395, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"model_a": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "model_b": "1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15%"}, "model_tokens": {"model_a": [[59093, " advantage", "normal", 0.7435867786407471]], "model_b": [[59093, " advantage", "normal", 0.5287151336669922]]}, "loss": {"model_a": 0.5353751128298887, "model_b": 1.1482387288325249}, "topk": {"model_a": [59093, 1, 0.7435867786407471, [[59093, 0.743587, " advantage", false], [38720, 0.048959, " human", false], [332, 0.031887, " a", false], [22590, 0.024873, " the", false], [31044, 0.010123, " hand", false], [45929, 0.005852, " expert", false], [4419, 0.00574, " an", false], [30923, 0.004843, " full", false], [46227, 0.004628, " humans", false], [31162, 0.004046, " into", false]]], "model_b": [59093, 1, 0.5287151336669922, [[59093, 0.528715, " advantage", false], [332, 0.091275, " a", false], [22590, 0.059881, " the", false], [31162, 0.033416, " into", false], [4419, 0.018123, " an", false], [38720, 0.016447, " human", false], [63649, 0.014946, " inspiration", false], [30923, 0.014078, " full", false], [4596, 0.007176, " in", false], [31601, 0.006583, " over", false]]]}, "raw_delta": -0.033984375000000004, "tuned_delta": 0.018870568898199817}, {"byte_start": 2291, "byte_end": 2294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 396, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.03% 0.03% 0.03%", "model_b": "0.03% 0.03% 0.03%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9947741627693176]], "model_b": [[4706, " of", "normal", 0.9951691031455994]]}, "loss": {"model_a": 0.03155308367829662, "model_b": 0.02898480942541201}, "topk": {"model_a": [4706, 1, 0.9947741627693176, [[4706, 0.994774, " of", false], [38720, 0.001486, " human", false], [45, 0.001225, ",", false], [52028, 0.000407, " instead", false], [22590, 0.000232, " the", false], [275, 0.000226, " (", false], [4596, 0.000171, " in", false], [31581, 0.000149, " only", false], [4423, 7.6e-05, " as", false], [21265, 5.6e-05, " and", false]]], "model_b": [4706, 1, 0.9951691031455994, [[4706, 0.995169, " of", false], [45, 0.000652, ",", false], [22590, 0.000373, " the", false], [22187, 0.000361, " not", false], [11, 0.000255, "\n", false], [31581, 0.000214, " only", false], [275, 0.000199, " (", false], [52028, 0.000126, " instead", false], [332, 0.000118, " a", false], [4596, 0.000112, " in", false]]]}, "raw_delta": 0.00014241536458333348, "tuned_delta": 0.05299735926278316}, {"byte_start": 2294, "byte_end": 2300, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 397, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "model_b": "5.64% 5.64% 5.64% 5.64% 5.64% 5.64%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.4173719584941864]], "model_b": [[38720, " human", "normal", 0.15226154029369354]]}, "loss": {"model_a": 2.618172152654938, "model_b": 5.635527503472513}, "topk": {"model_a": [38720, 1, 0.4173719584941864, [[38720, 0.417372, " human", false], [22590, 0.184514, " the", false], [52964, 0.037001, " special", false], [59943, 0.032043, " knowledge", false], [59792, 0.017825, " heuristic", false], [332, 0.015341, " a", false], [45775, 0.014989, " domain", false], [51832, 0.013362, " general", false], [31044, 0.012728, " hand", false], [46227, 0.011162, " humans", false]]], "model_b": [38720, 2, 0.15226154029369354, [[22590, 0.330378, " the", false], [38720, 0.152262, " human", false], [30597, 0.040464, " deep", false], [332, 0.033449, " a", false], [51832, 0.024299, " general", false], [59943, 0.017375, " knowledge", false], [38864, 0.008585, " large", false], [52195, 0.008372, " massive", false], [4404, 0.007833, " ``", false], [52964, 0.007329, " special", false]]]}, "raw_delta": -0.16731770833333334, "tuned_delta": -0.11446276443513352}, {"byte_start": 2300, "byte_end": 2310, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 398, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32%", "model_b": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.4794679284095764]], "model_b": [[59943, " knowledge", "normal", 0.54017174243927]]}, "loss": {"model_a": 1.3173045539366997, "model_b": 1.120061091315162}, "topk": {"model_a": [59943, 1, 0.4794679284095764, [[59943, 0.479468, " knowledge", false], [65034, 0.169094, " understanding", false], [59683, 0.047853, " expertise", false], [46, 0.041428, "-", false], [38786, 0.032535, " input", false], [59917, 0.030823, " intuition", false], [52022, 0.013833, " insight", false], [38013, 0.008111, " chess", false], [31702, 0.007905, " play", false], [62418, 0.006792, " psychology", false]]], "model_b": [59943, 1, 0.54017174243927, [[59943, 0.540172, " knowledge", false], [65034, 0.107301, " understanding", false], [59917, 0.057916, " intuition", false], [46, 0.03869, "-", false], [59683, 0.021656, " expertise", false], [38786, 0.02138, " input", false], [59304, 0.008801, " cognition", false], [52022, 0.007899, " insight", false], [56537, 0.007199, " learning", false], [46543, 0.006641, " memory", false]]]}, "raw_delta": 0.010937499999999994, "tuned_delta": 0.06379244389819981}, {"byte_start": 2310, "byte_end": 2311, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "36.91%", "model_b": "31.98%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1284930408000946]], "model_b": [[45, ",", "normal", 0.17178332805633545]]}, "loss": {"model_a": 36.91270514774496, "model_b": 31.98161858220651}, "topk": {"model_a": [45, 3, 0.1284930408000946, [[4706, 0.488144, " of", false], [47, 0.164439, ".", false], [45, 0.128493, ",", false], [37598, 0.062634, " about", false], [21265, 0.056146, " and", false], [4596, 0.025345, " in", false], [275, 0.018066, " (", false], [4811, 0.009671, " to", false], [60, 0.007168, ";", false], [59, 0.003624, ":", false]]], "model_b": [45, 2, 0.17178332805633545, [[4706, 0.416088, " of", false], [45, 0.171783, ",", false], [47, 0.139266, ".", false], [37598, 0.060687, " about", false], [21265, 0.038148, " and", false], [4596, 0.035517, " in", false], [32227, 0.022164, " that", false], [275, 0.02161, " (", false], [4811, 0.015766, " to", false], [4715, 0.00583, " or", false]]]}, "raw_delta": 0.2734375, "tuned_delta": 0.32629244389819984}, {"byte_start": 2311, "byte_end": 2314, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 399, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "29.68% 29.68% 29.68%", "model_b": "30.81% 30.81% 30.81%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.007184943184256554]], "model_b": [[4715, " or", "normal", 0.005786491557955742]]}, "loss": {"model_a": 29.6804448516219, "model_b": 30.8075503523164}, "topk": {"model_a": [4715, 15, 0.007184943184256554, [[21400, 0.381282, " but", false], [21265, 0.189607, " and", false], [32139, 0.031424, " such", false], [59841, 0.021942, " including", false], [32487, 0.021907, " with", false], [40186, 0.018878, " which", false], [4596, 0.017954, " in", false], [4423, 0.017325, " as", false], [61953, 0.010099, " especially", false], [31581, 0.009887, " only", false]]], "model_b": [4715, 17, 0.005786491557955742, [[21400, 0.368968, " but", false], [21265, 0.233122, " and", false], [32139, 0.028534, " such", false], [40186, 0.021187, " which", false], [32487, 0.019557, " with", false], [31581, 0.017497, " only", false], [4423, 0.016224, " as", false], [4596, 0.012355, " in", false], [59841, 0.011591, " including", false], [32230, 0.008683, " then", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 2314, "byte_end": 2317, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 400, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "16.91% 16.91% 16.91%", "model_b": "27.99% 27.99% 27.99%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.05976875498890877]], "model_b": [[4706, " of", "normal", 0.009619863703846931]]}, "loss": {"model_a": 16.90658251041754, "model_b": 27.989786600580146}, "topk": {"model_a": [4706, 3, 0.05976875498890877, [[4450, 0.195898, " by", false], [4424, 0.074449, " at", false], [4706, 0.059769, " of", false], [4404, 0.045314, " ``", false], [30788, 0.039335, " even", false], [4596, 0.026464, " in", false], [31458, 0.025246, " more", false], [59943, 0.023925, " knowledge", false], [45, 0.022975, ",", false], [40085, 0.022758, " using", false]]], "model_b": [4706, 19, 0.009619863703846931, [[4424, 0.123093, " at", false], [4404, 0.100145, " ``", false], [4450, 0.047387, " by", false], [4596, 0.036918, " in", false], [40085, 0.026705, " using", false], [4811, 0.026208, " to", false], [22590, 0.026179, " the", false], [45, 0.025227, ",", false], [30788, 0.023474, " even", false], [47001, 0.020251, " rather", false]]]}, "raw_delta": -0.6145833333333333, "tuned_delta": -0.5617283894351335}, {"byte_start": 2317, "byte_end": 2321, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 401, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99%", "model_b": "11.20% 11.20% 11.20% 11.20%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.08757662773132324]], "model_b": [[22590, " the", "normal", 0.08394689857959747]]}, "loss": {"model_a": 10.9892786317714, "model_b": 11.20061091315162}, "topk": {"model_a": [22590, 1, 0.08757662773132324, [[22590, 0.087577, " the", false], [38720, 0.067338, " human", false], [59792, 0.044686, " heuristic", false], [59943, 0.039669, " knowledge", false], [31044, 0.039512, " hand", false], [4404, 0.034781, " ``", false], [39193, 0.034321, " other", false], [332, 0.021453, " a", false], [32074, 0.018961, " some", false], [52964, 0.013585, " special", false]]], "model_b": [22590, 1, 0.08394689857959747, [[22590, 0.083947, " the", false], [38720, 0.059603, " human", false], [38888, 0.033236, " lever", false], [32074, 0.031592, " some", false], [332, 0.029139, " a", false], [40085, 0.02844, " using", false], [51832, 0.027074, " general", false], [39193, 0.026366, " other", false], [4404, 0.026155, " ``", false], [59792, 0.019354, " heuristic", false]]]}, "raw_delta": -0.01171875, "tuned_delta": 0.04113619389819982}, {"byte_start": 2321, "byte_end": 2329, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 402, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57%", "model_b": "8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 0.08480515331029892]], "model_b": [[52964, " special", "normal", 0.018890444189310074]]}, "loss": {"model_a": 5.565083409679106, "model_b": 8.946399911762613}, "topk": {"model_a": [52964, 2, 0.08480515331029892, [[60572, 0.127585, " structure", false], [52964, 0.084805, " special", false], [38720, 0.059464, " human", false], [30808, 0.028467, " fact", false], [62293, 0.026341, " particular", false], [4404, 0.021674, " ``", false], [30941, 0.019235, " game", false], [39558, 0.013855, " rules", false], [57271, 0.012155, " specific", false], [47484, 0.011488, " symmet", false]]], "model_b": [52964, 6, 0.018890444189310074, [[38720, 0.074861, " human", false], [30808, 0.061963, " fact", false], [59943, 0.038544, " knowledge", false], [4404, 0.032579, " ``", false], [50836, 0.023995, " ability", false], [52964, 0.01889, " special", false], [60572, 0.018285, " structure", false], [51832, 0.014813, " general", false], [52140, 0.013101, " limited", false], [45775, 0.012998, " domain", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13464505610180016}, {"byte_start": 2329, "byte_end": 2338, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 403, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"model_a": "9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08%", "model_b": "10.02% 10.02% 10.02% 10.02% 10.02% 10.02% 10.02% 10.02% 10.02%"}, "model_tokens": {"model_a": [[56215, " features", "normal", 0.010999530553817749]], "model_b": [[56215, " features", "normal", 0.006747689563781023]]}, "loss": {"model_a": 9.079460977816826, "model_b": 10.01871556172891}, "topk": {"model_a": [56215, 6, 0.010999530553817749, [[60572, 0.671288, " structure", false], [46642, 0.031629, " nature", false], [62404, 0.031195, " properties", false], [62586, 0.019539, " structures", false], [65258, 0.012082, " characteristics", false], [56215, 0.011, " features", false], [56353, 0.009929, " hardware", false], [39558, 0.007128, " rules", false], [39654, 0.007115, " shape", false], [56310, 0.006932, " geometry", false]]], "model_b": [56215, 11, 0.006747689563781023, [[60572, 0.509633, " structure", false], [62586, 0.041015, " structures", false], [62404, 0.028188, " properties", false], [56353, 0.026383, " hardware", false], [46642, 0.01031, " nature", false], [45, 0.010182, ",", false], [38720, 0.00882, " human", false], [64254, 0.008013, " architecture", false], [64862, 0.007527, " computational", false], [39558, 0.007154, " rules", false]]]}, "raw_delta": -0.05208333333333337, "tuned_delta": 0.0007716105648664512}, {"byte_start": 2338, "byte_end": 2341, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 404, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.18% 0.18% 0.18%", "model_b": "0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9708913564682007]], "model_b": [[4706, " of", "normal", 0.933143138885498]]}, "loss": {"model_a": 0.17757781977087866, "model_b": 0.41385905103626264}, "topk": {"model_a": [4706, 1, 0.9708913564682007, [[4706, 0.970891, " of", false], [32227, 0.007583, " that", false], [21265, 0.004214, " and", false], [4596, 0.003079, " in", false], [275, 0.002844, " (", false], [45, 0.00093, ",", false], [4715, 0.000526, " or", false], [47660, 0.0005, " unique", false], [32139, 0.000356, " such", false], [56454, 0.00035, " inherent", false]]], "model_b": [4706, 1, 0.933143138885498, [[4706, 0.933143, " of", false], [32227, 0.032942, " that", false], [21265, 0.004068, " and", false], [56454, 0.002734, " inherent", false], [4596, 0.001954, " in", false], [275, 0.001933, " (", false], [45, 0.001351, ",", false], [38547, 0.001173, " found", false], [56976, 0.001054, " provided", false], [61603, 0.000927, " associated", false]]]}, "raw_delta": -0.013102213541666666, "tuned_delta": 0.03975273035653316}, {"byte_start": 2341, "byte_end": 2345, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 405, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "3.75% 3.75% 3.75% 3.75%", "model_b": "6.23% 6.23% 6.23% 6.23%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.4325893223285675]], "model_b": [[22590, " the", "normal", 0.2557132840156555]]}, "loss": {"model_a": 3.7511479944988912, "model_b": 6.234302300716467}, "topk": {"model_a": [22590, 1, 0.4325893223285675, [[22590, 0.432589, " the", false], [3851, 0.235731, " Go", false], [37876, 0.062621, " board", false], [332, 0.024545, " a", false], [62293, 0.018514, " particular", false], [30941, 0.017006, " game", false], [52491, 0.013592, " playing", false], [38576, 0.01121, " games", false], [51161, 0.007022, " certain", false], [32234, 0.006821, " this", false]]], "model_b": [22590, 2, 0.2557132840156555, [[3851, 0.422084, " Go", false], [22590, 0.255713, " the", false], [38720, 0.044242, " human", false], [332, 0.020954, " a", false], [55809, 0.015471, " computer", false], [38013, 0.013238, " chess", false], [30941, 0.00934, " game", false], [3609, 0.009025, " AI", false], [38576, 0.008324, " games", false], [52491, 0.006604, " playing", false]]]}, "raw_delta": -0.1376953125, "tuned_delta": -0.08484036860180018}, {"byte_start": 2345, "byte_end": 2350, "display": {"text": " game", "kind": "normal"}, "is_word": true, "word_id": 406, "word_key": " game", "bytes_hex": "20 67 61 6d 65", "compression": {"model_a": "3.78% 3.78% 3.78% 3.78% 3.78%", "model_b": "6.51% 6.51% 6.51% 6.51% 6.51%"}, "model_tokens": {"model_a": [[30941, " game", "normal", 0.3533889651298523]], "model_b": [[30941, " game", "normal", 0.1638253927230835]]}, "loss": {"model_a": 3.7758034273265837, "model_b": 6.509034266510753}, "topk": {"model_a": [30941, 1, 0.3533889651298523, [[30941, 0.353389, " game", false], [37876, 0.270152, " board", false], [3851, 0.135271, " Go", false], [62293, 0.021198, " particular", false], [45775, 0.016289, " domain", false], [22638, 0.007942, " two", false], [52569, 0.007173, " problem", false], [52491, 0.006801, " playing", false], [38720, 0.006326, " human", false], [39558, 0.006011, " rules", false]]], "model_b": [30941, 2, 0.1638253927230835, [[3851, 0.368264, " Go", false], [30941, 0.163825, " game", false], [38720, 0.075582, " human", false], [37876, 0.026966, " board", false], [45775, 0.026289, " domain", false], [55809, 0.014095, " computer", false], [39558, 0.013146, " rules", false], [52569, 0.012838, " problem", false], [3609, 0.012653, " AI", false], [60572, 0.007137, " structure", false]]]}, "raw_delta": -0.15156250000000002, "tuned_delta": -0.0987075561018002}, {"byte_start": 2350, "byte_end": 2351, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "29.45%", "model_b": "34.24%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.19347816705703735]], "model_b": [[45, ",", "normal", 0.14918695390224457]]}, "loss": {"model_a": 29.445631205643878, "model_b": 34.23582958359552}, "topk": {"model_a": [45, 2, 0.19347816705703735, [[47, 0.356938, ".", false], [45, 0.193478, ",", false], [4706, 0.09627, " of", false], [275, 0.070143, " (", false], [32139, 0.035664, " such", false], [32227, 0.031594, " that", false], [460, 0.030245, "'s", false], [60572, 0.024385, " structure", false], [46342, 0.022294, " itself", false], [37876, 0.010796, " board", false]]], "model_b": [45, 3, 0.14918695390224457, [[47, 0.29402, ".", false], [32227, 0.194866, " that", false], [45, 0.149187, ",", false], [275, 0.050714, " (", false], [46342, 0.038213, " itself", false], [32139, 0.034616, " such", false], [4596, 0.026667, " in", false], [4706, 0.019196, " of", false], [460, 0.01334, "'s", false], [21265, 0.013309, " and", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21277005610180016}, {"byte_start": 2351, "byte_end": 2355, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 407, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "5.81% 5.81% 5.81% 5.81%", "model_b": "8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.2766144275665283]], "model_b": [[21400, " but", "normal", 0.15923331677913666]]}, "loss": {"model_a": 5.811637737956029, "model_b": 8.24195897382855}, "topk": {"model_a": [21400, 1, 0.2766144275665283, [[21400, 0.276614, " but", false], [32139, 0.202373, " such", false], [4715, 0.142192, " or", false], [21265, 0.107633, " and", false], [31296, 0.028154, " like", false], [4596, 0.025608, " in", false], [4811, 0.015871, " to", false], [59841, 0.015543, " including", false], [4423, 0.012479, " as", false], [47001, 0.011773, " rather", false]]], "model_b": [21400, 2, 0.15923331677913666, [[32139, 0.24349, " such", false], [21400, 0.159233, " but", false], [4715, 0.140316, " or", false], [21265, 0.104814, " and", false], [31296, 0.032689, " like", false], [4596, 0.030812, " in", false], [4811, 0.025501, " to", false], [21700, 0.019704, " for", false], [59841, 0.018894, " including", false], [40186, 0.017688, " which", false]]]}, "raw_delta": -0.134765625, "tuned_delta": -0.08191068110180018}, {"byte_start": 2355, "byte_end": 2359, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 408, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"model_a": "18.32% 18.32% 18.32% 18.32%", "model_b": "21.98% 21.98% 21.98% 21.98%"}, "model_tokens": {"model_a": [[21256, " all", "normal", 0.017056068405508995]], "model_b": [[21256, " all", "normal", 0.007687249220907688]]}, "loss": {"model_a": 18.315464386285665, "model_b": 21.9785572635428}, "topk": {"model_a": [21256, 12, 0.017056068405508995, [[39936, 0.166694, " these", false], [22590, 0.096323, " the", false], [32465, 0.087044, " when", false], [32234, 0.072538, " this", false], [4596, 0.059055, " in", false], [4601, 0.037027, " it", false], [4423, 0.02839, " as", false], [32232, 0.027402, " they", false], [32230, 0.021441, " then", false], [61959, 0.019798, " eventually", false]]], "model_b": [21256, 27, 0.007687249220907688, [[39936, 0.158511, " these", false], [22590, 0.138224, " the", false], [4596, 0.061076, " in", false], [32232, 0.05306, " they", false], [32234, 0.051613, " this", false], [4601, 0.035748, " it", false], [32465, 0.021199, " when", false], [61959, 0.01928, " eventually", false], [4450, 0.017778, " by", false], [45, 0.016728, ",", false]]]}, "raw_delta": -0.203125, "tuned_delta": -0.15027005610180016}, {"byte_start": 2359, "byte_end": 2365, "display": {"text": " those", "kind": "normal"}, "is_word": true, "word_id": 409, "word_key": " those", "bytes_hex": "20 74 68 6f 73 65", "compression": {"model_a": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "model_b": "11.18% 11.18% 11.18% 11.18% 11.18% 11.18%"}, "model_tokens": {"model_a": [[39944, " those", "normal", 0.030141286551952362]], "model_b": [[39944, " those", "normal", 0.024385707452893257]]}, "loss": {"model_a": 10.566614069010962, "model_b": 11.177129548553816}, "topk": {"model_a": [39944, 9, 0.030141286551952362, [[4706, 0.250124, " of", false], [39936, 0.159733, " these", false], [32139, 0.077698, " such", false], [45953, 0.072466, " failed", false], [32234, 0.066598, " this", false], [32462, 0.061453, " were", false], [32227, 0.044146, " that", false], [22590, 0.036933, " the", false], [39944, 0.030141, " those", false], [46936, 0.024968, " proved", false]]], "model_b": [39944, 8, 0.024385707452893257, [[4706, 0.391057, " of", false], [39936, 0.121978, " these", false], [32462, 0.043188, " were", false], [22590, 0.039964, " the", false], [45953, 0.03895, " failed", false], [32227, 0.036748, " that", false], [32234, 0.032114, " this", false], [39944, 0.024386, " those", false], [4596, 0.021288, " in", false], [51566, 0.016201, " efforts", false]]]}, "raw_delta": -0.03385416666666663, "tuned_delta": 0.019000777231533192}, {"byte_start": 2365, "byte_end": 2373, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 410, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"model_a": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "model_b": "1.98% 1.98% 1.98% 1.98% 1.98% 1.98% 1.98% 1.98%"}, "model_tokens": {"model_a": [[51566, " efforts", "normal", 0.5074682831764221]], "model_b": [[51566, " efforts", "normal", 0.417220801115036]]}, "loss": {"model_a": 1.514548016558238, "model_b": 1.9812401379395552}, "topk": {"model_a": [51566, 1, 0.5074682831764221, [[51566, 0.507468, " efforts", false], [52224, 0.117665, " methods", false], [61590, 0.078472, " approaches", false], [38720, 0.023063, " human", false], [55572, 0.019791, " attempts", false], [32462, 0.018326, " were", false], [38328, 0.011677, " early", false], [22762, 0.010225, " who", false], [45953, 0.00944, " failed", false], [32227, 0.00718, " that", false]]], "model_b": [51566, 1, 0.417220801115036, [[51566, 0.417221, " efforts", false], [52224, 0.148015, " methods", false], [61590, 0.129351, " approaches", false], [55572, 0.01946, " attempts", false], [32227, 0.011117, " that", false], [32462, 0.01084, " were", false], [62581, 0.010276, " strategies", false], [38720, 0.009271, " human", false], [38328, 0.007715, " early", false], [62633, 0.006557, " techniques", false]]]}, "raw_delta": -0.02587890625, "tuned_delta": 0.02697603764819982}, {"byte_start": 2373, "byte_end": 2380, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 411, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"model_a": "6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48%", "model_b": "8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57%"}, "model_tokens": {"model_a": [[46936, " proved", "normal", 0.07995548844337463]], "model_b": [[46936, " proved", "normal", 0.03583824262022972]]}, "loss": {"model_a": 6.48085662899339, "model_b": 8.574052558854607}, "topk": {"model_a": [46936, 3, 0.07995548844337463, [[32462, 0.355696, " were", false], [45953, 0.147377, " failed", false], [46936, 0.079955, " proved", false], [62676, 0.043323, " ultimately", false], [30383, 0.025952, " came", false], [21532, 0.022537, " did", false], [38367, 0.020028, " ended", false], [61959, 0.01987, " eventually", false], [32460, 0.014106, " went", false], [31059, 0.013414, " have", false]]], "model_b": [46936, 5, 0.03583824262022972, [[32462, 0.312913, " were", false], [45953, 0.10896, " failed", false], [38367, 0.049087, " ended", false], [21532, 0.039142, " did", false], [46936, 0.035838, " proved", false], [62676, 0.035355, " ultimately", false], [61959, 0.031672, " eventually", false], [21795, 0.028001, " had", false], [30383, 0.025305, " came", false], [47638, 0.022014, " turned", false]]]}, "raw_delta": -0.11607142857142858, "tuned_delta": -0.06321648467322875}, {"byte_start": 2380, "byte_end": 2391, "display": {"text": " irrelevant", "kind": "normal"}, "is_word": true, "word_id": 412, "word_key": " irrelevant", "bytes_hex": "20 69 72 72 65 6c 65 76 61 6e 74", "compression": {"model_a": "8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35%", "model_b": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%"}, "model_tokens": {"model_a": [[62161, " irrelevant", "normal", 0.006078746169805527]], "model_b": [[62161, " irrelevant", "normal", 0.0018604384968057275]]}, "loss": {"model_a": 8.350827118781995, "model_b": 10.297645710890684}, "topk": {"model_a": [62161, 23, 0.006078746169805527, [[4811, 0.193784, " to", false], [62676, 0.104622, " ultimately", false], [62088, 0.069425, " inadequate", false], [63631, 0.058628, " ineffective", false], [21719, 0.058389, " fut", false], [64450, 0.042278, " insufficient", false], [31277, 0.038941, " less", false], [64616, 0.02663, " unsuccessful", false], [38562, 0.021994, " fruit", false], [47650, 0.01836, " unable", false]]], "model_b": [62161, 50, 0.0018604384968057275, [[21719, 0.217937, " fut", false], [4811, 0.208306, " to", false], [63631, 0.085355, " ineffective", false], [52094, 0.035362, " largely", false], [38562, 0.032151, " fruit", false], [64616, 0.030708, " unsuccessful", false], [53247, 0.021536, " useless", false], [4596, 0.019549, " in", false], [62676, 0.016705, " ultimately", false], [51336, 0.0167, " counter", false]]]}, "raw_delta": -0.10795454545454543, "tuned_delta": -0.055099601556345607}, {"byte_start": 2391, "byte_end": 2392, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "63.96%", "model_b": "52.69%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.02906819060444832]], "model_b": [[45, ",", "normal", 0.054435063153505325]]}, "loss": {"model_a": 63.96323716441302, "model_b": 52.692182157468}, "topk": {"model_a": [45, 7, 0.02906819060444832, [[32465, 0.277863, " when", false], [4811, 0.182514, " to", false], [4596, 0.152418, " in", false], [47, 0.127229, ".", false], [4423, 0.066178, " as", false], [31578, 0.037939, " once", false], [45, 0.029068, ",", false], [55794, 0.016874, " compared", false], [21265, 0.015047, " and", false], [51018, 0.011938, " because", false]]], "model_b": [45, 6, 0.054435063153505325, [[47, 0.291627, ".", false], [4596, 0.170779, " in", false], [4811, 0.096937, " to", false], [32465, 0.089005, " when", false], [4423, 0.063866, " as", false], [45, 0.054435, ",", false], [51018, 0.030622, " because", false], [4450, 0.023351, " by", false], [31601, 0.021036, " over", false], [31578, 0.020003, " once", false]]]}, "raw_delta": 0.625, "tuned_delta": 0.6778549438981998}, {"byte_start": 2392, "byte_end": 2395, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 413, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "18.97% 18.97% 18.97%", "model_b": "22.54% 22.54% 22.54%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.042305782437324524]], "model_b": [[4715, " or", "normal", 0.02376241609454155]]}, "loss": {"model_a": 18.972942595024126, "model_b": 22.542110013890053}, "topk": {"model_a": [4715, 5, 0.042305782437324524, [[21265, 0.32769, " and", false], [4423, 0.135105, " as", false], [51018, 0.067449, " because", false], [4596, 0.053281, " in", false], [4715, 0.042306, " or", false], [32465, 0.04056, " when", false], [40187, 0.033892, " while", false], [31578, 0.020258, " once", false], [39690, 0.019332, " since", false], [32487, 0.015702, " with", false]]], "model_b": [4715, 5, 0.02376241609454155, [[21265, 0.344623, " and", false], [4423, 0.164551, " as", false], [51018, 0.08261, " because", false], [39690, 0.041976, " since", false], [4715, 0.023762, " or", false], [4596, 0.02143, " in", false], [4424, 0.020421, " at", false], [45913, 0.017453, " except", false], [32487, 0.017307, " with", false], [30788, 0.015625, " even", false]]]}, "raw_delta": -0.19791666666666674, "tuned_delta": -0.1450617227684669}, {"byte_start": 2395, "byte_end": 2401, "display": {"text": " worse", "kind": "normal"}, "is_word": true, "word_id": 414, "word_key": " worse", "bytes_hex": "20 77 6f 72 73 65", "compression": {"model_a": "7.65% 7.65% 7.65% 7.65% 7.65% 7.65%", "model_b": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"model_a": [[40216, " worse", "normal", 0.07876795530319214]], "model_b": [[40216, " worse", "normal", 0.03381677716970444]]}, "loss": {"model_a": 7.654924858883497, "model_b": 10.190912235446126}, "topk": {"model_a": [40216, 2, 0.07876795530319214, [[4424, 0.364148, " at", false], [40216, 0.078768, " worse", false], [30788, 0.052791, " even", false], [31581, 0.028107, " only", false], [31277, 0.020633, " less", false], [22187, 0.015001, " not", false], [62161, 0.014878, " irrelevant", false], [63631, 0.013968, " ineffective", false], [22614, 0.013547, " too", false], [51336, 0.010361, " counter", false]]], "model_b": [40216, 4, 0.03381677716970444, [[4424, 0.274657, " at", false], [32462, 0.064129, " were", false], [30788, 0.056245, " even", false], [40216, 0.033817, " worse", false], [63631, 0.025439, " ineffective", false], [47001, 0.022559, " rather", false], [22614, 0.019177, " too", false], [51336, 0.0174, " counter", false], [47285, 0.016938, " simply", false], [31581, 0.015761, " only", false]]]}, "raw_delta": -0.14062499999999997, "tuned_delta": -0.08777005610180015}, {"byte_start": 2401, "byte_end": 2402, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.63%", "model_b": "6.94%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.817914605140686]], "model_b": [[45, ",", "normal", 0.6771745681762695]]}, "loss": {"model_a": 3.62787083036043, "model_b": 6.938743238650531}, "topk": {"model_a": [45, 1, 0.817914605140686, [[45, 0.817915, ",", false], [47, 0.135256, ".", false], [32226, 0.008731, " than", false], [59, 0.005737, ":", false], [275, 0.003944, " (", false], [39820, 0.003645, " still", false], [4596, 0.002625, " in", false], [22797, 0.001886, " yet", false], [32465, 0.001794, " when", false], [62161, 0.001486, " irrelevant", false]]], "model_b": [45, 1, 0.6771745681762695, [[45, 0.677175, ",", false], [47, 0.238099, ".", false], [32226, 0.011396, " than", false], [4596, 0.008628, " in", false], [59, 0.007243, ":", false], [51018, 0.003273, " because", false], [22797, 0.002788, " yet", false], [32462, 0.002525, " were", false], [275, 0.002242, " (", false], [4811, 0.002116, " to", false]]]}, "raw_delta": -0.18359375, "tuned_delta": -0.13073880610180016}, {"byte_start": 2402, "byte_end": 2407, "display": {"text": " once", "kind": "normal"}, "is_word": true, "word_id": 415, "word_key": " once", "bytes_hex": "20 6f 6e 63 65", "compression": {"model_a": "11.05% 11.05% 11.05% 11.05% 11.05%", "model_b": "30.88% 30.88% 30.88% 30.88% 30.88%"}, "model_tokens": {"model_a": [[31578, " once", "normal", 0.04680713266134262]], "model_b": [[31578, " once", "normal", 0.00018784687563311309]]}, "loss": {"model_a": 11.045633906806126, "model_b": 30.88269071902937}, "topk": {"model_a": [31578, 5, 0.04680713266134262, [[32465, 0.449328, " when", false], [4596, 0.120948, " in", false], [4423, 0.113755, " as", false], [4811, 0.113299, " to", false], [31578, 0.046807, " once", false], [51018, 0.013608, " because", false], [37634, 0.011977, " after", false], [22590, 0.009124, " the", false], [21265, 0.00582, " and", false], [4424, 0.00492, " at", false]]], "model_b": [31578, 384, 0.00018784687563311309, [[51336, 0.130673, " counter", false], [4596, 0.068859, " in", false], [32462, 0.053354, " were", false], [4811, 0.047091, " to", false], [4423, 0.027701, " as", false], [32465, 0.025287, " when", false], [45953, 0.025079, " failed", false], [32232, 0.024462, " they", false], [51018, 0.023732, " because", false], [47768, 0.019458, " wasted", false]]]}, "raw_delta": -1.0999999999999999, "tuned_delta": -1.0471450561018}, {"byte_start": 2407, "byte_end": 2414, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 416, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17%", "model_b": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.061495181173086166]], "model_b": [[47202, " search", "normal", 0.014682039618492126]]}, "loss": {"model_a": 7.165170682986479, "model_b": 10.868517328125558}, "topk": {"model_a": [47202, 4, 0.061495181173086166, [[22590, 0.253577, " the", false], [332, 0.096527, " a", false], [51832, 0.083636, " general", false], [47202, 0.061495, " search", false], [30597, 0.045817, " deep", false], [52224, 0.028162, " methods", false], [52195, 0.024438, " massive", false], [63370, 0.020693, " computation", false], [4601, 0.020411, " it", false], [59345, 0.015016, " computers", false]]], "model_b": [47202, 11, 0.014682039618492126, [[22590, 0.356844, " the", false], [332, 0.075028, " a", false], [51832, 0.047769, " general", false], [32232, 0.040599, " they", false], [3851, 0.034147, " Go", false], [52224, 0.024601, " methods", false], [38720, 0.020885, " human", false], [4601, 0.020826, " it", false], [37635, 0.017766, " again", false], [31458, 0.015574, " more", false]]]}, "raw_delta": -0.20535714285714282, "tuned_delta": -0.152502198958943}, {"byte_start": 2414, "byte_end": 2418, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 417, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "8.45% 8.45% 8.45% 8.45%", "model_b": "9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.15219539403915405]], "model_b": [[22748, " was", "normal", 0.12929710745811462]]}, "loss": {"model_a": 8.45329125520877, "model_b": 9.157732193142833}, "topk": {"model_a": [22748, 3, 0.15219539403915405, [[45283, 0.236366, " became", false], [46, 0.153231, "-", false], [22748, 0.152195, " was", false], [52224, 0.093136, " methods", false], [21795, 0.033279, " had", false], [21265, 0.014711, " and", false], [32487, 0.014573, " with", false], [61559, 0.013327, " algorithms", false], [62633, 0.012905, " techniques", false], [37810, 0.012044, " based", false]]], "model_b": [22748, 4, 0.12929710745811462, [[52224, 0.228456, " methods", false], [46, 0.168477, "-", false], [45283, 0.139786, " became", false], [22748, 0.129297, " was", false], [4450, 0.035286, " by", false], [62633, 0.022648, " techniques", false], [21795, 0.018626, " had", false], [61559, 0.013917, " algorithms", false], [37828, 0.013818, " began", false], [21265, 0.012167, " and", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.013792443898199822}, {"byte_start": 2418, "byte_end": 2426, "display": {"text": " applied", "kind": "normal"}, "is_word": true, "word_id": 418, "word_key": " applied", "bytes_hex": "20 61 70 70 6c 69 65 64", "compression": {"model_a": "6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09%", "model_b": "10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07%"}, "model_tokens": {"model_a": [[50937, " applied", "normal", 0.06760700047016144]], "model_b": [[50937, " applied", "normal", 0.01146637462079525]]}, "loss": {"model_a": 6.093414113129654, "model_b": 10.073505412457116}, "topk": {"model_a": [50937, 3, 0.06760700047016144, [[59206, 0.087078, " available", false], [31351, 0.080367, " made", false], [50937, 0.067607, " applied", false], [32354, 0.032771, " used", false], [59506, 0.028604, " developed", false], [51744, 0.02755, " finally", false], [51097, 0.026204, " brought", false], [22590, 0.025432, " the", false], [64583, 0.025269, " sufficiently", false], [63616, 0.020609, " implemented", false]]], "model_b": [50937, 20, 0.01146637462079525, [[59206, 0.080118, " available", false], [63616, 0.057095, " implemented", false], [31351, 0.056977, " made", false], [38547, 0.038804, " found", false], [59506, 0.036311, " developed", false], [61885, 0.030819, " discovered", false], [63594, 0.028288, " generalized", false], [62151, 0.021501, " introduced", false], [39887, 0.020598, " taken", false], [4692, 0.016344, " no", false]]]}, "raw_delta": -0.220703125, "tuned_delta": -0.16784818110180016}, {"byte_start": 2426, "byte_end": 2438, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 419, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"model_a": "8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50%", "model_b": "7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37%"}, "model_tokens": {"model_a": [[63507, " effectively", "normal", 0.003408447140827775]], "model_b": [[63507, " effectively", "normal", 0.0071459985338151455]]}, "loss": {"model_a": 8.500253984404374, "model_b": 7.373148483709871}, "topk": {"model_a": [63507, 22, 0.003408447140827775, [[47, 0.43855, ".", false], [4811, 0.161787, " to", false], [4596, 0.085154, " in", false], [21265, 0.042884, " and", false], [45, 0.035811, ",", false], [4712, 0.030048, " on", false], [4517, 0.020354, " en", false], [32487, 0.018491, " with", false], [4424, 0.017752, " at", false], [4423, 0.015177, " as", false]]], "model_b": [63507, 16, 0.0071459985338151455, [[47, 0.390005, ".", false], [4811, 0.177595, " to", false], [4596, 0.08703, " in", false], [45, 0.043771, ",", false], [31458, 0.024753, " more", false], [32487, 0.020716, " with", false], [4450, 0.019521, " by", false], [4423, 0.017603, " as", false], [21265, 0.017332, " and", false], [4712, 0.016528, " on", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 2438, "byte_end": 2441, "display": {"text": " at", "kind": "normal"}, "is_word": true, "word_id": 420, "word_key": " at", "bytes_hex": "20 61 74", "compression": {"model_a": "32.12% 32.12% 32.12%", "model_b": "29.49% 29.49% 29.49%"}, "model_tokens": {"model_a": [[4424, " at", "normal", 0.004785093944519758]], "model_b": [[4424, " at", "normal", 0.00744384853169322]]}, "loss": {"model_a": 32.122506769793326, "model_b": 29.492593934839483}, "topk": {"model_a": [4424, 11, 0.004785093944519758, [[47, 0.566376, ".", false], [4811, 0.223827, " to", false], [21265, 0.057329, " and", false], [45, 0.038662, ",", false], [4596, 0.027702, " in", false], [275, 0.011519, " (", false], [4450, 0.010911, " by", false], [4712, 0.009293, " on", false], [32487, 0.008872, " with", false], [40085, 0.006443, " using", false]]], "model_b": [4424, 13, 0.00744384853169322, [[47, 0.49816, ".", false], [4811, 0.124317, " to", false], [4450, 0.094539, " by", false], [45, 0.050663, ",", false], [4596, 0.043042, " in", false], [21265, 0.026952, " and", false], [45865, 0.024021, " enough", false], [4712, 0.01952, " on", false], [32487, 0.018999, " with", false], [4423, 0.010442, " as", false]]]}, "raw_delta": 0.14583333333333326, "tuned_delta": 0.1986882772315331}, {"byte_start": 2441, "byte_end": 2447, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 421, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"model_a": "5.26% 5.26% 5.26% 5.26% 5.26% 5.26%", "model_b": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"model_a": [[39590, " scale", "normal", 0.17481854557991028]], "model_b": [[39590, " scale", "normal", 0.09567037969827652]]}, "loss": {"model_a": 5.259825669907679, "model_b": 7.0913721085362456}, "topk": {"model_a": [39590, 3, 0.17481854557991028, [[332, 0.198232, " a", false], [22590, 0.190199, " the", false], [39590, 0.174819, " scale", false], [38864, 0.088783, " large", false], [21256, 0.036157, " all", false], [52195, 0.032227, " massive", false], [4419, 0.027902, " an", false], [62606, 0.016145, " sufficient", false], [62431, 0.013205, " reasonable", false], [31082, 0.010543, " high", false]]], "model_b": [39590, 3, 0.09567037969827652, [[22590, 0.279557, " the", false], [332, 0.180007, " a", false], [39590, 0.09567, " scale", false], [21256, 0.092636, " all", false], [32074, 0.028531, " some", false], [38864, 0.028169, " large", false], [21273, 0.021292, " any", false], [4419, 0.017475, " an", false], [64583, 0.013406, " sufficiently", false], [62431, 0.009643, " reasonable", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 2447, "byte_end": 2448, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "3.56%", "model_b": "4.02%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8200810551643372]], "model_b": [[47, ".", "normal", 0.7990453243255615]]}, "loss": {"model_a": 3.557426736567024, "model_b": 4.015313346224166}, "topk": {"model_a": [47, 1, 0.8200810551643372, [[47, 0.820081, ".", false], [45, 0.043111, ",", false], [4811, 0.041318, " to", false], [21265, 0.028015, " and", false], [275, 0.013228, " (", false], [4596, 0.008781, " in", false], [4450, 0.007929, " by", false], [40085, 0.007204, " using", false], [32487, 0.006512, " with", false], [4712, 0.002872, " on", false]]], "model_b": [47, 1, 0.7990453243255615, [[47, 0.799045, ".", false], [45, 0.05539, ",", false], [21265, 0.028102, " and", false], [4811, 0.019751, " to", false], [4596, 0.016284, " in", false], [4450, 0.013485, " by", false], [275, 0.011514, " (", false], [32487, 0.007818, " with", false], [4712, 0.005536, " on", false], [40085, 0.004766, " using", false]]]}, "raw_delta": -0.025390625, "tuned_delta": 0.02746431889819982}, {"byte_start": 2448, "byte_end": 2453, "display": {"text": " Also", "kind": "normal"}, "is_word": true, "word_id": 422, "word_key": " also", "bytes_hex": "20 41 6c 73 6f", "compression": {"model_a": "27.39% 27.39% 27.39% 27.39% 27.39%", "model_b": "26.60% 26.60% 26.60% 26.60% 26.60%"}, "model_tokens": {"model_a": [[28402, " Also", "normal", 0.000499704503454268]], "model_b": [[28402, " Also", "normal", 0.0006224684184417129]]}, "loss": {"model_a": 27.38866366687641, "model_b": 26.599689816390264}, "topk": {"model_a": [28402, 110, 0.000499704503454268, [[261, 0.298872, "\n\n", false], [20996, 0.123689, " The", false], [3913, 0.036181, " In", false], [267, 0.032975, "  ", false], [29894, 0.028715, " This", false], [36251, 0.028461, " Again", false], [3918, 0.025146, " It", false], [300, 0.017857, " A", false], [29511, 0.016831, " Once", false], [37451, 0.016446, " There", false]]], "model_b": [28402, 125, 0.0006224684184417129, [[261, 0.132906, "\n\n", false], [20996, 0.132787, " The", false], [267, 0.052558, "  ", false], [3913, 0.051128, " In", false], [29894, 0.034048, " This", false], [3851, 0.026804, " Go", false], [3918, 0.024628, " It", false], [300, 0.019543, " A", false], [37453, 0.017719, " These", false], [19417, 0.016657, " And", false]]]}, "raw_delta": 0.043749999999999956, "tuned_delta": 0.09660494389819978}, {"byte_start": 2453, "byte_end": 2463, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 423, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"model_a": "14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99%", "model_b": "8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68%"}, "model_tokens": {"model_a": [[59829, " important", "normal", 0.00024038294213823974]], "model_b": [[59829, " important", "normal", 0.008188338950276375]]}, "loss": {"model_a": 14.990503159236885, "model_b": 8.67871235534767}, "topk": {"model_a": [59829, 116, 0.00024038294213823974, [[45, 0.422338, ",", false], [4596, 0.196018, " in", false], [31296, 0.078569, " like", false], [4423, 0.047365, " as", false], [4424, 0.02467, " at", false], [32487, 0.013517, " with", false], [51419, 0.011332, " delayed", false], [332, 0.011317, " a", false], [52906, 0.009428, " similar", false], [31077, 0.009052, " here", false]]], "model_b": [59829, 13, 0.008188338950276375, [[45, 0.494786, ",", false], [4596, 0.052715, " in", false], [31296, 0.041518, " like", false], [62161, 0.021246, " irrelevant", false], [4706, 0.014763, " of", false], [31578, 0.014092, " once", false], [31968, 0.010728, " seen", false], [38869, 0.010579, " later", false], [332, 0.010316, " a", false], [51960, 0.009938, " ignored", false]]]}, "raw_delta": 0.35000000000000003, "tuned_delta": 0.40285494389819987}, {"byte_start": 2463, "byte_end": 2467, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 424, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "7.64% 7.64% 7.64% 7.64%", "model_b": "5.46% 5.46% 5.46% 5.46%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.18366031348705292]], "model_b": [[22748, " was", "normal", 0.2994954288005829]]}, "loss": {"model_a": 7.643184176584596, "model_b": 5.459417268988997}, "topk": {"model_a": [22748, 2, 0.18366031348705292, [[4596, 0.242537, " in", false], [22748, 0.18366, " was", false], [31077, 0.129802, " here", false], [45, 0.110551, ",", false], [32462, 0.101758, " were", false], [4811, 0.081848, " to", false], [4600, 0.054336, " is", false], [21700, 0.021692, " for", false], [21286, 0.016028, " are", false], [21400, 0.007726, " but", false]]], "model_b": [22748, 1, 0.2994954288005829, [[22748, 0.299495, " was", false], [4811, 0.127262, " to", false], [4600, 0.119593, " is", false], [4596, 0.116492, " in", false], [45, 0.099248, ",", false], [32462, 0.059979, " were", false], [21700, 0.054562, " for", false], [31077, 0.030303, " here", false], [21286, 0.019811, " are", false], [4424, 0.012389, " at", false]]]}, "raw_delta": 0.12109375, "tuned_delta": 0.17394869389819984}, {"byte_start": 2467, "byte_end": 2471, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 425, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.37% 1.37% 1.37% 1.37%", "model_b": "1.85% 1.85% 1.85% 1.85%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.7396533489227295]], "model_b": [[22590, " the", "normal", 0.6630631685256958]]}, "loss": {"model_a": 1.373659828971425, "model_b": 1.8491574620769182}, "topk": {"model_a": [22590, 1, 0.7396533489227295, [[22590, 0.739653, " the", false], [332, 0.068729, " a", false], [32227, 0.057327, " that", false], [4419, 0.013847, " an", false], [32499, 0.006147, " work", false], [21835, 0.00568, " how", false], [57103, 0.005415, " research", false], [56950, 0.005397, " progress", false], [50919, 0.004085, " another", false], [38720, 0.003787, " human", false]]], "model_b": [22590, 1, 0.6630631685256958, [[22590, 0.663063, " the", false], [32227, 0.125759, " that", false], [332, 0.055063, " a", false], [4419, 0.01212, " an", false], [4811, 0.009522, " to", false], [22187, 0.005803, " not", false], [21835, 0.004968, " how", false], [32234, 0.004037, " this", false], [63822, 0.003851, " recognizing", false], [51746, 0.003391, " finding", false]]]}, "raw_delta": -0.0263671875, "tuned_delta": 0.02648775639819982}, {"byte_start": 2471, "byte_end": 2475, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 426, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "18.17% 18.17% 18.17% 18.17%", "model_b": "22.68% 22.68% 22.68% 22.68%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.017895683646202087]], "model_b": [[22681, " use", "normal", 0.006453223060816526]]}, "loss": {"model_a": 18.174576198698855, "model_b": 22.682998201476863}, "topk": {"model_a": [22681, 5, 0.017895683646202087, [[30808, 0.076886, " fact", false], [59544, 0.039034, " discovery", false], [63469, 0.036202, " development", false], [63820, 0.030885, " realization", false], [22681, 0.017896, " use", false], [63729, 0.014946, " observation", false], [51708, 0.014701, " failure", false], [59612, 0.013345, " emergence", false], [63821, 0.013257, " recognition", false], [52013, 0.01299, " initial", false]]], "model_b": [22681, 13, 0.006453223060816526, [[30808, 0.113714, " fact", false], [63820, 0.05192, " realization", false], [45294, 0.035361, " belief", false], [59544, 0.024251, " discovery", false], [63729, 0.01735, " observation", false], [63821, 0.01715, " recognition", false], [63469, 0.015737, " development", false], [51708, 0.015735, " failure", false], [57404, 0.012184, " tendency", false], [31135, 0.011158, " idea", false]]]}, "raw_delta": -0.25, "tuned_delta": -0.19714505610180016}, {"byte_start": 2475, "byte_end": 2478, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 427, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.24% 0.24% 0.24%", "model_b": "0.16% 0.16% 0.16%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9601859450340271]], "model_b": [[4706, " of", "normal", 0.9739702343940735]]}, "loss": {"model_a": 0.24361915770219716, "model_b": 0.15849921103516443}, "topk": {"model_a": [4706, 1, 0.9601859450340271, [[4706, 0.960186, " of", false], [45, 0.013908, ",", false], [4450, 0.009366, " by", false], [4596, 0.007208, " in", false], [275, 0.001272, " (", false], [4424, 0.000753, " at", false], [21265, 0.000689, " and", false], [31601, 0.000536, " over", false], [32227, 0.000328, " that", false], [21700, 0.000291, " for", false]]], "model_b": [4706, 1, 0.9739702343940735, [[4706, 0.97397, " of", false], [4450, 0.011903, " by", false], [45, 0.003109, ",", false], [4596, 0.00234, " in", false], [32227, 0.001168, " that", false], [31351, 0.001086, " made", false], [21265, 0.000781, " and", false], [4811, 0.000622, " to", false], [275, 0.000448, " (", false], [21700, 0.000281, " for", false]]]}, "raw_delta": 0.004720052083333334, "tuned_delta": 0.05757499598153316}, {"byte_start": 2478, "byte_end": 2487, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 428, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%", "model_b": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.0025880855973809958]], "model_b": [[56537, " learning", "normal", 0.003542921971529722]]}, "loss": {"model_a": 11.95984170181389, "model_b": 11.333671979205832}, "topk": {"model_a": [56537, 55, 0.0025880855973809958, [[38720, 0.063247, " human", false], [332, 0.051261, " a", false], [46658, 0.046635, " neural", false], [22590, 0.042072, " the", false], [30597, 0.039506, " deep", false], [52195, 0.033947, " massive", false], [65003, 0.022989, " reinforcement", false], [59988, 0.022974, " massively", false], [52167, 0.019536, " machine", false], [56812, 0.017953, " parallel", false]]], "model_b": [56537, 38, 0.003542921971529722, [[38720, 0.140135, " human", false], [30597, 0.068231, " deep", false], [59792, 0.042151, " heuristic", false], [22590, 0.036876, " the", false], [332, 0.031428, " a", false], [51832, 0.028815, " general", false], [4404, 0.019399, " ``", false], [47202, 0.018442, " search", false], [3609, 0.017911, " AI", false], [52167, 0.017716, " machine", false]]]}, "raw_delta": 0.03472222222222221, "tuned_delta": 0.08757716612042203}, {"byte_start": 2487, "byte_end": 2490, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 429, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "20.85% 20.85% 20.85%", "model_b": "22.07% 22.07% 22.07%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.03101550228893757]], "model_b": [[4450, " by", "normal", 0.02558513544499874]]}, "loss": {"model_a": 20.851451762848296, "model_b": 22.07248272193401}, "topk": {"model_a": [4450, 8, 0.03101550228893757, [[4811, 0.170209, " to", false], [52224, 0.169493, " methods", false], [61559, 0.121447, " algorithms", false], [30917, 0.095079, " from", false], [45, 0.092623, ",", false], [46, 0.035423, "-", false], [62633, 0.031319, " techniques", false], [4450, 0.031016, " by", false], [21265, 0.023255, " and", false], [4596, 0.021238, " in", false]]], "model_b": [4450, 9, 0.02558513544499874, [[4811, 0.146963, " to", false], [61559, 0.112884, " algorithms", false], [46, 0.075809, "-", false], [52224, 0.068692, " methods", false], [45, 0.053224, ",", false], [4596, 0.051027, " in", false], [30917, 0.04963, " from", false], [62633, 0.044571, " techniques", false], [4450, 0.025585, " by", false], [4423, 0.025268, " as", false]]]}, "raw_delta": -0.06770833333333326, "tuned_delta": -0.014853389435133438}, {"byte_start": 2490, "byte_end": 2495, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 430, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"model_a": "16.57% 16.57% 16.57% 16.57% 16.57%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[31978, " self", "normal", 0.009957978501915932]], "model_b": [[31978, " self", "normal", 0.006662741769105196]]}, "loss": {"model_a": 16.568450860209186, "model_b": 18.03368801111204}, "topk": {"model_a": [31978, 15, 0.009957978501915932, [[65003, 0.191397, " reinforcement", false], [59815, 0.147939, " imitation", false], [30597, 0.071219, " deep", false], [51668, 0.050254, " example", false], [46658, 0.044844, " neural", false], [38720, 0.028988, " human", false], [30218, 0.025808, " back", false], [52491, 0.020132, " playing", false], [62557, 0.01997, " simulation", false], [64886, 0.016509, " demonstration", false]]], "model_b": [31978, 22, 0.006662741769105196, [[59815, 0.076912, " imitation", false], [46227, 0.062047, " humans", false], [40010, 0.061835, " trial", false], [52491, 0.048665, " playing", false], [38720, 0.04459, " human", false], [61979, 0.042451, " experience", false], [51668, 0.037955, " example", false], [65003, 0.034655, " reinforcement", false], [63729, 0.032149, " observation", false], [22590, 0.031917, " the", false]]]}, "raw_delta": -0.08125000000000004, "tuned_delta": -0.028395056101800223}, {"byte_start": 2495, "byte_end": 2500, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 431, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83% 11.83%", "model_b": "16.23% 16.23% 16.23% 16.23% 16.23%"}, "model_tokens": {"model_a": [[31702, " play", "normal", 0.03800477087497711]], "model_b": [[31702, " play", "normal", 0.011169259436428547]]}, "loss": {"model_a": 11.834607757292277, "model_b": 16.230319210000836}, "topk": {"model_a": [31702, 2, 0.03800477087497711, [[46, 0.941312, "-", false], [31702, 0.038005, " play", false], [26697, 0.010844, "play", false], [57453, 0.000973, " training", false], [52491, 0.000885, " playing", false], [63621, 0.000687, " improvement", false], [21265, 0.000544, " and", false], [4715, 0.00039, " or", false], [45, 0.000342, ",", false], [61793, 0.000308, " correction", false]]], "model_b": [31702, 3, 0.011169259436428547, [[46, 0.916271, "-", false], [26697, 0.020017, "play", false], [31702, 0.011169, " play", false], [63621, 0.007883, " improvement", false], [45, 0.004966, ",", false], [57453, 0.003257, " training", false], [47, 0.002916, ".", false], [52491, 0.002421, " playing", false], [61958, 0.001414, " evaluation", false], [56537, 0.001245, " learning", false]]]}, "raw_delta": -0.24375, "tuned_delta": -0.1908950561018002}, {"byte_start": 2500, "byte_end": 2503, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 432, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "11.69% 11.69% 11.69%", "model_b": "14.56% 14.56% 14.56%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.1415397822856903]], "model_b": [[4811, " to", "normal", 0.08752110600471497]]}, "loss": {"model_a": 11.693719569705465, "model_b": 14.558446050637324}, "topk": {"model_a": [4811, 2, 0.1415397822856903, [[45, 0.39722, ",", false], [4811, 0.14154, " to", false], [47, 0.126414, ".", false], [275, 0.042302, " (", false], [21265, 0.03218, " and", false], [4596, 0.027257, " in", false], [32487, 0.021702, " with", false], [4706, 0.020843, " of", false], [4712, 0.017068, " on", false], [59, 0.016175, ":", false]]], "model_b": [4811, 3, 0.08752110600471497, [[45, 0.352886, ",", false], [47, 0.152839, ".", false], [4811, 0.087521, " to", false], [4596, 0.061318, " in", false], [275, 0.043671, " (", false], [4706, 0.039374, " of", false], [21265, 0.035892, " and", false], [59, 0.021125, ":", false], [4712, 0.020903, " on", false], [50870, 0.020209, " against", false]]]}, "raw_delta": -0.15885416666666663, "tuned_delta": -0.10599922276846681}, {"byte_start": 2503, "byte_end": 2509, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 433, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"model_a": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "model_b": "10.85% 10.85% 10.85% 10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[38877, " learn", "normal", 0.02970532514154911]], "model_b": [[38877, " learn", "normal", 0.02700219675898552]]}, "loss": {"model_a": 10.566614069010962, "model_b": 10.848390444184586}, "topk": {"model_a": [38877, 2, 0.02970532514154911, [[51982, 0.156393, " improve", false], [38877, 0.029705, " learn", false], [40000, 0.02712, " train", false], [30858, 0.026678, " find", false], [51456, 0.026171, " develop", false], [56010, 0.025573, " discover", false], [37786, 0.021548, " avoid", false], [37923, 0.018305, " build", false], [31358, 0.017134, " make", false], [59771, 0.016011, " gradually", false]]], "model_b": [38877, 5, 0.02700219675898552, [[51982, 0.115712, " improve", false], [56791, 0.032878, " overcome", false], [31358, 0.030674, " make", false], [40000, 0.029158, " train", false], [38877, 0.027002, " learn", false], [37923, 0.024875, " build", false], [37786, 0.02256, " avoid", false], [51456, 0.02108, " develop", false], [47030, 0.018577, " reduce", false], [30938, 0.017609, " gain", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 2509, "byte_end": 2511, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 434, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "23.95% 23.95%", "model_b": "29.73% 29.73%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.06919506937265396]], "model_b": [[332, " a", "normal", 0.03741900250315666]]}, "loss": {"model_a": 23.95099188975818, "model_b": 29.727407580817506}, "topk": {"model_a": [332, 4, 0.06919506937265396, [[22590, 0.136374, " the", false], [4811, 0.125286, " to", false], [30917, 0.103793, " from", false], [332, 0.069195, " a", false], [21835, 0.062136, " how", false], [37598, 0.026206, " about", false], [47202, 0.025223, " search", false], [32464, 0.018529, " what", false], [51832, 0.015947, " general", false], [22168, 0.015177, " new", false]]], "model_b": [332, 6, 0.03741900250315666, [[22590, 0.153423, " the", false], [21835, 0.119948, " how", false], [30917, 0.081108, " from", false], [37598, 0.055786, " about", false], [4811, 0.051841, " to", false], [332, 0.037419, " a", false], [32464, 0.034885, " what", false], [62581, 0.021658, " strategies", false], [31458, 0.020069, " more", false], [38720, 0.019461, " human", false]]]}, "raw_delta": -0.3203125, "tuned_delta": -0.26745755610180016}, {"byte_start": 2511, "byte_end": 2517, "display": {"text": " value", "kind": "normal"}, "is_word": true, "word_id": 435, "word_key": " value", "bytes_hex": "20 76 61 6c 75 65", "compression": {"model_a": "16.34% 16.34% 16.34% 16.34% 16.34% 16.34%", "model_b": "21.70% 21.70% 21.70% 21.70% 21.70% 21.70%"}, "model_tokens": {"model_a": [[40093, " value", "normal", 0.004384035710245371]], "model_b": [[40093, " value", "normal", 0.0007248707115650177]]}, "loss": {"model_a": 16.343029760070287, "model_b": 21.696780888369172}, "topk": {"model_a": [40093, 33, 0.004384035710245371, [[51832, 0.073376, " general", false], [46857, 0.063685, " policy", false], [47202, 0.055546, " search", false], [30992, 0.047701, " good", false], [65161, 0.041892, " representation", false], [57317, 0.038562, " strategy", false], [30597, 0.037457, " deep", false], [39043, 0.031612, " model", false], [38864, 0.027655, " large", false], [45301, 0.02379, " better", false]]], "model_b": [40093, 165, 0.0007248707115650177, [[57317, 0.067435, " strategy", false], [51832, 0.044872, " general", false], [38720, 0.043453, " human", false], [22168, 0.038043, " new", false], [62483, 0.037019, " repertoire", false], [45301, 0.035218, " better", false], [30941, 0.034348, " game", false], [4404, 0.025406, " ``", false], [30992, 0.020266, " good", false], [31466, 0.017827, " much", false]]]}, "raw_delta": -0.296875, "tuned_delta": -0.24402005610180016}, {"byte_start": 2517, "byte_end": 2526, "display": {"text": " function", "kind": "normal"}, "is_word": true, "word_id": 436, "word_key": " function", "bytes_hex": "20 66 75 6e 63 74 69 6f 6e", "compression": {"model_a": "0.77% 0.77% 0.77% 0.77% 0.77% 0.77% 0.77% 0.77% 0.77%", "model_b": "1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06%"}, "model_tokens": {"model_a": [[56292, " function", "normal", 0.6790925860404968]], "model_b": [[56292, " function", "normal", 0.5843533873558044]]}, "loss": {"model_a": 0.7709714709611701, "model_b": 1.064488528433697}, "topk": {"model_a": [56292, 1, 0.6790925860404968, [[56292, 0.679093, " function", false], [21700, 0.054344, " for", false], [56149, 0.051269, " estimate", false], [46, 0.051204, "-", false], [4706, 0.024685, " of", false], [65161, 0.014392, " representation", false], [39043, 0.012356, " model", false], [61955, 0.007471, " estimation", false], [59793, 0.005654, " hierarchy", false], [64831, 0.005635, " approximation", false]]], "model_b": [56292, 1, 0.5843533873558044, [[56292, 0.584353, " function", false], [21700, 0.051106, " for", false], [64371, 0.041056, " distribution", false], [46, 0.038471, "-", false], [65161, 0.02862, " representation", false], [59793, 0.018943, " hierarchy", false], [47487, 0.018777, " system", false], [39043, 0.018136, " model", false], [60572, 0.017273, " structure", false], [4706, 0.013046, " of", false]]]}, "raw_delta": -0.01627604166666666, "tuned_delta": 0.036578902231533164}, {"byte_start": 2526, "byte_end": 2528, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "35.64% 35.64%", "model_b": "30.57% 30.57%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.019283566623926163]], "model_b": [[275, " (", "normal", 0.03355369716882706]]}, "loss": {"model_a": 35.64471145946364, "model_b": 30.572736706338382}, "topk": {"model_a": [275, 9, 0.019283566623926163, [[21700, 0.169628, " for", false], [45, 0.169504, ",", false], [32227, 0.168416, " that", false], [47, 0.083785, ".", false], [30917, 0.057111, " from", false], [4811, 0.051118, " to", false], [21265, 0.04593, " and", false], [4706, 0.044605, " of", false], [275, 0.019284, " (", false], [55536, 0.018563, " approxim", false]]], "model_b": [275, 8, 0.03355369716882706, [[32227, 0.242619, " that", false], [21700, 0.147878, " for", false], [45, 0.145897, ",", false], [47, 0.075668, ".", false], [4811, 0.050193, " to", false], [30917, 0.039797, " from", false], [21265, 0.039545, " and", false], [275, 0.033554, " (", false], [4596, 0.029122, " in", false], [4706, 0.018811, " of", false]]]}, "raw_delta": 0.28125, "tuned_delta": 0.33410494389819984}, {"byte_start": 2528, "byte_end": 2530, "display": {"text": "as", "kind": "normal"}, "is_word": true, "word_id": 437, "word_key": "as", "bytes_hex": "61 73", "compression": {"model_a": "30.57% 30.57%", "model_b": "36.63% 36.63%"}, "model_tokens": {"model_a": [[1751, "as", "normal", 0.0334651917219162]], "model_b": [[1751, "as", "normal", 0.017456352710723877]]}, "loss": {"model_a": 30.572736706338382, "model_b": 36.63092877257133}, "topk": {"model_a": [1751, 6, 0.0334651917219162, [[36003, 0.082153, "which", false], [2101, 0.073073, "or", false], [98, 0.05765, "a", false], [8801, 0.057546, "the", false], [7005, 0.044791, "and", false], [1751, 0.033465, "as", false], [7579, 0.032232, "for", false], [1950, 0.024929, "in", false], [2215, 0.024777, "to", false], [1746, 0.019411, "an", false]]], "model_b": [1751, 11, 0.017456352710723877, [[8801, 0.09797, "the", false], [98, 0.070307, "a", false], [2101, 0.068019, "or", false], [36003, 0.054511, "which", false], [106, 0.030739, "i", false], [7005, 0.030498, "and", false], [87, 0.025531, "V", false], [8695, 0.024865, "see", false], [1950, 0.024629, "in", false], [27142, 0.023172, "that", false]]]}, "raw_delta": -0.3359375, "tuned_delta": -0.28308255610180016}, {"byte_start": 2530, "byte_end": 2533, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 438, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "31.18% 31.18% 31.18%", "model_b": "27.99% 27.99% 27.99%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.005531010217964649]], "model_b": [[4601, " it", "normal", 0.009495694190263748]]}, "loss": {"model_a": 31.183252185881237, "model_b": 27.989786600580146}, "topk": {"model_a": [4601, 20, 0.005531010217964649, [[4596, 0.289191, " in", false], [52369, 0.22026, " opposed", false], [22748, 0.045509, " was", false], [332, 0.03625, " a", false], [32458, 0.03191, " well", false], [32487, 0.022574, " with", false], [4600, 0.01547, " is", false], [22590, 0.015353, " the", false], [21795, 0.015132, " had", false], [4419, 0.012379, " an", false]]], "model_b": [4601, 11, 0.009495694190263748, [[52369, 0.432471, " opposed", false], [4596, 0.200633, " in", false], [32487, 0.029501, " with", false], [32458, 0.018328, " well", false], [59546, 0.017136, " discussed", false], [332, 0.015749, " a", false], [32354, 0.015209, " used", false], [59488, 0.013216, " described", false], [22590, 0.010719, " the", false], [22748, 0.009662, " was", false]]]}, "raw_delta": 0.17708333333333348, "tuned_delta": 0.22993827723153332}, {"byte_start": 2533, "byte_end": 2537, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 439, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "6.73% 6.73% 6.73% 6.73%", "model_b": "7.33% 7.33% 7.33% 7.33%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.22459329664707184]], "model_b": [[22748, " was", "normal", 0.19946284592151642]]}, "loss": {"model_a": 6.727410957270312, "model_b": 7.326185754514267}, "topk": {"model_a": [22748, 1, 0.22459329664707184, [[22748, 0.224593, " was", false], [47638, 0.182939, " turned", false], [4600, 0.154301, " is", false], [32462, 0.118613, " were", false], [40040, 0.087781, " turns", false], [51896, 0.029593, " happens", false], [21795, 0.023825, " had", false], [40219, 0.01806, " would", false], [56348, 0.016823, " happened", false], [21800, 0.011359, " has", false]]], "model_b": [22748, 2, 0.19946284592151642, [[4600, 0.258128, " is", false], [22748, 0.199463, " was", false], [47638, 0.066204, " turned", false], [40219, 0.058771, " would", false], [40040, 0.053514, " turns", false], [32462, 0.043266, " were", false], [45283, 0.032811, " became", false], [21795, 0.029514, " had", false], [47266, 0.025758, " should", false], [21800, 0.02009, " has", false]]]}, "raw_delta": -0.033203125, "tuned_delta": 0.01965181889819982}, {"byte_start": 2537, "byte_end": 2540, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 440, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "24.23% 24.23% 24.23%", "model_b": "17.28% 17.28% 17.28%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.017858993262052536]], "model_b": [[4596, " in", "normal", 0.05652039125561714]]}, "loss": {"model_a": 24.232768264931806, "model_b": 17.282284343982372}, "topk": {"model_a": [4596, 10, 0.017858993262052536, [[45395, 0.282471, " called", false], [32230, 0.04923, " then", false], [38848, 0.041376, " known", false], [38869, 0.031014, " later", false], [30666, 0.029048, " done", false], [22187, 0.027166, " not", false], [62275, 0.025501, " originally", false], [52112, 0.01967, " learned", false], [62684, 0.018368, " understood", false], [4596, 0.017859, " in", false]]], "model_b": [4596, 4, 0.05652039125561714, [[45395, 0.366293, " called", false], [38848, 0.066298, " known", false], [32230, 0.058089, " then", false], [4596, 0.05652, " in", false], [47525, 0.048181, " termed", false], [30666, 0.035766, " done", false], [38869, 0.027089, " later", false], [21700, 0.020644, " for", false], [57053, 0.020468, " referred", false], [4811, 0.01997, " to", false]]]}, "raw_delta": 0.3854166666666667, "tuned_delta": 0.4382716105648665}, {"byte_start": 2540, "byte_end": 2545, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 441, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"model_a": "17.81% 17.81% 17.81% 17.81% 17.81%", "model_b": "17.70% 17.70% 17.70% 17.70% 17.70%"}, "model_tokens": {"model_a": [[31370, " many", "normal", 0.007079240400344133]], "model_b": [[31370, " many", "normal", 0.0073697203770279884]]}, "loss": {"model_a": 17.808266910973142, "model_b": 17.69555636090369}, "topk": {"model_a": [31370, 20, 0.007079240400344133, [[38013, 0.328695, " chess", false], [22590, 0.148687, " the", false], [3851, 0.080459, " Go", false], [55809, 0.039768, " computer", false], [36274, 0.031598, " Alpha", false], [30322, 0.022598, " both", false], [3492, 0.021164, " 19", false], [38720, 0.019494, " human", false], [36466, 0.019181, " Chess", false], [38328, 0.015466, " early", false]]], "model_b": [31370, 11, 0.0073697203770279884, [[3851, 0.326416, " Go", false], [22590, 0.107525, " the", false], [38013, 0.092976, " chess", false], [28753, 0.044442, " Deep", false], [38720, 0.042925, " human", false], [55809, 0.038097, " computer", false], [39193, 0.016904, " other", false], [3609, 0.014466, " AI", false], [30597, 0.008513, " deep", false], [47202, 0.008185, " search", false]]]}, "raw_delta": 0.006250000000000089, "tuned_delta": 0.05910494389819991}, {"byte_start": 2545, "byte_end": 2551, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 442, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "3.19% 3.19% 3.19% 3.19% 3.19% 3.19%", "model_b": "3.57% 3.57% 3.57% 3.57% 3.57% 3.57%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.34638914465904236]], "model_b": [[39193, " other", "normal", 0.30442193150520325]]}, "loss": {"model_a": 3.193465585301091, "model_b": 3.5691674188659244}, "topk": {"model_a": [39193, 1, 0.34638914465904236, [[39193, 0.346389, " other", false], [51551, 0.092391, " earlier", false], [4706, 0.07354, " of", false], [38328, 0.057158, " early", false], [51515, 0.042734, " domains", false], [38013, 0.028152, " chess", false], [55809, 0.027247, " computer", false], [3609, 0.024189, " AI", false], [38576, 0.024158, " games", false], [56926, 0.022924, " previous", false]]], "model_b": [39193, 1, 0.30442193150520325, [[39193, 0.304422, " other", false], [38576, 0.066986, " games", false], [3609, 0.04457, " AI", false], [4706, 0.038266, " of", false], [37970, 0.030744, " cases", false], [55809, 0.023647, " computer", false], [38720, 0.02271, " human", false], [47202, 0.021548, " search", false], [37738, 0.021134, " areas", false], [38328, 0.019662, " early", false]]]}, "raw_delta": -0.020833333333333315, "tuned_delta": 0.03202161056486651}, {"byte_start": 2551, "byte_end": 2557, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 443, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"model_a": "8.03% 8.03% 8.03% 8.03% 8.03% 8.03%", "model_b": "6.39% 6.39% 6.39% 6.39% 6.39% 6.39%"}, "model_tokens": {"model_a": [[38576, " games", "normal", 0.06916578859090805]], "model_b": [[38576, " games", "normal", 0.11949160695075989]]}, "loss": {"model_a": 8.030626692448331, "model_b": 6.386931170602182}, "topk": {"model_a": [38576, 4, 0.06916578859090805, [[51515, 0.493115, " domains", false], [3609, 0.083584, " AI", false], [37738, 0.078465, " areas", false], [38576, 0.069166, " games", false], [45976, 0.034355, " fields", false], [37970, 0.034298, " cases", false], [64251, 0.01622, " applications", false], [56939, 0.014302, " problems", false], [38328, 0.012653, " early", false], [55809, 0.012399, " computer", false]]], "model_b": [38576, 3, 0.11949160695075989, [[51515, 0.183152, " domains", false], [37738, 0.166471, " areas", false], [38576, 0.119492, " games", false], [45976, 0.087668, " fields", false], [3609, 0.080897, " AI", false], [55809, 0.021371, " computer", false], [30941, 0.018257, " game", false], [63481, 0.01668, " disciplines", false], [37970, 0.015147, " cases", false], [56939, 0.014307, " problems", false]]]}, "raw_delta": 0.09114583333333331, "tuned_delta": 0.14400077723153315}, {"byte_start": 2557, "byte_end": 2561, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 444, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "20.01% 20.01% 20.01% 20.01%", "model_b": "20.01% 20.01% 20.01% 20.01%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.012099945917725563]], "model_b": [[21265, " and", "normal", 0.012044657953083515]]}, "loss": {"model_a": 20.00612263732742, "model_b": 20.00612263732742}, "topk": {"model_a": [21265, 7, 0.012099945917725563, [[42, 0.276377, ")", false], [497, 0.231257, "),", false], [499, 0.173698, ").", false], [45, 0.116553, ",", false], [4423, 0.049054, " as", false], [4424, 0.015448, " at", false], [21265, 0.0121, " and", false], [4706, 0.00918, " of", false], [22614, 0.008848, " too", false], [32139, 0.008484, " such", false]]], "model_b": [21265, 6, 0.012044657953083515, [[42, 0.38861, ")", false], [497, 0.219285, "),", false], [499, 0.179689, ").", false], [45, 0.077856, ",", false], [32139, 0.022522, " such", false], [21265, 0.012045, " and", false], [31296, 0.010345, " like", false], [40185, 0.008957, " where", false], [4706, 0.008468, " of", false], [4424, 0.008024, " at", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 2561, "byte_end": 2566, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 445, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "18.15% 18.15% 18.15% 18.15% 18.15%", "model_b": "13.69% 13.69% 13.69% 13.69% 13.69%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.006624673958867788]], "model_b": [[30788, " even", "normal", 0.022639598697423935]]}, "loss": {"model_a": 18.146398561181492, "model_b": 13.694331833438206}, "topk": {"model_a": [30788, 20, 0.006624673958867788, [[51515, 0.365458, " domains", false], [4596, 0.119494, " in", false], [64251, 0.043412, " applications", false], [4423, 0.035278, " as", false], [39193, 0.02771, " other", false], [3609, 0.026046, " AI", false], [4811, 0.020319, " to", false], [56939, 0.012922, " problems", false], [31370, 0.01231, " many", false], [39898, 0.012151, " tasks", false]]], "model_b": [30788, 7, 0.022639598697423935, [[51515, 0.152644, " domains", false], [4596, 0.074931, " in", false], [3609, 0.043213, " AI", false], [31370, 0.042888, " many", false], [56939, 0.03156, " problems", false], [39898, 0.029813, " tasks", false], [30788, 0.02264, " even", false], [64251, 0.022457, " applications", false], [45, 0.020139, ",", false], [22187, 0.0182, " not", false]]]}, "raw_delta": 0.2468750000000001, "tuned_delta": 0.2997299438981999}, {"byte_start": 2566, "byte_end": 2569, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 446, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "4.48% 4.48% 4.48%", "model_b": "7.28% 7.28% 7.28%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.4736306667327881]], "model_b": [[4596, " in", "normal", 0.2976779341697693]]}, "loss": {"model_a": 4.484940638180208, "model_b": 7.279223025318662}, "topk": {"model_a": [4596, 1, 0.4736306667327881, [[4596, 0.473631, " in", false], [38013, 0.062208, " chess", false], [22184, 0.03612, " non", false], [31458, 0.034591, " more", false], [32074, 0.029234, " some", false], [4423, 0.018208, " as", false], [4811, 0.018066, " to", false], [52391, 0.010942, " outside", false], [22190, 0.010299, " now", false], [31370, 0.010171, " many", false]]], "model_b": [4596, 1, 0.2976779341697693, [[4596, 0.297678, " in", false], [32074, 0.082362, " some", false], [38013, 0.037263, " chess", false], [22590, 0.026765, " the", false], [31458, 0.026542, " more", false], [39193, 0.022111, " other", false], [21700, 0.018435, " for", false], [332, 0.017301, " a", false], [31370, 0.015684, " many", false], [4811, 0.014685, " to", false]]]}, "raw_delta": -0.15494791666666666, "tuned_delta": -0.10209297276846684}, {"byte_start": 2569, "byte_end": 2575, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 447, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "model_b": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.24172928929328918]], "model_b": [[38013, " chess", "normal", 0.062201086431741714]]}, "loss": {"model_a": 4.226645627604385, "model_b": 8.359365796817562}, "topk": {"model_a": [38013, 1, 0.24172928929328918, [[38013, 0.241729, " chess", false], [3851, 0.085215, " Go", false], [22590, 0.079574, " the", false], [55809, 0.04814, " computer", false], [32074, 0.043792, " some", false], [31370, 0.025823, " many", false], [38328, 0.019842, " early", false], [38720, 0.01704, " human", false], [39311, 0.016009, " poker", false], [47202, 0.015788, " search", false]]], "model_b": [38013, 3, 0.062201086431741714, [[32074, 0.106671, " some", false], [22590, 0.077265, " the", false], [38013, 0.062201, " chess", false], [38720, 0.059492, " human", false], [46227, 0.041409, " humans", false], [31370, 0.032722, " many", false], [39193, 0.029234, " other", false], [65003, 0.026938, " reinforcement", false], [332, 0.021406, " a", false], [52299, 0.017447, " natural", false]]]}, "raw_delta": -0.2291666666666667, "tuned_delta": -0.1763117227684669}, {"byte_start": 2575, "byte_end": 2576, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "43.68%", "model_b": "57.20%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.08948458731174469]], "model_b": [[45, ",", "normal", 0.041017524898052216]]}, "loss": {"model_a": 43.67533815191197, "model_b": 57.200604160246}, "topk": {"model_a": [45, 4, 0.08948458731174469, [[499, 0.284219, ").", false], [42, 0.229231, ")", false], [497, 0.211683, "),", false], [45, 0.089485, ",", false], [45285, 0.055404, " before", false], [4596, 0.014007, " in", false], [4424, 0.013518, " at", false], [39356, 0.012203, " prior", false], [502, 0.005165, ");", false], [37634, 0.004787, " after", false]]], "model_b": [45, 4, 0.041017524898052216, [[42, 0.379129, ")", false], [497, 0.218409, "),", false], [499, 0.19993, ").", false], [45, 0.041018, ",", false], [46342, 0.030988, " itself", false], [21265, 0.021911, " and", false], [4596, 0.012276, " in", false], [502, 0.011403, ");", false], [4424, 0.009112, " at", false], [21700, 0.004806, " for", false]]]}, "raw_delta": -0.75, "tuned_delta": -0.6971450561018002}, {"byte_start": 2576, "byte_end": 2585, "display": {"text": " although", "kind": "normal"}, "is_word": true, "word_id": 448, "word_key": " although", "bytes_hex": "20 61 6c 74 68 6f 75 67 68", "compression": {"model_a": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "model_b": "7.45% 7.45% 7.45% 7.45% 7.45% 7.45% 7.45% 7.45% 7.45%"}, "model_tokens": {"model_a": [[55495, " although", "normal", 0.02955758012831211]], "model_b": [[55495, " although", "normal", 0.02429584227502346]]}, "loss": {"model_a": 7.044409379340641, "model_b": 7.451419699035879}, "topk": {"model_a": [55495, 6, 0.02955758012831211, [[21400, 0.194065, " but", false], [40185, 0.118716, " where", false], [45285, 0.058988, " before", false], [47544, 0.056149, " though", false], [21265, 0.032054, " and", false], [55495, 0.029558, " although", false], [4423, 0.028066, " as", false], [22449, 0.025959, " see", false], [40186, 0.022474, " which", false], [21700, 0.021753, " for", false]]], "model_b": [55495, 11, 0.02429584227502346, [[21400, 0.134146, " but", false], [40185, 0.070194, " where", false], [4596, 0.054786, " in", false], [21265, 0.049136, " and", false], [47544, 0.048312, " though", false], [40186, 0.032657, " which", false], [3851, 0.031219, " Go", false], [22590, 0.030867, " the", false], [4423, 0.029914, " as", false], [21700, 0.028243, " for", false]]]}, "raw_delta": -0.02256944444444442, "tuned_delta": 0.030285499453755402}, {"byte_start": 2585, "byte_end": 2594, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 449, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39%", "model_b": "8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.005565821658819914]], "model_b": [[56537, " learning", "normal", 0.015728676691651344]]}, "loss": {"model_a": 10.394417395293745, "model_b": 8.328057310687155}, "topk": {"model_a": [56537, 19, 0.005565821658819914, [[22590, 0.150539, " the", false], [4596, 0.117913, " in", false], [32227, 0.099789, " that", false], [39934, 0.068084, " there", false], [4601, 0.066587, " it", false], [22187, 0.06187, " not", false], [32234, 0.054847, " this", false], [38013, 0.027975, " chess", false], [31277, 0.019741, " less", false], [31077, 0.018261, " here", false]]], "model_b": [56537, 14, 0.015728676691651344, [[22590, 0.13996, " the", false], [22187, 0.085657, " not", false], [4601, 0.076407, " it", false], [4596, 0.060201, " in", false], [32234, 0.059724, " this", false], [32227, 0.041737, " that", false], [3851, 0.020304, " Go", false], [39934, 0.020177, " there", false], [31466, 0.019466, " much", false], [31277, 0.017826, " less", false]]]}, "raw_delta": 0.11458333333333326, "tuned_delta": 0.1674382772315331}, {"byte_start": 2594, "byte_end": 2598, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 450, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"model_a": "26.35% 26.35% 26.35% 26.35%", "model_b": "26.35% 26.35% 26.35% 26.35%"}, "model_tokens": {"model_a": [[21532, " did", "normal", 0.0028810889925807714]], "model_b": [[21532, " did", "normal", 0.002922740997746587]]}, "loss": {"model_a": 26.346091078734, "model_b": 26.346091078734}, "topk": {"model_a": [21532, 25, 0.0028810889925807714, [[4450, 0.380989, " by", false], [332, 0.126184, " a", false], [22590, 0.071093, " the", false], [22748, 0.068771, " was", false], [4706, 0.056963, " of", false], [4596, 0.03874, " in", false], [4811, 0.033535, " to", false], [30917, 0.02326, " from", false], [46, 0.016442, "-", false], [4600, 0.016001, " is", false]]], "model_b": [21532, 29, 0.002922740997746587, [[4450, 0.268345, " by", false], [22748, 0.166412, " was", false], [332, 0.055394, " a", false], [4596, 0.043072, " in", false], [4811, 0.039645, " to", false], [40093, 0.027725, " value", false], [4600, 0.027138, " is", false], [4706, 0.027095, " of", false], [22590, 0.025771, " the", false], [30917, 0.025059, " from", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 2598, "byte_end": 2602, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 451, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "0.21% 0.21% 0.21% 0.21%", "model_b": "0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.954839289188385]], "model_b": [[22187, " not", "normal", 0.9001966714859009]]}, "loss": {"model_a": 0.2080302144836533, "model_b": 0.4776990110365372}, "topk": {"model_a": [22187, 1, 0.954839289188385, [[22187, 0.954839, " not", false], [32187, 0.003571, " take", false], [31702, 0.00322, " play", false], [39166, 0.002873, " occur", false], [31466, 0.001909, " much", false], [46159, 0.001633, " happen", false], [31458, 0.001395, " more", false], [61959, 0.00134, " eventually", false], [31967, 0.0013, " seem", false], [31059, 0.001004, " have", false]]], "model_b": [22187, 1, 0.9001966714859009, [[22187, 0.900197, " not", false], [32187, 0.013522, " take", false], [39166, 0.00991, " occur", false], [46159, 0.007772, " happen", false], [31466, 0.003301, " much", false], [61959, 0.002765, " eventually", false], [45284, 0.002324, " become", false], [52724, 0.002243, " require", false], [30482, 0.002193, " come", false], [31059, 0.002018, " have", false]]]}, "raw_delta": -0.01495361328125, "tuned_delta": 0.03790133061694982}, {"byte_start": 2602, "byte_end": 2607, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 452, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"model_a": "8.85% 8.85% 8.85% 8.85% 8.85%", "model_b": "14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"model_a": [[31702, " play", "normal", 0.08666630834341049]], "model_b": [[31702, " play", "normal", 0.01688573881983757]]}, "loss": {"model_a": 8.847778180451845, "model_b": 14.765082059097983}, "topk": {"model_a": [31702, 1, 0.08666630834341049, [[31702, 0.086666, " play", false], [31967, 0.063153, " seem", false], [56041, 0.038945, " dominate", false], [32499, 0.032124, " work", false], [45185, 0.031616, " appear", false], [39166, 0.030756, " occur", false], [39801, 0.028981, " start", false], [22770, 0.02753, " win", false], [46159, 0.025182, " happen", false], [39374, 0.023773, " prove", false]]], "model_b": [31702, 16, 0.01688573881983757, [[45284, 0.080067, " become", false], [39166, 0.078557, " occur", false], [30482, 0.071509, " come", false], [32187, 0.047155, " take", false], [37829, 0.040502, " begin", false], [46159, 0.034844, " happen", false], [45185, 0.026456, " appear", false], [45150, 0.024874, " always", false], [45846, 0.020636, " emerge", false], [22797, 0.020068, " yet", false]]]}, "raw_delta": -0.328125, "tuned_delta": -0.27527005610180016}, {"byte_start": 2607, "byte_end": 2609, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 453, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "8.77% 8.77%", "model_b": "6.52% 6.52%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.3755667805671692]], "model_b": [[332, " a", "normal", 0.48289451003074646]]}, "loss": {"model_a": 8.770289677279099, "model_b": 6.516078675890093}, "topk": {"model_a": [332, 1, 0.3755667805671692, [[332, 0.375567, " a", false], [4423, 0.230581, " as", false], [22590, 0.11632, " the", false], [32139, 0.096036, " such", false], [32227, 0.035363, " that", false], [4419, 0.02994, " an", false], [31466, 0.027224, " much", false], [21273, 0.017189, " any", false], [46647, 0.012085, " nearly", false], [32234, 0.011513, " this", false]]], "model_b": [332, 1, 0.48289451003074646, [[332, 0.482895, " a", false], [22249, 0.144994, " out", false], [4423, 0.143065, " as", false], [22590, 0.043459, " the", false], [4419, 0.034712, " an", false], [31466, 0.02782, " much", false], [46342, 0.018442, " itself", false], [32139, 0.015331, " such", false], [21273, 0.011806, " any", false], [46647, 0.010337, " nearly", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17785494389819984}, {"byte_start": 2609, "byte_end": 2613, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 454, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"model_a": "17.61% 17.61% 17.61% 17.61%", "model_b": "15.36% 15.36% 15.36% 15.36%"}, "model_tokens": {"model_a": [[21357, " big", "normal", 0.02009044960141182]], "model_b": [[21357, " big", "normal", 0.03324894234538078]]}, "loss": {"model_a": 17.611023448351602, "model_b": 15.356812446962596}, "topk": {"model_a": [21357, 11, 0.02009044960141182, [[31894, 0.32776, " role", false], [51156, 0.097959, " central", false], [38961, 0.073442, " major", false], [38864, 0.058188, " large", false], [60273, 0.056718, " prominent", false], [63870, 0.039793, " significant", false], [56040, 0.038624, " dominant", false], [31633, 0.035638, " part", false], [45752, 0.030285, " direct", false], [52555, 0.020123, " primary", false]]], "model_b": [21357, 9, 0.03324894234538078, [[38864, 0.203478, " large", false], [38961, 0.14804, " major", false], [51156, 0.106336, " central", false], [31894, 0.086186, " role", false], [63870, 0.06335, " significant", false], [56040, 0.041903, " dominant", false], [60273, 0.039293, " prominent", false], [21952, 0.034871, " key", false], [21357, 0.033249, " big", false], [32386, 0.018315, " very", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17785494389819984}, {"byte_start": 2613, "byte_end": 2618, "display": {"text": " role", "kind": "normal"}, "is_word": true, "word_id": 455, "word_key": " role", "bytes_hex": "20 72 6f 6c 65", "compression": {"model_a": "0.63% 0.63% 0.63% 0.63% 0.63%", "model_b": "0.43% 0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"model_a": [[31894, " role", "normal", 0.8398662805557251]], "model_b": [[31894, " role", "normal", 0.8881008625030518]]}, "loss": {"model_a": 0.6269524347613171, "model_b": 0.42618676745010875}, "topk": {"model_a": [31894, 1, 0.8398662805557251, [[31894, 0.839866, " role", false], [31633, 0.116483, " part", false], [45865, 0.021799, " enough", false], [52013, 0.008769, " initial", false], [45752, 0.002001, " direct", false], [45, 0.001574, ",", false], [4715, 0.000728, " or", false], [39568, 0.000721, " rôle", false], [31895, 0.000619, " roll", false], [38328, 0.000547, " early", false]]], "model_b": [31894, 1, 0.8881008625030518, [[31894, 0.888101, " role", false], [31633, 0.095788, " part", false], [45950, 0.002614, " factor", false], [45865, 0.002349, " enough", false], [31895, 0.001227, " roll", false], [45, 0.000749, ",", false], [4715, 0.000663, " or", false], [31044, 0.000431, " hand", false], [4588, 0.00027, " if", false], [11, 0.000252, "\n", false]]]}, "raw_delta": 0.011132812500000002, "tuned_delta": 0.06398775639819983}, {"byte_start": 2618, "byte_end": 2621, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 456, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "3.33% 3.33% 3.33%", "model_b": "2.38% 2.38% 2.38%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.5772871375083923]], "model_b": [[4596, " in", "normal", 0.6751785278320312]]}, "loss": {"model_a": 3.3343537728879036, "model_b": 2.383358506676917}, "topk": {"model_a": [4596, 1, 0.5772871375083923, [[4596, 0.577287, " in", false], [39934, 0.145351, " there", false], [499, 0.071883, ").", false], [4424, 0.035775, " at", false], [40076, 0.029034, " until", false], [59868, 0.020631, " initially", false], [31077, 0.013599, " here", false], [497, 0.012967, "),", false], [42, 0.01223, ")", false], [32230, 0.010474, " then", false]]], "model_b": [4596, 1, 0.6751785278320312, [[4596, 0.675179, " in", false], [40076, 0.077049, " until", false], [499, 0.064471, ").", false], [42, 0.02277, ")", false], [4424, 0.019983, " at", false], [39934, 0.019775, " there", false], [21700, 0.019674, " for", false], [497, 0.016649, "),", false], [59868, 0.006841, " initially", false], [32230, 0.006452, " then", false]]]}, "raw_delta": 0.052734375, "tuned_delta": 0.10558931889819982}, {"byte_start": 2621, "byte_end": 2625, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 457, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.57% 5.57% 5.57% 5.57%", "model_b": "6.02% 6.02% 6.02% 6.02%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.2928292751312256]], "model_b": [[22590, " the", "normal", 0.2657221257686615]]}, "loss": {"model_a": 5.565083409679106, "model_b": 6.022970019336248}, "topk": {"model_a": [22590, 1, 0.2928292751312256, [[22590, 0.292829, " the", false], [38013, 0.219499, " chess", false], [3851, 0.093535, " Go", false], [55809, 0.046308, " computer", false], [32227, 0.042282, " that", false], [38328, 0.02273, " early", false], [53354, 0.02017, " winning", false], [39944, 0.017885, " those", false], [47202, 0.014441, " search", false], [45833, 0.012294, " either", false]]], "model_b": [22590, 1, 0.2657221257686615, [[22590, 0.265722, " the", false], [3851, 0.263964, " Go", false], [32234, 0.040059, " this", false], [38013, 0.033684, " chess", false], [32227, 0.031838, " that", false], [38328, 0.028107, " early", false], [55809, 0.018289, " computer", false], [31461, 0.016475, " most", false], [38720, 0.009684, " human", false], [39944, 0.008747, " those", false]]]}, "raw_delta": -0.025390625, "tuned_delta": 0.02746431889819982}, {"byte_start": 2625, "byte_end": 2628, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 458, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"model_a": "23.58% 23.58% 23.58%", "model_b": "25.36% 25.36% 25.36%"}, "model_tokens": {"model_a": [[3492, " 19", "normal", 0.019657691940665245]], "model_b": [[3492, " 19", "normal", 0.014982953667640686]]}, "loss": {"model_a": 23.575290056193346, "model_b": 25.359873765626308}, "topk": {"model_a": [3492, 13, 0.019657691940665245, [[38328, 0.10517, " early", false], [47202, 0.08699, " search", false], [52013, 0.075046, " initial", false], [38013, 0.055422, " chess", false], [3851, 0.053055, " Go", false], [51551, 0.040986, " earlier", false], [38491, 0.03608, " final", false], [38720, 0.03344, " human", false], [38499, 0.032116, " first", false], [38869, 0.021641, " later", false]]], "model_b": [3492, 11, 0.014982953667640686, [[38328, 0.160086, " early", false], [3851, 0.078211, " Go", false], [59657, 0.040416, " evolution", false], [53052, 0.03133, " success", false], [63469, 0.03119, " development", false], [30941, 0.031093, " game", false], [30405, 0.025967, " case", false], [52013, 0.022289, " initial", false], [38491, 0.021848, " final", false], [38720, 0.020925, " human", false]]]}, "raw_delta": -0.09895833333333326, "tuned_delta": -0.04610338943513344}, {"byte_start": 2628, "byte_end": 2630, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 459, "word_key": "97", "bytes_hex": "39 37", "compression": {"model_a": "1.67% 1.67%", "model_b": "10.36% 10.36%"}, "model_tokens": {"model_a": [[717, "97", "normal", 0.8302068710327148]], "model_b": [[717, "97", "normal", 0.3165627717971802]]}, "loss": {"model_a": 1.6730472275934023, "model_b": 10.355281787630743}, "topk": {"model_a": [717, 1, 0.8302068710327148, [[717, 0.830207, "97", false], [710, 0.105307, "90", false], [716, 0.029014, "96", false], [700, 0.008104, "80", false], [690, 0.003935, "70", false], [719, 0.003715, "99", false], [709, 0.003683, "89", false], [670, 0.002747, "50", false], [715, 0.002712, "95", false], [718, 0.001416, "98", false]]], "model_b": [717, 1, 0.3165627717971802, [[717, 0.316563, "97", false], [710, 0.218616, "90", false], [700, 0.21409, "80", false], [690, 0.099309, "70", false], [680, 0.041751, "60", false], [716, 0.018912, "96", false], [719, 0.011322, "99", false], [718, 0.009491, "98", false], [670, 0.007609, "50", false], [715, 0.00743, "95", false]]]}, "raw_delta": -0.4814453125, "tuned_delta": -0.42859036860180016}, {"byte_start": 2630, "byte_end": 2638, "display": {"text": " program", "kind": "normal"}, "is_word": true, "word_id": 460, "word_key": " program", "bytes_hex": "20 70 72 6f 67 72 61 6d", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99%", "model_b": "16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62%"}, "model_tokens": {"model_a": [[52580, " program", "normal", 0.00766520481556654]], "model_b": [[52580, " program", "normal", 0.0006317073712125421]]}, "loss": {"model_a": 10.9892786317714, "model_b": 16.62480613524391}, "topk": {"model_a": [52580, 21, 0.00766520481556654, [[53283, 0.12737, " victory", false], [38981, 0.069941, " match", false], [45685, 0.067613, " defeat", false], [30941, 0.066407, " game", false], [38013, 0.058695, " chess", false], [21265, 0.052622, " and", false], [46, 0.047299, "-", false], [20184, 0.044737, " Kas", false], [40213, 0.04342, " world", false], [47202, 0.031241, " search", false]]], "model_b": [52580, 122, 0.0006317073712125421, [[3851, 0.079371, " Go", false], [38013, 0.054612, " chess", false], [53283, 0.052956, " victory", false], [20184, 0.052099, " Kas", false], [45685, 0.049574, " defeat", false], [30405, 0.046693, " case", false], [30941, 0.033691, " game", false], [46, 0.030283, "-", false], [40213, 0.025896, " world", false], [52738, 0.024997, " results", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.25964505610180016}, {"byte_start": 2638, "byte_end": 2643, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 461, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "13.92% 13.92% 13.92% 13.92% 13.92%", "model_b": "15.89% 15.89% 15.89% 15.89% 15.89%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.021264201030135155]], "model_b": [[32227, " that", "normal", 0.012416651472449303]]}, "loss": {"model_a": 13.919752933577106, "model_b": 15.892187559792486}, "topk": {"model_a": [32227, 5, 0.021264201030135155, [[499, 0.690594, ").", false], [497, 0.082804, "),", false], [42, 0.061698, ")", false], [45, 0.03472, ",", false], [32227, 0.021264, " that", false], [21700, 0.01732, " for", false], [580, 0.016732, ".)", false], [21265, 0.011418, " and", false], [4706, 0.005581, " of", false], [460, 0.004232, "'s", false]]], "model_b": [32227, 13, 0.012416651472449303, [[499, 0.461952, ").", false], [42, 0.098318, ")", false], [497, 0.070002, "),", false], [21700, 0.054104, " for", false], [4706, 0.035631, " of", false], [50870, 0.023114, " against", false], [4596, 0.019853, " in", false], [580, 0.019402, ".)", false], [45, 0.015885, ",", false], [4424, 0.013815, " at", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 2643, "byte_end": 2649, "display": {"text": " first", "kind": "normal"}, "is_word": true, "word_id": 462, "word_key": " first", "bytes_hex": "20 66 69 72 73 74", "compression": {"model_a": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%", "model_b": "20.85% 20.85% 20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[38499, " first", "normal", 0.005304576829075813]], "model_b": [[38499, " first", "normal", 0.0009758607484400272]]}, "loss": {"model_a": 15.779477009723035, "model_b": 20.851451762848296}, "topk": {"model_a": [38499, 9, 0.005304576829075813, [[22777, 0.406379, " won", false], [55934, 0.274453, " defeated", false], [30256, 0.097376, " beat", false], [51744, 0.0171, " finally", false], [22748, 0.017015, " was", false], [61959, 0.009941, " eventually", false], [62676, 0.009769, " ultimately", false], [21994, 0.007706, " led", false], [38499, 0.005305, " first", false], [32272, 0.005085, " took", false]]], "model_b": [38499, 81, 0.0009758607484400272, [[22777, 0.255547, " won", false], [55934, 0.156276, " defeated", false], [46936, 0.053159, " proved", false], [22748, 0.030445, " was", false], [30256, 0.02645, " beat", false], [45283, 0.025217, " became", false], [21994, 0.022691, " led", false], [32272, 0.021496, " took", false], [56942, 0.016025, " produced", false], [31351, 0.014846, " made", false]]]}, "raw_delta": -0.28125, "tuned_delta": -0.22839505610180016}, {"byte_start": 2649, "byte_end": 2654, "display": {"text": " beat", "kind": "normal"}, "is_word": true, "word_id": 463, "word_key": " beat", "bytes_hex": "20 62 65 61 74", "compression": {"model_a": "5.61% 5.61% 5.61% 5.61% 5.61%", "model_b": "11.10% 11.10% 11.10% 11.10% 11.10%"}, "model_tokens": {"model_a": [[30256, " beat", "normal", 0.21381770074367523]], "model_b": [[30256, " beat", "normal", 0.045871980488300323]]}, "loss": {"model_a": 5.6073498659551495, "model_b": 11.10198918184085}, "topk": {"model_a": [30256, 3, 0.21381770074367523, [[55934, 0.277631, " defeated", false], [22777, 0.246833, " won", false], [30256, 0.213818, " beat", false], [31351, 0.012145, " made", false], [55437, 0.00926, " achieved", false], [32272, 0.009244, " took", false], [32354, 0.008687, " used", false], [52086, 0.006128, " knocked", false], [51097, 0.005451, " brought", false], [47333, 0.004737, " solved", false]]], "model_b": [30256, 7, 0.045871980488300323, [[22777, 0.089459, " won", false], [32354, 0.0731, " used", false], [47270, 0.066907, " showed", false], [50937, 0.059883, " applied", false], [46936, 0.055908, " proved", false], [64347, 0.049327, " demonstrated", false], [30256, 0.045872, " beat", false], [55437, 0.039771, " achieved", false], [52112, 0.036492, " learned", false], [55934, 0.024097, " defeated", false]]]}, "raw_delta": -0.3046875, "tuned_delta": -0.25183255610180016}, {"byte_start": 2654, "byte_end": 2656, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 464, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "36.63% 36.63%", "model_b": "30.71% 30.71%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.01698998175561428]], "model_b": [[332, " a", "normal", 0.032871197909116745]]}, "loss": {"model_a": 36.63092877257133, "model_b": 30.713624893925193}, "topk": {"model_a": [332, 3, 0.01698998175561428, [[20184, 0.831147, " Kas", false], [22590, 0.100774, " the", false], [332, 0.01699, " a", false], [40213, 0.011454, " world", false], [38720, 0.009857, " human", false], [19948, 0.003623, " Gar", false], [38013, 0.003403, " chess", false], [46227, 0.001617, " humans", false], [38621, 0.001196, " grand", false], [28951, 0.001195, " Gary", false]]], "model_b": [332, 3, 0.032871197909116745, [[20184, 0.763552, " Kas", false], [22590, 0.045832, " the", false], [332, 0.032871, " a", false], [40213, 0.020043, " world", false], [19948, 0.019551, " Gar", false], [3851, 0.017685, " Go", false], [28753, 0.0115, " Deep", false], [37576, 0.00926, " World", false], [38621, 0.003567, " grand", false], [20273, 0.003498, " Lee", false]]]}, "raw_delta": 0.328125, "tuned_delta": 0.38097994389819984}, {"byte_start": 2656, "byte_end": 2662, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 465, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"model_a": "2.82% 2.82% 2.82% 2.82% 2.82% 2.82%", "model_b": "3.31% 3.31% 3.31% 3.31% 3.31% 3.31%"}, "model_tokens": {"model_a": [[40213, " world", "normal", 0.3914233446121216]], "model_b": [[40213, " world", "normal", 0.33036497235298157]]}, "loss": {"model_a": 2.8177637517362566, "model_b": 3.310872408290101}, "topk": {"model_a": [40213, 1, 0.3914233446121216, [[40213, 0.391423, " world", false], [38720, 0.293753, " human", false], [38621, 0.131522, " grand", false], [38013, 0.04957, " chess", false], [22615, 0.047595, " top", false], [55716, 0.013824, " champion", false], [64532, 0.009259, " professional", false], [20184, 0.007315, " Kas", false], [47436, 0.006144, " strong", false], [39471, 0.005894, " reign", false]]], "model_b": [40213, 1, 0.33036497235298157, [[40213, 0.330365, " world", false], [38720, 0.184093, " human", false], [38621, 0.042989, " grand", false], [3851, 0.0366, " Go", false], [64532, 0.035317, " professional", false], [22615, 0.032237, " top", false], [55809, 0.023568, " computer", false], [46526, 0.023096, " master", false], [55716, 0.02182, " champion", false], [39855, 0.018392, " super", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.02551119389819982}, {"byte_start": 2662, "byte_end": 2671, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 466, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"model_a": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "model_b": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"model_a": [[55716, " champion", "normal", 0.7686011791229248]], "model_b": [[55716, " champion", "normal", 0.8632250428199768]]}, "loss": {"model_a": 0.5283307034505481, "model_b": 0.2935170574725267}, "topk": {"model_a": [55716, 1, 0.7686011791229248, [[55716, 0.768601, " champion", false], [38013, 0.106775, " chess", false], [46, 0.081304, "-", false], [37996, 0.01172, " champ", false], [64275, 0.008239, " championship", false], [38621, 0.008012, " grand", false], [38046, 0.002355, " class", false], [46526, 0.002321, " master", false], [38720, 0.002225, " human", false], [46841, 0.000875, " player", false]]], "model_b": [55716, 1, 0.8632250428199768, [[55716, 0.863225, " champion", false], [46, 0.079431, "-", false], [38013, 0.017023, " chess", false], [38621, 0.005226, " grand", false], [47024, 0.003024, " record", false], [46841, 0.00279, " player", false], [46685, 0.002401, " number", false], [64275, 0.002243, " championship", false], [37996, 0.001825, " champ", false], [64532, 0.001539, " professional", false]]]}, "raw_delta": 0.01302083333333333, "tuned_delta": 0.06587577723153315}, {"byte_start": 2671, "byte_end": 2673, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"model_a": "2.89% 2.89%", "model_b": "4.93% 4.93%"}, "model_tokens": {"model_a": [[499, ").", "normal", 0.7266738414764404]], "model_b": [[499, ").", "normal", 0.5840897560119629]]}, "loss": {"model_a": 2.8882078455296627, "model_b": 4.931086565538449}, "topk": {"model_a": [499, 1, 0.7266738414764404, [[499, 0.726674, ").", false], [497, 0.057502, "),", false], [42, 0.049568, ")", false], [45, 0.04009, ",", false], [580, 0.032478, ".)", false], [4596, 0.018732, " in", false], [47, 0.0165, ".", false], [4424, 0.011887, " at", false], [21265, 0.004822, " and", false], [4450, 0.00456, " by", false]]], "model_b": [499, 1, 0.5840897560119629, [[499, 0.58409, ").", false], [4596, 0.109329, " in", false], [42, 0.070828, ")", false], [45, 0.051846, ",", false], [497, 0.051119, "),", false], [47, 0.027023, ".", false], [4424, 0.019368, " at", false], [580, 0.011062, ".)", false], [4450, 0.008653, " by", false], [502, 0.00527, ");", false]]]}, "raw_delta": -0.11328125, "tuned_delta": -0.06042630610180018}, {"byte_start": 2673, "byte_end": 2682, "display": {"text": " Learning", "kind": "normal"}, "is_word": true, "word_id": 467, "word_key": " learning", "bytes_hex": "20 4c 65 61 72 6e 69 6e 67", "compression": {"model_a": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%", "model_b": "8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70%"}, "model_tokens": {"model_a": [[55122, " Learning", "normal", 0.015134541317820549]], "model_b": [[55122, " Learning", "normal", 0.012911861762404442]]}, "loss": {"model_a": 8.45329125520877, "model_b": 8.703759144251991}, "topk": {"model_a": [55122, 10, 0.015134541317820549, [[261, 0.279088, "\n\n", false], [20996, 0.110158, " The", false], [267, 0.057187, "  ", false], [29894, 0.049585, " This", false], [3913, 0.040867, " In", false], [19555, 0.038474, " But", false], [3918, 0.021844, " It", false], [36251, 0.020257, " Again", false], [37453, 0.018361, " These", false], [55122, 0.015135, " Learning", false]]], "model_b": [55122, 16, 0.012911861762404442, [[261, 0.149566, "\n\n", false], [20996, 0.104216, " The", false], [29894, 0.05696, " This", false], [267, 0.048657, "  ", false], [3913, 0.047837, " In", false], [37453, 0.043949, " These", false], [19555, 0.027562, " But", false], [3918, 0.018408, " It", false], [11, 0.017395, "\n", false], [300, 0.01571, " A", false]]]}, "raw_delta": -0.013888888888888895, "tuned_delta": 0.038966055009310926}, {"byte_start": 2682, "byte_end": 2685, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 468, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "7.84% 7.84% 7.84%", "model_b": "6.39% 6.39% 6.39%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.27113616466522217]], "model_b": [[4450, " by", "normal", 0.3497852087020874]]}, "loss": {"model_a": 7.842775775665913, "model_b": 6.386931170602182}, "topk": {"model_a": [4450, 1, 0.27113616466522217, [[4450, 0.271136, " by", false], [4600, 0.082569, " is", false], [22748, 0.081993, " was", false], [332, 0.049744, " a", false], [30917, 0.046386, " from", false], [4811, 0.038372, " to", false], [22590, 0.031638, " the", false], [4706, 0.031098, " of", false], [45, 0.023575, ",", false], [21800, 0.020569, " has", false]]], "model_b": [4450, 1, 0.3497852087020874, [[4450, 0.349785, " by", false], [22748, 0.097998, " was", false], [4600, 0.051442, " is", false], [4811, 0.040763, " to", false], [30917, 0.027216, " from", false], [332, 0.026345, " a", false], [4596, 0.023712, " in", false], [45, 0.021884, ",", false], [4706, 0.017131, " of", false], [22590, 0.015121, " the", false]]]}, "raw_delta": 0.08072916666666663, "tuned_delta": 0.13358411056486647}, {"byte_start": 2685, "byte_end": 2690, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 469, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"model_a": "0.65% 0.65% 0.65% 0.65% 0.65%", "model_b": "2.71% 2.71% 2.71% 2.71% 2.71%"}, "model_tokens": {"model_a": [[31978, " self", "normal", 0.8354401588439941]], "model_b": [[31978, " self", "normal", 0.46954578161239624]]}, "loss": {"model_a": 0.6480856628993389, "model_b": 2.705053201666806}, "topk": {"model_a": [31978, 1, 0.8354401588439941, [[31978, 0.83544, " self", false], [47202, 0.014871, " search", false], [38720, 0.013084, " human", false], [40093, 0.010785, " value", false], [65003, 0.009184, " reinforcement", false], [46342, 0.00874, " itself", false], [52491, 0.007665, " playing", false], [59815, 0.006051, " imitation", false], [31702, 0.004061, " play", false], [62557, 0.003161, " simulation", false]]], "model_b": [31978, 1, 0.46954578161239624, [[31978, 0.469546, " self", false], [31702, 0.134425, " play", false], [52491, 0.071326, " playing", false], [40010, 0.015928, " trial", false], [61979, 0.012584, " experience", false], [46342, 0.011715, " itself", false], [47497, 0.008927, " taking", false], [22590, 0.008023, " the", false], [47202, 0.008001, " search", false], [40093, 0.007978, " value", false]]]}, "raw_delta": -0.1140625, "tuned_delta": -0.061207556101800176}, {"byte_start": 2690, "byte_end": 2695, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 470, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"model_a": "0.94% 0.94% 0.94% 0.94% 0.94%", "model_b": "0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"model_a": [[31702, " play", "normal", 0.7712420225143433]], "model_b": [[31702, " play", "normal", 0.9550389051437378]]}, "loss": {"model_a": 0.9369064474523053, "model_b": 0.16554362041450507}, "topk": {"model_a": [31702, 1, 0.7712420225143433, [[31702, 0.771242, " play", false], [46, 0.224068, "-", false], [26697, 0.001684, "play", false], [52491, 0.00039, " playing", false], [39301, 0.000277, " plays", false], [4715, 0.000181, " or", false], [47077, 0.000125, " replay", false], [11, 0.000106, "\n", false], [261, 7.5e-05, "\n\n", false], [21265, 6.4e-05, " and", false]]], "model_b": [31702, 1, 0.9550389051437378, [[31702, 0.955039, " play", false], [46, 0.033199, "-", false], [26697, 0.003746, "play", false], [52491, 0.00344, " playing", false], [56537, 0.000268, " learning", false], [46840, 0.00023, " played", false], [39301, 0.000218, " plays", false], [38877, 0.000118, " learn", false], [61958, 0.000104, " evaluation", false], [29593, 9.8e-05, " Play", false]]]}, "raw_delta": 0.042773437500000004, "tuned_delta": 0.09562838139819982}, {"byte_start": 2695, "byte_end": 2696, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "51.28%", "model_b": "50.16%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.0589311309158802]], "model_b": [[45, ",", "normal", 0.061828434467315674]]}, "loss": {"model_a": 51.283300281599864, "model_b": 50.156194780905366}, "topk": {"model_a": [45, 3, 0.0589311309158802, [[4600, 0.273234, " is", false], [22748, 0.16693, " was", false], [45, 0.058931, ",", false], [21800, 0.047295, " has", false], [46936, 0.028118, " proved", false], [21795, 0.017565, " had", false], [21413, 0.017187, " can", false], [30135, 0.016378, " also", false], [4596, 0.016375, " in", false], [21265, 0.013506, " and", false]]], "model_b": [45, 3, 0.061828434467315674, [[22748, 0.220829, " was", false], [4600, 0.198458, " is", false], [45, 0.061828, ",", false], [21413, 0.023614, " can", false], [45283, 0.021424, " became", false], [21800, 0.02046, " has", false], [46936, 0.017836, " proved", false], [4596, 0.014947, " in", false], [21795, 0.013247, " had", false], [50887, 0.012743, " allowed", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 2696, "byte_end": 2700, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 471, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55%", "model_b": "12.89% 12.89% 12.89% 12.89%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.07718450576066971]], "model_b": [[21265, " and", "normal", 0.05706906318664551]]}, "loss": {"model_a": 11.55283138211865, "model_b": 12.891269164193373}, "topk": {"model_a": [21265, 2, 0.07718450576066971, [[4715, 0.101046, " or", false], [21265, 0.077185, " and", false], [51948, 0.075303, " however", false], [4596, 0.066998, " in", false], [40186, 0.055727, " which", false], [4423, 0.040547, " as", false], [4450, 0.030813, " by", false], [32487, 0.02467, " with", false], [32465, 0.021649, " when", false], [55780, 0.018576, " combined", false]]], "model_b": [21265, 4, 0.05706906318664551, [[4596, 0.084682, " in", false], [40186, 0.068736, " which", false], [4715, 0.061147, " or", false], [21265, 0.057069, " and", false], [4423, 0.047575, " as", false], [51948, 0.036482, " however", false], [22590, 0.02892, " the", false], [55780, 0.028642, " combined", false], [40187, 0.02329, " while", false], [32465, 0.023017, " when", false]]]}, "raw_delta": -0.07421875, "tuned_delta": -0.02136380610180018}, {"byte_start": 2700, "byte_end": 2709, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 472, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04%", "model_b": "6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.04902108386158943]], "model_b": [[56537, " learning", "normal", 0.03347543627023697]]}, "loss": {"model_a": 6.042537823167749, "model_b": 6.825249976427822}, "topk": {"model_a": [56537, 4, 0.04902108386158943, [[22590, 0.133339, " the", false], [4450, 0.089687, " by", false], [32230, 0.050493, " then", false], [56537, 0.049021, " learning", false], [47202, 0.038665, " search", false], [4596, 0.035348, " in", false], [21902, 0.033388, " its", false], [39193, 0.030281, " other", false], [40085, 0.024732, " using", false], [61953, 0.022399, " especially", false]]], "model_b": [56537, 6, 0.03347543627023697, [[22590, 0.253182, " the", false], [4450, 0.065913, " by", false], [61953, 0.051862, " especially", false], [4596, 0.050266, " in", false], [21902, 0.037618, " its", false], [56537, 0.033475, " learning", false], [31458, 0.027456, " more", false], [39193, 0.021644, " other", false], [22187, 0.019804, " not", false], [64507, 0.017652, " particularly", false]]]}, "raw_delta": -0.04340277777777779, "tuned_delta": 0.009452166120422031}, {"byte_start": 2709, "byte_end": 2712, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 473, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "20.76% 20.76% 20.76%", "model_b": "18.13% 18.13% 18.13%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.031219901517033577]], "model_b": [[4596, " in", "normal", 0.0487254336476326]]}, "loss": {"model_a": 20.75752630445709, "model_b": 18.12761346950325}, "topk": {"model_a": [4596, 6, 0.031219901517033577, [[4450, 0.424668, " by", false], [30917, 0.107858, " from", false], [4811, 0.085296, " to", false], [332, 0.039875, " a", false], [22590, 0.032588, " the", false], [4596, 0.03122, " in", false], [32487, 0.030772, " with", false], [4706, 0.02913, " of", false], [22705, 0.01113, " via", false], [40085, 0.010648, " using", false]]], "model_b": [4596, 4, 0.0487254336476326, [[4450, 0.309295, " by", false], [30917, 0.151789, " from", false], [4811, 0.088109, " to", false], [4596, 0.048725, " in", false], [32487, 0.041134, " with", false], [53140, 0.032376, " through", false], [4706, 0.029938, " of", false], [22705, 0.023759, " via", false], [40085, 0.018342, " using", false], [22590, 0.015113, " the", false]]]}, "raw_delta": 0.14583333333333348, "tuned_delta": 0.19868827723153332}, {"byte_start": 2712, "byte_end": 2720, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 474, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "1.87% 1.87% 1.87% 1.87% 1.87% 1.87% 1.87% 1.87%", "model_b": "2.54% 2.54% 2.54% 2.54% 2.54% 2.54% 2.54% 2.54%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.4373762905597687]], "model_b": [[51832, " general", "normal", 0.32668763399124146]]}, "loss": {"model_a": 1.8667684855252697, "model_b": 2.535987376562631}, "topk": {"model_a": [51832, 1, 0.4373762905597687, [[51832, 0.437376, " general", false], [22590, 0.114505, " the", false], [332, 0.068765, " a", false], [39193, 0.03129, " other", false], [62293, 0.016834, " particular", false], [38576, 0.016768, " games", false], [38864, 0.015925, " large", false], [47202, 0.013883, " search", false], [56812, 0.012825, " parallel", false], [4419, 0.012641, " an", false]]], "model_b": [51832, 1, 0.32668763399124146, [[51832, 0.326688, " general", false], [332, 0.167972, " a", false], [22590, 0.11121, " the", false], [39193, 0.030677, " other", false], [4419, 0.021096, " an", false], [38576, 0.019307, " games", false], [32234, 0.014439, " this", false], [32448, 0.011794, " ways", false], [31978, 0.009668, " self", false], [38720, 0.009232, " human", false]]]}, "raw_delta": -0.037109375, "tuned_delta": 0.01574556889819982}, {"byte_start": 2720, "byte_end": 2721, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.18%", "model_b": "3.45%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9366965889930725]], "model_b": [[45, ",", "normal", 0.8270139694213867]]}, "loss": {"model_a": 1.1799385710395573, "model_b": 3.451760595876914}, "topk": {"model_a": [45, 1, 0.9366965889930725, [[45, 0.936697, ",", false], [275, 0.008862, " (", false], [4450, 0.00712, " by", false], [30917, 0.006089, " from", false], [4596, 0.004227, " in", false], [21286, 0.003563, " are", false], [4600, 0.002205, " is", false], [4423, 0.002145, " as", false], [21700, 0.001876, " for", false], [32487, 0.001623, " with", false]]], "model_b": [45, 1, 0.8270139694213867, [[45, 0.827014, ",", false], [4450, 0.043312, " by", false], [30917, 0.03124, " from", false], [275, 0.012716, " (", false], [22748, 0.005982, " was", false], [40085, 0.005319, " using", false], [22705, 0.00455, " via", false], [4600, 0.004261, " is", false], [4596, 0.00393, " in", false], [32487, 0.003908, " with", false]]]}, "raw_delta": -0.1259765625, "tuned_delta": -0.07312161860180018}, {"byte_start": 2721, "byte_end": 2724, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 475, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "8.45% 8.45% 8.45%", "model_b": "9.02% 9.02% 9.02%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.2424180805683136]], "model_b": [[4600, " is", "normal", 0.22019228339195251]]}, "loss": {"model_a": 8.45329125520877, "model_b": 9.01684400555602}, "topk": {"model_a": [4600, 1, 0.2424180805683136, [[4600, 0.242418, " is", false], [22748, 0.137141, " was", false], [21286, 0.091824, " are", false], [21800, 0.089791, " has", false], [32462, 0.047136, " were", false], [46936, 0.032661, " proved", false], [31059, 0.026704, " have", false], [21795, 0.023498, " had", false], [45283, 0.016601, " became", false], [21413, 0.015474, " can", false]]], "model_b": [4600, 1, 0.22019228339195251, [[4600, 0.220192, " is", false], [22748, 0.210715, " was", false], [32462, 0.04842, " were", false], [21286, 0.042572, " are", false], [21800, 0.040901, " has", false], [45283, 0.027661, " became", false], [46936, 0.024967, " proved", false], [21413, 0.020365, " can", false], [21795, 0.016835, " had", false], [21532, 0.009108, " did", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 2724, "byte_end": 2729, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 476, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"model_a": "28.85% 28.85% 28.85% 28.85% 28.85%", "model_b": "25.70% 25.70% 25.70% 25.70% 25.70%"}, "model_tokens": {"model_a": [[31296, " like", "normal", 0.000330429058521986]], "model_b": [[31296, " like", "normal", 0.0008152991649694741]]}, "loss": {"model_a": 28.853900817779266, "model_b": 25.698005415834658}, "topk": {"model_a": [31296, 196, 0.000330429058521986, [[332, 0.281064, " a", false], [22590, 0.06593, " the", false], [22187, 0.061047, " not", false], [4419, 0.058671, " an", false], [22226, 0.032656, " one", false], [31466, 0.032285, " much", false], [39171, 0.022063, " often", false], [31458, 0.021698, " more", false], [50919, 0.020862, " another", false], [30135, 0.014315, " also", false]]], "model_b": [31296, 108, 0.0008152991649694741, [[332, 0.202642, " a", false], [22590, 0.182725, " the", false], [4419, 0.051941, " an", false], [22226, 0.043922, " one", false], [22187, 0.041384, " not", false], [32464, 0.026519, " what", false], [22190, 0.02646, " now", false], [31466, 0.017944, " much", false], [39820, 0.011795, " still", false], [32386, 0.011191, " very", false]]]}, "raw_delta": 0.17500000000000004, "tuned_delta": 0.22785494389819988}, {"byte_start": 2729, "byte_end": 2736, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 477, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "8.25% 8.25% 8.25% 8.25% 8.25% 8.25% 8.25%", "model_b": "15.46% 15.46% 15.46% 15.46% 15.46% 15.46% 15.46%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.04022342339158058]], "model_b": [[47202, " search", "normal", 0.002499517984688282]]}, "loss": {"model_a": 8.252022415799035, "model_b": 15.45744686666746}, "topk": {"model_a": [47202, 4, 0.04022342339158058, [[332, 0.183935, " a", false], [22590, 0.125593, " the", false], [38720, 0.049485, " human", false], [47202, 0.040223, " search", false], [37920, 0.034038, " brute", false], [4419, 0.01995, " an", false], [21273, 0.0191, " any", false], [60463, 0.016883, " searching", false], [30597, 0.016027, " deep", false], [38888, 0.016019, " lever", false]]], "model_b": [47202, 34, 0.002499517984688282, [[56537, 0.239753, " learning", false], [22590, 0.137477, " the", false], [332, 0.070553, " a", false], [47497, 0.026018, " taking", false], [40085, 0.019209, " using", false], [38720, 0.018395, " human", false], [30597, 0.016535, " deep", false], [4419, 0.013216, " an", false], [31978, 0.01141, " self", false], [57453, 0.01081, " training", false]]]}, "raw_delta": -0.39955357142857145, "tuned_delta": -0.3466986275303716}, {"byte_start": 2736, "byte_end": 2739, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 478, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "5.26% 5.26% 5.26%", "model_b": "6.72% 6.72% 6.72%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.4204898774623871]], "model_b": [[4596, " in", "normal", 0.32310786843299866]]}, "loss": {"model_a": 5.259825669907679, "model_b": 6.71567027497141}, "topk": {"model_a": [4596, 1, 0.4204898774623871, [[4596, 0.42049, " in", false], [45, 0.22891, ",", false], [4450, 0.056023, " by", false], [59, 0.052907, ":", false], [21400, 0.040048, " but", false], [47, 0.039977, ".", false], [21265, 0.021196, " and", false], [60, 0.016397, ";", false], [32487, 0.011621, " with", false], [31581, 0.009878, " only", false]]], "model_b": [4596, 1, 0.32310786843299866, [[4596, 0.323108, " in", false], [45, 0.107558, ",", false], [4450, 0.089082, " by", false], [59, 0.065315, ":", false], [47, 0.044845, ".", false], [21265, 0.043302, " and", false], [32227, 0.037173, " that", false], [21400, 0.032726, " but", false], [21700, 0.018794, " for", false], [60, 0.017197, ";", false]]]}, "raw_delta": -0.08072916666666663, "tuned_delta": -0.027874222768466808}, {"byte_start": 2739, "byte_end": 2744, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 479, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.62% 1.62% 1.62% 1.62% 1.62%", "model_b": "2.61% 2.61% 2.61% 2.61% 2.61%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.6359608173370361]], "model_b": [[32227, " that", "normal", 0.48553159832954407]]}, "loss": {"model_a": 1.6202141572483475, "model_b": 2.606431470356037}, "topk": {"model_a": [32227, 1, 0.6359608173370361, [[32227, 0.635961, " that", false], [22590, 0.083345, " the", false], [37832, 0.036785, " being", false], [31370, 0.035908, " many", false], [21902, 0.030627, " its", false], [38013, 0.019153, " chess", false], [332, 0.017353, " a", false], [32234, 0.016861, " this", false], [39920, 0.007708, " terms", false], [46170, 0.006663, " having", false]]], "model_b": [32227, 1, 0.48553159832954407, [[32227, 0.485532, " that", false], [38013, 0.126855, " chess", false], [22590, 0.095399, " the", false], [31370, 0.031732, " many", false], [51832, 0.026939, " general", false], [332, 0.026108, " a", false], [55809, 0.024397, " computer", false], [21902, 0.015671, " its", false], [39193, 0.01525, " other", false], [3851, 0.00902, " Go", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0018325561018001785}, {"byte_start": 2744, "byte_end": 2747, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 480, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "2.45% 2.45% 2.45%", "model_b": "2.43% 2.43% 2.43%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.6641919612884521]], "model_b": [[4601, " it", "normal", 0.6688187718391418]]}, "loss": {"model_a": 2.4538026004703233, "model_b": 2.4303212358725212}, "topk": {"model_a": [4601, 1, 0.6641919612884521, [[4601, 0.664192, " it", false], [22590, 0.108357, " the", false], [45, 0.023197, ",", false], [21902, 0.01994, " its", false], [332, 0.012142, " a", false], [30322, 0.011902, " both", false], [39934, 0.010964, " there", false], [56537, 0.009262, " learning", false], [22226, 0.006506, " one", false], [47202, 0.00572, " search", false]]], "model_b": [4601, 1, 0.6688187718391418, [[4601, 0.668819, " it", false], [22590, 0.074987, " the", false], [30322, 0.033225, " both", false], [39934, 0.020741, " there", false], [332, 0.015512, " a", false], [21902, 0.012752, " its", false], [45, 0.010439, ",", false], [22799, 0.008181, " you", false], [4588, 0.006975, " if", false], [22226, 0.006793, " one", false]]]}, "raw_delta": 0.0013020833333333426, "tuned_delta": 0.054157027231533164}, {"byte_start": 2747, "byte_end": 2755, "display": {"text": " enables", "kind": "normal"}, "is_word": true, "word_id": 481, "word_key": " enables", "bytes_hex": "20 65 6e 61 62 6c 65 73", "compression": {"model_a": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "model_b": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"model_a": [[51597, " enables", "normal", 0.004983329679816961]], "model_b": [[51597, " enables", "normal", 0.0028392684180289507]]}, "loss": {"model_a": 11.97549594487909, "model_b": 13.173045539367}, "topk": {"model_a": [51597, 27, 0.004983329679816961, [[4600, 0.24774, " is", false], [21413, 0.092399, " can", false], [56540, 0.059084, " leverage", false], [30659, 0.034625, " does", false], [57102, 0.030622, " requires", false], [47181, 0.030366, " scales", false], [56501, 0.025466, " involves", false], [21800, 0.023595, " has", false], [32356, 0.020999, " uses", false], [39914, 0.016981, " tends", false]]], "model_b": [51597, 39, 0.0028392684180289507, [[4600, 0.324105, " is", false], [21413, 0.070451, " can", false], [57102, 0.054109, " requires", false], [56540, 0.048869, " leverage", false], [30659, 0.028533, " does", false], [32356, 0.02823, " uses", false], [39888, 0.027711, " takes", false], [56501, 0.021844, " involves", false], [38964, 0.021737, " makes", false], [47056, 0.020859, " relies", false]]]}, "raw_delta": -0.06640625, "tuned_delta": -0.013551306101800178}, {"byte_start": 2755, "byte_end": 2763, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 482, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "model_b": "10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.040357425808906555]], "model_b": [[52195, " massive", "normal", 0.008654110133647919]]}, "loss": {"model_a": 7.25574166072086, "model_b": 10.707502256597774}, "topk": {"model_a": [52195, 3, 0.040357425808906555, [[22590, 0.181135, " the", false], [332, 0.109615, " a", false], [52195, 0.040357, " massive", false], [38888, 0.03349, " lever", false], [22226, 0.032826, " one", false], [4419, 0.03117, " an", false], [59988, 0.025902, " massively", false], [52224, 0.024894, " methods", false], [63370, 0.02327, " computation", false], [51832, 0.021012, " general", false]]], "model_b": [52195, 18, 0.008654110133647919, [[22590, 0.199932, " the", false], [332, 0.11528, " a", false], [51832, 0.04592, " general", false], [4419, 0.043823, " an", false], [63370, 0.038843, " computation", false], [45124, 0.026297, " agents", false], [65135, 0.020153, " generalization", false], [22226, 0.019975, " one", false], [31458, 0.019527, " more", false], [22799, 0.017633, " you", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13855130610180016}, {"byte_start": 2763, "byte_end": 2775, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 483, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72%", "model_b": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.16332165896892548]], "model_b": [[63370, " computation", "normal", 0.2271721065044403]]}, "loss": {"model_a": 2.723838293345048, "model_b": 2.2307296367912035}, "topk": {"model_a": [63370, 1, 0.16332165896892548, [[63370, 0.163322, " computation", false], [45, 0.138892, ",", false], [56812, 0.120582, " parallel", false], [63621, 0.092749, " improvement", false], [64423, 0.065934, " improvements", false], [56950, 0.049514, " progress", false], [63562, 0.033048, " exploration", false], [38888, 0.029448, " lever", false], [56540, 0.023476, " leverage", false], [59847, 0.016892, " increases", false]]], "model_b": [63370, 1, 0.2271721065044403, [[63370, 0.227172, " computation", false], [45, 0.081097, ",", false], [65135, 0.063275, " generalization", false], [56812, 0.043252, " parallel", false], [39590, 0.038168, " scale", false], [51832, 0.026817, " general", false], [64862, 0.025793, " computational", false], [63562, 0.022641, " exploration", false], [30597, 0.022017, " deep", false], [59346, 0.021445, " computing", false]]]}, "raw_delta": 0.027343749999999997, "tuned_delta": 0.08019869389819982}, {"byte_start": 2775, "byte_end": 2778, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 484, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "4.32% 4.32% 4.32%", "model_b": "11.22% 11.22% 11.22%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.48553267121315]], "model_b": [[4811, " to", "normal", 0.1538623869419098]]}, "loss": {"model_a": 4.320571085995593, "model_b": 11.224092277749422}, "topk": {"model_a": [4811, 1, 0.48553267121315, [[4811, 0.485533, " to", false], [45, 0.09907, ",", false], [47, 0.073175, ".", false], [32487, 0.033088, " with", false], [21265, 0.032928, " and", false], [4424, 0.0323, " at", false], [4596, 0.028236, " in", false], [53356, 0.026915, " without", false], [4712, 0.020541, " on", false], [4706, 0.019663, " of", false]]], "model_b": [4811, 3, 0.1538623869419098, [[45, 0.270061, ",", false], [47, 0.194681, ".", false], [4811, 0.153862, " to", false], [21265, 0.08956, " and", false], [32227, 0.027312, " that", false], [4450, 0.023491, " by", false], [4424, 0.023485, " at", false], [275, 0.021791, " (", false], [4596, 0.019403, " in", false], [4706, 0.017161, " of", false]]]}, "raw_delta": -0.3828125, "tuned_delta": -0.32995755610180016}, {"byte_start": 2778, "byte_end": 2781, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 485, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "1.50% 1.50% 1.50%", "model_b": "3.12% 3.12% 3.12%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.7808938026428223]], "model_b": [[4435, " be", "normal", 0.5915042161941528]]}, "loss": {"model_a": 1.4969369931098861, "model_b": 3.1230214915076844}, "topk": {"model_a": [4435, 1, 0.7808938026428223, [[4435, 0.780894, " be", false], [56540, 0.05814, " leverage", false], [32187, 0.006568, " take", false], [45284, 0.006057, " become", false], [52570, 0.00537, " proceed", false], [51982, 0.005081, " improve", false], [31702, 0.005009, " play", false], [31358, 0.004936, " make", false], [30858, 0.003916, " find", false], [22249, 0.00347, " out", false]]], "model_b": [4435, 1, 0.5915042161941528, [[4435, 0.591504, " be", false], [45284, 0.029481, " become", false], [56540, 0.028765, " leverage", false], [32187, 0.027471, " take", false], [39590, 0.019896, " scale", false], [22770, 0.013262, " win", false], [53051, 0.011517, " succeed", false], [51982, 0.011107, " improve", false], [4491, 0.009931, " do", false], [50848, 0.009858, " achieve", false]]]}, "raw_delta": -0.09016927083333333, "tuned_delta": -0.03731432693513351}, {"byte_start": 2781, "byte_end": 2789, "display": {"text": " brought", "kind": "normal"}, "is_word": true, "word_id": 486, "word_key": " brought", "bytes_hex": "20 62 72 6f 75 67 68 74", "compression": {"model_a": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%", "model_b": "14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30%"}, "model_tokens": {"model_a": [[51097, " brought", "normal", 0.00672551104798913]], "model_b": [[51097, " brought", "normal", 0.0017313762800768018]]}, "loss": {"model_a": 11.271055006945026, "model_b": 14.3001510400615}, "topk": {"model_a": [51097, 13, 0.00672551104798913, [[50937, 0.305008, " applied", false], [56540, 0.168066, " leverage", false], [60152, 0.092357, " performed", false], [30666, 0.080413, " done", false], [32354, 0.069184, " used", false], [51139, 0.023411, " carried", false], [59355, 0.022818, " conducted", false], [31351, 0.011627, " made", false], [55957, 0.00908, " deployed", false], [22418, 0.008846, " run", false]]], "model_b": [51097, 34, 0.0017313762800768018, [[50937, 0.36869, " applied", false], [56540, 0.154402, " leverage", false], [32354, 0.143389, " used", false], [30666, 0.044967, " done", false], [60152, 0.04239, " performed", false], [31351, 0.019344, " made", false], [55957, 0.013644, " deployed", false], [51903, 0.013332, " harness", false], [51139, 0.01159, " carried", false], [59355, 0.008892, " conducted", false]]]}, "raw_delta": -0.16796875, "tuned_delta": -0.11511380610180018}, {"byte_start": 2789, "byte_end": 2792, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 487, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.24% 0.24% 0.24%", "model_b": "2.35% 2.35% 2.35%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9612718224525452]], "model_b": [[4811, " to", "normal", 0.6771755814552307]]}, "loss": {"model_a": 0.23921640184010928, "model_b": 2.3481364597802137}, "topk": {"model_a": [4811, 1, 0.9612718224525452, [[4811, 0.961272, " to", false], [31162, 0.012103, " into", false], [40062, 0.004677, " under", false], [4596, 0.002279, " in", false], [56003, 0.00124, " directly", false], [52628, 0.001237, " quickly", false], [63507, 0.001169, " effectively", false], [30678, 0.001113, " down", false], [57435, 0.001085, " together", false], [51791, 0.000888, " forward", false]]], "model_b": [4811, 1, 0.6771755814552307, [[4811, 0.677176, " to", false], [31162, 0.123182, " into", false], [57435, 0.032646, " together", false], [30678, 0.02151, " down", false], [40062, 0.019549, " under", false], [22249, 0.019358, " out", false], [4596, 0.013701, " in", false], [46705, 0.011146, " online", false], [4712, 0.006451, " on", false], [4424, 0.006423, " at", false]]]}, "raw_delta": -0.11694335937500001, "tuned_delta": -0.06408841547680019}, {"byte_start": 2792, "byte_end": 2797, "display": {"text": " bear", "kind": "normal"}, "is_word": true, "word_id": 488, "word_key": " bear", "bytes_hex": "20 62 65 61 72", "compression": {"model_a": "0.06% 0.06% 0.06% 0.06% 0.06%", "model_b": "0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"model_a": [[30255, " bear", "normal", 0.9847694635391235]], "model_b": [[30255, " bear", "normal", 0.9745910167694092]]}, "loss": {"model_a": 0.05525458606920316, "model_b": 0.09333842427626349}, "topk": {"model_a": [30255, 1, 0.9847694635391235, [[30255, 0.984769, " bear", false], [22590, 0.004673, " the", false], [332, 0.002701, " a", false], [4419, 0.000921, " an", false], [31702, 0.000572, " play", false], [39590, 0.000569, " scale", false], [30235, 0.000419, " bare", false], [32202, 0.000306, " task", false], [22681, 0.000219, " use", false], [32499, 0.000162, " work", false]]], "model_b": [30255, 1, 0.9745910167694092, [[30255, 0.974591, " bear", false], [22590, 0.007851, " the", false], [39590, 0.003177, " scale", false], [332, 0.00309, " a", false], [31702, 0.002168, " play", false], [37823, 0.000805, " bears", false], [4419, 0.000707, " an", false], [31044, 0.000358, " hand", false], [22681, 0.000309, " use", false], [31427, 0.000233, " mind", false]]]}, "raw_delta": -0.0021118164062499997, "tuned_delta": 0.05074312749194982}, {"byte_start": 2797, "byte_end": 2798, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "45.93%", "model_b": "41.98%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.07866539806127548]], "model_b": [[47, ".", "normal", 0.09691029042005539]]}, "loss": {"model_a": 45.92954915330098, "model_b": 41.98467990087022}, "topk": {"model_a": [47, 2, 0.07866539806127548, [[4712, 0.613678, " on", false], [47, 0.078665, ".", false], [45, 0.073907, ",", false], [4596, 0.058302, " in", false], [4811, 0.026185, " to", false], [53356, 0.018578, " without", false], [4424, 0.012507, " at", false], [21265, 0.010231, " and", false], [52628, 0.006706, " quickly", false], [31601, 0.006414, " over", false]]], "model_b": [47, 2, 0.09691029042005539, [[4712, 0.597248, " on", false], [47, 0.09691, ".", false], [45, 0.087653, ",", false], [4596, 0.037468, " in", false], [31601, 0.019711, " over", false], [4424, 0.013746, " at", false], [21265, 0.012947, " and", false], [53356, 0.010087, " without", false], [4811, 0.009569, " to", false], [4450, 0.008291, " by", false]]]}, "raw_delta": 0.21875, "tuned_delta": 0.27160494389819984}, {"byte_start": 2798, "byte_end": 2805, "display": {"text": " Search", "kind": "normal"}, "is_word": true, "word_id": 489, "word_key": " search", "bytes_hex": "20 53 65 61 72 63 68", "compression": {"model_a": "9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58%", "model_b": "9.98% 9.98% 9.98% 9.98% 9.98% 9.98% 9.98%"}, "model_tokens": {"model_a": [[44844, " Search", "normal", 0.024017278105020523]], "model_b": [[44844, " Search", "normal", 0.020962383598089218]]}, "loss": {"model_a": 9.580396755903271, "model_b": 9.98293443472274}, "topk": {"model_a": [44844, 9, 0.024017278105020523, [[261, 0.160575, "\n\n", false], [19555, 0.106946, " But", false], [20996, 0.10121, " The", false], [3918, 0.076942, " It", false], [3913, 0.048261, " In", false], [19417, 0.031542, " And", false], [55122, 0.028116, " Learning", false], [267, 0.025282, "  ", false], [44844, 0.024017, " Search", false], [29894, 0.022862, " This", false]]], "model_b": [44844, 10, 0.020962383598089218, [[19555, 0.151032, " But", false], [20996, 0.117798, " The", false], [261, 0.089238, "\n\n", false], [3918, 0.07081, " It", false], [3913, 0.044894, " In", false], [19417, 0.031652, " And", false], [267, 0.028234, "  ", false], [50318, 0.025973, " However", false], [29894, 0.024625, " This", false], [44844, 0.020962, " Search", false]]]}, "raw_delta": -0.022321428571428603, "tuned_delta": 0.03053351532677122}, {"byte_start": 2805, "byte_end": 2809, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 490, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "9.72% 9.72% 9.72% 9.72%", "model_b": "12.82% 12.82% 12.82% 12.82%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.11666335165500641]], "model_b": [[21265, " and", "normal", 0.05832850933074951]]}, "loss": {"model_a": 9.721284943490085, "model_b": 12.820825070399966}, "topk": {"model_a": [21265, 2, 0.11666335165500641, [[4600, 0.192088, " is", false], [21265, 0.116663, " and", false], [45, 0.072507, ",", false], [22748, 0.053892, " was", false], [4596, 0.043797, " in", false], [21800, 0.036154, " has", false], [21413, 0.035198, " can", false], [46, 0.030554, "-", false], [30659, 0.018901, " does", false], [4450, 0.018035, " by", false]]], "model_b": [21265, 3, 0.05832850933074951, [[4600, 0.176464, " is", false], [45, 0.142571, ",", false], [21265, 0.058329, " and", false], [22748, 0.054433, " was", false], [46, 0.054116, "-", false], [4596, 0.037135, " in", false], [21413, 0.024015, " can", false], [57102, 0.023338, " requires", false], [7856, 0.022807, "ing", false], [52224, 0.017415, " methods", false]]]}, "raw_delta": -0.171875, "tuned_delta": -0.11902005610180018}, {"byte_start": 2809, "byte_end": 2818, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 491, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49%", "model_b": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.7848356366157532]], "model_b": [[56537, " learning", "normal", 0.4923510253429413]]}, "loss": {"model_a": 0.4872383154043943, "model_b": 1.4245361189333299}, "topk": {"model_a": [56537, 1, 0.7848356366157532, [[56537, 0.784836, " learning", false], [31978, 0.19264, " self", false], [30597, 0.002628, " deep", false], [22590, 0.001691, " the", false], [65003, 0.00165, " reinforcement", false], [51832, 0.001382, " general", false], [39193, 0.000961, " other", false], [21902, 0.000593, " its", false], [40093, 0.000495, " value", false], [38888, 0.000402, " lever", false]]], "model_b": [56537, 1, 0.4923510253429413, [[56537, 0.492351, " learning", false], [31978, 0.326697, " self", false], [51832, 0.018249, " general", false], [65135, 0.014755, " generalization", false], [40093, 0.014454, " value", false], [30597, 0.012096, " deep", false], [22590, 0.011704, " the", false], [39193, 0.008927, " other", false], [21902, 0.008533, " its", false], [65003, 0.004221, " reinforcement", false]]]}, "raw_delta": -0.05197482638888889, "tuned_delta": 0.0008801175093109334}, {"byte_start": 2818, "byte_end": 2822, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 492, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "4.72% 4.72% 4.72% 4.72%", "model_b": "5.85% 5.85% 5.85% 5.85%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.3498106598854065]], "model_b": [[21286, " are", "normal", 0.26956799626350403]]}, "loss": {"model_a": 4.719754284158229, "model_b": 5.846859784852732}, "topk": {"model_a": [21286, 1, 0.3498106598854065, [[21286, 0.349811, " are", false], [4450, 0.097696, " by", false], [21413, 0.06562, " can", false], [30322, 0.060809, " both", false], [31059, 0.051976, " have", false], [45, 0.033439, ",", false], [4596, 0.031343, " in", false], [32462, 0.029059, " were", false], [4491, 0.011978, " do", false], [22681, 0.011245, " use", false]]], "model_b": [21286, 2, 0.26956799626350403, [[4450, 0.276487, " by", false], [21286, 0.269568, " are", false], [4596, 0.082736, " in", false], [45, 0.039668, ",", false], [30322, 0.031065, " both", false], [21413, 0.026899, " can", false], [31059, 0.026129, " have", false], [32462, 0.026106, " were", false], [4491, 0.015092, " do", false], [57435, 0.009386, " together", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 2822, "byte_end": 2826, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 493, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "12.19% 12.19% 12.19% 12.19%", "model_b": "15.15% 15.15% 15.15% 15.15%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.06632135808467865]], "model_b": [[22590, " the", "normal", 0.034474536776542664]]}, "loss": {"model_a": 12.186828226259308, "model_b": 15.145480165582377}, "topk": {"model_a": [22590, 4, 0.06632135808467865, [[64857, 0.121137, " complementary", false], [30322, 0.119442, " both", false], [22187, 0.070994, " not", false], [22590, 0.066321, " the", false], [22638, 0.04091, " two", false], [32239, 0.02672, " thus", false], [30135, 0.020186, " also", false], [59513, 0.017167, " different", false], [32386, 0.016981, " very", false], [45, 0.016536, ",", false]]], "model_b": [22590, 6, 0.034474536776542664, [[30322, 0.124204, " both", false], [22638, 0.08266, " two", false], [64857, 0.076008, " complementary", false], [22187, 0.070218, " not", false], [59513, 0.039605, " different", false], [22590, 0.034475, " the", false], [30135, 0.0238, " also", false], [31296, 0.021176, " like", false], [32239, 0.018252, " thus", false], [32386, 0.017224, " very", false]]]}, "raw_delta": -0.1640625, "tuned_delta": -0.11120755610180018}, {"byte_start": 2826, "byte_end": 2830, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 494, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"model_a": "4.75% 4.75% 4.75% 4.75%", "model_b": "4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"model_a": [[22638, " two", "normal", 0.3483581840991974]], "model_b": [[22638, " two", "normal", 0.38090911507606506]]}, "loss": {"model_a": 4.754976331054933, "model_b": 4.3323117682944945}, "topk": {"model_a": [22638, 1, 0.3483581840991974, [[22638, 0.348358, " two", false], [31937, 0.105616, " same", false], [31461, 0.069442, " most", false], [31581, 0.061543, " only", false], [51832, 0.019432, " general", false], [57481, 0.017252, " ultimate", false], [31356, 0.016615, " main", false], [52224, 0.015191, " methods", false], [21952, 0.011114, " key", false], [21357, 0.009176, " big", false]]], "model_b": [22638, 1, 0.38090911507606506, [[22638, 0.380909, " two", false], [31937, 0.075925, " same", false], [31581, 0.048256, " only", false], [56767, 0.047044, " opposite", false], [31461, 0.036202, " most", false], [30273, 0.012305, " best", false], [37717, 0.01082, " antit", false], [32448, 0.008602, " ways", false], [31356, 0.00809, " main", false], [52224, 0.007275, " methods", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07629244389819982}, {"byte_start": 2830, "byte_end": 2835, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 495, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "5.24% 5.24% 5.24% 5.24% 5.24%", "model_b": "7.50% 7.50% 7.50% 7.50% 7.50%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.23447805643081665]], "model_b": [[31461, " most", "normal", 0.12435755878686905]]}, "loss": {"model_a": 5.241040578229438, "model_b": 7.495251579618443}, "topk": {"model_a": [31461, 1, 0.23447805643081665, [[31461, 0.234478, " most", false], [31356, 0.094586, " main", false], [51832, 0.06343, " general", false], [52224, 0.062682, " methods", false], [61590, 0.037512, " approaches", false], [52469, 0.028981, " pillars", false], [38961, 0.023033, " major", false], [21357, 0.022754, " big", false], [39682, 0.01994, " sides", false], [56040, 0.019224, " dominant", false]]], "model_b": [31461, 1, 0.12435755878686905, [[31461, 0.124358, " most", false], [31356, 0.084169, " main", false], [38961, 0.074434, " major", false], [61590, 0.039028, " approaches", false], [32448, 0.037811, " ways", false], [39682, 0.037017, " sides", false], [52224, 0.02719, " methods", false], [56194, 0.025416, " extremes", false], [63591, 0.023061, " fundamental", false], [30757, 0.021619, " ends", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 2835, "byte_end": 2845, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 496, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"model_a": "2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71%", "model_b": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32%"}, "model_tokens": {"model_a": [[59829, " important", "normal", 0.2198876291513443]], "model_b": [[59829, " important", "normal", 0.27621975541114807]]}, "loss": {"model_a": 2.7050532016668054, "model_b": 2.3246550951824116}, "topk": {"model_a": [59829, 2, 0.2198876291513443, [[51832, 0.229168, " general", false], [59829, 0.219888, " important", false], [59593, 0.16456, " effective", false], [56900, 0.116635, " powerful", false], [63591, 0.03673, " fundamental", false], [60274, 0.022912, " promising", false], [45534, 0.018497, " common", false], [37812, 0.017187, " basic", false], [59594, 0.013031, " efficient", false], [62603, 0.010843, " successful", false]]], "model_b": [59829, 1, 0.27621975541114807, [[59829, 0.27622, " important", false], [59593, 0.110372, " effective", false], [45534, 0.090401, " common", false], [60273, 0.04922, " prominent", false], [63591, 0.043518, " fundamental", false], [37812, 0.034813, " basic", false], [56900, 0.033529, " powerful", false], [51832, 0.026151, " general", false], [62603, 0.019196, " successful", false], [52346, 0.017339, " obvious", false]]]}, "raw_delta": 0.021093749999999994, "tuned_delta": 0.07394869389819982}, {"byte_start": 2845, "byte_end": 2853, "display": {"text": " classes", "kind": "normal"}, "is_word": true, "word_id": 497, "word_key": " classes", "bytes_hex": "20 63 6c 61 73 73 65 73", "compression": {"model_a": "10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64%", "model_b": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12%"}, "model_tokens": {"model_a": [[51200, " classes", "normal", 0.008807763457298279]], "model_b": [[51200, " classes", "normal", 0.0046080173924565315]]}, "loss": {"model_a": 10.637058162804367, "model_b": 12.116384132465903}, "topk": {"model_a": [51200, 19, 0.008807763457298279, [[52224, 0.185416, " methods", false], [51832, 0.159741, " general", false], [32448, 0.048392, " ways", false], [61590, 0.042632, " approaches", false], [62633, 0.037186, " techniques", false], [21265, 0.027478, " and", false], [39979, 0.02586, " tools", false], [38888, 0.022677, " lever", false], [45, 0.021299, ",", false], [64862, 0.016938, " computational", false]]], "model_b": [51200, 37, 0.0046080173924565315, [[32448, 0.091462, " ways", false], [52224, 0.090706, " methods", false], [61590, 0.080232, " approaches", false], [51832, 0.048424, " general", false], [50964, 0.029971, " aspects", false], [47539, 0.027488, " things", false], [39979, 0.026628, " tools", false], [62581, 0.02414, " strategies", false], [61723, 0.022933, " components", false], [51703, 0.02228, " factors", false]]]}, "raw_delta": -0.08203125, "tuned_delta": -0.02917630610180018}, {"byte_start": 2853, "byte_end": 2856, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 498, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.03% 0.03% 0.03%", "model_b": "0.11% 0.11% 0.11%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9949312806129456]], "model_b": [[4706, " of", "normal", 0.981881320476532]]}, "loss": {"model_a": 0.030635842873694974, "model_b": 0.1093351039085162}, "topk": {"model_a": [4706, 1, 0.9949312806129456, [[4706, 0.994931, " of", false], [4596, 0.001776, " in", false], [21700, 0.000519, " for", false], [45, 0.000491, ",", false], [32227, 0.000277, " that", false], [4715, 0.000243, " or", false], [275, 0.000214, " (", false], [4811, 0.000171, " to", false], [47, 0.000151, ".", false], [21265, 0.000126, " and", false]]], "model_b": [4706, 1, 0.981881320476532, [[4706, 0.981881, " of", false], [4596, 0.004096, " in", false], [32227, 0.003253, " that", false], [45, 0.002229, ",", false], [21700, 0.001073, " for", false], [47, 0.001014, ".", false], [4811, 0.000938, " to", false], [275, 0.000625, " (", false], [11, 0.000344, "\n", false], [21265, 0.000343, " and", false]]]}, "raw_delta": -0.004364013671875, "tuned_delta": 0.04849093022632482}, {"byte_start": 2856, "byte_end": 2867, "display": {"text": " techniques", "kind": "normal"}, "is_word": true, "word_id": 499, "word_key": " techniques", "bytes_hex": "20 74 65 63 68 6e 69 71 75 65 73", "compression": {"model_a": "4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97%", "model_b": "5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61%"}, "model_tokens": {"model_a": [[62633, " techniques", "normal", 0.04822281002998352]], "model_b": [[62633, " techniques", "normal", 0.03257099539041519]]}, "loss": {"model_a": 4.9695106166984875, "model_b": 5.609911469365819}, "topk": {"model_a": [62633, 4, 0.04822281002998352, [[52224, 0.407013, " methods", false], [51832, 0.179219, " general", false], [61559, 0.079326, " algorithms", false], [62633, 0.048223, " techniques", false], [3609, 0.044719, " AI", false], [61590, 0.035611, " approaches", false], [63370, 0.022687, " computation", false], [59113, 0.016687, " algorithm", false], [64862, 0.0114, " computational", false], [46561, 0.009747, " method", false]]], "model_b": [62633, 6, 0.03257099539041519, [[52224, 0.279092, " methods", false], [3609, 0.140981, " AI", false], [57103, 0.074101, " research", false], [61559, 0.052818, " algorithms", false], [51832, 0.041032, " general", false], [62633, 0.032571, " techniques", false], [61590, 0.025621, " approaches", false], [63370, 0.016929, " computation", false], [55809, 0.016821, " computer", false], [52167, 0.016384, " machine", false]]]}, "raw_delta": -0.035511363636363646, "tuned_delta": 0.017343580261836175}, {"byte_start": 2867, "byte_end": 2871, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 500, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "5.07% 5.07% 5.07% 5.07%", "model_b": "8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.32260483503341675]], "model_b": [[21700, " for", "normal", 0.14102023839950562]]}, "loss": {"model_a": 5.071974753125262, "model_b": 8.875955817969208}, "topk": {"model_a": [21700, 1, 0.32260483503341675, [[21700, 0.322605, " for", false], [32227, 0.232815, " that", false], [4596, 0.173715, " in", false], [45, 0.061196, ",", false], [4811, 0.034004, " to", false], [47, 0.030551, ".", false], [32354, 0.018465, " used", false], [59206, 0.013358, " available", false], [21265, 0.00738, " and", false], [4450, 0.006967, " by", false]]], "model_b": [21700, 3, 0.14102023839950562, [[4596, 0.251669, " in", false], [32227, 0.231146, " that", false], [21700, 0.14102, " for", false], [32354, 0.085129, " used", false], [45, 0.059931, ",", false], [4811, 0.033155, " to", false], [47, 0.026141, ".", false], [59206, 0.020614, " available", false], [50937, 0.011569, " applied", false], [21265, 0.007872, " and", false]]]}, "raw_delta": -0.2109375, "tuned_delta": -0.15808255610180016}, {"byte_start": 2871, "byte_end": 2881, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 501, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"model_a": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "model_b": "14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37%"}, "model_tokens": {"model_a": [[60720, " utilizing", "normal", 0.0008722257916815579]], "model_b": [[60720, " utilizing", "normal", 0.0003449231735430658]]}, "loss": {"model_a": 12.679936882813154, "model_b": 14.370595133854907}, "topk": {"model_a": [60720, 132, 0.0008722257916815579, [[59832, 0.061991, " improving", false], [3609, 0.059179, " AI", false], [51832, 0.058164, " general", false], [38888, 0.057947, " lever", false], [52949, 0.041036, " solving", false], [46500, 0.037364, " making", false], [47497, 0.021289, " taking", false], [51844, 0.021081, " getting", false], [51392, 0.020727, " dealing", false], [22590, 0.01947, " the", false]]], "model_b": [60720, 233, 0.0003449231735430658, [[3609, 0.108058, " AI", false], [59832, 0.07206, " improving", false], [38888, 0.068069, " lever", false], [51832, 0.039686, " general", false], [46500, 0.037731, " making", false], [22590, 0.03619, " the", false], [55809, 0.024186, " computer", false], [59346, 0.023158, " computing", false], [52949, 0.021486, " solving", false], [59069, 0.017535, " achieving", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.04089505610180018}, {"byte_start": 2881, "byte_end": 2889, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 502, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "4.37% 4.37% 4.37% 4.37% 4.37% 4.37% 4.37% 4.37%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.143527552485466]], "model_b": [[52195, " massive", "normal", 0.06326282024383545]]}, "loss": {"model_a": 4.367533815191197, "model_b": 6.199080253819764}, "topk": {"model_a": [52195, 2, 0.143527552485466, [[63370, 0.531405, " computation", false], [52195, 0.143528, " massive", false], [51832, 0.06595, " general", false], [22590, 0.056844, " the", false], [59988, 0.040293, " massively", false], [38864, 0.021748, " large", false], [64862, 0.014995, " computational", false], [59346, 0.007142, " computing", false], [332, 0.005392, " a", false], [51266, 0.00449, " compute", false]]], "model_b": [52195, 5, 0.06326282024383545, [[63370, 0.197329, " computation", false], [51832, 0.179968, " general", false], [22590, 0.118283, " the", false], [32234, 0.069243, " this", false], [52195, 0.063263, " massive", false], [59346, 0.034952, " computing", false], [38720, 0.032667, " human", false], [64862, 0.021438, " computational", false], [38864, 0.021003, " large", false], [3609, 0.016536, " AI", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 2889, "byte_end": 2897, "display": {"text": " amounts", "kind": "normal"}, "is_word": true, "word_id": 503, "word_key": " amounts", "bytes_hex": "20 61 6d 6f 75 6e 74 73", "compression": {"model_a": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%", "model_b": "9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79%"}, "model_tokens": {"model_a": [[50897, " amounts", "normal", 0.008533269166946411]], "model_b": [[50897, " amounts", "normal", 0.01309353206306696]]}, "loss": {"model_a": 10.777946350391181, "model_b": 9.79172903728349}, "topk": {"model_a": [50897, 4, 0.008533269166946411, [[63370, 0.89807, " computation", false], [64862, 0.02223, " computational", false], [45, 0.018407, ",", false], [50897, 0.008533, " amounts", false], [59346, 0.006314, " computing", false], [64298, 0.006114, " computations", false], [56812, 0.004656, " parallel", false], [51266, 0.003307, " compute", false], [51832, 0.002735, " general", false], [56353, 0.002043, " hardware", false]]], "model_b": [50897, 5, 0.01309353206306696, [[63370, 0.74864, " computation", false], [59346, 0.04381, " computing", false], [64862, 0.040834, " computational", false], [45, 0.036494, ",", false], [50897, 0.013094, " amounts", false], [64298, 0.012582, " computations", false], [51266, 0.010348, " compute", false], [51832, 0.007997, " general", false], [56812, 0.004259, " parallel", false], [3609, 0.003329, " AI", false]]]}, "raw_delta": 0.0546875, "tuned_delta": 0.10754244389819982}, {"byte_start": 2897, "byte_end": 2900, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 504, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9986644983291626]], "model_b": [[4706, " of", "normal", 0.9964355230331421]]}, "loss": {"model_a": 0.008071719080494484, "model_b": 0.02155515890813868}, "topk": {"model_a": [4706, 1, 0.9986644983291626, [[4706, 0.998664, " of", false], [63370, 0.000345, " computation", false], [21265, 0.000174, " and", false], [275, 0.000152, " (", false], [4715, 9.1e-05, " or", false], [45, 4.9e-05, ",", false], [11, 4.2e-05, "\n", false], [261, 3.5e-05, "\n\n", false], [4588, 3.4e-05, " if", false], [59346, 2.9e-05, " computing", false]]], "model_b": [4706, 1, 0.9964355230331421, [[4706, 0.996436, " of", false], [11, 0.000699, "\n", false], [21265, 0.000531, " and", false], [275, 0.000338, " (", false], [64862, 0.000246, " computational", false], [45, 0.000208, ",", false], [4715, 0.00016, " or", false], [261, 0.000143, "\n\n", false], [47, 0.00012, ".", false], [63370, 0.000107, " computation", false]]]}, "raw_delta": -0.0007476806640625, "tuned_delta": 0.05210726323413732}, {"byte_start": 2900, "byte_end": 2912, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 505, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%", "model_b": "0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.9030185341835022]], "model_b": [[63370, " computation", "normal", 0.6752276420593262]]}, "loss": {"model_a": 0.15556404046043915, "model_b": 0.5870341149450533}, "topk": {"model_a": [63370, 1, 0.9030185341835022, [[63370, 0.903019, " computation", false], [64862, 0.028788, " computational", false], [59346, 0.014672, " computing", false], [51266, 0.009448, " compute", false], [55809, 0.004583, " computer", false], [59206, 0.004209, " available", false], [52167, 0.002465, " machine", false], [56812, 0.002179, " parallel", false], [51832, 0.002143, " general", false], [56353, 0.001819, " hardware", false]]], "model_b": [63370, 1, 0.6752276420593262, [[63370, 0.675228, " computation", false], [59346, 0.089949, " computing", false], [64862, 0.051349, " computational", false], [30579, 0.036206, " data", false], [63637, 0.022502, " information", false], [51266, 0.01898, " compute", false], [59206, 0.010678, " available", false], [51832, 0.008178, " general", false], [38720, 0.005993, " human", false], [55809, 0.005738, " computer", false]]]}, "raw_delta": -0.02392578125, "tuned_delta": 0.02892916264819982}, {"byte_start": 2912, "byte_end": 2915, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 506, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "14.46% 14.46% 14.46%", "model_b": "13.43% 13.43% 13.43%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.09011572599411011]], "model_b": [[4596, " in", "normal", 0.10819895565509796]]}, "loss": {"model_a": 14.464520592246117, "model_b": 13.43134054994282}, "topk": {"model_a": [4596, 4, 0.09011572599411011, [[47, 0.444268, ".", false], [45, 0.173337, ",", false], [4811, 0.114559, " to", false], [4596, 0.090116, " in", false], [21700, 0.027015, " for", false], [21265, 0.018293, " and", false], [32227, 0.017344, " that", false], [60, 0.013864, ";", false], [63507, 0.011647, " effectively", false], [4712, 0.009159, " on", false]]], "model_b": [4596, 4, 0.10819895565509796, [[47, 0.410667, ".", false], [45, 0.181913, ",", false], [4811, 0.111947, " to", false], [4596, 0.108199, " in", false], [21700, 0.045159, " for", false], [21265, 0.026626, " and", false], [32227, 0.01633, " that", false], [275, 0.013989, " (", false], [60, 0.008931, ";", false], [63507, 0.006752, " effectively", false]]]}, "raw_delta": 0.05729166666666674, "tuned_delta": 0.11014661056486656}, {"byte_start": 2915, "byte_end": 2918, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 507, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "4.65% 4.65% 4.65%", "model_b": "9.39% 9.39% 9.39%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.4586777687072754]], "model_b": [[3609, " AI", "normal", 0.2099425494670868]]}, "loss": {"model_a": 4.649310190364823, "model_b": 9.392545839120855}, "topk": {"model_a": [3609, 1, 0.4586777687072754, [[3609, 0.458678, " AI", false], [332, 0.084705, " a", false], [22590, 0.064146, " the", false], [51832, 0.046592, " general", false], [4419, 0.030424, " an", false], [52949, 0.024017, " solving", false], [61594, 0.01892, " artificial", false], [46588, 0.018793, " modern", false], [52167, 0.017314, " machine", false], [32448, 0.013587, " ways", false]]], "model_b": [3609, 1, 0.2099425494670868, [[3609, 0.209943, " AI", false], [51832, 0.154168, " general", false], [22590, 0.104284, " the", false], [332, 0.085464, " a", false], [55809, 0.057282, " computer", false], [39189, 0.029685, " order", false], [38576, 0.020918, " games", false], [4419, 0.020744, " an", false], [61594, 0.016147, " artificial", false], [56901, 0.015847, " practice", false]]]}, "raw_delta": -0.26302083333333337, "tuned_delta": -0.21016588943513353}, {"byte_start": 2918, "byte_end": 2927, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 508, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "2.79% 2.79% 2.79% 2.79% 2.79% 2.79% 2.79% 2.79% 2.79%", "model_b": "3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.2478596568107605]], "model_b": [[57103, " research", "normal", 0.16715504229068756]]}, "loss": {"model_a": 2.786455265605853, "model_b": 3.5848216619311257}, "topk": {"model_a": [57103, 2, 0.2478596568107605, [[47, 0.469999, ".", false], [57103, 0.24786, " research", false], [45, 0.133478, ",", false], [53087, 0.026666, " systems", false], [52224, 0.016976, " methods", false], [21265, 0.014366, " and", false], [56949, 0.010588, " programs", false], [60, 0.008723, ";", false], [275, 0.006393, " (", false], [39971, 0.004677, " today", false]]], "model_b": [57103, 3, 0.16715504229068756, [[47, 0.538305, ".", false], [45, 0.198639, ",", false], [57103, 0.167155, " research", false], [21265, 0.012224, " and", false], [275, 0.011909, " (", false], [60, 0.007334, ";", false], [64251, 0.005999, " applications", false], [53087, 0.005634, " systems", false], [4811, 0.003167, " to", false], [21700, 0.003166, " for", false]]]}, "raw_delta": -0.044270833333333315, "tuned_delta": 0.008584110564866507}, {"byte_start": 2927, "byte_end": 2928, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.04%", "model_b": "7.01%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7556390166282654]], "model_b": [[47, ".", "normal", 0.6791210174560547]]}, "loss": {"model_a": 5.036752706228558, "model_b": 7.009187332443938}, "topk": {"model_a": [47, 1, 0.7556390166282654, [[47, 0.755639, ".", false], [45, 0.161726, ",", false], [21265, 0.014211, " and", false], [60, 0.012137, ";", false], [275, 0.010651, " (", false], [39971, 0.007298, " today", false], [51018, 0.003667, " because", false], [56949, 0.003217, " programs", false], [4596, 0.003068, " in", false], [59, 0.003002, ":", false]]], "model_b": [47, 1, 0.6791210174560547, [[47, 0.679121, ".", false], [45, 0.212637, ",", false], [39971, 0.023156, " today", false], [21265, 0.022497, " and", false], [275, 0.011919, " (", false], [60, 0.009125, ";", false], [4596, 0.003758, " in", false], [59, 0.002809, ":", false], [4811, 0.002681, " to", false], [4424, 0.002122, " at", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 2928, "byte_end": 2931, "display": {"text": " In", "kind": "normal"}, "is_word": true, "word_id": 509, "word_key": " in", "bytes_hex": "20 49 6e", "compression": {"model_a": "21.13% 21.13% 21.13%", "model_b": "21.79% 21.79% 21.79%"}, "model_tokens": {"model_a": [[3913, " In", "normal", 0.029775399714708328]], "model_b": [[3913, " In", "normal", 0.026831308379769325]]}, "loss": {"model_a": 21.133228138021924, "model_b": 21.79070634676038}, "topk": {"model_a": [3913, 5, 0.029775399714708328, [[261, 0.421592, "\n\n", false], [20996, 0.066907, " The", false], [29893, 0.043399, " They", false], [267, 0.039527, "  ", false], [3913, 0.029775, " In", false], [44844, 0.022861, " Search", false], [3918, 0.020698, " It", false], [19417, 0.01929, " And", false], [28530, 0.018614, " Both", false], [19555, 0.016457, " But", false]]], "model_b": [3913, 6, 0.026831308379769325, [[261, 0.366019, "\n\n", false], [267, 0.069452, "  ", false], [20996, 0.06741, " The", false], [11, 0.05521, "\n", false], [44844, 0.028729, " Search", false], [3913, 0.026831, " In", false], [19555, 0.021388, " But", false], [29893, 0.018988, " They", false], [19417, 0.015505, " And", false], [3918, 0.014677, " It", false]]]}, "raw_delta": -0.03645833333333326, "tuned_delta": 0.016396610564866562}, {"byte_start": 2931, "byte_end": 2940, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 510, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04%", "model_b": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.049491651356220245]], "model_b": [[55809, " computer", "normal", 0.052452635020017624]]}, "loss": {"model_a": 6.042537823167749, "model_b": 5.885995392515736}, "topk": {"model_a": [55809, 4, 0.049491651356220245, [[22590, 0.171705, " the", false], [30322, 0.103477, " both", false], [38013, 0.093484, " chess", false], [55809, 0.049492, " computer", false], [30808, 0.044222, " fact", false], [56901, 0.041997, " practice", false], [31370, 0.033308, " many", false], [32234, 0.032101, " this", false], [51832, 0.026929, " general", false], [332, 0.02177, " a", false]]], "model_b": [55809, 3, 0.052452635020017624, [[22590, 0.205148, " the", false], [30322, 0.074029, " both", false], [55809, 0.052453, " computer", false], [30808, 0.039739, " fact", false], [30719, 0.037312, " each", false], [3492, 0.03476, " 19", false], [55856, 0.034045, " contrast", false], [3609, 0.029903, " AI", false], [51832, 0.028891, " general", false], [32234, 0.027082, " this", false]]]}, "raw_delta": 0.008680555555555525, "tuned_delta": 0.061535499453755346}, {"byte_start": 2940, "byte_end": 2943, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 511, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"model_a": "4.48% 4.48% 4.48%", "model_b": "21.70% 21.70% 21.70%"}, "model_tokens": {"model_a": [[3851, " Go", "normal", 0.4730294644832611]], "model_b": [[3851, " Go", "normal", 0.02688601426780224]]}, "loss": {"model_a": 4.484940638180208, "model_b": 21.696780888369172}, "topk": {"model_a": [3851, 1, 0.4730294644832611, [[3851, 0.473029, " Go", false], [38013, 0.3588, " chess", false], [38576, 0.064519, " games", false], [46, 0.026104, "-", false], [52814, 0.020665, " science", false], [36466, 0.010621, " Chess", false], [47202, 0.003914, " search", false], [47732, 0.003721, " vision", false], [52491, 0.002778, " playing", false], [30941, 0.002632, " game", false]]], "model_b": [3851, 5, 0.02688601426780224, [[38013, 0.452022, " chess", false], [38576, 0.093073, " games", false], [47202, 0.055517, " search", false], [47732, 0.051587, " vision", false], [3851, 0.026886, " Go", false], [39311, 0.023756, " poker", false], [46, 0.021757, "-", false], [30941, 0.021399, " game", false], [52814, 0.020908, " science", false], [52491, 0.017677, " playing", false]]]}, "raw_delta": -0.9544270833333334, "tuned_delta": -0.9015721394351336}, {"byte_start": 2943, "byte_end": 2944, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.26%", "model_b": "4.54%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8336088061332703]], "model_b": [[45, ",", "normal", 0.7758035659790039]]}, "loss": {"model_a": 3.2580393379450463, "model_b": 4.543644049674714}, "topk": {"model_a": [45, 1, 0.8336088061332703, [[45, 0.833609, ",", false], [21265, 0.044449, " and", false], [22590, 0.027182, " the", false], [39934, 0.012457, " there", false], [4423, 0.012252, " as", false], [4601, 0.008953, " it", false], [275, 0.007278, " (", false], [32232, 0.005239, " they", false], [4596, 0.005052, " in", false], [4424, 0.003106, " at", false]]], "model_b": [45, 1, 0.7758035659790039, [[45, 0.775804, ",", false], [21265, 0.103331, " and", false], [22590, 0.026011, " the", false], [4601, 0.009815, " it", false], [57103, 0.007865, " research", false], [32234, 0.006529, " this", false], [39934, 0.006377, " there", false], [275, 0.0047, " (", false], [56537, 0.003863, " learning", false], [31978, 0.003684, " self", false]]]}, "raw_delta": -0.0712890625, "tuned_delta": -0.01843411860180018}, {"byte_start": 2944, "byte_end": 2947, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 512, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "15.87% 15.87% 15.87%", "model_b": "27.05% 27.05% 27.05%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.07207941263914108]], "model_b": [[4423, " as", "normal", 0.011040277779102325]]}, "loss": {"model_a": 15.873402468114245, "model_b": 27.05053201666806}, "topk": {"model_a": [4423, 4, 0.07207941263914108, [[22590, 0.240841, " the", false], [56537, 0.097014, " learning", false], [47202, 0.079971, " search", false], [4423, 0.072079, " as", false], [4601, 0.053005, " it", false], [39936, 0.035964, " these", false], [51948, 0.030038, " however", false], [32232, 0.024494, " they", false], [21265, 0.022851, " and", false], [332, 0.019221, " a", false]]], "model_b": [4423, 14, 0.011040277779102325, [[22590, 0.296201, " the", false], [56537, 0.059345, " learning", false], [332, 0.034056, " a", false], [51948, 0.031118, " however", false], [4601, 0.02876, " it", false], [32234, 0.025045, " this", false], [39934, 0.024686, " there", false], [39936, 0.022569, " these", false], [31978, 0.020721, " self", false], [47202, 0.016094, " search", false]]]}, "raw_delta": -0.6197916666666666, "tuned_delta": -0.5669367227684668}, {"byte_start": 2947, "byte_end": 2950, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 513, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "0.70% 0.70% 0.70%", "model_b": "1.51% 1.51% 1.51%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.8897480964660645]], "model_b": [[4596, " in", "normal", 0.7765874862670898]]}, "loss": {"model_a": 0.6985705967846135, "model_b": 1.514548016558238}, "topk": {"model_a": [4596, 1, 0.8897480964660645, [[4596, 0.889748, " in", false], [32458, 0.02741, " well", false], [32487, 0.027285, " with", false], [4601, 0.007152, " it", false], [59608, 0.004455, " elsewhere", false], [22748, 0.003807, " was", false], [4600, 0.003266, " is", false], [332, 0.003253, " a", false], [22590, 0.002271, " the", false], [22190, 0.001814, " now", false]]], "model_b": [4596, 1, 0.7765874862670898, [[4596, 0.776587, " in", false], [32487, 0.081577, " with", false], [32458, 0.033869, " well", false], [59608, 0.016844, " elsewhere", false], [4601, 0.00938, " it", false], [21700, 0.007309, " for", false], [4858, 0.005505, " we", false], [332, 0.005185, " a", false], [4600, 0.004603, " is", false], [22748, 0.004438, " was", false]]]}, "raw_delta": -0.045247395833333336, "tuned_delta": 0.007607548064866486}, {"byte_start": 2950, "byte_end": 2959, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 514, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72%", "model_b": "4.01% 4.01% 4.01% 4.01% 4.01% 4.01% 4.01% 4.01% 4.01%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.25532466173171997]], "model_b": [[55809, " computer", "normal", 0.13552680611610413]]}, "loss": {"model_a": 2.7238382933450476, "model_b": 4.007486224691565}, "topk": {"model_a": [55809, 2, 0.25532466173171997, [[38013, 0.465499, " chess", false], [55809, 0.255325, " computer", false], [31370, 0.081564, " many", false], [39193, 0.041045, " other", false], [22590, 0.032236, " the", false], [31461, 0.016021, " most", false], [21256, 0.01213, " all", false], [3609, 0.008911, " AI", false], [4788, 0.005703, " so", false], [36466, 0.005531, " Chess", false]]], "model_b": [55809, 2, 0.13552680611610413, [[38013, 0.602602, " chess", false], [55809, 0.135527, " computer", false], [31370, 0.050499, " many", false], [3609, 0.045423, " AI", false], [39193, 0.037313, " other", false], [22590, 0.02377, " the", false], [21256, 0.01919, " all", false], [31461, 0.015205, " most", false], [36466, 0.008241, " Chess", false], [47202, 0.006585, " search", false]]]}, "raw_delta": -0.07118055555555557, "tuned_delta": -0.018325611657355745}, {"byte_start": 2959, "byte_end": 2965, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 515, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%", "model_b": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.9752193689346313]], "model_b": [[38013, " chess", "normal", 0.9818809032440186]]}, "loss": {"model_a": 0.07521374597733496, "model_b": 0.0546675519542581}, "topk": {"model_a": [38013, 1, 0.9752193689346313, [[38013, 0.975219, " chess", false], [36466, 0.018929, " Chess", false], [47202, 0.001134, " search", false], [46, 0.000909, "-", false], [39311, 0.000493, " poker", false], [3851, 0.000492, " Go", false], [38576, 0.000311, " games", false], [51180, 0.00014, " checker", false], [20660, 0.000121, " Pok", false], [52814, 8.4e-05, " science", false]]], "model_b": [38013, 1, 0.9818809032440186, [[38013, 0.981881, " chess", false], [36466, 0.011586, " Chess", false], [47202, 0.002762, " search", false], [38576, 0.001077, " games", false], [3609, 0.000326, " AI", false], [46, 0.000316, "-", false], [31702, 0.000206, " play", false], [39311, 0.000196, " poker", false], [52491, 0.00016, " playing", false], [30941, 6.6e-05, " game", false]]]}, "raw_delta": 0.0011393229166666663, "tuned_delta": 0.053994266814866486}, {"byte_start": 2965, "byte_end": 2966, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "0.68%", "model_b": "1.23%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9629252552986145]], "model_b": [[45, ",", "normal", 0.9337862133979797]]}, "loss": {"model_a": 0.6824271586236246, "model_b": 1.2327716413846121}, "topk": {"model_a": [45, 1, 0.9629252552986145, [[45, 0.962925, ",", false], [21265, 0.011886, " and", false], [45285, 0.006032, " before", false], [275, 0.005515, " (", false], [4596, 0.0019, " in", false], [22590, 0.001036, " the", false], [332, 0.000941, " a", false], [51551, 0.000575, " earlier", false], [39934, 0.000524, " there", false], [4424, 0.000464, " at", false]]], "model_b": [45, 1, 0.9337862133979797, [[45, 0.933786, ",", false], [21265, 0.044352, " and", false], [275, 0.004339, " (", false], [4715, 0.0023, " or", false], [4596, 0.00212, " in", false], [22590, 0.002073, " the", false], [57103, 0.000972, " research", false], [4424, 0.000758, " at", false], [332, 0.000619, " a", false], [39934, 0.000538, " there", false]]]}, "raw_delta": -0.030517578125, "tuned_delta": 0.02233736577319982}, {"byte_start": 2966, "byte_end": 2978, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 516, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "model_b": "7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.011587098240852356]], "model_b": [[63843, " researchers", "normal", 0.008551239967346191]]}, "loss": {"model_a": 6.71567027497141, "model_b": 7.138334837731849}, "topk": {"model_a": [63843, 12, 0.011587098240852356, [[22590, 0.367073, " the", false], [47202, 0.073676, " search", false], [56537, 0.068261, " learning", false], [4601, 0.055851, " it", false], [39936, 0.049941, " these", false], [39934, 0.036267, " there", false], [38720, 0.035227, " human", false], [332, 0.016487, " a", false], [32232, 0.014506, " they", false], [52224, 0.013679, " methods", false]]], "model_b": [63843, 16, 0.008551239967346191, [[22590, 0.353923, " the", false], [39934, 0.046462, " there", false], [4601, 0.04446, " it", false], [39936, 0.039567, " these", false], [56537, 0.031211, " learning", false], [32234, 0.026218, " this", false], [332, 0.024753, " a", false], [52195, 0.015033, " massive", false], [38720, 0.014246, " human", false], [21265, 0.01307, " and", false]]]}, "raw_delta": -0.0234375, "tuned_delta": 0.02941744389819982}, {"byte_start": 2978, "byte_end": 2979, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"model_a": "58.89%", "model_b": "78.33%"}, "model_tokens": {"model_a": [[40, "'", "normal", 0.037737879902124405]], "model_b": [[40, "'", "normal", 0.012874784879386425]]}, "loss": {"model_a": 58.891262411287755, "model_b": 78.33383229826792}, "topk": {"model_a": [40, 4, 0.037737879902124405, [[22762, 0.250653, " who", false], [32462, 0.079991, " were", false], [21795, 0.039324, " had", false], [40, 0.037738, "'", false], [21532, 0.025517, " did", false], [32487, 0.023266, " with", false], [31059, 0.02076, " have", false], [59868, 0.020541, " initially", false], [32227, 0.015692, " that", false], [52112, 0.014657, " learned", false]]], "model_b": [40, 9, 0.012874784879386425, [[32462, 0.125557, " were", false], [22762, 0.116367, " who", false], [21795, 0.037602, " had", false], [55616, 0.022837, " believed", false], [21532, 0.022587, " did", false], [47340, 0.022474, " sought", false], [51770, 0.017576, " focused", false], [47763, 0.014876, " wanted", false], [40, 0.012875, "'", false], [59868, 0.012661, " initially", false]]]}, "raw_delta": -1.078125, "tuned_delta": -1.0252700561018002}, {"byte_start": 2979, "byte_end": 2987, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 517, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"model_a": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[52013, " initial", "normal", 0.09282573312520981]], "model_b": [[52013, " initial", "normal", 0.06403638422489166]]}, "loss": {"model_a": 5.353751128298887, "model_b": 6.199080253819764}, "topk": {"model_a": [52013, 1, 0.09282573312520981, [[52013, 0.092826, " initial", false], [38720, 0.081883, " human", false], [62157, 0.076332, " investment", false], [51566, 0.049973, " efforts", false], [63678, 0.030683, " investments", false], [61701, 0.024596, " commitment", false], [55572, 0.02099, " attempts", false], [64997, 0.019406, " psychological", false], [45294, 0.017786, " belief", false], [65034, 0.017011, " understanding", false]]], "model_b": [52013, 2, 0.06403638422489166, [[51566, 0.067713, " efforts", false], [52013, 0.064036, " initial", false], [45294, 0.040004, " belief", false], [55572, 0.02435, " attempts", false], [65126, 0.020237, " disappointment", false], [63588, 0.020189, " frustration", false], [38499, 0.019099, " first", false], [38530, 0.017722, " focus", false], [59943, 0.014812, " knowledge", false], [51024, 0.012833, " beliefs", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.0059799438981998215}, {"byte_start": 2987, "byte_end": 2994, "display": {"text": " effort", "kind": "normal"}, "is_word": true, "word_id": 518, "word_key": " effort", "bytes_hex": "20 65 66 66 6f 72 74", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"model_a": [[45829, " effort", "normal", 0.004204032011330128]], "model_b": [[45829, " effort", "normal", 0.025776837021112442]]}, "loss": {"model_a": 14.088818758681281, "model_b": 9.419381684375487}, "topk": {"model_a": [45829, 37, 0.004204032011330128, [[51566, 0.136961, " efforts", false], [62157, 0.107512, " investment", false], [63678, 0.058537, " investments", false], [38530, 0.047789, " focus", false], [62500, 0.03476, " resistance", false], [61701, 0.031419, " commitment", false], [55572, 0.023247, " attempts", false], [57077, 0.021367, " reliance", false], [62476, 0.019632, " reluctance", false], [61590, 0.017706, " approaches", false]]], "model_b": [45829, 5, 0.025776837021112442, [[51566, 0.185123, " efforts", false], [45294, 0.062163, " belief", false], [38530, 0.061922, " focus", false], [61947, 0.058583, " enthusiasm", false], [45829, 0.025777, " effort", false], [55532, 0.021129, " approach", false], [55572, 0.020453, " attempts", false], [63588, 0.018992, " frustration", false], [53052, 0.016068, " success", false], [60587, 0.014851, " successes", false]]]}, "raw_delta": 0.2589285714285714, "tuned_delta": 0.31178351532677123}, {"byte_start": 2994, "byte_end": 2998, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 519, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "5.32% 5.32% 5.32% 5.32%", "model_b": "4.24% 4.24% 4.24% 4.24%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.30675947666168213]], "model_b": [[22748, " was", "normal", 0.3829701542854309]]}, "loss": {"model_a": 5.3185290814021835, "model_b": 4.244256651052736}, "topk": {"model_a": [22748, 1, 0.30675947666168213, [[22748, 0.306759, " was", false], [4811, 0.167447, " to", false], [4424, 0.10197, " at", false], [32460, 0.069828, " went", false], [4596, 0.045016, " in", false], [51770, 0.026237, " focused", false], [31162, 0.022044, " into", false], [47518, 0.020572, " tended", false], [4712, 0.019785, " on", false], [21795, 0.014533, " had", false]]], "model_b": [22748, 1, 0.3829701542854309, [[22748, 0.38297, " was", false], [4811, 0.254727, " to", false], [51770, 0.03573, " focused", false], [4596, 0.033717, " in", false], [32460, 0.018231, " went", false], [21795, 0.014544, " had", false], [4424, 0.013753, " at", false], [4712, 0.011013, " on", false], [45, 0.010142, ",", false], [21265, 0.008898, " and", false]]]}, "raw_delta": 0.0595703125, "tuned_delta": 0.11242525639819982}, {"byte_start": 2998, "byte_end": 3007, "display": {"text": " directed", "kind": "normal"}, "is_word": true, "word_id": 520, "word_key": " directed", "bytes_hex": "20 64 69 72 65 63 74 65 64", "compression": {"model_a": "6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45%", "model_b": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57%"}, "model_tokens": {"model_a": [[56002, " directed", "normal", 0.03996158763766289]], "model_b": [[56002, " directed", "normal", 0.06195797398686409]]}, "loss": {"model_a": 6.449548142862987, "model_b": 5.572910531211706}, "topk": {"model_a": [56002, 9, 0.03996158763766289, [[4811, 0.186037, " to", false], [39762, 0.072875, " spent", false], [22187, 0.065529, " not", false], [4596, 0.05974, " in", false], [51459, 0.057461, " devoted", false], [51770, 0.052679, " focused", false], [37810, 0.052238, " based", false], [4712, 0.040471, " on", false], [56002, 0.039962, " directed", false], [56495, 0.029426, " invested", false]]], "model_b": [56002, 2, 0.06195797398686409, [[4811, 0.4423, " to", false], [56002, 0.061958, " directed", false], [37810, 0.060962, " based", false], [51770, 0.037305, " focused", false], [22187, 0.034576, " not", false], [47768, 0.022633, " wasted", false], [60031, 0.018832, " motivated", false], [4712, 0.018682, " on", false], [4596, 0.018653, " in", false], [51459, 0.011715, " devoted", false]]]}, "raw_delta": 0.048611111111111105, "tuned_delta": 0.10146605500931093}, {"byte_start": 3007, "byte_end": 3015, "display": {"text": " towards", "kind": "normal"}, "is_word": true, "word_id": 521, "word_key": " towards", "bytes_hex": "20 74 6f 77 61 72 64 73", "compression": {"model_a": "4.02% 4.02% 4.02% 4.02% 4.02% 4.02% 4.02% 4.02%", "model_b": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%"}, "model_tokens": {"model_a": [[53169, " towards", "normal", 0.16615939140319824]], "model_b": [[53169, " towards", "normal", 0.11246705055236816]]}, "loss": {"model_a": 4.015313346224166, "model_b": 4.931086565538449}, "topk": {"model_a": [53169, 3, 0.16615939140319824, [[4424, 0.327573, " at", false], [47585, 0.223058, " toward", false], [53169, 0.166159, " towards", false], [4811, 0.117189, " to", false], [30211, 0.045436, " away", false], [50870, 0.015371, " against", false], [60247, 0.012907, " primarily", false], [4596, 0.01013, " in", false], [45145, 0.009101, " almost", false], [31162, 0.008167, " into", false]]], "model_b": [53169, 4, 0.11246705055236816, [[4424, 0.413996, " at", false], [47585, 0.201444, " toward", false], [4811, 0.138369, " to", false], [53169, 0.112467, " towards", false], [30211, 0.024814, " away", false], [4450, 0.019434, " by", false], [50870, 0.013145, " against", false], [22187, 0.013034, " not", false], [4596, 0.004708, " in", false], [60247, 0.004479, " primarily", false]]]}, "raw_delta": -0.05078125, "tuned_delta": 0.0020736938981998215}, {"byte_start": 3015, "byte_end": 3025, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 522, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99%", "model_b": "10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93%"}, "model_tokens": {"model_a": [[60720, " utilizing", "normal", 0.0022570525761693716]], "model_b": [[60720, " utilizing", "normal", 0.002348734764382243]]}, "loss": {"model_a": 10.9892786317714, "model_b": 10.932923356736676}, "topk": {"model_a": [60720, 38, 0.0022570525761693716, [[52224, 0.191724, " methods", false], [38720, 0.11504, " human", false], [22590, 0.10269, " the", false], [47202, 0.087525, " search", false], [38888, 0.054431, " lever", false], [55586, 0.043016, " avoiding", false], [61590, 0.023611, " approaches", false], [332, 0.023071, " a", false], [40085, 0.015784, " using", false], [61984, 0.014167, " exploiting", false]]], "model_b": [60720, 54, 0.002348734764382243, [[38888, 0.180919, " lever", false], [22590, 0.054888, " the", false], [55586, 0.052009, " avoiding", false], [56537, 0.03925, " learning", false], [47202, 0.033978, " search", false], [61984, 0.028041, " exploiting", false], [59832, 0.02752, " improving", false], [52224, 0.026551, " methods", false], [38720, 0.025158, " human", false], [40085, 0.024963, " using", false]]]}, "raw_delta": 0.0031250000000000444, "tuned_delta": 0.055979943898199866}, {"byte_start": 3025, "byte_end": 3031, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 523, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "1.09% 1.09% 1.09% 1.09% 1.09% 1.09%", "model_b": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.6973157525062561]], "model_b": [[38720, " human", "normal", 0.3250206410884857]]}, "loss": {"model_a": 1.0918834537977993, "model_b": 3.3813165020835076}, "topk": {"model_a": [38720, 1, 0.6973157525062561, [[38720, 0.697316, " human", false], [39931, 0.118973, " their", false], [22590, 0.047768, " the", false], [59943, 0.0293, " knowledge", false], [47202, 0.011139, " search", false], [32464, 0.005022, " what", false], [39936, 0.004971, " these", false], [46227, 0.004954, " humans", false], [332, 0.004112, " a", false], [52964, 0.00403, " special", false]]], "model_b": [38720, 1, 0.3250206410884857, [[38720, 0.325021, " human", false], [22590, 0.128005, " the", false], [47202, 0.093767, " search", false], [52195, 0.071496, " massive", false], [56537, 0.028395, " learning", false], [39936, 0.025532, " these", false], [32234, 0.02447, " this", false], [39931, 0.022274, " their", false], [59943, 0.018554, " knowledge", false], [30597, 0.017431, " deep", false]]]}, "raw_delta": -0.126953125, "tuned_delta": -0.07409818110180018}, {"byte_start": 3031, "byte_end": 3045, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 524, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"model_a": "4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45%", "model_b": "4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41%"}, "model_tokens": {"model_a": [[65034, " understanding", "normal", 0.03160172328352928]], "model_b": [[65034, " understanding", "normal", 0.03294064849615097]]}, "loss": {"model_a": 4.44804135095509, "model_b": 4.4077875830731434}, "topk": {"model_a": [65034, 2, 0.03160172328352928, [[59943, 0.894852, " knowledge", false], [65034, 0.031602, " understanding", false], [59683, 0.016361, " expertise", false], [46, 0.013313, "-", false], [38786, 0.010587, " input", false], [52022, 0.002075, " insight", false], [59917, 0.002073, " intuition", false], [38013, 0.001814, " chess", false], [31702, 0.001447, " play", false], [45775, 0.001412, " domain", false]]], "model_b": [65034, 4, 0.03294064849615097, [[59943, 0.719563, " knowledge", false], [38786, 0.088319, " input", false], [46, 0.049806, "-", false], [65034, 0.032941, " understanding", false], [59683, 0.009567, " expertise", false], [56537, 0.007388, " learning", false], [47802, 0.006322, " wisdom", false], [52022, 0.005914, " insight", false], [63637, 0.005808, " information", false], [64452, 0.004066, " intelligence", false]]]}, "raw_delta": 0.002232142857142877, "tuned_delta": 0.0550870867553427}, {"byte_start": 3045, "byte_end": 3047, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "39.73% 39.73%", "model_b": "37.76% 37.76%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.012095415964722633]], "model_b": [[275, " (", "normal", 0.015344199724495411]]}, "loss": {"model_a": 39.73046889948122, "model_b": 37.758034273265835}, "topk": {"model_a": [275, 8, 0.012095415964722633, [[4706, 0.442564, " of", false], [45, 0.217553, ",", false], [21265, 0.074389, " and", false], [47, 0.074088, ".", false], [4596, 0.045546, " in", false], [47001, 0.034163, " rather", false], [4811, 0.030743, " to", false], [275, 0.012095, " (", false], [4423, 0.009831, " as", false], [52028, 0.00697, " instead", false]]], "model_b": [275, 9, 0.015344199724495411, [[4706, 0.500958, " of", false], [45, 0.12409, ",", false], [4811, 0.087217, " to", false], [47, 0.0592, ".", false], [21265, 0.043449, " and", false], [4596, 0.040769, " in", false], [4423, 0.028657, " as", false], [47001, 0.026536, " rather", false], [275, 0.015344, " (", false], [21700, 0.011701, " for", false]]]}, "raw_delta": 0.109375, "tuned_delta": 0.16222994389819984}, {"byte_start": 3047, "byte_end": 3049, "display": {"text": "so", "kind": "normal"}, "is_word": true, "word_id": 525, "word_key": "so", "bytes_hex": "73 6f", "compression": {"model_a": "50.16% 50.16%", "model_b": "52.69% 52.69%"}, "model_tokens": {"model_a": [[2190, "so", "normal", 0.0037951830308884382]], "model_b": [[2190, "so", "normal", 0.0028974430169910192]]}, "loss": {"model_a": 50.156194780905366, "model_b": 52.692182157468}, "topk": {"model_a": [2190, 38, 0.0037951830308884382, [[2101, 0.098914, "or", false], [1950, 0.089274, "in", false], [7005, 0.087096, "and", false], [2090, 0.055693, "of", false], [36003, 0.051255, "which", false], [1751, 0.045923, "as", false], [8801, 0.033271, "the", false], [98, 0.022873, "a", false], [102, 0.016843, "e", false], [42135, 0.016155, "rather", false]]], "model_b": [2190, 40, 0.0028974430169910192, [[2101, 0.132615, "or", false], [7005, 0.124689, "and", false], [1950, 0.066841, "in", false], [36003, 0.057641, "which", false], [1751, 0.049002, "as", false], [8801, 0.039061, "the", false], [2090, 0.028748, "of", false], [58313, 0.028488, "knowledge", false], [42233, 0.016595, "search", false], [42135, 0.01549, "rather", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08777005610180018}, {"byte_start": 3049, "byte_end": 3054, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 526, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "6.68% 6.68% 6.68% 6.68% 6.68%", "model_b": "3.97% 3.97% 3.97% 3.97% 3.97%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.15592114627361298]], "model_b": [[32227, " that", "normal", 0.33469370007514954]]}, "loss": {"model_a": 6.678100091614928, "model_b": 3.9730468899481215}, "topk": {"model_a": [32227, 2, 0.15592114627361298, [[46, 0.32385, "-", false], [32227, 0.155921, " that", false], [4423, 0.088511, " as", false], [45395, 0.069005, " called", false], [32232, 0.053603, " they", false], [22590, 0.022251, " the", false], [31466, 0.020639, " much", false], [45, 0.019847, ",", false], [4811, 0.019634, " to", false], [21660, 0.017661, " far", false]]], "model_b": [32227, 1, 0.33469370007514954, [[32227, 0.334694, " that", false], [46, 0.153347, "-", false], [32232, 0.073834, " they", false], [4811, 0.059866, " to", false], [4423, 0.057139, " as", false], [22590, 0.029961, " the", false], [45395, 0.028907, " called", false], [31466, 0.026366, " much", false], [21660, 0.01791, " far", false], [4601, 0.017564, " it", false]]]}, "raw_delta": 0.15, "tuned_delta": 0.2028549438981998}, {"byte_start": 3054, "byte_end": 3059, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 527, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"model_a": "26.49% 26.49% 26.49% 26.49% 26.49%", "model_b": "23.89% 23.89% 23.89% 23.89% 23.89%"}, "model_tokens": {"model_a": [[31277, " less", "normal", 0.0006553056300617754]], "model_b": [[31277, " less", "normal", 0.001320666866376996]]}, "loss": {"model_a": 26.48697926632081, "model_b": 23.894636614723453}, "topk": {"model_a": [31277, 93, 0.0006553056300617754, [[22590, 0.21128, " the", false], [32232, 0.111678, " they", false], [47202, 0.103913, " search", false], [4601, 0.062402, " it", false], [56537, 0.039403, " learning", false], [332, 0.037003, " a", false], [38720, 0.026984, " human", false], [39931, 0.024003, " their", false], [45, 0.022713, ",", false], [46227, 0.017999, " humans", false]]], "model_b": [31277, 61, 0.001320666866376996, [[32232, 0.250544, " they", false], [22590, 0.170599, " the", false], [47202, 0.051605, " search", false], [39931, 0.044297, " their", false], [4601, 0.036776, " it", false], [332, 0.029244, " a", false], [38720, 0.025757, " human", false], [45, 0.016534, ",", false], [56537, 0.015655, " learning", false], [46227, 0.014126, " humans", false]]]}, "raw_delta": 0.14375000000000004, "tuned_delta": 0.19660494389819988}, {"byte_start": 3059, "byte_end": 3066, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 528, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "model_b": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.07276514172554016]], "model_b": [[47202, " search", "normal", 0.03395988047122955]]}, "loss": {"model_a": 6.762633004167015, "model_b": 8.735067630382394}, "topk": {"model_a": [47202, 3, 0.07276514172554016, [[63370, 0.297344, " computation", false], [52195, 0.088123, " massive", false], [47202, 0.072765, " search", false], [45829, 0.071532, " effort", false], [56537, 0.046744, " learning", false], [32251, 0.046004, " time", false], [4706, 0.036649, " of", false], [59346, 0.028044, " computing", false], [22748, 0.025192, " was", false], [38720, 0.020752, " human", false]]], "model_b": [47202, 7, 0.03395988047122955, [[63370, 0.226618, " computation", false], [45829, 0.090605, " effort", false], [38720, 0.061999, " human", false], [64862, 0.047647, " computational", false], [52195, 0.04743, " massive", false], [59346, 0.04411, " computing", false], [47202, 0.03396, " search", false], [32251, 0.033431, " time", false], [4706, 0.018111, " of", false], [46, 0.017983, "-", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 3066, "byte_end": 3070, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 529, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "3.68% 3.68% 3.68% 3.68%", "model_b": "3.79% 3.79% 3.79% 3.79%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.4389701783657074]], "model_b": [[22748, " was", "normal", 0.42982035875320435]]}, "loss": {"model_a": 3.6807039007054847, "model_b": 3.7863700413955943}, "topk": {"model_a": [22748, 1, 0.4389701783657074, [[22748, 0.43897, " was", false], [40219, 0.269956, " would", false], [38128, 0.056983, " could", false], [21265, 0.05322, " and", false], [4715, 0.035353, " or", false], [21795, 0.031574, " had", false], [4600, 0.017243, " is", false], [32251, 0.013911, " time", false], [31506, 0.013826, " need", false], [45829, 0.013074, " effort", false]]], "model_b": [22748, 1, 0.42982035875320435, [[22748, 0.42982, " was", false], [40219, 0.174897, " would", false], [38128, 0.115432, " could", false], [21265, 0.051271, " and", false], [4600, 0.045448, " is", false], [39021, 0.034326, " might", false], [45, 0.021801, ",", false], [45829, 0.014574, " effort", false], [46, 0.014464, "-", false], [22074, 0.008019, " may", false]]]}, "raw_delta": -0.005859375, "tuned_delta": 0.04699556889819982}, {"byte_start": 3070, "byte_end": 3077, "display": {"text": " needed", "kind": "normal"}, "is_word": true, "word_id": 530, "word_key": " needed", "bytes_hex": "20 6e 65 65 64 65 64", "compression": {"model_a": "1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88%", "model_b": "1.79% 1.79% 1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"model_a": [[46650, " needed", "normal", 0.4814949631690979]], "model_b": [[46650, " needed", "normal", 0.4988114535808563]]}, "loss": {"model_a": 1.881863648481, "model_b": 1.7912926707466197}, "topk": {"model_a": [46650, 1, 0.4814949631690979, [[46650, 0.481495, " needed", false], [57101, 0.351842, " required", false], [60050, 0.122763, " necessary", false], [30666, 0.007482, " done", false], [56500, 0.005819, " involved", false], [55448, 0.004922, " actually", false], [60152, 0.003836, " performed", false], [32354, 0.002661, " used", false], [56895, 0.001517, " possible", false], [37832, 0.001117, " being", false]]], "model_b": [46650, 1, 0.4988114535808563, [[46650, 0.498811, " needed", false], [57101, 0.215886, " required", false], [60050, 0.093838, " necessary", false], [30666, 0.042643, " done", false], [60152, 0.027101, " performed", false], [32354, 0.023332, " used", false], [56895, 0.013414, " possible", false], [59206, 0.006696, " available", false], [50937, 0.005228, " applied", false], [37832, 0.004849, " being", false]]]}, "raw_delta": 0.0050223214285714385, "tuned_delta": 0.05787726532677126}, {"byte_start": 3077, "byte_end": 3078, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "19.44%", "model_b": "20.15%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.3401392102241516]], "model_b": [[42, ")", "normal", 0.33101072907447815]]}, "loss": {"model_a": 19.44256988698017, "model_b": 20.147010824914233}, "topk": {"model_a": [42, 2, 0.3401392102241516, [[497, 0.364409, "),", false], [42, 0.340139, ")", false], [499, 0.119132, ").", false], [45, 0.052473, ",", false], [4811, 0.043008, " to", false], [21265, 0.017023, " and", false], [502, 0.009541, ");", false], [4596, 0.009236, " in", false], [4715, 0.008596, " or", false], [21700, 0.008153, " for", false]]], "model_b": [42, 1, 0.33101072907447815, [[42, 0.331011, ")", false], [497, 0.274755, "),", false], [499, 0.140964, ").", false], [4811, 0.060251, " to", false], [45, 0.059308, ",", false], [21265, 0.040597, " and", false], [4596, 0.020406, " in", false], [21700, 0.012211, " for", false], [502, 0.008167, ");", false], [32226, 0.007011, " than", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.013792443898199822}, {"byte_start": 3078, "byte_end": 3082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 531, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "5.00% 5.00% 5.00% 5.00%", "model_b": "5.35% 5.35% 5.35% 5.35%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.3284440338611603]], "model_b": [[21265, " and", "normal", 0.30312976241111755]]}, "loss": {"model_a": 5.001530659331855, "model_b": 5.353751128298887}, "topk": {"model_a": [21265, 1, 0.3284440338611603, [[21265, 0.328444, " and", false], [47001, 0.248453, " rather", false], [21400, 0.195238, " but", false], [4715, 0.081953, " or", false], [40187, 0.020975, " while", false], [4596, 0.01556, " in", false], [52028, 0.014116, " instead", false], [4423, 0.01289, " as", false], [45285, 0.010617, " before", false], [4811, 0.006185, " to", false]]], "model_b": [21265, 1, 0.30312976241111755, [[21265, 0.30313, " and", false], [21400, 0.241492, " but", false], [47001, 0.148247, " rather", false], [4715, 0.07433, " or", false], [4811, 0.041842, " to", false], [4596, 0.035144, " in", false], [4423, 0.022246, " as", false], [52028, 0.017011, " instead", false], [53356, 0.010272, " without", false], [4450, 0.009241, " by", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03332369389819982}, {"byte_start": 3082, "byte_end": 3087, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 532, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "10.88% 10.88% 10.88% 10.88% 10.88%", "model_b": "19.84% 19.84% 19.84% 19.84% 19.84%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.04921281337738037]], "model_b": [[31581, " only", "normal", 0.004124380182474852]]}, "loss": {"model_a": 10.87656808170195, "model_b": 19.837056812223246}, "topk": {"model_a": [31581, 6, 0.04921281337738037, [[32230, 0.10532, " then", false], [32234, 0.069656, " this", false], [22590, 0.065466, " the", false], [56537, 0.064435, " learning", false], [45, 0.053056, ",", false], [31581, 0.049213, " only", false], [32232, 0.042007, " they", false], [4601, 0.030335, " it", false], [32227, 0.029828, " that", false], [22187, 0.023035, " not", false]]], "model_b": [31581, 34, 0.004124380182474852, [[32230, 0.120086, " then", false], [56537, 0.053762, " learning", false], [22590, 0.048672, " the", false], [45, 0.031856, ",", false], [4811, 0.028595, " to", false], [53169, 0.024912, " towards", false], [38869, 0.02452, " later", false], [4596, 0.024161, " in", false], [32227, 0.022255, " that", false], [38720, 0.021751, " human", false]]]}, "raw_delta": -0.49687500000000007, "tuned_delta": -0.44402005610180023}, {"byte_start": 3087, "byte_end": 3092, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 533, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55% 11.55%", "model_b": "18.48% 18.48% 18.48% 18.48% 18.48%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.04058396443724632]], "model_b": [[31466, " much", "normal", 0.00587884709239006]]}, "loss": {"model_a": 11.55283138211865, "model_b": 18.48453021138984}, "topk": {"model_a": [31466, 3, 0.04058396443724632, [[38869, 0.5323, " later", false], [37634, 0.080866, " after", false], [31466, 0.040584, " much", false], [32465, 0.036145, " when", false], [32230, 0.034983, " then", false], [47205, 0.033126, " second", false], [61552, 0.025154, " afterwards", false], [4596, 0.019905, " in", false], [4424, 0.014152, " at", false], [59771, 0.011203, " gradually", false]]], "model_b": [31466, 21, 0.00587884709239006, [[38869, 0.429606, " later", false], [32230, 0.061926, " then", false], [37634, 0.051809, " after", false], [32465, 0.026133, " when", false], [4596, 0.019722, " in", false], [4811, 0.016104, " to", false], [47205, 0.014005, " second", false], [22590, 0.012353, " the", false], [59771, 0.012288, " gradually", false], [45283, 0.012276, " became", false]]]}, "raw_delta": -0.3843749999999999, "tuned_delta": -0.3315200561018001}, {"byte_start": 3092, "byte_end": 3098, "display": {"text": " later", "kind": "normal"}, "is_word": true, "word_id": 534, "word_key": " later", "bytes_hex": "20 6c 61 74 65 72", "compression": {"model_a": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06%", "model_b": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"model_a": [[38869, " later", "normal", 0.9786133170127869]], "model_b": [[38869, " later", "normal", 0.9137549996376038]]}, "loss": {"model_a": 0.06494064896579653, "model_b": 0.27003569287472456}, "topk": {"model_a": [38869, 1, 0.9786133170127869, [[38869, 0.978613, " later", false], [31458, 0.010601, " more", false], [45, 0.002514, ",", false], [46405, 0.001275, " latter", false], [31466, 0.001033, " much", false], [31277, 0.000933, " less", false], [51816, 0.000661, " further", false], [61552, 0.000637, " afterwards", false], [31255, 0.000468, " late", false], [64580, 0.000449, " subsequently", false]]], "model_b": [38869, 1, 0.9137549996376038, [[38869, 0.913755, " later", false], [31458, 0.041458, " more", false], [31277, 0.014214, " less", false], [45, 0.008385, ",", false], [45683, 0.002452, " deeper", false], [31466, 0.002423, " much", false], [51816, 0.001994, " further", false], [37634, 0.001938, " after", false], [4706, 0.001879, " of", false], [46470, 0.001099, " longer", false]]]}, "raw_delta": -0.011372884114583334, "tuned_delta": 0.041482059783616486}, {"byte_start": 3098, "byte_end": 3102, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 535, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "10.21% 10.21% 10.21% 10.21%", "model_b": "15.29% 15.29% 15.29% 15.29%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.10333471745252609]], "model_b": [[22748, " was", "normal", 0.0338088795542717]]}, "loss": {"model_a": 10.214393600043929, "model_b": 15.286368353169191}, "topk": {"model_a": [22748, 2, 0.10333471745252609, [[21532, 0.522922, " did", false], [22748, 0.103335, " was", false], [32462, 0.102123, " were", false], [45, 0.076492, ",", false], [53169, 0.028261, " towards", false], [47585, 0.014457, " toward", false], [275, 0.011006, " (", false], [30383, 0.010852, " came", false], [47638, 0.007237, " turned", false], [52112, 0.007163, " learned", false]]], "model_b": [22748, 5, 0.0338088795542717, [[21532, 0.263094, " did", false], [45, 0.147636, ",", false], [32462, 0.063005, " were", false], [32232, 0.037539, " they", false], [22748, 0.033809, " was", false], [37828, 0.029368, " began", false], [4596, 0.028505, " in", false], [4811, 0.022908, " to", false], [52112, 0.020956, " learned", false], [56537, 0.018457, " learning", false]]]}, "raw_delta": -0.28125, "tuned_delta": -0.22839505610180016}, {"byte_start": 3102, "byte_end": 3107, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 536, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "20.63% 20.63% 20.63% 20.63% 20.63%", "model_b": "18.15% 18.15% 18.15% 18.15% 18.15%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.0032405531965196133]], "model_b": [[31466, " much", "normal", 0.006635008379817009]]}, "loss": {"model_a": 20.626030662709397, "model_b": 18.146398561181492}, "topk": {"model_a": [31466, 21, 0.0032405531965196133, [[22590, 0.224024, " the", false], [56537, 0.170707, " learning", false], [4601, 0.158828, " it", false], [47202, 0.075603, " search", false], [32234, 0.037187, " this", false], [39934, 0.036405, " there", false], [39931, 0.032338, " their", false], [32227, 0.028434, " that", false], [51832, 0.019009, " general", false], [332, 0.016534, " a", false]]], "model_b": [31466, 17, 0.006635008379817009, [[22590, 0.254605, " the", false], [4601, 0.185147, " it", false], [56537, 0.078256, " learning", false], [59193, 0.053329, " attention", false], [332, 0.04189, " a", false], [39931, 0.038741, " their", false], [32234, 0.030966, " this", false], [32232, 0.029968, " they", false], [39934, 0.027982, " there", false], [32227, 0.019616, " that", false]]]}, "raw_delta": 0.13749999999999996, "tuned_delta": 0.1903549438981998}, {"byte_start": 3107, "byte_end": 3115, "display": {"text": " greater", "kind": "normal"}, "is_word": true, "word_id": 537, "word_key": " greater", "bytes_hex": "20 67 72 65 61 74 65 72", "compression": {"model_a": "7.89% 7.89% 7.89% 7.89% 7.89% 7.89% 7.89% 7.89%", "model_b": "11.13% 11.13% 11.13% 11.13% 11.13% 11.13% 11.13% 11.13%"}, "model_tokens": {"model_a": [[51867, " greater", "normal", 0.030625106766819954]], "model_b": [[51867, " greater", "normal", 0.007241510320454836]]}, "loss": {"model_a": 7.889738504861517, "model_b": 11.130166819358212}, "topk": {"model_a": [51867, 5, 0.030625106766819954, [[31458, 0.306286, " more", false], [4706, 0.215451, " of", false], [45829, 0.107686, " effort", false], [47202, 0.051433, " search", false], [51867, 0.030625, " greater", false], [31277, 0.028215, " less", false], [56537, 0.026787, " learning", false], [59193, 0.02469, " attention", false], [45683, 0.014824, " deeper", false], [45301, 0.013976, " better", false]]], "model_b": [51867, 12, 0.007241510320454836, [[4706, 0.384006, " of", false], [31458, 0.135944, " more", false], [45829, 0.113871, " effort", false], [59193, 0.08905, " attention", false], [57103, 0.019762, " research", false], [56537, 0.016612, " learning", false], [45683, 0.015143, " deeper", false], [56103, 0.009252, " emphasis", false], [56950, 0.008578, " progress", false], [31277, 0.008147, " less", false]]]}, "raw_delta": -0.1796875, "tuned_delta": -0.12683255610180016}, {"byte_start": 3115, "byte_end": 3123, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 538, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"model_a": "4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86%", "model_b": "12.33% 12.33% 12.33% 12.33% 12.33% 12.33% 12.33% 12.33%"}, "model_tokens": {"model_a": [[53052, " success", "normal", 0.1148604080080986]], "model_b": [[53052, " success", "normal", 0.004178218077868223]]}, "loss": {"model_a": 4.8606424717450425, "model_b": 12.327716413846122}, "topk": {"model_a": [53052, 3, 0.1148604080080986, [[45829, 0.180634, " effort", false], [56950, 0.122517, " progress", false], [53052, 0.11486, " success", false], [64902, 0.051505, " effectiveness", false], [47202, 0.048972, " search", false], [63370, 0.045676, " computation", false], [64862, 0.032152, " computational", false], [51030, 0.02386, " benefit", false], [59346, 0.019677, " computing", false], [22681, 0.018528, " use", false]]], "model_b": [53052, 20, 0.004178218077868223, [[45829, 0.337204, " effort", false], [59193, 0.154845, " attention", false], [56103, 0.088014, " emphasis", false], [63370, 0.035732, " computation", false], [64862, 0.03507, " computational", false], [59346, 0.033101, " computing", false], [57077, 0.028513, " reliance", false], [38530, 0.026895, " focus", false], [22681, 0.018707, " use", false], [56950, 0.014957, " progress", false]]]}, "raw_delta": -0.4140625, "tuned_delta": -0.36120755610180016}, {"byte_start": 3123, "byte_end": 3127, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 539, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"model_a": "15.57% 15.57% 15.57% 15.57%", "model_b": "30.71% 30.71% 30.71% 30.71%"}, "model_tokens": {"model_a": [[21795, " had", "normal", 0.031969696283340454]], "model_b": [[21795, " had", "normal", 0.001098484150134027]]}, "loss": {"model_a": 15.568144728342816, "model_b": 30.713624893925193}, "topk": {"model_a": [21795, 6, 0.031969696283340454, [[55437, 0.462154, " achieved", false], [38547, 0.090741, " found", false], [56741, 0.071586, " obtained", false], [57027, 0.062898, " realized", false], [31968, 0.051986, " seen", false], [21795, 0.03197, " had", false], [55571, 0.027564, " attained", false], [4596, 0.018296, " in", false], [56895, 0.015362, " possible", false], [51097, 0.014334, " brought", false]]], "model_b": [21795, 64, 0.001098484150134027, [[55437, 0.349075, " achieved", false], [57027, 0.17274, " realized", false], [56741, 0.036873, " obtained", false], [31968, 0.028171, " seen", false], [55571, 0.027184, " attained", false], [4596, 0.023454, " in", false], [38547, 0.022523, " found", false], [52643, 0.017719, " reached", false], [61618, 0.016802, " attributed", false], [21572, 0.016055, " due", false]]]}, "raw_delta": -0.83984375, "tuned_delta": -0.7869888061018002}, {"byte_start": 3127, "byte_end": 3130, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 540, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "7.47% 7.47% 7.47%", "model_b": "18.60% 18.60% 18.60%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.28907766938209534]], "model_b": [[4450, " by", "normal", 0.044994913041591644]]}, "loss": {"model_a": 7.467073942101079, "model_b": 18.597240761459293}, "topk": {"model_a": [4450, 2, 0.28907766938209534, [[32487, 0.32666, " with", false], [4450, 0.289078, " by", false], [4596, 0.110763, " in", false], [30917, 0.035458, " from", false], [32465, 0.030839, " when", false], [30259, 0.027934, " been", false], [40085, 0.022588, " using", false], [4712, 0.014818, " on", false], [4811, 0.01341, " to", false], [53140, 0.010716, " through", false]]], "model_b": [4450, 6, 0.044994913041591644, [[30259, 0.24952, " been", false], [4811, 0.16244, " to", false], [47, 0.10919, ".", false], [32487, 0.060841, " with", false], [4596, 0.056299, " in", false], [4450, 0.044995, " by", false], [22590, 0.028662, " the", false], [332, 0.0284, " a", false], [55437, 0.021987, " achieved", false], [32465, 0.01813, " when", false]]]}, "raw_delta": -0.6171875, "tuned_delta": -0.5643325561018002}, {"byte_start": 3130, "byte_end": 3140, "display": {"text": " embracing", "kind": "normal"}, "is_word": true, "word_id": 541, "word_key": " embracing", "bytes_hex": "20 65 6d 62 72 61 63 69 6e 67", "compression": {"model_a": "8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40%", "model_b": "12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06%"}, "model_tokens": {"model_a": [[59611, " embracing", "normal", 0.009467663243412971]], "model_b": [[59611, " embracing", "normal", 0.0012345211580395699]]}, "loss": {"model_a": 8.396935980174046, "model_b": 12.06002885743118}, "topk": {"model_a": [59611, 23, 0.009467663243412971, [[40085, 0.100543, " using", false], [38888, 0.087163, " lever", false], [56537, 0.071316, " learning", false], [60720, 0.059614, " utilizing", false], [22590, 0.049918, " the", false], [47497, 0.042605, " taking", false], [55531, 0.033217, " applying", false], [47285, 0.024513, " simply", false], [332, 0.022889, " a", false], [39944, 0.019717, " those", false]]], "model_b": [59611, 43, 0.0012345211580395699, [[38888, 0.567971, " lever", false], [40085, 0.047167, " using", false], [55531, 0.036529, " applying", false], [47497, 0.032738, " taking", false], [60720, 0.025477, " utilizing", false], [22590, 0.017222, " the", false], [56537, 0.013585, " learning", false], [52700, 0.01167, " relying", false], [47285, 0.010732, " simply", false], [46500, 0.008393, " making", false]]]}, "raw_delta": -0.20312499999999994, "tuned_delta": -0.1502700561018001}, {"byte_start": 3140, "byte_end": 3147, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 542, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88%", "model_b": "5.31% 5.31% 5.31% 5.31% 5.31% 5.31% 5.31%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.4831279218196869]], "model_b": [[47202, " search", "normal", 0.12691177427768707]]}, "loss": {"model_a": 1.881863648481, "model_b": 5.313497360416941}, "topk": {"model_a": [47202, 1, 0.4831279218196869, [[47202, 0.483128, " search", false], [22590, 0.181751, " the", false], [52195, 0.070888, " massive", false], [56537, 0.045163, " learning", false], [21265, 0.040137, " and", false], [51832, 0.025596, " general", false], [332, 0.021506, " a", false], [63370, 0.015284, " computation", false], [31458, 0.005894, " more", false], [37920, 0.005595, " brute", false]]], "model_b": [47202, 3, 0.12691177427768707, [[51832, 0.206579, " general", false], [22590, 0.134588, " the", false], [47202, 0.126912, " search", false], [56537, 0.072195, " learning", false], [332, 0.060285, " a", false], [52195, 0.045068, " massive", false], [52224, 0.02428, " methods", false], [31978, 0.020413, " self", false], [63370, 0.019964, " computation", false], [31458, 0.019322, " more", false]]]}, "raw_delta": -0.19029017857142858, "tuned_delta": -0.13743523467322877}, {"byte_start": 3147, "byte_end": 3151, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 543, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "7.33% 7.33% 7.33% 7.33%", "model_b": "7.01% 7.01% 7.01% 7.01%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.1965981274843216]], "model_b": [[21265, " and", "normal", 0.2153063714504242]]}, "loss": {"model_a": 7.326185754514267, "model_b": 7.009187332443938}, "topk": {"model_a": [21265, 2, 0.1965981274843216, [[47, 0.420886, ".", false], [21265, 0.196598, " and", false], [4423, 0.091405, " as", false], [45, 0.049085, ",", false], [275, 0.046199, " (", false], [4596, 0.016105, " in", false], [46, 0.015989, "-", false], [32487, 0.013734, " with", false], [31458, 0.010294, " more", false], [4811, 0.010245, " to", false]]], "model_b": [21265, 2, 0.2153063714504242, [[47, 0.32488, ".", false], [21265, 0.215306, " and", false], [275, 0.057303, " (", false], [4423, 0.054973, " as", false], [46, 0.053612, "-", false], [45, 0.043802, ",", false], [4596, 0.029199, " in", false], [52224, 0.022313, " methods", false], [37810, 0.016249, " based", false], [21700, 0.015659, " for", false]]]}, "raw_delta": 0.017578125, "tuned_delta": 0.07043306889819982}, {"byte_start": 3151, "byte_end": 3160, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 544, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%", "model_b": "1.68% 1.68% 1.68% 1.68% 1.68% 1.68% 1.68% 1.68% 1.68%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.6964988708496094]], "model_b": [[56537, " learning", "normal", 0.42830225825309753]]}, "loss": {"model_a": 0.7279223025318663, "model_b": 1.6828311295091531}, "topk": {"model_a": [56537, 1, 0.6964988708496094, [[56537, 0.696499, " learning", false], [31978, 0.052996, " self", false], [38888, 0.037265, " lever", false], [22590, 0.024436, " the", false], [21902, 0.01879, " its", false], [45, 0.009798, ",", false], [4450, 0.009575, " by", false], [40085, 0.007089, " using", false], [52195, 0.00683, " massive", false], [51832, 0.005054, " general", false]]], "model_b": [56537, 1, 0.42830225825309753, [[56537, 0.428302, " learning", false], [38888, 0.165778, " lever", false], [51832, 0.041314, " general", false], [31978, 0.024467, " self", false], [22590, 0.021826, " the", false], [40085, 0.020884, " using", false], [63370, 0.018313, " computation", false], [39193, 0.010507, " other", false], [59346, 0.009369, " computing", false], [30597, 0.009046, " deep", false]]]}, "raw_delta": -0.05295138888888889, "tuned_delta": -9.644499068906659e-05}, {"byte_start": 3160, "byte_end": 3161, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "6.73%", "model_b": "8.24%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6872859001159668]], "model_b": [[47, ".", "normal", 0.631603479385376]]}, "loss": {"model_a": 6.727410957270312, "model_b": 8.24195897382855}, "topk": {"model_a": [47, 1, 0.6872859001159668, [[47, 0.687286, ".", false], [4423, 0.058165, " as", false], [45, 0.041269, ",", false], [4450, 0.040108, " by", false], [275, 0.023795, " (", false], [4596, 0.018244, " in", false], [21265, 0.011694, " and", false], [4811, 0.010193, " to", false], [31458, 0.007948, " more", false], [52028, 0.007272, " instead", false]]], "model_b": [47, 1, 0.631603479385376, [[47, 0.631603, ".", false], [275, 0.051979, " (", false], [4450, 0.039089, " by", false], [45, 0.037884, ",", false], [4423, 0.034968, " as", false], [4596, 0.026681, " in", false], [52224, 0.017134, " methods", false], [4811, 0.013264, " to", false], [21700, 0.01307, " for", false], [21265, 0.01139, " and", false]]]}, "raw_delta": -0.083984375, "tuned_delta": -0.03112943110180018}, {"byte_start": 3161, "byte_end": 3162, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "4.21%", "model_b": "6.52%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.6307504773139954]], "model_b": [[261, "\n\n", "control", 0.4876733124256134]]}, "loss": {"model_a": 4.209034604156033, "model_b": 6.516078675890093}, "topk": {"model_a": [261, 1, 0.6307504773139954, [[261, 0.63075, "\n\n", false], [20996, 0.044753, " The", false], [267, 0.039294, "  ", false], [29894, 0.019569, " This", false], [3913, 0.018587, " In", false], [3918, 0.014513, " It", false], [3336, 0.012605, " \n\n", false], [19417, 0.011705, " And", false], [19555, 0.01022, " But", false], [0, 0.009259, "[0]", false]]], "model_b": [261, 1, 0.4876733124256134, [[261, 0.487673, "\n\n", false], [267, 0.070869, "  ", false], [20996, 0.046998, " The", false], [3913, 0.044231, " In", false], [11, 0.043138, "\n", false], [29894, 0.030869, " This", false], [3336, 0.019602, " \n\n", false], [3918, 0.012731, " It", false], [19417, 0.010886, " And", false], [37453, 0.007772, " These", false]]]}, "raw_delta": -0.1279296875, "tuned_delta": -0.07507474360180018}, {"byte_start": 3162, "byte_end": 3163, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "4.21%", "model_b": "6.52%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.6307504773139954]], "model_b": [[261, "\n\n", "control", 0.4876733124256134]]}, "loss": {"model_a": 4.209034604156033, "model_b": 6.516078675890093}, "topk": {"model_a": [261, 1, 0.6307504773139954, [[261, 0.63075, "\n\n", false], [20996, 0.044753, " The", false], [267, 0.039294, "  ", false], [29894, 0.019569, " This", false], [3913, 0.018587, " In", false], [3918, 0.014513, " It", false], [3336, 0.012605, " \n\n", false], [19417, 0.011705, " And", false], [19555, 0.01022, " But", false], [0, 0.009259, "[0]", false]]], "model_b": [261, 1, 0.4876733124256134, [[261, 0.487673, "\n\n", false], [267, 0.070869, "  ", false], [20996, 0.046998, " The", false], [3913, 0.044231, " In", false], [11, 0.043138, "\n", false], [29894, 0.030869, " This", false], [3336, 0.019602, " \n\n", false], [3918, 0.012731, " It", false], [19417, 0.010886, " And", false], [37453, 0.007772, " These", false]]]}, "raw_delta": -0.1279296875, "tuned_delta": -0.07507474360180018}, {"byte_start": 3163, "byte_end": 3165, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 545, "word_key": "in", "bytes_hex": "49 6e", "compression": {"model_a": "16.41% 16.41%", "model_b": "15.08% 15.08%"}, "model_tokens": {"model_a": [[1136, "In", "normal", 0.16085301339626312]], "model_b": [[1136, "In", "normal", 0.187474325299263]]}, "loss": {"model_a": 16.413473853863692, "model_b": 15.075036071788972}, "topk": {"model_a": [1136, 2, 0.16085301339626312, [[6699, 0.161621, "The", false], [1136, 0.160853, "In", false], [66, 0.093996, "A", false], [48358, 0.057582, "Another", false], [33504, 0.042712, "There", false], [1141, 0.024949, "It", false], [24242, 0.016711, "This", false], [33505, 0.015496, "These", false], [6393, 0.014343, "One", false], [849, 0.011995, "An", false]]], "model_b": [1136, 1, 0.187474325299263, [[1136, 0.187474, "In", false], [6699, 0.165424, "The", false], [66, 0.057961, "A", false], [24242, 0.02953, "This", false], [33504, 0.028861, "There", false], [48358, 0.024581, "Another", false], [53454, 0.022711, "Computer", false], [6393, 0.014744, "One", false], [1141, 0.014385, "It", false], [820, 0.013886, "AI", false]]]}, "raw_delta": 0.07421875, "tuned_delta": 0.12707369389819984}, {"byte_start": 3165, "byte_end": 3172, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 546, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"model_a": "12.64% 12.64% 12.64% 12.64% 12.64% 12.64% 12.64%", "model_b": "16.75% 16.75% 16.75% 16.75% 16.75% 16.75% 16.75%"}, "model_tokens": {"model_a": [[47350, " speech", "normal", 0.007453210651874542]], "model_b": [[47350, " speech", "normal", 0.0015016007237136364]]}, "loss": {"model_a": 12.639683114931204, "model_b": 16.745567438889754}, "topk": {"model_a": [47350, 20, 0.007453210651874542, [[55809, 0.295079, " computer", false], [22590, 0.130867, " the", false], [52299, 0.045557, " natural", false], [52766, 0.045393, " robotic", false], [3492, 0.035421, " 19", false], [52167, 0.026084, " machine", false], [3609, 0.021454, " AI", false], [51832, 0.01953, " general", false], [3493, 0.017224, " 20", false], [332, 0.01613, " a", false]]], "model_b": [47350, 52, 0.0015016007237136364, [[55809, 0.375784, " computer", false], [22590, 0.111634, " the", false], [52167, 0.044856, " machine", false], [3609, 0.035944, " AI", false], [65003, 0.029932, " reinforcement", false], [39193, 0.017296, " other", false], [30322, 0.016643, " both", false], [332, 0.012923, " a", false], [50919, 0.01056, " another", false], [31370, 0.010372, " many", false]]]}, "raw_delta": -0.22767857142857156, "tuned_delta": -0.17482362753037173}, {"byte_start": 3172, "byte_end": 3184, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 547, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"model_a": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%", "model_b": "0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76%"}, "model_tokens": {"model_a": [[63821, " recognition", "normal", 0.869993269443512]], "model_b": [[63821, " recognition", "normal", 0.6027653217315674]]}, "loss": {"model_a": 0.20839711080549397, "model_b": 0.757274008279119}, "topk": {"model_a": [63821, 1, 0.869993269443512, [[63821, 0.869993, " recognition", false], [21265, 0.025087, " and", false], [45, 0.023497, ",", false], [62378, 0.020885, " processing", false], [46, 0.017787, "-", false], [60615, 0.012659, " synthesis", false], [65034, 0.010875, " understanding", false], [62035, 0.002806, " generation", false], [63944, 0.00247, " translation", false], [62634, 0.001285, " technology", false]]], "model_b": [63821, 1, 0.6027653217315674, [[63821, 0.602765, " recognition", false], [46, 0.101487, "-", false], [21265, 0.070219, " and", false], [60615, 0.069978, " synthesis", false], [62378, 0.034364, " processing", false], [45, 0.030477, ",", false], [65034, 0.019338, " understanding", false], [60335, 0.011133, " recognize", false], [56529, 0.00574, " language", false], [62634, 0.00325, " technology", false]]]}, "raw_delta": -0.030436197916666668, "tuned_delta": 0.022418745981533154}, {"byte_start": 3184, "byte_end": 3185, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.75%", "model_b": "3.15%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8576618432998657]], "model_b": [[45, ",", "normal", 0.8389545679092407]]}, "loss": {"model_a": 2.74731965794285, "model_b": 3.1523731972549367}, "topk": {"model_a": [45, 1, 0.8576618432998657, [[45, 0.857662, ",", false], [21265, 0.070864, " and", false], [275, 0.010603, " (", false], [22590, 0.008603, " the", false], [57103, 0.007125, " research", false], [39934, 0.006761, " there", false], [4601, 0.003311, " it", false], [4596, 0.00319, " in", false], [53087, 0.003036, " systems", false], [332, 0.002254, " a", false]]], "model_b": [45, 1, 0.8389545679092407, [[45, 0.838955, ",", false], [21265, 0.064064, " and", false], [275, 0.022599, " (", false], [57103, 0.014011, " research", false], [22590, 0.011862, " the", false], [39934, 0.004196, " there", false], [4596, 0.003383, " in", false], [4601, 0.003337, " it", false], [32234, 0.001942, " this", false], [53087, 0.001706, " systems", false]]]}, "raw_delta": -0.0224609375, "tuned_delta": 0.03039400639819982}, {"byte_start": 3185, "byte_end": 3191, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 548, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"model_a": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "model_b": "9.63% 9.63% 9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"model_a": [[39934, " there", "normal", 0.04968200996518135]], "model_b": [[39934, " there", "normal", 0.04031412675976753]]}, "loss": {"model_a": 9.01684400555602, "model_b": 9.627359485098875}, "topk": {"model_a": [39934, 4, 0.04968200996518135, [[22590, 0.361769, " the", false], [63843, 0.064621, " researchers", false], [332, 0.05362, " a", false], [39934, 0.049682, " there", false], [4601, 0.024821, " it", false], [50919, 0.016915, " another", false], [4423, 0.0138, " as", false], [38328, 0.013607, " early", false], [40186, 0.013353, " which", false], [22226, 0.012676, " one", false]]], "model_b": [39934, 3, 0.04031412675976753, [[22590, 0.363664, " the", false], [332, 0.048145, " a", false], [39934, 0.040314, " there", false], [63843, 0.028919, " researchers", false], [31466, 0.018842, " much", false], [32234, 0.018108, " this", false], [4601, 0.015344, " it", false], [22226, 0.014396, " one", false], [57103, 0.012773, " research", false], [38328, 0.012746, " early", false]]]}, "raw_delta": -0.03385416666666663, "tuned_delta": 0.019000777231533192}, {"byte_start": 3191, "byte_end": 3195, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 549, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "4.02% 4.02% 4.02% 4.02%", "model_b": "4.39% 4.39% 4.39% 4.39%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.4065247178077698]], "model_b": [[22748, " was", "normal", 0.37649038434028625]]}, "loss": {"model_a": 4.015313346224166, "model_b": 4.385144838639549}, "topk": {"model_a": [22748, 1, 0.4065247178077698, [[22748, 0.406525, " was", false], [32462, 0.209496, " were", false], [21800, 0.11806, " has", false], [4600, 0.105197, " is", false], [31059, 0.060903, " have", false], [21286, 0.054464, " are", false], [21795, 0.016866, " had", false], [30135, 0.002793, " also", false], [39620, 0.002221, " seems", false], [22614, 0.002031, " too", false]]], "model_b": [22748, 1, 0.37649038434028625, [[22748, 0.37649, " was", false], [32462, 0.214913, " were", false], [4600, 0.138603, " is", false], [21286, 0.116427, " are", false], [21800, 0.06276, " has", false], [31059, 0.04416, " have", false], [21795, 0.00996, " had", false], [30135, 0.00551, " also", false], [22614, 0.003811, " too", false], [22074, 0.001915, " may", false]]]}, "raw_delta": -0.0205078125, "tuned_delta": 0.03234713139819982}, {"byte_start": 3195, "byte_end": 3198, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 550, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"model_a": "13.71% 13.71% 13.71%", "model_b": "15.31% 15.31% 15.31%"}, "model_tokens": {"model_a": [[4419, " an", "normal", 0.10250672698020935]], "model_b": [[4419, " an", "normal", 0.07878382503986359]]}, "loss": {"model_a": 13.713116925116447, "model_b": 15.309849717766994}, "topk": {"model_a": [4419, 2, 0.10250672698020935, [[332, 0.492511, " a", false], [4419, 0.102507, " an", false], [30135, 0.052332, " also", false], [50919, 0.031499, " another", false], [22590, 0.029227, " the", false], [59868, 0.028268, " initially", false], [30788, 0.020943, " even", false], [31466, 0.020601, " much", false], [52906, 0.019971, " similar", false], [4692, 0.015494, " no", false]]], "model_b": [4419, 2, 0.07878382503986359, [[332, 0.343079, " a", false], [4419, 0.078784, " an", false], [31466, 0.07254, " much", false], [22590, 0.048772, " the", false], [30135, 0.047286, " also", false], [4692, 0.034066, " no", false], [59868, 0.027968, " initially", false], [52013, 0.022776, " initial", false], [46454, 0.020384, " little", false], [50919, 0.019823, " another", false]]]}, "raw_delta": -0.08854166666666674, "tuned_delta": -0.03568672276846692}, {"byte_start": 3198, "byte_end": 3204, "display": {"text": " early", "kind": "normal"}, "is_word": true, "word_id": 551, "word_key": " early", "bytes_hex": "20 65 61 72 6c 79", "compression": {"model_a": "4.70% 4.70% 4.70% 4.70% 4.70% 4.70%", "model_b": "4.09% 4.09% 4.09% 4.09% 4.09% 4.09%"}, "model_tokens": {"model_a": [[38328, " early", "normal", 0.2094777375459671]], "model_b": [[38328, " early", "normal", 0.25682786107063293]]}, "loss": {"model_a": 4.696272919560427, "model_b": 4.085757440017572}, "topk": {"model_a": [38328, 2, 0.2094777375459671, [[52013, 0.246023, " initial", false], [38328, 0.209478, " early", false], [30788, 0.114105, " even", false], [51639, 0.03958, " equally", false], [51551, 0.031508, " earlier", false], [59134, 0.029321, " analogous", false], [45829, 0.02225, " effort", false], [59829, 0.018665, " important", false], [56125, 0.015692, " enormous", false], [50976, 0.013045, " attempt", false]]], "model_b": [38328, 1, 0.25682786107063293, [[38328, 0.256828, " early", false], [52013, 0.24645, " initial", false], [51551, 0.046832, " earlier", false], [45829, 0.036899, " effort", false], [56125, 0.017762, " enormous", false], [50976, 0.017453, " attempt", false], [63667, 0.017318, " interesting", false], [51639, 0.016447, " equally", false], [60080, 0.015647, " obsession", false], [30788, 0.015264, " even", false]]]}, "raw_delta": 0.033854166666666685, "tuned_delta": 0.0867091105648665}, {"byte_start": 3204, "byte_end": 3216, "display": {"text": " competition", "kind": "normal"}, "is_word": true, "word_id": 552, "word_key": " competition", "bytes_hex": "20 63 6f 6d 70 65 74 69 74 69 6f 6e", "compression": {"model_a": "8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69%", "model_b": "13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[63361, " competition", "normal", 0.0030500220600515604]], "model_b": [[63361, " competition", "normal", 0.0001074282408808358]]}, "loss": {"model_a": 8.688104901186788, "model_b": 13.713116925116447}, "topk": {"model_a": [63361, 46, 0.0030500220600515604, [[45829, 0.133821, " effort", false], [45, 0.055527, ",", false], [21265, 0.046709, " and", false], [50976, 0.045306, " attempt", false], [46790, 0.043001, " period", false], [56103, 0.039262, " emphasis", false], [55532, 0.029303, " approach", false], [31813, 0.024648, " race", false], [38530, 0.021498, " focus", false], [57404, 0.021349, " tendency", false]]], "model_b": [63361, 643, 0.0001074282408808358, [[45829, 0.161554, " effort", false], [53052, 0.042111, " success", false], [38530, 0.039414, " focus", false], [50976, 0.037759, " attempt", false], [45, 0.034578, ",", false], [61947, 0.033868, " enthusiasm", false], [45294, 0.030329, " belief", false], [60080, 0.029428, " obsession", false], [56477, 0.013246, " interest", false], [21265, 0.012947, " and", false]]]}, "raw_delta": -0.27864583333333337, "tuned_delta": -0.22579088943513353}, {"byte_start": 3216, "byte_end": 3217, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "73.26%", "model_b": "76.08%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.01735544018447399]], "model_b": [[45, ",", "normal", 0.014770129695534706]]}, "loss": {"model_a": 73.26185754514266, "model_b": 76.07962129687893}, "topk": {"model_a": [45, 6, 0.01735544018447399, [[51035, 0.786486, " between", false], [37694, 0.037059, " among", false], [4811, 0.036301, " to", false], [4596, 0.022975, " in", false], [21700, 0.019223, " for", false], [45, 0.017355, ",", false], [32487, 0.012995, " with", false], [4706, 0.012028, " of", false], [32227, 0.008012, " that", false], [31601, 0.004825, " over", false]]], "model_b": [45, 7, 0.014770129695534706, [[51035, 0.667575, " between", false], [32487, 0.088503, " with", false], [21700, 0.047118, " for", false], [4596, 0.028337, " in", false], [4811, 0.026315, " to", false], [37694, 0.021453, " among", false], [45, 0.01477, ",", false], [32227, 0.012305, " that", false], [4450, 0.010144, " by", false], [50870, 0.009589, " against", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 3217, "byte_end": 3227, "display": {"text": " sponsored", "kind": "normal"}, "is_word": true, "word_id": 553, "word_key": " sponsored", "bytes_hex": "20 73 70 6f 6e 73 6f 72 65 64", "compression": {"model_a": "11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16%", "model_b": "12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79%"}, "model_tokens": {"model_a": [[60543, " sponsored", "normal", 0.0020650378428399563]], "model_b": [[60543, " sponsored", "normal", 0.0008212585235014558]]}, "loss": {"model_a": 11.158344456875577, "model_b": 12.792647432882601}, "topk": {"model_a": [60543, 66, 0.0020650378428399563, [[4596, 0.17074, " in", false], [51035, 0.097569, " between", false], [32487, 0.041486, " with", false], [30917, 0.034307, " from", false], [22590, 0.032027, " the", false], [40186, 0.02955, " which", false], [21265, 0.023895, " and", false], [3492, 0.022808, " 19", false], [57295, 0.018323, " starting", false], [30135, 0.017424, " also", false]]], "model_b": [60543, 118, 0.0008212585235014558, [[4596, 0.102722, " in", false], [32487, 0.094154, " with", false], [21400, 0.067422, " but", false], [21265, 0.066919, " and", false], [51035, 0.040398, " between", false], [4423, 0.035332, " as", false], [22590, 0.031106, " the", false], [40185, 0.015717, " where", false], [21700, 0.015417, " for", false], [22614, 0.015044, " too", false]]]}, "raw_delta": -0.09062499999999996, "tuned_delta": -0.037770056101800134}, {"byte_start": 3227, "byte_end": 3230, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 554, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "0.47% 0.47% 0.47%", "model_b": "1.06% 1.06% 1.06%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.9243119359016418]], "model_b": [[4450, " by", "normal", 0.8395534157752991]]}, "loss": {"model_a": 0.472562462530768, "model_b": 1.0566614069010962}, "topk": {"model_a": [4450, 1, 0.9243119359016418, [[4450, 0.924312, " by", false], [4596, 0.036904, " in", false], [52063, 0.005999, " jointly", false], [21265, 0.004591, " and", false], [21700, 0.003129, " for", false], [4424, 0.00282, " at", false], [59868, 0.002301, " initially", false], [4423, 0.001899, " as", false], [46768, 0.001823, " partly", false], [45, 0.00126, ",", false]]], "model_b": [4450, 1, 0.8395534157752991, [[4450, 0.839553, " by", false], [4596, 0.08013, " in", false], [52063, 0.011147, " jointly", false], [21265, 0.010384, " and", false], [4424, 0.00617, " at", false], [46768, 0.004914, " partly", false], [52094, 0.004766, " largely", false], [45, 0.004023, ",", false], [59868, 0.003683, " initially", false], [4423, 0.002232, " as", false]]]}, "raw_delta": -0.03238932291666667, "tuned_delta": 0.02046562098153315}, {"byte_start": 3230, "byte_end": 3234, "display": {"text": " DAR", "kind": "normal"}, "is_word": true, "word_id": 555, "word_key": " dar", "bytes_hex": "20 44 41 52", "compression": {"model_a": "5.53% 5.53% 5.53% 5.53%", "model_b": "11.91% 11.91% 11.91% 11.91%"}, "model_tokens": {"model_a": [[19678, " DAR", "normal", 0.2904881536960602]], "model_b": [[19678, " DAR", "normal", 0.07156697660684586]]}, "loss": {"model_a": 5.529861362782403, "model_b": 11.905051851085684}, "topk": {"model_a": [19678, 1, 0.2904881536960602, [[19678, 0.290488, " DAR", false], [22590, 0.19669, " the", false], [28484, 0.173245, " Bell", false], [3620, 0.087891, " AT", false], [20077, 0.087414, " IBM", false], [54894, 0.020458, " Carnegie", false], [323, 0.019903, " X", false], [332, 0.013674, " a", false], [62041, 0.006271, " government", false], [36292, 0.004806, " Apple", false]]], "model_b": [19678, 3, 0.07156697660684586, [[22590, 0.268638, " the", false], [20077, 0.140832, " IBM", false], [19678, 0.071567, " DAR", false], [20354, 0.049451, " MIT", false], [332, 0.037842, " a", false], [58902, 0.037511, " Microsoft", false], [28484, 0.030679, " Bell", false], [47350, 0.028826, " speech", false], [44348, 0.024033, " Google", false], [54894, 0.022664, " Carnegie", false]]]}, "raw_delta": -0.353515625, "tuned_delta": -0.30066068110180016}, {"byte_start": 3234, "byte_end": 3236, "display": {"text": "PA", "kind": "normal"}, "is_word": true, "word_id": 556, "word_key": "pa", "bytes_hex": "50 41", "compression": {"model_a": "0.00% 0.00%", "model_b": "0.01% 0.01%"}, "model_tokens": {"model_a": [[1342, "PA", "normal", 0.9995243549346924]], "model_b": [[1342, "PA", "normal", 0.999221920967102]]}, "loss": {"model_a": 0.004265169741397653, "model_b": 0.0069824956250300295}, "topk": {"model_a": [1342, 1, 0.9995243549346924, [[1342, 0.999524, "PA", false], [6405, 9.1e-05, "PAN", false], [81, 8.3e-05, "P", false], [66, 7.6e-05, "A", false], [85, 3.5e-05, "T", false], [6408, 2.2e-05, "PAT", false], [2111, 2.1e-05, "pa", false], [1470, 1.9e-05, "TA", false], [6407, 9e-06, "PAS", false], [1364, 8e-06, "Pa", false]]], "model_b": [1342, 1, 0.999221920967102, [[1342, 0.999222, "PA", false], [66, 0.000166, "A", false], [70, 4.9e-05, "E", false], [2111, 4.4e-05, "pa", false], [1360, 3.4e-05, "PU", false], [812, 3.1e-05, "AA", false], [76, 2.7e-05, "K", false], [4104, 2.1e-05, " PA", false], [1178, 1.7e-05, "KN", false], [1104, 1.6e-05, "IA", false]]]}, "raw_delta": -0.0001506805419921875, "tuned_delta": 0.052704263356207634}, {"byte_start": 3236, "byte_end": 3237, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.84%", "model_b": "4.12%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8095117807388306]], "model_b": [[45, ",", "normal", 0.7947840094566345]]}, "loss": {"model_a": 3.839203111740649, "model_b": 4.120979486914275}, "topk": {"model_a": [45, 1, 0.8095117807388306, [[45, 0.809512, ",", false], [4596, 0.079858, " in", false], [21265, 0.056325, " and", false], [275, 0.024089, " (", false], [51035, 0.003069, " between", false], [21700, 0.00292, " for", false], [4811, 0.002409, " to", false], [4423, 0.002059, " as", false], [460, 0.001803, "'s", false], [45805, 0.001527, " during", false]]], "model_b": [45, 1, 0.7947840094566345, [[45, 0.794784, ",", false], [21265, 0.074647, " and", false], [4596, 0.048029, " in", false], [275, 0.030108, " (", false], [460, 0.010256, "'s", false], [47, 0.007557, ".", false], [4423, 0.003226, " as", false], [21700, 0.002375, " for", false], [4811, 0.001869, " to", false], [32487, 0.00175, " with", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 3237, "byte_end": 3240, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 557, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "16.91% 16.91% 16.91%", "model_b": "20.38% 20.38% 20.38%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.06080134958028793]], "model_b": [[4596, " in", "normal", 0.033477943390607834]]}, "loss": {"model_a": 16.90658251041754, "model_b": 20.38182447089225}, "topk": {"model_a": [4596, 3, 0.06080134958028793, [[51035, 0.659432, " between", false], [4811, 0.116876, " to", false], [4596, 0.060801, " in", false], [32227, 0.043481, " that", false], [21700, 0.027144, " for", false], [32487, 0.012696, " with", false], [37694, 0.011658, " among", false], [40186, 0.011542, " which", false], [40185, 0.004859, " where", false], [4706, 0.004323, " of", false]]], "model_b": [4596, 6, 0.033477943390607834, [[51035, 0.578665, " between", false], [4811, 0.078488, " to", false], [32227, 0.058016, " that", false], [32487, 0.049809, " with", false], [21700, 0.047798, " for", false], [4596, 0.033478, " in", false], [40185, 0.028148, " where", false], [50870, 0.016389, " against", false], [40186, 0.016218, " which", false], [21265, 0.011498, " and", false]]]}, "raw_delta": -0.19270833333333326, "tuned_delta": -0.13985338943513342}, {"byte_start": 3240, "byte_end": 3244, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 558, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "12.05% 12.05% 12.05% 12.05%", "model_b": "10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.06973370164632797]], "model_b": [[22590, " the", "normal", 0.09931225329637527]]}, "loss": {"model_a": 12.045940038672496, "model_b": 10.425725881424148}, "topk": {"model_a": [22590, 2, 0.06973370164632797, [[40186, 0.671123, " which", false], [22590, 0.069734, " the", false], [3492, 0.065469, " 19", false], [53342, 0.013871, " whether", false], [52224, 0.008915, " methods", false], [40085, 0.008102, " using", false], [22638, 0.007519, " two", false], [61857, 0.006108, " developing", false], [21835, 0.005579, " how", false], [332, 0.005348, " a", false]]], "model_b": [22590, 2, 0.09931225329637527, [[40186, 0.644626, " which", false], [22590, 0.099312, " the", false], [3492, 0.047643, " 19", false], [332, 0.009461, " a", false], [21835, 0.009151, " how", false], [47350, 0.008201, " speech", false], [52167, 0.007823, " machine", false], [40085, 0.006189, " using", false], [51035, 0.004641, " between", false], [53342, 0.004631, " whether", false]]]}, "raw_delta": 0.08984375, "tuned_delta": 0.14269869389819984}, {"byte_start": 3244, "byte_end": 3247, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 559, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"model_a": "6.53% 6.53% 6.53%", "model_b": "7.47% 7.47% 7.47%"}, "model_tokens": {"model_a": [[3492, " 19", "normal", 0.3362497389316559]], "model_b": [[3492, " 19", "normal", 0.28519123792648315]]}, "loss": {"model_a": 6.527819358188994, "model_b": 7.467073942101079}, "topk": {"model_a": [3492, 1, 0.3362497389316559, [[3492, 0.33625, " 19", false], [31255, 0.136928, " late", false], [38328, 0.090815, " early", false], [22681, 0.04909, " use", false], [22089, 0.046513, " mid", false], [63469, 0.021941, " development", false], [30899, 0.015111, " form", false], [38478, 0.009958, " field", false], [47202, 0.009082, " search", false], [45010, 0.006893, " United", false]]], "model_b": [3492, 1, 0.28519123792648315, [[3492, 0.285191, " 19", false], [38328, 0.103618, " early", false], [31255, 0.065783, " late", false], [22681, 0.057978, " use", false], [22089, 0.035934, " mid", false], [63469, 0.032568, " development", false], [40237, 0.016381, " years", false], [30173, 0.013296, " area", false], [45294, 0.010782, " belief", false], [50836, 0.009139, " ability", false]]]}, "raw_delta": -0.052083333333333315, "tuned_delta": 0.0007716105648665067}, {"byte_start": 3247, "byte_end": 3249, "display": {"text": "70", "kind": "normal"}, "is_word": true, "word_id": 560, "word_key": "70", "bytes_hex": "37 30", "compression": {"model_a": "7.89% 7.89%", "model_b": "11.91% 11.91%"}, "model_tokens": {"model_a": [[690, "70", "normal", 0.41649606823921204]], "model_b": [[690, "70", "normal", 0.2674158215522766]]}, "loss": {"model_a": 7.889738504861517, "model_b": 11.905051851085684}, "topk": {"model_a": [690, 1, 0.41649606823921204, [[690, 0.416496, "70", false], [700, 0.215445, "80", false], [680, 0.183971, "60", false], [710, 0.136324, "90", false], [670, 0.019079, "50", false], [686, 0.002596, "66", false], [689, 0.002368, "69", false], [711, 0.001828, "91", false], [691, 0.001571, "71", false], [706, 0.001231, "86", false]]], "model_b": [690, 2, 0.2674158215522766, [[700, 0.41359, "80", false], [690, 0.267416, "70", false], [710, 0.196498, "90", false], [680, 0.101693, "60", false], [670, 0.010493, "50", false], [705, 0.000764, "85", false], [660, 0.000585, "40", false], [706, 0.000579, "86", false], [715, 0.000524, "95", false], [709, 0.000433, "89", false]]]}, "raw_delta": -0.22265625, "tuned_delta": -0.16980130610180016}, {"byte_start": 3249, "byte_end": 3250, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 561, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "2.34%", "model_b": "0.88%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.8776984214782715]], "model_b": [[116, "s", "normal", 0.9520741105079651]]}, "loss": {"model_a": 2.342266118630763, "model_b": 0.884953928279668}, "topk": {"model_a": [116, 1, 0.8776984214782715, [[116, 0.877698, "s", false], [460, 0.119184, "'s", false], [21265, 0.000561, " and", false], [46, 0.000474, "-", false], [28309, 0.000411, "’s", false], [97, 0.000213, "`", false], [40, 0.000143, "'", false], [350, 0.000129, " s", false], [9835, 0.000117, "′", false], [439, 8.8e-05, "''", false]]], "model_b": [116, 1, 0.9520741105079651, [[116, 0.952074, "s", false], [460, 0.045196, "'s", false], [46, 0.000632, "-", false], [28309, 0.000322, "’s", false], [21265, 0.000176, " and", false], [7789, 0.000131, "ies", false], [40, 0.000128, "'", false], [4811, 8.9e-05, " to", false], [48, 6.8e-05, "/", false], [84, 6.5e-05, "S", false]]]}, "raw_delta": 0.080810546875, "tuned_delta": 0.13366549077319984}, {"byte_start": 3250, "byte_end": 3251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "70.73%", "model_b": "56.36%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.019462158903479576]], "model_b": [[47, ".", "normal", 0.043890297412872314]]}, "loss": {"model_a": 70.72587016858003, "model_b": 56.355275034725125}, "topk": {"model_a": [47, 6, 0.019462158903479576, [[51035, 0.423203, " between", false], [45, 0.196741, ",", false], [21265, 0.170018, " and", false], [4811, 0.082737, " to", false], [32227, 0.031006, " that", false], [47, 0.019462, ".", false], [21700, 0.013546, " for", false], [4596, 0.011457, " in", false], [37694, 0.007653, " among", false], [275, 0.00455, " (", false]]], "model_b": [47, 5, 0.043890297412872314, [[51035, 0.3112, " between", false], [21265, 0.20798, " and", false], [45, 0.158605, ",", false], [4811, 0.067616, " to", false], [47, 0.04389, ".", false], [32487, 0.03636, " with", false], [32227, 0.035217, " that", false], [21700, 0.023253, " for", false], [46, 0.013059, "-", false], [4450, 0.01029, " by", false]]]}, "raw_delta": 0.796875, "tuned_delta": 0.8497299438981998}, {"byte_start": 3251, "byte_end": 3255, "display": {"text": " Ent", "kind": "normal"}, "is_word": true, "word_id": 562, "word_key": " ent", "bytes_hex": "20 45 6e 74", "compression": {"model_a": "38.32% 38.32% 38.32% 38.32%", "model_b": "32.55% 32.55% 32.55% 32.55%"}, "model_tokens": {"model_a": [[19830, " Ent", "normal", 0.0002028000890277326]], "model_b": [[19830, " Ent", "normal", 0.0007399555179290473]]}, "loss": {"model_a": 38.321587023613084, "model_b": 32.545171332553764}, "topk": {"model_a": [19830, 170, 0.0002028000890277326, [[20996, 0.335367, " The", false], [20556, 0.146693, " One", false], [3918, 0.057483, " It", false], [3913, 0.040059, " In", false], [29894, 0.03953, " This", false], [37451, 0.028343, " There", false], [63222, 0.024464, " Researchers", false], [300, 0.023244, " A", false], [19678, 0.021406, " DAR", false], [21042, 0.014849, " Two", false]]], "model_b": [19830, 118, 0.0007399555179290473, [[20996, 0.210616, " The", false], [29894, 0.059091, " This", false], [3913, 0.058434, " In", false], [300, 0.035779, " A", false], [63222, 0.028162, " Researchers", false], [3918, 0.027416, " It", false], [20556, 0.025185, " One", false], [37451, 0.022364, " There", false], [44900, 0.018136, " Speech", false], [19555, 0.017609, " But", false]]]}, "raw_delta": 0.3203125, "tuned_delta": 0.37316744389819984}, {"byte_start": 3255, "byte_end": 3259, "display": {"text": "rant", "kind": "normal"}, "is_word": true, "word_id": 563, "word_key": "rant", "bytes_hex": "72 61 6e 74", "compression": {"model_a": "4.02% 4.02% 4.02% 4.02%", "model_b": "28.60% 28.60% 28.60% 28.60%"}, "model_tokens": {"model_a": [[26809, "rant", "normal", 0.40987658500671387]], "model_b": [[26809, "rant", "normal", 0.0017240220913663507]]}, "loss": {"model_a": 4.015313346224166, "model_b": 28.600302080123}, "topk": {"model_a": [26809, 2, 0.40987658500671387, [[26892, 0.462931, "ries", false], [26809, 0.409877, "rant", false], [7730, 0.059132, "hus", false], [7896, 0.019432, "ire", false], [35492, 0.017903, "rance", false], [34889, 0.014344, "ities", false], [34895, 0.004576, "itled", false], [25664, 0.001647, "iced", false], [8359, 0.001002, "omo", false], [34612, 0.000856, "icing", false]]], "model_b": [26809, 13, 0.0017240220913663507, [[7730, 0.501604, "hus", false], [7896, 0.39309, "ire", false], [26892, 0.02176, "ries", false], [34889, 0.019603, "ities", false], [8359, 0.01182, "omo", false], [34895, 0.007814, "itled", false], [26942, 0.006833, "ropy", false], [7715, 0.004742, "hou", false], [35492, 0.004399, "rance", false], [26965, 0.004127, "rust", false]]]}, "raw_delta": -1.36328125, "tuned_delta": -1.3104263061018002}, {"byte_start": 3259, "byte_end": 3260, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 564, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.24%", "model_b": "0.57%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9869351387023926]], "model_b": [[116, "s", "normal", 0.9683756232261658]]}, "loss": {"model_a": 0.23774881655274663, "model_b": 0.572358262071427}, "topk": {"model_a": [116, 1, 0.9869351387023926, [[116, 0.986935, "s", false], [300, 0.002909, " A", false], [284, 0.002093, " 1", false], [39904, 0.000588, " teams", false], [37634, 0.000376, " after", false], [46685, 0.000319, " number", false], [270, 0.000279, " #", false], [4596, 0.000258, " in", false], [4066, 0.000224, " No", false], [4811, 0.000174, " to", false]]], "model_b": [116, 1, 0.9683756232261658, [[116, 0.968376, "s", false], [59326, 0.004991, " companies", false], [63843, 0.002195, " researchers", false], [57103, 0.001625, " research", false], [39904, 0.001134, " teams", false], [51566, 0.001047, " efforts", false], [47350, 0.000915, " speech", false], [56949, 0.000821, " programs", false], [64973, 0.000536, " organizations", false], [4596, 0.000516, " in", false]]]}, "raw_delta": -0.0185546875, "tuned_delta": 0.03430025639819982}, {"byte_start": 3260, "byte_end": 3269, "display": {"text": " included", "kind": "normal"}, "is_word": true, "word_id": 565, "word_key": " included", "bytes_hex": "20 69 6e 63 6c 75 64 65 64", "compression": {"model_a": "5.98% 5.98% 5.98% 5.98% 5.98% 5.98% 5.98% 5.98% 5.98%", "model_b": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%"}, "model_tokens": {"model_a": [[56427, " included", "normal", 0.05059453845024109]], "model_b": [[56427, " included", "normal", 0.02706131897866726]]}, "loss": {"model_a": 5.979920850906945, "model_b": 7.232260296123058}, "topk": {"model_a": [56427, 4, 0.05059453845024109, [[32462, 0.33962, " were", false], [32354, 0.066441, " used", false], [4811, 0.055416, " to", false], [56427, 0.050595, " included", false], [21795, 0.035736, " had", false], [4596, 0.028691, " in", false], [55796, 0.027294, " competed", false], [59506, 0.017861, " developed", false], [22762, 0.017562, " who", false], [40013, 0.013596, " tried", false]]], "model_b": [56427, 6, 0.02706131897866726, [[32462, 0.148345, " were", false], [4811, 0.076712, " to", false], [4596, 0.072178, " in", false], [32354, 0.065867, " used", false], [21795, 0.037852, " had", false], [56427, 0.027061, " included", false], [40013, 0.021092, " tried", false], [51196, 0.018047, " claimed", false], [31351, 0.017858, " made", false], [59506, 0.017798, " developed", false]]]}, "raw_delta": -0.06944444444444448, "tuned_delta": -0.016589500546244654}, {"byte_start": 3269, "byte_end": 3271, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 566, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "22.68% 22.68%", "model_b": "22.40% 22.40%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.07994856685400009]], "model_b": [[332, " a", "normal", 0.0847340002655983]]}, "loss": {"model_a": 22.682998201476863, "model_b": 22.40122182630324}, "topk": {"model_a": [332, 3, 0.07994856685400009, [[63843, 0.099336, " researchers", false], [22590, 0.098679, " the", false], [332, 0.079949, " a", false], [30322, 0.0466, " both", false], [32074, 0.02686, " some", false], [22638, 0.025302, " two", false], [31370, 0.024941, " many", false], [46787, 0.015896, " people", false], [52869, 0.015874, " several", false], [45929, 0.012826, " expert", false]]], "model_b": [332, 2, 0.0847340002655983, [[22590, 0.100226, " the", false], [332, 0.084734, " a", false], [63843, 0.038499, " researchers", false], [30322, 0.028365, " both", false], [47350, 0.02767, " speech", false], [20077, 0.024947, " IBM", false], [31370, 0.021039, " many", false], [20354, 0.018723, " MIT", false], [46787, 0.018539, " people", false], [32074, 0.015023, " some", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06847994389819982}, {"byte_start": 3271, "byte_end": 3276, "display": {"text": " host", "kind": "normal"}, "is_word": true, "word_id": 567, "word_key": " host", "bytes_hex": "20 68 6f 73 74", "compression": {"model_a": "25.36% 25.36% 25.36% 25.36% 25.36%", "model_b": "26.60% 26.60% 26.60% 26.60% 26.60%"}, "model_tokens": {"model_a": [[31112, " host", "normal", 0.0008912928169593215]], "model_b": [[31112, " host", "normal", 0.0006211800500750542]]}, "loss": {"model_a": 25.359873765626308, "model_b": 26.599689816390264}, "topk": {"model_a": [31112, 86, 0.0008912928169593215, [[32207, 0.176035, " team", false], [46685, 0.105956, " number", false], [38640, 0.104108, " group", false], [53264, 0.046625, " variety", false], [38864, 0.037277, " large", false], [38720, 0.033431, " human", false], [47350, 0.027334, " speech", false], [21674, 0.023676, " few", false], [57103, 0.020523, " research", false], [47202, 0.018582, " search", false]]], "model_b": [31112, 184, 0.0006211800500750542, [[46685, 0.113236, " number", false], [53264, 0.064902, " variety", false], [38720, 0.047991, " human", false], [47350, 0.037229, " speech", false], [47487, 0.024865, " system", false], [46561, 0.021297, " method", false], [52167, 0.019323, " machine", false], [38640, 0.01851, " group", false], [38864, 0.01722, " large", false], [52580, 0.016365, " program", false]]]}, "raw_delta": -0.06875000000000009, "tuned_delta": -0.015895056101800267}, {"byte_start": 3276, "byte_end": 3279, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 568, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.04% 0.04% 0.04%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9939544796943665]], "model_b": [[4706, " of", "normal", 0.9967646598815918]]}, "loss": {"model_a": 0.0365061840231455, "model_b": 0.019445505057554897}, "topk": {"model_a": [4706, 1, 0.9939544796943665, [[4706, 0.993954, " of", false], [22762, 0.000653, " who", false], [32227, 0.000414, " that", false], [45, 0.000319, ",", false], [46, 0.000254, "-", false], [37747, 0.00021, " array", false], [1851, 0.000179, "el", false], [52580, 0.000177, " program", false], [275, 0.000171, " (", false], [21265, 0.00015, " and", false]]], "model_b": [4706, 1, 0.9967646598815918, [[4706, 0.996765, " of", false], [46, 0.000298, "-", false], [332, 0.000268, " a", false], [45, 0.000142, ",", false], [46685, 0.000138, " number", false], [11, 0.000116, "\n", false], [7512, 0.000115, "ess", false], [275, 0.000113, " (", false], [32227, 0.000107, " that", false], [55809, 9.9e-05, " computer", false]]]}, "raw_delta": 0.0009460449218749997, "tuned_delta": 0.05380098882007482}, {"byte_start": 3279, "byte_end": 3287, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 569, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17%", "model_b": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93% 14.93% 14.93%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 0.002928188070654869]], "model_b": [[52964, " special", "normal", 0.0013258279068395495]]}, "loss": {"model_a": 13.173045539367, "model_b": 14.934147884202158}, "topk": {"model_a": [52964, 54, 0.002928188070654869, [[63843, 0.21061, " researchers", false], [38720, 0.079886, " human", false], [57103, 0.045391, " research", false], [52224, 0.03026, " methods", false], [46787, 0.022223, " people", false], [55809, 0.020022, " computer", false], [3609, 0.019999, " AI", false], [47350, 0.018077, " speech", false], [59513, 0.016659, " different", false], [61590, 0.014807, " approaches", false]]], "model_b": [52964, 105, 0.0013258279068395495, [[63843, 0.098232, " researchers", false], [38720, 0.063244, " human", false], [59513, 0.040278, " different", false], [32458, 0.02582, " well", false], [3609, 0.025278, " AI", false], [57103, 0.02428, " research", false], [46787, 0.02329, " people", false], [61590, 0.019391, " approaches", false], [52224, 0.0188, " methods", false], [60274, 0.018737, " promising", false]]]}, "raw_delta": -0.09765625, "tuned_delta": -0.04480130610180018}, {"byte_start": 3287, "byte_end": 3295, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 570, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "model_b": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.052433159202337265]], "model_b": [[52224, " methods", "normal", 0.055639758706092834]]}, "loss": {"model_a": 6.656966863476906, "model_b": 6.516078675890093}, "topk": {"model_a": [52224, 3, 0.052433159202337265, [[46, 0.671003, "-", false], [52610, 0.059391, " purpose", false], [52224, 0.052433, " methods", false], [62633, 0.027381, " techniques", false], [61590, 0.025084, " approaches", false], [25971, 0.007201, "ists", false], [38720, 0.007115, " human", false], [27161, 0.006636, "ties", false], [45, 0.006075, ",", false], [53087, 0.004418, " systems", false]]], "model_b": [52224, 2, 0.055639758706092834, [[46, 0.443921, "-", false], [52224, 0.05564, " methods", false], [57103, 0.048099, " research", false], [62633, 0.038511, " techniques", false], [57257, 0.019616, " software", false], [38720, 0.018514, " human", false], [63843, 0.016163, " researchers", false], [61590, 0.014965, " approaches", false], [52610, 0.014134, " purpose", false], [51565, 0.014117, " effects", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06066744389819982}, {"byte_start": 3295, "byte_end": 3300, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 571, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "7.19% 7.19% 7.19% 7.19% 7.19%", "model_b": "5.18% 5.18% 5.18% 5.18% 5.18%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.1361222118139267]], "model_b": [[32227, " that", "normal", 0.2355164736509323]]}, "loss": {"model_a": 7.185297566927454, "model_b": 5.184685303194711}, "topk": {"model_a": [32227, 3, 0.1361222118139267, [[45, 0.2063, ",", false], [21700, 0.137234, " for", false], [32227, 0.136122, " that", false], [37810, 0.135346, " based", false], [55966, 0.035103, " designed", false], [21265, 0.031658, " and", false], [38888, 0.020458, " lever", false], [47, 0.016944, ".", false], [4811, 0.016641, " to", false], [32139, 0.016002, " such", false]]], "model_b": [32227, 1, 0.2355164736509323, [[32227, 0.235516, " that", false], [45, 0.224244, ",", false], [21700, 0.114787, " for", false], [37810, 0.065998, " based", false], [275, 0.053573, " (", false], [21265, 0.039624, " and", false], [32139, 0.020234, " such", false], [47, 0.014373, ".", false], [59841, 0.013078, " including", false], [55966, 0.01233, " designed", false]]]}, "raw_delta": 0.11093750000000002, "tuned_delta": 0.16379244389819986}, {"byte_start": 3300, "byte_end": 3305, "display": {"text": " took", "kind": "normal"}, "is_word": true, "word_id": 572, "word_key": " took", "bytes_hex": "20 74 6f 6f 6b", "compression": {"model_a": "8.00% 8.00% 8.00% 8.00% 8.00%", "model_b": "12.00% 12.00% 12.00% 12.00% 12.00%"}, "model_tokens": {"model_a": [[32272, " took", "normal", 0.10863658785820007]], "model_b": [[32272, " took", "normal", 0.035712677985429764]]}, "loss": {"model_a": 8.002449054930967, "model_b": 12.003673582396452}, "topk": {"model_a": [32272, 2, 0.10863658785820007, [[32462, 0.139313, " were", false], [32272, 0.108637, " took", false], [56540, 0.105411, " leverage", false], [59685, 0.067186, " exploited", false], [31351, 0.054689, " made", false], [40013, 0.038893, " tried", false], [32354, 0.03802, " used", false], [57510, 0.033259, " utilized", false], [21795, 0.029704, " had", false], [59189, 0.02192, " attempted", false]]], "model_b": [32272, 6, 0.035712677985429764, [[32462, 0.168255, " were", false], [56540, 0.138939, " leverage", false], [32354, 0.068645, " used", false], [47054, 0.038766, " relied", false], [31351, 0.036145, " made", false], [32272, 0.035713, " took", false], [59685, 0.034678, " exploited", false], [21795, 0.026963, " had", false], [57510, 0.025662, " utilized", false], [21532, 0.024549, " did", false]]]}, "raw_delta": -0.22187500000000004, "tuned_delta": -0.1690200561018002}, {"byte_start": 3305, "byte_end": 3315, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 573, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"model_a": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%", "model_b": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"model_a": [[59093, " advantage", "normal", 0.9134929180145264]], "model_b": [[59093, " advantage", "normal", 0.7971101403236389]]}, "loss": {"model_a": 0.1629019668972523, "model_b": 0.41562015338109776}, "topk": {"model_a": [59093, 1, 0.9134929180145264, [[59093, 0.913493, " advantage", false], [38720, 0.019798, " human", false], [30923, 0.008447, " full", false], [31162, 0.007946, " into", false], [332, 0.004059, " a", false], [61544, 0.004055, " advantages", false], [22590, 0.003319, " the", false], [38629, 0.003119, " great", false], [50845, 0.002409, " account", false], [56540, 0.00157, " leverage", false]]], "model_b": [59093, 1, 0.7971101403236389, [[59093, 0.79711, " advantage", false], [30923, 0.024409, " full", false], [332, 0.015111, " a", false], [52195, 0.011364, " massive", false], [22590, 0.00994, " the", false], [63649, 0.007378, " inspiration", false], [38720, 0.006661, " human", false], [31162, 0.006457, " into", false], [4712, 0.003476, " on", false], [4423, 0.003407, " as", false]]]}, "raw_delta": -0.014013671874999998, "tuned_delta": 0.03884127202319983}, {"byte_start": 3315, "byte_end": 3318, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 574, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.03% 0.03% 0.03%", "model_b": "0.05% 0.05% 0.05%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9953218102455139]], "model_b": [[4706, " of", "normal", 0.9922602772712708]]}, "loss": {"model_a": 0.028067568620810366, "model_b": 0.046595832873763614}, "topk": {"model_a": [4706, 1, 0.9953218102455139, [[4706, 0.995322, " of", false], [45, 0.001156, ",", false], [4596, 0.000763, " in", false], [38720, 0.000596, " human", false], [275, 0.00022, " (", false], [45833, 0.000201, " either", false], [22590, 0.000155, " the", false], [22187, 0.000143, " not", false], [4715, 0.000132, " or", false], [30322, 9.2e-05, " both", false]]], "model_b": [4706, 1, 0.9922602772712708, [[4706, 0.99226, " of", false], [45, 0.001005, ",", false], [22187, 0.000651, " not", false], [22590, 0.000441, " the", false], [30322, 0.000418, " both", false], [45833, 0.000383, " either", false], [275, 0.000309, " (", false], [56003, 0.00029, " directly", false], [11, 0.000204, "\n", false], [332, 0.000198, " a", false]]]}, "raw_delta": -0.0010274251302083335, "tuned_delta": 0.051827518767991486}, {"byte_start": 3318, "byte_end": 3324, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 575, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "3.71% 3.71% 3.71% 3.71% 3.71% 3.71%", "model_b": "4.44% 4.44% 4.44% 4.44% 4.44% 4.44%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.29380398988723755]], "model_b": [[38720, " human", "normal", 0.23036672174930573]]}, "loss": {"model_a": 3.7100556064527375, "model_b": 4.437977908984604}, "topk": {"model_a": [38720, 1, 0.29380398988723755, [[38720, 0.293804, " human", false], [22590, 0.263014, " the", false], [59943, 0.061471, " knowledge", false], [62182, 0.028709, " linguistic", false], [45775, 0.017382, " domain", false], [332, 0.014888, " a", false], [52964, 0.011897, " special", false], [62293, 0.011503, " particular", false], [56215, 0.011367, " features", false], [53265, 0.009472, " various", false]]], "model_b": [38720, 1, 0.23036672174930573, [[38720, 0.230367, " human", false], [22590, 0.182838, " the", false], [52195, 0.024145, " massive", false], [47350, 0.022492, " speech", false], [52964, 0.02017, " special", false], [332, 0.02003, " a", false], [30597, 0.018796, " deep", false], [52167, 0.015644, " machine", false], [38864, 0.013886, " large", false], [62182, 0.009304, " linguistic", false]]]}, "raw_delta": -0.04036458333333334, "tuned_delta": 0.012490360564866479}, {"byte_start": 3324, "byte_end": 3334, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 576, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78%", "model_b": "1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.6488920450210571]], "model_b": [[59943, " knowledge", "normal", 0.4036145508289337]]}, "loss": {"model_a": 0.7784072364171407, "model_b": 1.627258566627688}, "topk": {"model_a": [59943, 1, 0.6488920450210571, [[59943, 0.648892, " knowledge", false], [65034, 0.168842, " understanding", false], [62182, 0.029598, " linguistic", false], [46, 0.025337, "-", false], [38786, 0.019423, " input", false], [59683, 0.018229, " expertise", false], [47350, 0.011887, " speech", false], [56529, 0.010498, " language", false], [61979, 0.003283, " experience", false], [59917, 0.003175, " intuition", false]]], "model_b": [59943, 1, 0.4036145508289337, [[59943, 0.403615, " knowledge", false], [65034, 0.092764, " understanding", false], [47350, 0.088315, " speech", false], [46, 0.082239, "-", false], [38786, 0.055486, " input", false], [56529, 0.035012, " language", false], [62182, 0.018001, " linguistic", false], [56537, 0.011822, " learning", false], [59683, 0.011316, " expertise", false], [46543, 0.00566, " memory", false]]]}, "raw_delta": -0.047070312499999996, "tuned_delta": 0.005784631398199826}, {"byte_start": 3334, "byte_end": 3337, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"model_a": "48.47% 48.47% 48.47%", "model_b": "50.72% 50.72% 50.72%"}, "model_tokens": {"model_a": [[5346, "---", "normal", 0.00032309035304933786]], "model_b": [[5346, "---", "normal", 0.00021370417380239815]]}, "loss": {"model_a": 48.46553652986361, "model_b": 50.719747531252615}, "topk": {"model_a": [5346, 39, 0.00032309035304933786, [[45, 0.262073, ",", false], [4706, 0.261997, " of", false], [47, 0.119919, ".", false], [37598, 0.087124, " about", false], [21265, 0.085614, " and", false], [275, 0.051029, " (", false], [4596, 0.03618, " in", false], [59, 0.018191, ":", false], [4811, 0.01088, " to", false], [32139, 0.007084, " such", false]]], "model_b": [5346, 58, 0.00021370417380239815, [[4706, 0.240509, " of", false], [45, 0.231625, ",", false], [47, 0.110663, ".", false], [37598, 0.082443, " about", false], [275, 0.068471, " (", false], [21265, 0.059972, " and", false], [4596, 0.044222, " in", false], [4811, 0.034828, " to", false], [4715, 0.017336, " or", false], [59, 0.011824, ":", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 3337, "byte_end": 3346, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 577, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33%", "model_b": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.02556772716343403]], "model_b": [[58313, "knowledge", "normal", 0.0027521008159965277]]}, "loss": {"model_a": 7.326185754514267, "model_b": 11.834607757292277}, "topk": {"model_a": [58313, 6, 0.02556772716343403, [[35381, 0.083752, "phone", false], [7579, 0.048503, "for", false], [27095, 0.045231, "such", false], [58282, 0.038122, "including", false], [1950, 0.026021, "in", false], [58313, 0.025568, "knowledge", false], [8801, 0.023042, "the", false], [2090, 0.022923, "of", false], [49411, 0.014458, "methods", false], [98, 0.013598, "a", false]]], "model_b": [58313, 64, 0.0027521008159965277, [[8801, 0.058501, "the", false], [7579, 0.046537, "for", false], [1950, 0.034562, "in", false], [98, 0.027765, "a", false], [7005, 0.026606, "and", false], [27095, 0.020699, "such", false], [58282, 0.01898, "including", false], [27142, 0.017465, "that", false], [8260, 0.017157, "not", false], [7195, 0.01586, "but", false]]]}, "raw_delta": -0.25, "tuned_delta": -0.19714505610180016}, {"byte_start": 3346, "byte_end": 3349, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 578, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.56% 1.56% 1.56%", "model_b": "7.70% 7.70% 7.70%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.7729128003120422]], "model_b": [[4706, " of", "normal", 0.27606573700904846]]}, "loss": {"model_a": 1.5615107457538422, "model_b": 7.7018875880791}, "topk": {"model_a": [4706, 1, 0.7729128003120422, [[4706, 0.772913, " of", false], [37598, 0.08798, " about", false], [32227, 0.056066, " that", false], [46, 0.005782, "-", false], [37810, 0.00523, " based", false], [32139, 0.004868, " such", false], [4596, 0.004641, " in", false], [30917, 0.003258, " from", false], [22187, 0.003252, " not", false], [55442, 0.003005, " acquired", false]]], "model_b": [4706, 1, 0.27606573700904846, [[4706, 0.276066, " of", false], [37598, 0.27008, " about", false], [32227, 0.186733, " that", false], [4596, 0.030895, " in", false], [4712, 0.019445, " on", false], [45, 0.009376, ",", false], [37810, 0.008859, " based", false], [30917, 0.008826, " from", false], [46, 0.008006, "-", false], [32139, 0.007894, " such", false]]]}, "raw_delta": -0.3404947916666667, "tuned_delta": -0.28763984776846685}, {"byte_start": 3349, "byte_end": 3355, "display": {"text": " words", "kind": "normal"}, "is_word": true, "word_id": 579, "word_key": " words", "bytes_hex": "20 77 6f 72 64 73", "compression": {"model_a": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "model_b": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99%"}, "model_tokens": {"model_a": [[40210, " words", "normal", 0.017510516569018364]], "model_b": [[40210, " words", "normal", 0.025606537237763405]]}, "loss": {"model_a": 12.116384132465903, "model_b": 10.9892786317714}, "topk": {"model_a": [40210, 11, 0.017510516569018364, [[22590, 0.210966, " the", false], [39273, 0.123534, " phone", false], [47350, 0.084013, " speech", false], [56529, 0.062707, " language", false], [21835, 0.041831, " how", false], [55440, 0.040199, " acoustic", false], [51860, 0.038633, " grammar", false], [62182, 0.034551, " linguistic", false], [59946, 0.021189, " languages", false], [64996, 0.018818, " pronunciation", false]]], "model_b": [40210, 6, 0.025606537237763405, [[22590, 0.261001, " the", false], [21835, 0.139231, " how", false], [39273, 0.066871, " phone", false], [47350, 0.047419, " speech", false], [32464, 0.027075, " what", false], [40210, 0.025607, " words", false], [56529, 0.024848, " language", false], [32497, 0.019637, " word", false], [50199, 0.018396, " English", false], [38720, 0.016389, " human", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 3355, "byte_end": 3356, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "6.09%", "model_b": "9.79%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.7119166851043701]], "model_b": [[45, ",", "normal", 0.5828771591186523]]}, "loss": {"model_a": 6.093414113129654, "model_b": 9.79172903728349}, "topk": {"model_a": [45, 1, 0.7119166851043701, [[45, 0.711917, ",", false], [21265, 0.19248, " and", false], [4596, 0.025162, " in", false], [275, 0.016054, " (", false], [32227, 0.009218, " that", false], [4715, 0.009197, " or", false], [4423, 0.004116, " as", false], [5346, 0.003781, "---", false], [40, 0.002749, "'", false], [4811, 0.001323, " to", false]]], "model_b": [45, 1, 0.5828771591186523, [[45, 0.582877, ",", false], [21265, 0.225873, " and", false], [4596, 0.033945, " in", false], [4715, 0.027299, " or", false], [275, 0.016747, " (", false], [32227, 0.014686, " that", false], [4423, 0.011387, " as", false], [30917, 0.00528, " from", false], [47, 0.004621, ".", false], [4811, 0.003507, " to", false]]]}, "raw_delta": -0.205078125, "tuned_delta": -0.15222318110180016}, {"byte_start": 3356, "byte_end": 3359, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 580, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "10.57% 10.57% 10.57%", "model_b": "17.94% 17.94% 17.94%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.17037168145179749]], "model_b": [[4706, " of", "normal", 0.050897203385829926]]}, "loss": {"model_a": 10.566614069010962, "model_b": 17.939762552720833}, "topk": {"model_a": [4706, 2, 0.17037168145179749, [[59943, 0.431444, " knowledge", false], [4706, 0.170372, " of", false], [51860, 0.050202, " grammar", false], [39273, 0.029664, " phone", false], [21265, 0.015132, " and", false], [32497, 0.013971, " word", false], [47486, 0.013711, " syntax", false], [64996, 0.011936, " pronunciation", false], [47341, 0.011697, " sounds", false], [52464, 0.011382, " phrases", false]]], "model_b": [4706, 5, 0.050897203385829926, [[51860, 0.091062, " grammar", false], [39273, 0.072042, " phone", false], [52464, 0.068061, " phrases", false], [64996, 0.053209, " pronunciation", false], [4706, 0.050897, " of", false], [47486, 0.040359, " syntax", false], [40210, 0.029404, " words", false], [59943, 0.027735, " knowledge", false], [47350, 0.025564, " speech", false], [39931, 0.021979, " their", false]]]}, "raw_delta": -0.4088541666666667, "tuned_delta": -0.35599922276846685}, {"byte_start": 3359, "byte_end": 3365, "display": {"text": " phone", "kind": "normal"}, "is_word": true, "word_id": 581, "word_key": " phone", "bytes_hex": "20 70 68 6f 6e 65", "compression": {"model_a": "7.65% 7.65% 7.65% 7.65% 7.65% 7.65%", "model_b": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"model_a": [[39273, " phone", "normal", 0.0778711661696434]], "model_b": [[39273, " phone", "normal", 0.09497666358947754]]}, "loss": {"model_a": 7.654924858883497, "model_b": 7.0913721085362456}, "topk": {"model_a": [39273, 2, 0.0778711661696434, [[51860, 0.179947, " grammar", false], [39273, 0.077871, " phone", false], [22590, 0.073666, " the", false], [47350, 0.047755, " speech", false], [56529, 0.043487, " language", false], [47486, 0.035144, " syntax", false], [64996, 0.024657, " pronunciation", false], [57192, 0.024372, " sentence", false], [51310, 0.023476, " context", false], [60476, 0.022758, " sentences", false]]], "model_b": [39273, 1, 0.09497666358947754, [[39273, 0.094977, " phone", false], [22590, 0.079305, " the", false], [51860, 0.06286, " grammar", false], [21835, 0.051815, " how", false], [47350, 0.049031, " speech", false], [64996, 0.046487, " pronunciation", false], [39931, 0.025336, " their", false], [47486, 0.025328, " syntax", false], [56529, 0.018075, " language", false], [31670, 0.017822, " phon", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 3365, "byte_end": 3368, "display": {"text": "mes", "kind": "normal"}, "is_word": true, "word_id": 582, "word_key": "mes", "bytes_hex": "6d 65 73", "compression": {"model_a": "2.88% 2.88% 2.88%", "model_b": "3.55% 3.55% 3.55%"}, "model_tokens": {"model_a": [[8164, "mes", "normal", 0.620806872844696]], "model_b": [[8164, "mes", "normal", 0.5542075634002686]]}, "loss": {"model_a": 2.8764671632307617, "model_b": 3.5456860542681228}, "topk": {"model_a": [8164, 1, 0.620806872844696, [[8164, 0.620807, "mes", false], [8807, 0.169609, "tic", false], [27159, 0.163428, "tics", false], [2038, 0.030895, "me", false], [8169, 0.008397, "mic", false], [35770, 0.002482, "tical", false], [46, 0.000412, "-", false], [31989, 0.000307, " sets", false], [60483, 0.000143, " sequences", false], [56832, 0.000135, " patterns", false]]], "model_b": [8164, 1, 0.5542075634002686, [[8164, 0.554208, "mes", false], [27159, 0.1936, "tics", false], [8807, 0.118074, "tic", false], [2038, 0.107848, "me", false], [8169, 0.011126, "mic", false], [52333, 0.002313, " numbers", false], [35770, 0.002224, "tical", false], [46, 0.000864, "-", false], [56832, 0.00057, " patterns", false], [40050, 0.000541, " types", false]]]}, "raw_delta": -0.037109375, "tuned_delta": 0.01574556889819982}, {"byte_start": 3368, "byte_end": 3369, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.29%", "model_b": "3.54%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8807870745658875]], "model_b": [[45, ",", "normal", 0.8224924802780151]]}, "loss": {"model_a": 2.289433048285708, "model_b": 3.539815713118672}, "topk": {"model_a": [45, 1, 0.8807870745658875, [[45, 0.880787, ",", false], [21265, 0.046662, " and", false], [275, 0.034836, " (", false], [4596, 0.010483, " in", false], [4715, 0.005838, " or", false], [5346, 0.003906, "---", false], [4706, 0.003214, " of", false], [47, 0.003036, ".", false], [4423, 0.001426, " as", false], [32227, 0.001153, " that", false]]], "model_b": [45, 1, 0.8224924802780151, [[45, 0.822492, ",", false], [21265, 0.080392, " and", false], [275, 0.032952, " (", false], [4715, 0.014513, " or", false], [4596, 0.011592, " in", false], [5346, 0.009886, "---", false], [47, 0.004767, ".", false], [4706, 0.003239, " of", false], [21643, 0.00182, " etc", false], [48, 0.001745, "/", false]]]}, "raw_delta": -0.0693359375, "tuned_delta": -0.01648099360180018}, {"byte_start": 3369, "byte_end": 3372, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 583, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.37% 1.37% 1.37%", "model_b": "2.40% 2.40% 2.40%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.7971240878105164]], "model_b": [[4706, " of", "normal", 0.6710361838340759]]}, "loss": {"model_a": 1.3677894878219745, "model_b": 2.3950991889758177}, "topk": {"model_a": [4706, 1, 0.7971240878105164, [[4706, 0.797124, " of", false], [21265, 0.113438, " and", false], [21643, 0.02585, " etc", false], [4715, 0.009571, " or", false], [30788, 0.006602, " even", false], [59943, 0.006489, " knowledge", false], [22590, 0.002197, " the", false], [39273, 0.001862, " phone", false], [55440, 0.001429, " acoustic", false], [51860, 0.001424, " grammar", false]]], "model_b": [4706, 1, 0.6710361838340759, [[4706, 0.671036, " of", false], [21265, 0.143216, " and", false], [21643, 0.059485, " etc", false], [4715, 0.037658, " or", false], [31768, 0.004698, " pros", false], [31162, 0.004665, " into", false], [39273, 0.003883, " phone", false], [22590, 0.003579, " the", false], [30788, 0.003231, " even", false], [32497, 0.002872, " word", false]]]}, "raw_delta": -0.056966145833333336, "tuned_delta": -0.004111201935133514}, {"byte_start": 3372, "byte_end": 3376, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 584, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.20% 11.20% 11.20% 11.20%", "model_b": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.08411436527967453]], "model_b": [[22590, " the", "normal", 0.07578276842832565]]}, "loss": {"model_a": 11.20061091315162, "model_b": 11.623275475912058}, "topk": {"model_a": [22590, 2, 0.08411436527967453, [[51860, 0.137388, " grammar", false], [22590, 0.084114, " the", false], [55440, 0.053842, " acoustic", false], [56529, 0.037841, " language", false], [51310, 0.035892, " context", false], [47350, 0.035343, " speech", false], [62182, 0.028634, " linguistic", false], [39273, 0.028403, " phone", false], [47486, 0.022636, " syntax", false], [21835, 0.021268, " how", false]]], "model_b": [22590, 1, 0.07578276842832565, [[22590, 0.075783, " the", false], [31768, 0.051418, " pros", false], [39273, 0.046542, " phone", false], [51860, 0.045761, " grammar", false], [47350, 0.04559, " speech", false], [32497, 0.040197, " word", false], [64996, 0.034782, " pronunciation", false], [47486, 0.030995, " syntax", false], [56529, 0.027846, " language", false], [21835, 0.024345, " how", false]]]}, "raw_delta": -0.0234375, "tuned_delta": 0.02941744389819982}, {"byte_start": 3376, "byte_end": 3382, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 585, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.006282585673034191]], "model_b": [[38720, " human", "normal", 0.01362643949687481]]}, "loss": {"model_a": 15.215924259375784, "model_b": 12.96171325798678}, "topk": {"model_a": [38720, 28, 0.006282585673034191, [[60572, 0.123306, " structure", false], [55440, 0.073841, " acoustic", false], [51860, 0.063286, " grammar", false], [22752, 0.030879, " way", false], [39273, 0.024935, " phone", false], [47341, 0.021408, " sounds", false], [51310, 0.021384, " context", false], [47350, 0.020398, " speech", false], [56529, 0.019784, " language", false], [39747, 0.018825, " sound", false]]], "model_b": [38720, 17, 0.01362643949687481, [[31768, 0.094887, " pros", false], [60572, 0.078331, " structure", false], [39273, 0.035889, " phone", false], [51860, 0.028476, " grammar", false], [31670, 0.02377, " phon", false], [51310, 0.023641, " context", false], [55440, 0.022095, " acoustic", false], [39558, 0.020655, " rules", false], [47341, 0.019361, " sounds", false], [64996, 0.018247, " pronunciation", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17785494389819984}, {"byte_start": 3382, "byte_end": 3388, "display": {"text": " vocal", "kind": "normal"}, "is_word": true, "word_id": 586, "word_key": " vocal", "bytes_hex": "20 76 6f 63 61 6c", "compression": {"model_a": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%", "model_b": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"model_a": [[40136, " vocal", "normal", 0.09253990650177002]], "model_b": [[40136, " vocal", "normal", 0.01580442301928997]]}, "loss": {"model_a": 7.0913721085362456, "model_b": 12.492085966030738}, "topk": {"model_a": [40136, 2, 0.09253990650177002, [[40139, 0.422688, " voice", false], [40136, 0.09254, " vocal", false], [47350, 0.064301, " speech", false], [56529, 0.04479, " language", false], [50905, 0.031893, " anatomy", false], [55579, 0.031252, " auditory", false], [52963, 0.030694, " speaker", false], [21590, 0.022464, " ear", false], [62321, 0.017937, " physiology", false], [39070, 0.01777, " mouth", false]]], "model_b": [40136, 11, 0.01580442301928997, [[40139, 0.313743, " voice", false], [52963, 0.073862, " speaker", false], [21590, 0.067246, " ear", false], [56529, 0.066009, " language", false], [31427, 0.032605, " mind", false], [30305, 0.027915, " body", false], [37898, 0.025389, " brain", false], [47577, 0.023401, " tongue", false], [46, 0.022691, "-", false], [47350, 0.020376, " speech", false]]]}, "raw_delta": -0.2994791666666667, "tuned_delta": -0.24662422276846685}, {"byte_start": 3388, "byte_end": 3394, "display": {"text": " tract", "kind": "normal"}, "is_word": true, "word_id": 587, "word_key": " tract", "bytes_hex": "20 74 72 61 63 74", "compression": {"model_a": "1.10% 1.10% 1.10% 1.10% 1.10% 1.10%", "model_b": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"model_a": [[39996, " tract", "normal", 0.695245623588562]], "model_b": [[39996, " tract", "normal", 0.633985698223114]]}, "loss": {"model_a": 1.09775379494725, "model_b": 1.3677894878219745}, "topk": {"model_a": [39996, 1, 0.695245623588562, [[39996, 0.695246, " tract", false], [59153, 0.12353, " apparatus", false], [47487, 0.065208, " system", false], [50905, 0.040905, " anatomy", false], [38115, 0.009449, " cords", false], [46719, 0.009121, " organs", false], [59994, 0.008012, " mechanism", false], [38024, 0.004497, " chord", false], [62382, 0.00436, " production", false], [39191, 0.003789, " organ", false]]], "model_b": [39996, 1, 0.633985698223114, [[39996, 0.633986, " tract", false], [50905, 0.075687, " anatomy", false], [47487, 0.057809, " system", false], [59153, 0.040349, " apparatus", false], [59994, 0.025103, " mechanism", false], [39438, 0.021739, " range", false], [49344, 0.008682, "ization", false], [46, 0.005294, "-", false], [51706, 0.003789, " faculty", false], [54114, 0.003641, "izations", false]]]}, "raw_delta": -0.014973958333333337, "tuned_delta": 0.037880985564866486}, {"byte_start": 3394, "byte_end": 3395, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "9.16%", "model_b": "10.78%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.6020835041999817]], "model_b": [[45, ",", "normal", 0.5521984696388245]]}, "loss": {"model_a": 9.157732193142833, "model_b": 10.777946350391181}, "topk": {"model_a": [45, 1, 0.6020835041999817, [[45, 0.602084, ",", false], [47, 0.158145, ".", false], [5346, 0.107527, "---", false], [21265, 0.08151, " and", false], [275, 0.008191, " (", false], [568, 0.004627, "--", false], [21643, 0.003592, " etc", false], [60, 0.003487, ";", false], [50905, 0.002659, " anatomy", false], [116, 0.002186, "s", false]]], "model_b": [45, 1, 0.5521984696388245, [[45, 0.552198, ",", false], [47, 0.176571, ".", false], [5346, 0.126866, "---", false], [21265, 0.048886, " and", false], [275, 0.019035, " (", false], [460, 0.007379, "'s", false], [60572, 0.006079, " structure", false], [4423, 0.005736, " as", false], [21643, 0.004983, " etc", false], [568, 0.004207, "--", false]]]}, "raw_delta": -0.08984375, "tuned_delta": -0.03698880610180018}, {"byte_start": 3395, "byte_end": 3399, "display": {"text": " etc", "kind": "normal"}, "is_word": true, "word_id": 588, "word_key": " etc", "bytes_hex": "20 65 74 63", "compression": {"model_a": "9.93% 9.93% 9.93% 9.93%", "model_b": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"model_a": [[21643, " etc", "normal", 0.11122097074985504]], "model_b": [[21643, " etc", "normal", 0.15003611147403717]]}, "loss": {"model_a": 9.932617224870304, "model_b": 8.594179442795582}, "topk": {"model_a": [21643, 3, 0.11122097074985504, [[4706, 0.511816, " of", false], [21265, 0.29685, " and", false], [21643, 0.111221, " etc", false], [59943, 0.017757, " knowledge", false], [4715, 0.008257, " or", false], [30788, 0.007334, " even", false], [22590, 0.005926, " the", false], [55440, 0.001916, " acoustic", false], [4522, 0.001897, " et", false], [4423, 0.001601, " as", false]]], "model_b": [21643, 3, 0.15003611147403717, [[4706, 0.483461, " of", false], [21265, 0.216552, " and", false], [21643, 0.150036, " etc", false], [4715, 0.0259, " or", false], [22590, 0.01541, " the", false], [30788, 0.009006, " even", false], [21700, 0.007779, " for", false], [21400, 0.005596, " but", false], [59943, 0.003964, " knowledge", false], [4522, 0.003899, " et", false]]]}, "raw_delta": 0.07421875, "tuned_delta": 0.12707369389819984}, {"byte_start": 3399, "byte_end": 3400, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "4.54%", "model_b": "2.84%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7773990631103516]], "model_b": [[47, ".", "normal", 0.8546682596206665]]}, "loss": {"model_a": 4.543644049674714, "model_b": 2.835374775184608}, "topk": {"model_a": [47, 1, 0.7773990631103516, [[47, 0.777399, ".", false], [5361, 0.092753, ".--", false], [583, 0.057147, ".,", false], [5346, 0.038118, "---", false], [584, 0.006711, ".-", false], [45, 0.004824, ",", false], [23326, 0.004311, ".—", false], [25358, 0.003669, "eter", false], [585, 0.002989, "..", false], [568, 0.00243, "--", false]]], "model_b": [47, 1, 0.8546682596206665, [[47, 0.854668, ".", false], [5361, 0.058676, ".--", false], [583, 0.031134, ".,", false], [5346, 0.018914, "---", false], [45, 0.008065, ",", false], [568, 0.005049, "--", false], [585, 0.002693, "..", false], [584, 0.002321, ".-", false], [19310, 0.002009, " ---", false], [23323, 0.001692, "....", false]]]}, "raw_delta": 0.0947265625, "tuned_delta": 0.14758150639819984}, {"byte_start": 3400, "byte_end": 3403, "display": {"text": " On", "kind": "normal"}, "is_word": true, "word_id": 589, "word_key": " on", "bytes_hex": "20 4f 6e", "compression": {"model_a": "39.64% 39.64% 39.64%", "model_b": "39.07% 39.07% 39.07%"}, "model_tokens": {"model_a": [[4095, " On", "normal", 0.0013493710430338979]], "model_b": [[4095, " On", "normal", 0.001505706924945116]]}, "loss": {"model_a": 39.636543441090005, "model_b": 39.07299069074275}, "topk": {"model_a": [4095, 73, 0.0013493710430338979, [[20996, 0.182047, " The", false], [37453, 0.104859, " These", false], [19555, 0.06217, " But", false], [3913, 0.038369, " In", false], [19407, 0.031001, " All", false], [29894, 0.030291, " This", false], [37451, 0.027659, " There", false], [29804, 0.027328, " Some", false], [20556, 0.025084, " One", false], [29425, 0.02314, " Most", false]]], "model_b": [4095, 74, 0.001505706924945116, [[20996, 0.126201, " The", false], [19555, 0.100272, " But", false], [37453, 0.087399, " These", false], [3913, 0.04871, " In", false], [29894, 0.041004, " This", false], [37451, 0.022973, " There", false], [19407, 0.020885, " All", false], [20556, 0.017046, " One", false], [3918, 0.016936, " It", false], [275, 0.016777, " (", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 3403, "byte_end": 3407, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 590, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.69% 2.69% 2.69% 2.69%", "model_b": "2.17% 2.17% 2.17% 2.17%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.5485147833824158]], "model_b": [[22590, " the", "normal", 0.6135150790214539]]}, "loss": {"model_a": 2.6944865875977952, "model_b": 2.174961395871423}, "topk": {"model_a": [22590, 1, 0.5485147833824158, [[22590, 0.548515, " the", false], [332, 0.072087, " a", false], [22615, 0.047236, " top", false], [50987, 0.04597, " average", false], [32234, 0.039006, " this", false], [22226, 0.034711, " one", false], [34514, 0.011914, "going", false], [39227, 0.011598, " paper", false], [39931, 0.011246, " their", false], [32227, 0.011073, " that", false]]], "model_b": [22590, 1, 0.6135150790214539, [[22590, 0.613515, " the", false], [332, 0.064957, " a", false], [39227, 0.035367, " paper", false], [22226, 0.019418, " one", false], [22615, 0.01902, " top", false], [21902, 0.018876, " its", false], [32234, 0.015073, " this", false], [50987, 0.013909, " average", false], [32074, 0.013251, " some", false], [39931, 0.010348, " their", false]]]}, "raw_delta": 0.02880859375, "tuned_delta": 0.08166353764819982}, {"byte_start": 3407, "byte_end": 3413, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 591, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "2.35% 2.35% 2.35% 2.35% 2.35% 2.35%", "model_b": "2.08% 2.08% 2.08% 2.08% 2.08% 2.08%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.4540320932865143]], "model_b": [[39193, " other", "normal", 0.5004579424858093]]}, "loss": {"model_a": 2.3481364597802137, "model_b": 2.078100766905489}, "topk": {"model_a": [39193, 1, 0.4540320932865143, [[39193, 0.454032, " other", false], [40190, 0.139123, " whole", false], [37815, 0.070571, " basis", false], [22226, 0.039272, " one", false], [30807, 0.027172, " face", false], [53064, 0.01248, " surface", false], [38499, 0.009485, " first", false], [19678, 0.007714, " DAR", false], [30218, 0.006248, " back", false], [22752, 0.004875, " way", false]]], "model_b": [39193, 1, 0.5004579424858093, [[39193, 0.500458, " other", false], [37815, 0.081935, " basis", false], [53064, 0.071662, " surface", false], [22226, 0.038991, " one", false], [40190, 0.030635, " whole", false], [30807, 0.016466, " face", false], [55855, 0.011328, " contrary", false], [38499, 0.006439, " first", false], [38720, 0.005718, " human", false], [31515, 0.005127, " next", false]]]}, "raw_delta": 0.014973958333333343, "tuned_delta": 0.06782890223153316}, {"byte_start": 3413, "byte_end": 3418, "display": {"text": " side", "kind": "normal"}, "is_word": true, "word_id": 592, "word_key": " side", "bytes_hex": "20 73 69 64 65", "compression": {"model_a": "3.00% 3.00% 3.00% 3.00% 3.00%", "model_b": "7.61% 7.61% 7.61% 7.61% 7.61%"}, "model_tokens": {"model_a": [[32011, " side", "normal", 0.43465369939804077]], "model_b": [[32011, " side", "normal", 0.12040365487337112]]}, "loss": {"model_a": 3.000918395599113, "model_b": 7.607962129687892}, "topk": {"model_a": [32011, 2, 0.43465369939804077, [[31044, 0.541748, " hand", false], [32011, 0.434654, " side", false], [21616, 0.015571, " end", false], [32207, 0.001555, " team", false], [45, 0.001225, ",", false], [51699, 0.000939, " extreme", false], [38559, 0.000278, " front", false], [32462, 0.00024, " were", false], [38660, 0.000145, " hands", false], [57274, 0.000126, " spectrum", false]]], "model_b": [32011, 2, 0.12040365487337112, [[31044, 0.825368, " hand", false], [32011, 0.120404, " side", false], [21616, 0.042194, " end", false], [51699, 0.003427, " extreme", false], [38660, 0.001377, " hands", false], [45, 0.000913, ",", false], [57274, 0.000333, " spectrum", false], [21795, 0.000312, " had", false], [30729, 0.000271, " edge", false], [55532, 0.000262, " approach", false]]]}, "raw_delta": -0.25546875, "tuned_delta": -0.2026138061018002}, {"byte_start": 3418, "byte_end": 3423, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 593, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "4.62% 4.62% 4.62% 4.62% 4.62%", "model_b": "5.78% 5.78% 5.78% 5.78% 5.78%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.27824515104293823]], "model_b": [[32462, " were", "normal", 0.20073066651821136]]}, "loss": {"model_a": 4.62113255284746, "model_b": 5.776415691059325}, "topk": {"model_a": [32462, 2, 0.27824515104293823, [[45, 0.332613, ",", false], [32462, 0.278245, " were", false], [22748, 0.193529, " was", false], [4706, 0.157525, " of", false], [39934, 0.019791, " there", false], [39826, 0.004007, " stood", false], [22590, 0.001946, " the", false], [275, 0.001543, " (", false], [4858, 0.001369, " we", false], [5346, 0.001042, "---", false]]], "model_b": [32462, 2, 0.20073066651821136, [[4706, 0.535615, " of", false], [32462, 0.200731, " were", false], [45, 0.141315, ",", false], [22748, 0.094355, " was", false], [39934, 0.008075, " there", false], [39826, 0.004372, " stood", false], [22590, 0.001672, " the", false], [4858, 0.001172, " we", false], [55526, 0.000754, " appeared", false], [275, 0.000715, " (", false]]]}, "raw_delta": -0.06406250000000002, "tuned_delta": -0.0112075561018002}, {"byte_start": 3423, "byte_end": 3429, "display": {"text": " newer", "kind": "normal"}, "is_word": true, "word_id": 594, "word_key": " newer", "bytes_hex": "20 6e 65 77 65 72", "compression": {"model_a": "26.67% 26.67% 26.67% 26.67% 26.67% 26.67%", "model_b": "25.74% 25.74% 25.74% 25.74% 25.74% 25.74%"}, "model_tokens": {"model_a": [[39116, " newer", "normal", 0.00014249391097109765]], "model_b": [[39116, " newer", "normal", 0.00019147903367411345]]}, "loss": {"model_a": 26.67483018310323, "model_b": 25.73557559919114}, "topk": {"model_a": [39116, 286, 0.00014249391097109765, [[52224, 0.220191, " methods", false], [63843, 0.15007, " researchers", false], [22590, 0.12913, " the", false], [332, 0.042049, " a", false], [39944, 0.020052, " those", false], [61590, 0.019922, " approaches", false], [39904, 0.018776, " teams", false], [62633, 0.015403, " techniques", false], [51566, 0.014795, " efforts", false], [38328, 0.01268, " early", false]]], "model_b": [39116, 352, 0.00019147903367411345, [[52224, 0.156762, " methods", false], [22590, 0.067576, " the", false], [332, 0.056346, " a", false], [51832, 0.054622, " general", false], [31370, 0.029493, " many", false], [61590, 0.028995, " approaches", false], [63843, 0.016833, " researchers", false], [47202, 0.016601, " search", false], [22638, 0.016214, " two", false], [31458, 0.012718, " more", false]]]}, "raw_delta": 0.05208333333333348, "tuned_delta": 0.1049382772315333}, {"byte_start": 3429, "byte_end": 3437, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 595, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "1.65% 1.65% 1.65% 1.65% 1.65% 1.65% 1.65% 1.65%", "model_b": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.4750566780567169]], "model_b": [[52224, " methods", "normal", 0.5422415733337402]]}, "loss": {"model_a": 1.646630692420875, "model_b": 1.373659828971425}, "topk": {"model_a": [52224, 1, 0.4750566780567169, [[52224, 0.475057, " methods", false], [45, 0.132048, ",", false], [61590, 0.132043, " approaches", false], [62633, 0.062625, " techniques", false], [38378, 0.036777, " entra", false], [21265, 0.023924, " and", false], [63843, 0.01749, " researchers", false], [57103, 0.010006, " research", false], [63363, 0.00721, " competitors", false], [4404, 0.005998, " ``", false]]], "model_b": [52224, 1, 0.5422415733337402, [[52224, 0.542242, " methods", false], [61590, 0.125874, " approaches", false], [45, 0.084401, ",", false], [21265, 0.039065, " and", false], [51832, 0.037902, " general", false], [62633, 0.033068, " techniques", false], [61559, 0.007324, " algorithms", false], [57103, 0.006276, " research", false], [53087, 0.005361, " systems", false], [38378, 0.004843, " entra", false]]]}, "raw_delta": 0.01513671875, "tuned_delta": 0.06799166264819982}, {"byte_start": 3437, "byte_end": 3442, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 596, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.13% 3.13% 3.13% 3.13% 3.13%", "model_b": "1.45% 1.45% 1.45% 1.45% 1.45%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.42222630977630615]], "model_b": [[32227, " that", "normal", 0.6665999889373779]]}, "loss": {"model_a": 3.1277177644272443, "model_b": 1.451148332144172}, "topk": {"model_a": [32227, 1, 0.42222630977630615, [[32227, 0.422226, " that", false], [37810, 0.231703, " based", false], [45, 0.104707, ",", false], [4706, 0.03518, " of", false], [40085, 0.022135, " using", false], [5346, 0.02004, "---", false], [32139, 0.014706, " such", false], [21700, 0.011623, " for", false], [275, 0.009671, " (", false], [38888, 0.008659, " lever", false]]], "model_b": [32227, 1, 0.6665999889373779, [[32227, 0.6666, " that", false], [37810, 0.103047, " based", false], [45, 0.069208, ",", false], [5346, 0.01243, "---", false], [40186, 0.011847, " which", false], [4706, 0.011824, " of", false], [40085, 0.009252, " using", false], [275, 0.009182, " (", false], [38888, 0.008914, " lever", false], [32487, 0.006785, " with", false]]]}, "raw_delta": 0.09296874999999999, "tuned_delta": 0.14582369389819982}, {"byte_start": 3442, "byte_end": 3447, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 597, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "7.95% 7.95% 7.95% 7.95% 7.95%", "model_b": "9.41% 9.41% 9.41% 9.41% 9.41%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.11201926320791245]], "model_b": [[32462, " were", "normal", 0.07283622026443481]]}, "loss": {"model_a": 7.946093779896243, "model_b": 9.411330930799096}, "topk": {"model_a": [32462, 3, 0.11201926320791245, [[32354, 0.161455, " used", false], [32272, 0.132327, " took", false], [32462, 0.112019, " were", false], [21532, 0.051007, " did", false], [56540, 0.050717, " leverage", false], [57510, 0.038327, " utilized", false], [31351, 0.037906, " made", false], [47054, 0.026644, " relied", false], [21795, 0.020182, " had", false], [50937, 0.015936, " applied", false]]], "model_b": [32462, 4, 0.07283622026443481, [[56540, 0.242768, " leverage", false], [32272, 0.185704, " took", false], [32354, 0.089097, " used", false], [32462, 0.072836, " were", false], [57510, 0.035139, " utilized", false], [47054, 0.03357, " relied", false], [59685, 0.031037, " exploited", false], [21532, 0.020129, " did", false], [31351, 0.016628, " made", false], [38128, 0.01276, " could", false]]]}, "raw_delta": -0.08124999999999999, "tuned_delta": -0.028395056101800167}, {"byte_start": 3447, "byte_end": 3452, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 598, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "10.59% 10.59% 10.59% 10.59% 10.59%", "model_b": "10.93% 10.93% 10.93% 10.93% 10.93%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.05285457521677017]], "model_b": [[31458, " more", "normal", 0.048501159995794296]]}, "loss": {"model_a": 10.594791706528325, "model_b": 10.932923356736675}, "topk": {"model_a": [31458, 2, 0.05285457521677017, [[37810, 0.291151, " based", false], [31458, 0.052855, " more", false], [22187, 0.051126, " not", false], [63541, 0.019233, " essentially", false], [46957, 0.017331, " purely", false], [31466, 0.016338, " much", false], [47202, 0.016037, " search", false], [51832, 0.012933, " general", false], [45, 0.009769, ",", false], [52094, 0.009434, " largely", false]]], "model_b": [31458, 2, 0.048501159995794296, [[37810, 0.323314, " based", false], [31458, 0.048501, " more", false], [22187, 0.032772, " not", false], [31277, 0.019341, " less", false], [31466, 0.01617, " much", false], [51832, 0.015168, " general", false], [46083, 0.014954, " geared", false], [63541, 0.014361, " essentially", false], [52094, 0.01217, " largely", false], [53180, 0.011121, " trained", false]]]}, "raw_delta": -0.018749999999999933, "tuned_delta": 0.03410494389819989}, {"byte_start": 3452, "byte_end": 3464, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 599, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"model_a": "7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56%", "model_b": "10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94%"}, "model_tokens": {"model_a": [[63885, " statistical", "normal", 0.006669470574706793]], "model_b": [[63885, " statistical", "normal", 0.0006863577291369438]]}, "loss": {"model_a": 7.560999400492288, "model_b": 10.942315902575794}, "topk": {"model_a": [63885, 20, 0.006669470574706793, [[51832, 0.385186, " general", false], [31296, 0.069652, " like", false], [30579, 0.026033, " data", false], [59593, 0.024663, " effective", false], [59758, 0.023369, " generally", false], [4715, 0.019216, " or", false], [4596, 0.018707, " in", false], [64862, 0.014551, " computational", false], [37810, 0.013754, " based", false], [51216, 0.011926, " closely", false]]], "model_b": [63885, 112, 0.0006863577291369438, [[51832, 0.345844, " general", false], [59593, 0.086187, " effective", false], [31296, 0.041248, " like", false], [64862, 0.03242, " computational", false], [56900, 0.0232, " powerful", false], [59594, 0.015708, " efficient", false], [30579, 0.015003, " data", false], [65014, 0.014716, " sophisticated", false], [63594, 0.01466, " generalized", false], [4404, 0.010506, " ``", false]]]}, "raw_delta": -0.18750000000000003, "tuned_delta": -0.13464505610180022}, {"byte_start": 3464, "byte_end": 3467, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 600, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "7.47% 7.47% 7.47%", "model_b": "10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.2928273677825928]], "model_b": [[4596, " in", "normal", 0.1634882092475891]]}, "loss": {"model_a": 7.467073942101079, "model_b": 10.848390444184586}, "topk": {"model_a": [4596, 2, 0.2928273677825928, [[45, 0.33551, ",", false], [4596, 0.292827, " in", false], [21265, 0.179348, " and", false], [47, 0.073304, ".", false], [5346, 0.027321, "---", false], [275, 0.025163, " (", false], [4715, 0.012488, " or", false], [32226, 0.006861, " than", false], [59, 0.005239, ":", false], [46, 0.004868, "-", false]]], "model_b": [4596, 3, 0.1634882092475891, [[45, 0.330661, ",", false], [21265, 0.198319, " and", false], [4596, 0.163488, " in", false], [5346, 0.067936, "---", false], [47, 0.067906, ".", false], [275, 0.040216, " (", false], [59, 0.016909, ":", false], [4715, 0.016058, " or", false], [46, 0.014868, "-", false], [32226, 0.014474, " than", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13464505610180016}, {"byte_start": 3467, "byte_end": 3474, "display": {"text": " nature", "kind": "normal"}, "is_word": true, "word_id": 601, "word_key": " nature", "bytes_hex": "20 6e 61 74 75 72 65", "compression": {"model_a": "0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74%", "model_b": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"model_a": [[46642, " nature", "normal", 0.7467482089996338]], "model_b": [[46642, " nature", "normal", 0.6401297450065613]]}, "loss": {"model_a": 0.7446947058160106, "model_b": 1.1422006636502329}, "topk": {"model_a": [46642, 1, 0.7467482089996338, [[46642, 0.746748, " nature", false], [55532, 0.071425, " approach", false], [59284, 0.053146, " character", false], [39931, 0.046491, " their", false], [46004, 0.022895, " flavor", false], [22590, 0.010958, " the", false], [47362, 0.010222, " spirit", false], [63735, 0.005132, " orientation", false], [46723, 0.002439, " origin", false], [30899, 0.002177, " form", false]]], "model_b": [46642, 1, 0.6401297450065613, [[46642, 0.64013, " nature", false], [39931, 0.124695, " their", false], [59284, 0.056782, " character", false], [55532, 0.045545, " approach", false], [47362, 0.019634, " spirit", false], [22590, 0.015036, " the", false], [63735, 0.009623, " orientation", false], [32227, 0.009476, " that", false], [45717, 0.00762, " design", false], [46723, 0.004841, " origin", false]]]}, "raw_delta": -0.022042410714285723, "tuned_delta": 0.0308125331839141}, {"byte_start": 3474, "byte_end": 3478, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 602, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "7.82% 7.82% 7.82% 7.82%", "model_b": "8.49% 8.49% 8.49% 8.49%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.178047314286232]], "model_b": [[21265, " and", "normal", 0.1532915085554123]]}, "loss": {"model_a": 7.819294411068111, "model_b": 8.488513302105472}, "topk": {"model_a": [21265, 3, 0.178047314286232, [[45, 0.451097, ",", false], [47, 0.234303, ".", false], [21265, 0.178047, " and", false], [5346, 0.0492, "---", false], [275, 0.045993, " (", false], [59, 0.011368, ":", false], [21400, 0.010095, " but", false], [60, 0.006038, ";", false], [4715, 0.002039, " or", false], [32227, 0.001723, " that", false]]], "model_b": [21265, 3, 0.1532915085554123, [[45, 0.43571, ",", false], [47, 0.172826, ".", false], [21265, 0.153292, " and", false], [5346, 0.123379, "---", false], [275, 0.041105, " (", false], [21400, 0.02491, " but", false], [59, 0.014398, ":", false], [60, 0.006037, ";", false], [568, 0.003095, "--", false], [19310, 0.00301, " ---", false]]]}, "raw_delta": -0.037109375, "tuned_delta": 0.01574556889819982}, {"byte_start": 3478, "byte_end": 3482, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 603, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"model_a": "11.76% 11.76% 11.76% 11.76%", "model_b": "16.34% 16.34% 16.34% 16.34%"}, "model_tokens": {"model_a": [[21532, " did", "normal", 0.07366282492876053]], "model_b": [[21532, " did", "normal", 0.026745272800326347]]}, "loss": {"model_a": 11.76416366349887, "model_b": 16.343029760070287}, "topk": {"model_a": [21532, 3, 0.07366282492876053, [[32227, 0.155326, " that", false], [32354, 0.075692, " used", false], [21532, 0.073663, " did", false], [37810, 0.064063, " based", false], [32462, 0.050208, " were", false], [31458, 0.046267, " more", false], [32272, 0.025165, " took", false], [31351, 0.02509, " made", false], [21795, 0.02413, " had", false], [45, 0.021957, ",", false]]], "model_b": [21532, 11, 0.026745272800326347, [[32462, 0.088614, " were", false], [32227, 0.077926, " that", false], [32354, 0.058563, " used", false], [47054, 0.051332, " relied", false], [31458, 0.044029, " more", false], [56540, 0.03619, " leverage", false], [32272, 0.035076, " took", false], [37810, 0.032181, " based", false], [45, 0.028844, ",", false], [40186, 0.028734, " which", false]]]}, "raw_delta": -0.25390625, "tuned_delta": -0.20105130610180016}, {"byte_start": 3482, "byte_end": 3487, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 604, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "22.99% 22.99% 22.99% 22.99% 22.99%", "model_b": "15.22% 15.22% 15.22% 15.22% 15.22%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.0016968126874417067]], "model_b": [[31466, " much", "normal", 0.014698252081871033]]}, "loss": {"model_a": 22.99295221416785, "model_b": 15.215924259375784}, "topk": {"model_a": [31466, 4, 0.0016968126874417067, [[22187, 0.976157, " not", false], [30211, 0.004169, " away", false], [4692, 0.002717, " no", false], [31466, 0.001697, " much", false], [31277, 0.001413, " less", false], [31458, 0.001256, " more", false], [46454, 0.001184, " little", false], [332, 0.001044, " a", false], [45301, 0.00079, " better", false], [31856, 0.000556, " rely", false]]], "model_b": [31466, 3, 0.014698252081871033, [[22187, 0.855129, " not", false], [45301, 0.02019, " better", false], [31466, 0.014698, " much", false], [332, 0.010246, " a", false], [30211, 0.008508, " away", false], [22590, 0.006436, " the", false], [32458, 0.006197, " well", false], [31277, 0.006173, " less", false], [46454, 0.005336, " little", false], [21660, 0.004987, " far", false]]]}, "raw_delta": 0.4312499999999999, "tuned_delta": 0.48410494389819975}, {"byte_start": 3487, "byte_end": 3492, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 605, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "8.74% 8.74% 8.74% 8.74% 8.74%", "model_b": "10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.08817194402217865]], "model_b": [[31458, " more", "normal", 0.05937027186155319]]}, "loss": {"model_a": 8.735067630382394, "model_b": 10.200304781285249}, "topk": {"model_a": [31458, 3, 0.08817194402217865, [[45301, 0.483806, " better", false], [31277, 0.297442, " less", false], [31458, 0.088172, " more", false], [4706, 0.045373, " of", false], [32487, 0.014982, " with", false], [22590, 0.013964, " the", false], [4811, 0.009794, " to", false], [45, 0.005089, ",", false], [4715, 0.004059, " or", false], [38475, 0.002839, " fewer", false]]], "model_b": [31458, 4, 0.05937027186155319, [[45301, 0.645097, " better", false], [31277, 0.190808, " less", false], [4706, 0.084448, " of", false], [31458, 0.05937, " more", false], [22590, 0.003261, " the", false], [45, 0.002562, ",", false], [40216, 0.002015, " worse", false], [4811, 0.001901, " to", false], [38475, 0.000964, " fewer", false], [51867, 0.000813, " greater", false]]]}, "raw_delta": -0.08125000000000004, "tuned_delta": -0.028395056101800223}, {"byte_start": 3492, "byte_end": 3504, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 606, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%", "model_b": "4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.09333442896604538]], "model_b": [[63370, " computation", "normal", 0.03985937312245369]]}, "loss": {"model_a": 3.5456860542681228, "model_b": 4.83716110714724}, "topk": {"model_a": [63370, 2, 0.09333442896604538, [[32487, 0.243192, " with", false], [63370, 0.093334, " computation", false], [4811, 0.060867, " to", false], [51832, 0.049822, " general", false], [4706, 0.049729, " of", false], [56537, 0.037455, " learning", false], [32499, 0.026303, " work", false], [47202, 0.013376, " search", false], [60463, 0.013091, " searching", false], [4450, 0.012975, " by", false]]], "model_b": [63370, 8, 0.03985937312245369, [[32487, 0.124183, " with", false], [4706, 0.122927, " of", false], [4811, 0.106583, " to", false], [32499, 0.0656, " work", false], [32226, 0.062819, " than", false], [59346, 0.052495, " computing", false], [4450, 0.041925, " by", false], [63370, 0.039859, " computation", false], [51832, 0.022192, " general", false], [47, 0.019537, ".", false]]]}, "raw_delta": -0.07161458333333336, "tuned_delta": -0.018759639435133535}, {"byte_start": 3504, "byte_end": 3505, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "33.95%", "model_b": "36.35%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.15157459676265717]], "model_b": [[45, ",", "normal", 0.13408640027046204]]}, "loss": {"model_a": 33.95405320842189, "model_b": 36.34915239739771}, "topk": {"model_a": [45, 2, 0.15157459676265717, [[47, 0.502508, ".", false], [45, 0.151575, ",", false], [5346, 0.04709, "---", false], [275, 0.046031, " (", false], [4596, 0.028801, " in", false], [4811, 0.024974, " to", false], [22278, 0.023767, " per", false], [32226, 0.021044, " than", false], [21265, 0.019436, " and", false], [4712, 0.019351, " on", false]]], "model_b": [45, 2, 0.13408640027046204, [[47, 0.408728, ".", false], [45, 0.134086, ",", false], [32226, 0.076712, " than", false], [5346, 0.069406, "---", false], [4596, 0.052163, " in", false], [4811, 0.030961, " to", false], [275, 0.028969, " (", false], [32487, 0.018865, " with", false], [4712, 0.016911, " on", false], [22278, 0.016186, " per", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07995755610180018}, {"byte_start": 3505, "byte_end": 3511, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 607, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "12.59% 12.59% 12.59% 12.59% 12.59% 12.59%", "model_b": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.015353722497820854]], "model_b": [[37810, " based", "normal", 0.006241780240088701]]}, "loss": {"model_a": 12.586011424421944, "model_b": 15.309849717766994}, "topk": {"model_a": [37810, 12, 0.015353722497820854, [[21400, 0.221215, " but", false], [21265, 0.110455, " and", false], [59841, 0.060392, " including", false], [40085, 0.037876, " using", false], [4596, 0.026567, " in", false], [40186, 0.02271, " which", false], [32487, 0.020916, " with", false], [38888, 0.01793, " lever", false], [32139, 0.016625, " such", false], [61953, 0.015793, " especially", false]]], "model_b": [37810, 21, 0.006241780240088701, [[21400, 0.301673, " but", false], [21265, 0.152444, " and", false], [59841, 0.066172, " including", false], [40085, 0.032044, " using", false], [40186, 0.023483, " which", false], [32139, 0.022302, " such", false], [4596, 0.021315, " in", false], [32487, 0.014481, " with", false], [30788, 0.013376, " even", false], [4788, 0.013014, " so", false]]]}, "raw_delta": -0.15104166666666674, "tuned_delta": -0.09818672276846692}, {"byte_start": 3511, "byte_end": 3514, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 608, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.55% 0.55% 0.55%", "model_b": "1.06% 1.06% 1.06%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9132784008979797]], "model_b": [[4712, " on", "normal", 0.8374754190444946]]}, "loss": {"model_a": 0.5459417268988996, "model_b": 1.0625317480505467}, "topk": {"model_a": [4712, 1, 0.9132784008979797, [[4712, 0.913278, " on", false], [4596, 0.011472, " in", false], [32350, 0.010601, " upon", false], [52094, 0.009688, " largely", false], [46495, 0.00741, " mainly", false], [45, 0.006157, ",", false], [60247, 0.00568, " primarily", false], [46602, 0.004512, " mostly", false], [45202, 0.002892, " around", false], [31581, 0.002202, " only", false]]], "model_b": [4712, 1, 0.8374754190444946, [[4712, 0.837475, " on", false], [4596, 0.044892, " in", false], [52094, 0.019958, " largely", false], [32350, 0.019937, " upon", false], [60247, 0.008077, " primarily", false], [46602, 0.007643, " mostly", false], [46495, 0.006668, " mainly", false], [45, 0.004113, ",", false], [56131, 0.00403, " entirely", false], [31458, 0.002984, " more", false]]]}, "raw_delta": -0.028645833333333332, "tuned_delta": 0.02420911056486649}, {"byte_start": 3514, "byte_end": 3521, "display": {"text": " hidden", "kind": "normal"}, "is_word": true, "word_id": 609, "word_key": " hidden", "bytes_hex": "20 68 69 64 64 65 6e", "compression": {"model_a": "9.10% 9.10% 9.10% 9.10% 9.10% 9.10% 9.10%", "model_b": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"model_a": [[46196, " hidden", "normal", 0.02935795672237873]], "model_b": [[46196, " hidden", "normal", 0.002613342134281993]]}, "loss": {"model_a": 9.097351541319913, "model_b": 15.296431795139677}, "topk": {"model_a": [46196, 6, 0.02935795672237873, [[22590, 0.16603, " the", false], [56537, 0.068296, " learning", false], [332, 0.050552, " a", false], [38864, 0.048553, " large", false], [52195, 0.035344, " massive", false], [46196, 0.029358, " hidden", false], [63885, 0.023525, " statistical", false], [52224, 0.022249, " methods", false], [62633, 0.016554, " techniques", false], [51832, 0.01353, " general", false]]], "model_b": [46196, 55, 0.002613342134281993, [[22590, 0.1355, " the", false], [56537, 0.05133, " learning", false], [30597, 0.050769, " deep", false], [332, 0.048987, " a", false], [51832, 0.037935, " general", false], [52167, 0.035141, " machine", false], [52195, 0.017824, " massive", false], [62633, 0.017685, " techniques", false], [61559, 0.014066, " algorithms", false], [52112, 0.013604, " learned", false]]]}, "raw_delta": -0.34375, "tuned_delta": -0.29089505610180016}, {"byte_start": 3521, "byte_end": 3528, "display": {"text": " Markov", "kind": "normal"}, "is_word": true, "word_id": 610, "word_key": " markov", "bytes_hex": "20 4d 61 72 6b 6f 76", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "model_b": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%"}, "model_tokens": {"model_a": [[44557, " Markov", "normal", 0.9540068507194519]], "model_b": [[44557, " Markov", "normal", 0.9234638214111328]]}, "loss": {"model_a": 0.12201923389215041, "model_b": 0.20630056039497588}, "topk": {"model_a": [44557, 1, 0.9540068507194519, [[44557, 0.954007, " Markov", false], [46, 0.020269, "-", false], [31376, 0.011954, " mark", false], [60725, 0.002068, " variables", false], [47398, 0.001243, " states", false], [40069, 0.000929, " units", false], [39802, 0.000761, " state", false], [57518, 0.000566, " variable", false], [275, 0.000435, " (", false], [46587, 0.000362, " models", false]]], "model_b": [44557, 1, 0.9234638214111328, [[44557, 0.923464, " Markov", false], [46, 0.051448, "-", false], [31376, 0.003706, " mark", false], [30899, 0.002326, " form", false], [40069, 0.002143, " units", false], [57518, 0.001314, " variable", false], [38541, 0.000935, " forms", false], [60725, 0.00086, " variables", false], [47398, 0.000758, " states", false], [39802, 0.000732, " state", false]]]}, "raw_delta": -0.004673549107142856, "tuned_delta": 0.048181394791056965}, {"byte_start": 3528, "byte_end": 3535, "display": {"text": " models", "kind": "normal"}, "is_word": true, "word_id": 611, "word_key": " models", "bytes_hex": "20 6d 6f 64 65 6c 73", "compression": {"model_a": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "model_b": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"model_a": [[46587, " models", "normal", 0.9433397054672241]], "model_b": [[46587, " models", "normal", 0.9676041007041931]]}, "loss": {"model_a": 0.15095162955729943, "model_b": 0.08491029162598092}, "topk": {"model_a": [46587, 1, 0.9433397054672241, [[46587, 0.94334, " models", false], [39043, 0.014399, " model", false], [46, 0.00997, "-", false], [56658, 0.006732, " modeling", false], [21265, 0.004177, " and", false], [45447, 0.00323, " chains", false], [4715, 0.002825, " or", false], [44592, 0.002445, " Models", false], [60261, 0.002042, " processes", false], [60020, 0.00104, " modelling", false]]], "model_b": [46587, 1, 0.9676041007041931, [[46587, 0.967604, " models", false], [56658, 0.007357, " modeling", false], [39043, 0.004017, " model", false], [60261, 0.00364, " processes", false], [45447, 0.002253, " chains", false], [21265, 0.001887, " and", false], [56567, 0.001058, " machines", false], [4715, 0.000854, " or", false], [44592, 0.000806, " Models", false], [56705, 0.000755, " networks", false]]]}, "raw_delta": 0.003662109375, "tuned_delta": 0.05651705327319982}, {"byte_start": 3535, "byte_end": 3537, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "17.75% 17.75%", "model_b": "22.82% 22.82%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.1397610902786255]], "model_b": [[275, " (", "normal", 0.08120135217905045]]}, "loss": {"model_a": 17.751911635938416, "model_b": 22.823886389063677}, "topk": {"model_a": [275, 4, 0.1397610902786255, [[21265, 0.28346, " and", false], [47, 0.248766, ".", false], [45, 0.217286, ",", false], [275, 0.139761, " (", false], [4715, 0.038466, " or", false], [4706, 0.013079, " of", false], [32227, 0.011295, " that", false], [5346, 0.010262, "---", false], [21700, 0.006187, " for", false], [32487, 0.004908, " with", false]]], "model_b": [275, 4, 0.08120135217905045, [[45, 0.331823, ",", false], [21265, 0.276453, " and", false], [47, 0.181593, ".", false], [275, 0.081201, " (", false], [4715, 0.063514, " or", false], [5346, 0.016749, "---", false], [4706, 0.010074, " of", false], [21700, 0.007105, " for", false], [32227, 0.005222, " that", false], [4423, 0.002757, " as", false]]]}, "raw_delta": -0.28125, "tuned_delta": -0.22839505610180016}, {"byte_start": 3537, "byte_end": 3539, "display": {"text": "HM", "kind": "normal"}, "is_word": true, "word_id": 612, "word_key": "hm", "bytes_hex": "48 4d", "compression": {"model_a": "2.73% 2.73%", "model_b": "6.52% 6.52%"}, "model_tokens": {"model_a": [[1082, "HM", "normal", 0.7383397817611694]], "model_b": [[1082, "HM", "normal", 0.48420006036758423]]}, "loss": {"model_a": 2.7297086344944983, "model_b": 6.516078675890093}, "topk": {"model_a": [1082, 1, 0.7383397817611694, [[1082, 0.73834, "HM", false], [36003, 0.023064, "which", false], [98, 0.021445, "a", false], [7005, 0.019508, "and", false], [2101, 0.014814, "or", false], [8695, 0.012056, "see", false], [8801, 0.009963, "the", false], [1926, 0.008514, "hm", false], [27142, 0.007538, "that", false], [1746, 0.00457, "an", false]]], "model_b": [1082, 1, 0.48420006036758423, [[1082, 0.4842, "HM", false], [36003, 0.065857, "which", false], [2101, 0.031039, "or", false], [7005, 0.023722, "and", false], [7579, 0.021346, "for", false], [8801, 0.019847, "the", false], [1751, 0.014549, "as", false], [1950, 0.014258, "in", false], [8695, 0.013607, "see", false], [98, 0.013534, "a", false]]]}, "raw_delta": -0.2099609375, "tuned_delta": -0.15710599360180016}, {"byte_start": 3539, "byte_end": 3541, "display": {"text": "Ms", "kind": "normal"}, "is_word": true, "word_id": 613, "word_key": "ms", "bytes_hex": "4d 73", "compression": {"model_a": "0.77% 0.77%", "model_b": "2.10% 2.10%"}, "model_tokens": {"model_a": [[1261, "Ms", "normal", 0.9185234308242798]], "model_b": [[1261, "Ms", "normal", 0.7922157049179077]]}, "loss": {"model_a": 0.7660795200032947, "model_b": 2.0957117903538407}, "topk": {"model_a": [1261, 1, 0.9185234308242798, [[1261, 0.918523, "Ms", false], [78, 0.079429, "M", false], [1243, 0.001208, "MS", false], [1140, 0.00018, "Is", false], [116, 7.9e-05, "s", false], [1242, 2.9e-05, "MR", false], [77, 2.9e-05, "L", false], [1000, 2.8e-05, "Es", false], [84, 2.5e-05, "S", false], [1237, 2.5e-05, "MM", false]]], "model_b": [1261, 1, 0.7922157049179077, [[1261, 0.792216, "Ms", false], [78, 0.206315, "M", false], [116, 0.000437, "s", false], [42, 0.000137, ")", false], [497, 0.000111, "),", false], [1243, 0.000105, "MS", false], [499, 7.2e-05, ").", false], [1236, 5.9e-05, "ML", false], [46587, 5e-05, " models", false], [68, 4.5e-05, "C", false]]]}, "raw_delta": -0.07373046875, "tuned_delta": -0.02087552485180018}, {"byte_start": 3541, "byte_end": 3543, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"model_a": "8.35% 8.35%", "model_b": "11.13% 11.13%"}, "model_tokens": {"model_a": [[499, ").", "normal", 0.40225595235824585]], "model_b": [[499, ").", "normal", 0.2916545569896698]]}, "loss": {"model_a": 8.34762511451866, "model_b": 11.130166819358212}, "topk": {"model_a": [499, 1, 0.40225595235824585, [[499, 0.402256, ").", false], [42, 0.346846, ")", false], [497, 0.22338, "),", false], [5308, 0.009404, ")--", false], [45, 0.007429, ",", false], [502, 0.002648, ");", false], [60, 0.001694, ";", false], [21700, 0.001291, " for", false], [5346, 0.000594, "---", false], [501, 0.000583, "):", false]]], "model_b": [499, 2, 0.2916545569896698, [[42, 0.415553, ")", false], [499, 0.291655, ").", false], [497, 0.252517, "),", false], [45, 0.014629, ",", false], [5308, 0.010481, ")--", false], [502, 0.003148, ");", false], [60, 0.001874, ";", false], [5346, 0.001574, "---", false], [21700, 0.001374, " for", false], [4715, 0.001194, " or", false]]]}, "raw_delta": -0.154296875, "tuned_delta": -0.10144193110180018}, {"byte_start": 3543, "byte_end": 3549, "display": {"text": " Again", "kind": "normal"}, "is_word": true, "word_id": 614, "word_key": " again", "bytes_hex": "20 41 67 61 69 6e", "compression": {"model_a": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%", "model_b": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22%"}, "model_tokens": {"model_a": [[36251, " Again", "normal", 0.003622871357947588]], "model_b": [[36251, " Again", "normal", 0.006411013193428516]]}, "loss": {"model_a": 16.90658251041754, "model_b": 15.215924259375784}, "topk": {"model_a": [36251, 33, 0.003622871357947588, [[20996, 0.332668, " The", false], [37453, 0.084506, " These", false], [3866, 0.082378, " HM", false], [3913, 0.055594, " In", false], [3918, 0.027155, " It", false], [29894, 0.021691, " This", false], [3642, 0.017901, " At", false], [54829, 0.016464, " Although", false], [37451, 0.014719, " There", false], [300, 0.012615, " A", false]]], "model_b": [36251, 29, 0.006411013193428516, [[20996, 0.192547, " The", false], [3913, 0.072499, " In", false], [37453, 0.066245, " These", false], [29894, 0.033839, " This", false], [3866, 0.027877, " HM", false], [3918, 0.023781, " It", false], [37451, 0.022702, " There", false], [300, 0.019996, " A", false], [3641, 0.018049, " As", false], [3642, 0.017538, " At", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14660494389819984}, {"byte_start": 3549, "byte_end": 3550, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.52%", "model_b": "2.47%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8688128590583801]], "model_b": [[45, ",", "normal", 0.8733248114585876]]}, "loss": {"model_a": 2.518376353114279, "model_b": 2.4655432827692243}, "topk": {"model_a": [45, 1, 0.8688128590583801, [[45, 0.868813, ",", false], [22590, 0.050942, " the", false], [39934, 0.014278, " there", false], [4601, 0.009728, " it", false], [21265, 0.006724, " and", false], [4596, 0.004612, " in", false], [39936, 0.004391, " these", false], [3866, 0.004211, " HM", false], [32234, 0.003468, " this", false], [47202, 0.002786, " search", false]]], "model_b": [45, 1, 0.8733248114585876, [[45, 0.873325, ",", false], [22590, 0.028937, " the", false], [39934, 0.02277, " there", false], [4601, 0.008837, " it", false], [4596, 0.008205, " in", false], [32234, 0.007554, " this", false], [39936, 0.00574, " these", false], [21265, 0.002884, " and", false], [332, 0.002453, " a", false], [38720, 0.002198, " human", false]]]}, "raw_delta": 0.0029296875, "tuned_delta": 0.05578463139819982}, {"byte_start": 3550, "byte_end": 3554, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 615, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "3.35% 3.35% 3.35% 3.35%", "model_b": "6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.4818570017814636]], "model_b": [[22590, " the", "normal", 0.23466208577156067]]}, "loss": {"model_a": 3.3460944551868046, "model_b": 6.551300722786796}, "topk": {"model_a": [22590, 1, 0.4818570017814636, [[22590, 0.481857, " the", false], [39934, 0.046257, " there", false], [3866, 0.044986, " HM", false], [38720, 0.038439, " human", false], [4601, 0.037738, " it", false], [39936, 0.036352, " these", false], [32234, 0.019397, " this", false], [4596, 0.018527, " in", false], [63843, 0.017521, " researchers", false], [332, 0.014608, " a", false]]], "model_b": [22590, 1, 0.23466208577156067, [[22590, 0.234662, " the", false], [39936, 0.078542, " these", false], [4601, 0.063296, " it", false], [39934, 0.058144, " there", false], [32234, 0.050373, " this", false], [4596, 0.038929, " in", false], [38720, 0.038171, " human", false], [32465, 0.02213, " when", false], [4423, 0.020266, " as", false], [332, 0.018861, " a", false]]]}, "raw_delta": -0.177734375, "tuned_delta": -0.12487943110180018}, {"byte_start": 3554, "byte_end": 3566, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 616, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"model_a": "5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00%", "model_b": "5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73%"}, "model_tokens": {"model_a": [[63885, " statistical", "normal", 0.0360807366669178]], "model_b": [[63885, " statistical", "normal", 0.022040219977498055]]}, "loss": {"model_a": 5.001530659331855, "model_b": 5.729452961863722}, "topk": {"model_a": [63885, 5, 0.0360807366669178, [[3866, 0.176467, " HM", false], [38720, 0.161868, " human", false], [38328, 0.043819, " early", false], [52013, 0.038266, " initial", false], [63885, 0.036081, " statistical", false], [52224, 0.034973, " methods", false], [47798, 0.030421, " winner", false], [47202, 0.024926, " search", false], [63843, 0.022676, " researchers", false], [39116, 0.021246, " newer", false]]], "model_b": [63885, 4, 0.022040219977498055, [[38720, 0.183121, " human", false], [38328, 0.053107, " early", false], [52013, 0.028994, " initial", false], [63885, 0.02204, " statistical", false], [47798, 0.019003, " winner", false], [63361, 0.015865, " competition", false], [22638, 0.015508, " two", false], [53052, 0.012315, " success", false], [52738, 0.011711, " results", false], [38499, 0.011698, " first", false]]]}, "raw_delta": -0.040364583333333315, "tuned_delta": 0.012490360564866507}, {"byte_start": 3566, "byte_end": 3574, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 617, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69%", "model_b": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.7370352745056152]], "model_b": [[52224, " methods", "normal", 0.5149917006492615]]}, "loss": {"model_a": 0.6868299144857125, "model_b": 1.4881314813857105}, "topk": {"model_a": [52224, 1, 0.7370352745056152, [[52224, 0.737035, " methods", false], [55532, 0.064678, " approach", false], [61590, 0.050447, " approaches", false], [46561, 0.034801, " method", false], [3866, 0.014024, " HM", false], [45, 0.013648, ",", false], [46, 0.013308, "-", false], [46587, 0.013301, " models", false], [62633, 0.009662, " techniques", false], [39043, 0.004374, " model", false]]], "model_b": [52224, 1, 0.5149917006492615, [[52224, 0.514992, " methods", false], [55532, 0.131289, " approach", false], [46561, 0.069665, " method", false], [3866, 0.063606, " HM", false], [61590, 0.046253, " approaches", false], [46587, 0.029851, " models", false], [46, 0.013172, "-", false], [62633, 0.012229, " techniques", false], [39043, 0.010296, " model", false], [61559, 0.006905, " algorithms", false]]]}, "raw_delta": -0.04443359375, "tuned_delta": 0.008421350148199822}, {"byte_start": 3574, "byte_end": 3578, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 618, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"model_a": "3.61% 3.61% 3.61% 3.61%", "model_b": "6.13% 6.13% 6.13% 6.13%"}, "model_tokens": {"model_a": [[22777, " won", "normal", 0.4478346109390259]], "model_b": [[22777, " won", "normal", 0.25623154640197754]]}, "loss": {"model_a": 3.6102598069120786, "model_b": 6.128636160026358}, "topk": {"model_a": [22777, 1, 0.4478346109390259, [[22777, 0.447835, " won", false], [32462, 0.152142, " were", false], [46936, 0.05452, " proved", false], [45, 0.035339, ",", false], [61959, 0.03008, " eventually", false], [21795, 0.018855, " had", false], [60244, 0.018358, " prevailed", false], [21532, 0.012738, " did", false], [30256, 0.01257, " beat", false], [47211, 0.012053, " seemed", false]]], "model_b": [22777, 2, 0.25623154640197754, [[32462, 0.282613, " were", false], [22777, 0.256232, " won", false], [46936, 0.058806, " proved", false], [21795, 0.031382, " had", false], [21532, 0.026641, " did", false], [32272, 0.020761, " took", false], [32227, 0.019508, " that", false], [45, 0.017522, ",", false], [47518, 0.015328, " tended", false], [45283, 0.010065, " became", false]]]}, "raw_delta": -0.1396484375, "tuned_delta": -0.08679349360180018}, {"byte_start": 3578, "byte_end": 3582, "display": {"text": " out", "kind": "normal"}, "is_word": true, "word_id": 619, "word_key": " out", "bytes_hex": "20 6f 75 74", "compression": {"model_a": "10.28% 10.28% 10.28% 10.28%", "model_b": "9.37% 9.37% 9.37% 9.37%"}, "model_tokens": {"model_a": [[22249, " out", "normal", 0.10188664495944977]], "model_b": [[22249, " out", "normal", 0.12429650127887726]]}, "loss": {"model_a": 10.284837693837336, "model_b": 9.369064474523052}, "topk": {"model_a": [22249, 4, 0.10188664495944977, [[45, 0.25158, ",", false], [47, 0.207819, ".", false], [22590, 0.130728, " the", false], [22249, 0.101887, " out", false], [4450, 0.05439, " by", false], [4596, 0.045629, " in", false], [5346, 0.026396, "---", false], [21265, 0.024958, " and", false], [32234, 0.011585, " this", false], [21357, 0.008733, " big", false]]], "model_b": [22249, 4, 0.12429650127887726, [[47, 0.225055, ".", false], [45, 0.179494, ",", false], [22590, 0.170505, " the", false], [22249, 0.124297, " out", false], [4596, 0.063355, " in", false], [21265, 0.037327, " and", false], [4450, 0.022129, " by", false], [51018, 0.020988, " because", false], [32465, 0.01155, " when", false], [4712, 0.009282, " on", false]]]}, "raw_delta": 0.05078125, "tuned_delta": 0.10363619389819982}, {"byte_start": 3582, "byte_end": 3587, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 620, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "12.79% 12.79% 12.79% 12.79% 12.79%", "model_b": "14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.02874206006526947]], "model_b": [[31601, " over", "normal", 0.0163179412484169]]}, "loss": {"model_a": 12.792647432882603, "model_b": 14.765082059097983}, "topk": {"model_a": [31601, 6, 0.02874206006526947, [[45, 0.314263, ",", false], [47, 0.247405, ".", false], [4596, 0.139049, " in", false], [21265, 0.054942, " and", false], [4450, 0.029217, " by", false], [31601, 0.028742, " over", false], [61959, 0.025724, " eventually", false], [5346, 0.018976, "---", false], [51018, 0.009563, " because", false], [32465, 0.008537, " when", false]]], "model_b": [31601, 8, 0.0163179412484169, [[47, 0.353942, ".", false], [45, 0.205151, ",", false], [4596, 0.126606, " in", false], [21265, 0.066316, " and", false], [51018, 0.041629, " because", false], [4712, 0.02931, " on", false], [32465, 0.017102, " when", false], [31601, 0.016318, " over", false], [21700, 0.010462, " for", false], [4423, 0.010318, " as", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 3587, "byte_end": 3591, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 621, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.84% 1.84% 1.84% 1.84%", "model_b": "0.34% 0.34% 0.34% 0.34%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.6652633547782898]], "model_b": [[22590, " the", "normal", 0.9279612302780151]]}, "loss": {"model_a": 1.8403519503527423, "model_b": 0.3390122013807683}, "topk": {"model_a": [22590, 1, 0.6652633547782898, [[22590, 0.665263, " the", false], [32251, 0.118401, " time", false], [332, 0.032858, " a", false], [52224, 0.030236, " methods", false], [38720, 0.02103, " human", false], [39944, 0.0206, " those", false], [31370, 0.01212, " many", false], [31323, 0.010386, " long", false], [3866, 0.003985, " HM", false], [31458, 0.003871, " more", false]]], "model_b": [22590, 1, 0.9279612302780151, [[22590, 0.927961, " the", false], [39931, 0.009194, " their", false], [39944, 0.008598, " those", false], [3866, 0.005468, " HM", false], [21256, 0.005044, " all", false], [332, 0.003224, " a", false], [38720, 0.003055, " human", false], [39936, 0.00252, " these", false], [31370, 0.002467, " many", false], [52224, 0.002463, " methods", false]]]}, "raw_delta": 0.083251953125, "tuned_delta": 0.13610689702319984}, {"byte_start": 3591, "byte_end": 3597, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 622, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "2.57% 2.57% 2.57% 2.57% 2.57% 2.57%", "model_b": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.42568930983543396]], "model_b": [[38720, " human", "normal", 0.30793383717536926]]}, "loss": {"model_a": 2.571209423459334, "model_b": 3.5456860542681228}, "topk": {"model_a": [38720, 1, 0.42568930983543396, [[38720, 0.425689, " human", false], [52224, 0.114839, " methods", false], [31458, 0.066146, " more", false], [52964, 0.0334, " special", false], [63875, 0.027954, " specialized", false], [59943, 0.021395, " knowledge", false], [31580, 0.018533, " ones", false], [47202, 0.01766, " search", false], [3866, 0.015203, " HM", false], [39174, 0.012063, " older", false]]], "model_b": [38720, 1, 0.30793383717536926, [[38720, 0.307934, " human", false], [3866, 0.305936, " HM", false], [31458, 0.063103, " more", false], [63885, 0.050406, " statistical", false], [52964, 0.043021, " special", false], [47202, 0.015751, " search", false], [46196, 0.011734, " hidden", false], [59792, 0.008528, " heuristic", false], [52224, 0.007885, " methods", false], [51551, 0.007486, " earlier", false]]]}, "raw_delta": -0.05403645833333335, "tuned_delta": -0.001181514435133528}, {"byte_start": 3597, "byte_end": 3598, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "4.72%", "model_b": "3.21%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.7706761360168457]], "model_b": [[46, "-", "normal", 0.8371728658676147]]}, "loss": {"model_a": 4.719754284158229, "model_b": 3.2052062675999915}, "topk": {"model_a": [46, 1, 0.7706761360168457, [[46, 0.770676, "-", false], [59943, 0.14104, " knowledge", false], [52224, 0.050024, " methods", false], [61590, 0.005555, " approaches", false], [34864, 0.005049, "istic", false], [7919, 0.002393, "ist", false], [46561, 0.001773, " method", false], [65034, 0.00171, " understanding", false], [56529, 0.001659, " language", false], [46587, 0.001259, " models", false]]], "model_b": [46, 1, 0.8371728658676147, [[46, 0.837173, "-", false], [59943, 0.104336, " knowledge", false], [52224, 0.0137, " methods", false], [38786, 0.009265, " input", false], [61590, 0.003682, " approaches", false], [55532, 0.001612, " approach", false], [46561, 0.001261, " method", false], [31580, 0.001183, " ones", false], [102, 0.00098, "e", false], [46297, 0.000804, " inputs", false]]]}, "raw_delta": 0.083984375, "tuned_delta": 0.13683931889819984}, {"byte_start": 3598, "byte_end": 3607, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 623, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.9511051774024963]], "model_b": [[58313, "knowledge", "normal", 0.8924340605735779]]}, "loss": {"model_a": 0.1002849946364466, "model_b": 0.22894330482857084}, "topk": {"model_a": [58313, 1, 0.9511051774024963, [[58313, 0.951105, "knowledge", false], [34011, 0.009867, "based", false], [42430, 0.004491, "unders", false], [54122, 0.003406, "language", false], [54208, 0.002513, "oriented", false], [26085, 0.002488, "know", false], [48948, 0.001528, "centric", false], [41394, 0.001307, "expert", false], [35074, 0.001148, "model", false], [49161, 0.001132, "focused", false]]], "model_b": [58313, 1, 0.8924340605735779, [[58313, 0.892434, "knowledge", false], [34011, 0.032684, "based", false], [34795, 0.018537, "input", false], [26085, 0.005028, "know", false], [33992, 0.003237, "aware", false], [48948, 0.003027, "centric", false], [41273, 0.001812, "driven", false], [41269, 0.001698, "domain", false], [54359, 0.001547, "specific", false], [53835, 0.001432, "centered", false]]]}, "raw_delta": -0.007134331597222222, "tuned_delta": 0.0457206123009776}, {"byte_start": 3607, "byte_end": 3608, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "30.71%", "model_b": "25.78%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.18402493000030518]], "model_b": [[46, "-", "normal", 0.23880502581596375]]}, "loss": {"model_a": 30.713624893925193, "model_b": 25.782538328386746}, "topk": {"model_a": [46, 2, 0.18402493000030518, [[52224, 0.674843, " methods", false], [46, 0.184025, "-", false], [61590, 0.07031, " approaches", false], [37810, 0.019254, " based", false], [55532, 0.009998, " approach", false], [31580, 0.009678, " ones", false], [46561, 0.003909, " method", false], [45, 0.003035, ",", false], [62633, 0.001727, " techniques", false], [46587, 0.001712, " models", false]]], "model_b": [46, 2, 0.23880502581596375, [[52224, 0.445691, " methods", false], [46, 0.238805, "-", false], [61590, 0.124797, " approaches", false], [37810, 0.085946, " based", false], [55532, 0.017921, " approach", false], [31580, 0.009642, " ones", false], [34011, 0.005145, "based", false], [62633, 0.004359, " techniques", false], [46561, 0.004173, " method", false], [45796, 0.003158, " driven", false]]]}, "raw_delta": 0.2734375, "tuned_delta": 0.32629244389819984}, {"byte_start": 3608, "byte_end": 3613, "display": {"text": "based", "kind": "normal"}, "is_word": true, "word_id": 624, "word_key": "based", "bytes_hex": "62 61 73 65 64", "compression": {"model_a": "0.43% 0.43% 0.43% 0.43% 0.43%", "model_b": "0.32% 0.32% 0.32% 0.32% 0.32%"}, "model_tokens": {"model_a": [[34011, "based", "normal", 0.8871493935585022]], "model_b": [[34011, "based", "normal", 0.9153889417648315]]}, "loss": {"model_a": 0.43323117682944945, "model_b": 0.31875952441516403}, "topk": {"model_a": [34011, 1, 0.8871493935585022, [[34011, 0.887149, "based", false], [54208, 0.02166, "oriented", false], [58213, 0.011844, "dependent", false], [41273, 0.010235, "driven", false], [49161, 0.007614, "focused", false], [49411, 0.004742, "methods", false], [26476, 0.003384, "only", false], [25885, 0.002136, "inte", false], [48948, 0.002124, "centric", false], [8080, 0.002058, "lev", false]]], "model_b": [34011, 1, 0.9153889417648315, [[34011, 0.915389, "based", false], [54208, 0.02013, "oriented", false], [41273, 0.010937, "driven", false], [34547, 0.005086, "heavy", false], [49161, 0.003757, "focused", false], [48948, 0.003415, "centric", false], [53835, 0.002418, "centered", false], [26996, 0.002071, "seek", false], [54087, 0.001954, "inspired", false], [34453, 0.001816, "first", false]]]}, "raw_delta": 0.00634765625, "tuned_delta": 0.05920260014819982}, {"byte_start": 3613, "byte_end": 3621, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 625, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63%", "model_b": "0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.7575957179069519]], "model_b": [[52224, " methods", "normal", 0.6950480937957764]]}, "loss": {"model_a": 0.6251913324164818, "model_b": 0.8145098344862616}, "topk": {"model_a": [52224, 1, 0.7575957179069519, [[52224, 0.757596, " methods", false], [61590, 0.093073, " approaches", false], [31580, 0.088058, " ones", false], [55532, 0.010249, " approach", false], [45, 0.0048, ",", false], [51566, 0.004354, " efforts", false], [63363, 0.003156, " competitors", false], [46561, 0.003021, " method", false], [47, 0.002962, ".", false], [62633, 0.002343, " techniques", false]]], "model_b": [52224, 1, 0.6950480937957764, [[52224, 0.695048, " methods", false], [31580, 0.109996, " ones", false], [61590, 0.107327, " approaches", false], [55532, 0.009361, " approach", false], [62633, 0.006984, " techniques", false], [47202, 0.006127, " search", false], [46561, 0.005333, " method", false], [63363, 0.004424, " competitors", false], [51566, 0.002259, " efforts", false], [45, 0.002198, ",", false]]]}, "raw_delta": -0.010498046875, "tuned_delta": 0.04235689702319982}, {"byte_start": 3621, "byte_end": 3622, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "14.23%", "model_b": "11.76%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.45019814372062683]], "model_b": [[47, ".", "normal", 0.5168300271034241]]}, "loss": {"model_a": 14.229706946268095, "model_b": 11.76416366349887}, "topk": {"model_a": [47, 1, 0.45019814372062683, [[47, 0.450198, ".", false], [45, 0.313204, ",", false], [4596, 0.061323, " in", false], [21265, 0.040128, " and", false], [4450, 0.025523, " by", false], [5346, 0.013629, "---", false], [275, 0.011248, " (", false], [51018, 0.008309, " because", false], [32227, 0.007864, " that", false], [37634, 0.004738, " after", false]]], "model_b": [47, 1, 0.5168300271034241, [[47, 0.51683, ".", false], [45, 0.193888, ",", false], [4596, 0.096865, " in", false], [51018, 0.02393, " because", false], [32227, 0.023231, " that", false], [21265, 0.017448, " and", false], [4712, 0.011376, " on", false], [21700, 0.010269, " for", false], [4424, 0.009992, " at", false], [275, 0.008742, " (", false]]]}, "raw_delta": 0.13671875, "tuned_delta": 0.18957369389819984}, {"byte_start": 3622, "byte_end": 3627, "display": {"text": " This", "kind": "normal"}, "is_word": true, "word_id": 626, "word_key": " this", "bytes_hex": "20 54 68 69 73", "compression": {"model_a": "9.97% 9.97% 9.97% 9.97% 9.97%", "model_b": "9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"model_a": [[29894, " This", "normal", 0.06181350722908974]], "model_b": [[29894, " This", "normal", 0.07581163197755814]]}, "loss": {"model_a": 9.974883681146347, "model_b": 9.24226510569492}, "topk": {"model_a": [29894, 4, 0.06181350722908974, [[261, 0.19928, "\n\n", false], [20996, 0.134942, " The", false], [3913, 0.068706, " In", false], [29894, 0.061814, " This", false], [19555, 0.031297, " But", false], [3918, 0.030459, " It", false], [19417, 0.023346, " And", false], [267, 0.02152, "  ", false], [300, 0.01969, " A", false], [37451, 0.018511, " There", false]]], "model_b": [29894, 3, 0.07581163197755814, [[261, 0.202353, "\n\n", false], [20996, 0.100709, " The", false], [29894, 0.075812, " This", false], [3913, 0.058624, " In", false], [19555, 0.027314, " But", false], [3918, 0.026075, " It", false], [267, 0.02415, "  ", false], [37451, 0.022327, " There", false], [19417, 0.021247, " And", false], [36251, 0.021238, " Again", false]]]}, "raw_delta": 0.04062500000000002, "tuned_delta": 0.09347994389819984}, {"byte_start": 3627, "byte_end": 3631, "display": {"text": " led", "kind": "normal"}, "is_word": true, "word_id": 627, "word_key": " led", "bytes_hex": "20 6c 65 64", "compression": {"model_a": "22.26% 22.26% 22.26% 22.26%", "model_b": "21.84% 21.84% 21.84% 21.84%"}, "model_tokens": {"model_a": [[21994, " led", "normal", 0.007286480627954006]], "model_b": [[21994, " led", "normal", 0.00803307443857193]]}, "loss": {"model_a": 22.260333638716425, "model_b": 21.837669075955986}, "topk": {"model_a": [21994, 10, 0.007286480627954006, [[22748, 0.333104, " was", false], [32251, 0.12415, " time", false], [4600, 0.087577, " is", false], [63361, 0.066463, " competition", false], [52427, 0.046169, " pattern", false], [56348, 0.012124, " happened", false], [38328, 0.010554, " early", false], [22074, 0.008978, " may", false], [53283, 0.008389, " victory", false], [21994, 0.007286, " led", false]]], "model_b": [21994, 11, 0.00803307443857193, [[22748, 0.291007, " was", false], [4600, 0.137069, " is", false], [52427, 0.072515, " pattern", false], [63361, 0.029567, " competition", false], [32251, 0.014963, " time", false], [45315, 0.011001, " bitter", false], [39831, 0.010877, " story", false], [59392, 0.009553, " continued", false], [53052, 0.008282, " success", false], [40009, 0.00806, " trend", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07629244389819982}, {"byte_start": 3631, "byte_end": 3634, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 628, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "2.10% 2.10% 2.10%", "model_b": "1.86% 1.86% 1.86%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7004135847091675]], "model_b": [[4811, " to", "normal", 0.7335218191146851]]}, "loss": {"model_a": 2.101582131503291, "model_b": 1.8550278032263687}, "topk": {"model_a": [4811, 1, 0.7004135847091675, [[4811, 0.700414, " to", false], [32074, 0.053727, " some", false], [31370, 0.04605, " many", false], [22590, 0.043138, " the", false], [63843, 0.021715, " researchers", false], [332, 0.018023, " a", false], [46787, 0.011171, " people", false], [22226, 0.010695, " one", false], [19678, 0.009744, " DAR", false], [45, 0.007678, ",", false]]], "model_b": [4811, 1, 0.7335218191146851, [[4811, 0.733522, " to", false], [63843, 0.04741, " researchers", false], [31370, 0.036438, " many", false], [32074, 0.025773, " some", false], [22590, 0.025216, " the", false], [332, 0.013138, " a", false], [45, 0.012573, ",", false], [46787, 0.00997, " people", false], [22226, 0.006151, " one", false], [4596, 0.005239, " in", false]]]}, "raw_delta": 0.013671875, "tuned_delta": 0.06652681889819982}, {"byte_start": 3634, "byte_end": 3636, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 629, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "10.21% 10.21%", "model_b": "12.54% 12.54%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.32252037525177]], "model_b": [[332, " a", "normal", 0.24982376396656036]]}, "loss": {"model_a": 10.214393600043929, "model_b": 12.539048695226342}, "topk": {"model_a": [332, 1, 0.32252037525177, [[332, 0.32252, " a", false], [22590, 0.251223, " the", false], [4419, 0.047326, " an", false], [31466, 0.028287, " much", false], [32074, 0.025382, " some", false], [31370, 0.018584, " many", false], [51816, 0.014073, " further", false], [50919, 0.0129, " another", false], [31458, 0.009086, " more", false], [65126, 0.007995, " disappointment", false]]], "model_b": [332, 2, 0.24982376396656036, [[22590, 0.28816, " the", false], [332, 0.249824, " a", false], [4419, 0.049783, " an", false], [32074, 0.028157, " some", false], [31370, 0.023346, " many", false], [31466, 0.018703, " much", false], [57103, 0.012921, " research", false], [51816, 0.012234, " further", false], [22638, 0.008203, " two", false], [50919, 0.006816, " another", false]]]}, "raw_delta": -0.12890625, "tuned_delta": -0.07605130610180018}, {"byte_start": 3636, "byte_end": 3642, "display": {"text": " major", "kind": "normal"}, "is_word": true, "word_id": 630, "word_key": " major", "bytes_hex": "20 6d 61 6a 6f 72", "compression": {"model_a": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%", "model_b": "13.90% 13.90% 13.90% 13.90% 13.90% 13.90%"}, "model_tokens": {"model_a": [[38961, " major", "normal", 0.01673424057662487]], "model_b": [[38961, " major", "normal", 0.009727684780955315]]}, "loss": {"model_a": 12.30423504924832, "model_b": 13.900967841898865}, "topk": {"model_a": [38961, 12, 0.01673424057662487, [[31323, 0.058031, " long", false], [46790, 0.057754, " period", false], [45315, 0.031353, " bitter", false], [39664, 0.022748, " shift", false], [45674, 0.020854, " decade", false], [55591, 0.020549, " backlash", false], [38629, 0.020227, " great", false], [45450, 0.02011, " change", false], [51816, 0.019981, " further", false], [22168, 0.018154, " new", false]]], "model_b": [38961, 15, 0.009727684780955315, [[46790, 0.035802, " period", false], [31323, 0.030831, " long", false], [52427, 0.024596, " pattern", false], [45315, 0.024483, " bitter", false], [51832, 0.019027, " general", false], [22031, 0.01713, " lot", false], [47234, 0.015323, " series", false], [45669, 0.015294, " debate", false], [55591, 0.014976, " backlash", false], [22168, 0.014845, " new", false]]]}, "raw_delta": -0.08854166666666674, "tuned_delta": -0.03568672276846692}, {"byte_start": 3642, "byte_end": 3649, "display": {"text": " change", "kind": "normal"}, "is_word": true, "word_id": 631, "word_key": " change", "bytes_hex": "20 63 68 61 6e 67 65", "compression": {"model_a": "4.95% 4.95% 4.95% 4.95% 4.95% 4.95% 4.95%", "model_b": "7.12% 7.12% 7.12% 7.12% 7.12% 7.12% 7.12%"}, "model_tokens": {"model_a": [[45450, " change", "normal", 0.1471361517906189]], "model_b": [[45450, " change", "normal", 0.06280500441789627]]}, "loss": {"model_a": 4.951213449479423, "model_b": 7.124916915104532}, "topk": {"model_a": [45450, 2, 0.1471361517906189, [[39664, 0.186555, " shift", false], [45450, 0.147136, " change", false], [4757, 0.043828, " re", false], [56810, 0.03804, " paradigm", false], [57103, 0.036608, " research", false], [45829, 0.033344, " effort", false], [22378, 0.029203, " ret", false], [57138, 0.018445, " revision", false], [31872, 0.0159, " retr", false], [45, 0.010901, ",", false]]], "model_b": [45450, 2, 0.06280500441789627, [[39664, 0.103545, " shift", false], [45450, 0.062805, " change", false], [45669, 0.045428, " debate", false], [4757, 0.032174, " re", false], [45829, 0.027957, " effort", false], [57103, 0.02589, " research", false], [65126, 0.022654, " disappointment", false], [56810, 0.022432, " paradigm", false], [63415, 0.018882, " controversy", false], [22459, 0.018761, " set", false]]]}, "raw_delta": -0.12053571428571422, "tuned_delta": -0.0676807703875144}, {"byte_start": 3649, "byte_end": 3652, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 632, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "0.62% 0.62% 0.62%", "model_b": "0.78% 0.78% 0.78%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.9015942811965942]], "model_b": [[4596, " in", "normal", 0.8774064183235168]]}, "loss": {"model_a": 0.6163858206923061, "model_b": 0.7807553728769211}, "topk": {"model_a": [4596, 1, 0.9015942811965942, [[4596, 0.901594, " in", false], [4706, 0.04797, " of", false], [45, 0.01582, ",", false], [59, 0.006379, ":", false], [47, 0.004074, ".", false], [4811, 0.00191, " to", false], [30917, 0.001698, " from", false], [4424, 0.001578, " at", false], [32227, 0.001508, " that", false], [37694, 0.001328, " among", false]]], "model_b": [4596, 1, 0.8774064183235168, [[4596, 0.877406, " in", false], [4706, 0.063857, " of", false], [45, 0.015019, ",", false], [59, 0.006338, ":", false], [31601, 0.004102, " over", false], [47, 0.004073, ".", false], [32227, 0.002914, " that", false], [30917, 0.002316, " from", false], [21700, 0.001893, " for", false], [4811, 0.001781, " to", false]]]}, "raw_delta": -0.009114583333333336, "tuned_delta": 0.043740360564866486}, {"byte_start": 3652, "byte_end": 3656, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 633, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"model_a": "35.36% 35.36% 35.36% 35.36%", "model_b": "35.36% 35.36% 35.36% 35.36%"}, "model_tokens": {"model_a": [[21256, " all", "normal", 0.00039231861592270434]], "model_b": [[21256, " all", "normal", 0.0003896649868693203]]}, "loss": {"model_a": 35.362935084290015, "model_b": 35.362935084290015}, "topk": {"model_a": [21256, 88, 0.00039231861592270434, [[22590, 0.446433, " the", false], [57103, 0.072957, " research", false], [47350, 0.072481, " speech", false], [3609, 0.06861, " AI", false], [59526, 0.061201, " direction", false], [56103, 0.03624, " emphasis", false], [38530, 0.023152, " focus", false], [57419, 0.014304, " thinking", false], [21835, 0.012684, " how", false], [55574, 0.009881, " attitude", false]]], "model_b": [21256, 89, 0.0003896649868693203, [[22590, 0.552629, " the", false], [57103, 0.088625, " research", false], [21835, 0.057083, " how", false], [3609, 0.038585, " AI", false], [47350, 0.02966, " speech", false], [32464, 0.01777, " what", false], [55532, 0.014121, " approach", false], [30322, 0.010081, " both", false], [57419, 0.009933, " thinking", false], [59526, 0.009134, " direction", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 3656, "byte_end": 3659, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 634, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "12.49% 12.49% 12.49%", "model_b": "11.74% 11.74% 11.74%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.12452349066734314]], "model_b": [[4706, " of", "normal", 0.14011384546756744]]}, "loss": {"model_a": 12.492085966030738, "model_b": 11.740682298901067}, "topk": {"model_a": [4706, 2, 0.12452349066734314, [[47350, 0.427561, " speech", false], [4706, 0.124523, " of", false], [22590, 0.071701, " the", false], [3609, 0.070759, " AI", false], [62597, 0.053462, " subsequent", false], [57103, 0.042275, " research", false], [37738, 0.027115, " areas", false], [50964, 0.017114, " aspects", false], [46064, 0.015662, " future", false], [55809, 0.008446, " computer", false]]], "model_b": [4706, 2, 0.14011384546756744, [[47350, 0.276447, " speech", false], [4706, 0.140114, " of", false], [22590, 0.136753, " the", false], [3609, 0.050255, " AI", false], [57103, 0.035138, " research", false], [37738, 0.028793, " areas", false], [62597, 0.028432, " subsequent", false], [61590, 0.026778, " approaches", false], [52224, 0.019192, " methods", false], [50964, 0.010702, " aspects", false]]]}, "raw_delta": 0.04166666666666674, "tuned_delta": 0.09452161056486656}, {"byte_start": 3659, "byte_end": 3667, "display": {"text": " natural", "kind": "normal"}, "is_word": true, "word_id": 635, "word_key": " natural", "bytes_hex": "20 6e 61 74 75 72 61 6c", "compression": {"model_a": "14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37%", "model_b": "15.99% 15.99% 15.99% 15.99% 15.99% 15.99% 15.99% 15.99%"}, "model_tokens": {"model_a": [[52299, " natural", "normal", 0.0017308343667536974]], "model_b": [[52299, " natural", "normal", 0.0008189572254195809]]}, "loss": {"model_a": 14.370595133854907, "model_b": 15.990809291103256}, "topk": {"model_a": [52299, 14, 0.0017308343667536974, [[47350, 0.751391, " speech", false], [3609, 0.077539, " AI", false], [22590, 0.062142, " the", false], [55809, 0.02974, " computer", false], [57103, 0.011595, " research", false], [19678, 0.008637, " DAR", false], [64862, 0.005269, " computational", false], [52167, 0.002919, " machine", false], [62182, 0.002388, " linguistic", false], [47368, 0.001867, " spoken", false]]], "model_b": [52299, 23, 0.0008189572254195809, [[47350, 0.527685, " speech", false], [22590, 0.334968, " the", false], [3609, 0.032689, " AI", false], [55809, 0.016052, " computer", false], [39936, 0.01497, " these", false], [32234, 0.007785, " this", false], [52167, 0.007196, " machine", false], [39944, 0.006125, " those", false], [38720, 0.00566, " human", false], [57103, 0.004682, " research", false]]]}, "raw_delta": -0.08984375, "tuned_delta": -0.03698880610180018}, {"byte_start": 3667, "byte_end": 3676, "display": {"text": " language", "kind": "normal"}, "is_word": true, "word_id": 636, "word_key": " language", "bytes_hex": "20 6c 61 6e 67 75 61 67 65", "compression": {"model_a": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%", "model_b": "2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33%"}, "model_tokens": {"model_a": [[56529, " language", "normal", 0.8103179931640625]], "model_b": [[56529, " language", "normal", 0.3133000135421753]]}, "loss": {"model_a": 0.42266456276043846, "model_b": 2.3324822167150123}, "topk": {"model_a": [56529, 1, 0.8103179931640625, [[56529, 0.810318, " language", false], [46, 0.182737, "-", false], [59946, 0.002568, " languages", false], [47350, 0.002081, " speech", false], [21265, 0.000325, " and", false], [34864, 0.000208, "istic", false], [275, 0.000156, " (", false], [52814, 0.000133, " science", false], [48, 0.000106, "/", false], [57167, 9e-05, " sciences", false]]], "model_b": [56529, 2, 0.3133000135421753, [[46, 0.654903, "-", false], [56529, 0.3133, " language", false], [47350, 0.008974, " speech", false], [21265, 0.005914, " and", false], [59946, 0.002621, " languages", false], [4715, 0.000878, " or", false], [38720, 0.00083, " human", false], [65117, 0.000721, " communications", false], [11, 0.000713, "\n", false], [52814, 0.000681, " science", false]]]}, "raw_delta": -0.10590277777777779, "tuned_delta": -0.05304783387957797}, {"byte_start": 3676, "byte_end": 3687, "display": {"text": " processing", "kind": "normal"}, "is_word": true, "word_id": 637, "word_key": " processing", "bytes_hex": "20 70 72 6f 63 65 73 73 69 6e 67", "compression": {"model_a": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "model_b": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"model_a": [[62378, " processing", "normal", 0.9209213256835938]], "model_b": [[62378, " processing", "normal", 0.8427163362503052]]}, "loss": {"model_a": 0.13448417906013957, "model_b": 0.2801753730419573}, "topk": {"model_a": [62378, 1, 0.9209213256835938, [[62378, 0.920921, " processing", false], [57103, 0.040272, " research", false], [65034, 0.018016, " understanding", false], [45, 0.002965, ",", false], [21265, 0.00207, " and", false], [46, 0.001574, "-", false], [63821, 0.001511, " recognition", false], [275, 0.001287, " (", false], [47, 0.001233, ".", false], [62634, 0.000768, " technology", false]]], "model_b": [62378, 1, 0.8427163362503052, [[62378, 0.842716, " processing", false], [65034, 0.018445, " understanding", false], [63821, 0.015608, " recognition", false], [47350, 0.014659, " speech", false], [57103, 0.014577, " research", false], [46, 0.010718, "-", false], [21265, 0.007423, " and", false], [53087, 0.004813, " systems", false], [62634, 0.004431, " technology", false], [3609, 0.004258, " AI", false]]]}, "raw_delta": -0.008078835227272724, "tuned_delta": 0.0447761086709271}, {"byte_start": 3687, "byte_end": 3688, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "21.84%", "model_b": "24.23%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.296637624502182]], "model_b": [[45, ",", "normal", 0.2616400718688965]]}, "loss": {"model_a": 21.837669075955986, "model_b": 24.232768264931806}, "topk": {"model_a": [45, 1, 0.296637624502182, [[45, 0.296638, ",", false], [275, 0.242434, " (", false], [47, 0.148456, ".", false], [57103, 0.094094, " research", false], [59, 0.045315, ":", false], [5346, 0.040139, "---", false], [21265, 0.038469, " and", false], [4596, 0.017757, " in", false], [32227, 0.010802, " that", false], [60, 0.005535, ";", false]]], "model_b": [45, 1, 0.2616400718688965, [[45, 0.26164, ",", false], [47, 0.184068, ".", false], [275, 0.171719, " (", false], [57103, 0.096232, " research", false], [21265, 0.061595, " and", false], [4596, 0.032835, " in", false], [59, 0.031883, ":", false], [5346, 0.017164, "---", false], [52224, 0.011842, " methods", false], [4423, 0.011005, " as", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07995755610180018}, {"byte_start": 3688, "byte_end": 3698, "display": {"text": " gradually", "kind": "normal"}, "is_word": true, "word_id": 638, "word_key": " gradually", "bytes_hex": "20 67 72 61 64 75 61 6c 6c 79", "compression": {"model_a": "14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99%", "model_b": "17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58%"}, "model_tokens": {"model_a": [[59771, " gradually", "normal", 0.0002471302286721766]], "model_b": [[59771, " gradually", "normal", 5.65048903808929e-05]]}, "loss": {"model_a": 14.990503159236885, "model_b": 17.582845810834236}, "topk": {"model_a": [59771, 131, 0.0002471302286721766, [[40186, 0.160915, " which", false], [21265, 0.118876, " and", false], [30917, 0.096462, " from", false], [32487, 0.068092, " with", false], [40185, 0.06117, " where", false], [4423, 0.054776, " as", false], [4811, 0.053476, " to", false], [4596, 0.041837, " in", false], [30211, 0.022891, " away", false], [59841, 0.021538, " including", false]]], "model_b": [59771, 399, 5.65048903808929e-05, [[21265, 0.19816, " and", false], [40185, 0.094668, " where", false], [4423, 0.086444, " as", false], [32487, 0.085939, " with", false], [30917, 0.067136, " from", false], [40186, 0.056208, " which", false], [4596, 0.036451, " in", false], [21400, 0.026367, " but", false], [4811, 0.022995, " to", false], [22590, 0.021236, " the", false]]]}, "raw_delta": -0.1437499999999999, "tuned_delta": -0.09089505610180008}, {"byte_start": 3698, "byte_end": 3703, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 639, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "17.70% 17.70% 17.70% 17.70% 17.70%", "model_b": "20.85% 20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.007393436972051859]], "model_b": [[31601, " over", "normal", 0.003135876962915063]]}, "loss": {"model_a": 17.69555636090369, "model_b": 20.851451762848296}, "topk": {"model_a": [31601, 20, 0.007393436972051859, [[60385, 0.163246, " replacing", false], [46612, 0.134314, " moving", false], [57209, 0.129, " shifting", false], [52107, 0.033227, " leading", false], [50834, 0.025755, " abandon", false], [45, 0.02146, ",", false], [55660, 0.021212, " bringing", false], [46500, 0.015996, " making", false], [39856, 0.015836, " suppl", false], [38269, 0.014704, " displ", false]]], "model_b": [31601, 45, 0.003135876962915063, [[46612, 0.23252, " moving", false], [57209, 0.064182, " shifting", false], [60385, 0.039964, " replacing", false], [52107, 0.038568, " leading", false], [46500, 0.037304, " making", false], [57050, 0.024541, " reducing", false], [47497, 0.023725, " taking", false], [57088, 0.017915, " removing", false], [55611, 0.015082, " becoming", false], [52613, 0.012252, " pushing", false]]]}, "raw_delta": -0.17500000000000004, "tuned_delta": -0.12214505610180022}, {"byte_start": 3703, "byte_end": 3711, "display": {"text": " decades", "kind": "normal"}, "is_word": true, "word_id": 640, "word_key": " decades", "bytes_hex": "20 64 65 63 61 64 65 73", "compression": {"model_a": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "model_b": "9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[51396, " decades", "normal", 0.020421912893652916]], "model_b": [[51396, " decades", "normal", 0.017409812659025192]]}, "loss": {"model_a": 8.735067630382394, "model_b": 9.157732193142833}, "topk": {"model_a": [51396, 6, 0.020421912893652916, [[22590, 0.512357, " the", false], [332, 0.168796, " a", false], [32251, 0.092415, " time", false], [31370, 0.06089, " many", false], [52869, 0.042431, " several", false], [51396, 0.020422, " decades", false], [3493, 0.014304, " 20", false], [37598, 0.013776, " about", false], [22638, 0.008066, " two", false], [3483, 0.005897, " 10", false]]], "model_b": [51396, 6, 0.017409812659025192, [[22590, 0.412625, " the", false], [332, 0.155853, " a", false], [31370, 0.122328, " many", false], [52869, 0.086023, " several", false], [32251, 0.0356, " time", false], [51396, 0.01741, " decades", false], [31458, 0.016361, " more", false], [22638, 0.014311, " two", false], [3503, 0.009747, " 30", false], [39946, 0.006722, " three", false]]]}, "raw_delta": -0.0234375, "tuned_delta": 0.02941744389819982}, {"byte_start": 3711, "byte_end": 3712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "13.45%", "model_b": "18.88%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.4762890636920929]], "model_b": [[45, ",", "normal", 0.35004180669784546]]}, "loss": {"model_a": 13.454821914540624, "model_b": 18.879017136632918}, "topk": {"model_a": [45, 1, 0.4762890636920929, [[45, 0.476289, ",", false], [47, 0.368633, ".", false], [4706, 0.01905, " of", false], [21265, 0.018091, " and", false], [4423, 0.015984, " as", false], [59, 0.011355, ":", false], [4811, 0.00906, " to", false], [5346, 0.007765, "---", false], [275, 0.007652, " (", false], [21400, 0.007622, " but", false]]], "model_b": [45, 2, 0.35004180669784546, [[47, 0.427391, ".", false], [45, 0.350042, ",", false], [4706, 0.070159, " of", false], [4423, 0.019566, " as", false], [59, 0.019532, ":", false], [21265, 0.017397, " and", false], [275, 0.014068, " (", false], [40076, 0.00949, " until", false], [4596, 0.007453, " in", false], [4811, 0.006439, " to", false]]]}, "raw_delta": -0.30078125, "tuned_delta": -0.24792630610180016}, {"byte_start": 3712, "byte_end": 3718, "display": {"text": " where", "kind": "normal"}, "is_word": true, "word_id": 641, "word_key": " where", "bytes_hex": "20 77 68 65 72 65", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99%", "model_b": "10.85% 10.85% 10.85% 10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[40185, " where", "normal", 0.025591030716896057]], "model_b": [[40185, " where", "normal", 0.026948951184749603]]}, "loss": {"model_a": 10.9892786317714, "model_b": 10.848390444184586}, "topk": {"model_a": [40185, 11, 0.025591030716896057, [[30917, 0.173788, " from", false], [4423, 0.135837, " as", false], [32487, 0.086839, " with", false], [4811, 0.079786, " to", false], [21265, 0.073762, " and", false], [30211, 0.058252, " away", false], [4596, 0.054631, " in", false], [21400, 0.03817, " but", false], [53169, 0.037893, " towards", false], [40186, 0.027583, " which", false]]], "model_b": [40185, 9, 0.026948951184749603, [[30917, 0.169148, " from", false], [21265, 0.149518, " and", false], [4423, 0.109597, " as", false], [4811, 0.087169, " to", false], [32487, 0.064022, " with", false], [40076, 0.038414, " until", false], [4596, 0.037105, " in", false], [21400, 0.032382, " but", false], [40185, 0.026949, " where", false], [30211, 0.019193, " away", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06066744389819982}, {"byte_start": 3718, "byte_end": 3729, "display": {"text": " statistics", "kind": "normal"}, "is_word": true, "word_id": 642, "word_key": " statistics", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 73", "compression": {"model_a": "9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84%", "model_b": "9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32%"}, "model_tokens": {"model_a": [[62577, " statistics", "normal", 0.002479551825672388]], "model_b": [[62577, " statistics", "normal", 0.0033852974884212017]]}, "loss": {"model_a": 9.836557096970202, "model_b": 9.324236414836342}, "topk": {"model_a": [62577, 38, 0.002479551825672388, [[63885, 0.215971, " statistical", false], [22590, 0.197879, " the", false], [3866, 0.080888, " HM", false], [52224, 0.042858, " methods", false], [38720, 0.039723, " human", false], [31458, 0.023158, " more", false], [21256, 0.016193, " all", false], [4601, 0.016116, " it", false], [31466, 0.014971, " much", false], [31461, 0.013793, " most", false]]], "model_b": [62577, 38, 0.0033852974884212017, [[22590, 0.247697, " the", false], [63885, 0.083859, " statistical", false], [38720, 0.07203, " human", false], [31466, 0.024044, " much", false], [3866, 0.022472, " HM", false], [21256, 0.0208, " all", false], [332, 0.019735, " a", false], [31458, 0.019609, " more", false], [4601, 0.018925, " it", false], [46227, 0.017124, " humans", false]]]}, "raw_delta": 0.02840909090909083, "tuned_delta": 0.08126403480729065}, {"byte_start": 3729, "byte_end": 3733, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 643, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "11.13% 11.13% 11.13% 11.13%", "model_b": "11.91% 11.91% 11.91% 11.91%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.08548733592033386]], "model_b": [[21265, " and", "normal", 0.07094316929578781]]}, "loss": {"model_a": 11.130166819358212, "model_b": 11.905051851085684}, "topk": {"model_a": [21265, 2, 0.08548733592033386, [[45283, 0.111597, " became", false], [21265, 0.085487, " and", false], [30383, 0.069941, " came", false], [46, 0.061414, "-", false], [32272, 0.053912, " took", false], [31059, 0.047672, " have", false], [57094, 0.044577, " replaced", false], [22777, 0.043409, " won", false], [32462, 0.037508, " were", false], [37828, 0.0351, " began", false]]], "model_b": [21265, 3, 0.07094316929578781, [[45283, 0.212538, " became", false], [32462, 0.083343, " were", false], [21265, 0.070943, " and", false], [59572, 0.062085, " dominated", false], [22748, 0.045062, " was", false], [32272, 0.038095, " took", false], [31059, 0.031256, " have", false], [45, 0.026981, ",", false], [46, 0.026354, "-", false], [275, 0.025705, " (", false]]]}, "raw_delta": -0.04296875, "tuned_delta": 0.009886193898199822}, {"byte_start": 3733, "byte_end": 3745, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 644, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85%", "model_b": "5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.14767977595329285]], "model_b": [[63370, " computation", "normal", 0.027223113924264908]]}, "loss": {"model_a": 2.8529857986329596, "model_b": 5.424195222092293}, "topk": {"model_a": [63370, 2, 0.14767977595329285, [[3866, 0.188009, " HM", false], [63370, 0.14768, " computation", false], [56537, 0.135112, " learning", false], [47202, 0.074025, " search", false], [63885, 0.065686, " statistical", false], [52167, 0.051393, " machine", false], [56935, 0.025322, " probabil", false], [52195, 0.018793, " massive", false], [63787, 0.01825, " probability", false], [30597, 0.017254, " deep", false]]], "model_b": [63370, 6, 0.027223113924264908, [[3866, 0.296679, " HM", false], [52167, 0.100715, " machine", false], [38720, 0.07561, " human", false], [56537, 0.047433, " learning", false], [63885, 0.032035, " statistical", false], [63370, 0.027223, " computation", false], [30597, 0.020769, " deep", false], [22590, 0.016648, " the", false], [47202, 0.014868, " search", false], [46196, 0.013644, " hidden", false]]]}, "raw_delta": -0.142578125, "tuned_delta": -0.08972318110180018}, {"byte_start": 3745, "byte_end": 3750, "display": {"text": " came", "kind": "normal"}, "is_word": true, "word_id": 645, "word_key": " came", "bytes_hex": "20 63 61 6d 65", "compression": {"model_a": "8.12% 8.12% 8.12% 8.12% 8.12%", "model_b": "14.31% 14.31% 14.31% 14.31% 14.31%"}, "model_tokens": {"model_a": [[30383, " came", "normal", 0.10573261976242065]], "model_b": [[30383, " came", "normal", 0.018926488235592842]]}, "loss": {"model_a": 8.115159605000418, "model_b": 14.314239858820182}, "topk": {"model_a": [30383, 2, 0.10573261976242065, [[45283, 0.112943, " became", false], [30383, 0.105733, " came", false], [31059, 0.100427, " have", false], [32272, 0.077267, " took", false], [57094, 0.051581, " replaced", false], [22777, 0.049661, " won", false], [32462, 0.048631, " were", false], [61959, 0.032544, " eventually", false], [22190, 0.030329, " now", false], [59771, 0.027151, " gradually", false]]], "model_b": [30383, 8, 0.018926488235592842, [[45283, 0.244488, " became", false], [32462, 0.183793, " were", false], [31059, 0.06573, " have", false], [21286, 0.045222, " are", false], [59572, 0.043921, " dominated", false], [55858, 0.032032, " converge", false], [32272, 0.023484, " took", false], [30383, 0.018926, " came", false], [64430, 0.017734, " increasingly", false], [45284, 0.016936, " become", false]]]}, "raw_delta": -0.34374999999999994, "tuned_delta": -0.2908950561018001}, {"byte_start": 3750, "byte_end": 3753, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 646, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.23% 0.23% 0.23%", "model_b": "0.62% 0.62% 0.62%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.961857259273529]], "model_b": [[4811, " to", "normal", 0.9016938805580139]]}, "loss": {"model_a": 0.23334606069065872, "model_b": 0.6222561618417567}, "topk": {"model_a": [4811, 1, 0.961857259273529, [[4811, 0.961857, " to", false], [38499, 0.009005, " first", false], [31162, 0.007166, " into", false], [4596, 0.004989, " in", false], [22249, 0.00257, " out", false], [57435, 0.002282, " together", false], [64430, 0.001797, " increasingly", false], [31458, 0.000594, " more", false], [4712, 0.000503, " on", false], [45285, 0.000502, " before", false]]], "model_b": [4811, 1, 0.9016938805580139, [[4811, 0.901694, " to", false], [57435, 0.031587, " together", false], [64430, 0.021568, " increasingly", false], [31162, 0.017167, " into", false], [38499, 0.003778, " first", false], [22249, 0.002935, " out", false], [31458, 0.002383, " more", false], [4596, 0.001676, " in", false], [4423, 0.001541, " as", false], [40062, 0.001282, " under", false]]]}, "raw_delta": -0.021565755208333332, "tuned_delta": 0.03128918868986649}, {"byte_start": 3753, "byte_end": 3762, "display": {"text": " dominate", "kind": "normal"}, "is_word": true, "word_id": 647, "word_key": " dominate", "bytes_hex": "20 64 6f 6d 69 6e 61 74 65", "compression": {"model_a": "1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41%", "model_b": "1.74% 1.74% 1.74% 1.74% 1.74% 1.74% 1.74% 1.74% 1.74%"}, "model_tokens": {"model_a": [[56041, " dominate", "normal", 0.49143069982528687]], "model_b": [[56041, " dominate", "normal", 0.4188868999481201]]}, "loss": {"model_a": 1.4088818758681283, "model_b": 1.737620980237358}, "topk": {"model_a": [56041, 1, 0.49143069982528687, [[56041, 0.491431, " dominate", false], [4435, 0.190064, " be", false], [31907, 0.047701, " rule", false], [31702, 0.044779, " play", false], [56906, 0.039218, " predomin", false], [52716, 0.025981, " replace", false], [32187, 0.021349, " take", false], [22590, 0.019725, " the", false], [52550, 0.01178, " prevail", false], [31059, 0.006532, " have", false]]], "model_b": [56041, 1, 0.4188868999481201, [[56041, 0.418887, " dominate", false], [4435, 0.28993, " be", false], [32187, 0.026905, " take", false], [22590, 0.023162, " the", false], [22770, 0.019245, " win", false], [31702, 0.018936, " play", false], [31907, 0.01676, " rule", false], [52716, 0.014633, " replace", false], [56906, 0.014613, " predomin", false], [31059, 0.012288, " have", false]]]}, "raw_delta": -0.01822916666666667, "tuned_delta": 0.03462577723153315}, {"byte_start": 3762, "byte_end": 3766, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 648, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "12.40% 12.40% 12.40% 12.40%", "model_b": "7.89% 7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.0644843801856041]], "model_b": [[22590, " the", "normal", 0.1703592836856842]]}, "loss": {"model_a": 12.398160507639528, "model_b": 7.889738504861517}, "topk": {"model_a": [22590, 3, 0.0644843801856041, [[47, 0.56717, ".", false], [45, 0.139449, ",", false], [22590, 0.064484, " the", false], [31601, 0.052863, " over", false], [21265, 0.043779, " and", false], [275, 0.0128, " (", false], [57103, 0.009494, " research", false], [4596, 0.009205, " in", false], [21256, 0.006977, " all", false], [52224, 0.006482, " methods", false]]], "model_b": [22590, 2, 0.1703592836856842, [[47, 0.448357, ".", false], [22590, 0.170359, " the", false], [45, 0.061848, ",", false], [21265, 0.036587, " and", false], [47350, 0.025236, " speech", false], [4596, 0.020175, " in", false], [21256, 0.01621, " all", false], [52299, 0.014395, " natural", false], [57103, 0.013474, " research", false], [31601, 0.011657, " over", false]]]}, "raw_delta": 0.25, "tuned_delta": 0.30285494389819984}, {"byte_start": 3766, "byte_end": 3772, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 649, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"model_a": "3.12% 3.12% 3.12% 3.12% 3.12% 3.12%", "model_b": "3.64% 3.64% 3.64% 3.64% 3.64% 3.64%"}, "model_tokens": {"model_a": [[38478, " field", "normal", 0.35379740595817566]], "model_b": [[38478, " field", "normal", 0.2982555031776428]]}, "loss": {"model_a": 3.1230214915076844, "model_b": 3.639611512659331}, "topk": {"model_a": [38478, 1, 0.35379740595817566, [[38478, 0.353797, " field", false], [57103, 0.191892, " research", false], [52224, 0.065537, " methods", false], [39597, 0.03235, " scene", false], [39802, 0.026105, " state", false], [55532, 0.024694, " approach", false], [61590, 0.019269, " approaches", false], [45829, 0.012504, " effort", false], [59945, 0.01114, " landscape", false], [45775, 0.00977, " domain", false]]], "model_b": [38478, 1, 0.2982555031776428, [[38478, 0.298256, " field", false], [57103, 0.081519, " research", false], [55532, 0.053041, " approach", false], [52224, 0.041508, " methods", false], [30173, 0.021069, " area", false], [45829, 0.01824, " effort", false], [46561, 0.017071, " method", false], [45775, 0.015628, " domain", false], [3609, 0.014146, " AI", false], [52571, 0.013934, " process", false]]]}, "raw_delta": -0.028645833333333315, "tuned_delta": 0.024209110564866507}, {"byte_start": 3772, "byte_end": 3773, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.95%", "model_b": "4.21%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7178393006324768]], "model_b": [[47, ".", "normal", 0.7943127155303955]]}, "loss": {"model_a": 5.952525925542842, "model_b": 4.209034604156033}, "topk": {"model_a": [47, 1, 0.7178393006324768, [[47, 0.717839, ".", false], [45, 0.138475, ",", false], [21265, 0.040682, " and", false], [275, 0.013805, " (", false], [4706, 0.013097, " of", false], [31601, 0.011133, " over", false], [5346, 0.006648, "---", false], [40187, 0.006268, " while", false], [4596, 0.006095, " in", false], [4423, 0.005339, " as", false]]], "model_b": [47, 1, 0.7943127155303955, [[47, 0.794313, ".", false], [45, 0.065074, ",", false], [21265, 0.030174, " and", false], [4706, 0.028016, " of", false], [275, 0.013636, " (", false], [4596, 0.009326, " in", false], [4423, 0.007075, " as", false], [21700, 0.003426, " for", false], [5346, 0.003271, "---", false], [4424, 0.002207, " at", false]]]}, "raw_delta": 0.0966796875, "tuned_delta": 0.14953463139819984}, {"byte_start": 3773, "byte_end": 3777, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 650, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "10.78% 10.78% 10.78% 10.78%", "model_b": "11.20% 11.20% 11.20% 11.20%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.09076663851737976]], "model_b": [[20996, " The", "normal", 0.08266658335924149]]}, "loss": {"model_a": 10.777946350391181, "model_b": 11.20061091315162}, "topk": {"model_a": [20996, 2, 0.09076663851737976, [[261, 0.407122, "\n\n", false], [20996, 0.090767, " The", false], [29894, 0.039778, " This", false], [3913, 0.031061, " In", false], [3918, 0.029376, " It", false], [267, 0.025666, "  ", false], [37451, 0.019155, " There", false], [36251, 0.015516, " Again", false], [275, 0.015023, " (", false], [19555, 0.012959, " But", false]]], "model_b": [20996, 2, 0.08266658335924149, [[261, 0.328054, "\n\n", false], [20996, 0.082667, " The", false], [3913, 0.056123, " In", false], [29894, 0.049278, " This", false], [267, 0.027669, "  ", false], [3918, 0.022217, " It", false], [11, 0.018361, "\n", false], [37451, 0.01832, " There", false], [300, 0.01378, " A", false], [19555, 0.012802, " But", false]]]}, "raw_delta": -0.0234375, "tuned_delta": 0.02941744389819982}, {"byte_start": 3777, "byte_end": 3784, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 651, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"model_a": "16.02% 16.02% 16.02% 16.02% 16.02% 16.02% 16.02%", "model_b": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"model_a": [[47014, " recent", "normal", 0.001985829556360841]], "model_b": [[47014, " recent", "normal", 0.002644717926159501]]}, "loss": {"model_a": 16.020999617014713, "model_b": 15.296431795139677}, "topk": {"model_a": [47014, 81, 0.001985829556360841, [[38720, 0.094761, " human", false], [63885, 0.086314, " statistical", false], [38328, 0.032011, " early", false], [52224, 0.02248, " methods", false], [52013, 0.019574, " initial", false], [19678, 0.016059, " DAR", false], [62577, 0.015992, " statistics", false], [46430, 0.015889, " lesson", false], [31937, 0.014073, " same", false], [31461, 0.012226, " most", false]]], "model_b": [47014, 60, 0.002644717926159501, [[63885, 0.069084, " statistical", false], [38720, 0.066164, " human", false], [31937, 0.026832, " same", false], [38328, 0.02149, " early", false], [47009, 0.02053, " reason", false], [62577, 0.01792, " statistics", false], [38499, 0.016617, " first", false], [31461, 0.016406, " most", false], [21952, 0.01394, " key", false], [52964, 0.012248, " special", false]]]}, "raw_delta": 0.0401785714285714, "tuned_delta": 0.09303351532677122}, {"byte_start": 3784, "byte_end": 3789, "display": {"text": " rise", "kind": "normal"}, "is_word": true, "word_id": 652, "word_key": " rise", "bytes_hex": "20 72 69 73 65", "compression": {"model_a": "13.36% 13.36% 13.36% 13.36% 13.36%", "model_b": "12.57% 12.57% 12.57% 12.57% 12.57%"}, "model_tokens": {"model_a": [[31886, " rise", "normal", 0.024365076795220375]], "model_b": [[31886, " rise", "normal", 0.030451463535428047]]}, "loss": {"model_a": 13.356200183229856, "model_b": 12.567226332743704}, "topk": {"model_a": [31886, 5, 0.024365076795220375, [[53052, 0.163783, " success", false], [59687, 0.05859, " explosion", false], [60587, 0.051036, " successes", false], [22377, 0.029686, " res", false], [31886, 0.024365, " rise", false], [55465, 0.021762, " advances", false], [32499, 0.021367, " work", false], [56950, 0.020205, " progress", false], [63469, 0.020036, " development", false], [40009, 0.01923, " trend", false]]], "model_b": [31886, 5, 0.030451463535428047, [[53052, 0.062276, " success", false], [22377, 0.043769, " res", false], [40009, 0.038958, " trend", false], [60587, 0.030758, " successes", false], [31886, 0.030451, " rise", false], [39859, 0.029991, " surge", false], [59687, 0.026644, " explosion", false], [55465, 0.023281, " advances", false], [52753, 0.019787, " revival", false], [63469, 0.016423, " development", false]]]}, "raw_delta": 0.043749999999999956, "tuned_delta": 0.09660494389819978}, {"byte_start": 3789, "byte_end": 3792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 653, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.87% 0.87% 0.87%", "model_b": "2.05% 2.05% 2.05%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.864526629447937]], "model_b": [[4706, " of", "normal", 0.7106306552886963]]}, "loss": {"model_a": 0.8746808312681296, "model_b": 2.054619402307687}, "topk": {"model_a": [4706, 1, 0.864526629447937, [[4706, 0.864527, " of", false], [4596, 0.099814, " in", false], [4811, 0.020594, " to", false], [21265, 0.00879, " and", false], [45, 0.002744, ",", false], [275, 0.001305, " (", false], [37635, 0.000326, " again", false], [30917, 0.000194, " from", false], [4600, 0.000111, " is", false], [30218, 9.4e-05, " back", false]]], "model_b": [4706, 1, 0.7106306552886963, [[4706, 0.710631, " of", false], [4596, 0.258063, " in", false], [4811, 0.013718, " to", false], [21265, 0.005357, " and", false], [45, 0.003388, ",", false], [275, 0.000987, " (", false], [30218, 0.00095, " back", false], [37635, 0.00093, " again", false], [32227, 0.000477, " that", false], [32487, 0.000385, " with", false]]]}, "raw_delta": -0.0654296875, "tuned_delta": -0.012574743601800178}, {"byte_start": 3792, "byte_end": 3797, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 654, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"model_a": "1.85% 1.85% 1.85% 1.85% 1.85%", "model_b": "3.92% 3.92% 3.92% 3.92% 3.92%"}, "model_tokens": {"model_a": [[30597, " deep", "normal", 0.6035642623901367]], "model_b": [[30597, " deep", "normal", 0.3374604880809784]]}, "loss": {"model_a": 1.8456352573872479, "model_b": 3.9166916149133963}, "topk": {"model_a": [30597, 1, 0.6035642623901367, [[30597, 0.603564, " deep", false], [46658, 0.118085, " neural", false], [22590, 0.021521, " the", false], [60342, 0.02145, " recurrent", false], [59193, 0.019629, " attention", false], [52167, 0.018761, " machine", false], [4404, 0.013704, " ``", false], [32497, 0.009341, " word", false], [64597, 0.00796, " transformers", false], [38864, 0.006483, " large", false]]], "model_b": [30597, 1, 0.3374604880809784, [[30597, 0.33746, " deep", false], [52167, 0.095895, " machine", false], [46658, 0.062708, " neural", false], [38864, 0.041692, " large", false], [46086, 0.036579, " genera", false], [3609, 0.027691, " AI", false], [22590, 0.025462, " the", false], [52299, 0.014196, " natural", false], [63885, 0.012435, " statistical", false], [47350, 0.010631, " speech", false]]]}, "raw_delta": -0.11484375, "tuned_delta": -0.06198880610180017}, {"byte_start": 3797, "byte_end": 3806, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 655, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49%", "model_b": "0.61% 0.61% 0.61% 0.61% 0.61% 0.61% 0.61% 0.61% 0.61%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.7834071516990662]], "model_b": [[56537, " learning", "normal", 0.7393114566802979]]}, "loss": {"model_a": 0.4872383154043943, "model_b": 0.6066019187765553}, "topk": {"model_a": [56537, 1, 0.7834071516990662, [[56537, 0.783407, " learning", false], [46658, 0.172457, " neural", false], [46, 0.016549, "-", false], [56705, 0.004807, " networks", false], [31510, 0.002512, " nets", false], [47350, 0.0021, " speech", false], [56529, 0.001311, " language", false], [46086, 0.001261, " genera", false], [65003, 0.001036, " reinforcement", false], [45, 0.001033, ",", false]]], "model_b": [56537, 1, 0.7393114566802979, [[56537, 0.739311, " learning", false], [46658, 0.126678, " neural", false], [46, 0.06092, "-", false], [52299, 0.007222, " natural", false], [46086, 0.004547, " genera", false], [47350, 0.004005, " speech", false], [47202, 0.003878, " search", false], [52167, 0.003836, " machine", false], [56529, 0.003507, " language", false], [46587, 0.003172, " models", false]]]}, "raw_delta": -0.006618923611111107, "tuned_delta": 0.04623602028708872}, {"byte_start": 3806, "byte_end": 3809, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 656, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "10.43% 10.43% 10.43%", "model_b": "11.93% 11.93% 11.93%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.17703208327293396]], "model_b": [[4596, " in", "normal", 0.13691382110118866]]}, "loss": {"model_a": 10.425725881424148, "model_b": 11.928533215683485}, "topk": {"model_a": [4596, 1, 0.17703208327293396, [[4596, 0.177032, " in", false], [45, 0.139878, ",", false], [21800, 0.119042, " has", false], [4600, 0.090814, " is", false], [52224, 0.076817, " methods", false], [21265, 0.038514, " and", false], [275, 0.036194, " (", false], [21700, 0.024612, " for", false], [22748, 0.024106, " was", false], [62633, 0.021755, " techniques", false]]], "model_b": [4596, 2, 0.13691382110118866, [[45, 0.166459, ",", false], [4596, 0.136914, " in", false], [21800, 0.135265, " has", false], [52224, 0.055335, " methods", false], [4600, 0.04643, " is", false], [275, 0.044795, " (", false], [21265, 0.042299, " and", false], [22748, 0.028936, " was", false], [4706, 0.028266, " of", false], [62633, 0.02588, " techniques", false]]]}, "raw_delta": -0.08333333333333337, "tuned_delta": -0.03047838943513355}, {"byte_start": 3809, "byte_end": 3816, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 657, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"model_a": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%", "model_b": "2.51% 2.51% 2.51% 2.51% 2.51% 2.51% 2.51%"}, "model_tokens": {"model_a": [[47350, " speech", "normal", 0.30205366015434265]], "model_b": [[47350, " speech", "normal", 0.38338425755500793]]}, "loss": {"model_a": 3.099540126909882, "model_b": 2.50579705065117}, "topk": {"model_a": [47350, 1, 0.30205366015434265, [[47350, 0.302054, " speech", false], [4047, 0.273531, " NL", false], [52299, 0.163085, " natural", false], [55809, 0.066247, " computer", false], [22590, 0.029283, " the", false], [32234, 0.02686, " this", false], [3609, 0.012598, " AI", false], [62293, 0.010452, " particular", false], [38744, 0.009046, " image", false], [52167, 0.008979, " machine", false]]], "model_b": [47350, 1, 0.38338425755500793, [[47350, 0.383384, " speech", false], [52299, 0.280843, " natural", false], [4047, 0.092876, " NL", false], [22590, 0.045401, " the", false], [32234, 0.030361, " this", false], [55809, 0.025359, " computer", false], [52167, 0.014952, " machine", false], [56529, 0.013114, " language", false], [50475, 0.012187, " Natural", false], [46658, 0.007812, " neural", false]]]}, "raw_delta": 0.03292410714285715, "tuned_delta": 0.08577905104105697}, {"byte_start": 3816, "byte_end": 3828, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 658, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"model_a": "0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39%", "model_b": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"model_a": [[63821, " recognition", "normal", 0.7711982727050781]], "model_b": [[63821, " recognition", "normal", 0.7272058129310608]]}, "loss": {"model_a": 0.3933128570131859, "model_b": 0.48136797425494376}, "topk": {"model_a": [63821, 1, 0.7711982727050781, [[63821, 0.771198, " recognition", false], [21265, 0.072232, " and", false], [62378, 0.047176, " processing", false], [21800, 0.021838, " has", false], [45, 0.016241, ",", false], [4600, 0.013337, " is", false], [275, 0.005199, " (", false], [46, 0.004189, "-", false], [65034, 0.004142, " understanding", false], [22748, 0.003535, " was", false]]], "model_b": [63821, 1, 0.7272058129310608, [[63821, 0.727206, " recognition", false], [62378, 0.062853, " processing", false], [21265, 0.054349, " and", false], [21800, 0.026832, " has", false], [45, 0.018614, ",", false], [46, 0.013463, "-", false], [4600, 0.011626, " is", false], [22748, 0.006144, " was", false], [60335, 0.005318, " recognize", false], [275, 0.004477, " (", false]]]}, "raw_delta": -0.0048828125, "tuned_delta": 0.04797213139819982}, {"byte_start": 3828, "byte_end": 3831, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 659, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "7.98% 7.98% 7.98%", "model_b": "7.51% 7.51% 7.51%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.26714470982551575]], "model_b": [[4600, " is", "normal", 0.28831809759140015]]}, "loss": {"model_a": 7.983663963252726, "model_b": 7.514036671296684}, "topk": {"model_a": [4600, 1, 0.26714470982551575, [[4600, 0.267145, " is", false], [21800, 0.201374, " has", false], [21265, 0.106443, " and", false], [45, 0.101852, ",", false], [22748, 0.078315, " was", false], [275, 0.022908, " (", false], [21413, 0.021348, " can", false], [39680, 0.007938, " shows", false], [5346, 0.007829, "---", false], [30135, 0.007423, " also", false]]], "model_b": [4600, 1, 0.28831809759140015, [[4600, 0.288318, " is", false], [45, 0.122653, ",", false], [21800, 0.10541, " has", false], [22748, 0.085073, " was", false], [21265, 0.053661, " and", false], [275, 0.026528, " (", false], [22074, 0.017887, " may", false], [21413, 0.017063, " can", false], [30135, 0.01557, " also", false], [39680, 0.011869, " shows", false]]]}, "raw_delta": 0.02604166666666663, "tuned_delta": 0.07889661056486645}, {"byte_start": 3831, "byte_end": 3835, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 660, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.20% 11.20% 11.20% 11.20%", "model_b": "13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.08310132473707199]], "model_b": [[22590, " the", "normal", 0.05363049358129501]]}, "loss": {"model_a": 11.20061091315162, "model_b": 13.173045539367}, "topk": {"model_a": [22590, 3, 0.08310132473707199, [[332, 0.2584, " a", false], [4419, 0.088994, " an", false], [22590, 0.083101, " the", false], [50919, 0.042525, " another", false], [31198, 0.032695, " just", false], [22797, 0.027438, " yet", false], [4596, 0.023097, " in", false], [47285, 0.022295, " simply", false], [52906, 0.01897, " similar", false], [52094, 0.01859, " largely", false]]], "model_b": [22590, 4, 0.05363049358129501, [[332, 0.330597, " a", false], [4419, 0.081437, " an", false], [50919, 0.080014, " another", false], [22590, 0.05363, " the", false], [37810, 0.038687, " based", false], [52094, 0.021589, " largely", false], [4596, 0.019114, " in", false], [21572, 0.018747, " due", false], [30135, 0.017568, " also", false], [22226, 0.01433, " one", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05652005610180018}, {"byte_start": 3835, "byte_end": 3840, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 661, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "7.83% 7.83% 7.83% 7.83% 7.83%", "model_b": "8.17% 8.17% 8.17% 8.17% 8.17%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.1123746931552887]], "model_b": [[31461, " most", "normal", 0.10331621021032333]]}, "loss": {"model_a": 7.833383229826793, "model_b": 8.171514880035144}, "topk": {"model_a": [31461, 3, 0.1123746931552887, [[46404, 0.353577, " latest", false], [45635, 0.132747, " culmin", false], [31461, 0.112375, " most", false], [52299, 0.04461, " natural", false], [64328, 0.040321, " continuation", false], [47092, 0.034982, " result", false], [52154, 0.030636, " logical", false], [31515, 0.027731, " next", false], [38491, 0.01717, " final", false], [31937, 0.014912, " same", false]]], "model_b": [31461, 2, 0.10331621021032333, [[47092, 0.18501, " result", false], [31461, 0.103316, " most", false], [46404, 0.089672, " latest", false], [45635, 0.062413, " culmin", false], [52748, 0.039435, " reverse", false], [52574, 0.028417, " product", false], [46588, 0.024008, " modern", false], [45752, 0.01872, " direct", false], [56767, 0.016515, " opposite", false], [31937, 0.015127, " same", false]]]}, "raw_delta": -0.01874999999999999, "tuned_delta": 0.03410494389819983}, {"byte_start": 3840, "byte_end": 3847, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 662, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"model_a": "1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13%", "model_b": "4.17% 4.17% 4.17% 4.17% 4.17% 4.17% 4.17%"}, "model_tokens": {"model_a": [[47014, " recent", "normal", 0.6433455348014832]], "model_b": [[47014, " recent", "normal", 0.1992841511964798]]}, "loss": {"model_a": 1.1271055006945025, "model_b": 4.166264975781465}, "topk": {"model_a": [47014, 1, 0.6433455348014832, [[47014, 0.643346, " recent", false], [56056, 0.100219, " dramatic", false], [52346, 0.051646, " obvious", false], [63878, 0.020879, " spectacular", false], [60273, 0.019068, " prominent", false], [53296, 0.016331, " visible", false], [57323, 0.015055, " striking", false], [51699, 0.013196, " extreme", false], [59829, 0.011178, " important", false], [45752, 0.010152, " direct", false]]], "model_b": [47014, 2, 0.1992841511964798, [[56056, 0.274642, " dramatic", false], [47014, 0.199284, " recent", false], [52346, 0.089415, " obvious", false], [57323, 0.086686, " striking", false], [63878, 0.029251, " spectacular", false], [63870, 0.02581, " significant", false], [59829, 0.018553, " important", false], [62477, 0.017155, " remarkable", false], [53296, 0.014375, " visible", false], [52321, 0.013948, " notable", false]]]}, "raw_delta": -0.16852678571428575, "tuned_delta": -0.11567184181608593}, {"byte_start": 3847, "byte_end": 3852, "display": {"text": " step", "kind": "normal"}, "is_word": true, "word_id": 663, "word_key": " step", "bytes_hex": "20 73 74 65 70", "compression": {"model_a": "18.82% 18.82% 18.82% 18.82% 18.82%", "model_b": "17.02% 17.02% 17.02% 17.02% 17.02%"}, "model_tokens": {"model_a": [[32115, " step", "normal", 0.005469643510878086]], "model_b": [[32115, " step", "normal", 0.008976245298981667]]}, "loss": {"model_a": 18.822661861598192, "model_b": 17.019293060486987}, "topk": {"model_a": [32115, 21, 0.005469643510878086, [[51668, 0.367254, " example", false], [64955, 0.094885, " manifestation", false], [21265, 0.051247, " and", false], [53275, 0.033853, " version", false], [45, 0.027628, ",", false], [56467, 0.025702, " instance", false], [59932, 0.021061, " iteration", false], [4706, 0.02084, " of", false], [59695, 0.017466, " extension", false], [63469, 0.017059, " development", false]]], "model_b": [32115, 15, 0.008976245298981667, [[51668, 0.28956, " example", false], [64955, 0.181301, " manifestation", false], [21265, 0.049563, " and", false], [32139, 0.025814, " such", false], [45, 0.019627, ",", false], [56467, 0.0185, " instance", false], [4706, 0.018134, " of", false], [63469, 0.016909, " development", false], [53275, 0.016036, " version", false], [46263, 0.012352, " incarn", false]]]}, "raw_delta": 0.09999999999999998, "tuned_delta": 0.1528549438981998}, {"byte_start": 3852, "byte_end": 3855, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 664, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "1.54% 1.54% 1.54%", "model_b": "1.93% 1.93% 1.93%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.7726312279701233]], "model_b": [[4596, " in", "normal", 0.7240283489227295]]}, "loss": {"model_a": 1.53802938115604, "model_b": 1.925471897019775}, "topk": {"model_a": [4596, 1, 0.7726312279701233, [[4596, 0.772631, " in", false], [37678, 0.087611, " along", false], [4706, 0.051711, " of", false], [4712, 0.012874, " on", false], [45, 0.010604, ",", false], [53169, 0.009763, " towards", false], [47, 0.007186, ".", false], [30678, 0.006968, " down", false], [47585, 0.006806, " toward", false], [30211, 0.005082, " away", false]]], "model_b": [4596, 1, 0.7240283489227295, [[4596, 0.724028, " in", false], [47585, 0.04157, " toward", false], [53169, 0.03986, " towards", false], [4706, 0.030647, " of", false], [32227, 0.028925, " that", false], [4712, 0.016245, " on", false], [37678, 0.011808, " along", false], [47, 0.010194, ".", false], [30211, 0.010161, " away", false], [45, 0.010129, ",", false]]]}, "raw_delta": -0.021484375, "tuned_delta": 0.03137056889819982}, {"byte_start": 3855, "byte_end": 3860, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 665, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "1.66% 1.66% 1.66% 1.66% 1.66%", "model_b": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.6323899626731873]], "model_b": [[32234, " this", "normal", 0.5498917698860168]]}, "loss": {"model_a": 1.6554362041450505, "model_b": 2.141500451319555}, "topk": {"model_a": [32234, 1, 0.6323899626731873, [[32234, 0.63239, " this", false], [32227, 0.168583, " that", false], [22590, 0.121055, " the", false], [332, 0.052014, " a", false], [4419, 0.005062, " an", false], [39936, 0.003167, " these", false], [32464, 0.002529, " what", false], [61774, 0.001128, " continuing", false], [59725, 0.000641, " following", false], [55531, 0.000513, " applying", false]]], "model_b": [32234, 1, 0.5498917698860168, [[32234, 0.549892, " this", false], [22590, 0.192025, " the", false], [32227, 0.091217, " that", false], [332, 0.089583, " a", false], [4419, 0.010919, " an", false], [32139, 0.004368, " such", false], [32464, 0.004258, " what", false], [38888, 0.003684, " lever", false], [59611, 0.002258, " embracing", false], [47497, 0.002097, " taking", false]]]}, "raw_delta": -0.026953124999999994, "tuned_delta": 0.025901818898199827}, {"byte_start": 3860, "byte_end": 3871, "display": {"text": " consistent", "kind": "normal"}, "is_word": true, "word_id": 666, "word_key": " consistent", "bytes_hex": "20 63 6f 6e 73 69 73 74 65 6e 74", "compression": {"model_a": "18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24%", "model_b": "13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22%"}, "model_tokens": {"model_a": [[61756, " consistent", "normal", 1.4924115930625703e-05]], "model_b": [[61756, " consistent", "normal", 0.00030854842043481767]]}, "loss": {"model_a": 18.238616283965587, "model_b": 13.217873599053709}, "topk": {"model_a": [61756, 981, 1.4924115930625703e-05, [[52571, 0.160754, " process", false], [31323, 0.135206, " long", false], [59657, 0.072277, " evolution", false], [40009, 0.069912, " trend", false], [59526, 0.042668, " direction", false], [51832, 0.039862, " general", false], [64386, 0.029652, " evolutionary", false], [31937, 0.027266, " same", false], [63797, 0.025852, " progression", false], [45450, 0.024995, " change", false]]], "model_b": [61756, 151, 0.00030854842043481767, [[40009, 0.272738, " trend", false], [59526, 0.094869, " direction", false], [52571, 0.091709, " process", false], [31323, 0.070773, " long", false], [52427, 0.065293, " pattern", false], [51832, 0.043413, " general", false], [59657, 0.022136, " evolution", false], [45450, 0.016036, " change", false], [51929, 0.015964, " history", false], [63797, 0.01407, " progression", false]]]}, "raw_delta": 0.278409090909091, "tuned_delta": 0.33126403480729083}, {"byte_start": 3871, "byte_end": 3881, "display": {"text": " direction", "kind": "normal"}, "is_word": true, "word_id": 667, "word_key": " direction", "bytes_hex": "20 64 69 72 65 63 74 69 6f 6e", "compression": {"model_a": "8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62%", "model_b": "7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50%"}, "model_tokens": {"model_a": [[59526, " direction", "normal", 0.008413325995206833]], "model_b": [[59526, " direction", "normal", 0.015553847886621952]]}, "loss": {"model_a": 8.622357080312945, "model_b": 7.495251579618443}, "topk": {"model_a": [59526, 18, 0.008413325995206833, [[52427, 0.245605, " pattern", false], [40009, 0.199254, " trend", false], [45, 0.058403, ",", false], [63797, 0.038376, " progression", false], [56950, 0.033512, " progress", false], [59657, 0.029808, " evolution", false], [21265, 0.02918, " and", false], [52571, 0.025617, " process", false], [45450, 0.019801, " change", false], [38974, 0.019312, " march", false]]], "model_b": [59526, 7, 0.015553847886621952, [[40009, 0.445391, " trend", false], [52427, 0.247425, " pattern", false], [45, 0.024252, ",", false], [51832, 0.023245, " general", false], [21265, 0.023013, " and", false], [52571, 0.017151, " process", false], [59526, 0.015554, " direction", false], [59657, 0.015232, " evolution", false], [63797, 0.009554, " progression", false], [62061, 0.008982, " historical", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 3881, "byte_end": 3882, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.57%", "model_b": "6.76%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7336514592170715]], "model_b": [[47, ".", "normal", 0.6875604391098022]]}, "loss": {"model_a": 5.565083409679106, "model_b": 6.762633004167015}, "topk": {"model_a": [47, 1, 0.7336514592170715, [[47, 0.733651, ".", false], [45, 0.116863, ",", false], [4706, 0.076788, " of", false], [5346, 0.008548, "---", false], [21265, 0.008427, " and", false], [53169, 0.006414, " towards", false], [275, 0.005262, " (", false], [4596, 0.005249, " in", false], [32227, 0.004438, " that", false], [47585, 0.004208, " toward", false]]], "model_b": [47, 1, 0.6875604391098022, [[47, 0.68756, ".", false], [45, 0.121418, ",", false], [4706, 0.109738, " of", false], [5346, 0.017226, "---", false], [59, 0.009308, ":", false], [4596, 0.008968, " in", false], [275, 0.008142, " (", false], [21265, 0.005159, " and", false], [60, 0.004104, ";", false], [32227, 0.003264, " that", false]]]}, "raw_delta": -0.06640625, "tuned_delta": -0.013551306101800178}, {"byte_start": 3882, "byte_end": 3887, "display": {"text": " Deep", "kind": "normal"}, "is_word": true, "word_id": 668, "word_key": " deep", "bytes_hex": "20 44 65 65 70", "compression": {"model_a": "14.31% 14.31% 14.31% 14.31% 14.31%", "model_b": "13.86% 13.86% 13.86% 13.86% 13.86%"}, "model_tokens": {"model_a": [[28753, " Deep", "normal", 0.018543995916843414]], "model_b": [[28753, " Deep", "normal", 0.021273121237754822]]}, "loss": {"model_a": 14.314239858820182, "model_b": 13.863397658542382}, "topk": {"model_a": [28753, 5, 0.018543995916843414, [[261, 0.646703, "\n\n", false], [20996, 0.043666, " The", false], [3918, 0.029743, " It", false], [267, 0.023415, "  ", false], [28753, 0.018544, " Deep", false], [3913, 0.017913, " In", false], [37451, 0.009992, " There", false], [29894, 0.009243, " This", false], [36251, 0.008297, " Again", false], [44900, 0.007287, " Speech", false]]], "model_b": [28753, 7, 0.021273121237754822, [[261, 0.514675, "\n\n", false], [20996, 0.058912, " The", false], [3913, 0.036517, " In", false], [267, 0.035422, "  ", false], [11, 0.032646, "\n", false], [3918, 0.028816, " It", false], [28753, 0.021273, " Deep", false], [29894, 0.015167, " This", false], [3336, 0.012879, " \n\n", false], [19555, 0.009042, " But", false]]]}, "raw_delta": 0.02499999999999991, "tuned_delta": 0.07785494389819973}, {"byte_start": 3887, "byte_end": 3896, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 669, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "model_b": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.9391831159591675]], "model_b": [[56537, " learning", "normal", 0.9395096302032471]]}, "loss": {"model_a": 0.1262123347131865, "model_b": 0.12474474942582386}, "topk": {"model_a": [56537, 1, 0.9391831159591675, [[56537, 0.939183, " learning", false], [46658, 0.020539, " neural", false], [46, 0.015048, "-", false], [56705, 0.002709, " networks", false], [31510, 0.002476, " nets", false], [52224, 0.002123, " methods", false], [47350, 0.001741, " speech", false], [46587, 0.00146, " models", false], [1857, 0.001356, "er", false], [55122, 0.001304, " Learning", false]]], "model_b": [56537, 1, 0.9395096302032471, [[56537, 0.93951, " learning", false], [46658, 0.017134, " neural", false], [46, 0.007684, "-", false], [52224, 0.006353, " methods", false], [1857, 0.002766, "er", false], [47202, 0.00253, " search", false], [55122, 0.001871, " Learning", false], [47350, 0.001695, " speech", false], [56705, 0.001092, " networks", false], [61590, 0.000768, " approaches", false]]]}, "raw_delta": 8.138020833333391e-05, "tuned_delta": 0.05293632410653316}, {"byte_start": 3896, "byte_end": 3904, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 670, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12%", "model_b": "8.03% 8.03% 8.03% 8.03% 8.03% 8.03% 8.03% 8.03%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.15847846865653992]], "model_b": [[52224, " methods", "normal", 0.02816818654537201]]}, "loss": {"model_a": 4.120979486914275, "model_b": 8.030626692448331}, "topk": {"model_a": [52224, 2, 0.15847846865653992, [[4600, 0.208106, " is", false], [52224, 0.158478, " methods", false], [45, 0.086777, ",", false], [21800, 0.077345, " has", false], [30659, 0.025664, " does", false], [32356, 0.025328, " uses", false], [21413, 0.024652, " can", false], [62633, 0.018495, " techniques", false], [22748, 0.017224, " was", false], [21265, 0.01381, " and", false]]], "model_b": [52224, 6, 0.02816818654537201, [[4600, 0.274082, " is", false], [45, 0.1096, ",", false], [21800, 0.075477, " has", false], [22748, 0.047108, " was", false], [32356, 0.041225, " uses", false], [52224, 0.028168, " methods", false], [4596, 0.022942, " in", false], [21413, 0.017481, " can", false], [47056, 0.014223, " relies", false], [56540, 0.013092, " leverage", false]]]}, "raw_delta": -0.216796875, "tuned_delta": -0.16394193110180016}, {"byte_start": 3904, "byte_end": 3909, "display": {"text": " rely", "kind": "normal"}, "is_word": true, "word_id": 671, "word_key": " rely", "bytes_hex": "20 72 65 6c 79", "compression": {"model_a": "16.23% 16.23% 16.23% 16.23% 16.23%", "model_b": "14.26% 14.26% 14.26% 14.26% 14.26%"}, "model_tokens": {"model_a": [[31856, " rely", "normal", 0.011062804609537125]], "model_b": [[31856, " rely", "normal", 0.019426267594099045]]}, "loss": {"model_a": 16.230319210000836, "model_b": 14.257884583785458}, "topk": {"model_a": [31856, 14, 0.011062804609537125, [[21286, 0.252335, " are", false], [45, 0.118289, ",", false], [31059, 0.107488, " have", false], [4491, 0.045172, " do", false], [21413, 0.030991, " can", false], [22681, 0.023271, " use", false], [56540, 0.022842, " leverage", false], [32187, 0.017824, " take", false], [32462, 0.014604, " were", false], [31358, 0.012051, " make", false]]], "model_b": [31856, 12, 0.019426267594099045, [[21286, 0.217893, " are", false], [45, 0.096698, ",", false], [31059, 0.087078, " have", false], [22681, 0.037074, " use", false], [32462, 0.03702, " were", false], [56540, 0.031305, " leverage", false], [21413, 0.025959, " can", false], [32187, 0.023354, " take", false], [37810, 0.020638, " based", false], [4491, 0.019986, " do", false]]]}, "raw_delta": 0.109375, "tuned_delta": 0.16222994389819984}, {"byte_start": 3909, "byte_end": 3914, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 672, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "22.32% 22.32% 22.32% 22.32% 22.32%", "model_b": "29.76% 29.76% 29.76% 29.76% 29.76%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.0020208877976983786]], "model_b": [[30788, " even", "normal", 0.00026548324967734516]]}, "loss": {"model_a": 22.31668891375115, "model_b": 29.755585218334865}, "topk": {"model_a": [30788, 30, 0.0020208877976983786, [[4712, 0.681747, " on", false], [51919, 0.136546, " heavily", false], [31458, 0.013708, " more", false], [32350, 0.012332, " upon", false], [45, 0.01095, ",", false], [4596, 0.010938, " in", false], [32386, 0.009323, " very", false], [31466, 0.009204, " much", false], [45145, 0.009088, " almost", false], [22187, 0.006041, " not", false]]], "model_b": [30788, 61, 0.00026548324967734516, [[4712, 0.648001, " on", false], [51919, 0.17831, " heavily", false], [32350, 0.021797, " upon", false], [56131, 0.016035, " entirely", false], [45145, 0.008907, " almost", false], [60247, 0.00782, " primarily", false], [31458, 0.005946, " more", false], [22187, 0.005343, " not", false], [45, 0.005328, ",", false], [4596, 0.005233, " in", false]]]}, "raw_delta": -0.4124999999999998, "tuned_delta": -0.3596450561018}, {"byte_start": 3914, "byte_end": 3919, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 673, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55% 11.55%", "model_b": "8.90% 8.90% 8.90% 8.90% 8.90%"}, "model_tokens": {"model_a": [[31277, " less", "normal", 0.039583150297403336]], "model_b": [[31277, " less", "normal", 0.08496444672346115]]}, "loss": {"model_a": 11.55283138211865, "model_b": 8.904133455486571}, "topk": {"model_a": [31277, 2, 0.039583150297403336, [[31458, 0.95006, " more", false], [31277, 0.039583, " less", false], [51816, 0.004917, " further", false], [4712, 0.001683, " on", false], [31466, 0.000427, " much", false], [51918, 0.000408, " heavier", false], [45501, 0.000404, " closer", false], [51919, 0.000279, " heavily", false], [57326, 0.000274, " stronger", false], [4811, 0.000272, " to", false]]], "model_b": [31277, 2, 0.08496444672346115, [[31458, 0.895586, " more", false], [31277, 0.084964, " less", false], [4712, 0.003001, " on", false], [51816, 0.002943, " further", false], [51867, 0.002841, " greater", false], [51919, 0.002179, " heavily", false], [46397, 0.000752, " larger", false], [22190, 0.000537, " now", false], [57326, 0.000467, " stronger", false], [31466, 0.000448, " much", false]]]}, "raw_delta": 0.14687499999999998, "tuned_delta": 0.1997299438981998}, {"byte_start": 3919, "byte_end": 3922, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 674, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.61% 0.61% 0.61%", "model_b": "0.22% 0.22% 0.22%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9029704332351685]], "model_b": [[4712, " on", "normal", 0.964267909526825]]}, "loss": {"model_a": 0.6134506501175808, "model_b": 0.2186702078170324}, "topk": {"model_a": [4712, 1, 0.9029704332351685, [[4712, 0.90297, " on", false], [32226, 0.059543, " than", false], [32350, 0.017674, " upon", false], [56003, 0.006608, " directly", false], [45, 0.002621, ",", false], [51919, 0.002262, " heavily", false], [275, 0.00211, " (", false], [61983, 0.001594, " explicitly", false], [4596, 0.000422, " in", false], [4706, 0.000366, " of", false]]], "model_b": [4712, 1, 0.964267909526825, [[4712, 0.964268, " on", false], [32350, 0.006241, " upon", false], [51919, 0.006062, " heavily", false], [4706, 0.002864, " of", false], [21265, 0.002845, " and", false], [61983, 0.002655, " explicitly", false], [45, 0.002384, ",", false], [275, 0.001801, " (", false], [32226, 0.001245, " than", false], [4715, 0.000918, " or", false]]]}, "raw_delta": 0.02189127604166667, "tuned_delta": 0.07474621993986649}, {"byte_start": 3922, "byte_end": 3928, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 675, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "1.03% 1.03% 1.03% 1.03% 1.03% 1.03%", "model_b": "1.64% 1.64% 1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.7104966640472412]], "model_b": [[38720, " human", "normal", 0.5795212388038635]]}, "loss": {"model_a": 1.0273097011538435, "model_b": 1.6436955218461495}, "topk": {"model_a": [38720, 1, 0.7104966640472412, [[38720, 0.710497, " human", false], [59943, 0.049574, " knowledge", false], [22590, 0.039722, " the", false], [45775, 0.021586, " domain", false], [21273, 0.015534, " any", false], [52964, 0.013597, " special", false], [39356, 0.011022, " prior", false], [65034, 0.010673, " understanding", false], [63875, 0.010271, " specialized", false], [56179, 0.009066, " explicit", false]]], "model_b": [38720, 1, 0.5795212388038635, [[38720, 0.579521, " human", false], [59943, 0.056108, " knowledge", false], [22590, 0.041026, " the", false], [52964, 0.021224, " special", false], [21273, 0.016007, " any", false], [52195, 0.013452, " massive", false], [46227, 0.013187, " humans", false], [332, 0.012524, " a", false], [63885, 0.010746, " statistical", false], [63370, 0.01038, " computation", false]]]}, "raw_delta": -0.03417968749999999, "tuned_delta": 0.01867525639819983}, {"byte_start": 3928, "byte_end": 3938, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 676, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "model_b": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.7867221236228943]], "model_b": [[59943, " knowledge", "normal", 0.6772744059562683]]}, "loss": {"model_a": 0.4314700744846143, "model_b": 0.7009187332443938}, "topk": {"model_a": [59943, 1, 0.7867221236228943, [[59943, 0.786722, " knowledge", false], [46, 0.079664, "-", false], [65034, 0.070141, " understanding", false], [38786, 0.032533, " input", false], [59683, 0.005825, " expertise", false], [45775, 0.002413, " domain", false], [46297, 0.001813, " inputs", false], [63637, 0.001588, " information", false], [52022, 0.001151, " insight", false], [62182, 0.00099, " linguistic", false]]], "model_b": [59943, 1, 0.6772744059562683, [[59943, 0.677274, " knowledge", false], [38786, 0.144451, " input", false], [46, 0.057818, "-", false], [65034, 0.054215, " understanding", false], [59683, 0.004882, " expertise", false], [46297, 0.003512, " inputs", false], [56537, 0.002679, " learning", false], [63637, 0.00235, " information", false], [45829, 0.002213, " effort", false], [52022, 0.001802, " insight", false]]]}, "raw_delta": -0.01494140625, "tuned_delta": 0.037913537648199824}, {"byte_start": 3938, "byte_end": 3939, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "37.48%", "model_b": "31.28%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1257818043231964]], "model_b": [[45, ",", "normal", 0.17764297127723694]]}, "loss": {"model_a": 37.47625789809221, "model_b": 31.277177644272445}, "topk": {"model_a": [45, 3, 0.1257818043231964, [[32226, 0.446972, " than", false], [21265, 0.161712, " and", false], [45, 0.125782, ",", false], [4706, 0.058024, " of", false], [47, 0.0563, ".", false], [5346, 0.035247, "---", false], [275, 0.02457, " (", false], [37598, 0.018296, " about", false], [4596, 0.013911, " in", false], [60, 0.006601, ";", false]]], "model_b": [45, 2, 0.17764297127723694, [[32226, 0.26249, " than", false], [45, 0.177643, ",", false], [21265, 0.172964, " and", false], [4706, 0.140372, " of", false], [275, 0.038526, " (", false], [47, 0.033814, ".", false], [5346, 0.030928, "---", false], [4811, 0.023756, " to", false], [4596, 0.02315, " in", false], [37598, 0.017371, " about", false]]]}, "raw_delta": 0.34375, "tuned_delta": 0.39660494389819984}, {"byte_start": 3939, "byte_end": 3943, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 677, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.00% 4.00% 4.00% 4.00%", "model_b": "4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.40972328186035156]], "model_b": [[21265, " and", "normal", 0.35582661628723145]]}, "loss": {"model_a": 3.997702322775814, "model_b": 4.684532237261526}, "topk": {"model_a": [21265, 1, 0.40972328186035156, [[21265, 0.409723, " and", false], [21400, 0.127221, " but", false], [55495, 0.046636, " although", false], [39690, 0.030423, " since", false], [4423, 0.025623, " as", false], [40186, 0.022763, " which", false], [52700, 0.021096, " relying", false], [4788, 0.01828, " so", false], [30788, 0.01597, " even", false], [4596, 0.015598, " in", false]]], "model_b": [21265, 1, 0.35582661628723145, [[21265, 0.355827, " and", false], [21400, 0.132695, " but", false], [4596, 0.041121, " in", false], [4715, 0.028359, " or", false], [55495, 0.0274, " although", false], [4423, 0.027256, " as", false], [40085, 0.014946, " using", false], [52700, 0.014195, " relying", false], [51018, 0.012339, " because", false], [39690, 0.011695, " since", false]]]}, "raw_delta": -0.0380859375, "tuned_delta": 0.014769006398199822}, {"byte_start": 3943, "byte_end": 3947, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 678, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "21.27% 21.27% 21.27% 21.27%", "model_b": "18.17% 18.17% 18.17% 18.17%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.008943989872932434]], "model_b": [[22681, " use", "normal", 0.017957450821995735]]}, "loss": {"model_a": 21.274116325608734, "model_b": 18.174576198698855}, "topk": {"model_a": [22681, 22, 0.008943989872932434, [[31458, 0.195224, " more", false], [21286, 0.112577, " are", false], [32232, 0.059744, " they", false], [30788, 0.043741, " even", false], [52028, 0.036818, " instead", false], [31059, 0.035388, " have", false], [22590, 0.026307, " the", false], [4596, 0.023552, " in", false], [31856, 0.020585, " rely", false], [4788, 0.019945, " so", false]]], "model_b": [22681, 14, 0.017957450821995735, [[21286, 0.114785, " are", false], [32232, 0.060546, " they", false], [22590, 0.054299, " the", false], [31458, 0.04869, " more", false], [4596, 0.039472, " in", false], [30788, 0.036586, " even", false], [52028, 0.028162, " instead", false], [31856, 0.027271, " rely", false], [31059, 0.025116, " have", false], [21413, 0.023981, " can", false]]]}, "raw_delta": 0.171875, "tuned_delta": 0.22472994389819984}, {"byte_start": 3947, "byte_end": 3952, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 679, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "10.09% 10.09% 10.09% 10.09% 10.09%", "model_b": "15.22% 15.22% 15.22% 15.22% 15.22%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.061103008687496185]], "model_b": [[30788, " even", "normal", 0.014800889417529106]]}, "loss": {"model_a": 10.087594231215798, "model_b": 15.215924259375784}, "topk": {"model_a": [30788, 5, 0.061103008687496185, [[52195, 0.319995, " massive", false], [31466, 0.069509, " much", false], [31458, 0.068267, " more", false], [63370, 0.063059, " computation", false], [30788, 0.061103, " even", false], [21660, 0.032965, " far", false], [332, 0.028429, " a", false], [22590, 0.02719, " the", false], [31581, 0.023844, " only", false], [59988, 0.020461, " massively", false]]], "model_b": [30788, 10, 0.014800889417529106, [[31466, 0.157229, " much", false], [52195, 0.142968, " massive", false], [31458, 0.081367, " more", false], [332, 0.062622, " a", false], [63370, 0.037222, " computation", false], [22590, 0.032648, " the", false], [21660, 0.032309, " far", false], [51832, 0.016491, " general", false], [63885, 0.016116, " statistical", false], [30788, 0.014801, " even", false]]]}, "raw_delta": -0.28437500000000004, "tuned_delta": -0.2315200561018002}, {"byte_start": 3952, "byte_end": 3957, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 680, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "1.15% 1.15% 1.15% 1.15% 1.15%", "model_b": "3.97% 3.97% 3.97% 3.97% 3.97%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.7271632552146912]], "model_b": [[31458, " more", "normal", 0.333651065826416]]}, "loss": {"model_a": 1.1482387288325244, "model_b": 3.9730468899481215}, "topk": {"model_a": [31458, 1, 0.7271632552146912, [[31458, 0.727163, " more", false], [31277, 0.176446, " less", false], [46397, 0.021372, " larger", false], [38475, 0.020194, " fewer", false], [51867, 0.016147, " greater", false], [52195, 0.006165, " massive", false], [45305, 0.004498, " bigger", false], [31466, 0.00359, " much", false], [52932, 0.00272, " smaller", false], [51918, 0.002416, " heavier", false]]], "model_b": [31458, 2, 0.333651065826416, [[31277, 0.52536, " less", false], [31458, 0.333651, " more", false], [51867, 0.054376, " greater", false], [46397, 0.020322, " larger", false], [38475, 0.018139, " fewer", false], [31466, 0.006156, " much", false], [52932, 0.005954, " smaller", false], [46198, 0.004241, " higher", false], [45305, 0.00228, " bigger", false], [38940, 0.002185, " lower", false]]]}, "raw_delta": -0.15664062499999998, "tuned_delta": -0.10378568110180016}, {"byte_start": 3957, "byte_end": 3969, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 681, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37%", "model_b": "0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.7805874347686768]], "model_b": [[63370, " computation", "normal", 0.7226740121841431]]}, "loss": {"model_a": 0.37129907770274634, "model_b": 0.48723831540439433}, "topk": {"model_a": [63370, 1, 0.7805874347686768, [[63370, 0.780587, " computation", false], [52195, 0.13006, " massive", false], [47202, 0.012025, " search", false], [4706, 0.010596, " of", false], [64862, 0.006968, " computational", false], [59346, 0.00659, " computing", false], [62577, 0.003879, " statistics", false], [51266, 0.00357, " compute", false], [64298, 0.003214, " computations", false], [63885, 0.003109, " statistical", false]]], "model_b": [63370, 1, 0.7226740121841431, [[63370, 0.722674, " computation", false], [59346, 0.056647, " computing", false], [52195, 0.033442, " massive", false], [64862, 0.027166, " computational", false], [4706, 0.019484, " of", false], [62577, 0.018056, " statistics", false], [63885, 0.012712, " statistical", false], [51832, 0.011212, " general", false], [56900, 0.009361, " powerful", false], [51266, 0.005974, " compute", false]]]}, "raw_delta": -0.006429036458333336, "tuned_delta": 0.046425907439866486}, {"byte_start": 3969, "byte_end": 3970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "15.08%", "model_b": "17.89%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.43417292833328247]], "model_b": [[45, ",", "normal", 0.37782999873161316]]}, "loss": {"model_a": 15.075036071788972, "model_b": 17.892799823525227}, "topk": {"model_a": [45, 1, 0.43417292833328247, [[45, 0.434173, ",", false], [47, 0.295492, ".", false], [32226, 0.170528, " than", false], [275, 0.021811, " (", false], [4811, 0.01946, " to", false], [5346, 0.01261, "---", false], [21265, 0.00815, " and", false], [22278, 0.006299, " per", false], [4596, 0.005896, " in", false], [21700, 0.00346, " for", false]]], "model_b": [45, 1, 0.37782999873161316, [[45, 0.37783, ",", false], [47, 0.264017, ".", false], [32226, 0.182433, " than", false], [4811, 0.041959, " to", false], [4596, 0.03092, " in", false], [275, 0.019181, " (", false], [5346, 0.012807, "---", false], [21265, 0.010205, " and", false], [21700, 0.008503, " for", false], [22278, 0.006718, " per", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 3970, "byte_end": 3979, "display": {"text": " together", "kind": "normal"}, "is_word": true, "word_id": 682, "word_key": " together", "bytes_hex": "20 74 6f 67 65 74 68 65 72", "compression": {"model_a": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "model_b": "20.79% 20.79% 20.79% 20.79% 20.79% 20.79% 20.79% 20.79% 20.79%"}, "model_tokens": {"model_a": [[57435, " together", "normal", 1.5857367543503642e-05]], "model_b": [[57435, " together", "normal", 3.148894029436633e-05]]}, "loss": {"model_a": 22.166408180325217, "model_b": 20.78883479058749}, "topk": {"model_a": [57435, 296, 1.5857367543503642e-05, [[32226, 0.474321, " than", false], [21265, 0.16578, " and", false], [21400, 0.109608, " but", false], [4788, 0.056407, " so", false], [4811, 0.045508, " to", false], [40186, 0.022539, " which", false], [4596, 0.013858, " in", false], [22797, 0.009187, " yet", false], [46500, 0.008861, " making", false], [4423, 0.007222, " as", false]]], "model_b": [57435, 293, 3.148894029436633e-05, [[32226, 0.428117, " than", false], [21265, 0.122553, " and", false], [4811, 0.090673, " to", false], [4596, 0.080044, " in", false], [21400, 0.066769, " but", false], [4423, 0.020523, " as", false], [4788, 0.0194, " so", false], [51018, 0.012016, " because", false], [21700, 0.010949, " for", false], [55794, 0.009873, " compared", false]]]}, "raw_delta": 0.07638888888888906, "tuned_delta": 0.1292438327870889}, {"byte_start": 3979, "byte_end": 3984, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 683, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "0.66% 0.66% 0.66% 0.66% 0.66%", "model_b": "0.62% 0.62% 0.62% 0.62% 0.62%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.830287516117096]], "model_b": [[32487, " with", "normal", 0.8440451622009277]]}, "loss": {"model_a": 0.6621744816580203, "model_b": 0.6199080253819764}, "topk": {"model_a": [32487, 1, 0.830287516117096, [[32487, 0.830288, " with", false], [47, 0.026157, ".", false], [4811, 0.01418, " to", false], [57581, 0.010707, " yielding", false], [45, 0.009215, ",", false], [38888, 0.007972, " lever", false], [4596, 0.007314, " in", false], [46500, 0.006793, " making", false], [56109, 0.006192, " enabling", false], [52107, 0.005627, " leading", false]]], "model_b": [32487, 1, 0.8440451622009277, [[32487, 0.844045, " with", false], [4811, 0.039822, " to", false], [45, 0.029923, ",", false], [47, 0.023023, ".", false], [46500, 0.00733, " making", false], [4596, 0.005967, " in", false], [55882, 0.003382, " creating", false], [21700, 0.00245, " for", false], [56109, 0.002026, " enabling", false], [57581, 0.001954, " yielding", false]]]}, "raw_delta": 0.0023437499999999986, "tuned_delta": 0.05519869389819982}, {"byte_start": 3984, "byte_end": 3993, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 684, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39%", "model_b": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.025194142013788223]], "model_b": [[56537, " learning", "normal", 0.02960561029613018]]}, "loss": {"model_a": 7.388802726775073, "model_b": 7.044409379340641}, "topk": {"model_a": [56537, 5, 0.025194142013788223, [[52195, 0.27652, " massive", false], [22590, 0.073703, " the", false], [332, 0.062368, " a", false], [38864, 0.025759, " large", false], [56537, 0.025194, " learning", false], [39193, 0.023206, " other", false], [63885, 0.020234, " statistical", false], [31458, 0.020036, " more", false], [31466, 0.017728, " much", false], [31370, 0.014724, " many", false]]], "model_b": [56537, 5, 0.02960561029613018, [[332, 0.107501, " a", false], [22590, 0.095537, " the", false], [63885, 0.064848, " statistical", false], [52195, 0.061392, " massive", false], [56537, 0.029606, " learning", false], [4419, 0.025034, " an", false], [22168, 0.023251, " new", false], [31458, 0.023142, " more", false], [52964, 0.019971, " special", false], [65014, 0.015532, " sophisticated", false]]]}, "raw_delta": 0.01909722222222221, "tuned_delta": 0.07195216612042203}, {"byte_start": 3993, "byte_end": 3996, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 685, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "33.81% 33.81% 33.81%", "model_b": "34.19% 34.19% 34.19%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.003603593911975622]], "model_b": [[4712, " on", "normal", 0.003417176427319646]]}, "loss": {"model_a": 33.81316502083508, "model_b": 34.18886685439991}, "topk": {"model_a": [4712, 19, 0.003603593911975622, [[47, 0.31283, ".", false], [4450, 0.168776, " by", false], [45, 0.142332, ",", false], [30917, 0.071529, " from", false], [4811, 0.036992, " to", false], [4596, 0.035516, " in", false], [61559, 0.02911, " algorithms", false], [21265, 0.021435, " and", false], [52224, 0.020844, " methods", false], [62633, 0.019162, " techniques", false]]], "model_b": [4712, 20, 0.003417176427319646, [[4450, 0.27146, " by", false], [47, 0.136912, ".", false], [4811, 0.114867, " to", false], [45, 0.107846, ",", false], [4596, 0.081427, " in", false], [4706, 0.033578, " of", false], [62633, 0.027864, " techniques", false], [21265, 0.026944, " and", false], [30917, 0.026737, " from", false], [52224, 0.017686, " methods", false]]]}, "raw_delta": -0.02083333333333326, "tuned_delta": 0.03202161056486656}, {"byte_start": 3996, "byte_end": 4001, "display": {"text": " huge", "kind": "normal"}, "is_word": true, "word_id": 686, "word_key": " huge", "bytes_hex": "20 68 75 67 65", "compression": {"model_a": "12.34% 12.34% 12.34% 12.34% 12.34%", "model_b": "10.37% 10.37% 10.37% 10.37% 10.37%"}, "model_tokens": {"model_a": [[31118, " huge", "normal", 0.03267655894160271]], "model_b": [[31118, " huge", "normal", 0.0562690831720829]]}, "loss": {"model_a": 12.341805232604802, "model_b": 10.369370606389422}, "topk": {"model_a": [31118, 5, 0.03267655894160271, [[52195, 0.54953, " massive", false], [22590, 0.080077, " the", false], [38864, 0.071143, " large", false], [332, 0.064951, " a", false], [31118, 0.032677, " huge", false], [31466, 0.020884, " much", false], [30579, 0.020855, " data", false], [32386, 0.020072, " very", false], [32373, 0.010383, " vast", false], [4419, 0.009547, " an", false]]], "model_b": [31118, 4, 0.0562690831720829, [[52195, 0.380914, " massive", false], [22590, 0.150684, " the", false], [332, 0.085207, " a", false], [31118, 0.056269, " huge", false], [38864, 0.054743, " large", false], [32373, 0.025763, " vast", false], [32386, 0.018616, " very", false], [39931, 0.015525, " their", false], [56125, 0.015343, " enormous", false], [30579, 0.014608, " data", false]]]}, "raw_delta": 0.109375, "tuned_delta": 0.16222994389819984}, {"byte_start": 4001, "byte_end": 4010, "display": {"text": " training", "kind": "normal"}, "is_word": true, "word_id": 687, "word_key": " training", "bytes_hex": "20 74 72 61 69 6e 69 6e 67", "compression": {"model_a": "8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95%", "model_b": "9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52%"}, "model_tokens": {"model_a": [[57453, " training", "normal", 0.011415001004934311]], "model_b": [[57453, " training", "normal", 0.008521446026861668]]}, "loss": {"model_a": 8.954227033295215, "model_b": 9.517779783642466}, "topk": {"model_a": [57453, 10, 0.011415001004934311, [[50897, 0.59368, " amounts", false], [55913, 0.090359, " datasets", false], [30579, 0.08765, " data", false], [59442, 0.031579, " databases", false], [45588, 0.026997, " corpor", false], [62426, 0.02394, " quantities", false], [45, 0.019075, ",", false], [53304, 0.0151, " volumes", false], [63344, 0.014619, " collections", false], [57453, 0.011415, " training", false]]], "model_b": [57453, 11, 0.008521446026861668, [[50897, 0.429333, " amounts", false], [55913, 0.140191, " datasets", false], [30579, 0.115541, " data", false], [45, 0.051261, ",", false], [31989, 0.027326, " sets", false], [53304, 0.026995, " volumes", false], [45588, 0.026567, " corpor", false], [62426, 0.016843, " quantities", false], [52333, 0.01119, " numbers", false], [63344, 0.008977, " collections", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 4010, "byte_end": 4015, "display": {"text": " sets", "kind": "normal"}, "is_word": true, "word_id": 688, "word_key": " sets", "bytes_hex": "20 73 65 74 73", "compression": {"model_a": "2.17% 2.17% 2.17% 2.17% 2.17%", "model_b": "4.03% 4.03% 4.03% 4.03% 4.03%"}, "model_tokens": {"model_a": [[31989, " sets", "normal", 0.5484493970870972]], "model_b": [[31989, " sets", "normal", 0.3260919749736786]]}, "loss": {"model_a": 2.1696780888369176, "model_b": 4.029402164982847}, "topk": {"model_a": [31989, 1, 0.5484493970870972, [[31989, 0.548449, " sets", false], [30579, 0.221441, " data", false], [55913, 0.135755, " datasets", false], [45588, 0.058894, " corpor", false], [59442, 0.01394, " databases", false], [63344, 0.00508, " collections", false], [52800, 0.004136, " samples", false], [56162, 0.001475, " examples", false], [45590, 0.001072, " corpus", false], [21265, 0.001021, " and", false]]], "model_b": [31989, 1, 0.3260919749736786, [[31989, 0.326092, " sets", false], [30579, 0.297504, " data", false], [45588, 0.242506, " corpor", false], [55913, 0.100733, " datasets", false], [52800, 0.004153, " samples", false], [59442, 0.002973, " databases", false], [63344, 0.002914, " collections", false], [22459, 0.002463, " set", false], [21265, 0.002292, " and", false], [45590, 0.001969, " corpus", false]]]}, "raw_delta": -0.103125, "tuned_delta": -0.05027005610180017}, {"byte_start": 4015, "byte_end": 4016, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "36.63%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1308417171239853]], "model_b": [[45, ",", "normal", 0.20532141625881195]]}, "loss": {"model_a": 36.63092877257133, "model_b": 28.600302080123}, "topk": {"model_a": [45, 2, 0.1308417171239853, [[47, 0.591865, ".", false], [45, 0.130842, ",", false], [4706, 0.130779, " of", false], [32227, 0.02692, " that", false], [275, 0.018613, " (", false], [21265, 0.013443, " and", false], [4811, 0.012805, " to", false], [5346, 0.011624, "---", false], [30917, 0.008141, " from", false], [4596, 0.004446, " in", false]]], "model_b": [45, 2, 0.20532141625881195, [[47, 0.431747, ".", false], [45, 0.205321, ",", false], [4706, 0.161081, " of", false], [4811, 0.058657, " to", false], [21265, 0.024008, " and", false], [275, 0.023831, " (", false], [32227, 0.014128, " that", false], [30917, 0.009313, " from", false], [4596, 0.008887, " in", false], [4450, 0.008351, " by", false]]]}, "raw_delta": 0.4453125, "tuned_delta": 0.49816744389819984}, {"byte_start": 4016, "byte_end": 4019, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 689, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "5.49% 5.49% 5.49%", "model_b": "5.85% 5.85% 5.85%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.40008628368377686]], "model_b": [[4811, " to", "normal", 0.3767208755016327]]}, "loss": {"model_a": 5.4946393158857, "model_b": 5.846859784852732}, "topk": {"model_a": [4811, 1, 0.40008628368377686, [[4811, 0.400086, " to", false], [21265, 0.171663, " and", false], [32226, 0.068177, " than", false], [4788, 0.049148, " so", false], [40186, 0.042888, " which", false], [21400, 0.034776, " but", false], [4596, 0.024463, " in", false], [4423, 0.01694, " as", false], [21700, 0.014047, " for", false], [30322, 0.007939, " both", false]]], "model_b": [4811, 1, 0.3767208755016327, [[4811, 0.376721, " to", false], [32226, 0.172773, " than", false], [21265, 0.107117, " and", false], [4596, 0.055808, " in", false], [4423, 0.032243, " as", false], [21400, 0.023575, " but", false], [40186, 0.022079, " which", false], [21700, 0.018236, " for", false], [4788, 0.011444, " so", false], [55794, 0.009941, " compared", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03332369389819982}, {"byte_start": 4019, "byte_end": 4027, "display": {"text": " produce", "kind": "normal"}, "is_word": true, "word_id": 690, "word_key": " produce", "bytes_hex": "20 70 72 6f 64 75 63 65", "compression": {"model_a": "7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15%", "model_b": "7.43% 7.43% 7.43% 7.43% 7.43% 7.43% 7.43% 7.43%"}, "model_tokens": {"model_a": [[52573, " produce", "normal", 0.04165380820631981]], "model_b": [[52573, " produce", "normal", 0.03653605282306671]]}, "loss": {"model_a": 7.15007552003075, "model_b": 7.431851895204376}, "topk": {"model_a": [52573, 4, 0.04165380820631981, [[50848, 0.167405, " achieve", false], [31358, 0.064706, " make", false], [51982, 0.042387, " improve", false], [52573, 0.041654, " produce", false], [22249, 0.03531, " out", false], [4491, 0.026123, " do", false], [45851, 0.022029, " enable", false], [30256, 0.021662, " beat", false], [39740, 0.021614, " solve", false], [52446, 0.017599, " perform", false]]], "model_b": [52573, 6, 0.03653605282306671, [[50848, 0.143961, " achieve", false], [52446, 0.05019, " perform", false], [4491, 0.049212, " do", false], [31358, 0.045967, " make", false], [51982, 0.043425, " improve", false], [52573, 0.036536, " produce", false], [56540, 0.03549, " leverage", false], [21751, 0.026873, " get", false], [38877, 0.018323, " learn", false], [22770, 0.017549, " win", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 4027, "byte_end": 4040, "display": {"text": " dramatically", "kind": "normal"}, "is_word": true, "word_id": 691, "word_key": " dramatically", "bytes_hex": "20 64 72 61 6d 61 74 69 63 61 6c 6c 79", "compression": {"model_a": "7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63%", "model_b": "9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67%"}, "model_tokens": {"model_a": [[64374, " dramatically", "normal", 0.004101419355720282]], "model_b": [[64374, " dramatically", "normal", 0.0009459151769988239]]}, "loss": {"model_a": 7.6296372354704785, "model_b": 9.66709717903362}, "topk": {"model_a": [64374, 46, 0.004101419355720282, [[62084, 0.066708, " impressive", false], [45301, 0.066277, " better", false], [22590, 0.055195, " the", false], [52738, 0.054471, " results", false], [39802, 0.047672, " state", false], [32386, 0.043973, " very", false], [30992, 0.039737, " good", false], [31466, 0.029783, " much", false], [30789, 0.024371, " ever", false], [62477, 0.021786, " remarkable", false]]], "model_b": [64374, 107, 0.0009459151769988239, [[52738, 0.117115, " results", false], [22590, 0.108243, " the", false], [39802, 0.04961, " state", false], [332, 0.049342, " a", false], [32386, 0.040836, " very", false], [45301, 0.033994, " better", false], [30992, 0.026295, " good", false], [63750, 0.024422, " performance", false], [62084, 0.022814, " impressive", false], [46199, 0.019128, " highly", false]]]}, "raw_delta": -0.11298076923076918, "tuned_delta": -0.060125825332569355}, {"byte_start": 4040, "byte_end": 4047, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 692, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"model_a": "1.43% 1.43% 1.43% 1.43% 1.43% 1.43% 1.43%", "model_b": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18%"}, "model_tokens": {"model_a": [[45301, " better", "normal", 0.5748533010482788]], "model_b": [[45301, " better", "normal", 0.634577214717865]]}, "loss": {"model_a": 1.429008759809101, "model_b": 1.177422710546936}, "topk": {"model_a": [45301, 1, 0.5748533010482788, [[45301, 0.574853, " better", false], [56418, 0.2252, " improved", false], [31458, 0.080288, " more", false], [57350, 0.043212, " superior", false], [46198, 0.018633, " higher", false], [51867, 0.008587, " greater", false], [62603, 0.00544, " successful", false], [59593, 0.004992, " effective", false], [30992, 0.004073, " good", false], [57326, 0.003806, " stronger", false]]], "model_b": [45301, 1, 0.634577214717865, [[45301, 0.634577, " better", false], [56418, 0.155273, " improved", false], [57350, 0.066409, " superior", false], [31458, 0.063876, " more", false], [46198, 0.011872, " higher", false], [51867, 0.00997, " greater", false], [59593, 0.009943, " effective", false], [62603, 0.007484, " successful", false], [45961, 0.00343, " faster", false], [56120, 0.0033, " enhanced", false]]]}, "raw_delta": 0.01395089285714285, "tuned_delta": 0.06680583675534267}, {"byte_start": 4047, "byte_end": 4054, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 693, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"model_a": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "model_b": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%"}, "model_tokens": {"model_a": [[47350, " speech", "normal", 0.07323822379112244]], "model_b": [[47350, " speech", "normal", 0.017386874184012413]]}, "loss": {"model_a": 6.762633004167015, "model_b": 10.465979649306096}, "topk": {"model_a": [47350, 3, 0.07323822379112244, [[52738, 0.441623, " results", false], [63750, 0.364011, " performance", false], [47350, 0.073238, " speech", false], [53087, 0.032595, " systems", false], [63821, 0.013132, " recognition", false], [52224, 0.006591, " methods", false], [55434, 0.005165, " accuracy", false], [32497, 0.00488, " word", false], [46587, 0.004404, " models", false], [56529, 0.003663, " language", false]]], "model_b": [47350, 3, 0.017386874184012413, [[52738, 0.645166, " results", false], [63750, 0.263543, " performance", false], [47350, 0.017387, " speech", false], [53087, 0.006291, " systems", false], [64510, 0.005722, " performances", false], [52224, 0.003855, " methods", false], [56782, 0.00335, " outcomes", false], [21265, 0.002863, " and", false], [55434, 0.002579, " accuracy", false], [46587, 0.002422, " models", false]]]}, "raw_delta": -0.20535714285714285, "tuned_delta": -0.152502198958943}, {"byte_start": 4054, "byte_end": 4066, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 694, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"model_a": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "model_b": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%"}, "model_tokens": {"model_a": [[63821, " recognition", "normal", 0.8591951131820679]], "model_b": [[63821, " recognition", "normal", 0.7054373621940613]]}, "loss": {"model_a": 0.22747571954120818, "model_b": 0.5253955328758227}, "topk": {"model_a": [63821, 1, 0.8591951131820679, [[63821, 0.859195, " recognition", false], [46, 0.073035, "-", false], [65034, 0.016651, " understanding", false], [60335, 0.014778, " recognize", false], [53087, 0.010334, " systems", false], [62378, 0.005226, " processing", false], [21265, 0.003966, " and", false], [46587, 0.002291, " models", false], [64591, 0.001432, " technologies", false], [62634, 0.001033, " technology", false]]], "model_b": [63821, 1, 0.7054373621940613, [[63821, 0.705437, " recognition", false], [46, 0.164003, "-", false], [60615, 0.014152, " synthesis", false], [65034, 0.013916, " understanding", false], [63750, 0.012278, " performance", false], [60335, 0.008374, " recognize", false], [52738, 0.0074, " results", false], [52621, 0.006098, " quality", false], [53087, 0.005171, " systems", false], [62378, 0.004345, " processing", false]]]}, "raw_delta": -0.01652018229166666, "tuned_delta": 0.036334761606533164}, {"byte_start": 4066, "byte_end": 4074, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 695, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"model_a": "2.38% 2.38% 2.38% 2.38% 2.38% 2.38% 2.38% 2.38%", "model_b": "3.45% 3.45% 3.45% 3.45% 3.45% 3.45% 3.45% 3.45%"}, "model_tokens": {"model_a": [[53087, " systems", "normal", 0.35357731580734253]], "model_b": [[53087, " systems", "normal", 0.2196575552225113]]}, "loss": {"model_a": 2.3774881655274664, "model_b": 3.451760595876914}, "topk": {"model_a": [53087, 1, 0.35357731580734253, [[53087, 0.353577, " systems", false], [47, 0.223317, ".", false], [63750, 0.130777, " performance", false], [52738, 0.077695, " results", false], [32226, 0.076461, " than", false], [45, 0.017904, ",", false], [21265, 0.017826, " and", false], [55434, 0.014072, " accuracy", false], [51616, 0.012537, " engines", false], [46587, 0.007277, " models", false]]], "model_b": [53087, 2, 0.2196575552225113, [[52738, 0.244378, " results", false], [53087, 0.219658, " systems", false], [63750, 0.163005, " performance", false], [47, 0.147746, ".", false], [32226, 0.101981, " than", false], [55434, 0.015612, " accuracy", false], [45, 0.009534, ",", false], [21265, 0.009042, " and", false], [64510, 0.007704, " performances", false], [4596, 0.005518, " in", false]]]}, "raw_delta": -0.0595703125, "tuned_delta": -0.0067153686018001785}, {"byte_start": 4074, "byte_end": 4075, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.99%", "model_b": "9.44%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7156290411949158]], "model_b": [[47, ".", "normal", 0.5890799164772034]]}, "loss": {"model_a": 5.987747972439545, "model_b": 9.439508568316459}, "topk": {"model_a": [47, 1, 0.7156290411949158, [[47, 0.715629, ".", false], [32226, 0.194009, " than", false], [45, 0.027391, ",", false], [275, 0.00763, " (", false], [32227, 0.007084, " that", false], [5346, 0.00673, "---", false], [21265, 0.0064, " and", false], [4596, 0.005224, " in", false], [21700, 0.004296, " for", false], [39971, 0.002936, " today", false]]], "model_b": [47, 1, 0.5890799164772034, [[47, 0.58908, ".", false], [32226, 0.299006, " than", false], [45, 0.029033, ",", false], [32227, 0.014879, " that", false], [275, 0.00717, " (", false], [39971, 0.006919, " today", false], [55794, 0.006742, " compared", false], [4596, 0.006224, " in", false], [21265, 0.005294, " and", false], [32487, 0.004645, " with", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13855130610180016}, {"byte_start": 4075, "byte_end": 4078, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 696, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"model_a": "31.37% 31.37% 31.37%", "model_b": "30.06% 30.06% 30.06%"}, "model_tokens": {"model_a": [[3641, " As", "normal", 0.005346032790839672]], "model_b": [[3641, " As", "normal", 0.006902337074279785]]}, "loss": {"model_a": 31.371103102663653, "model_b": 30.056146685186736}, "topk": {"model_a": [3641, 14, 0.005346032790839672, [[261, 0.673398, "\n\n", false], [20996, 0.042097, " The", false], [267, 0.026973, "  ", false], [29894, 0.017037, " This", false], [3913, 0.01496, " In", false], [3918, 0.013152, " It", false], [36251, 0.010115, " Again", false], [37453, 0.010021, " These", false], [275, 0.009955, " (", false], [3336, 0.008028, " \n\n", false]]], "model_b": [3641, 15, 0.006902337074279785, [[261, 0.44807, "\n\n", false], [20996, 0.068397, " The", false], [267, 0.042149, "  ", false], [29894, 0.039814, " This", false], [28753, 0.03064, " Deep", false], [3913, 0.029087, " In", false], [11, 0.028455, "\n", false], [37453, 0.018565, " These", false], [3918, 0.015061, " It", false], [3336, 0.012591, " \n\n", false]]]}, "raw_delta": 0.07291666666666652, "tuned_delta": 0.12577161056486635}, {"byte_start": 4078, "byte_end": 4081, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 697, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "7.94% 7.94% 7.94%", "model_b": "15.87% 15.87% 15.87%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.2690526247024536]], "model_b": [[4596, " in", "normal", 0.07181155681610107]]}, "loss": {"model_a": 7.936701234057122, "model_b": 15.873402468114245}, "topk": {"model_a": [4596, 1, 0.2690526247024536, [[4596, 0.269053, " in", false], [32487, 0.263461, " with", false], [332, 0.055132, " a", false], [22590, 0.037816, " the", false], [45150, 0.025136, " always", false], [45285, 0.016494, " before", false], [47350, 0.015808, " speech", false], [21700, 0.015373, " for", false], [31458, 0.014574, " more", false], [4858, 0.013873, " we", false]]], "model_b": [4596, 3, 0.07181155681610107, [[332, 0.247055, " a", false], [32487, 0.126972, " with", false], [4596, 0.071812, " in", false], [22590, 0.057193, " the", false], [4858, 0.03139, " we", false], [22226, 0.027179, " one", false], [32139, 0.023455, " such", false], [21700, 0.022298, " for", false], [4419, 0.019969, " an", false], [30597, 0.018148, " deep", false]]]}, "raw_delta": -0.4401041666666667, "tuned_delta": -0.38724922276846685}, {"byte_start": 4081, "byte_end": 4085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 698, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.71% 7.71% 7.71% 7.71%", "model_b": "9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.17879702150821686]], "model_b": [[22590, " the", "normal", 0.1295093446969986]]}, "loss": {"model_a": 7.713628270378002, "model_b": 9.157732193142833}, "topk": {"model_a": [22590, 3, 0.17879702150821686, [[55809, 0.350383, " computer", false], [38013, 0.20892, " chess", false], [22590, 0.178797, " the", false], [3851, 0.050429, " Go", false], [39193, 0.050043, " other", false], [31370, 0.022637, " many", false], [21256, 0.020314, " all", false], [30322, 0.011292, " both", false], [47202, 0.010976, " search", false], [47350, 0.00983, " speech", false]]], "model_b": [22590, 3, 0.1295093446969986, [[55809, 0.297924, " computer", false], [38013, 0.187279, " chess", false], [22590, 0.129509, " the", false], [47350, 0.088074, " speech", false], [21256, 0.046335, " all", false], [3609, 0.045676, " AI", false], [39193, 0.043317, " other", false], [3851, 0.026509, " Go", false], [31370, 0.024766, " many", false], [52299, 0.019157, " natural", false]]]}, "raw_delta": -0.080078125, "tuned_delta": -0.02722318110180018}, {"byte_start": 4085, "byte_end": 4091, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 699, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"model_a": "15.59% 15.59% 15.59% 15.59% 15.59% 15.59%", "model_b": "18.69% 18.69% 18.69% 18.69% 18.69% 18.69%"}, "model_tokens": {"model_a": [[38576, " games", "normal", 0.005593450274318457]], "model_b": [[38576, " games", "normal", 0.0019957490731030703]]}, "loss": {"model_a": 15.591626092940619, "model_b": 18.691166219850498}, "topk": {"model_a": [38576, 17, 0.005593450274318457, [[39193, 0.339949, " other", false], [51551, 0.095615, " earlier", false], [38013, 0.090456, " chess", false], [30405, 0.089105, " case", false], [56926, 0.064375, " previous", false], [22638, 0.046427, " two", false], [55809, 0.041956, " computer", false], [37970, 0.033242, " cases", false], [3851, 0.014962, " Go", false], [56162, 0.012521, " examples", false]]], "model_b": [38576, 32, 0.0019957490731030703, [[30405, 0.259445, " case", false], [39193, 0.129216, " other", false], [38013, 0.111361, " chess", false], [55809, 0.092444, " computer", false], [51551, 0.038924, " earlier", false], [56926, 0.024809, " previous", false], [38328, 0.022775, " early", false], [47350, 0.019985, " speech", false], [30941, 0.017503, " game", false], [31636, 0.016457, " past", false]]]}, "raw_delta": -0.1718749999999999, "tuned_delta": -0.11902005610180007}, {"byte_start": 4091, "byte_end": 4092, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "13.38%", "model_b": "38.32%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.47374916076660156]], "model_b": [[45, ",", "normal", 0.1203915923833847]]}, "loss": {"model_a": 13.384377820747218, "model_b": 38.321587023613084}, "topk": {"model_a": [45, 1, 0.47374916076660156, [[45, 0.473749, ",", false], [4706, 0.155646, " of", false], [37599, 0.070401, " above", false], [21265, 0.054118, " and", false], [60003, 0.05406, " mentioned", false], [59546, 0.022803, " discussed", false], [56162, 0.019851, " examples", false], [31198, 0.014238, " just", false], [37970, 0.012037, " cases", false], [59488, 0.009612, " described", false]]], "model_b": [45, 3, 0.1203915923833847, [[4706, 0.350845, " of", false], [60003, 0.162926, " mentioned", false], [45, 0.120392, ",", false], [21265, 0.075145, " and", false], [59546, 0.049839, " discussed", false], [37599, 0.046561, " above", false], [32227, 0.016869, " that", false], [31198, 0.013935, " just", false], [38037, 0.012636, " cited", false], [59488, 0.011999, " described", false]]]}, "raw_delta": -1.3828125, "tuned_delta": -1.3299575561018002}, {"byte_start": 4092, "byte_end": 4104, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 700, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80%", "model_b": "8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.020761338993906975]], "model_b": [[63843, " researchers", "normal", 0.003046129597350955]]}, "loss": {"model_a": 5.799897055657128, "model_b": 8.688104901186788}, "topk": {"model_a": [63843, 9, 0.020761338993906975, [[22590, 0.324049, " the", false], [39934, 0.057332, " there", false], [4601, 0.055698, " it", false], [32234, 0.04643, " this", false], [39936, 0.046105, " these", false], [38720, 0.040781, " human", false], [30597, 0.034473, " deep", false], [56537, 0.030556, " learning", false], [63843, 0.020761, " researchers", false], [47202, 0.01898, " search", false]]], "model_b": [63843, 41, 0.003046129597350955, [[22590, 0.288835, " the", false], [4601, 0.059603, " it", false], [39936, 0.053484, " these", false], [32234, 0.052184, " this", false], [39934, 0.049046, " there", false], [56537, 0.023604, " learning", false], [30597, 0.022386, " deep", false], [332, 0.015879, " a", false], [47350, 0.014626, " speech", false], [38720, 0.014184, " human", false]]]}, "raw_delta": -0.16015625, "tuned_delta": -0.10730130610180018}, {"byte_start": 4104, "byte_end": 4111, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 701, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"model_a": "22.86% 22.86% 22.86% 22.86% 22.86% 22.86% 22.86%", "model_b": "16.50% 16.50% 16.50% 16.50% 16.50% 16.50% 16.50%"}, "model_tokens": {"model_a": [[45150, " always", "normal", 0.00014360311615746468]], "model_b": [[45150, " always", "normal", 0.0016627619042992592]]}, "loss": {"model_a": 22.864140156945616, "model_b": 16.50404483159807}, "topk": {"model_a": [45150, 271, 0.00014360311615746468, [[22762, 0.231798, " who", false], [40, 0.215984, "'", false], [32462, 0.046399, " were", false], [4596, 0.037299, " in", false], [59868, 0.035655, " initially", false], [31059, 0.028743, " have", false], [21286, 0.027631, " are", false], [32487, 0.024042, " with", false], [4424, 0.018055, " at", false], [21795, 0.014186, " had", false]]], "model_b": [45150, 74, 0.0016627619042992592, [[40, 0.22481, "'", false], [22762, 0.068135, " who", false], [32462, 0.063518, " were", false], [4596, 0.051735, " in", false], [31059, 0.050205, " have", false], [59868, 0.038417, " initially", false], [21286, 0.027726, " are", false], [32216, 0.016775, " tend", false], [21795, 0.012691, " had", false], [52834, 0.012073, " seeking", false]]]}, "raw_delta": 0.35267857142857145, "tuned_delta": 0.4055335153267713}, {"byte_start": 4111, "byte_end": 4117, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 702, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"model_a": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "model_b": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"model_a": [[40013, " tried", "normal", 0.009544571861624718]], "model_b": [[40013, " tried", "normal", 0.03359391167759895]]}, "loss": {"model_a": 13.994893300290073, "model_b": 10.190912235446126}, "topk": {"model_a": [40013, 19, 0.009544571861624718, [[21795, 0.049614, " had", false], [31059, 0.048313, " have", false], [47763, 0.038581, " wanted", false], [31967, 0.031986, " seem", false], [32216, 0.02642, " tend", false], [32435, 0.026115, " want", false], [55800, 0.024827, " complain", false], [47211, 0.024019, " seemed", false], [22441, 0.020016, " say", false], [38709, 0.016603, " hoped", false]]], "model_b": [40013, 7, 0.03359391167759895, [[47763, 0.082152, " wanted", false], [31966, 0.055662, " seek", false], [32435, 0.055518, " want", false], [47340, 0.044867, " sought", false], [31059, 0.035062, " have", false], [21795, 0.034093, " had", false], [40013, 0.033594, " tried", false], [22626, 0.029119, " try", false], [31967, 0.024356, " seem", false], [32216, 0.02294, " tend", false]]]}, "raw_delta": 0.2109375, "tuned_delta": 0.26379244389819984}, {"byte_start": 4117, "byte_end": 4120, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 703, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.38% 1.38% 1.38%", "model_b": "0.33% 0.33% 0.33%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7926995158195496]], "model_b": [[4811, " to", "normal", 0.9470464587211609]]}, "loss": {"model_a": 1.3795301701208755, "model_b": 0.32727151908186725}, "topk": {"model_a": [4811, 1, 0.7926995158195496, [[4811, 0.7927, " to", false], [22590, 0.032338, " the", false], [52224, 0.022774, " methods", false], [38720, 0.015733, " human", false], [39931, 0.012373, " their", false], [22249, 0.01072, " out", false], [46162, 0.007815, " harder", false], [21700, 0.007753, " for", false], [45, 0.007359, ",", false], [31048, 0.007181, " hard", false]]], "model_b": [4811, 1, 0.9470464587211609, [[4811, 0.947046, " to", false], [38499, 0.007449, " first", false], [22590, 0.0037, " the", false], [39931, 0.002808, " their", false], [31048, 0.002362, " hard", false], [21700, 0.00212, " for", false], [46162, 0.002045, " harder", false], [45, 0.002005, ",", false], [332, 0.001871, " a", false], [22187, 0.001732, " not", false]]]}, "raw_delta": 0.058349609375, "tuned_delta": 0.11120455327319982}, {"byte_start": 4120, "byte_end": 4125, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 704, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"model_a": "13.36% 13.36% 13.36% 13.36% 13.36%", "model_b": "12.29% 12.29% 12.29% 12.29% 12.29%"}, "model_tokens": {"model_a": [[31358, " make", "normal", 0.024724485352635384]], "model_b": [[31358, " make", "normal", 0.033341385424137115]]}, "loss": {"model_a": 13.356200183229856, "model_b": 12.285449957570078}, "topk": {"model_a": [31358, 10, 0.024724485352635384, [[22681, 0.070932, " use", false], [30858, 0.060071, " find", false], [32187, 0.036052, " take", false], [56540, 0.033684, " leverage", false], [51982, 0.032439, " improve", false], [37786, 0.030173, " avoid", false], [21751, 0.029647, " get", false], [37730, 0.026848, " apply", false], [63623, 0.025887, " incorporate", false], [31358, 0.024724, " make", false]]], "model_b": [31358, 7, 0.033341385424137115, [[22681, 0.073532, " use", false], [37786, 0.051485, " avoid", false], [30858, 0.049588, " find", false], [56540, 0.041972, " leverage", false], [51982, 0.036383, " improve", false], [32187, 0.033753, " take", false], [31358, 0.033341, " make", false], [31205, 0.029369, " keep", false], [62683, 0.029205, " understand", false], [22770, 0.028724, " win", false]]]}, "raw_delta": 0.059374999999999956, "tuned_delta": 0.11222994389819978}, {"byte_start": 4125, "byte_end": 4133, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 705, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"model_a": "12.82% 12.82% 12.82% 12.82% 12.82% 12.82% 12.82% 12.82%", "model_b": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%"}, "model_tokens": {"model_a": [[53087, " systems", "normal", 0.0033729735296219587]], "model_b": [[53087, " systems", "normal", 0.0024756642524152994]]}, "loss": {"model_a": 12.820825070399966, "model_b": 13.52526600833403}, "topk": {"model_a": [53087, 27, 0.0033729735296219587, [[39931, 0.301869, " their", false], [22590, 0.167614, " the", false], [22681, 0.092129, " use", false], [38720, 0.046806, " human", false], [332, 0.04457, " a", false], [32157, 0.023781, " sure", false], [39631, 0.023422, " sense", false], [56950, 0.020668, " progress", false], [4601, 0.018862, " it", false], [52224, 0.018507, " methods", false]]], "model_b": [53087, 36, 0.0024756642524152994, [[22590, 0.232018, " the", false], [39931, 0.16381, " their", false], [22681, 0.091882, " use", false], [32157, 0.054111, " sure", false], [332, 0.045162, " a", false], [47350, 0.028474, " speech", false], [38720, 0.026343, " human", false], [56950, 0.018061, " progress", false], [39936, 0.01606, " these", false], [4601, 0.010833, " it", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.013792443898199822}, {"byte_start": 4133, "byte_end": 4138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 706, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.96% 1.96% 1.96% 1.96% 1.96%", "model_b": "3.14% 3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.5841537714004517]], "model_b": [[32227, " that", "normal", 0.4214909076690674]]}, "loss": {"model_a": 1.9583458074566982, "model_b": 3.141806583185926}, "topk": {"model_a": [32227, 1, 0.5841537714004517, [[32227, 0.584154, " that", false], [37810, 0.09359, " based", false], [32499, 0.04095, " work", false], [32487, 0.028981, " with", false], [45301, 0.027356, " better", false], [31458, 0.027223, " more", false], [40085, 0.017473, " using", false], [21700, 0.014944, " for", false], [4491, 0.008561, " do", false], [4423, 0.008094, " as", false]]], "model_b": [32227, 1, 0.4214909076690674, [[32227, 0.421491, " that", false], [45301, 0.078759, " better", false], [31458, 0.074745, " more", false], [4423, 0.062175, " as", false], [37810, 0.056844, " based", false], [32499, 0.040483, " work", false], [52446, 0.016888, " perform", false], [31277, 0.016482, " less", false], [4404, 0.01432, " ``", false], [32487, 0.009387, " with", false]]]}, "raw_delta": -0.065625, "tuned_delta": -0.012770056101800181}, {"byte_start": 4138, "byte_end": 4145, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 707, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"model_a": "7.57% 7.57% 7.57% 7.57% 7.57% 7.57% 7.57%", "model_b": "8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41%"}, "model_tokens": {"model_a": [[47812, " worked", "normal", 0.05263246223330498]], "model_b": [[47812, " worked", "normal", 0.038121297955513]]}, "loss": {"model_a": 7.567708361805946, "model_b": 8.413037487326823}, "topk": {"model_a": [47812, 6, 0.05263246223330498, [[32462, 0.132947, " were", false], [32354, 0.102237, " used", false], [40219, 0.082876, " would", false], [38128, 0.079171, " could", false], [21532, 0.070121, " did", false], [47812, 0.052632, " worked", false], [47054, 0.040616, " relied", false], [32272, 0.033577, " took", false], [56540, 0.024957, " leverage", false], [31351, 0.020888, " made", false]]], "model_b": [47812, 7, 0.038121297955513, [[32462, 0.153475, " were", false], [56540, 0.116962, " leverage", false], [32354, 0.094379, " used", false], [32272, 0.072094, " took", false], [47054, 0.069622, " relied", false], [21532, 0.043557, " did", false], [47812, 0.038121, " worked", false], [38128, 0.031496, " could", false], [21286, 0.017233, " are", false], [40219, 0.016985, " would", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.0059799438981998215}, {"byte_start": 4145, "byte_end": 4149, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 708, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "19.58% 19.58% 19.58% 19.58%", "model_b": "18.88% 18.88% 18.88% 18.88%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.013219756074249744]], "model_b": [[22590, " the", "normal", 0.015179893001914024]]}, "loss": {"model_a": 19.58345807456698, "model_b": 18.879017136632918}, "topk": {"model_a": [22590, 13, 0.013219756074249744, [[32458, 0.281611, " well", false], [32487, 0.123935, " with", false], [4596, 0.089131, " in", false], [4450, 0.06794, " by", false], [45301, 0.066695, " better", false], [4712, 0.058427, " on", false], [53356, 0.037894, " without", false], [21700, 0.035453, " for", false], [4423, 0.028863, " as", false], [37810, 0.028259, " based", false]]], "model_b": [22590, 11, 0.015179893001914024, [[32458, 0.232775, " well", false], [45301, 0.153954, " better", false], [30273, 0.124309, " best", false], [32487, 0.100763, " with", false], [4450, 0.060807, " by", false], [21700, 0.046193, " for", false], [4712, 0.04063, " on", false], [4596, 0.036245, " in", false], [4424, 0.018792, " at", false], [4423, 0.017535, " as", false]]]}, "raw_delta": 0.0390625, "tuned_delta": 0.09191744389819982}, {"byte_start": 4149, "byte_end": 4153, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 709, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"model_a": "1.11% 1.11% 1.11% 1.11%", "model_b": "7.82% 7.82% 7.82% 7.82%"}, "model_tokens": {"model_a": [[22752, " way", "normal", 0.7833326458930969]], "model_b": [[22752, " way", "normal", 0.17645211517810822]]}, "loss": {"model_a": 1.105091721384063, "model_b": 7.819294411068111}, "topk": {"model_a": [22752, 1, 0.7833326458930969, [[22752, 0.783333, " way", false], [30273, 0.075162, " best", false], [31937, 0.030507, " same", false], [39523, 0.020113, " right", false], [4404, 0.019646, " ``", false], [38720, 0.016765, " human", false], [38499, 0.013407, " first", false], [31461, 0.008686, " most", false], [22221, 0.003472, " old", false], [30724, 0.002815, " easy", false]]], "model_b": [22752, 2, 0.17645211517810822, [[30273, 0.670881, " best", false], [22752, 0.176452, " way", false], [31937, 0.077818, " same", false], [31461, 0.015661, " most", false], [45301, 0.011021, " better", false], [38879, 0.01096, " least", false], [51900, 0.006811, " hardest", false], [39523, 0.003738, " right", false], [38720, 0.003564, " human", false], [51718, 0.003342, " fastest", false]]]}, "raw_delta": -0.372314453125, "tuned_delta": -0.31945950922680016}, {"byte_start": 4153, "byte_end": 4157, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 710, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "16.84% 16.84% 16.84% 16.84%", "model_b": "12.54% 12.54% 12.54% 12.54%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.02356562949717045]], "model_b": [[22590, " the", "normal", 0.06187152490019798]]}, "loss": {"model_a": 16.83613841662413, "model_b": 12.539048695226342}, "topk": {"model_a": [22590, 6, 0.02356562949717045, [[32232, 0.427483, " they", false], [46227, 0.21276, " humans", false], [46787, 0.138171, " people", false], [38720, 0.06241, " human", false], [32227, 0.059323, " that", false], [22590, 0.023566, " the", false], [51685, 0.013171, " experts", false], [332, 0.010389, " a", false], [39931, 0.009824, " their", false], [4404, 0.006745, " ``", false]]], "model_b": [22590, 5, 0.06187152490019798, [[32232, 0.447123, " they", false], [32227, 0.132923, " that", false], [46227, 0.114206, " humans", false], [46787, 0.080238, " people", false], [22590, 0.061872, " the", false], [38720, 0.049673, " human", false], [332, 0.026189, " a", false], [4858, 0.01444, " we", false], [39931, 0.011631, " their", false], [4404, 0.006671, " ``", false]]]}, "raw_delta": 0.23828125, "tuned_delta": 0.29113619389819984}, {"byte_start": 4157, "byte_end": 4169, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 711, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92%", "model_b": "8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.00260747317224741]], "model_b": [[63843, " researchers", "normal", 0.0026341089978814125]]}, "loss": {"model_a": 8.922918547164814, "model_b": 8.922918547164814}, "topk": {"model_a": [63843, 21, 0.00260747317224741, [[38720, 0.542834, " human", false], [51685, 0.124336, " experts", false], [46227, 0.071135, " humans", false], [40213, 0.040672, " world", false], [45775, 0.017635, " domain", false], [53087, 0.012043, " systems", false], [4404, 0.010215, " ``", false], [47487, 0.009846, " system", false], [30273, 0.009263, " best", false], [45929, 0.008288, " expert", false]]], "model_b": [63843, 25, 0.0026341089978814125, [[38720, 0.467195, " human", false], [46787, 0.072369, " people", false], [30273, 0.063728, " best", false], [46227, 0.049523, " humans", false], [40213, 0.03959, " world", false], [51685, 0.02263, " experts", false], [52489, 0.014436, " players", false], [46795, 0.011772, " person", false], [51832, 0.010178, " general", false], [30941, 0.009501, " game", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 4169, "byte_end": 4177, "display": {"text": " thought", "kind": "normal"}, "is_word": true, "word_id": 712, "word_key": " thought", "bytes_hex": "20 74 68 6f 75 67 68 74", "compression": {"model_a": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%", "model_b": "3.12% 3.12% 3.12% 3.12% 3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"model_a": [[53137, " thought", "normal", 0.311259001493454]], "model_b": [[53137, " thought", "normal", 0.25046274065971375]]}, "loss": {"model_a": 2.6416535172527404, "model_b": 3.1171511503582336}, "topk": {"model_a": [53137, 1, 0.311259001493454, [[53137, 0.311259, " thought", false], [47763, 0.203698, " wanted", false], [31220, 0.141786, " knew", false], [62684, 0.057305, " understood", false], [55616, 0.048067, " believed", false], [62643, 0.039959, " themselves", false], [21532, 0.026153, " did", false], [56175, 0.017921, " expected", false], [40, 0.015885, "'", false], [40219, 0.014364, " would", false]]], "model_b": [53137, 2, 0.25046274065971375, [[47763, 0.30422, " wanted", false], [53137, 0.250463, " thought", false], [21795, 0.075189, " had", false], [38709, 0.032322, " hoped", false], [55616, 0.029923, " believed", false], [56175, 0.023008, " expected", false], [60227, 0.022226, " preferred", false], [40219, 0.021539, " would", false], [56401, 0.017724, " imagined", false], [40, 0.015194, "'", false]]]}, "raw_delta": -0.0263671875, "tuned_delta": 0.02648775639819982}, {"byte_start": 4177, "byte_end": 4183, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 713, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "20.85% 20.85% 20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.009134320542216301]], "model_b": [[39931, " their", "normal", 0.0009753991034813225]]}, "loss": {"model_a": 14.088818758681281, "model_b": 20.851451762848296}, "topk": {"model_a": [39931, 18, 0.009134320542216301, [[22590, 0.170129, " the", false], [46227, 0.150865, " humans", false], [32232, 0.104958, " they", false], [46787, 0.104245, " people", false], [38720, 0.089898, " human", false], [47350, 0.070972, " speech", false], [22748, 0.034997, " was", false], [4601, 0.025599, " it", false], [30273, 0.023953, " best", false], [332, 0.019538, " a", false]]], "model_b": [39931, 28, 0.0009753991034813225, [[32232, 0.667376, " they", false], [45, 0.072069, ",", false], [22590, 0.039134, " the", false], [4601, 0.030883, " it", false], [47, 0.029085, ".", false], [32227, 0.026926, " that", false], [40219, 0.025705, " would", false], [32229, 0.011071, " them", false], [30273, 0.008784, " best", false], [22748, 0.006258, " was", false]]]}, "raw_delta": -0.375, "tuned_delta": -0.32214505610180016}, {"byte_start": 4183, "byte_end": 4187, "display": {"text": " own", "kind": "normal"}, "is_word": true, "word_id": 714, "word_key": " own", "bytes_hex": "20 6f 77 6e", "compression": {"model_a": "17.47% 17.47% 17.47% 17.47%", "model_b": "16.20% 16.20% 16.20% 16.20%"}, "model_tokens": {"model_a": [[22251, " own", "normal", 0.020515209063887596]], "model_b": [[22251, " own", "normal", 0.027667870745062828]]}, "loss": {"model_a": 17.47013526076479, "model_b": 16.202141572483473}, "topk": {"model_a": [22251, 7, 0.020515209063887596, [[53087, 0.367229, " systems", false], [38720, 0.156334, " human", false], [59943, 0.061903, " knowledge", false], [47487, 0.060584, " system", false], [52224, 0.057431, " methods", false], [45775, 0.053032, " domain", false], [22251, 0.020515, " own", false], [65034, 0.009593, " understanding", false], [47350, 0.008543, " speech", false], [38478, 0.008091, " field", false]]], "model_b": [22251, 6, 0.027667870745062828, [[53087, 0.314159, " systems", false], [52224, 0.172819, " methods", false], [47487, 0.086814, " system", false], [38720, 0.083936, " human", false], [46561, 0.030245, " method", false], [22251, 0.027668, " own", false], [52964, 0.014027, " special", false], [59943, 0.010673, " knowledge", false], [61559, 0.010422, " algorithms", false], [63363, 0.009993, " competitors", false]]]}, "raw_delta": 0.0703125, "tuned_delta": 0.12316744389819982}, {"byte_start": 4187, "byte_end": 4193, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 715, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"model_a": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[39026, " minds", "normal", 0.007010555826127529]], "model_b": [[39026, " minds", "normal", 0.0014171014772728086]]}, "loss": {"model_a": 14.934147884202158, "model_b": 19.724346262153794}, "topk": {"model_a": [39026, 14, 0.007010555826127529, [[53087, 0.217054, " systems", false], [38720, 0.169272, " human", false], [52224, 0.129596, " methods", false], [59943, 0.123852, " knowledge", false], [47487, 0.053842, " system", false], [65034, 0.01888, " understanding", false], [47350, 0.018018, " speech", false], [45775, 0.015038, " domain", false], [59683, 0.014585, " expertise", false], [52964, 0.01196, " special", false]]], "model_b": [39026, 41, 0.0014171014772728086, [[53087, 0.374392, " systems", false], [52224, 0.228874, " methods", false], [47487, 0.080269, " system", false], [46561, 0.039247, " method", false], [38720, 0.026399, " human", false], [40219, 0.025104, " would", false], [52964, 0.018528, " special", false], [59943, 0.012413, " knowledge", false], [45346, 0.011428, " brains", false], [61590, 0.010432, " approaches", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21277005610180016}, {"byte_start": 4193, "byte_end": 4200, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 716, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"model_a": "1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06%", "model_b": "1.85% 1.85% 1.85% 1.85% 1.85% 1.85% 1.85%"}, "model_tokens": {"model_a": [[47812, " worked", "normal", 0.6602880954742432]], "model_b": [[47812, " worked", "normal", 0.48807719349861145]]}, "loss": {"model_a": 1.0616931278863395, "model_b": 1.8516733225695396}, "topk": {"model_a": [47812, 1, 0.6602880954742432, [[47812, 0.660288, " worked", false], [21532, 0.144207, " did", false], [40219, 0.079185, " would", false], [47266, 0.031704, " should", false], [53137, 0.011982, " thought", false], [32499, 0.011801, " work", false], [39021, 0.009072, " might", false], [32462, 0.008832, " were", false], [56760, 0.008103, " operated", false], [39196, 0.004973, " ought", false]]], "model_b": [47812, 1, 0.48807719349861145, [[47812, 0.488077, " worked", false], [40219, 0.163777, " would", false], [47266, 0.126353, " should", false], [21532, 0.039897, " did", false], [32462, 0.03217, " were", false], [39196, 0.023795, " ought", false], [32499, 0.017258, " work", false], [39021, 0.010892, " might", false], [56760, 0.010521, " operated", false], [53137, 0.00859, " thought", false]]]}, "raw_delta": -0.04380580357142856, "tuned_delta": 0.00904914032677126}, {"byte_start": 4200, "byte_end": 4203, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"model_a": "15.22% 15.22% 15.22%", "model_b": "22.92% 22.92% 22.92%"}, "model_tokens": {"model_a": [[5346, "---", "normal", 0.07951655983924866]], "model_b": [[5346, "---", "normal", 0.022419512271881104]]}, "loss": {"model_a": 15.215924259375784, "model_b": 22.917811847454885}, "topk": {"model_a": [5346, 3, 0.07951655983924866, [[45, 0.516939, ",", false], [47, 0.2601, ".", false], [5346, 0.079517, "---", false], [275, 0.027224, " (", false], [30273, 0.024461, " best", false], [60, 0.022171, ";", false], [21265, 0.018616, " and", false], [32465, 0.005795, " when", false], [21400, 0.005746, " but", false], [4596, 0.005666, " in", false]]], "model_b": [5346, 4, 0.022419512271881104, [[45, 0.439182, ",", false], [47, 0.379996, ".", false], [275, 0.038249, " (", false], [5346, 0.02242, "---", false], [21265, 0.015912, " and", false], [60, 0.014787, ";", false], [4596, 0.012233, " in", false], [21400, 0.008615, " but", false], [22590, 0.006607, " the", false], [4450, 0.005585, " by", false]]]}, "raw_delta": -0.42708333333333326, "tuned_delta": -0.3742283894351334}, {"byte_start": 4203, "byte_end": 4207, "display": {"text": "they", "kind": "normal"}, "is_word": true, "word_id": 717, "word_key": "they", "bytes_hex": "74 68 65 79", "compression": {"model_a": "17.54% 17.54% 17.54% 17.54%", "model_b": "19.02% 19.02% 19.02% 19.02%"}, "model_tokens": {"model_a": [[27148, "they", "normal", 0.020454436540603638]], "model_b": [[27148, "they", "normal", 0.014828271232545376]]}, "loss": {"model_a": 17.540579354558197, "model_b": 19.01990532421973}, "topk": {"model_a": [27148, 13, 0.020454436540603638, [[1950, 0.098391, "in", false], [27142, 0.081169, "that", false], [7005, 0.066014, "and", false], [7195, 0.055251, "but", false], [1782, 0.041094, "by", false], [27493, 0.038416, "with", false], [8801, 0.037234, "the", false], [36003, 0.034565, "which", false], [98, 0.032994, "a", false], [34011, 0.02543, "based", false]]], "model_b": [27148, 15, 0.014828271232545376, [[27142, 0.09448, "that", false], [7195, 0.079318, "but", false], [7005, 0.070565, "and", false], [1950, 0.065365, "in", false], [34580, 0.052607, "human", false], [1751, 0.034404, "as", false], [1782, 0.032741, "by", false], [8801, 0.03179, "the", false], [98, 0.02962, "a", false], [27493, 0.029598, "with", false]]]}, "raw_delta": -0.08203125, "tuned_delta": -0.02917630610180018}, {"byte_start": 4207, "byte_end": 4213, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 718, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"model_a": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "model_b": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75%"}, "model_tokens": {"model_a": [[40013, " tried", "normal", 0.11053095757961273]], "model_b": [[40013, " tried", "normal", 0.07584866881370544]]}, "loss": {"model_a": 6.621744816580202, "model_b": 7.748850317274705}, "topk": {"model_a": [40013, 1, 0.11053095757961273, [[40013, 0.110531, " tried", false], [47763, 0.090578, " wanted", false], [32462, 0.086448, " were", false], [21532, 0.08045, " did", false], [32354, 0.048448, " used", false], [53137, 0.039334, " thought", false], [45150, 0.038113, " always", false], [21795, 0.024735, " had", false], [47812, 0.019215, " worked", false], [40219, 0.019005, " would", false]]], "model_b": [40013, 2, 0.07584866881370544, [[32462, 0.134906, " were", false], [40013, 0.075849, " tried", false], [47763, 0.067976, " wanted", false], [21532, 0.059227, " did", false], [39115, 0.036001, " never", false], [55616, 0.029812, " believed", false], [40219, 0.029609, " would", false], [21795, 0.028838, " had", false], [45150, 0.02521, " always", false], [53137, 0.024301, " thought", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 4213, "byte_end": 4216, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 719, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.67% 0.67% 0.67%", "model_b": "0.72% 0.72% 0.72%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8942117691040039]], "model_b": [[4811, " to", "normal", 0.8880968689918518]]}, "loss": {"model_a": 0.6721540616120861, "model_b": 0.7161816202329652}, "topk": {"model_a": [4811, 1, 0.8942117691040039, [[4811, 0.894212, " to", false], [52224, 0.009516, " methods", false], [31048, 0.007488, " hard", false], [38720, 0.006636, " human", false], [38499, 0.00488, " first", false], [22590, 0.004681, " the", false], [45, 0.004397, ",", false], [21700, 0.004052, " for", false], [22249, 0.004007, " out", false], [22187, 0.003321, " not", false]]], "model_b": [4811, 1, 0.8880968689918518, [[4811, 0.888097, " to", false], [22187, 0.022169, " not", false], [31048, 0.00701, " hard", false], [21700, 0.005189, " for", false], [45, 0.004699, ",", false], [39931, 0.003744, " their", false], [38720, 0.003576, " human", false], [22590, 0.003527, " the", false], [52224, 0.002833, " methods", false], [21265, 0.002758, " and", false]]]}, "raw_delta": -0.00244140625, "tuned_delta": 0.05041353764819982}, {"byte_start": 4216, "byte_end": 4220, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 720, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"model_a": "20.29% 20.29% 20.29% 20.29%", "model_b": "21.70% 21.70% 21.70% 21.70%"}, "model_tokens": {"model_a": [[22339, " put", "normal", 0.010945071466267109]], "model_b": [[22339, " put", "normal", 0.008142626844346523]]}, "loss": {"model_a": 20.287899012501047, "model_b": 21.696780888369172}, "topk": {"model_a": [22339, 25, 0.010945071466267109, [[31358, 0.072357, " make", false], [22681, 0.072267, " use", false], [37923, 0.059927, " build", false], [39025, 0.052012, " mimic", false], [39043, 0.029844, " model", false], [32187, 0.029264, " take", false], [4516, 0.024517, " em", false], [4404, 0.01917, " ``", false], [45616, 0.018871, " create", false], [45854, 0.018251, " encode", false]]], "model_b": [22339, 20, 0.008142626844346523, [[31358, 0.128619, " make", false], [22681, 0.075219, " use", false], [30858, 0.054056, " find", false], [32187, 0.053087, " take", false], [56540, 0.036822, " leverage", false], [4491, 0.02743, " do", false], [62683, 0.023187, " understand", false], [21751, 0.021412, " get", false], [4435, 0.020477, " be", false], [37923, 0.016479, " build", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.02527005610180018}, {"byte_start": 4220, "byte_end": 4225, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 721, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "26.26% 26.26% 26.26% 26.26% 26.26%", "model_b": "22.65% 22.65% 22.65% 22.65% 22.65%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.0006982529885135591]], "model_b": [[32227, " that", "normal", 0.001884651486761868]]}, "loss": {"model_a": 26.26155816618191, "model_b": 22.654820563959504}, "topk": {"model_a": [32227, 67, 0.0006982529885135591, [[4596, 0.18583, " in", false], [39931, 0.175639, " their", false], [22590, 0.110214, " the", false], [57435, 0.072513, " together", false], [38720, 0.072448, " human", false], [21256, 0.031125, " all", false], [40210, 0.027239, " words", false], [4404, 0.027186, " ``", false], [59943, 0.024152, " knowledge", false], [332, 0.02238, " a", false]]], "model_b": [32227, 42, 0.001884651486761868, [[39931, 0.172192, " their", false], [22590, 0.159119, " the", false], [38720, 0.137904, " human", false], [62643, 0.058607, " themselves", false], [332, 0.036863, " a", false], [21256, 0.031931, " all", false], [4596, 0.031076, " in", false], [46227, 0.021294, " humans", false], [4423, 0.01807, " as", false], [57435, 0.013512, " together", false]]]}, "raw_delta": 0.19999999999999996, "tuned_delta": 0.2528549438981998}, {"byte_start": 4225, "byte_end": 4235, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 722, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "model_b": "2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.23440676927566528]], "model_b": [[59943, " knowledge", "normal", 0.3202984035015106]]}, "loss": {"model_a": 2.620520289114718, "model_b": 2.028789901250105}, "topk": {"model_a": [59943, 1, 0.23440676927566528, [[59943, 0.234407, " knowledge", false], [38720, 0.227343, " human", false], [31162, 0.052358, " into", false], [4404, 0.041637, " ``", false], [52964, 0.041579, " special", false], [4596, 0.024248, " in", false], [65034, 0.019214, " understanding", false], [31427, 0.018013, " mind", false], [47487, 0.016275, " system", false], [62293, 0.015182, " particular", false]]], "model_b": [59943, 1, 0.3202984035015106, [[59943, 0.320298, " knowledge", false], [38720, 0.117511, " human", false], [31427, 0.045568, " mind", false], [52964, 0.040169, " special", false], [31162, 0.039605, " into", false], [4596, 0.036841, " in", false], [47487, 0.029725, " system", false], [63637, 0.014137, " information", false], [22752, 0.012488, " way", false], [46545, 0.010839, " mental", false]]]}, "raw_delta": 0.032812500000000015, "tuned_delta": 0.08566744389819983}, {"byte_start": 4235, "byte_end": 4238, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 723, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "10.38% 10.38% 10.38%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.17817959189414978]], "model_b": [[4596, " in", "normal", 0.10875225067138672]]}, "loss": {"model_a": 10.378763152228546, "model_b": 13.243489633160404}, "topk": {"model_a": [4596, 2, 0.17817959189414978, [[31162, 0.511717, " into", false], [4596, 0.17818, " in", false], [4811, 0.112676, " to", false], [4706, 0.052709, " of", false], [32232, 0.031239, " they", false], [45, 0.014237, ",", false], [56003, 0.009874, " directly", false], [21265, 0.009751, " and", false], [32227, 0.009624, " that", false], [46301, 0.004959, " inside", false]]], "model_b": [4596, 3, 0.10875225067138672, [[31162, 0.582186, " into", false], [4811, 0.148538, " to", false], [4596, 0.108752, " in", false], [4706, 0.029336, " of", false], [45, 0.014097, ",", false], [21265, 0.010982, " and", false], [4712, 0.008928, " on", false], [30218, 0.008631, " back", false], [275, 0.006971, " (", false], [40185, 0.006338, " where", false]]]}, "raw_delta": -0.15885416666666663, "tuned_delta": -0.10599922276846681}, {"byte_start": 4238, "byte_end": 4244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 724, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "6.48% 6.48% 6.48% 6.48% 6.48% 6.48%", "model_b": "8.27% 8.27% 8.27% 8.27% 8.27% 8.27%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.11641982197761536]], "model_b": [[39931, " their", "normal", 0.06386612355709076]]}, "loss": {"model_a": 6.48085662899339, "model_b": 8.265440338426352}, "topk": {"model_a": [39931, 2, 0.11641982197761536, [[22590, 0.604659, " the", false], [39931, 0.11642, " their", false], [45, 0.051243, ",", false], [332, 0.031932, " a", false], [47, 0.031755, ".", false], [21265, 0.014703, " and", false], [4423, 0.012111, " as", false], [4811, 0.008928, " to", false], [53087, 0.008047, " systems", false], [56567, 0.007377, " machines", false]]], "model_b": [39931, 3, 0.06386612355709076, [[22590, 0.398207, " the", false], [332, 0.136658, " a", false], [39931, 0.063866, " their", false], [4423, 0.031069, " as", false], [39291, 0.026817, " place", false], [45, 0.021495, ",", false], [47, 0.019276, ".", false], [39934, 0.016007, " there", false], [4811, 0.015465, " to", false], [57257, 0.014064, " software", false]]]}, "raw_delta": -0.09895833333333331, "tuned_delta": -0.04610338943513349}, {"byte_start": 4244, "byte_end": 4252, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 725, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"model_a": "1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83%", "model_b": "3.40% 3.40% 3.40% 3.40% 3.40% 3.40% 3.40% 3.40%"}, "model_tokens": {"model_a": [[53087, " systems", "normal", 0.44626832008361816]], "model_b": [[53087, " systems", "normal", 0.22215737402439117]]}, "loss": {"model_a": 1.8315464386285667, "model_b": 3.3989275255318594}, "topk": {"model_a": [53087, 1, 0.44626832008361816, [[53087, 0.446268, " systems", false], [46587, 0.122536, " models", false], [52224, 0.100688, " methods", false], [47487, 0.068409, " system", false], [61559, 0.052856, " algorithms", false], [56949, 0.025103, " programs", false], [47350, 0.017767, " speech", false], [56567, 0.017541, " machines", false], [30469, 0.012174, " code", false], [22251, 0.010278, " own", false]]], "model_b": [53087, 1, 0.22215737402439117, [[53087, 0.222157, " systems", false], [52224, 0.112537, " methods", false], [46587, 0.096378, " models", false], [38673, 0.0738, " heads", false], [47487, 0.056879, " system", false], [31060, 0.036403, " head", false], [61559, 0.031455, " algorithms", false], [22251, 0.031155, " own", false], [39026, 0.026759, " minds", false], [56949, 0.018546, " programs", false]]]}, "raw_delta": -0.0869140625, "tuned_delta": -0.03405911860180018}, {"byte_start": 4252, "byte_end": 4255, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"model_a": "9.02% 9.02% 9.02%", "model_b": "22.26% 22.26% 22.26%"}, "model_tokens": {"model_a": [[5346, "---", "normal", 0.22581958770751953]], "model_b": [[5346, "---", "normal", 0.02459218166768551]]}, "loss": {"model_a": 9.01684400555602, "model_b": 22.260333638716425}, "topk": {"model_a": [5346, 3, 0.22581958770751953, [[47, 0.334076, ".", false], [45, 0.231652, ",", false], [5346, 0.22582, "---", false], [21265, 0.051831, " and", false], [4596, 0.017953, " in", false], [4423, 0.013668, " as", false], [47001, 0.012154, " rather", false], [4450, 0.010664, " by", false], [4811, 0.009726, " to", false], [52028, 0.008561, " instead", false]]], "model_b": [5346, 6, 0.02459218166768551, [[47, 0.410351, ".", false], [45, 0.193842, ",", false], [21265, 0.099385, " and", false], [4811, 0.047617, " to", false], [4596, 0.036577, " in", false], [5346, 0.024592, "---", false], [4423, 0.023427, " as", false], [4788, 0.022528, " so", false], [4450, 0.011764, " by", false], [275, 0.011608, " (", false]]]}, "raw_delta": -0.734375, "tuned_delta": -0.6815200561018002}, {"byte_start": 4255, "byte_end": 4258, "display": {"text": "but", "kind": "normal"}, "is_word": true, "word_id": 726, "word_key": "but", "bytes_hex": "62 75 74", "compression": {"model_a": "2.54% 2.54% 2.54%", "model_b": "3.15% 3.15% 3.15%"}, "model_tokens": {"model_a": [[7195, "but", "normal", 0.6542940139770508]], "model_b": [[7195, "but", "normal", 0.5948882102966309]]}, "loss": {"model_a": 2.535987376562631, "model_b": 3.146502856105486}, "topk": {"model_a": [7195, 1, 0.6542940139770508, [[7195, 0.654294, "but", false], [7005, 0.239623, "and", false], [35898, 0.015545, "until", false], [36003, 0.00952, "which", false], [26476, 0.007127, "only", false], [36004, 0.005696, "while", false], [2190, 0.005338, "so", false], [36002, 0.004527, "where", false], [42135, 0.004409, "rather", false], [27493, 0.003749, "with", false]]], "model_b": [7195, 1, 0.5948882102966309, [[7195, 0.594888, "but", false], [7005, 0.165145, "and", false], [8260, 0.016896, "not", false], [27148, 0.014212, "they", false], [26476, 0.012866, "only", false], [2190, 0.012779, "so", false], [1950, 0.012201, "in", false], [8801, 0.009052, "the", false], [2215, 0.008464, "to", false], [35898, 0.007733, "until", false]]]}, "raw_delta": -0.03385416666666666, "tuned_delta": 0.019000777231533164}, {"byte_start": 4258, "byte_end": 4261, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 727, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "16.91% 16.91% 16.91%", "model_b": "17.00% 17.00% 17.00%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.05985134467482567]], "model_b": [[4601, " it", "normal", 0.059255246073007584]]}, "loss": {"model_a": 16.90658251041754, "model_b": 17.000507968808748}, "topk": {"model_a": [4601, 5, 0.05985134467482567, [[22590, 0.154223, " the", false], [32232, 0.110256, " they", false], [4596, 0.077104, " in", false], [32234, 0.065715, " this", false], [4601, 0.059851, " it", false], [32227, 0.044131, " that", false], [30597, 0.041909, " deep", false], [61959, 0.035259, " eventually", false], [45, 0.033356, ",", false], [4423, 0.026939, " as", false]]], "model_b": [4601, 4, 0.059255246073007584, [[32232, 0.122064, " they", false], [22590, 0.111072, " the", false], [4596, 0.080263, " in", false], [4601, 0.059255, " it", false], [45, 0.042864, ",", false], [39931, 0.029504, " their", false], [32234, 0.029442, " this", false], [32227, 0.029419, " that", false], [32465, 0.024116, " when", false], [39936, 0.020409, " these", false]]]}, "raw_delta": -0.00520833333333337, "tuned_delta": 0.04764661056486645}, {"byte_start": 4261, "byte_end": 4268, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 728, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"model_a": "8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53%", "model_b": "11.35% 11.35% 11.35% 11.35% 11.35% 11.35% 11.35%"}, "model_tokens": {"model_a": [[46936, " proved", "normal", 0.03679249435663223]], "model_b": [[46936, " proved", "normal", 0.01248219981789589]]}, "loss": {"model_a": 8.53379879097266, "model_b": 11.351562542708919}, "topk": {"model_a": [46936, 6, 0.03679249435663223, [[22748, 0.334355, " was", false], [4600, 0.094463, " is", false], [47638, 0.094123, " turned", false], [21532, 0.07026, " did", false], [40040, 0.043167, " turns", false], [46936, 0.036792, " proved", false], [39115, 0.031296, " never", false], [30633, 0.025171, " didn", false], [21800, 0.018181, " has", false], [45150, 0.015661, " always", false]]], "model_b": [46936, 12, 0.01248219981789589, [[22748, 0.328535, " was", false], [39115, 0.15937, " never", false], [4600, 0.071173, " is", false], [21532, 0.065173, " did", false], [47638, 0.040762, " turned", false], [32272, 0.032775, " took", false], [30633, 0.026758, " didn", false], [45150, 0.01916, " always", false], [47812, 0.015266, " worked", false], [40040, 0.014508, " turns", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 4268, "byte_end": 4279, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 729, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"model_a": "6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38%", "model_b": "8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"model_a": [[62676, " ultimately", "normal", 0.020496545359492302]], "model_b": [[62676, " ultimately", "normal", 0.004824909847229719]]}, "loss": {"model_a": 6.378392492566615, "model_b": 8.760683664489086}, "topk": {"model_a": [62676, 12, 0.020496545359492302, [[4811, 0.213013, " to", false], [22187, 0.066712, " not", false], [62082, 0.056201, " impossible", false], [332, 0.051529, " a", false], [62161, 0.049208, " irrelevant", false], [31466, 0.038657, " much", false], [21719, 0.03778, " fut", false], [31277, 0.0342, " less", false], [32227, 0.031324, " that", false], [31458, 0.028027, " more", false]]], "model_b": [62676, 28, 0.004824909847229719, [[4811, 0.334464, " to", false], [62082, 0.091328, " impossible", false], [59516, 0.039534, " difficult", false], [21719, 0.030594, " fut", false], [63631, 0.028042, " ineffective", false], [22187, 0.027843, " not", false], [32386, 0.025166, " very", false], [31466, 0.024038, " much", false], [332, 0.023432, " a", false], [53247, 0.017703, " useless", false]]]}, "raw_delta": -0.1321022727272727, "tuned_delta": -0.07924732882907289}, {"byte_start": 4279, "byte_end": 4287, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 730, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"model_a": "10.14% 10.14% 10.14% 10.14% 10.14% 10.14% 10.14% 10.14%", "model_b": "9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79%"}, "model_tokens": {"model_a": [[51336, " counter", "normal", 0.011058651842176914]], "model_b": [[51336, " counter", "normal", 0.013142944313585758]]}, "loss": {"model_a": 10.143949506250523, "model_b": 9.79172903728349}, "topk": {"model_a": [51336, 16, 0.011058651842176914, [[4811, 0.211264, " to", false], [21719, 0.116278, " fut", false], [62161, 0.091068, " irrelevant", false], [22187, 0.083035, " not", false], [31458, 0.061769, " more", false], [31277, 0.041357, " less", false], [62082, 0.034509, " impossible", false], [4832, 0.030704, " un", false], [332, 0.027697, " a", false], [31466, 0.023797, " much", false]]], "model_b": [51336, 10, 0.013142944313585758, [[4811, 0.224026, " to", false], [21719, 0.140941, " fut", false], [53247, 0.089856, " useless", false], [63631, 0.070672, " ineffective", false], [62161, 0.051259, " irrelevant", false], [62082, 0.049818, " impossible", false], [22187, 0.028112, " not", false], [60772, 0.014617, " worthless", false], [64616, 0.013169, " unsuccessful", false], [51336, 0.013143, " counter", false]]]}, "raw_delta": 0.01953125, "tuned_delta": 0.07238619389819982}, {"byte_start": 4287, "byte_end": 4297, "display": {"text": "productive", "kind": "normal"}, "is_word": true, "word_id": 731, "word_key": "productive", "bytes_hex": "70 72 6f 64 75 63 74 69 76 65", "compression": {"model_a": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "model_b": "0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67%"}, "model_tokens": {"model_a": [[61076, "productive", "normal", 0.8825404644012451]], "model_b": [[61076, "productive", "normal", 0.691795289516449]]}, "loss": {"model_a": 0.2254211001389005, "model_b": 0.6656966863476906}, "topk": {"model_a": [61076, 1, 0.8825404644012451, [[61076, 0.88254, "productive", false], [46, 0.096918, "-", false], [62383, 0.016075, " productive", false], [4811, 0.002644, " to", false], [49587, 0.000289, "product", false], [59593, 0.00025, " effective", false], [47687, 0.000148, " useful", false], [59918, 0.000125, " intuitive", false], [7865, 0.000106, "int", false], [25390, 9.4e-05, "fact", false]]], "model_b": [61076, 1, 0.691795289516449, [[61076, 0.691795, "productive", false], [46, 0.237432, "-", false], [4811, 0.030356, " to", false], [62383, 0.027099, " productive", false], [7865, 0.008237, "int", false], [59918, 0.002087, " intuitive", false], [59593, 0.000659, " effective", false], [58227, 0.000244, "effective", false], [1843, 0.000198, "ed", false], [47687, 0.000155, " useful", false]]]}, "raw_delta": -0.024414062499999997, "tuned_delta": 0.028440881398199825}, {"byte_start": 4297, "byte_end": 4298, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "48.75%", "model_b": "38.04%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.06738156825304031]], "model_b": [[45, ",", "normal", 0.12078883498907089]]}, "loss": {"model_a": 48.747312905037234, "model_b": 38.03981064843946}, "topk": {"model_a": [45, 2, 0.06738156825304031, [[47, 0.778545, ".", false], [45, 0.067382, ",", false], [4811, 0.059409, " to", false], [21265, 0.027568, " and", false], [4596, 0.017055, " in", false], [21700, 0.007759, " for", false], [4423, 0.00757, " as", false], [51018, 0.005475, " because", false], [275, 0.004051, " (", false], [32465, 0.003217, " when", false]]], "model_b": [45, 2, 0.12078883498907089, [[47, 0.693475, ".", false], [45, 0.120789, ",", false], [4596, 0.041834, " in", false], [4811, 0.025916, " to", false], [21265, 0.025512, " and", false], [51018, 0.016766, " because", false], [4423, 0.015891, " as", false], [32465, 0.011587, " when", false], [21700, 0.010918, " for", false], [59, 0.00377, ":", false]]]}, "raw_delta": 0.59375, "tuned_delta": 0.6466049438981998}, {"byte_start": 4298, "byte_end": 4302, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 732, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.54% 4.54% 4.54% 4.54%", "model_b": "5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.36137905716896057]], "model_b": [[21265, " and", "normal", 0.2830912172794342]]}, "loss": {"model_a": 4.543644049674714, "model_b": 5.670749550369216}, "topk": {"model_a": [21265, 1, 0.36137905716896057, [[21265, 0.361379, " and", false], [4423, 0.131722, " as", false], [51018, 0.050769, " because", false], [4596, 0.028883, " in", false], [30788, 0.02306, " even", false], [39690, 0.022747, " since", false], [22187, 0.018869, " not", false], [61953, 0.01851, " especially", false], [31198, 0.017124, " just", false], [4424, 0.016268, " at", false]]], "model_b": [21265, 1, 0.2830912172794342, [[21265, 0.283091, " and", false], [4423, 0.216166, " as", false], [51018, 0.067429, " because", false], [39690, 0.043954, " since", false], [4596, 0.026255, " in", false], [30788, 0.021219, " even", false], [61953, 0.019916, " especially", false], [21700, 0.019895, " for", false], [4788, 0.017145, " so", false], [4424, 0.01461, " at", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 4302, "byte_end": 4304, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 733, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "34.38% 34.38%", "model_b": "43.11% 43.11%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.022072935476899147]], "model_b": [[332, " a", "normal", 0.008275652304291725]]}, "loss": {"model_a": 34.37671777118233, "model_b": 43.111785401564724}, "topk": {"model_a": [332, 8, 0.022072935476899147, [[22590, 0.141657, " the", false], [32232, 0.123529, " they", false], [4596, 0.035881, " in", false], [4601, 0.03577, " it", false], [22748, 0.026896, " was", false], [61959, 0.0263, " eventually", false], [22190, 0.023376, " now", false], [332, 0.022073, " a", false], [39931, 0.021755, " their", false], [31581, 0.019333, " only", false]]], "model_b": [332, 26, 0.008275652304291725, [[22590, 0.16504, " the", false], [32232, 0.047658, " they", false], [4596, 0.039598, " in", false], [39931, 0.032123, " their", false], [4601, 0.027427, " it", false], [31581, 0.02475, " only", false], [30788, 0.018249, " even", false], [30597, 0.017724, " deep", false], [53087, 0.017622, " systems", false], [22748, 0.017265, " was", false]]]}, "raw_delta": -0.484375, "tuned_delta": -0.43152005610180016}, {"byte_start": 4304, "byte_end": 4308, "display": {"text": " col", "kind": "normal"}, "is_word": true, "word_id": 734, "word_key": " col", "bytes_hex": "20 63 6f 6c", "compression": {"model_a": "41.42% 41.42% 41.42% 41.42%", "model_b": "47.06% 47.06% 47.06% 47.06%"}, "model_tokens": {"model_a": [[21454, " col", "normal", 0.00010250632476527244]], "model_b": [[21454, " col", "normal", 3.0208191674319096e-05]]}, "loss": {"model_a": 41.42112715052297, "model_b": 47.05665465399548}, "topk": {"model_a": [21454, 782, 0.00010250632476527244, [[38961, 0.058253, " major", false], [31466, 0.033761, " much", false], [22168, 0.033425, " new", false], [45301, 0.033387, " better", false], [40166, 0.020443, " waste", false], [31458, 0.020397, " more", false], [52245, 0.016786, " mistake", false], [59513, 0.016167, " different", false], [30585, 0.015082, " dead", false], [32386, 0.015059, " very", false]]], "model_b": [21454, 1356, 3.0208191674319096e-05, [[22031, 0.062577, " lot", false], [31466, 0.053037, " much", false], [31458, 0.045737, " more", false], [45301, 0.035002, " better", false], [31118, 0.026756, " huge", false], [38864, 0.025803, " large", false], [38629, 0.024691, " great", false], [22168, 0.024327, " new", false], [38961, 0.023301, " major", false], [21357, 0.021689, " big", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.25964505610180016}, {"byte_start": 4308, "byte_end": 4312, "display": {"text": "ossa", "kind": "normal"}, "is_word": true, "word_id": 735, "word_key": "ossa", "bytes_hex": "6f 73 73 61", "compression": {"model_a": "0.02% 0.02% 0.02% 0.02%", "model_b": "0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"model_a": [[26568, "ossa", "normal", 0.9957947731018066]], "model_b": [[26568, "ossa", "normal", 0.9936297535896301]]}, "loss": {"model_a": 0.018849298534563824, "model_b": 0.0287554992242616}, "topk": {"model_a": [26568, 1, 0.9957947731018066, [[26568, 0.995795, "ossa", false], [8420, 0.003294, "oss", false], [33773, 0.000114, "ander", false], [117, 7.8e-05, "t", false], [2102, 7.7e-05, "os", false], [46, 5.9e-05, "-", false], [112, 5.3e-05, "o", false], [26721, 4.2e-05, "port", false], [98, 3.9e-05, "a", false], [2218, 3.8e-05, "ts", false]]], "model_b": [26568, 1, 0.9936297535896301, [[26568, 0.99363, "ossa", false], [8420, 0.002703, "oss", false], [46, 0.000536, "-", false], [26555, 0.000467, "osal", false], [33773, 0.00028, "ander", false], [8387, 0.000245, "oph", false], [98, 0.000244, "a", false], [24385, 0.000171, "abor", false], [117, 0.000133, "t", false], [26569, 0.000119, "osse", false]]]}, "raw_delta": -0.00054931640625, "tuned_delta": 0.05230562749194982}, {"byte_start": 4312, "byte_end": 4313, "display": {"text": "l", "kind": "normal"}, "is_word": true, "word_id": 736, "word_key": "l", "bytes_hex": "6c", "compression": {"model_a": "1.14%", "model_b": "0.17%"}, "model_tokens": {"model_a": [[109, "l", "normal", 0.9380108714103699]], "model_b": [[109, "l", "normal", 0.9902612566947937]]}, "loss": {"model_a": 1.144716524142854, "model_b": 0.17390885655247207}, "topk": {"model_a": [109, 1, 0.9380108714103699, [[109, 0.938011, "l", false], [2018, 0.061714, "ll", false], [2025, 0.000101, "lt", false], [2030, 2.2e-05, "ly", false], [2077, 1.7e-05, "nt", false], [2206, 1.5e-05, "te", false], [2174, 1.4e-05, "ry", false], [40166, 1.1e-05, " waste", false], [8099, 7e-06, "lit", false], [26157, 7e-06, "list", false]]], "model_b": [109, 1, 0.9902612566947937, [[109, 0.990261, "l", false], [2018, 0.009681, "ll", false], [2174, 1.3e-05, "ry", false], [2030, 5e-06, "ly", false], [34, 4e-06, "!", false], [2011, 2e-06, "le", false], [2024, 2e-06, "ls", false], [2015, 2e-06, "li", false], [8064, 2e-06, "lbl", false], [2206, 1e-06, "te", false]]]}, "raw_delta": 0.0538330078125, "tuned_delta": 0.10668795171069982}, {"byte_start": 4313, "byte_end": 4319, "display": {"text": " waste", "kind": "normal"}, "is_word": true, "word_id": 737, "word_key": " waste", "bytes_hex": "20 77 61 73 74 65", "compression": {"model_a": "0.59% 0.59% 0.59% 0.59% 0.59% 0.59%", "model_b": "7.70% 7.70% 7.70% 7.70% 7.70% 7.70%"}, "model_tokens": {"model_a": [[40166, " waste", "normal", 0.8192620277404785]], "model_b": [[40166, " waste", "normal", 0.07717099040746689]]}, "loss": {"model_a": 0.5929044560945039, "model_b": 7.7018875880791}, "topk": {"model_a": [40166, 1, 0.8192620277404785, [[40166, 0.819262, " waste", false], [52245, 0.072656, " mistake", false], [31333, 0.014194, " loss", false], [38392, 0.008758, " error", false], [32251, 0.007332, " time", false], [51708, 0.007299, " failure", false], [45157, 0.005651, " amount", false], [62157, 0.00319, " investment", false], [45829, 0.003172, " effort", false], [65126, 0.002416, " disappointment", false]]], "model_b": [40166, 2, 0.07717099040746689, [[45157, 0.38708, " amount", false], [40166, 0.077171, " waste", false], [45829, 0.040266, " effort", false], [51708, 0.023832, " failure", false], [31333, 0.023656, " loss", false], [46430, 0.021358, " lesson", false], [52245, 0.020993, " mistake", false], [38392, 0.01433, " error", false], [46685, 0.013619, " number", false], [22459, 0.012455, " set", false]]]}, "raw_delta": -0.3942057291666666, "tuned_delta": -0.34135078526846674}, {"byte_start": 4319, "byte_end": 4322, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 738, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.10% 0.10% 0.10%", "model_b": "0.36% 0.36% 0.36%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9837121367454529]], "model_b": [[4706, " of", "normal", 0.9418061375617981]]}, "loss": {"model_a": 0.09906200689697776, "model_b": 0.3595583954038452}, "topk": {"model_a": [4706, 1, 0.9837121367454529, [[4706, 0.983712, " of", false], [47, 0.007265, ".", false], [4596, 0.002473, " in", false], [45, 0.002413, ",", false], [4811, 0.000841, " to", false], [21700, 0.000329, " for", false], [4588, 0.000212, " if", false], [30322, 0.000204, " both", false], [115, 0.000185, "r", false], [32465, 0.000175, " when", false]]], "model_b": [4706, 1, 0.9418061375617981, [[4706, 0.941806, " of", false], [47, 0.038918, ".", false], [45, 0.008229, ",", false], [4596, 0.003892, " in", false], [4811, 0.000695, " to", false], [7592, 0.000646, "ful", false], [32465, 0.000414, " when", false], [4588, 0.000409, " if", false], [275, 0.000408, " (", false], [32227, 0.000391, " that", false]]]}, "raw_delta": -0.014444986979166666, "tuned_delta": 0.03840995691903316}, {"byte_start": 4322, "byte_end": 4333, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 739, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"model_a": "11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37%", "model_b": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%"}, "model_tokens": {"model_a": [[62496, " researcher", "normal", 0.0009707725839689374]], "model_b": [[62496, " researcher", "normal", 7.696600368944928e-05]]}, "loss": {"model_a": 11.3735191433718, "model_b": 15.574548736869486}, "topk": {"model_a": [62496, 26, 0.0009707725839689374, [[32251, 0.42288, " time", false], [45829, 0.213963, " effort", false], [57103, 0.093224, " research", false], [60406, 0.082355, " resources", false], [38720, 0.045661, " human", false], [59346, 0.023217, " computing", false], [63370, 0.012824, " computation", false], [64862, 0.011861, " computational", false], [22590, 0.008835, " the", false], [39052, 0.006712, " money", false]]], "model_b": [62496, 234, 7.696600368944928e-05, [[32251, 0.324617, " time", false], [60406, 0.177229, " resources", false], [45829, 0.097109, " effort", false], [64862, 0.0704, " computational", false], [57103, 0.035408, " research", false], [59346, 0.025855, " computing", false], [39052, 0.023635, " money", false], [38720, 0.020891, " human", false], [45860, 0.015091, " energy", false], [57516, 0.014694, " valuable", false]]]}, "raw_delta": -0.23295454545454541, "tuned_delta": -0.18009960155634558}, {"byte_start": 4333, "byte_end": 4335, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 740, "word_key": "'s", "bytes_hex": "27 73", "compression": {"model_a": "26.21% 26.21%", "model_b": "19.87% 19.87%"}, "model_tokens": {"model_a": [[460, "'s", "normal", 0.054352376610040665]], "model_b": [[460, "'s", "normal", 0.11073441058397293]]}, "loss": {"model_a": 26.205202891147184, "model_b": 19.86523444974061}, "topk": {"model_a": [460, 3, 0.054352376610040665, [[32251, 0.667085, " time", false], [45829, 0.165443, " effort", false], [460, 0.054352, "'s", false], [21265, 0.040722, " and", false], [45860, 0.016168, " energy", false], [46, 0.00989, "-", false], [60406, 0.009343, " resources", false], [51566, 0.004385, " efforts", false], [59193, 0.002752, " attention", false], [38853, 0.002407, " labor", false]]], "model_b": [460, 2, 0.11073441058397293, [[32251, 0.598311, " time", false], [460, 0.110734, "'s", false], [45829, 0.110558, " effort", false], [21265, 0.055152, " and", false], [45860, 0.036748, " energy", false], [60406, 0.020263, " resources", false], [47499, 0.017564, " talent", false], [51566, 0.005429, " efforts", false], [46, 0.004162, "-", false], [45, 0.003818, ",", false]]]}, "raw_delta": 0.3515625, "tuned_delta": 0.40441744389819984}, {"byte_start": 4335, "byte_end": 4340, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 741, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "0.50% 0.50% 0.50% 0.50% 0.50%", "model_b": "0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.8708484768867493]], "model_b": [[32251, " time", "normal", 0.8006796836853027]]}, "loss": {"model_a": 0.5001530659331854, "model_b": 0.8101070786241737}, "topk": {"model_a": [32251, 1, 0.8708484768867493, [[32251, 0.870848, " time", false], [45829, 0.039119, " effort", false], [21265, 0.020374, " and", false], [51566, 0.016816, " efforts", false], [45860, 0.00624, " energy", false], [38720, 0.003476, " human", false], [60406, 0.00275, " resources", false], [56903, 0.002628, " precious", false], [57516, 0.002365, " valuable", false], [59193, 0.001914, " attention", false]]], "model_b": [32251, 1, 0.8006796836853027, [[32251, 0.80068, " time", false], [45829, 0.033709, " effort", false], [45860, 0.016722, " energy", false], [57516, 0.016474, " valuable", false], [51566, 0.015898, " efforts", false], [56903, 0.010467, " precious", false], [21265, 0.007929, " and", false], [60406, 0.006557, " resources", false], [47499, 0.005076, " talent", false], [64862, 0.004052, " computational", false]]]}, "raw_delta": -0.0171875, "tuned_delta": 0.03566744389819982}, {"byte_start": 4340, "byte_end": 4341, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "40.01%", "model_b": "45.65%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.11087194830179214]], "model_b": [[45, ",", "normal", 0.08081928640604019]]}, "loss": {"model_a": 40.01224527465484, "model_b": 45.647772778127354}, "topk": {"model_a": [45, 3, 0.11087194830179214, [[47, 0.640336, ".", false], [21265, 0.155578, " and", false], [45, 0.110872, ",", false], [4811, 0.025902, " to", false], [4596, 0.010639, " in", false], [275, 0.007843, " (", false], [32227, 0.006554, " that", false], [5346, 0.003996, "---", false], [4423, 0.003494, " as", false], [32465, 0.002765, " when", false]]], "model_b": [45, 3, 0.08081928640604019, [[47, 0.574879, ".", false], [21265, 0.296293, " and", false], [45, 0.080819, ",", false], [4596, 0.007969, " in", false], [275, 0.005513, " (", false], [32227, 0.004411, " that", false], [32465, 0.004243, " when", false], [4423, 0.002886, " as", false], [4811, 0.002007, " to", false], [4588, 0.00127, " if", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.25964505610180016}, {"byte_start": 4341, "byte_end": 4346, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 742, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"model_a": "12.68% 12.68% 12.68% 12.68% 12.68%", "model_b": "10.26% 10.26% 10.26% 10.26% 10.26%"}, "model_tokens": {"model_a": [[32465, " when", "normal", 0.02941037155687809]], "model_b": [[32465, " when", "normal", 0.058145299553871155]]}, "loss": {"model_a": 12.679936882813154, "model_b": 10.256660056319973}, "topk": {"model_a": [32465, 7, 0.02941037155687809, [[4811, 0.48583, " to", false], [51018, 0.054155, " because", false], [4423, 0.047252, " as", false], [4596, 0.036581, " in", false], [21265, 0.033216, " and", false], [45860, 0.031874, " energy", false], [32465, 0.02941, " when", false], [21700, 0.026097, " for", false], [22187, 0.025224, " not", false], [45829, 0.024754, " effort", false]]], "model_b": [32465, 5, 0.058145299553871155, [[45860, 0.13604, " energy", false], [45829, 0.092978, " effort", false], [21265, 0.079528, " and", false], [4423, 0.06777, " as", false], [32465, 0.058145, " when", false], [51018, 0.048808, " because", false], [4596, 0.045262, " in", false], [39052, 0.035881, " money", false], [61953, 0.031841, " especially", false], [39690, 0.031129, " since", false]]]}, "raw_delta": 0.13437500000000002, "tuned_delta": 0.18722994389819986}, {"byte_start": 4346, "byte_end": 4347, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "97.49%", "model_b": "77.77%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.004442139528691769]], "model_b": [[45, ",", "normal", 0.013129550963640213]]}, "loss": {"model_a": 97.49462581007447, "model_b": 77.77027954792068}, "topk": {"model_a": [45, 33, 0.004442139528691769, [[22590, 0.239071, " the", false], [32232, 0.097042, " they", false], [4601, 0.089803, " it", false], [30597, 0.038017, " deep", false], [32227, 0.03587, " that", false], [332, 0.025754, " a", false], [4596, 0.023079, " in", false], [39931, 0.018014, " their", false], [45301, 0.017185, " better", false], [32464, 0.01594, " what", false]]], "model_b": [45, 14, 0.013129550963640213, [[22590, 0.218766, " the", false], [4601, 0.069837, " it", false], [32232, 0.061109, " they", false], [332, 0.035266, " a", false], [55794, 0.031195, " compared", false], [52195, 0.03114, " massive", false], [39931, 0.030162, " their", false], [53087, 0.019022, " systems", false], [21256, 0.018, " all", false], [4596, 0.016145, " in", false]]]}, "raw_delta": 1.09375, "tuned_delta": 1.1466049438981998}, {"byte_start": 4347, "byte_end": 4355, "display": {"text": " through", "kind": "normal"}, "is_word": true, "word_id": 743, "word_key": " through", "bytes_hex": "20 74 68 72 6f 75 67 68", "compression": {"model_a": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%", "model_b": "13.03% 13.03% 13.03% 13.03% 13.03% 13.03% 13.03% 13.03%"}, "model_tokens": {"model_a": [[53140, " through", "normal", 0.002387400483712554]], "model_b": [[53140, " through", "normal", 0.00308551755733788]]}, "loss": {"model_a": 13.595710102127438, "model_b": 13.032157351780185}, "topk": {"model_a": [53140, 36, 0.002387400483712554, [[4596, 0.245013, " in", false], [52028, 0.179985, " instead", false], [4423, 0.086962, " as", false], [4450, 0.03763, " by", false], [31578, 0.036127, " once", false], [32487, 0.034816, " with", false], [61959, 0.030538, " eventually", false], [31601, 0.024619, " over", false], [4424, 0.018281, " at", false], [37634, 0.016861, " after", false]]], "model_b": [53140, 26, 0.00308551755733788, [[4596, 0.253724, " in", false], [4423, 0.156314, " as", false], [52028, 0.104808, " instead", false], [32487, 0.041539, " with", false], [4450, 0.032278, " by", false], [4424, 0.029601, " at", false], [37634, 0.026169, " after", false], [21700, 0.025946, " for", false], [31578, 0.025358, " once", false], [21265, 0.021078, " and", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 4355, "byte_end": 4361, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 744, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"model_a": "14.18% 14.18% 14.18% 14.18% 14.18% 14.18%", "model_b": "20.76% 20.76% 20.76% 20.76% 20.76% 20.76%"}, "model_tokens": {"model_a": [[37045, " Moore", "normal", 0.00889422744512558]], "model_b": [[37045, " Moore", "normal", 0.0009917125571519136]]}, "loss": {"model_a": 14.182744217072491, "model_b": 20.75752630445709}, "topk": {"model_a": [37045, 18, 0.00889422744512558, [[22590, 0.179379, " the", false], [52195, 0.143146, " massive", false], [56537, 0.083228, " learning", false], [63370, 0.053932, " computation", false], [30597, 0.048259, " deep", false], [63885, 0.024335, " statistical", false], [332, 0.021216, " a", false], [51832, 0.018297, " general", false], [47202, 0.016792, " search", false], [57103, 0.016413, " research", false]]], "model_b": [37045, 88, 0.0009917125571519136, [[52195, 0.209097, " massive", false], [22590, 0.163854, " the", false], [56537, 0.090961, " learning", false], [30597, 0.02941, " deep", false], [332, 0.026769, " a", false], [31978, 0.025126, " self", false], [51396, 0.017499, " decades", false], [51832, 0.017402, " general", false], [39660, 0.016893, " sheer", false], [39931, 0.013438, " their", false]]]}, "raw_delta": -0.3645833333333334, "tuned_delta": -0.3117283894351336}, {"byte_start": 4361, "byte_end": 4363, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 745, "word_key": "'s", "bytes_hex": "27 73", "compression": {"model_a": "0.03% 0.03%", "model_b": "0.03% 0.03%"}, "model_tokens": {"model_a": [[460, "'s", "normal", 0.996393620967865]], "model_b": [[460, "'s", "normal", 0.9964474439620972]]}, "loss": {"model_a": 0.032607910603588516, "model_b": 0.032057566120827524}, "topk": {"model_a": [460, 1, 0.996393620967865, [[460, 0.996394, "'s", false], [116, 0.001818, "s", false], [28309, 0.000497, "’s", false], [40, 0.000227, "'", false], [21265, 0.000219, " and", false], [45, 0.000163, ",", false], [46, 0.000161, "-", false], [439, 3e-05, "''", false], [21988, 2.8e-05, " law", false], [4522, 2.7e-05, " et", false]]], "model_b": [460, 1, 0.9964474439620972, [[460, 0.996447, "'s", false], [28309, 0.001471, "’s", false], [116, 0.000703, "s", false], [21265, 0.00037, " and", false], [45, 0.000228, ",", false], [46, 0.000182, "-", false], [40, 4.7e-05, "'", false], [4715, 2.3e-05, " or", false], [274, 1.7e-05, " '", false], [101, 1.4e-05, "d", false]]]}, "raw_delta": 3.0517578125e-05, "tuned_delta": 0.05288546147632482}, {"byte_start": 4363, "byte_end": 4367, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 746, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"model_a": "0.31% 0.31% 0.31% 0.31%", "model_b": "0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"model_a": [[21988, " law", "normal", 0.9330040812492371]], "model_b": [[21988, " law", "normal", 0.9458680748939514]]}, "loss": {"model_a": 0.3125956662082409, "model_b": 0.25095708413901036}, "topk": {"model_a": [21988, 1, 0.9330040812492371, [[21988, 0.933004, " law", false], [20267, 0.065092, " Law", false], [21265, 0.000218, " and", false], [31259, 0.000199, " laws", false], [45828, 0.000153, " effect", false], [46, 0.00011, "-", false], [45, 0.0001, ",", false], [53127, 9.9e-05, " theorem", false], [31907, 6.7e-05, " rule", false], [4715, 5.4e-05, " or", false]]], "model_b": [21988, 1, 0.9458680748939514, [[21988, 0.945868, " law", false], [20267, 0.031679, " Law", false], [21265, 0.002854, " and", false], [31907, 0.002489, " rule", false], [56537, 0.001303, " learning", false], [31259, 0.001272, " laws", false], [55836, 0.001249, " constant", false], [47205, 0.001043, " second", false], [46, 0.000635, "-", false], [60250, 0.000618, " principle", false]]]}, "raw_delta": 0.00341796875, "tuned_delta": 0.05627291264819982}, {"byte_start": 4367, "byte_end": 4368, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.52%", "model_b": "3.91%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8703024983406067]], "model_b": [[45, ",", "normal", 0.8064049482345581]]}, "loss": {"model_a": 2.518376353114279, "model_b": 3.9096472055340556}, "topk": {"model_a": [45, 1, 0.8703024983406067, [[45, 0.870302, ",", false], [21265, 0.093706, " and", false], [4706, 0.009449, " of", false], [4715, 0.007448, " or", false], [46, 0.003969, "-", false], [275, 0.003592, " (", false], [460, 0.001074, "'s", false], [22590, 0.00074, " the", false], [37677, 0.000631, " alone", false], [4596, 0.000505, " in", false]]], "model_b": [45, 1, 0.8064049482345581, [[45, 0.806405, ",", false], [21265, 0.158336, " and", false], [4706, 0.005903, " of", false], [4715, 0.005774, " or", false], [275, 0.004725, " (", false], [4596, 0.001941, " in", false], [46, 0.000944, "-", false], [22590, 0.000644, " the", false], [55465, 0.000602, " advances", false], [4712, 0.000527, " on", false]]]}, "raw_delta": -0.0771484375, "tuned_delta": -0.02429349360180018}, {"byte_start": 4368, "byte_end": 4376, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 747, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "model_b": "4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.049958325922489166]], "model_b": [[52195, " massive", "normal", 0.1165182814002037]]}, "loss": {"model_a": 6.762633004167015, "model_b": 4.8606424717450425}, "topk": {"model_a": [52195, 5, 0.049958325922489166, [[22590, 0.244659, " the", false], [63370, 0.125539, " computation", false], [32232, 0.068254, " they", false], [31458, 0.051521, " more", false], [52195, 0.049958, " massive", false], [4601, 0.036433, " it", false], [32227, 0.024094, " that", false], [332, 0.023815, " a", false], [45301, 0.022837, " better", false], [39931, 0.022699, " their", false]]], "model_b": [52195, 3, 0.1165182814002037, [[22590, 0.178928, " the", false], [63370, 0.142913, " computation", false], [52195, 0.116518, " massive", false], [51832, 0.030715, " general", false], [31466, 0.027823, " much", false], [59346, 0.027502, " computing", false], [4601, 0.023706, " it", false], [31458, 0.022203, " more", false], [332, 0.021684, " a", false], [53087, 0.019722, " systems", false]]]}, "raw_delta": 0.10546875, "tuned_delta": 0.15832369389819984}, {"byte_start": 4376, "byte_end": 4388, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 748, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09%", "model_b": "2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.24998295307159424]], "model_b": [[63370, " computation", "normal", 0.20766384899616241]]}, "loss": {"model_a": 2.0898414492043904, "model_b": 2.371617824378016}, "topk": {"model_a": [63370, 2, 0.24998295307159424, [[50897, 0.396696, " amounts", false], [63370, 0.249983, " computation", false], [64423, 0.036658, " improvements", false], [22168, 0.031495, " new", false], [64862, 0.021716, " computational", false], [45, 0.020498, ",", false], [31458, 0.019133, " more", false], [59847, 0.019125, " increases", false], [63621, 0.015993, " improvement", false], [61535, 0.015844, " additional", false]]], "model_b": [63370, 2, 0.20766384899616241, [[50897, 0.527791, " amounts", false], [63370, 0.207664, " computation", false], [59346, 0.025802, " computing", false], [62426, 0.018299, " quantities", false], [45, 0.017623, ",", false], [59847, 0.017105, " increases", false], [52333, 0.016382, " numbers", false], [64423, 0.014297, " improvements", false], [64862, 0.008347, " computational", false], [31458, 0.008133, " more", false]]]}, "raw_delta": -0.015624999999999991, "tuned_delta": 0.03722994389819983}, {"byte_start": 4388, "byte_end": 4395, "display": {"text": " became", "kind": "normal"}, "is_word": true, "word_id": 749, "word_key": " became", "bytes_hex": "20 62 65 63 61 6d 65", "compression": {"model_a": "2.51% 2.51% 2.51% 2.51% 2.51% 2.51% 2.51%", "model_b": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%"}, "model_tokens": {"model_a": [[45283, " became", "normal", 0.37947309017181396]], "model_b": [[45283, " became", "normal", 0.25645196437835693]]}, "loss": {"model_a": 2.50579705065117, "model_b": 3.502077805729347}, "topk": {"model_a": [45283, 1, 0.37947309017181396, [[45283, 0.379473, " became", false], [22748, 0.227648, " was", false], [38128, 0.056042, " could", false], [21265, 0.053189, " and", false], [30383, 0.047735, " came", false], [51744, 0.021061, " finally", false], [4600, 0.014273, " is", false], [21795, 0.01327, " had", false], [45, 0.011303, ",", false], [61959, 0.009236, " eventually", false]]], "model_b": [45283, 1, 0.25645196437835693, [[45283, 0.256452, " became", false], [22748, 0.163918, " was", false], [21265, 0.094851, " and", false], [4600, 0.072699, " is", false], [38128, 0.065869, " could", false], [51019, 0.042586, " becomes", false], [21800, 0.028037, " has", false], [21413, 0.022032, " can", false], [45, 0.017662, ",", false], [21795, 0.010828, " had", false]]]}, "raw_delta": -0.05524553571428571, "tuned_delta": -0.0023905918160858908}, {"byte_start": 4395, "byte_end": 4405, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 750, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "model_b": "1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.6286380887031555]], "model_b": [[59206, " available", "normal", 0.48533299565315247]]}, "loss": {"model_a": 0.8488513302105472, "model_b": 1.296171325798678}, "topk": {"model_a": [59206, 1, 0.6286380887031555, [[59206, 0.628638, " available", false], [22590, 0.100742, " the", false], [31458, 0.035837, " more", false], [332, 0.026808, " a", false], [56895, 0.014868, " possible", false], [52648, 0.01374, " readily", false], [46042, 0.010703, " freely", false], [59758, 0.010176, " generally", false], [64430, 0.010156, " increasingly", false], [31466, 0.009551, " much", false]]], "model_b": [59206, 1, 0.48533299565315247, [[59206, 0.485333, " available", false], [22590, 0.057887, " the", false], [31458, 0.043007, " more", false], [52648, 0.035721, " readily", false], [62675, 0.025713, " ubiquitous", false], [31466, 0.023773, " much", false], [332, 0.020789, " a", false], [47792, 0.01756, " widely", false], [64430, 0.013239, " increasingly", false], [45820, 0.011769, " easily", false]]]}, "raw_delta": -0.024804687499999988, "tuned_delta": 0.028050256398199833}, {"byte_start": 4405, "byte_end": 4409, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 751, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "12.82% 12.82% 12.82% 12.82%", "model_b": "10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.058458633720874786]], "model_b": [[21265, " and", "normal", 0.09897954761981964]]}, "loss": {"model_a": 12.820825070399966, "model_b": 10.425725881424148}, "topk": {"model_a": [21265, 4, 0.058458633720874786, [[47, 0.342059, ".", false], [4811, 0.220399, " to", false], [4424, 0.083048, " at", false], [21265, 0.058459, " and", false], [45, 0.050706, ",", false], [52028, 0.044586, " instead", false], [21700, 0.040296, " for", false], [4596, 0.038313, " in", false], [32227, 0.030314, " that", false], [4423, 0.010007, " as", false]]], "model_b": [21265, 4, 0.09897954761981964, [[47, 0.245723, ".", false], [4424, 0.201676, " at", false], [4811, 0.164062, " to", false], [21265, 0.09898, " and", false], [45, 0.045116, ",", false], [21700, 0.041593, " for", false], [4596, 0.036574, " in", false], [32227, 0.021752, " that", false], [45145, 0.014391, " almost", false], [31466, 0.014224, " much", false]]]}, "raw_delta": 0.1328125, "tuned_delta": 0.18566744389819984}, {"byte_start": 4409, "byte_end": 4411, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 752, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "43.68% 43.68%", "model_b": "38.89% 38.89%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.00783795490860939]], "model_b": [[332, " a", "normal", 0.013349362649023533]]}, "loss": {"model_a": 43.67533815191197, "model_b": 38.88513977396034}, "topk": {"model_a": [332, 21, 0.00783795490860939, [[22590, 0.133592, " the", false], [38128, 0.093366, " could", false], [22748, 0.075814, " was", false], [4601, 0.041198, " it", false], [31351, 0.038126, " made", false], [50887, 0.02054, " allowed", false], [51596, 0.019992, " enabled", false], [22249, 0.017649, " out", false], [45, 0.015424, ",", false], [32227, 0.014165, " that", false]]], "model_b": [332, 11, 0.013349362649023533, [[22590, 0.084904, " the", false], [22748, 0.072187, " was", false], [38128, 0.034664, " could", false], [31458, 0.033619, " more", false], [59593, 0.023978, " effective", false], [31466, 0.02243, " much", false], [45283, 0.018349, " became", false], [51832, 0.01826, " general", false], [4601, 0.017567, " it", false], [45, 0.017546, ",", false]]]}, "raw_delta": 0.265625, "tuned_delta": 0.31847994389819984}, {"byte_start": 4411, "byte_end": 4417, "display": {"text": " means", "kind": "normal"}, "is_word": true, "word_id": 753, "word_key": " means", "bytes_hex": "20 6d 65 61 6e 73", "compression": {"model_a": "28.74% 28.74% 28.74% 28.74% 28.74% 28.74%", "model_b": "21.98% 21.98% 21.98% 21.98% 21.98% 21.98%"}, "model_tokens": {"model_a": [[38989, " means", "normal", 7.061094947857782e-05]], "model_b": [[38989, " means", "normal", 0.0006783679127693176]]}, "loss": {"model_a": 28.741190267709815, "model_b": 21.9785572635428}, "topk": {"model_a": [38989, 516, 7.061094947857782e-05, [[59513, 0.136203, " different", false], [45301, 0.124051, " better", false], [22168, 0.085293, " new", false], [63885, 0.061226, " statistical", false], [31458, 0.059176, " more", false], [31466, 0.05785, " much", false], [47202, 0.023225, " search", false], [51832, 0.021933, " general", false], [47708, 0.020311, " vastly", false], [52907, 0.019731, " simpler", false]]], "model_b": [38989, 160, 0.0006783679127693176, [[31466, 0.075546, " much", false], [51832, 0.051519, " general", false], [22168, 0.041704, " new", false], [31118, 0.040642, " huge", false], [38864, 0.034805, " large", false], [45301, 0.034267, " better", false], [52195, 0.032142, " massive", false], [31458, 0.030744, " more", false], [32373, 0.030157, " vast", false], [22031, 0.02407, " lot", false]]]}, "raw_delta": 0.375, "tuned_delta": 0.42785494389819984}, {"byte_start": 4417, "byte_end": 4421, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 754, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "11.20% 11.20% 11.20% 11.20%", "model_b": "13.31% 13.31% 13.31% 13.31%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.08328719437122345]], "model_b": [[22748, " was", "normal", 0.05150920897722244]]}, "loss": {"model_a": 11.20061091315162, "model_b": 13.313933726953811}, "topk": {"model_a": [22748, 3, 0.08328719437122345, [[4706, 0.54081, " of", false], [4811, 0.243293, " to", false], [22748, 0.083287, " was", false], [21700, 0.075617, " for", false], [38128, 0.011226, " could", false], [4450, 0.011117, " by", false], [51680, 0.005272, " existed", false], [32227, 0.002828, " that", false], [21795, 0.002679, " had", false], [38547, 0.002312, " found", false]]], "model_b": [22748, 4, 0.05150920897722244, [[4706, 0.539779, " of", false], [4811, 0.239649, " to", false], [21700, 0.089503, " for", false], [22748, 0.051509, " was", false], [4450, 0.015949, " by", false], [51680, 0.009929, " existed", false], [45283, 0.008647, " became", false], [38128, 0.0068, " could", false], [32227, 0.003702, " that", false], [59206, 0.002364, " available", false]]]}, "raw_delta": -0.1171875, "tuned_delta": -0.06433255610180018}, {"byte_start": 4421, "byte_end": 4427, "display": {"text": " found", "kind": "normal"}, "is_word": true, "word_id": 755, "word_key": " found", "bytes_hex": "20 66 6f 75 6e 64", "compression": {"model_a": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48%", "model_b": "2.63% 2.63% 2.63% 2.63% 2.63% 2.63%"}, "model_tokens": {"model_a": [[38547, " found", "normal", 0.8536377549171448]], "model_b": [[38547, " found", "normal", 0.4182043969631195]]}, "loss": {"model_a": 0.47549763310549326, "model_b": 2.6299128349538394}, "topk": {"model_a": [38547, 1, 0.8536377549171448, [[38547, 0.853638, " found", false], [61885, 0.041881, " discovered", false], [59506, 0.016462, " developed", false], [56976, 0.015115, " provided", false], [51744, 0.014668, " finally", false], [51458, 0.010308, " devised", false], [59206, 0.005845, " available", false], [56492, 0.004009, " invented", false], [4424, 0.003829, " at", false], [61959, 0.003535, " eventually", false]]], "model_b": [38547, 1, 0.4182043969631195, [[38547, 0.418204, " found", false], [59206, 0.189845, " available", false], [61885, 0.138903, " discovered", false], [56976, 0.029464, " provided", false], [46650, 0.02221, " needed", false], [59506, 0.018237, " developed", false], [31351, 0.015753, " made", false], [51351, 0.009378, " created", false], [4811, 0.00734, " to", false], [4424, 0.007024, " at", false]]]}, "raw_delta": -0.11946614583333336, "tuned_delta": -0.06661120193513353}, {"byte_start": 4427, "byte_end": 4430, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 756, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.29% 1.29% 1.29%", "model_b": "0.89% 0.89% 0.89%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8052122592926025]], "model_b": [[4811, " to", "normal", 0.8625483512878418]]}, "loss": {"model_a": 1.285604711729667, "model_b": 0.8864215135670307}, "topk": {"model_a": [4811, 1, 0.8052122592926025, [[4811, 0.805212, " to", false], [4706, 0.090304, " of", false], [21700, 0.046858, " for", false], [275, 0.013616, " (", false], [45, 0.011119, ",", false], [32227, 0.010141, " that", false], [4450, 0.007618, " by", false], [5346, 0.002955, "---", false], [22187, 0.001397, " not", false], [4596, 0.001298, " in", false]]], "model_b": [4811, 1, 0.8625483512878418, [[4811, 0.862548, " to", false], [21700, 0.05579, " for", false], [4706, 0.024703, " of", false], [32227, 0.021924, " that", false], [45, 0.006249, ",", false], [4450, 0.004554, " by", false], [4596, 0.004515, " in", false], [275, 0.003041, " (", false], [47, 0.002062, ".", false], [4424, 0.001628, " at", false]]]}, "raw_delta": 0.022135416666666668, "tuned_delta": 0.07499036056486649}, {"byte_start": 4430, "byte_end": 4434, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 757, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"model_a": "13.60% 13.60% 13.60% 13.60%", "model_b": "18.88% 18.88% 18.88% 18.88%"}, "model_tokens": {"model_a": [[22339, " put", "normal", 0.04838074371218681]], "model_b": [[22339, " put", "normal", 0.015104366466403008]]}, "loss": {"model_a": 13.595710102127438, "model_b": 18.879017136632918}, "topk": {"model_a": [22339, 7, 0.04838074371218681, [[22681, 0.135285, " use", false], [31358, 0.106162, " make", false], [56540, 0.099469, " leverage", false], [32187, 0.087481, " take", false], [53251, 0.064182, " utilize", false], [37911, 0.048908, " bring", false], [22339, 0.048381, " put", false], [37730, 0.037731, " apply", false], [51690, 0.025215, " exploit", false], [21751, 0.020758, " get", false]]], "model_b": [22339, 11, 0.015104366466403008, [[56540, 0.305945, " leverage", false], [53251, 0.087353, " utilize", false], [31358, 0.080746, " make", false], [22681, 0.077584, " use", false], [32187, 0.070676, " take", false], [51903, 0.032097, " harness", false], [37730, 0.024822, " apply", false], [51690, 0.022776, " exploit", false], [4435, 0.016464, " be", false], [51982, 0.015907, " improve", false]]]}, "raw_delta": -0.29296875, "tuned_delta": -0.24011380610180016}, {"byte_start": 4434, "byte_end": 4437, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 758, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "5.66% 5.66% 5.66%", "model_b": "7.70% 7.70% 7.70%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.390901118516922]], "model_b": [[4601, " it", "normal", 0.27781879901885986]]}, "loss": {"model_a": 5.659008868070314, "model_b": 7.7018875880791}, "topk": {"model_a": [4601, 2, 0.390901118516922, [[32227, 0.402083, " that", false], [4601, 0.390901, " it", false], [22590, 0.049291, " the", false], [52195, 0.02749, " massive", false], [21256, 0.014536, " all", false], [63370, 0.012006, " computation", false], [32234, 0.011407, " this", false], [31466, 0.010069, " much", false], [332, 0.009875, " a", false], [32139, 0.008208, " such", false]]], "model_b": [4601, 2, 0.27781879901885986, [[32227, 0.334996, " that", false], [4601, 0.277819, " it", false], [22590, 0.101601, " the", false], [31458, 0.029079, " more", false], [32234, 0.024942, " this", false], [52195, 0.015272, " massive", false], [31466, 0.014914, " much", false], [21256, 0.014497, " all", false], [332, 0.013192, " a", false], [39944, 0.011872, " those", false]]]}, "raw_delta": -0.11328125, "tuned_delta": -0.06042630610180018}, {"byte_start": 4437, "byte_end": 4440, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 759, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "2.13% 2.13% 2.13%", "model_b": "0.89% 0.89% 0.89%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7025048732757568]], "model_b": [[4811, " to", "normal", 0.8600413203239441]]}, "loss": {"model_a": 2.1250634961010935, "model_b": 0.8922918547164811}, "topk": {"model_a": [4811, 1, 0.7025048732757568, [[4811, 0.702505, " to", false], [4596, 0.098626, " in", false], [21256, 0.058248, " all", false], [31162, 0.054111, " into", false], [39934, 0.031923, " there", false], [4424, 0.016333, " at", false], [40185, 0.005146, " where", false], [46301, 0.005099, " inside", false], [63507, 0.003761, " effectively", false], [56003, 0.002716, " directly", false]]], "model_b": [4811, 1, 0.8600413203239441, [[4811, 0.860041, " to", false], [31162, 0.051064, " into", false], [4596, 0.019209, " in", false], [21256, 0.009015, " all", false], [4424, 0.008739, " at", false], [31458, 0.006716, " more", false], [63507, 0.005868, " effectively", false], [56003, 0.002745, " directly", false], [57435, 0.002123, " together", false], [31466, 0.001833, " much", false]]]}, "raw_delta": 0.068359375, "tuned_delta": 0.12121431889819982}, {"byte_start": 4440, "byte_end": 4445, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 760, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"model_a": "7.95% 7.95% 7.95% 7.95% 7.95%", "model_b": "7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"model_a": [[30992, " good", "normal", 0.10982763022184372]], "model_b": [[30992, " good", "normal", 0.12313564866781235]]}, "loss": {"model_a": 7.946093779896243, "model_b": 7.551606854653167}, "topk": {"model_a": [30992, 3, 0.10982763022184372, [[22681, 0.307719, " use", false], [32499, 0.243348, " work", false], [30992, 0.109828, " good", false], [45301, 0.085858, " better", false], [59593, 0.079113, " effective", false], [22590, 0.020739, " the", false], [31466, 0.020497, " much", false], [62383, 0.017599, " productive", false], [30273, 0.011012, " best", false], [31458, 0.007308, " more", false]]], "model_b": [30992, 3, 0.12313564866781235, [[22681, 0.232283, " use", false], [32499, 0.132664, " work", false], [30992, 0.123136, " good", false], [45301, 0.108756, " better", false], [59593, 0.048771, " effective", false], [31466, 0.039733, " much", false], [22590, 0.031306, " the", false], [31458, 0.019797, " more", false], [332, 0.017295, " a", false], [62383, 0.015213, " productive", false]]]}, "raw_delta": 0.021874999999999978, "tuned_delta": 0.0747299438981998}, {"byte_start": 4445, "byte_end": 4449, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 761, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "0.17% 0.17% 0.17% 0.17%", "model_b": "0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.9618926644325256]], "model_b": [[22681, " use", "normal", 0.9096100926399231]]}, "loss": {"model_a": 0.17390885655247207, "model_b": 0.42706731862252634}, "topk": {"model_a": [22681, 1, 0.9618926644325256, [[22681, 0.961893, " use", false], [45828, 0.008224, " effect", false], [45, 0.005287, ",", false], [59093, 0.004005, " advantage", false], [32499, 0.001997, " work", false], [21265, 0.001875, " and", false], [51832, 0.001627, " general", false], [50845, 0.001018, " account", false], [60212, 0.000923, " practical", false], [275, 0.00086, " (", false]]], "model_b": [22681, 1, 0.9096100926399231, [[22681, 0.90961, " use", false], [50845, 0.029854, " account", false], [45828, 0.014525, " effect", false], [32356, 0.007071, " uses", false], [32499, 0.005718, " work", false], [45, 0.004781, ",", false], [52610, 0.003457, " purpose", false], [52860, 0.002998, " service", false], [59593, 0.002039, " effective", false], [40083, 0.001837, " usage", false]]]}, "raw_delta": -0.0140380859375, "tuned_delta": 0.03881685796069982}, {"byte_start": 4449, "byte_end": 4450, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "3.56%", "model_b": "2.94%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8192779421806335]], "model_b": [[47, ".", "normal", 0.8490055799484253]]}, "loss": {"model_a": 3.557426736567024, "model_b": 2.9410409158747175}, "topk": {"model_a": [47, 1, 0.8192779421806335, [[47, 0.819278, ".", false], [4596, 0.050958, " in", false], [45, 0.028298, ",", false], [5346, 0.017326, "---", false], [53356, 0.017253, " without", false], [52028, 0.01038, " instead", false], [275, 0.005676, " (", false], [4450, 0.005481, " by", false], [21265, 0.003156, " and", false], [21700, 0.003109, " for", false]]], "model_b": [47, 1, 0.8490055799484253, [[47, 0.849006, ".", false], [4596, 0.067385, " in", false], [45, 0.023546, ",", false], [275, 0.004818, " (", false], [4450, 0.004503, " by", false], [5346, 0.004446, "---", false], [21700, 0.004348, " for", false], [21265, 0.002946, " and", false], [32487, 0.002404, " with", false], [53356, 0.00224, " without", false]]]}, "raw_delta": 0.0341796875, "tuned_delta": 0.08703463139819982}, {"byte_start": 4450, "byte_end": 4451, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "1.98%", "model_b": "5.25%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.8037527203559875]], "model_b": [[261, "\n\n", "control", 0.5625398755073547]]}, "loss": {"model_a": 1.9812401379395552, "model_b": 5.248084987608777}, "topk": {"model_a": [261, 1, 0.8037527203559875, [[261, 0.803753, "\n\n", false], [267, 0.021645, "  ", false], [20996, 0.019981, " The", false], [0, 0.013356, "[0]", false], [3913, 0.009986, " In", false], [3918, 0.008428, " It", false], [3336, 0.008236, " \n\n", false], [3328, 0.007841, "\n\n\n", false], [11, 0.007355, "\n", false], [29894, 0.005757, " This", false]]], "model_b": [261, 1, 0.5625398755073547, [[261, 0.56254, "\n\n", false], [11, 0.054229, "\n", false], [267, 0.05138, "  ", false], [20996, 0.041915, " The", false], [3913, 0.022766, " In", false], [3336, 0.020296, " \n\n", false], [29894, 0.018022, " This", false], [28753, 0.017174, " Deep", false], [0, 0.014694, "[0]", false], [3918, 0.009958, " It", false]]]}, "raw_delta": -0.18115234375, "tuned_delta": -0.12829739985180016}, {"byte_start": 4451, "byte_end": 4452, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "1.98%", "model_b": "5.25%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.8037527203559875]], "model_b": [[261, "\n\n", "control", 0.5625398755073547]]}, "loss": {"model_a": 1.9812401379395552, "model_b": 5.248084987608777}, "topk": {"model_a": [261, 1, 0.8037527203559875, [[261, 0.803753, "\n\n", false], [267, 0.021645, "  ", false], [20996, 0.019981, " The", false], [0, 0.013356, "[0]", false], [3913, 0.009986, " In", false], [3918, 0.008428, " It", false], [3336, 0.008236, " \n\n", false], [3328, 0.007841, "\n\n\n", false], [11, 0.007355, "\n", false], [29894, 0.005757, " This", false]]], "model_b": [261, 1, 0.5625398755073547, [[261, 0.56254, "\n\n", false], [11, 0.054229, "\n", false], [267, 0.05138, "  ", false], [20996, 0.041915, " The", false], [3913, 0.022766, " In", false], [3336, 0.020296, " \n\n", false], [29894, 0.018022, " This", false], [28753, 0.017174, " Deep", false], [0, 0.014694, "[0]", false], [3918, 0.009958, " It", false]]]}, "raw_delta": -0.18115234375, "tuned_delta": -0.12829739985180016}, {"byte_start": 4452, "byte_end": 4454, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 762, "word_key": "in", "bytes_hex": "49 6e", "compression": {"model_a": "11.34% 11.34%", "model_b": "13.24% 13.24%"}, "model_tokens": {"model_a": [[1136, "In", "normal", 0.28118252754211426]], "model_b": [[1136, "In", "normal", 0.2314680516719818]]}, "loss": {"model_a": 11.341499100738432, "model_b": 13.243489633160404}, "topk": {"model_a": [1136, 1, 0.28118252754211426, [[1136, 0.281183, "In", false], [6699, 0.127372, "The", false], [66, 0.062465, "A", false], [33504, 0.062036, "There", false], [33505, 0.032893, "These", false], [48358, 0.030664, "Another", false], [1141, 0.024833, "It", false], [24242, 0.015986, "This", false], [6393, 0.012421, "One", false], [5559, 0.011385, "All", false]]], "model_b": [1136, 1, 0.2314680516719818, [[1136, 0.231468, "In", false], [6699, 0.136472, "The", false], [33504, 0.044858, "There", false], [66, 0.036009, "A", false], [24242, 0.027205, "This", false], [23560, 0.018325, "Deep", false], [48358, 0.015165, "Another", false], [1141, 0.014472, "It", false], [6393, 0.01336, "One", false], [853, 0.011574, "As", false]]]}, "raw_delta": -0.10546875, "tuned_delta": -0.05261380610180018}, {"byte_start": 4454, "byte_end": 4463, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 763, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "3.26% 3.26% 3.26% 3.26% 3.26% 3.26% 3.26% 3.26% 3.26%", "model_b": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.19519005715847015]], "model_b": [[55809, " computer", "normal", 0.16911627352237701]]}, "loss": {"model_a": 3.2560825575618964, "model_b": 3.553513175800724}, "topk": {"model_a": [55809, 1, 0.19519005715847015, [[55809, 0.19519, " computer", false], [52766, 0.159425, " robotic", false], [22590, 0.091206, " the", false], [52299, 0.050789, " natural", false], [21256, 0.023348, " all", false], [52209, 0.021798, " medical", false], [38744, 0.021718, " image", false], [52167, 0.020798, " machine", false], [332, 0.016605, " a", false], [31370, 0.016007, " many", false]]], "model_b": [55809, 1, 0.16911627352237701, [[55809, 0.169116, " computer", false], [22590, 0.132576, " the", false], [52766, 0.049694, " robotic", false], [38744, 0.046679, " image", false], [52167, 0.031518, " machine", false], [21256, 0.023187, " all", false], [39193, 0.020884, " other", false], [52209, 0.019751, " medical", false], [31370, 0.019008, " many", false], [52299, 0.018998, " natural", false]]]}, "raw_delta": -0.016493055555555552, "tuned_delta": 0.03636188834264427}, {"byte_start": 4463, "byte_end": 4470, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 764, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "model_b": "1.97% 1.97% 1.97% 1.97% 1.97% 1.97% 1.97%"}, "model_tokens": {"model_a": [[47732, " vision", "normal", 0.9545140266418457]], "model_b": [[47732, " vision", "normal", 0.46053579449653625]]}, "loss": {"model_a": 0.121390268768995, "model_b": 1.9724346262153793}, "topk": {"model_a": [47732, 1, 0.9545140266418457, [[47732, 0.954514, " vision", false], [52814, 0.006095, " science", false], [63944, 0.004191, " translation", false], [46, 0.003382, "-", false], [56329, 0.002974, " graphics", false], [52766, 0.002701, " robotic", false], [56529, 0.002574, " language", false], [31044, 0.002107, " hand", false], [38744, 0.001634, " image", false], [45032, 0.001131, " Vision", false]]], "model_b": [47732, 1, 0.46053579449653625, [[47732, 0.460536, " vision", false], [56329, 0.185182, " graphics", false], [39082, 0.025234, " music", false], [38576, 0.022399, " games", false], [52209, 0.016389, " medical", false], [38013, 0.014516, " chess", false], [38744, 0.014439, " image", false], [52814, 0.012688, " science", false], [47202, 0.011017, " search", false], [40115, 0.010525, " video", false]]]}, "raw_delta": -0.10264369419642859, "tuned_delta": -0.04978875029822877}, {"byte_start": 4470, "byte_end": 4471, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.43%", "model_b": "1.52%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9239686727523804]], "model_b": [[45, ",", "normal", 0.919212281703949]]}, "loss": {"model_a": 1.4264928993164798, "model_b": 1.5233535282824135}, "topk": {"model_a": [45, 1, 0.9239686727523804, [[45, 0.923969, ",", false], [21265, 0.031889, " and", false], [275, 0.009167, " (", false], [39934, 0.006789, " there", false], [5346, 0.003794, "---", false], [57103, 0.003464, " research", false], [22590, 0.003072, " the", false], [22614, 0.002319, " too", false], [53087, 0.001331, " systems", false], [4423, 0.00107, " as", false]]], "model_b": [45, 1, 0.919212281703949, [[45, 0.919212, ",", false], [21265, 0.01933, " and", false], [275, 0.014279, " (", false], [57103, 0.007965, " research", false], [22590, 0.006555, " the", false], [39934, 0.006288, " there", false], [4596, 0.002279, " in", false], [53087, 0.001597, " systems", false], [4601, 0.001184, " it", false], [32234, 0.000949, " this", false]]]}, "raw_delta": -0.00537109375, "tuned_delta": 0.04748385014819982}, {"byte_start": 4471, "byte_end": 4477, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 765, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"model_a": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11%", "model_b": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"model_a": [[39934, " there", "normal", 0.12875375151634216]], "model_b": [[39934, " there", "normal", 0.13495494425296783]]}, "loss": {"model_a": 6.105154795428556, "model_b": 6.011229337037347}, "topk": {"model_a": [39934, 2, 0.12875375151634216, [[22590, 0.334547, " the", false], [39934, 0.128754, " there", false], [332, 0.065088, " a", false], [63843, 0.03896, " researchers", false], [4601, 0.022968, " it", false], [50919, 0.022073, " another", false], [37635, 0.015774, " again", false], [52224, 0.015081, " methods", false], [4596, 0.013767, " in", false], [22226, 0.012005, " one", false]]], "model_b": [39934, 2, 0.13495494425296783, [[22590, 0.263022, " the", false], [39934, 0.134955, " there", false], [332, 0.050106, " a", false], [63843, 0.036858, " researchers", false], [38328, 0.025749, " early", false], [4601, 0.018619, " it", false], [4596, 0.014946, " in", false], [32234, 0.014797, " this", false], [31466, 0.014079, " much", false], [22226, 0.014041, " one", false]]]}, "raw_delta": 0.00520833333333337, "tuned_delta": 0.05806327723153319}, {"byte_start": 4477, "byte_end": 4481, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 766, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"model_a": "9.02% 9.02% 9.02% 9.02%", "model_b": "12.33% 12.33% 12.33% 12.33%"}, "model_tokens": {"model_a": [[21800, " has", "normal", 0.1361512839794159]], "model_b": [[21800, " has", "normal", 0.06372544169425964]]}, "loss": {"model_a": 9.01684400555602, "model_b": 12.327716413846122}, "topk": {"model_a": [21800, 3, 0.1361512839794159, [[22748, 0.388868, " was", false], [32462, 0.231123, " were", false], [21800, 0.136151, " has", false], [31059, 0.104382, " have", false], [4600, 0.070452, " is", false], [21286, 0.041788, " are", false], [21795, 0.004284, " had", false], [22614, 0.002806, " too", false], [37635, 0.0028, " again", false], [30135, 0.002444, " also", false]]], "model_b": [21800, 3, 0.06372544169425964, [[22748, 0.461266, " was", false], [32462, 0.273814, " were", false], [21800, 0.063725, " has", false], [4600, 0.056866, " is", false], [21286, 0.054809, " are", false], [31059, 0.050435, " have", false], [30135, 0.007582, " also", false], [21795, 0.006675, " had", false], [22614, 0.005653, " too", false], [37828, 0.001437, " began", false]]]}, "raw_delta": -0.18359375, "tuned_delta": -0.13073880610180016}, {"byte_start": 4481, "byte_end": 4486, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 767, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"model_a": "0.99% 0.99% 0.99% 0.99% 0.99%", "model_b": "1.26% 1.26% 1.26% 1.26% 1.26%"}, "model_tokens": {"model_a": [[30259, " been", "normal", 0.7596845626831055]], "model_b": [[30259, " been", "normal", 0.7056357860565186]]}, "loss": {"model_a": 0.9932617224870304, "model_b": 1.2609492789019747}, "topk": {"model_a": [30259, 1, 0.7596845626831055, [[30259, 0.759685, " been", false], [30135, 0.147549, " also", false], [45150, 0.018458, " always", false], [22187, 0.011578, " not", false], [31323, 0.011249, " long", false], [56548, 0.005827, " likewise", false], [57036, 0.005646, " recently", false], [37635, 0.005386, " again", false], [45, 0.004018, ",", false], [60505, 0.003546, " similarly", false]]], "model_b": [30259, 1, 0.7056357860565186, [[30259, 0.705636, " been", false], [30135, 0.140773, " also", false], [45150, 0.072312, " always", false], [31323, 0.025192, " long", false], [22187, 0.008653, " not", false], [39115, 0.006584, " never", false], [39171, 0.00401, " often", false], [65026, 0.003298, " traditionally", false], [57036, 0.002976, " recently", false], [64409, 0.002874, " historically", false]]]}, "raw_delta": -0.014843749999999994, "tuned_delta": 0.038011193898199826}, {"byte_start": 4486, "byte_end": 4488, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 768, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "3.93% 3.93%", "model_b": "4.58% 4.58%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.6447088718414307]], "model_b": [[332, " a", "normal", 0.5983240604400635]]}, "loss": {"model_a": 3.9272582289824074, "model_b": 4.578866096571416}, "topk": {"model_a": [332, 1, 0.6447088718414307, [[332, 0.644709, " a", false], [4419, 0.127724, " an", false], [52906, 0.023164, " similar", false], [31466, 0.017394, " much", false], [50919, 0.017038, " another", false], [22590, 0.016972, " the", false], [30788, 0.012795, " even", false], [45, 0.012188, ",", false], [4692, 0.007633, " no", false], [31458, 0.006029, " more", false]]], "model_b": [332, 1, 0.5983240604400635, [[332, 0.598324, " a", false], [4419, 0.099246, " an", false], [31466, 0.04828, " much", false], [22590, 0.023889, " the", false], [4692, 0.018502, " no", false], [46454, 0.015228, " little", false], [32074, 0.012101, " some", false], [52906, 0.011725, " similar", false], [50919, 0.010812, " another", false], [31277, 0.008191, " less", false]]]}, "raw_delta": -0.0361328125, "tuned_delta": 0.01672213139819982}, {"byte_start": 4488, "byte_end": 4496, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 769, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"model_a": "1.80% 1.80% 1.80% 1.80% 1.80% 1.80% 1.80% 1.80%", "model_b": "2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59%"}, "model_tokens": {"model_a": [[52906, " similar", "normal", 0.45146411657333374]], "model_b": [[52906, " similar", "normal", 0.3159043788909912]]}, "loss": {"model_a": 1.7963243917318634, "model_b": 2.5888204469076856}, "topk": {"model_a": [52906, 1, 0.45146411657333374, [[52906, 0.451464, " similar", false], [31323, 0.116185, " long", false], [32386, 0.021845, " very", false], [47405, 0.017261, " steady", false], [52427, 0.016859, " pattern", false], [60505, 0.015364, " similarly", false], [61774, 0.012958, " continuing", false], [38961, 0.011791, " major", false], [61756, 0.011347, " consistent", false], [31466, 0.008692, " much", false]]], "model_b": [52906, 1, 0.3159043788909912, [[52906, 0.315904, " similar", false], [31323, 0.146468, " long", false], [56812, 0.024486, " parallel", false], [60505, 0.023552, " similarly", false], [32386, 0.014446, " very", false], [47436, 0.012362, " strong", false], [47405, 0.012226, " steady", false], [61756, 0.011576, " consistent", false], [38629, 0.010114, " great", false], [61774, 0.009094, " continuing", false]]]}, "raw_delta": -0.0439453125, "tuned_delta": 0.008909631398199822}, {"byte_start": 4496, "byte_end": 4504, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 770, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"model_a": "1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90%", "model_b": "2.11% 2.11% 2.11% 2.11% 2.11% 2.11% 2.11% 2.11%"}, "model_tokens": {"model_a": [[52427, " pattern", "normal", 0.4310145974159241]], "model_b": [[52427, " pattern", "normal", 0.3887821137905121]]}, "loss": {"model_a": 1.901990532421973, "model_b": 2.1133228138021924}, "topk": {"model_a": [52427, 1, 0.4310145974159241, [[52427, 0.431015, " pattern", false], [39831, 0.085086, " story", false], [51929, 0.065488, " history", false], [45, 0.049178, ",", false], [63797, 0.019521, " progression", false], [39664, 0.016128, " shift", false], [59657, 0.013782, " evolution", false], [62660, 0.013765, " transition", false], [63361, 0.013583, " competition", false], [57328, 0.012598, " struggle", false]]], "model_b": [52427, 1, 0.3887821137905121, [[52427, 0.388782, " pattern", false], [40009, 0.089699, " trend", false], [39831, 0.021551, " story", false], [51929, 0.017627, " history", false], [59657, 0.016044, " evolution", false], [63469, 0.014879, " development", false], [57404, 0.014161, " tendency", false], [63797, 0.012633, " progression", false], [62315, 0.012413, " phenomenon", false], [45, 0.009414, ",", false]]]}, "raw_delta": -0.01171875, "tuned_delta": 0.04113619389819982}, {"byte_start": 4504, "byte_end": 4505, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "15.92%", "model_b": "17.75%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.41580042243003845]], "model_b": [[47, ".", "normal", 0.3697695732116699]]}, "loss": {"model_a": 15.920365197309849, "model_b": 17.751911635938416}, "topk": {"model_a": [47, 1, 0.41580042243003845, [[47, 0.4158, ".", false], [4706, 0.321526, " of", false], [45, 0.145444, ",", false], [31601, 0.021284, " over", false], [4596, 0.01585, " in", false], [59, 0.015535, ":", false], [5346, 0.006903, "---", false], [39690, 0.006146, " since", false], [32487, 0.005998, " with", false], [21700, 0.004646, " for", false]]], "model_b": [47, 1, 0.3697695732116699, [[47, 0.36977, ".", false], [4706, 0.341122, " of", false], [45, 0.111483, ",", false], [4596, 0.036863, " in", false], [31601, 0.024559, " over", false], [59, 0.016173, ":", false], [4811, 0.012249, " to", false], [32487, 0.012074, " with", false], [39690, 0.008836, " since", false], [5346, 0.008477, "---", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 4505, "byte_end": 4511, "display": {"text": " Early", "kind": "normal"}, "is_word": true, "word_id": 771, "word_key": " early", "bytes_hex": "20 45 61 72 6c 79", "compression": {"model_a": "5.52% 5.52% 5.52% 5.52% 5.52% 5.52%", "model_b": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57%"}, "model_tokens": {"model_a": [[36607, " Early", "normal", 0.15879465639591217]], "model_b": [[36607, " Early", "normal", 0.11271493136882782]]}, "loss": {"model_a": 5.518120680483502, "model_b": 6.574782087384598}, "topk": {"model_a": [36607, 2, 0.15879465639591217, [[20996, 0.164847, " The", false], [36607, 0.158795, " Early", false], [3913, 0.085369, " In", false], [37451, 0.045746, " There", false], [63222, 0.036884, " Researchers", false], [19907, 0.030073, " For", false], [50438, 0.022487, " Methods", false], [58864, 0.019879, " Initially", false], [3642, 0.017827, " At", false], [36809, 0.016896, " Human", false]]], "model_b": [36607, 2, 0.11271493136882782, [[20996, 0.119937, " The", false], [36607, 0.112715, " Early", false], [3913, 0.11041, " In", false], [54932, 0.044093, " Computer", false], [63222, 0.03246, " Researchers", false], [36809, 0.029291, " Human", false], [37451, 0.026261, " There", false], [19907, 0.025207, " For", false], [3642, 0.02448, " At", false], [300, 0.018341, " A", false]]]}, "raw_delta": -0.05859375, "tuned_delta": -0.0057388061018001785}, {"byte_start": 4511, "byte_end": 4519, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 772, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "3.17% 3.17% 3.17% 3.17% 3.17% 3.17% 3.17% 3.17%", "model_b": "4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.24330653250217438]], "model_b": [[52224, " methods", "normal", 0.11831909418106079]]}, "loss": {"model_a": 3.1699842207032884, "model_b": 4.825420424848339}, "topk": {"model_a": [52224, 1, 0.24330653250217438, [[52224, 0.243307, " methods", false], [55809, 0.105895, " computer", false], [51566, 0.1031, " efforts", false], [57103, 0.101409, " research", false], [32499, 0.060694, " work", false], [61590, 0.049565, " approaches", false], [63843, 0.044451, " researchers", false], [55572, 0.031297, " attempts", false], [4596, 0.029802, " in", false], [4712, 0.029164, " on", false]]], "model_b": [52224, 2, 0.11831909418106079, [[57103, 0.13164, " research", false], [52224, 0.118319, " methods", false], [51566, 0.117416, " efforts", false], [55809, 0.084006, " computer", false], [61590, 0.062992, " approaches", false], [32499, 0.062757, " work", false], [47732, 0.052588, " vision", false], [63843, 0.03903, " researchers", false], [55572, 0.033117, " attempts", false], [3609, 0.029925, " AI", false]]]}, "raw_delta": -0.091796875, "tuned_delta": -0.03894193110180018}, {"byte_start": 4519, "byte_end": 4529, "display": {"text": " conceived", "kind": "normal"}, "is_word": true, "word_id": 773, "word_key": " conceived", "bytes_hex": "20 63 6f 6e 63 65 69 76 65 64", "compression": {"model_a": "19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16%", "model_b": "18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82%"}, "model_tokens": {"model_a": [[59348, " conceived", "normal", 2.4193588615162298e-05]], "model_b": [[59348, " conceived", "normal", 3.0203440473997034e-05]]}, "loss": {"model_a": 19.160793511806542, "model_b": 18.82266186159819}, "topk": {"model_a": [59348, 511, 2.4193588615162298e-05, [[32462, 0.183883, " were", false], [47054, 0.115783, " relied", false], [45, 0.085555, ",", false], [4596, 0.079098, " in", false], [32354, 0.072028, " used", false], [21700, 0.049279, " for", false], [32227, 0.035982, " that", false], [40013, 0.035713, " tried", false], [4706, 0.025794, " of", false], [56427, 0.02504, " included", false]]], "model_b": [59348, 537, 3.0203440473997034e-05, [[32462, 0.191338, " were", false], [47054, 0.125212, " relied", false], [32354, 0.073703, " used", false], [45, 0.067709, ",", false], [51770, 0.067284, " focused", false], [32227, 0.062323, " that", false], [4596, 0.054192, " in", false], [37810, 0.03174, " based", false], [32272, 0.019188, " took", false], [56540, 0.015847, " leverage", false]]]}, "raw_delta": 0.018750000000000044, "tuned_delta": 0.07160494389819987}, {"byte_start": 4529, "byte_end": 4532, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 774, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "5.49% 5.49% 5.49%", "model_b": "1.66% 1.66% 1.66%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.4019838273525238]], "model_b": [[4706, " of", "normal", 0.7593581080436707]]}, "loss": {"model_a": 5.4946393158857, "model_b": 1.6554362041450505}, "topk": {"model_a": [4706, 1, 0.4019838273525238, [[4706, 0.401984, " of", false], [4450, 0.194099, " by", false], [4596, 0.084948, " in", false], [4811, 0.050233, " to", false], [21265, 0.031357, " and", false], [4423, 0.023332, " as", false], [30917, 0.017399, " from", false], [4712, 0.012904, " on", false], [332, 0.012485, " a", false], [32487, 0.011141, " with", false]]], "model_b": [4706, 1, 0.7593581080436707, [[4706, 0.759358, " of", false], [4450, 0.029551, " by", false], [4423, 0.023268, " as", false], [4596, 0.01986, " in", false], [22590, 0.01908, " the", false], [332, 0.016451, " a", false], [21265, 0.01326, " and", false], [39931, 0.011692, " their", false], [32227, 0.010789, " that", false], [4811, 0.006439, " to", false]]]}, "raw_delta": 0.212890625, "tuned_delta": 0.26574556889819984}, {"byte_start": 4532, "byte_end": 4539, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 775, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"model_a": "8.29% 8.29% 8.29% 8.29% 8.29% 8.29% 8.29%", "model_b": "5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09%"}, "model_tokens": {"model_a": [[47732, " vision", "normal", 0.04020076245069504]], "model_b": [[47732, " vision", "normal", 0.14037011563777924]]}, "loss": {"model_a": 8.29227618368098, "model_b": 5.092101637066235}, "topk": {"model_a": [47732, 7, 0.04020076245069504, [[4423, 0.19262, " as", false], [4450, 0.09907, " by", false], [22590, 0.09261, " the", false], [332, 0.086428, " a", false], [55809, 0.05502, " computer", false], [4596, 0.042157, " in", false], [47732, 0.040201, " vision", false], [47734, 0.021169, " visual", false], [38744, 0.017686, " image", false], [46249, 0.017642, " images", false]]], "model_b": [47732, 2, 0.14037011563777924, [[22590, 0.227281, " the", false], [47732, 0.14037, " vision", false], [55809, 0.05542, " computer", false], [332, 0.055311, " a", false], [59345, 0.03701, " computers", false], [39931, 0.036427, " their", false], [38720, 0.034301, " human", false], [38744, 0.02353, " image", false], [46249, 0.020506, " images", false], [46227, 0.018265, " humans", false]]]}, "raw_delta": 0.17745535714285707, "tuned_delta": 0.23031030104105688}, {"byte_start": 4539, "byte_end": 4542, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 776, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "2.52% 2.52% 2.52%", "model_b": "1.93% 1.93% 1.93%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.6589464545249939]], "model_b": [[4423, " as", "normal", 0.7241610884666443]]}, "loss": {"model_a": 2.52424669426373, "model_b": 1.925471897019775}, "topk": {"model_a": [4423, 1, 0.6589464545249939, [[4423, 0.658946, " as", false], [4596, 0.136082, " in", false], [53087, 0.041884, " systems", false], [39898, 0.025654, " tasks", false], [56939, 0.023246, " problems", false], [30917, 0.009735, " from", false], [4450, 0.009104, " by", false], [62378, 0.006085, " processing", false], [45, 0.006038, ",", false], [21265, 0.005476, " and", false]]], "model_b": [4423, 1, 0.7241610884666443, [[4423, 0.724161, " as", false], [4596, 0.131135, " in", false], [53087, 0.034357, " systems", false], [53140, 0.008718, " through", false], [45, 0.007889, ",", false], [4450, 0.007637, " by", false], [30917, 0.006197, " from", false], [21265, 0.006017, " and", false], [22187, 0.005151, " not", false], [275, 0.003956, " (", false]]]}, "raw_delta": 0.033203125000000014, "tuned_delta": 0.08605806889819984}, {"byte_start": 4542, "byte_end": 4552, "display": {"text": " searching", "kind": "normal"}, "is_word": true, "word_id": 777, "word_key": " searching", "bytes_hex": "20 73 65 61 72 63 68 69 6e 67", "compression": {"model_a": "14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88%", "model_b": "9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52%"}, "model_tokens": {"model_a": [[60463, " searching", "normal", 0.00026852163136936724]], "model_b": [[60463, " searching", "normal", 0.00512682693079114]]}, "loss": {"model_a": 14.877792609167432, "model_b": 9.524041480868547}, "topk": {"model_a": [60463, 145, 0.00026852163136936724, [[332, 0.474991, " a", false], [37832, 0.088455, " being", false], [4419, 0.065871, " an", false], [22590, 0.036053, " the", false], [60522, 0.026704, " something", false], [63541, 0.019683, " essentially", false], [52906, 0.014641, " similar", false], [59134, 0.012084, " analogous", false], [59927, 0.011414, " involving", false], [4404, 0.010145, " ``", false]]], "model_b": [60463, 16, 0.00512682693079114, [[332, 0.423857, " a", false], [4419, 0.053128, " an", false], [22590, 0.042831, " the", false], [37832, 0.039841, " being", false], [60522, 0.0342, " something", false], [46170, 0.019335, " having", false], [32074, 0.017881, " some", false], [4404, 0.015681, " ``", false], [4588, 0.013758, " if", false], [31198, 0.011446, " just", false]]]}, "raw_delta": 0.296875, "tuned_delta": 0.34972994389819984}, {"byte_start": 4552, "byte_end": 4556, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 778, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "3.52% 3.52% 3.52% 3.52%", "model_b": "6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.45727473497390747]], "model_b": [[21700, " for", "normal", 0.25192925333976746]]}, "loss": {"model_a": 3.5222046896703203, "model_b": 6.269524347613171}, "topk": {"model_a": [21700, 1, 0.45727473497390747, [[21700, 0.457275, " for", false], [53140, 0.13504, " through", false], [332, 0.087673, " a", false], [22590, 0.051937, " the", false], [4596, 0.045779, " in", false], [31601, 0.034268, " over", false], [45, 0.02859, ",", false], [5346, 0.014722, "---", false], [4419, 0.013284, " an", false], [21265, 0.009861, " and", false]]], "model_b": [21700, 1, 0.25192925333976746, [[21700, 0.251929, " for", false], [53140, 0.220529, " through", false], [332, 0.08126, " a", false], [4596, 0.077679, " in", false], [45, 0.054558, ",", false], [22590, 0.041738, " the", false], [31601, 0.025354, " over", false], [21265, 0.019676, " and", false], [4419, 0.019508, " an", false], [37694, 0.014671, " among", false]]]}, "raw_delta": -0.15234375, "tuned_delta": -0.09948880610180018}, {"byte_start": 4556, "byte_end": 4562, "display": {"text": " edges", "kind": "normal"}, "is_word": true, "word_id": 779, "word_key": " edges", "bytes_hex": "20 65 64 67 65 73", "compression": {"model_a": "11.60% 11.60% 11.60% 11.60% 11.60% 11.60%", "model_b": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%"}, "model_tokens": {"model_a": [[38332, " edges", "normal", 0.02123800478875637]], "model_b": [[38332, " edges", "normal", 0.009637332521378994]]}, "loss": {"model_a": 11.599794111314255, "model_b": 13.994893300290073}, "topk": {"model_a": [38332, 8, 0.02123800478875637, [[52342, 0.235149, " objects", false], [56832, 0.074266, " patterns", false], [56215, 0.063349, " features", false], [332, 0.037032, " a", false], [57271, 0.031113, " specific", false], [47734, 0.027918, " visual", false], [22590, 0.021916, " the", false], [38332, 0.021238, " edges", false], [4404, 0.020875, " ``", false], [46691, 0.018113, " object", false]]], "model_b": [38332, 17, 0.009637332521378994, [[52342, 0.207304, " objects", false], [332, 0.089049, " a", false], [47539, 0.057793, " things", false], [56832, 0.049579, " patterns", false], [22590, 0.036255, " the", false], [21265, 0.035479, " and", false], [57271, 0.034007, " specific", false], [62293, 0.024371, " particular", false], [4404, 0.022404, " ``", false], [56215, 0.019393, " features", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07995755610180018}, {"byte_start": 4562, "byte_end": 4563, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "21.84%", "model_b": "26.06%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.29853132367134094]], "model_b": [[45, ",", "normal", 0.2341333031654358]]}, "loss": {"model_a": 21.837669075955986, "model_b": 26.06431470356037}, "topk": {"model_a": [45, 1, 0.29853132367134094, [[45, 0.298531, ",", false], [21265, 0.28695, " and", false], [4596, 0.150493, " in", false], [4715, 0.112244, " or", false], [47, 0.033974, ".", false], [275, 0.023878, " (", false], [5346, 0.023817, "---", false], [4706, 0.011243, " of", false], [4811, 0.010022, " to", false], [32227, 0.006516, " that", false]]], "model_b": [45, 2, 0.2341333031654358, [[21265, 0.302598, " and", false], [45, 0.234133, ",", false], [4596, 0.200827, " in", false], [4715, 0.070067, " or", false], [275, 0.037733, " (", false], [47, 0.028381, ".", false], [4706, 0.023901, " of", false], [4811, 0.011667, " to", false], [5346, 0.01108, "---", false], [4712, 0.010073, " on", false]]]}, "raw_delta": -0.234375, "tuned_delta": -0.18152005610180016}, {"byte_start": 4563, "byte_end": 4566, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 780, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "8.22% 8.22% 8.22%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.254032701253891]], "model_b": [[4715, " or", "normal", 0.11065591871738434]]}, "loss": {"model_a": 8.218477609230748, "model_b": 13.243489633160404}, "topk": {"model_a": [4715, 1, 0.254032701253891, [[4715, 0.254033, " or", false], [21265, 0.185121, " and", false], [51327, 0.067708, " corners", false], [32230, 0.038666, " then", false], [21700, 0.029028, " for", false], [40186, 0.027936, " which", false], [38905, 0.026207, " lines", false], [47253, 0.02212, " shapes", false], [40085, 0.017819, " using", false], [4423, 0.014222, " as", false]]], "model_b": [4715, 2, 0.11065591871738434, [[51327, 0.12772, " corners", false], [4715, 0.110656, " or", false], [21265, 0.109862, " and", false], [38905, 0.0628, " lines", false], [55852, 0.040632, " contours", false], [21700, 0.030498, " for", false], [4423, 0.025297, " as", false], [59498, 0.017971, " detecting", false], [47253, 0.01693, " shapes", false], [52157, 0.012659, " looking", false]]]}, "raw_delta": -0.2786458333333333, "tuned_delta": -0.22579088943513348}, {"byte_start": 4566, "byte_end": 4578, "display": {"text": " generalized", "kind": "normal"}, "is_word": true, "word_id": 781, "word_key": " generalized", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 65 64", "compression": {"model_a": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[63594, " generalized", "normal", 5.800587314297445e-05]], "model_b": [[63594, " generalized", "normal", 9.106906873057596e-06]]}, "loss": {"model_a": 14.652371509028534, "model_b": 17.47013526076479}, "topk": {"model_a": [63594, 656, 5.800587314297445e-05, [[21700, 0.242455, " for", false], [39193, 0.085076, " other", false], [47253, 0.037796, " shapes", false], [38905, 0.03318, " lines", false], [4423, 0.024121, " as", false], [51327, 0.023492, " corners", false], [57413, 0.023159, " textures", false], [55852, 0.021868, " contours", false], [31458, 0.021622, " more", false], [56215, 0.018841, " features", false]]], "model_b": [63594, 2594, 9.106906873057596e-06, [[4423, 0.111164, " as", false], [21700, 0.085486, " for", false], [59498, 0.048753, " detecting", false], [38905, 0.037151, " lines", false], [51746, 0.032181, " finding", false], [4404, 0.031725, " ``", false], [39193, 0.029944, " other", false], [55852, 0.023635, " contours", false], [52342, 0.021127, " objects", false], [56215, 0.01962, " features", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 4578, "byte_end": 4588, "display": {"text": " cylinders", "kind": "normal"}, "is_word": true, "word_id": 782, "word_key": " cylinders", "bytes_hex": "20 63 79 6c 69 6e 64 65 72 73", "compression": {"model_a": "19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84%", "model_b": "19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84%"}, "model_tokens": {"model_a": [[59439, " cylinders", "normal", 1.673819679126609e-05]], "model_b": [[59439, " cylinders", "normal", 1.709010757622309e-05]]}, "loss": {"model_a": 19.837056812223242, "model_b": 19.837056812223242}, "topk": {"model_a": [59439, 1134, 1.673819679126609e-05, [[38332, 0.334704, " edges", false], [47253, 0.062111, " shapes", false], [30729, 0.052971, " edge", false], [32229, 0.029605, " them", false], [57527, 0.028095, " versions", false], [22590, 0.025775, " the", false], [4811, 0.025238, " to", false], [56215, 0.023479, " features", false], [32227, 0.02088, " that", false], [39936, 0.019165, " these", false]]], "model_b": [59439, 1920, 1.709010757622309e-05, [[56215, 0.060834, " features", false], [47253, 0.048752, " shapes", false], [39654, 0.036522, " shape", false], [4423, 0.031518, " as", false], [38332, 0.0301, " edges", false], [22590, 0.026433, " the", false], [46691, 0.022281, " object", false], [38744, 0.02041, " image", false], [4811, 0.019628, " to", false], [55852, 0.018966, " contours", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 4588, "byte_end": 4589, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "11.98%", "model_b": "7.15%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5138809680938721]], "model_b": [[45, ",", "normal", 0.6744356751441956]]}, "loss": {"model_a": 11.97549594487909, "model_b": 7.15007552003075}, "topk": {"model_a": [45, 1, 0.5138809680938721, [[45, 0.513881, ",", false], [47, 0.081153, ".", false], [4715, 0.06944, " or", false], [21265, 0.059133, " and", false], [275, 0.058501, " (", false], [4596, 0.047148, " in", false], [4706, 0.028019, " of", false], [32227, 0.02138, " that", false], [5346, 0.018775, "---", false], [21700, 0.010862, " for", false]]], "model_b": [45, 1, 0.6744356751441956, [[45, 0.674436, ",", false], [47, 0.132617, ".", false], [21265, 0.031843, " and", false], [275, 0.030632, " (", false], [4715, 0.027644, " or", false], [4596, 0.021642, " in", false], [5346, 0.012803, "---", false], [4706, 0.011275, " of", false], [60, 0.00822, ";", false], [32227, 0.007306, " that", false]]]}, "raw_delta": 0.267578125, "tuned_delta": 0.32043306889819984}, {"byte_start": 4589, "byte_end": 4592, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 783, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "4.32% 4.32% 4.32%", "model_b": "4.13% 4.13% 4.13%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.48613473773002625]], "model_b": [[4715, " or", "normal", 0.5044907331466675]]}, "loss": {"model_a": 4.320571085995593, "model_b": 4.132720169213176}, "topk": {"model_a": [4715, 1, 0.48613473773002625, [[4715, 0.486135, " or", false], [21265, 0.119562, " and", false], [4596, 0.109432, " in", false], [21643, 0.066589, " etc", false], [40186, 0.017898, " which", false], [32227, 0.017812, " that", false], [4811, 0.016877, " to", false], [4423, 0.011352, " as", false], [32487, 0.007511, " with", false], [40085, 0.006297, " using", false]]], "model_b": [4715, 1, 0.5044907331466675, [[4715, 0.504491, " or", false], [21265, 0.135086, " and", false], [4596, 0.104945, " in", false], [21643, 0.030875, " etc", false], [40186, 0.01661, " which", false], [32227, 0.016464, " that", false], [4811, 0.013682, " to", false], [4423, 0.010999, " as", false], [21400, 0.009992, " but", false], [37694, 0.009725, " among", false]]]}, "raw_delta": 0.010416666666666685, "tuned_delta": 0.0632716105648665}, {"byte_start": 4592, "byte_end": 4595, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 784, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "33.06% 33.06% 33.06%", "model_b": "33.25% 33.25% 33.25%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.004047906957566738]], "model_b": [[4596, " in", "normal", 0.003914339933544397]]}, "loss": {"model_a": 33.06176135370541, "model_b": 33.24961227048782}, "topk": {"model_a": [4596, 36, 0.004047906957566738, [[39193, 0.16138, " other", false], [63594, 0.107968, " generalized", false], [32074, 0.064557, " some", false], [38905, 0.026316, " lines", false], [22590, 0.018553, " the", false], [31458, 0.017928, " more", false], [30788, 0.017164, " even", false], [57564, 0.014803, " whatever", false], [37865, 0.014077, " blobs", false], [52906, 0.012295, " similar", false]]], "model_b": [4596, 45, 0.003914339933544397, [[39193, 0.122527, " other", false], [57564, 0.059795, " whatever", false], [32074, 0.030876, " some", false], [60522, 0.026333, " something", false], [30788, 0.023947, " even", false], [4423, 0.020171, " as", false], [38905, 0.020031, " lines", false], [22590, 0.017251, " the", false], [52906, 0.014361, " similar", false], [4404, 0.014354, " ``", false]]]}, "raw_delta": -0.01041666666666674, "tuned_delta": 0.04243827723153308}, {"byte_start": 4595, "byte_end": 4601, "display": {"text": " terms", "kind": "normal"}, "is_word": true, "word_id": 785, "word_key": " terms", "bytes_hex": "20 74 65 72 6d 73", "compression": {"model_a": "10.24% 10.24% 10.24% 10.24% 10.24% 10.24%", "model_b": "21.04% 21.04% 21.04% 21.04% 21.04% 21.04%"}, "model_tokens": {"model_a": [[39920, " terms", "normal", 0.03327147290110588]], "model_b": [[39920, " terms", "normal", 0.0008972890209406614]]}, "loss": {"model_a": 10.237874964641732, "model_b": 21.039302679630715}, "topk": {"model_a": [39920, 6, 0.03327147290110588, [[32074, 0.26078, " some", false], [39193, 0.216625, " other", false], [22590, 0.091082, " the", false], [51832, 0.06529, " general", false], [332, 0.052945, " a", false], [39920, 0.033271, " terms", false], [31458, 0.03, " more", false], [22226, 0.018805, " one", false], [31370, 0.016635, " many", false], [53265, 0.012637, " various", false]]], "model_b": [39920, 64, 0.0008972890209406614, [[32074, 0.274833, " some", false], [39193, 0.148516, " other", false], [22590, 0.142246, " the", false], [51832, 0.091873, " general", false], [332, 0.052816, " a", false], [31370, 0.029835, " many", false], [21273, 0.028507, " any", false], [22226, 0.028062, " one", false], [32234, 0.009104, " this", false], [57564, 0.005891, " whatever", false]]]}, "raw_delta": -0.5989583333333334, "tuned_delta": -0.5461033894351336}, {"byte_start": 4601, "byte_end": 4604, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 786, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.10% 0.10% 0.10%", "model_b": "0.13% 0.13% 0.13%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9841862320899963]], "model_b": [[4706, " of", "normal", 0.9782590866088867]]}, "loss": {"model_a": 0.0961268363222525, "model_b": 0.1313488832189557}, "topk": {"model_a": [4706, 1, 0.9841862320899963, [[4706, 0.984186, " of", false], [32227, 0.00356, " that", false], [31458, 0.002669, " more", false], [39193, 0.001337, " other", false], [52906, 0.000982, " similar", false], [31296, 0.000493, " like", false], [52693, 0.000321, " related", false], [56205, 0.000225, " familiar", false], [32139, 0.000189, " such", false], [45, 0.000166, ",", false]]], "model_b": [4706, 1, 0.9782590866088867, [[4706, 0.978259, " of", false], [32227, 0.005613, " that", false], [31296, 0.002067, " like", false], [31458, 0.001514, " more", false], [52906, 0.001252, " similar", false], [45, 0.000317, ",", false], [32139, 0.000304, " such", false], [4423, 0.000292, " as", false], [40185, 0.000276, " where", false], [56205, 0.000262, " familiar", false]]]}, "raw_delta": -0.001953125, "tuned_delta": 0.05090181889819982}, {"byte_start": 4604, "byte_end": 4607, "display": {"text": " SI", "kind": "normal"}, "is_word": true, "word_id": 787, "word_key": " si", "bytes_hex": "20 53 49", "compression": {"model_a": "47.71% 47.71% 47.71%", "model_b": "61.99% 61.99% 61.99%"}, "model_tokens": {"model_a": [[4191, " SI", "normal", 0.00036058356636203825]], "model_b": [[4191, " SI", "normal", 3.330556501168758e-05]]}, "loss": {"model_a": 47.71413286273394, "model_b": 61.99080253819764}, "topk": {"model_a": [4191, 322, 0.00036058356636203825, [[332, 0.088068, " a", false], [22590, 0.062393, " the", false], [31044, 0.031961, " hand", false], [39193, 0.03179, " other", false], [38720, 0.031264, " human", false], [32074, 0.021521, " some", false], [63885, 0.014549, " statistical", false], [59767, 0.013869, " geometric", false], [51725, 0.013863, " feature", false], [47734, 0.012416, " visual", false]]], "model_b": [4191, 2104, 3.330556501168758e-05, [[22590, 0.074748, " the", false], [332, 0.029537, " a", false], [4404, 0.022178, " ``", false], [39654, 0.018245, " shape", false], [38744, 0.016155, " image", false], [38083, 0.015765, " color", false], [38720, 0.014661, " human", false], [59767, 0.013741, " geometric", false], [21835, 0.011067, " how", false], [38924, 0.010606, " local", false]]]}, "raw_delta": -0.7916666666666665, "tuned_delta": -0.7388117227684667}, {"byte_start": 4607, "byte_end": 4609, "display": {"text": "FT", "kind": "normal"}, "is_word": true, "word_id": 788, "word_key": "ft", "bytes_hex": "46 54", "compression": {"model_a": "0.01% 0.01%", "model_b": "0.08% 0.08%"}, "model_tokens": {"model_a": [[1023, "FT", "normal", 0.9992585778236389]], "model_b": [[1023, "FT", "normal", 0.9910759925842285]]}, "loss": {"model_a": 0.006741719913822098, "model_b": 0.08145098344862615}, "topk": {"model_a": [1023, 1, 0.9992585778236389, [[1023, 0.999259, "FT", false], [1885, 0.000169, "ft", false], [83, 0.000113, "R", false], [904, 5.6e-05, "CK", false], [824, 2.1e-05, "AM", false], [1021, 2e-05, "FR", false], [6493, 1.8e-05, "REN", false], [56907, 1.4e-05, " prefixes", false], [71, 1.4e-05, "F", false], [909, 1.1e-05, "CP", false]]], "model_b": [1023, 1, 0.9910759925842285, [[1023, 0.991076, "FT", false], [71, 0.000768, "F", false], [83, 0.000523, "R", false], [68, 0.000436, "C", false], [69, 0.000399, "D", false], [85, 0.000326, "T", false], [1272, 0.000271, "NG", false], [1401, 0.000268, "RI", false], [84, 0.000266, "S", false], [87, 0.000259, "V", false]]]}, "raw_delta": -0.00414276123046875, "tuned_delta": 0.04871218266773107}, {"byte_start": 4609, "byte_end": 4618, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 789, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"model_a": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "model_b": "4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48%"}, "model_tokens": {"model_a": [[56215, " features", "normal", 0.23963482677936554]], "model_b": [[56215, " features", "normal", 0.10682279616594315]]}, "loss": {"model_a": 2.880380723997062, "model_b": 4.4771135166476075}, "topk": {"model_a": [56215, 1, 0.23963482677936554, [[56215, 0.239635, " features", false], [45, 0.149875, ",", false], [275, 0.107762, " (", false], [63458, 0.101873, " descriptors", false], [4715, 0.074171, " or", false], [21265, 0.073086, " and", false], [47, 0.043812, ".", false], [46, 0.019654, "-", false], [59940, 0.018834, " keypoints", false], [51725, 0.016694, " feature", false]]], "model_b": [56215, 3, 0.10682279616594315, [[45, 0.26291, ",", false], [275, 0.117911, " (", false], [56215, 0.106823, " features", false], [4715, 0.082903, " or", false], [21265, 0.065976, " and", false], [47, 0.04931, ".", false], [63458, 0.030074, " descriptors", false], [46, 0.013847, "-", false], [460, 0.009896, "'s", false], [21700, 0.008868, " for", false]]]}, "raw_delta": -0.08854166666666669, "tuned_delta": -0.035686722768466864}, {"byte_start": 4618, "byte_end": 4619, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "20.43%", "model_b": "21.98%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.321269690990448]], "model_b": [[47, ".", "normal", 0.29580068588256836]]}, "loss": {"model_a": 20.428787200087857, "model_b": 21.9785572635428}, "topk": {"model_a": [47, 2, 0.321269690990448, [[45, 0.365727, ",", false], [47, 0.32127, ".", false], [275, 0.073412, " (", false], [21265, 0.05867, " and", false], [4715, 0.046256, " or", false], [5346, 0.045515, "---", false], [32227, 0.0243, " that", false], [60, 0.007191, ";", false], [4596, 0.005972, " in", false], [4706, 0.004912, " of", false]]], "model_b": [47, 2, 0.29580068588256836, [[45, 0.455843, ",", false], [47, 0.295801, ".", false], [275, 0.037636, " (", false], [21265, 0.031232, " and", false], [4715, 0.030041, " or", false], [4423, 0.021212, " as", false], [5346, 0.02049, "---", false], [4706, 0.008761, " of", false], [21700, 0.007565, " for", false], [60, 0.007349, ";", false]]]}, "raw_delta": -0.0859375, "tuned_delta": -0.03308255610180018}, {"byte_start": 4619, "byte_end": 4623, "display": {"text": " But", "kind": "normal"}, "is_word": true, "word_id": 790, "word_key": " but", "bytes_hex": "20 42 75 74", "compression": {"model_a": "15.92% 15.92% 15.92% 15.92%", "model_b": "14.09% 14.09% 14.09% 14.09%"}, "model_tokens": {"model_a": [[19555, " But", "normal", 0.029402634128928185]], "model_b": [[19555, " But", "normal", 0.04401867091655731]]}, "loss": {"model_a": 15.920365197309849, "model_b": 14.088818758681281}, "topk": {"model_a": [19555, 8, 0.029402634128928185, [[37453, 0.247464, " These", false], [20996, 0.06455, " The", false], [36918, 0.060455, " Later", false], [29890, 0.042129, " Then", false], [29894, 0.036013, " This", false], [3913, 0.030065, " In", false], [19407, 0.029628, " All", false], [19555, 0.029403, " But", false], [37451, 0.020613, " There", false], [29421, 0.019811, " More", false]]], "model_b": [19555, 5, 0.04401867091655731, [[37453, 0.163121, " These", false], [36918, 0.112786, " Later", false], [20996, 0.06418, " The", false], [3913, 0.052714, " In", false], [19555, 0.044019, " But", false], [3641, 0.041841, " As", false], [29894, 0.037163, " This", false], [29521, 0.035283, " Over", false], [30032, 0.016004, " When", false], [36607, 0.015528, " Early", false]]]}, "raw_delta": 0.1015625, "tuned_delta": 0.15441744389819984}, {"byte_start": 4623, "byte_end": 4629, "display": {"text": " today", "kind": "normal"}, "is_word": true, "word_id": 791, "word_key": " today", "bytes_hex": "20 74 6f 64 61 79", "compression": {"model_a": "21.51% 21.51% 21.51% 21.51% 21.51% 21.51%", "model_b": "21.04% 21.04% 21.04% 21.04% 21.04% 21.04%"}, "model_tokens": {"model_a": [[39971, " today", "normal", 0.0007729920325800776]], "model_b": [[39971, " today", "normal", 0.0009074409608729184]]}, "loss": {"model_a": 21.508929971586756, "model_b": 21.039302679630715}, "topk": {"model_a": [39971, 94, 0.0007729920325800776, [[22590, 0.11425, " the", false], [39936, 0.103286, " these", false], [45, 0.082828, ",", false], [4423, 0.060182, " as", false], [4596, 0.0519, " in", false], [32487, 0.034152, " with", false], [4601, 0.028276, " it", false], [32465, 0.024882, " when", false], [4450, 0.024469, " by", false], [32230, 0.022105, " then", false]]], "model_b": [39971, 87, 0.0009074409608729184, [[39936, 0.116477, " these", false], [4423, 0.09563, " as", false], [22590, 0.084273, " the", false], [45, 0.056879, ",", false], [4596, 0.054307, " in", false], [32465, 0.046372, " when", false], [31601, 0.034711, " over", false], [32234, 0.031153, " this", false], [4601, 0.02915, " it", false], [32487, 0.025508, " with", false]]]}, "raw_delta": 0.02604166666666652, "tuned_delta": 0.07889661056486634}, {"byte_start": 4629, "byte_end": 4633, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 792, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"model_a": "23.39% 23.39% 23.39% 23.39%", "model_b": "21.98% 21.98% 21.98% 21.98%"}, "model_tokens": {"model_a": [[21256, " all", "normal", 0.005701408721506596]], "model_b": [[21256, " all", "normal", 0.007622078526765108]]}, "loss": {"model_a": 23.38743913941093, "model_b": 21.9785572635428}, "topk": {"model_a": [21256, 12, 0.005701408721506596, [[45, 0.485835, ",", false], [460, 0.268263, "'s", false], [22590, 0.05835, " the", false], [4601, 0.02094, " it", false], [4858, 0.019523, " we", false], [39934, 0.01744, " there", false], [39936, 0.012281, " these", false], [31461, 0.011599, " most", false], [30597, 0.010872, " deep", false], [47732, 0.008456, " vision", false]]], "model_b": [21256, 13, 0.007622078526765108, [[45, 0.549021, ",", false], [22590, 0.056682, " the", false], [460, 0.045968, "'s", false], [4601, 0.035218, " it", false], [4858, 0.03469, " we", false], [39934, 0.029093, " there", false], [39936, 0.028505, " these", false], [31461, 0.024206, " most", false], [47732, 0.018204, " vision", false], [332, 0.011516, " a", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13097994389819984}, {"byte_start": 4633, "byte_end": 4638, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 793, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "15.33% 15.33% 15.33% 15.33% 15.33%", "model_b": "20.74% 20.74% 20.74% 20.74% 20.74%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.01418666634708643]], "model_b": [[32234, " this", "normal", 0.003247368149459362]]}, "loss": {"model_a": 15.328634809445234, "model_b": 20.738741212778844}, "topk": {"model_a": [32234, 13, 0.01418666634708643, [[22590, 0.193788, " the", false], [4706, 0.167345, " of", false], [52224, 0.093043, " methods", false], [39936, 0.064851, " these", false], [55809, 0.044669, " computer", false], [62603, 0.035451, " successful", false], [32227, 0.032771, " that", false], [38961, 0.030105, " major", false], [47732, 0.027119, " vision", false], [39944, 0.022601, " those", false]]], "model_b": [32234, 35, 0.003247368149459362, [[47732, 0.22687, " vision", false], [4706, 0.108843, " of", false], [52224, 0.073682, " methods", false], [22590, 0.07097, " the", false], [38961, 0.046009, " major", false], [46588, 0.033165, " modern", false], [32227, 0.027381, " that", false], [38841, 0.025858, " kinds", false], [55809, 0.02393, " computer", false], [40050, 0.016744, " types", false]]]}, "raw_delta": -0.29999999999999993, "tuned_delta": -0.2471450561018001}, {"byte_start": 4638, "byte_end": 4641, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 794, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "5.47% 5.47% 5.47%", "model_b": "6.72% 6.72% 6.72%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.40344658493995667]], "model_b": [[4600, " is", "normal", 0.3232213854789734]]}, "loss": {"model_a": 5.471157951287898, "model_b": 6.71567027497141}, "topk": {"model_a": [4600, 1, 0.40344658493995667, [[4600, 0.403447, " is", false], [21800, 0.214287, " has", false], [39620, 0.059117, " seems", false], [32499, 0.046133, " work", false], [57103, 0.037863, " research", false], [38720, 0.029858, " human", false], [45829, 0.011572, " effort", false], [31615, 0.010571, " pale", false], [59943, 0.01019, " knowledge", false], [38932, 0.009214, " looks", false]]], "model_b": [4600, 1, 0.3232213854789734, [[4600, 0.323221, " is", false], [32499, 0.12639, " work", false], [21800, 0.113202, " has", false], [47732, 0.06301, " vision", false], [63370, 0.039675, " computation", false], [21413, 0.03415, " can", false], [57103, 0.029598, " research", false], [63637, 0.017594, " information", false], [45829, 0.014153, " effort", false], [59346, 0.009431, " computing", false]]]}, "raw_delta": -0.06901041666666663, "tuned_delta": -0.016155472768466808}, {"byte_start": 4641, "byte_end": 4651, "display": {"text": " discarded", "kind": "normal"}, "is_word": true, "word_id": 795, "word_key": " discarded", "bytes_hex": "20 64 69 73 63 61 72 64 65 64", "compression": {"model_a": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%", "model_b": "11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50%"}, "model_tokens": {"model_a": [[59536, " discarded", "normal", 0.001868218183517456]], "model_b": [[59536, " discarded", "normal", 0.0016992810415104032]]}, "loss": {"model_a": 11.32741028197975, "model_b": 11.496476107083927}, "topk": {"model_a": [59536, 91, 0.001868218183517456, [[45290, 0.058442, " behind", false], [332, 0.048873, " a", false], [30666, 0.041508, " done", false], [62161, 0.039846, " irrelevant", false], [31968, 0.028814, " seen", false], [4596, 0.023389, " in", false], [56738, 0.022544, " obsolete", false], [38319, 0.022342, " dwarf", false], [31323, 0.020387, " long", false], [52094, 0.020231, " largely", false]]], "model_b": [59536, 96, 0.0016992810415104032, [[30666, 0.134737, " done", false], [57094, 0.055155, " replaced", false], [37832, 0.051843, " being", false], [30991, 0.031512, " gone", false], [52094, 0.028803, " largely", false], [56738, 0.028299, " obsolete", false], [31198, 0.02773, " just", false], [332, 0.021828, " a", false], [31968, 0.017104, " seen", false], [47285, 0.014857, " simply", false]]]}, "raw_delta": -0.009374999999999911, "tuned_delta": 0.04347994389819991}, {"byte_start": 4651, "byte_end": 4652, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "39.73%", "model_b": "49.59%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.10939408838748932]], "model_b": [[47, ".", "normal", 0.06343134492635727]]}, "loss": {"model_a": 39.73046889948122, "model_b": 49.59264203055811}, "topk": {"model_a": [47, 3, 0.10939408838748932, [[4596, 0.377946, " in", false], [45, 0.212011, ",", false], [47, 0.109394, ".", false], [21265, 0.099395, " and", false], [4423, 0.080303, " as", false], [21700, 0.024619, " for", false], [5346, 0.017108, "---", false], [60, 0.01628, ";", false], [51018, 0.013047, " because", false], [4450, 0.010296, " by", false]]], "model_b": [47, 5, 0.06343134492635727, [[4596, 0.380206, " in", false], [45, 0.195533, ",", false], [21265, 0.160988, " and", false], [4423, 0.082849, " as", false], [47, 0.063431, ".", false], [21700, 0.041147, " for", false], [4811, 0.013347, " to", false], [51018, 0.010088, " because", false], [5346, 0.008726, "---", false], [60, 0.006046, ";", false]]]}, "raw_delta": -0.546875, "tuned_delta": -0.49402005610180016}, {"byte_start": 4652, "byte_end": 4659, "display": {"text": " Modern", "kind": "normal"}, "is_word": true, "word_id": 796, "word_key": " modern", "bytes_hex": "20 4d 6f 64 65 72 6e", "compression": {"model_a": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%", "model_b": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"model_a": [[44593, " Modern", "normal", 0.014880804345011711]], "model_b": [[44593, " Modern", "normal", 0.010616261512041092]]}, "loss": {"model_a": 10.868517328125558, "model_b": 11.673592685764493}, "topk": {"model_a": [44593, 13, 0.014880804345011711, [[50342, 0.220086, " Instead", false], [20996, 0.172074, " The", false], [28753, 0.043012, " Deep", false], [45032, 0.038653, " Vision", false], [36607, 0.030426, " Early", false], [3918, 0.027801, " It", false], [3913, 0.026701, " In", false], [37451, 0.020537, " There", false], [20530, 0.019407, " Now", false], [37468, 0.017588, " Today", false]]], "model_b": [44593, 15, 0.010616261512041092, [[50342, 0.238998, " Instead", false], [20996, 0.092075, " The", false], [45032, 0.039518, " Vision", false], [3913, 0.037723, " In", false], [54932, 0.035664, " Computer", false], [44757, 0.02723, " Rather", false], [37451, 0.026981, " There", false], [3918, 0.020395, " It", false], [300, 0.01798, " A", false], [50438, 0.015181, " Methods", false]]]}, "raw_delta": -0.044642857142857206, "tuned_delta": 0.008212086755342615}, {"byte_start": 4659, "byte_end": 4664, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 797, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"model_a": "13.47% 13.47% 13.47% 13.47% 13.47%", "model_b": "15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"model_a": [[30597, " deep", "normal", 0.024302441626787186]], "model_b": [[30597, " deep", "normal", 0.012739308178424835]]}, "loss": {"model_a": 13.468910733299305, "model_b": 15.779477009723035}, "topk": {"model_a": [30597, 7, 0.024302441626787186, [[52224, 0.401406, " methods", false], [55809, 0.194085, " computer", false], [47732, 0.103251, " vision", false], [53087, 0.057184, " systems", false], [61590, 0.056237, " approaches", false], [57103, 0.028473, " research", false], [30597, 0.024302, " deep", false], [38744, 0.010719, " image", false], [45, 0.010126, ",", false], [62633, 0.009858, " techniques", false]]], "model_b": [30597, 7, 0.012739308178424835, [[52224, 0.469946, " methods", false], [47732, 0.282951, " vision", false], [55809, 0.0747, " computer", false], [61590, 0.043885, " approaches", false], [53087, 0.013385, " systems", false], [62633, 0.012771, " techniques", false], [30597, 0.012739, " deep", false], [38744, 0.00978, " image", false], [61559, 0.006982, " algorithms", false], [47734, 0.005485, " visual", false]]]}, "raw_delta": -0.12812500000000004, "tuned_delta": -0.07527005610180022}, {"byte_start": 4664, "byte_end": 4665, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "43.39%", "model_b": "46.77%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.08955054730176926]], "model_b": [[46, "-", "normal", 0.07506144046783447]]}, "loss": {"model_a": 43.393561776738345, "model_b": 46.77487827882186}, "topk": {"model_a": [46, 3, 0.08955054730176926, [[56537, 0.59346, " learning", false], [63421, 0.090627, " convolution", false], [46, 0.089551, "-", false], [46658, 0.074553, " neural", false], [47732, 0.033544, " vision", false], [56705, 0.031519, " networks", false], [19593, 0.020196, " CNN", false], [52224, 0.012348, " methods", false], [47734, 0.008373, " visual", false], [52307, 0.007996, " network", false]]], "model_b": [46, 2, 0.07506144046783447, [[56537, 0.813567, " learning", false], [46, 0.075061, "-", false], [46658, 0.054387, " neural", false], [47732, 0.01373, " vision", false], [63421, 0.009785, " convolution", false], [56705, 0.003914, " networks", false], [38744, 0.002901, " image", false], [51725, 0.001244, " feature", false], [52167, 0.001241, " machine", false], [55809, 0.001178, " computer", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13464505610180016}, {"byte_start": 4665, "byte_end": 4673, "display": {"text": "learning", "kind": "normal"}, "is_word": true, "word_id": 798, "word_key": "learning", "bytes_hex": "6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.04% 0.04% 0.04% 0.04% 0.04% 0.04% 0.04% 0.04%"}, "model_tokens": {"model_a": [[54126, "learning", "normal", 0.9568225741386414]], "model_b": [[54126, "learning", "normal", 0.9822267293930054]]}, "loss": {"model_a": 0.10016269586249973, "model_b": 0.04017514724155209}, "topk": {"model_a": [54126, 1, 0.9568225741386414, [[54126, 0.956823, "learning", false], [26312, 0.011433, "neur", false], [49434, 0.006333, "network", false], [42506, 0.004108, "vision", false], [34973, 0.002904, "learn", false], [5695, 0.00268, "CNN", false], [34733, 0.002416, "image", false], [8235, 0.001699, "net", false], [63048, 0.001457, "convolution", false], [56537, 0.001289, " learning", false]]], "model_b": [54126, 1, 0.9822267293930054, [[54126, 0.982227, "learning", false], [26312, 0.006169, "neur", false], [49434, 0.002567, "network", false], [34973, 0.001317, "learn", false], [26665, 0.000971, "perc", false], [42506, 0.000701, "vision", false], [34733, 0.000499, "image", false], [41101, 0.000344, "belief", false], [56537, 0.000287, " learning", false], [63048, 0.000256, "convolution", false]]]}, "raw_delta": 0.003326416015625, "tuned_delta": 0.05618135991382482}, {"byte_start": 4673, "byte_end": 4680, "display": {"text": " neural", "kind": "normal"}, "is_word": true, "word_id": 799, "word_key": " neural", "bytes_hex": "20 6e 65 75 72 61 6c", "compression": {"model_a": "15.54% 15.54% 15.54% 15.54% 15.54% 15.54% 15.54%", "model_b": "18.36% 18.36% 18.36% 18.36% 18.36% 18.36% 18.36%"}, "model_tokens": {"model_a": [[46658, " neural", "normal", 0.0023668629582971334]], "model_b": [[46658, " neural", "normal", 0.0008197693969123065]]}, "loss": {"model_a": 15.53795440243136, "model_b": 18.355718154167608}, "topk": {"model_a": [46658, 19, 0.0023668629582971334, [[52224, 0.447215, " methods", false], [46, 0.160199, "-", false], [47732, 0.085994, " vision", false], [61590, 0.081943, " approaches", false], [53087, 0.06972, " systems", false], [55809, 0.048041, " computer", false], [62633, 0.017063, " techniques", false], [46587, 0.009323, " models", false], [37810, 0.009198, " based", false], [56705, 0.008946, " networks", false]]], "model_b": [46658, 22, 0.0008197693969123065, [[52224, 0.433007, " methods", false], [47732, 0.142516, " vision", false], [46, 0.114347, "-", false], [61590, 0.10191, " approaches", false], [53087, 0.066032, " systems", false], [37810, 0.032343, " based", false], [62633, 0.024164, " techniques", false], [61559, 0.015665, " algorithms", false], [46587, 0.012331, " models", false], [55809, 0.005118, " computer", false]]]}, "raw_delta": -0.15624999999999986, "tuned_delta": -0.10339505610180004}, {"byte_start": 4680, "byte_end": 4689, "display": {"text": " networks", "kind": "normal"}, "is_word": true, "word_id": 800, "word_key": " networks", "bytes_hex": "20 6e 65 74 77 6f 72 6b 73", "compression": {"model_a": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%", "model_b": "0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88%"}, "model_tokens": {"model_a": [[56705, " networks", "normal", 0.5715659260749817]], "model_b": [[56705, " networks", "normal", 0.646662175655365]]}, "loss": {"model_a": 1.1192783791619019, "model_b": 0.8766376116512797}, "topk": {"model_a": [56705, 1, 0.5715659260749817, [[56705, 0.571566, " networks", false], [46, 0.154449, "-", false], [52307, 0.12299, " network", false], [31510, 0.101298, " nets", false], [22166, 0.019699, " net", false], [53087, 0.006581, " systems", false], [47732, 0.005446, " vision", false], [61590, 0.003862, " approaches", false], [64833, 0.002991, " architectures", false], [52224, 0.002481, " methods", false]]], "model_b": [56705, 1, 0.646662175655365, [[56705, 0.646662, " networks", false], [46, 0.171414, "-", false], [31510, 0.072039, " nets", false], [52307, 0.060877, " network", false], [47732, 0.007043, " vision", false], [22166, 0.007005, " net", false], [53087, 0.004873, " systems", false], [64833, 0.004231, " architectures", false], [38744, 0.002929, " image", false], [46587, 0.002871, " models", false]]]}, "raw_delta": 0.013454861111111108, "tuned_delta": 0.06630980500931093}, {"byte_start": 4689, "byte_end": 4693, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 801, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "15.99% 15.99% 15.99% 15.99%", "model_b": "15.71% 15.71% 15.71% 15.71%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.02884654514491558]], "model_b": [[22681, " use", "normal", 0.030336573719978333]]}, "loss": {"model_a": 15.990809291103256, "model_b": 15.70903291592963}, "topk": {"model_a": [22681, 7, 0.02884654514491558, [[21286, 0.136724, " are", false], [45, 0.124585, ",", false], [31059, 0.10362, " have", false], [38877, 0.054649, " learn", false], [21413, 0.046477, " can", false], [4491, 0.032078, " do", false], [22681, 0.028847, " use", false], [32227, 0.02758, " that", false], [32499, 0.023484, " work", false], [32187, 0.019237, " take", false]]], "model_b": [22681, 5, 0.030336573719978333, [[21286, 0.234739, " are", false], [45, 0.120157, ",", false], [31059, 0.08096, " have", false], [21413, 0.044474, " can", false], [22681, 0.030337, " use", false], [32187, 0.028404, " take", false], [4491, 0.024627, " do", false], [38877, 0.021763, " learn", false], [32227, 0.020756, " that", false], [275, 0.016306, " (", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06847994389819982}, {"byte_start": 4693, "byte_end": 4698, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 802, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "14.99% 14.99% 14.99% 14.99% 14.99%", "model_b": "17.58% 17.58% 17.58% 17.58% 17.58%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.015558638609945774]], "model_b": [[31581, " only", "normal", 0.007598234340548515]]}, "loss": {"model_a": 14.990503159236885, "model_b": 17.58284581083424}, "topk": {"model_a": [31581, 9, 0.015558638609945774, [[52195, 0.370678, " massive", false], [332, 0.061566, " a", false], [63421, 0.041803, " convolution", false], [59988, 0.026155, " massively", false], [31118, 0.024404, " huge", false], [22590, 0.021634, " the", false], [56640, 0.019286, " millions", false], [56125, 0.016516, " enormous", false], [31581, 0.015559, " only", false], [31370, 0.015388, " many", false]]], "model_b": [31581, 20, 0.007598234340548515, [[52195, 0.174146, " massive", false], [332, 0.092728, " a", false], [31466, 0.040131, " much", false], [22590, 0.03944, " the", false], [31118, 0.027695, " huge", false], [30597, 0.027085, " deep", false], [38864, 0.023787, " large", false], [63421, 0.020575, " convolution", false], [56125, 0.017168, " enormous", false], [32386, 0.015799, " very", false]]]}, "raw_delta": -0.14374999999999993, "tuned_delta": -0.09089505610180011}, {"byte_start": 4698, "byte_end": 4702, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 803, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.41% 11.41% 11.41% 11.41%", "model_b": "10.85% 10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.0793071836233139]], "model_b": [[22590, " the", "normal", 0.0907275378704071]]}, "loss": {"model_a": 11.411943194531839, "model_b": 10.848390444184586}, "topk": {"model_a": [22590, 2, 0.0793071836233139, [[332, 0.237086, " a", false], [22590, 0.079307, " the", false], [52195, 0.051499, " massive", false], [63421, 0.040005, " convolution", false], [32386, 0.038209, " very", false], [22363, 0.023653, " raw", false], [62577, 0.019747, " statistics", false], [22226, 0.019642, " one", false], [63885, 0.018678, " statistical", false], [63370, 0.018408, " computation", false]]], "model_b": [22590, 2, 0.0907275378704071, [[332, 0.208104, " a", false], [22590, 0.090728, " the", false], [32386, 0.06208, " very", false], [52195, 0.047352, " massive", false], [63421, 0.027582, " convolution", false], [52112, 0.022417, " learned", false], [47284, 0.021077, " simple", false], [39720, 0.015526, " small", false], [22226, 0.012513, " one", false], [31466, 0.011313, " much", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 4702, "byte_end": 4710, "display": {"text": " notions", "kind": "normal"}, "is_word": true, "word_id": 804, "word_key": " notions", "bytes_hex": "20 6e 6f 74 69 6f 6e 73", "compression": {"model_a": "19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[52326, " notions", "normal", 0.00016343005700036883]], "model_b": [[52326, " notions", "normal", 0.00015514640836045146]]}, "loss": {"model_a": 19.58345807456698, "model_b": 19.724346262153794}, "topk": {"model_a": [52326, 485, 0.00016343005700036883, [[22363, 0.126863, " raw", false], [63370, 0.066808, " computation", false], [30579, 0.03725, " data", false], [52195, 0.030614, " massive", false], [63885, 0.028778, " statistical", false], [62577, 0.026821, " statistics", false], [37812, 0.026719, " basic", false], [31461, 0.026612, " most", false], [46826, 0.018222, " pixels", false], [32386, 0.015264, " very", false]]], "model_b": [52326, 541, 0.00015514640836045146, [[31461, 0.161888, " most", false], [57234, 0.027553, " simplest", false], [38332, 0.025661, " edges", false], [63637, 0.025568, " information", false], [56215, 0.023699, " features", false], [62577, 0.023046, " statistics", false], [30579, 0.017859, " data", false], [22363, 0.016249, " raw", false], [38879, 0.014402, " least", false], [38720, 0.01407, " human", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04504244389819982}, {"byte_start": 4710, "byte_end": 4713, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 805, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.66% 0.66% 0.66%", "model_b": "0.64% 0.64% 0.64%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8951891660690308]], "model_b": [[4706, " of", "normal", 0.8996827006340027]]}, "loss": {"model_a": 0.6633485498879104, "model_b": 0.6369320147153829}, "topk": {"model_a": [4706, 1, 0.8951891660690308, [[4706, 0.895189, " of", false], [32227, 0.057953, " that", false], [4404, 0.003865, " ``", false], [21265, 0.003735, " and", false], [30917, 0.003566, " from", false], [52112, 0.002556, " learned", false], [38547, 0.001787, " found", false], [45, 0.001555, ",", false], [56412, 0.001531, " implicit", false], [4858, 0.001274, " we", false]]], "model_b": [4706, 1, 0.8996827006340027, [[4706, 0.899683, " of", false], [32227, 0.041392, " that", false], [21265, 0.017543, " and", false], [45, 0.002926, ",", false], [4858, 0.002181, " we", false], [31461, 0.001522, " most", false], [45534, 0.001139, " common", false], [32232, 0.001055, " they", false], [56412, 0.001026, " implicit", false], [60050, 0.000966, " necessary", false]]]}, "raw_delta": 0.00146484375, "tuned_delta": 0.05431978764819982}, {"byte_start": 4713, "byte_end": 4725, "display": {"text": " convolution", "kind": "normal"}, "is_word": true, "word_id": 806, "word_key": " convolution", "bytes_hex": "20 63 6f 6e 76 6f 6c 75 74 69 6f 6e", "compression": {"model_a": "2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61%", "model_b": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%"}, "model_tokens": {"model_a": [[63421, " convolution", "normal", 0.17733125388622284]], "model_b": [[63421, " convolution", "normal", 0.01971733197569847]]}, "loss": {"model_a": 2.606431470356037, "model_b": 5.9173038786461385}, "topk": {"model_a": [63421, 1, 0.17733125388622284, [[63421, 0.177331, " convolution", false], [4404, 0.106805, " ``", false], [56324, 0.041178, " gradient", false], [332, 0.037921, " a", false], [46826, 0.036745, " pixels", false], [38332, 0.019386, " edges", false], [38924, 0.018816, " local", false], [59770, 0.018247, " gradients", false], [46442, 0.017509, " linear", false], [52962, 0.017368, " spatial", false]]], "model_b": [63421, 4, 0.01971733197569847, [[38332, 0.222722, " edges", false], [4404, 0.02133, " ``", false], [38924, 0.020583, " local", false], [63421, 0.019717, " convolution", false], [46826, 0.01876, " pixels", false], [38744, 0.017015, " image", false], [30729, 0.016487, " edge", false], [22590, 0.015491, " the", false], [39654, 0.015009, " shape", false], [56024, 0.013605, " distance", false]]]}, "raw_delta": -0.18359375, "tuned_delta": -0.13073880610180016}, {"byte_start": 4725, "byte_end": 4729, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 807, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "2.80% 2.80% 2.80% 2.80%", "model_b": "5.71% 5.71% 5.71% 5.71%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.5361390113830566]], "model_b": [[21265, " and", "normal", 0.28277409076690674]]}, "loss": {"model_a": 2.800152728287905, "model_b": 5.705971597265919}, "topk": {"model_a": [21265, 1, 0.5361390113830566, [[21265, 0.536139, " and", false], [116, 0.181518, "s", false], [45, 0.137792, ",", false], [1744, 0.063431, "al", false], [275, 0.018762, " (", false], [4706, 0.006669, " of", false], [32487, 0.006669, " with", false], [4596, 0.004927, " in", false], [5346, 0.004713, "---", false], [4715, 0.003461, " or", false]]], "model_b": [21265, 1, 0.28277409076690674, [[21265, 0.282774, " and", false], [116, 0.259397, "s", false], [45, 0.199269, ",", false], [1744, 0.159241, "al", false], [275, 0.03681, " (", false], [4715, 0.007282, " or", false], [32487, 0.007224, " with", false], [4596, 0.00465, " in", false], [4706, 0.003959, " of", false], [4712, 0.003532, " on", false]]]}, "raw_delta": -0.1611328125, "tuned_delta": -0.10827786860180018}, {"byte_start": 4729, "byte_end": 4737, "display": {"text": " certain", "kind": "normal"}, "is_word": true, "word_id": 808, "word_key": " certain", "bytes_hex": "20 63 65 72 74 61 69 6e", "compression": {"model_a": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%", "model_b": "24.09% 24.09% 24.09% 24.09% 24.09% 24.09% 24.09% 24.09%"}, "model_tokens": {"model_a": [[51161, " certain", "normal", 0.00015648182306904346]], "model_b": [[51161, " certain", "normal", 2.3310218239203095e-05]]}, "loss": {"model_a": 19.724346262153794, "model_b": 24.091880077344992}, "topk": {"model_a": [51161, 286, 0.00015648182306904346, [[52513, 0.543823, " pooling", false], [56324, 0.027326, " gradient", false], [30218, 0.020537, " back", false], [22073, 0.017305, " max", false], [61531, 0.01611, " activation", false], [46442, 0.014691, " linear", false], [22590, 0.01465, " the", false], [46528, 0.014556, " matrix", false], [332, 0.013659, " a", false], [4706, 0.010378, " of", false]]], "model_b": [51161, 868, 2.3310218239203095e-05, [[52513, 0.640392, " pooling", false], [61531, 0.0354, " activation", false], [22590, 0.010133, " the", false], [51725, 0.009507, " feature", false], [31978, 0.008871, " self", false], [4706, 0.006222, " of", false], [38924, 0.006194, " local", false], [64968, 0.005971, " normalization", false], [37816, 0.005231, " batch", false], [56537, 0.005018, " learning", false]]]}, "raw_delta": -0.2421875, "tuned_delta": -0.18933255610180016}, {"byte_start": 4737, "byte_end": 4743, "display": {"text": " kinds", "kind": "normal"}, "is_word": true, "word_id": 809, "word_key": " kinds", "bytes_hex": "20 6b 69 6e 64 73", "compression": {"model_a": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "model_b": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%"}, "model_tokens": {"model_a": [[38841, " kinds", "normal", 0.06867994368076324]], "model_b": [[38841, " kinds", "normal", 0.14126449823379517]]}, "loss": {"model_a": 8.077589421643935, "model_b": 5.8938225140483365}, "topk": {"model_a": [38841, 3, 0.06867994368076324, [[39193, 0.123027, " other", false], [40050, 0.081706, " types", false], [38841, 0.06868, " kinds", false], [38541, 0.049131, " forms", false], [57520, 0.041154, " variants", false], [47284, 0.029614, " simple", false], [37812, 0.026488, " basic", false], [65135, 0.023629, " generalization", false], [64284, 0.018458, " combinations", false], [62404, 0.015493, " properties", false]]], "model_b": [38841, 2, 0.14126449823379517, [[40050, 0.151409, " types", false], [38841, 0.141264, " kinds", false], [39193, 0.077632, " other", false], [64481, 0.076825, " mathematical", false], [62577, 0.025814, " statistics", false], [46442, 0.018819, " linear", false], [65135, 0.014628, " generalization", false], [63885, 0.01447, " statistical", false], [38541, 0.012348, " forms", false], [52964, 0.011998, " special", false]]]}, "raw_delta": 0.12109375, "tuned_delta": 0.17394869389819984}, {"byte_start": 4743, "byte_end": 4746, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 810, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.01% 0.01% 0.01%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9987673759460449]], "model_b": [[4706, " of", "normal", 0.9979907274246216]]}, "loss": {"model_a": 0.00738378847704325, "model_b": 0.012107578620741726}, "topk": {"model_a": [4706, 1, 0.9987673759460449, [[4706, 0.998767, " of", false], [21265, 0.000226, " and", false], [275, 0.00015, " (", false], [4715, 4.1e-05, " or", false], [45, 3.6e-05, ",", false], [46442, 2.4e-05, " linear", false], [11, 1.7e-05, "\n", false], [4588, 1.7e-05, " if", false], [63421, 1.6e-05, " convolution", false], [56324, 1.6e-05, " gradient", false]]], "model_b": [4706, 1, 0.9979907274246216, [[4706, 0.997991, " of", false], [275, 0.000231, " (", false], [65135, 9.9e-05, " generalization", false], [11, 9.5e-05, "\n", false], [45, 6.4e-05, ",", false], [32227, 5.1e-05, " that", false], [63421, 4.3e-05, " convolution", false], [4715, 3.8e-05, " or", false], [332, 3.3e-05, " a", false], [21265, 2.9e-05, " and", false]]]}, "raw_delta": -0.0002619425455729167, "tuned_delta": 0.05259300135262691}, {"byte_start": 4746, "byte_end": 4753, "display": {"text": " invari", "kind": "normal"}, "is_word": true, "word_id": 811, "word_key": " invari", "bytes_hex": "20 69 6e 76 61 72 69", "compression": {"model_a": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%", "model_b": "11.03% 11.03% 11.03% 11.03% 11.03% 11.03% 11.03%"}, "model_tokens": {"model_a": [[46326, " invari", "normal", 0.005143760237842798]], "model_b": [[46326, " invari", "normal", 0.013857589103281498]]}, "loss": {"model_a": 13.605773544097923, "model_b": 11.029532399653347}, "topk": {"model_a": [46326, 29, 0.005143760237842798, [[52513, 0.178475, " pooling", false], [61531, 0.069835, " activation", false], [31333, 0.033657, " loss", false], [60060, 0.028398, " nonlinear", false], [22184, 0.026391, " non", false], [51743, 0.0202, " filters", false], [51725, 0.019865, " feature", false], [46528, 0.018293, " matrix", false], [46442, 0.017346, " linear", false], [62577, 0.017181, " statistics", false]]], "model_b": [46326, 10, 0.013857589103281498, [[52513, 0.247242, " pooling", false], [61531, 0.035063, " activation", false], [65135, 0.028863, " generalization", false], [62577, 0.027179, " statistics", false], [51725, 0.021433, " feature", false], [64481, 0.020904, " mathematical", false], [46442, 0.019541, " linear", false], [63885, 0.015524, " statistical", false], [31978, 0.01437, " self", false], [46326, 0.013858, " invari", false]]]}, "raw_delta": 0.1428571428571428, "tuned_delta": 0.19571208675534263}, {"byte_start": 4753, "byte_end": 4758, "display": {"text": "ances", "kind": "normal"}, "is_word": true, "word_id": 812, "word_key": "ances", "bytes_hex": "61 6e 63 65 73", "compression": {"model_a": "9.24% 9.24% 9.24% 9.24% 9.24%", "model_b": "5.72% 5.72% 5.72% 5.72% 5.72%"}, "model_tokens": {"model_a": [[33764, "ances", "normal", 0.0770193487405777]], "model_b": [[33764, "ances", "normal", 0.20574714243412018]]}, "loss": {"model_a": 9.24226510569492, "model_b": 5.720060416024601}, "topk": {"model_a": [33764, 2, 0.0770193487405777, [[24566, 0.921049, "ance", false], [33764, 0.077019, "ances", false], [48811, 0.000745, "ability", false], [24569, 0.000382, "ancy", false], [24381, 0.000237, "able", false], [40971, 8.6e-05, "ancies", false], [33944, 8e-05, "ation", false], [46, 3.1e-05, "-", false], [24622, 2.9e-05, "anza", false], [25250, 2.2e-05, "ence", false]]], "model_b": [33764, 2, 0.20574714243412018, [[24566, 0.79021, "ance", false], [33764, 0.205747, "ances", false], [48811, 0.00067, "ability", false], [24569, 0.000644, "ancy", false], [8218, 0.000567, "nce", false], [24381, 0.000375, "able", false], [7473, 0.000371, "ent", false], [25250, 0.000332, "ence", false], [40971, 0.000162, "ancies", false], [33598, 0.000146, "ables", false]]]}, "raw_delta": 0.19531249999999994, "tuned_delta": 0.24816744389819978}, {"byte_start": 4758, "byte_end": 4759, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "24.37%", "model_b": "26.63%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.261186420917511]], "model_b": [[45, ",", "normal", 0.22715118527412415]]}, "loss": {"model_a": 24.373656452518617, "model_b": 26.627867453907623}, "topk": {"model_a": [45, 1, 0.261186420917511, [[45, 0.261186, ",", false], [4811, 0.160037, " to", false], [47, 0.130583, ".", false], [32227, 0.113643, " that", false], [275, 0.08087, " (", false], [5346, 0.037794, "---", false], [21265, 0.037569, " and", false], [4596, 0.01976, " in", false], [4706, 0.016602, " of", false], [4423, 0.010592, " as", false]]], "model_b": [45, 1, 0.22715118527412415, [[45, 0.227151, ",", false], [47, 0.197129, ".", false], [32227, 0.122174, " that", false], [4811, 0.092086, " to", false], [275, 0.050611, " (", false], [4706, 0.049301, " of", false], [5346, 0.046477, "---", false], [4596, 0.034272, " in", false], [21265, 0.025866, " and", false], [60, 0.00717, ";", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 4759, "byte_end": 4763, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 813, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.31% 4.31% 4.31% 4.31%", "model_b": "4.12% 4.12% 4.12% 4.12%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.38373133540153503]], "model_b": [[21265, " and", "normal", 0.3995138704776764]]}, "loss": {"model_a": 4.314700744846142, "model_b": 4.120979486914275}, "topk": {"model_a": [21265, 1, 0.38373133540153503, [[21265, 0.383731, " and", false], [21400, 0.177311, " but", false], [32139, 0.048395, " such", false], [40186, 0.045829, " which", false], [32487, 0.024805, " with", false], [53356, 0.022609, " without", false], [22797, 0.016715, " yet", false], [4423, 0.014895, " as", false], [22187, 0.014755, " not", false], [31296, 0.012972, " like", false]]], "model_b": [21265, 1, 0.3995138704776764, [[21265, 0.399514, " and", false], [21400, 0.059716, " but", false], [40186, 0.046823, " which", false], [32139, 0.045452, " such", false], [4715, 0.029969, " or", false], [4423, 0.016692, " as", false], [4811, 0.015874, " to", false], [32487, 0.015697, " with", false], [53356, 0.015134, " without", false], [31296, 0.015109, " like", false]]]}, "raw_delta": 0.0107421875, "tuned_delta": 0.06359713139819982}, {"byte_start": 4763, "byte_end": 4771, "display": {"text": " perform", "kind": "normal"}, "is_word": true, "word_id": 814, "word_key": " perform", "bytes_hex": "20 70 65 72 66 6f 72 6d", "compression": {"model_a": "12.26% 12.26% 12.26% 12.26% 12.26% 12.26% 12.26% 12.26%", "model_b": "14.58% 14.58% 14.58% 14.58% 14.58% 14.58% 14.58% 14.58%"}, "model_tokens": {"model_a": [[52446, " perform", "normal", 0.0044083259999752045]], "model_b": [[52446, " perform", "normal", 0.001536969793960452]]}, "loss": {"model_a": 12.257272320052715, "model_b": 14.581927415235127}, "topk": {"model_a": [52446, 40, 0.0044083259999752045, [[32232, 0.149306, " they", false], [39936, 0.088249, " these", false], [22590, 0.058522, " the", false], [21286, 0.037877, " are", false], [22797, 0.037041, " yet", false], [4491, 0.031112, " do", false], [38877, 0.027517, " learn", false], [31059, 0.026217, " have", false], [39944, 0.022162, " those", false], [21413, 0.017172, " can", false]]], "model_b": [52446, 83, 0.001536969793960452, [[22590, 0.075299, " the", false], [39936, 0.072458, " these", false], [32232, 0.070421, " they", false], [21286, 0.043625, " are", false], [30788, 0.024817, " even", false], [32230, 0.023655, " then", false], [4596, 0.023468, " in", false], [32234, 0.019862, " this", false], [31466, 0.019515, " much", false], [21256, 0.019298, " all", false]]]}, "raw_delta": -0.12890625, "tuned_delta": -0.07605130610180018}, {"byte_start": 4771, "byte_end": 4776, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 815, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "12.17% 12.17% 12.17% 12.17% 12.17%", "model_b": "7.78% 7.78% 7.78% 7.78% 7.78%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.03440967574715614]], "model_b": [[31466, " much", "normal", 0.11659453809261322]]}, "loss": {"model_a": 12.172739407500629, "model_b": 7.777027954792068}, "topk": {"model_a": [31466, 7, 0.03440967574715614, [[22590, 0.084036, " the", false], [39931, 0.078139, " their", false], [32386, 0.049471, " very", false], [32458, 0.049296, " well", false], [50892, 0.048225, " amazing", false], [332, 0.035266, " a", false], [31466, 0.03441, " much", false], [59699, 0.031383, " extremely", false], [62478, 0.029861, " remarkably", false], [52195, 0.022524, " massive", false]]], "model_b": [31466, 2, 0.11659453809261322, [[45301, 0.133609, " better", false], [31466, 0.116595, " much", false], [32458, 0.085868, " well", false], [32386, 0.04933, " very", false], [21660, 0.037997, " far", false], [59699, 0.029549, " extremely", false], [4788, 0.024512, " so", false], [4423, 0.024132, " as", false], [50892, 0.023101, " amazing", false], [62478, 0.021898, " remarkably", false]]]}, "raw_delta": 0.24375, "tuned_delta": 0.2966049438981998}, {"byte_start": 4776, "byte_end": 4783, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 816, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"model_a": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%", "model_b": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"model_a": [[45301, " better", "normal", 0.7996662855148315]], "model_b": [[45301, " better", "normal", 0.9336152076721191]]}, "loss": {"model_a": 0.5761320528103596, "model_b": 0.17485230423720519}, "topk": {"model_a": [45301, 1, 0.7996662855148315, [[45301, 0.799666, " better", false], [31458, 0.128529, " more", false], [45, 0.02104, ",", false], [4706, 0.009358, " of", false], [31466, 0.009335, " much", false], [22590, 0.006114, " the", false], [31277, 0.002411, " less", false], [46198, 0.002362, " higher", false], [4715, 0.002083, " or", false], [45961, 0.001914, " faster", false]]], "model_b": [45301, 1, 0.9336152076721191, [[45301, 0.933615, " better", false], [31458, 0.029074, " more", false], [45, 0.009008, ",", false], [31466, 0.006404, " much", false], [40216, 0.004251, " worse", false], [31277, 0.002721, " less", false], [4423, 0.001973, " as", false], [45961, 0.001492, " faster", false], [4706, 0.001137, " of", false], [46198, 0.001017, " higher", false]]]}, "raw_delta": 0.022251674107142853, "tuned_delta": 0.07510661800534267}, {"byte_start": 4783, "byte_end": 4784, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "17.26%", "model_b": "27.19%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.3856501579284668]], "model_b": [[47, ".", "normal", 0.22015078365802765]]}, "loss": {"model_a": 17.25880297938457, "model_b": 27.191420204254875}, "topk": {"model_a": [47, 1, 0.3856501579284668, [[47, 0.38565, ".", false], [32226, 0.230287, " than", false], [4712, 0.07341, " on", false], [45, 0.065638, ",", false], [4596, 0.045313, " in", false], [4424, 0.030211, " at", false], [5346, 0.027638, "---", false], [32487, 0.021216, " with", false], [21265, 0.013025, " and", false], [52394, 0.012075, " overall", false]]], "model_b": [47, 2, 0.22015078365802765, [[32226, 0.413576, " than", false], [47, 0.220151, ".", false], [4712, 0.065965, " on", false], [4596, 0.055225, " in", false], [45, 0.053293, ",", false], [4424, 0.050227, " at", false], [32487, 0.027703, " with", false], [32465, 0.01374, " when", false], [21265, 0.0091, " and", false], [40085, 0.007372, " using", false]]]}, "raw_delta": -0.55078125, "tuned_delta": -0.49792630610180016}, {"byte_start": 4784, "byte_end": 4785, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "23.95%", "model_b": "25.08%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.07093143463134766]], "model_b": [[261, "\n\n", "control", 0.06187887489795685]]}, "loss": {"model_a": 23.95099188975818, "model_b": 25.078097390452683}, "topk": {"model_a": [261, 3, 0.07093143463134766, [[20996, 0.139227, " The", false], [29894, 0.084779, " This", false], [261, 0.070931, "\n\n", false], [36251, 0.054598, " Again", false], [3913, 0.0422, " In", false], [3918, 0.034769, " It", false], [37451, 0.033163, " There", false], [29893, 0.029306, " They", false], [37453, 0.024945, " These", false], [3641, 0.023642, " As", false]]], "model_b": [261, 3, 0.06187887489795685, [[20996, 0.149396, " The", false], [29894, 0.068749, " This", false], [261, 0.061879, "\n\n", false], [3913, 0.049441, " In", false], [37453, 0.044535, " These", false], [19555, 0.043805, " But", false], [36251, 0.031002, " Again", false], [37451, 0.025569, " There", false], [19417, 0.02317, " And", false], [28753, 0.021917, " Deep", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 4785, "byte_end": 4786, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "23.95%", "model_b": "25.08%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.07093143463134766]], "model_b": [[261, "\n\n", "control", 0.06187887489795685]]}, "loss": {"model_a": 23.95099188975818, "model_b": 25.078097390452683}, "topk": {"model_a": [261, 3, 0.07093143463134766, [[20996, 0.139227, " The", false], [29894, 0.084779, " This", false], [261, 0.070931, "\n\n", false], [36251, 0.054598, " Again", false], [3913, 0.0422, " In", false], [3918, 0.034769, " It", false], [37451, 0.033163, " There", false], [29893, 0.029306, " They", false], [37453, 0.024945, " These", false], [3641, 0.023642, " As", false]]], "model_b": [261, 3, 0.06187887489795685, [[20996, 0.149396, " The", false], [29894, 0.068749, " This", false], [261, 0.061879, "\n\n", false], [3913, 0.049441, " In", false], [37453, 0.044535, " These", false], [19555, 0.043805, " But", false], [36251, 0.031002, " Again", false], [37451, 0.025569, " There", false], [19417, 0.02317, " And", false], [28753, 0.021917, " Deep", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 4786, "byte_end": 4790, "display": {"text": "This", "kind": "normal"}, "is_word": true, "word_id": 817, "word_key": "this", "bytes_hex": "54 68 69 73", "compression": {"model_a": "17.26% 17.26% 17.26% 17.26%", "model_b": "17.19% 17.19% 17.19% 17.19%"}, "model_tokens": {"model_a": [[24242, "This", "normal", 0.021429626271128654]], "model_b": [[24242, "This", "normal", 0.022140920162200928]]}, "loss": {"model_a": 17.25880297938457, "model_b": 17.188358885591164}, "topk": {"model_a": [24242, 8, 0.021429626271128654, [[1136, 0.222311, "In", false], [6699, 0.12427, "The", false], [33504, 0.074473, "There", false], [33505, 0.044885, "These", false], [66, 0.039411, "A", false], [1141, 0.035129, "It", false], [5559, 0.024486, "All", false], [24242, 0.02143, "This", false], [1461, 0.017723, "So", false], [48358, 0.013405, "Another", false]]], "model_b": [24242, 5, 0.022140920162200928, [[1136, 0.33933, "In", false], [6699, 0.119163, "The", false], [33504, 0.039976, "There", false], [66, 0.025559, "A", false], [24242, 0.022141, "This", false], [33505, 0.019194, "These", false], [6393, 0.013962, "One", false], [1141, 0.013633, "It", false], [48504, 0.012817, "Finally", false], [53454, 0.012615, "Computer", false]]]}, "raw_delta": 0.00390625, "tuned_delta": 0.05676119389819982}, {"byte_start": 4790, "byte_end": 4793, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 818, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "8.41% 8.41% 8.41%", "model_b": "7.56% 7.56% 7.56%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.24497567117214203]], "model_b": [[4600, " is", "normal", 0.2822357714176178]]}, "loss": {"model_a": 8.406328526013164, "model_b": 7.560999400492288}, "topk": {"model_a": [4600, 1, 0.24497567117214203, [[4600, 0.244976, " is", false], [52427, 0.212361, " pattern", false], [51832, 0.0199, " general", false], [46430, 0.019366, " lesson", false], [30659, 0.015755, " does", false], [21800, 0.015613, " has", false], [31254, 0.014605, " last", false], [31307, 0.014389, " list", false], [51929, 0.013441, " history", false], [31937, 0.011913, " same", false]]], "model_b": [4600, 1, 0.2822357714176178, [[4600, 0.282236, " is", false], [52427, 0.129236, " pattern", false], [38875, 0.019555, " leads", false], [31937, 0.019461, " same", false], [22748, 0.017131, " was", false], [21800, 0.015006, " has", false], [30659, 0.014813, " does", false], [46430, 0.014212, " lesson", false], [51668, 0.013886, " example", false], [50938, 0.012931, " applies", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.09972994389819982}, {"byte_start": 4793, "byte_end": 4795, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 819, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "19.30% 19.30%", "model_b": "18.32% 18.32%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.11890353262424469]], "model_b": [[332, " a", "normal", 0.13184314966201782]]}, "loss": {"model_a": 19.301681699393356, "model_b": 18.315464386285665}, "topk": {"model_a": [332, 2, 0.11890353262424469, [[22187, 0.445208, " not", false], [332, 0.118904, " a", false], [22590, 0.073161, " the", false], [31198, 0.041686, " just", false], [21256, 0.033997, " all", false], [4419, 0.026031, " an", false], [31581, 0.017321, " only", false], [4450, 0.01663, " by", false], [45, 0.013334, ",", false], [32313, 0.01291, " true", false]]], "model_b": [332, 2, 0.13184314966201782, [[22187, 0.380914, " not", false], [332, 0.131843, " a", false], [22590, 0.062282, " the", false], [4419, 0.033021, " an", false], [31198, 0.032981, " just", false], [21256, 0.023509, " all", false], [32313, 0.023351, " true", false], [31581, 0.018865, " only", false], [22763, 0.018805, " why", false], [30135, 0.014224, " also", false]]]}, "raw_delta": 0.0546875, "tuned_delta": 0.10754244389819982}, {"byte_start": 4795, "byte_end": 4799, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 820, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"model_a": "23.39% 23.39% 23.39% 23.39%", "model_b": "20.71% 20.71% 20.71% 20.71%"}, "model_tokens": {"model_a": [[21357, " big", "normal", 0.005515968427062035]], "model_b": [[21357, " big", "normal", 0.01023633498698473]]}, "loss": {"model_a": 23.38743913941093, "model_b": 20.710563575261485}, "topk": {"model_a": [21357, 26, 0.005515968427062035, [[52427, 0.181375, " pattern", false], [51832, 0.125756, " general", false], [32386, 0.072142, " very", false], [46430, 0.04662, " lesson", false], [45534, 0.026455, " common", false], [31323, 0.025387, " long", false], [30992, 0.017076, " good", false], [21365, 0.014698, " bit", false], [38049, 0.011901, " clear", false], [61756, 0.011838, " consistent", false]]], "model_b": [21357, 16, 0.01023633498698473, [[32386, 0.066538, " very", false], [52427, 0.05967, " pattern", false], [31323, 0.031689, " long", false], [53060, 0.030448, " summary", false], [51832, 0.029106, " general", false], [30992, 0.027765, " good", false], [65135, 0.019029, " generalization", false], [47284, 0.014781, " simple", false], [39720, 0.012084, " small", false], [21365, 0.011911, " bit", false]]]}, "raw_delta": 0.1484375, "tuned_delta": 0.20129244389819984}, {"byte_start": 4799, "byte_end": 4806, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 821, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%", "model_b": "2.56% 2.56% 2.56% 2.56% 2.56% 2.56% 2.56%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.4200761318206787]], "model_b": [[46430, " lesson", "normal", 0.3726769983768463]]}, "loss": {"model_a": 2.2340841174480324, "model_b": 2.556114260503604}, "topk": {"model_a": [46430, 1, 0.4200761318206787, [[46430, 0.420076, " lesson", false], [45450, 0.053707, " change", false], [39932, 0.039814, " theme", false], [45, 0.034435, ",", false], [31633, 0.029327, " part", false], [52427, 0.029313, " pattern", false], [30587, 0.027557, " deal", false], [39831, 0.026095, " story", false], [39981, 0.023803, " topic", false], [21265, 0.018201, " and", false]]], "model_b": [46430, 1, 0.3726769983768463, [[46430, 0.372677, " lesson", false], [39831, 0.062088, " story", false], [52569, 0.038592, " problem", false], [52427, 0.036689, " pattern", false], [45, 0.024217, ",", false], [30587, 0.022668, " deal", false], [47009, 0.021353, " reason", false], [61863, 0.020002, " difference", false], [45450, 0.014832, " change", false], [39932, 0.014302, " theme", false]]]}, "raw_delta": -0.01785714285714285, "tuned_delta": 0.03499780104105697}, {"byte_start": 4806, "byte_end": 4807, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "30.85%", "model_b": "31.00%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.1833907961845398]], "model_b": [[47, ".", "normal", 0.1789960265159607]]}, "loss": {"model_a": 30.854513081512007, "model_b": 30.99540126909882}, "topk": {"model_a": [47, 1, 0.1833907961845398, [[47, 0.183391, ".", false], [45, 0.178725, ",", false], [21700, 0.157706, " for", false], [32227, 0.089478, " that", false], [4811, 0.080403, " to", false], [4596, 0.074429, " in", false], [59, 0.057147, ":", false], [37598, 0.034574, " about", false], [4706, 0.026641, " of", false], [30917, 0.025756, " from", false]]], "model_b": [47, 2, 0.1789960265159607, [[21700, 0.190356, " for", false], [47, 0.178996, ".", false], [45, 0.170386, ",", false], [32227, 0.094499, " that", false], [4596, 0.083188, " in", false], [4811, 0.062195, " to", false], [5346, 0.045376, "---", false], [30917, 0.038367, " from", false], [4706, 0.030461, " of", false], [59, 0.02908, ":", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04504244389819982}, {"byte_start": 4807, "byte_end": 4810, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 822, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"model_a": "25.92% 25.92% 25.92%", "model_b": "25.92% 25.92% 25.92%"}, "model_tokens": {"model_a": [[3641, " As", "normal", 0.013478651642799377]], "model_b": [[3641, " As", "normal", 0.013539464212954044]]}, "loss": {"model_a": 25.92342651597356, "model_b": 25.92342651597356}, "topk": {"model_a": [3641, 10, 0.013478651642799377, [[3918, 0.183529, " It", false], [20996, 0.158965, " The", false], [3913, 0.041122, " In", false], [3908, 0.037581, " If", false], [37451, 0.02967, " There", false], [30032, 0.025331, " When", false], [4331, 0.022433, " We", false], [300, 0.014315, " A", false], [63222, 0.013839, " Researchers", false], [3641, 0.013479, " As", false]]], "model_b": [3641, 11, 0.013539464212954044, [[3918, 0.228491, " It", false], [20996, 0.108859, " The", false], [3913, 0.047717, " In", false], [3908, 0.043741, " If", false], [37451, 0.033726, " There", false], [4331, 0.026479, " We", false], [30032, 0.022937, " When", false], [19555, 0.015801, " But", false], [19417, 0.014896, " And", false], [54932, 0.014257, " Computer", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 4810, "byte_end": 4812, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 823, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "22.12% 22.12%", "model_b": "20.99% 20.99%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.08656177669763565]], "model_b": [[332, " a", "normal", 0.09662576019763947]]}, "loss": {"model_a": 22.11944545112961, "model_b": 20.99233995043511}, "topk": {"model_a": [332, 1, 0.08656177669763565, [[332, 0.086562, " a", false], [22590, 0.072838, " the", false], [3609, 0.072246, " AI", false], [31323, 0.070802, " long", false], [4858, 0.054491, " we", false], [308, 0.033668, " I", false], [4596, 0.033306, " in", false], [63843, 0.025308, " researchers", false], [32487, 0.021755, " with", false], [21660, 0.020132, " far", false]]], "model_b": [332, 1, 0.09662576019763947, [[332, 0.096626, " a", false], [4858, 0.070922, " we", false], [22590, 0.068303, " the", false], [4596, 0.062986, " in", false], [31323, 0.056028, " long", false], [32487, 0.045097, " with", false], [3609, 0.036582, " AI", false], [308, 0.025202, " I", false], [21660, 0.023506, " far", false], [37045, 0.022564, " Moore", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 4812, "byte_end": 4818, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 824, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"model_a": "13.06% 13.06% 13.06% 13.06% 13.06% 13.06%", "model_b": "13.71% 13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[38478, " field", "normal", 0.013176703825592995]], "model_b": [[38478, " field", "normal", 0.010570116341114044]]}, "loss": {"model_a": 13.055638716377988, "model_b": 13.713116925116447}, "topk": {"model_a": [38478, 12, 0.013176703825592995, [[51832, 0.22231, " general", false], [47092, 0.071139, " result", false], [62496, 0.055206, " researcher", false], [31907, 0.03513, " rule", false], [46530, 0.033079, " matter", false], [21458, 0.022386, " cor", false], [60212, 0.021507, " practical", false], [52942, 0.020524, " society", false], [57103, 0.018925, " research", false], [63388, 0.014534, " consequence", false]]], "model_b": [38478, 13, 0.010570116341114044, [[51832, 0.125845, " general", false], [47092, 0.101292, " result", false], [62496, 0.059665, " researcher", false], [31907, 0.053537, " rule", false], [63388, 0.029326, " consequence", false], [46530, 0.028851, " matter", false], [60212, 0.025235, " practical", false], [57103, 0.019097, " research", false], [55809, 0.016802, " computer", false], [62391, 0.012164, " programmer", false]]]}, "raw_delta": -0.03645833333333326, "tuned_delta": 0.016396610564866562}, {"byte_start": 4818, "byte_end": 4819, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "9.51%", "model_b": "7.89%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5906977653503418]], "model_b": [[45, ",", "normal", 0.6458930373191833]]}, "loss": {"model_a": 9.509952662109866, "model_b": 7.889738504861517}, "topk": {"model_a": [45, 1, 0.5906977653503418, [[45, 0.590698, ",", false], [4706, 0.125174, " of", false], [4858, 0.052579, " we", false], [46531, 0.032355, " mature", false], [38642, 0.030502, " grows", false], [32227, 0.021599, " that", false], [55981, 0.016008, " develops", false], [39072, 0.011669, " moves", false], [62394, 0.010946, " progresses", false], [55465, 0.005835, " advances", false]]], "model_b": [45, 1, 0.6458930373191833, [[45, 0.645893, ",", false], [4706, 0.08517, " of", false], [32227, 0.029977, " that", false], [4601, 0.025711, " it", false], [46531, 0.023351, " mature", false], [4858, 0.016772, " we", false], [55981, 0.010808, " develops", false], [55465, 0.010039, " advances", false], [4596, 0.009136, " in", false], [21800, 0.009076, " has", false]]]}, "raw_delta": 0.08984375, "tuned_delta": 0.14269869389819984}, {"byte_start": 4819, "byte_end": 4822, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 825, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "7.65% 7.65% 7.65%", "model_b": "13.81% 13.81% 13.81%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.2786005139350891]], "model_b": [[4858, " we", "normal", 0.10175453871488571]]}, "loss": {"model_a": 7.654924858883497, "model_b": 13.807042383507657}, "topk": {"model_a": [4858, 2, 0.2786005139350891, [[3609, 0.380155, " AI", false], [4858, 0.278601, " we", false], [55809, 0.109435, " computer", false], [4601, 0.039931, " it", false], [61594, 0.021039, " artificial", false], [22590, 0.020418, " the", false], [52167, 0.017241, " machine", false], [22248, 0.009357, " our", false], [21265, 0.008529, " and", false], [39934, 0.006458, " there", false]]], "model_b": [4858, 3, 0.10175453871488571, [[3609, 0.277586, " AI", false], [55809, 0.235011, " computer", false], [4858, 0.101755, " we", false], [4601, 0.069409, " it", false], [22590, 0.054967, " the", false], [21265, 0.026637, " and", false], [61594, 0.02021, " artificial", false], [57103, 0.018753, " research", false], [39934, 0.01336, " there", false], [52299, 0.01033, " natural", false]]]}, "raw_delta": -0.3411458333333333, "tuned_delta": -0.2882908894351335}, {"byte_start": 4822, "byte_end": 4828, "display": {"text": " still", "kind": "normal"}, "is_word": true, "word_id": 826, "word_key": " still", "bytes_hex": "20 73 74 69 6c 6c", "compression": {"model_a": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47%", "model_b": "17.00% 17.00% 17.00% 17.00% 17.00% 17.00%"}, "model_tokens": {"model_a": [[39820, " still", "normal", 0.0030168043449521065]], "model_b": [[39820, " still", "normal", 0.0034649791195988655]]}, "loss": {"model_a": 17.47013526076479, "model_b": 17.000507968808748}, "topk": {"model_a": [39820, 28, 0.0030168043449521065, [[31059, 0.23295, " have", false], [31506, 0.166021, " need", false], [47266, 0.161248, " should", false], [21286, 0.09285, " are", false], [31475, 0.042236, " must", false], [21413, 0.027307, " can", false], [32216, 0.022985, " tend", false], [4491, 0.014091, " do", false], [39196, 0.010811, " ought", false], [5231, 0.00911, "'ve", false]]], "model_b": [39820, 23, 0.0034649791195988655, [[31059, 0.283669, " have", false], [47266, 0.130027, " should", false], [21286, 0.115964, " are", false], [31506, 0.060245, " need", false], [21413, 0.040049, " can", false], [32216, 0.028883, " tend", false], [31475, 0.02835, " must", false], [22190, 0.014974, " now", false], [5231, 0.011703, "'ve", false], [32462, 0.011219, " were", false]]]}, "raw_delta": 0.02604166666666663, "tuned_delta": 0.07889661056486645}, {"byte_start": 4828, "byte_end": 4833, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 827, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "4.79% 4.79% 4.79% 4.79% 4.79%", "model_b": "3.41% 3.41% 3.41% 3.41% 3.41%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.26425880193710327]], "model_b": [[31059, " have", "normal", 0.38848116993904114]]}, "loss": {"model_a": 4.7901983779516355, "model_b": 3.40949413960087}, "topk": {"model_a": [31059, 1, 0.26425880193710327, [[31059, 0.264259, " have", false], [32216, 0.087031, " tend", false], [31506, 0.059979, " need", false], [4491, 0.045321, " do", false], [39942, 0.029483, " think", false], [31967, 0.021492, " seem", false], [57328, 0.020021, " struggle", false], [39761, 0.018796, " spend", false], [39171, 0.014437, " often", false], [38054, 0.01403, " cling", false]]], "model_b": [31059, 1, 0.38848116993904114, [[31059, 0.388481, " have", false], [31506, 0.107937, " need", false], [4491, 0.034949, " do", false], [32216, 0.027292, " tend", false], [39761, 0.022639, " spend", false], [21286, 0.017356, " are", false], [22681, 0.017126, " use", false], [51025, 0.016274, " believe", false], [31967, 0.012303, " seem", false], [31856, 0.01164, " rely", false]]]}, "raw_delta": 0.0765625, "tuned_delta": 0.1294174438981998}, {"byte_start": 4833, "byte_end": 4837, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 828, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "8.49% 8.49% 8.49% 8.49%", "model_b": "17.75% 17.75% 17.75% 17.75%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.15509766340255737]], "model_b": [[22187, " not", "normal", 0.019650762900710106]]}, "loss": {"model_a": 8.488513302105472, "model_b": 17.751911635938416}, "topk": {"model_a": [22187, 2, 0.15509766340255737, [[332, 0.319166, " a", false], [22187, 0.155098, " not", false], [31466, 0.082523, " much", false], [4811, 0.067771, " to", false], [31370, 0.051793, " many", false], [32074, 0.038341, " some", false], [22590, 0.02952, " the", false], [4419, 0.017555, " an", false], [22614, 0.012038, " too", false], [31335, 0.011072, " lots", false]]], "model_b": [22187, 8, 0.019650762900710106, [[332, 0.442304, " a", false], [31466, 0.142253, " much", false], [4811, 0.051131, " to", false], [31370, 0.041009, " many", false], [4419, 0.021647, " an", false], [22590, 0.021309, " the", false], [32074, 0.019921, " some", false], [22187, 0.019651, " not", false], [22614, 0.01706, " too", false], [4788, 0.009909, " so", false]]]}, "raw_delta": -0.513671875, "tuned_delta": -0.46081693110180016}, {"byte_start": 4837, "byte_end": 4848, "display": {"text": " thoroughly", "kind": "normal"}, "is_word": true, "word_id": 829, "word_key": " thoroughly", "bytes_hex": "20 74 68 6f 72 6f 75 67 68 6c 79", "compression": {"model_a": "11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32%", "model_b": "13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83%"}, "model_tokens": {"model_a": [[62646, " thoroughly", "normal", 0.0009956888388842344]], "model_b": [[62646, " thoroughly", "normal", 0.00021059098071418703]]}, "loss": {"model_a": 11.322287075158412, "model_b": 13.832658417614352}, "topk": {"model_a": [62646, 80, 0.0009956888388842344, [[38566, 0.236948, " fully", false], [52112, 0.194135, " learned", false], [22797, 0.037408, " yet", false], [56098, 0.033574, " embraced", false], [39423, 0.028742, " quite", false], [56480, 0.024553, " internal", false], [30482, 0.023188, " come", false], [46112, 0.021099, " gotten", false], [46526, 0.01832, " master", false], [31351, 0.018203, " made", false]]], "model_b": [62646, 245, 0.00021059098071418703, [[52112, 0.274349, " learned", false], [51738, 0.048523, " figured", false], [46526, 0.042825, " master", false], [38566, 0.037531, " fully", false], [22797, 0.032267, " yet", false], [31351, 0.030779, " made", false], [52643, 0.030348, " reached", false], [46112, 0.021251, " gotten", false], [30666, 0.019607, " done", false], [30259, 0.019411, " been", false]]]}, "raw_delta": -0.1392045454545455, "tuned_delta": -0.08634960155634568}, {"byte_start": 4848, "byte_end": 4856, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 830, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"model_a": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%", "model_b": "3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06%"}, "model_tokens": {"model_a": [[52112, " learned", "normal", 0.1295609474182129]], "model_b": [[52112, " learned", "normal", 0.2576465904712677]]}, "loss": {"model_a": 4.61408814346812, "model_b": 3.064318080013179}, "topk": {"model_a": [52112, 3, 0.1295609474182129, [[56480, 0.179516, " internal", false], [56098, 0.133741, " embraced", false], [52112, 0.129561, " learned", false], [62684, 0.074953, " understood", false], [55423, 0.063622, " absorbed", false], [45746, 0.033065, " digest", false], [37761, 0.031603, " assim", false], [38625, 0.028013, " grasp", false], [62141, 0.026715, " integrated", false], [63289, 0.018744, " appreciated", false]]], "model_b": [52112, 1, 0.2576465904712677, [[52112, 0.257647, " learned", false], [62684, 0.149414, " understood", false], [59685, 0.057336, " exploited", false], [63289, 0.045117, " appreciated", false], [46526, 0.032668, " master", false], [56182, 0.030012, " explored", false], [56098, 0.029287, " embraced", false], [38625, 0.020212, " grasp", false], [31428, 0.017572, " mine", false], [56480, 0.0175, " internal", false]]]}, "raw_delta": 0.0859375, "tuned_delta": 0.13879244389819984}, {"byte_start": 4856, "byte_end": 4859, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 831, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "2.32% 2.32% 2.32%", "model_b": "38.32% 38.32% 38.32%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.677315890789032]], "model_b": [[4601, " it", "normal", 0.0016924608498811722]]}, "loss": {"model_a": 2.3246550951824116, "model_b": 38.321587023613084}, "topk": {"model_a": [4601, 1, 0.677315890789032, [[4601, 0.677316, " it", false], [32234, 0.127661, " this", false], [22590, 0.048948, " the", false], [32227, 0.030953, " that", false], [4811, 0.02485, " to", false], [30917, 0.02267, " from", false], [21835, 0.016222, " how", false], [32464, 0.010287, " what", false], [21265, 0.007678, " and", false], [21256, 0.005091, " all", false]]], "model_b": [4601, 25, 0.0016924608498811722, [[21835, 0.266821, " how", false], [4811, 0.203572, " to", false], [30917, 0.195244, " from", false], [22590, 0.131856, " the", false], [32227, 0.047189, " that", false], [32464, 0.032799, " what", false], [21256, 0.013488, " all", false], [37598, 0.011818, " about", false], [32234, 0.010346, " this", false], [45, 0.009145, ",", false]]]}, "raw_delta": -1.99609375, "tuned_delta": -1.9432388061018002}, {"byte_start": 4859, "byte_end": 4860, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "26.35%", "model_b": "26.35%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.234673410654068]], "model_b": [[45, ",", "normal", 0.23818154633045197]]}, "loss": {"model_a": 26.346091078734, "model_b": 26.346091078734}, "topk": {"model_a": [45, 2, 0.234673410654068, [[47, 0.671303, ".", false], [45, 0.234673, ",", false], [21265, 0.017176, " and", false], [22797, 0.015439, " yet", false], [5346, 0.012264, "---", false], [60, 0.005795, ";", false], [4715, 0.005395, " or", false], [59, 0.005108, ":", false], [275, 0.004428, " (", false], [4596, 0.004321, " in", false]]], "model_b": [45, 2, 0.23818154633045197, [[47, 0.548507, ".", false], [45, 0.238182, ",", false], [5346, 0.036713, "---", false], [21265, 0.0246, " and", false], [22797, 0.017601, " yet", false], [60, 0.014457, ";", false], [32458, 0.013761, " well", false], [4596, 0.012396, " in", false], [22590, 0.012023, " the", false], [21256, 0.010343, " all", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 4860, "byte_end": 4863, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 832, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "25.74% 25.74% 25.74%", "model_b": "26.67% 26.67% 26.67%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.013639004901051521]], "model_b": [[4423, " as", "normal", 0.011628666892647743]]}, "loss": {"model_a": 25.73557559919114, "model_b": 26.67483018310323}, "topk": {"model_a": [4423, 9, 0.013639004901051521, [[21400, 0.354138, " but", false], [21265, 0.327752, " and", false], [55495, 0.045524, " although", false], [4715, 0.037441, " or", false], [30788, 0.021989, " even", false], [51018, 0.020665, " because", false], [47544, 0.015749, " though", false], [22185, 0.015352, " nor", false], [4423, 0.013639, " as", false], [51450, 0.013533, " despite", false]]], "model_b": [4423, 11, 0.011628666892647743, [[21265, 0.396458, " and", false], [21400, 0.327381, " but", false], [4715, 0.035884, " or", false], [55495, 0.024004, " although", false], [22185, 0.019788, " nor", false], [51450, 0.019248, " despite", false], [30788, 0.01683, " even", false], [51018, 0.013401, " because", false], [4596, 0.013081, " in", false], [4788, 0.011668, " so", false]]]}, "raw_delta": -0.05208333333333348, "tuned_delta": 0.0007716105648663402}, {"byte_start": 4863, "byte_end": 4866, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 833, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "11.98% 11.98% 11.98%", "model_b": "12.02% 12.02% 12.02%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.13870051503181458]], "model_b": [[4858, " we", "normal", 0.13420267403125763]]}, "loss": {"model_a": 11.97549594487909, "model_b": 12.022458674074693}, "topk": {"model_a": [4858, 2, 0.13870051503181458, [[4601, 0.153214, " it", false], [4858, 0.138701, " we", false], [59655, 0.108903, " evidenced", false], [39934, 0.049631, " there", false], [332, 0.049428, " a", false], [22590, 0.040278, " the", false], [4600, 0.030862, " is", false], [31370, 0.025904, " many", false], [3609, 0.019452, " AI", false], [31466, 0.016128, " much", false]]], "model_b": [4858, 1, 0.13420267403125763, [[4858, 0.134203, " we", false], [332, 0.096282, " a", false], [4601, 0.071266, " it", false], [39934, 0.053579, " there", false], [22590, 0.049095, " the", false], [59655, 0.03835, " evidenced", false], [4491, 0.034169, " do", false], [21660, 0.031121, " far", false], [4596, 0.020969, " in", false], [308, 0.020623, " I", false]]]}, "raw_delta": -0.0026041666666666297, "tuned_delta": 0.05025077723153319}, {"byte_start": 4866, "byte_end": 4870, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 834, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "11.91% 11.91% 11.91% 11.91%", "model_b": "12.61% 12.61% 12.61% 12.61%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.0700310617685318]], "model_b": [[21286, " are", "normal", 0.06092755123972893]]}, "loss": {"model_a": 11.905051851085684, "model_b": 12.609492789019747}, "topk": {"model_a": [21286, 4, 0.0700310617685318, [[31059, 0.248931, " have", false], [39820, 0.09733, " still", false], [47266, 0.084461, " should", false], [21286, 0.070031, " are", false], [55851, 0.039031, " continue", false], [22449, 0.023473, " see", false], [21413, 0.021868, " can", false], [21532, 0.020472, " did", false], [32475, 0.017965, " will", false], [31967, 0.016802, " seem", false]]], "model_b": [21286, 4, 0.06092755123972893, [[31059, 0.307849, " have", false], [47266, 0.083716, " should", false], [39820, 0.079268, " still", false], [21286, 0.060928, " are", false], [4491, 0.046544, " do", false], [21532, 0.025419, " did", false], [55851, 0.024543, " continue", false], [31506, 0.020441, " need", false], [38877, 0.0187, " learn", false], [21413, 0.016055, " can", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.013792443898199822}, {"byte_start": 4870, "byte_end": 4881, "display": {"text": " continuing", "kind": "normal"}, "is_word": true, "word_id": 835, "word_key": " continuing", "bytes_hex": "20 63 6f 6e 74 69 6e 75 69 6e 67", "compression": {"model_a": "8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81%", "model_b": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%"}, "model_tokens": {"model_a": [[61774, " continuing", "normal", 0.004558044485747814]], "model_b": [[61774, " continuing", "normal", 0.005715612322092056]]}, "loss": {"model_a": 8.811915732702476, "model_b": 8.45329125520877}, "topk": {"model_a": [61774, 16, 0.004558044485747814, [[39820, 0.602885, " still", false], [21256, 0.025086, " all", false], [22187, 0.02216, " not", false], [4788, 0.01717, " so", false], [4596, 0.015944, " in", false], [39364, 0.01348, " prone", false], [22614, 0.013024, " too", false], [22190, 0.012886, " now", false], [45150, 0.009485, " always", false], [61760, 0.009481, " constantly", false]]], "model_b": [61774, 21, 0.005715612322092056, [[39820, 0.3714, " still", false], [22187, 0.047946, " not", false], [56537, 0.029437, " learning", false], [61760, 0.02836, " constantly", false], [31198, 0.01984, " just", false], [4596, 0.019727, " in", false], [31581, 0.018095, " only", false], [39171, 0.014359, " often", false], [21256, 0.014231, " all", false], [45150, 0.013179, " always", false]]]}, "raw_delta": 0.019886363636363646, "tuned_delta": 0.07274130753456347}, {"byte_start": 4881, "byte_end": 4884, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 836, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.48% 0.48% 0.48%", "model_b": "0.77% 0.77% 0.77%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9239760041236877]], "model_b": [[4811, " to", "normal", 0.8786829710006714]]}, "loss": {"model_a": 0.47549763310549326, "model_b": 0.7748850317274705}, "topk": {"model_a": [4811, 1, 0.9239760041236877, [[4811, 0.923976, " to", false], [45, 0.012376, ",", false], [22590, 0.011565, " the", false], [4596, 0.006194, " in", false], [22248, 0.005699, " our", false], [32487, 0.005426, " with", false], [332, 0.004097, " a", false], [4712, 0.002737, " on", false], [51566, 0.002228, " efforts", false], [275, 0.001635, " (", false]]], "model_b": [4811, 1, 0.8786829710006714, [[4811, 0.878683, " to", false], [22248, 0.016532, " our", false], [22590, 0.015451, " the", false], [32487, 0.012612, " with", false], [4596, 0.010376, " in", false], [4712, 0.008804, " on", false], [30678, 0.008786, " down", false], [332, 0.005117, " a", false], [45, 0.003488, ",", false], [4419, 0.00209, " an", false]]]}, "raw_delta": -0.0166015625, "tuned_delta": 0.03625338139819982}, {"byte_start": 4884, "byte_end": 4889, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 837, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"model_a": "13.02% 13.02% 13.02% 13.02% 13.02%", "model_b": "10.88% 10.88% 10.88% 10.88% 10.88%"}, "model_tokens": {"model_a": [[31358, " make", "normal", 0.0270343329757452]], "model_b": [[31358, " make", "normal", 0.04907158389687538]]}, "loss": {"model_a": 13.018068533021506, "model_b": 10.87656808170195}, "topk": {"model_a": [31358, 6, 0.0270343329757452, [[46330, 0.085807, " invest", false], [22626, 0.055761, " try", false], [46960, 0.039613, " pursue", false], [22339, 0.031029, " put", false], [39761, 0.027857, " spend", false], [31358, 0.027034, " make", false], [40166, 0.025084, " waste", false], [4435, 0.021336, " be", false], [38530, 0.020374, " focus", false], [4491, 0.019953, " do", false]]], "model_b": [31358, 2, 0.04907158389687538, [[38877, 0.088805, " learn", false], [31358, 0.049072, " make", false], [57328, 0.033485, " struggle", false], [22626, 0.032805, " try", false], [46330, 0.032463, " invest", false], [4491, 0.031343, " do", false], [47202, 0.030891, " search", false], [39761, 0.027957, " spend", false], [46960, 0.02547, " pursue", false], [37923, 0.022432, " build", false]]]}, "raw_delta": 0.11875000000000002, "tuned_delta": 0.17160494389819986}, {"byte_start": 4889, "byte_end": 4893, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 838, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.62% 11.62% 11.62% 11.62%", "model_b": "14.93% 14.93% 14.93% 14.93%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.07610104233026505]], "model_b": [[22590, " the", "normal", 0.03633382171392441]]}, "loss": {"model_a": 11.623275475912058, "model_b": 14.934147884202158}, "topk": {"model_a": [22590, 2, 0.07610104233026505, [[51566, 0.082087, " efforts", false], [22590, 0.076101, " the", false], [56950, 0.058132, " progress", false], [52224, 0.057749, " methods", false], [56652, 0.034247, " mistakes", false], [57103, 0.027605, " research", false], [22681, 0.024852, " use", false], [332, 0.021168, " a", false], [63678, 0.018611, " investments", false], [38720, 0.017191, " human", false]]], "model_b": [22590, 4, 0.03633382171392441, [[56950, 0.150702, " progress", false], [56652, 0.101347, " mistakes", false], [22168, 0.051238, " new", false], [22590, 0.036334, " the", false], [31458, 0.027313, " more", false], [31118, 0.024028, " huge", false], [38629, 0.022104, " great", false], [22248, 0.017239, " our", false], [332, 0.016382, " a", false], [51566, 0.016092, " efforts", false]]]}, "raw_delta": -0.18359375, "tuned_delta": -0.13073880610180016}, {"byte_start": 4893, "byte_end": 4898, "display": {"text": " same", "kind": "normal"}, "is_word": true, "word_id": 839, "word_key": " same", "bytes_hex": "20 73 61 6d 65", "compression": {"model_a": "3.45% 3.45% 3.45% 3.45% 3.45%", "model_b": "3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"model_a": [[31937, " same", "normal", 0.38624903559684753]], "model_b": [[31937, " same", "normal", 0.37217479944229126]]}, "loss": {"model_a": 3.451760595876914, "model_b": 3.5785599647050454}, "topk": {"model_a": [31937, 1, 0.38624903559684753, [[31937, 0.386249, " same", false], [52245, 0.230787, " mistake", false], [56652, 0.050547, " mistakes", false], [38720, 0.02366, " human", false], [22221, 0.013462, " old", false], [62660, 0.011953, " transition", false], [45315, 0.011876, " bitter", false], [45829, 0.01138, " effort", false], [38392, 0.011158, " error", false], [45597, 0.008004, " costly", false]]], "model_b": [31937, 1, 0.37217479944229126, [[31937, 0.372175, " same", false], [56652, 0.147803, " mistakes", false], [52245, 0.042006, " mistake", false], [31461, 0.027574, " most", false], [38841, 0.018152, " kinds", false], [45829, 0.017456, " effort", false], [40229, 0.011643, " wrong", false], [47202, 0.008713, " search", false], [51039, 0.008367, " biggest", false], [38392, 0.007341, " error", false]]]}, "raw_delta": -0.007031249999999989, "tuned_delta": 0.04582369389819983}, {"byte_start": 4898, "byte_end": 4903, "display": {"text": " kind", "kind": "normal"}, "is_word": true, "word_id": 840, "word_key": " kind", "bytes_hex": "20 6b 69 6e 64", "compression": {"model_a": "18.94% 18.94% 18.94% 18.94% 18.94%", "model_b": "18.37% 18.37% 18.37% 18.37% 18.37%"}, "model_tokens": {"model_a": [[31214, " kind", "normal", 0.005167159251868725]], "model_b": [[31214, " kind", "normal", 0.006122685968875885]]}, "loss": {"model_a": 18.935372411667643, "model_b": 18.37181966132039}, "topk": {"model_a": [31214, 6, 0.005167159251868725, [[56652, 0.734502, " mistakes", false], [52245, 0.13136, " mistake", false], [38841, 0.014189, " kinds", false], [45888, 0.013428, " errors", false], [22221, 0.007576, " old", false], [31214, 0.005167, " kind", false], [39745, 0.004648, " sorts", false], [38392, 0.004572, " error", false], [21325, 0.004458, " bad", false], [37812, 0.004414, " basic", false]]], "model_b": [31214, 5, 0.006122685968875885, [[56652, 0.789385, " mistakes", false], [52245, 0.035274, " mistake", false], [38841, 0.02441, " kinds", false], [45888, 0.021584, " errors", false], [31214, 0.006123, " kind", false], [37812, 0.004997, " basic", false], [63591, 0.004106, " fundamental", false], [4440, 0.003681, " bl", false], [38392, 0.003463, " error", false], [45, 0.002984, ",", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 4903, "byte_end": 4906, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 841, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.03% 0.03% 0.03%", "model_b": "0.03% 0.03% 0.03%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9947977066040039]], "model_b": [[4706, " of", "normal", 0.9947562217712402]]}, "loss": {"model_a": 0.031186187356455963, "model_b": 0.03173653183921695}, "topk": {"model_a": [4706, 1, 0.9947977066040039, [[4706, 0.994798, " of", false], [56652, 0.002573, " mistakes", false], [45888, 0.000566, " errors", false], [46, 0.000324, "-", false], [45, 0.000165, ",", false], [275, 0.000103, " (", false], [21265, 0.0001, " and", false], [51566, 8.8e-05, " efforts", false], [4715, 8.1e-05, " or", false], [52245, 7.1e-05, " mistake", false]]], "model_b": [4706, 1, 0.9947562217712402, [[4706, 0.994756, " of", false], [56652, 0.001682, " mistakes", false], [45888, 0.000502, " errors", false], [46, 0.00038, "-", false], [21265, 0.00027, " and", false], [45, 0.000176, ",", false], [8579, 0.000153, "red", false], [7513, 0.000126, "est", false], [26151, 0.000102, "ling", false], [275, 9e-05, " (", false]]]}, "raw_delta": -3.0517578125e-05, "tuned_delta": 0.05282442632007482}, {"byte_start": 4906, "byte_end": 4915, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 842, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"model_a": "1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17%", "model_b": "0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%"}, "model_tokens": {"model_a": [[56652, " mistakes", "normal", 0.5563517212867737]], "model_b": [[56652, " mistakes", "normal", 0.614142119884491]]}, "loss": {"model_a": 1.1662411083575062, "model_b": 0.9666495092761881}, "topk": {"model_a": [56652, 1, 0.5563517212867737, [[56652, 0.556352, " mistakes", false], [52245, 0.06039, " mistake", false], [57103, 0.024885, " research", false], [45888, 0.023903, " errors", false], [51566, 0.021613, " efforts", false], [45829, 0.020253, " effort", false], [63678, 0.017723, " investments", false], [52224, 0.017154, " methods", false], [38392, 0.011943, " error", false], [62157, 0.011459, " investment", false]]], "model_b": [56652, 1, 0.614142119884491, [[56652, 0.614142, " mistakes", false], [52245, 0.034786, " mistake", false], [56950, 0.032418, " progress", false], [45888, 0.030599, " errors", false], [57103, 0.011722, " research", false], [45829, 0.009187, " effort", false], [37862, 0.006944, " blind", false], [4440, 0.006197, " bl", false], [38392, 0.006025, " error", false], [51566, 0.005916, " efforts", false]]]}, "raw_delta": 0.011067708333333343, "tuned_delta": 0.06392265223153316}, {"byte_start": 4915, "byte_end": 4916, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "32.69%", "model_b": "20.71%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.1626049280166626]], "model_b": [[47, ".", "normal", 0.31922832131385803]]}, "loss": {"model_a": 32.686059520140574, "model_b": 20.710563575261485}, "topk": {"model_a": [47, 3, 0.1626049280166626, [[4596, 0.199967, " in", false], [31601, 0.166794, " over", false], [47, 0.162605, ".", false], [32227, 0.104893, " that", false], [45, 0.086867, ",", false], [4423, 0.045163, " as", false], [37635, 0.029134, " again", false], [4858, 0.028167, " we", false], [32487, 0.021361, " with", false], [62482, 0.012338, " repeatedly", false]]], "model_b": [47, 1, 0.31922832131385803, [[47, 0.319228, ".", false], [31601, 0.124298, " over", false], [45, 0.082858, ",", false], [4596, 0.077729, " in", false], [32227, 0.069499, " that", false], [4858, 0.051341, " we", false], [4423, 0.034066, " as", false], [32487, 0.026505, " with", false], [21265, 0.025062, " and", false], [37635, 0.013468, " again", false]]]}, "raw_delta": 0.6640625, "tuned_delta": 0.7169174438981998}, {"byte_start": 4916, "byte_end": 4919, "display": {"text": " To", "kind": "normal"}, "is_word": true, "word_id": 843, "word_key": " to", "bytes_hex": "20 54 6f", "compression": {"model_a": "31.00% 31.00% 31.00%", "model_b": "29.49% 29.49% 29.49%"}, "model_tokens": {"model_a": [[4255, " To", "normal", 0.005856001283973455]], "model_b": [[4255, " To", "normal", 0.007396377623081207]]}, "loss": {"model_a": 30.99540126909882, "model_b": 29.492593934839483}, "topk": {"model_a": [4255, 27, 0.005856001283973455, [[4331, 0.127753, " We", false], [20996, 0.089293, " The", false], [261, 0.073154, "\n\n", false], [19555, 0.06108, " But", false], [3913, 0.054125, " In", false], [3918, 0.045495, " It", false], [37451, 0.044387, " There", false], [29894, 0.023144, " This", false], [19907, 0.020668, " For", false], [19417, 0.020113, " And", false]]], "model_b": [4255, 23, 0.007396377623081207, [[4331, 0.130516, " We", false], [19555, 0.126163, " But", false], [20996, 0.086231, " The", false], [261, 0.05452, "\n\n", false], [3918, 0.049515, " It", false], [19417, 0.036525, " And", false], [3913, 0.031918, " In", false], [37451, 0.028469, " There", false], [29894, 0.024615, " This", false], [3908, 0.01714, " If", false]]]}, "raw_delta": 0.08333333333333326, "tuned_delta": 0.1361882772315331}, {"byte_start": 4919, "byte_end": 4923, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 844, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"model_a": "17.68% 17.68% 17.68% 17.68%", "model_b": "21.13% 21.13% 21.13% 21.13%"}, "model_tokens": {"model_a": [[22449, " see", "normal", 0.01999257318675518]], "model_b": [[22449, " see", "normal", 0.009082840755581856]]}, "loss": {"model_a": 17.681467542145008, "model_b": 21.133228138021924}, "topk": {"model_a": [22449, 14, 0.01999257318675518, [[4435, 0.098472, " be", false], [31358, 0.061808, " make", false], [22590, 0.043571, " the", false], [32187, 0.04145, " take", false], [21751, 0.029618, " get", false], [4491, 0.028056, " do", false], [32074, 0.027429, " some", false], [37786, 0.027001, " avoid", false], [39232, 0.024763, " parap", false], [38877, 0.023829, " learn", false]]], "model_b": [22449, 18, 0.009082840755581856, [[4435, 0.098411, " be", false], [31358, 0.064955, " make", false], [38877, 0.054882, " learn", false], [37786, 0.046762, " avoid", false], [21751, 0.040256, " get", false], [4491, 0.035129, " do", false], [22590, 0.034387, " the", false], [51982, 0.024144, " improve", false], [32074, 0.019841, " some", false], [22339, 0.019763, " put", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13855130610180016}, {"byte_start": 4923, "byte_end": 4928, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 845, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "7.83% 7.83% 7.83% 7.83% 7.83%", "model_b": "8.23% 8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.11412829905748367]], "model_b": [[32234, " this", "normal", 0.10378582030534744]]}, "loss": {"model_a": 7.833383229826793, "model_b": 8.22787015506987}, "topk": {"model_a": [32234, 4, 0.11412829905748367, [[22590, 0.166783, " the", false], [22763, 0.163255, " why", false], [21835, 0.128892, " how", false], [32234, 0.114128, " this", false], [4601, 0.076323, " it", false], [32464, 0.057113, " what", false], [32227, 0.049695, " that", false], [332, 0.036571, " a", false], [4419, 0.018708, " an", false], [31458, 0.012861, " more", false]]], "model_b": [32234, 3, 0.10378582030534744, [[21835, 0.184012, " how", false], [22590, 0.167791, " the", false], [32234, 0.103786, " this", false], [32464, 0.072837, " what", false], [32227, 0.061716, " that", false], [4601, 0.044405, " it", false], [40185, 0.039136, " where", false], [332, 0.036233, " a", false], [4588, 0.033223, " if", false], [22763, 0.032183, " why", false]]]}, "raw_delta": -0.021874999999999978, "tuned_delta": 0.030979943898199844}, {"byte_start": 4928, "byte_end": 4929, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "12.82%", "model_b": "13.38%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.4983038306236267]], "model_b": [[45, ",", "normal", 0.4683462679386139]]}, "loss": {"model_a": 12.820825070399966, "model_b": 13.384377820747218}, "topk": {"model_a": [45, 1, 0.4983038306236267, [[45, 0.498304, ",", false], [46430, 0.131626, " lesson", false], [31458, 0.056448, " more", false], [4596, 0.04666, " in", false], [51208, 0.038711, " clearly", false], [52427, 0.038168, " pattern", false], [4423, 0.015632, " as", false], [4600, 0.010752, " is", false], [31461, 0.008782, " most", false], [4858, 0.007303, " we", false]]], "model_b": [45, 1, 0.4683462679386139, [[45, 0.468346, ",", false], [46430, 0.094982, " lesson", false], [4600, 0.057864, " is", false], [4596, 0.047043, " in", false], [51208, 0.0361, " clearly", false], [4858, 0.027298, " we", false], [52427, 0.019244, " pattern", false], [21700, 0.010541, " for", false], [31458, 0.00992, " more", false], [4423, 0.009323, " as", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 4929, "byte_end": 4933, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 846, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "24.23% 24.23% 24.23% 24.23%", "model_b": "21.27% 21.27% 21.27% 21.27%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.0046770707704126835]], "model_b": [[21265, " and", "normal", 0.008927552029490471]]}, "loss": {"model_a": 24.232768264931806, "model_b": 21.274116325608734}, "topk": {"model_a": [21265, 20, 0.0046770707704126835, [[4858, 0.168919, " we", false], [4601, 0.1655, " it", false], [55832, 0.161495, " consider", false], [22226, 0.080563, " one", false], [31324, 0.058651, " look", false], [22001, 0.052639, " let", false], [31198, 0.049465, " just", false], [51250, 0.038824, " compare", false], [32187, 0.022361, " take", false], [39942, 0.017122, " think", false]]], "model_b": [21265, 16, 0.008927552029490471, [[4858, 0.223276, " we", false], [55832, 0.139677, " consider", false], [31324, 0.131082, " look", false], [22001, 0.053526, " let", false], [4601, 0.052921, " it", false], [22226, 0.0445, " one", false], [31198, 0.043922, " just", false], [32187, 0.029859, " take", false], [39942, 0.023996, " think", false], [22799, 0.016037, " you", false]]]}, "raw_delta": 0.1640625, "tuned_delta": 0.21691744389819984}, {"byte_start": 4933, "byte_end": 4936, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 847, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "3.33% 3.33% 3.33%", "model_b": "3.94% 3.94% 3.94%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.5745233297348022]], "model_b": [[4811, " to", "normal", 0.5181233286857605]]}, "loss": {"model_a": 3.3343537728879036, "model_b": 3.9448692524307587}, "topk": {"model_a": [4811, 1, 0.5745233297348022, [[4811, 0.574523, " to", false], [22590, 0.053062, " the", false], [38877, 0.026317, " learn", false], [21835, 0.018352, " how", false], [22763, 0.018079, " why", false], [30135, 0.016449, " also", false], [22449, 0.0135, " see", false], [62683, 0.012929, " understand", false], [21902, 0.01124, " its", false], [52448, 0.010942, " perhaps", false]]], "model_b": [4811, 1, 0.5181233286857605, [[4811, 0.518123, " to", false], [22590, 0.061491, " the", false], [30135, 0.025626, " also", false], [62683, 0.022518, " understand", false], [46726, 0.017475, " others", false], [39193, 0.015963, " other", false], [52448, 0.01593, " perhaps", false], [31458, 0.01488, " more", false], [32464, 0.014475, " what", false], [38877, 0.013625, " learn", false]]]}, "raw_delta": -0.03385416666666666, "tuned_delta": 0.019000777231533164}, {"byte_start": 4936, "byte_end": 4948, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 848, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"model_a": "13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62%", "model_b": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50%"}, "model_tokens": {"model_a": [[63507, " effectively", "normal", 0.00011875177006004378]], "model_b": [[63507, " effectively", "normal", 3.1913514249026775e-05]]}, "loss": {"model_a": 13.61919146672524, "model_b": 15.49770063454941}, "topk": {"model_a": [63507, 340, 0.00011875177006004378, [[22449, 0.213074, " see", false], [62683, 0.147705, " understand", false], [38877, 0.091134, " learn", false], [37786, 0.051707, " avoid", false], [61588, 0.04702, " appreciate", false], [4435, 0.032467, " be", false], [21751, 0.031398, " get", false], [31358, 0.026367, " make", false], [31059, 0.01573, " have", false], [52653, 0.013743, " realize", false]]], "model_b": [63507, 823, 3.1913514249026775e-05, [[22449, 0.16467, " see", false], [62683, 0.158266, " understand", false], [38877, 0.073291, " learn", false], [61588, 0.032785, " appreciate", false], [21751, 0.03003, " get", false], [4435, 0.024383, " be", false], [32187, 0.018885, " take", false], [31358, 0.018722, " make", false], [31223, 0.017019, " know", false], [37786, 0.016514, " avoid", false]]]}, "raw_delta": -0.10416666666666663, "tuned_delta": -0.05131172276846681}, {"byte_start": 4948, "byte_end": 4955, "display": {"text": " resist", "kind": "normal"}, "is_word": true, "word_id": 849, "word_key": " resist", "bytes_hex": "20 72 65 73 69 73 74", "compression": {"model_a": "14.01% 14.01% 14.01% 14.01% 14.01% 14.01% 14.01%", "model_b": "19.48% 19.48% 19.48% 19.48% 19.48% 19.48% 19.48%"}, "model_tokens": {"model_a": [[47087, " resist", "normal", 0.0043001724407076836]], "model_b": [[47087, " resist", "normal", 0.0005201094318181276]]}, "loss": {"model_a": 14.008311222917389, "model_b": 19.48282365486211}, "topk": {"model_a": [47087, 33, 0.0043001724407076836, [[38877, 0.127212, " learn", false], [37730, 0.100338, " apply", false], [37786, 0.084858, " avoid", false], [22681, 0.056154, " use", false], [50855, 0.032481, " address", false], [56540, 0.032393, " leverage", false], [51336, 0.031593, " counter", false], [45522, 0.024684, " combat", false], [32187, 0.023693, " take", false], [53251, 0.021767, " utilize", false]]], "model_b": [47087, 198, 0.0005201094318181276, [[38877, 0.100315, " learn", false], [37730, 0.09169, " apply", false], [22681, 0.073556, " use", false], [56540, 0.052636, " leverage", false], [50855, 0.043503, " address", false], [37786, 0.027812, " avoid", false], [45450, 0.015833, " change", false], [31358, 0.015264, " make", false], [32187, 0.014889, " take", false], [51903, 0.014714, " harness", false]]]}, "raw_delta": -0.30357142857142844, "tuned_delta": -0.2507164846732286}, {"byte_start": 4955, "byte_end": 4958, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 850, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "13.62% 13.62% 13.62%", "model_b": "7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.10201247781515121]], "model_b": [[4601, " it", "normal", 0.26866498589515686]]}, "loss": {"model_a": 13.61919146672524, "model_b": 7.889738504861517}, "topk": {"model_a": [4601, 2, 0.10201247781515121, [[22590, 0.435221, " the", false], [4601, 0.102012, " it", false], [32234, 0.092436, " this", false], [39936, 0.050432, " these", false], [46500, 0.048664, " making", false], [60384, 0.022109, " repeating", false], [32229, 0.01595, " them", false], [39944, 0.015753, " those", false], [32227, 0.01449, " that", false], [32139, 0.014353, " such", false]]], "model_b": [4601, 2, 0.26866498589515686, [[22590, 0.318319, " the", false], [4601, 0.268665, " it", false], [32229, 0.072165, " them", false], [21902, 0.035101, " its", false], [32234, 0.028133, " this", false], [332, 0.019004, " a", false], [39936, 0.017411, " these", false], [39944, 0.013989, " those", false], [32139, 0.012486, " such", false], [51816, 0.012232, " further", false]]]}, "raw_delta": 0.31770833333333337, "tuned_delta": 0.3705632772315332}, {"byte_start": 4958, "byte_end": 4959, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "0.88%", "model_b": "2.17%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9527425765991211]], "model_b": [[45, ",", "normal", 0.8876431584358215]]}, "loss": {"model_a": 0.8761484165554922, "model_b": 2.1661558841472472}, "topk": {"model_a": [45, 1, 0.9527425765991211, [[45, 0.952743, ",", false], [4596, 0.014393, " in", false], [275, 0.003893, " (", false], [4423, 0.003174, " as", false], [32465, 0.002617, " when", false], [4600, 0.002336, " is", false], [5346, 0.001509, "---", false], [57102, 0.001441, " requires", false], [21265, 0.001323, " and", false], [38606, 0.000961, " going", false]]], "model_b": [45, 1, 0.8876431584358215, [[45, 0.887643, ",", false], [4596, 0.025394, " in", false], [4600, 0.021765, " is", false], [5346, 0.021735, "---", false], [57102, 0.004313, " requires", false], [4423, 0.00367, " as", false], [21265, 0.003373, " and", false], [275, 0.003179, " (", false], [21700, 0.003031, " for", false], [32465, 0.002071, " when", false]]]}, "raw_delta": -0.071533203125, "tuned_delta": -0.01867825922680018}, {"byte_start": 4959, "byte_end": 4962, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 851, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "5.00% 5.00% 5.00%", "model_b": "2.74% 2.74% 2.74%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.43613144755363464]], "model_b": [[4858, " we", "normal", 0.6350927352905273]]}, "loss": {"model_a": 5.001530659331855, "model_b": 2.735578975643949}, "topk": {"model_a": [4858, 1, 0.43613144755363464, [[4858, 0.436131, " we", false], [4601, 0.18133, " it", false], [22226, 0.103628, " one", false], [57102, 0.045983, " requires", false], [4600, 0.044275, " is", false], [22590, 0.024659, " the", false], [22799, 0.018464, " you", false], [308, 0.015876, " I", false], [332, 0.013112, " a", false], [22001, 0.009273, " let", false]]], "model_b": [4858, 1, 0.6350927352905273, [[4858, 0.635093, " we", false], [4600, 0.077392, " is", false], [4601, 0.033292, " it", false], [22226, 0.033215, " one", false], [22590, 0.023954, " the", false], [22799, 0.014503, " you", false], [39934, 0.012796, " there", false], [332, 0.011612, " a", false], [21256, 0.009899, " all", false], [57102, 0.009593, " requires", false]]]}, "raw_delta": 0.12565104166666666, "tuned_delta": 0.17850598556486647}, {"byte_start": 4962, "byte_end": 4967, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 852, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "9.97% 9.97% 9.97% 9.97% 9.97%", "model_b": "9.35% 9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.06227442994713783]], "model_b": [[31059, " have", "normal", 0.07308510690927505]]}, "loss": {"model_a": 9.974883681146347, "model_b": 9.354975655764372}, "topk": {"model_a": [31059, 3, 0.06227442994713783, [[31506, 0.592669, " need", false], [31475, 0.164638, " must", false], [31059, 0.062274, " have", false], [47266, 0.062249, " should", false], [21413, 0.030785, " can", false], [32475, 0.014895, " will", false], [38499, 0.010103, " first", false], [40219, 0.007856, " would", false], [39021, 0.006721, " might", false], [22074, 0.006175, " may", false]]], "model_b": [31059, 3, 0.07308510690927505, [[31506, 0.552233, " need", false], [31475, 0.228827, " must", false], [31059, 0.073085, " have", false], [47266, 0.036759, " should", false], [32475, 0.03217, " will", false], [38499, 0.012193, " first", false], [21413, 0.009301, " can", false], [21286, 0.006594, " are", false], [21256, 0.006501, " all", false], [40219, 0.003835, " would", false]]]}, "raw_delta": 0.03437499999999993, "tuned_delta": 0.08722994389819975}, {"byte_start": 4967, "byte_end": 4970, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 853, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.39% 0.39% 0.39%", "model_b": "1.31% 1.31% 1.31%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9367923140525818]], "model_b": [[4811, " to", "normal", 0.8038654923439026]]}, "loss": {"model_a": 0.39331285701318575, "model_b": 1.3149564174769197}, "topk": {"model_a": [4811, 1, 0.9367923140525818, [[4811, 0.936792, " to", false], [31581, 0.014162, " only", false], [332, 0.008546, " a", false], [22638, 0.003803, " two", false], [4419, 0.001415, " an", false], [32074, 0.001409, " some", false], [30259, 0.001353, " been", false], [39946, 0.001241, " three", false], [22590, 0.001135, " the", false], [38499, 0.000998, " first", false]]], "model_b": [4811, 1, 0.8038654923439026, [[4811, 0.803865, " to", false], [332, 0.040013, " a", false], [22638, 0.023451, " two", false], [39946, 0.012727, " three", false], [31581, 0.009976, " only", false], [22590, 0.008279, " the", false], [21772, 0.006679, " got", false], [4419, 0.005236, " an", false], [22187, 0.00467, " not", false], [30259, 0.004405, " been", false]]]}, "raw_delta": -0.05110677083333334, "tuned_delta": 0.001748173064866479}, {"byte_start": 4970, "byte_end": 4981, "display": {"text": " understand", "kind": "normal"}, "is_word": true, "word_id": 854, "word_key": " understand", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64", "compression": {"model_a": "2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91%", "model_b": "4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07%"}, "model_tokens": {"model_a": [[62683, " understand", "normal", 0.1684887558221817]], "model_b": [[62683, " understand", "normal", 0.08320644497871399]]}, "loss": {"model_a": 2.907419871109682, "model_b": 4.072949422964226}, "topk": {"model_a": [62683, 1, 0.1684887558221817, [[62683, 0.168489, " understand", false], [4435, 0.068354, " be", false], [31324, 0.053897, " look", false], [60335, 0.038017, " recognize", false], [38877, 0.033313, " learn", false], [31059, 0.032782, " have", false], [21295, 0.026324, " ask", false], [39942, 0.025995, " think", false], [22449, 0.025844, " see", false], [31205, 0.023131, " keep", false]]], "model_b": [62683, 1, 0.08320644497871399, [[62683, 0.083206, " understand", false], [38877, 0.081346, " learn", false], [4435, 0.078016, " be", false], [31324, 0.046975, " look", false], [31358, 0.029488, " make", false], [32187, 0.025072, " take", false], [22449, 0.02335, " see", false], [31059, 0.023162, " have", false], [31205, 0.020448, " keep", false], [4491, 0.018379, " do", false]]]}, "raw_delta": -0.06463068181818184, "tuned_delta": -0.011775737919982016}, {"byte_start": 4981, "byte_end": 4985, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 855, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.18% 5.18% 5.18% 5.18%", "model_b": "5.46% 5.46% 5.46% 5.46%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.3172062933444977]], "model_b": [[22590, " the", "normal", 0.29525914788246155]]}, "loss": {"model_a": 5.177640893815371, "model_b": 5.459417268988997}, "topk": {"model_a": [22590, 1, 0.3172062933444977, [[22590, 0.317206, " the", false], [32464, 0.149506, " what", false], [22763, 0.11575, " why", false], [21835, 0.093685, " how", false], [4601, 0.067098, " it", false], [32227, 0.030138, " that", false], [21265, 0.016573, " and", false], [332, 0.014402, " a", false], [21902, 0.013513, " its", false], [32234, 0.013232, " this", false]]], "model_b": [22590, 1, 0.29525914788246155, [[22590, 0.295259, " the", false], [4601, 0.094833, " it", false], [32464, 0.093145, " what", false], [21835, 0.082463, " how", false], [32227, 0.072779, " that", false], [22763, 0.072283, " why", false], [21902, 0.039473, " its", false], [32234, 0.03504, " this", false], [21265, 0.021879, " and", false], [40185, 0.015124, " where", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 4985, "byte_end": 4992, "display": {"text": " appeal", "kind": "normal"}, "is_word": true, "word_id": 856, "word_key": " appeal", "bytes_hex": "20 61 70 70 65 61 6c", "compression": {"model_a": "21.09% 21.09% 21.09% 21.09% 21.09% 21.09% 21.09%", "model_b": "23.83% 23.83% 23.83% 23.83% 23.83% 23.83% 23.83%"}, "model_tokens": {"model_a": [[45184, " appeal", "normal", 0.0002793184539768845]], "model_b": [[45184, " appeal", "normal", 9.380631672684103e-05]]}, "loss": {"model_a": 21.09297437013998, "model_b": 23.83023058611234}, "topk": {"model_a": [45184, 323, 0.0002793184539768845, [[46642, 0.095019, " nature", false], [46430, 0.041999, " lesson", false], [52127, 0.031222, " lessons", false], [52654, 0.029743, " reasons", false], [51929, 0.02848, " history", false], [51832, 0.027725, " general", false], [52427, 0.023978, " pattern", false], [62418, 0.023442, " psychology", false], [37812, 0.022552, " basic", false], [62680, 0.021761, " underlying", false]]], "model_b": [45184, 685, 9.380631672684103e-05, [[46642, 0.062022, " nature", false], [52127, 0.046621, " lessons", false], [51929, 0.045488, " history", false], [51832, 0.043688, " general", false], [21357, 0.040638, " big", false], [63591, 0.026475, " fundamental", false], [37812, 0.023251, " basic", false], [62680, 0.021589, " underlying", false], [46430, 0.017957, " lesson", false], [31894, 0.015559, " role", false]]]}, "raw_delta": -0.1517857142857142, "tuned_delta": -0.09893077038751437}, {"byte_start": 4992, "byte_end": 4995, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 857, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.93% 0.93% 0.93%", "model_b": "1.09% 1.09% 1.09%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8553966283798218]], "model_b": [[4706, " of", "normal", 0.8330783843994141]]}, "loss": {"model_a": 0.9275139016131844, "model_b": 1.0918834537977993}, "topk": {"model_a": [4706, 1, 0.8553966283798218, [[4706, 0.855397, " of", false], [4811, 0.052603, " to", false], [21265, 0.032766, " and", false], [32227, 0.014694, " that", false], [45, 0.014322, ",", false], [47, 0.005158, ".", false], [21700, 0.004663, " for", false], [5346, 0.003219, "---", false], [275, 0.001464, " (", false], [4715, 0.001392, " or", false]]], "model_b": [4706, 1, 0.8330783843994141, [[4706, 0.833078, " of", false], [21265, 0.070195, " and", false], [32227, 0.029912, " that", false], [4811, 0.017513, " to", false], [45, 0.010267, ",", false], [4858, 0.004138, " we", false], [275, 0.003149, " (", false], [21700, 0.002807, " for", false], [4601, 0.002431, " it", false], [4596, 0.002057, " in", false]]]}, "raw_delta": -0.009114583333333336, "tuned_delta": 0.043740360564866486}, {"byte_start": 4995, "byte_end": 5001, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 858, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "9.91% 9.91% 9.91% 9.91% 9.91% 9.91%", "model_b": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.03730778023600578]], "model_b": [[39936, " these", "normal", 0.06200062483549118]]}, "loss": {"model_a": 9.909135860272501, "model_b": 8.359365796817562}, "topk": {"model_a": [39936, 4, 0.03730778023600578, [[22590, 0.310407, " the", false], [38720, 0.228839, " human", false], [52224, 0.081649, " methods", false], [39936, 0.037308, " these", false], [47629, 0.015671, " trying", false], [22248, 0.014101, " our", false], [57103, 0.013565, " research", false], [332, 0.012564, " a", false], [61590, 0.010515, " approaches", false], [32234, 0.010258, " this", false]]], "model_b": [39936, 3, 0.06200062483549118, [[38720, 0.180967, " human", false], [22590, 0.179702, " the", false], [39936, 0.062001, " these", false], [51832, 0.04402, " general", false], [22248, 0.037848, " our", false], [52224, 0.023493, " methods", false], [332, 0.018763, " a", false], [32234, 0.016698, " this", false], [61590, 0.015134, " approaches", false], [47202, 0.012754, " search", false]]]}, "raw_delta": 0.08593749999999994, "tuned_delta": 0.13879244389819978}, {"byte_start": 5001, "byte_end": 5010, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 859, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"model_a": "12.77% 12.77% 12.77% 12.77% 12.77% 12.77% 12.77% 12.77% 12.77%", "model_b": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90%"}, "model_tokens": {"model_a": [[56652, " mistakes", "normal", 0.0017073815688490868]], "model_b": [[56652, " mistakes", "normal", 0.004365015774965286]]}, "loss": {"model_a": 12.77386234120436, "model_b": 10.89535317338019}, "topk": {"model_a": [56652, 44, 0.0017073815688490868, [[38720, 0.188876, " human", false], [39193, 0.103693, " other", false], [52224, 0.075963, " methods", false], [51551, 0.073696, " earlier", false], [22221, 0.067461, " old", false], [39174, 0.040157, " older", false], [63277, 0.037434, " alternative", false], [61590, 0.032868, " approaches", false], [22638, 0.024174, " two", false], [52964, 0.022903, " special", false]]], "model_b": [56652, 24, 0.004365015774965286, [[52224, 0.142379, " methods", false], [38720, 0.107792, " human", false], [61590, 0.1012, " approaches", false], [52964, 0.066832, " special", false], [51832, 0.058479, " general", false], [38841, 0.051975, " kinds", false], [22638, 0.026677, " two", false], [59513, 0.016836, " different", false], [62293, 0.014113, " particular", false], [56832, 0.014077, " patterns", false]]]}, "raw_delta": 0.10416666666666674, "tuned_delta": 0.15702161056486658}, {"byte_start": 5010, "byte_end": 5011, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "11.20%", "model_b": "16.06%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5372385382652283]], "model_b": [[47, ".", "normal", 0.4106141924858093]]}, "loss": {"model_a": 11.20061091315162, "model_b": 16.061253384896663}, "topk": {"model_a": [47, 1, 0.5372385382652283, [[47, 0.537239, ".", false], [45, 0.243176, ",", false], [21265, 0.121293, " and", false], [4811, 0.016634, " to", false], [4596, 0.015898, " in", false], [5346, 0.014652, "---", false], [59, 0.005927, ":", false], [4423, 0.005376, " as", false], [21700, 0.005123, " for", false], [275, 0.004102, " (", false]]], "model_b": [47, 1, 0.4106141924858093, [[47, 0.410614, ".", false], [45, 0.249173, ",", false], [21265, 0.186577, " and", false], [4811, 0.032177, " to", false], [4596, 0.026834, " in", false], [5346, 0.016433, "---", false], [59, 0.012205, ":", false], [4423, 0.008302, " as", false], [21700, 0.008262, " for", false], [275, 0.006206, " (", false]]]}, "raw_delta": -0.26953125, "tuned_delta": -0.21667630610180016}, {"byte_start": 5011, "byte_end": 5014, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 860, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"model_a": "17.85% 17.85% 17.85%", "model_b": "14.75% 14.75% 14.75%"}, "model_tokens": {"model_a": [[4331, " We", "normal", 0.05075846612453461]], "model_b": [[4331, " We", "normal", 0.08745554089546204]]}, "loss": {"model_a": 17.845837094329625, "model_b": 14.746296967419742}, "topk": {"model_a": [4331, 3, 0.05075846612453461, [[261, 0.362258, "\n\n", false], [20996, 0.098708, " The", false], [4331, 0.050758, " We", false], [29893, 0.030129, " They", false], [3913, 0.027799, " In", false], [37451, 0.027401, " There", false], [3918, 0.027116, " It", false], [20556, 0.02523, " One", false], [21152, 0.01897, " Why", false], [19417, 0.018232, " And", false]]], "model_b": [4331, 3, 0.08745554089546204, [[261, 0.149922, "\n\n", false], [20996, 0.095608, " The", false], [4331, 0.087456, " We", false], [29893, 0.051478, " They", false], [3918, 0.04088, " It", false], [3913, 0.03684, " In", false], [11, 0.030137, "\n", false], [19417, 0.026097, " And", false], [29894, 0.02532, " This", false], [4255, 0.023046, " To", false]]]}, "raw_delta": 0.171875, "tuned_delta": 0.22472994389819984}, {"byte_start": 5014, "byte_end": 5019, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 861, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "3.80% 3.80% 3.80% 3.80% 3.80%", "model_b": "4.40% 4.40% 4.40% 4.40% 4.40%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.3446548581123352]], "model_b": [[31059, " have", "normal", 0.29344964027404785]]}, "loss": {"model_a": 3.803981064843946, "model_b": 4.39571145270856}, "topk": {"model_a": [31059, 1, 0.3446548581123352, [[31059, 0.344655, " have", false], [31506, 0.100633, " need", false], [21413, 0.097477, " can", false], [32475, 0.057146, " will", false], [31475, 0.056031, " must", false], [21286, 0.044783, " are", false], [47266, 0.027422, " should", false], [30135, 0.01646, " also", false], [4491, 0.015651, " do", false], [31223, 0.012878, " know", false]]], "model_b": [31059, 1, 0.29344964027404785, [[31059, 0.29345, " have", false], [31506, 0.21561, " need", false], [31475, 0.131209, " must", false], [21413, 0.058895, " can", false], [47266, 0.042451, " should", false], [21286, 0.037785, " are", false], [32475, 0.030765, " will", false], [30135, 0.017338, " also", false], [4491, 0.013525, " do", false], [45409, 0.013315, " cannot", false]]]}, "raw_delta": -0.032812499999999994, "tuned_delta": 0.020042443898199827}, {"byte_start": 5019, "byte_end": 5022, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 862, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.93% 0.93% 0.93%", "model_b": "1.50% 1.50% 1.50%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8564462065696716]], "model_b": [[4811, " to", "normal", 0.7797873020172119]]}, "loss": {"model_a": 0.9333842427626349, "model_b": 1.5028073342593367}, "topk": {"model_a": [4811, 1, 0.8564462065696716, [[4811, 0.856446, " to", false], [332, 0.018809, " a", false], [31968, 0.011241, " seen", false], [50888, 0.009003, " already", false], [30259, 0.005421, " been", false], [22590, 0.005262, " the", false], [30135, 0.004905, " also", false], [22638, 0.004245, " two", false], [4419, 0.003432, " an", false], [21256, 0.003004, " all", false]]], "model_b": [4811, 1, 0.7797873020172119, [[4811, 0.779787, " to", false], [22187, 0.03495, " not", false], [332, 0.024667, " a", false], [30259, 0.014671, " been", false], [50888, 0.012498, " already", false], [31968, 0.012376, " seen", false], [52112, 0.010977, " learned", false], [4419, 0.006323, " an", false], [22590, 0.005337, " the", false], [30135, 0.004884, " also", false]]]}, "raw_delta": -0.03157552083333333, "tuned_delta": 0.021279423064866493}, {"byte_start": 5022, "byte_end": 5028, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 863, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"model_a": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%", "model_b": "9.96% 9.96% 9.96% 9.96% 9.96% 9.96%"}, "model_tokens": {"model_a": [[38877, " learn", "normal", 0.016794519498944283]], "model_b": [[38877, " learn", "normal", 0.03632981330156326]]}, "loss": {"model_a": 12.30423504924832, "model_b": 9.956098589468107}, "topk": {"model_a": [38877, 6, 0.016794519498944283, [[62683, 0.67829, " understand", false], [22449, 0.055469, " see", false], [4435, 0.018533, " be", false], [31223, 0.017751, " know", false], [21295, 0.016892, " ask", false], [38877, 0.016795, " learn", false], [60335, 0.016263, " recognize", false], [31324, 0.012621, " look", false], [52653, 0.009315, " realize", false], [61588, 0.00849, " appreciate", false]]], "model_b": [38877, 3, 0.03632981330156326, [[62683, 0.440481, " understand", false], [22449, 0.090168, " see", false], [38877, 0.03633, " learn", false], [4435, 0.0356, " be", false], [60335, 0.031771, " recognize", false], [31324, 0.025747, " look", false], [52653, 0.01924, " realize", false], [61588, 0.017052, " appreciate", false], [31223, 0.016822, " know", false], [21295, 0.014445, " ask", false]]]}, "raw_delta": 0.13020833333333326, "tuned_delta": 0.1830632772315331}, {"byte_start": 5028, "byte_end": 5032, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 864, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.21% 10.21% 10.21% 10.21%", "model_b": "10.28% 10.28% 10.28% 10.28%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.10271470993757248]], "model_b": [[22590, " the", "normal", 0.10198646038770676]]}, "loss": {"model_a": 10.214393600043929, "model_b": 10.284837693837336}, "topk": {"model_a": [22590, 3, 0.10271470993757248, [[4811, 0.259473, " to", false], [22763, 0.141509, " why", false], [22590, 0.102715, " the", false], [21835, 0.096533, " how", false], [32464, 0.078261, " what", false], [30917, 0.058117, " from", false], [32227, 0.049593, " that", false], [37598, 0.047045, " about", false], [22187, 0.017682, " not", false], [45, 0.015331, ",", false]]], "model_b": [22590, 4, 0.10198646038770676, [[32227, 0.248917, " that", false], [4811, 0.123651, " to", false], [30917, 0.116052, " from", false], [22590, 0.101986, " the", false], [21835, 0.091853, " how", false], [22763, 0.070308, " why", false], [32464, 0.039529, " what", false], [22187, 0.020869, " not", false], [37598, 0.019821, " about", false], [45, 0.014048, ",", false]]]}, "raw_delta": -0.00390625, "tuned_delta": 0.04894869389819982}, {"byte_start": 5032, "byte_end": 5039, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 865, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "5.39% 5.39% 5.39% 5.39% 5.39% 5.39% 5.39%", "model_b": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.12403124570846558]], "model_b": [[45315, " bitter", "normal", 0.005056930240243673]]}, "loss": {"model_a": 5.394004896180833, "model_b": 13.605773544097923}, "topk": {"model_a": [45315, 2, 0.12403124570846558, [[46430, 0.128609, " lesson", false], [45315, 0.124031, " bitter", false], [52127, 0.106013, " lessons", false], [52654, 0.045998, " reasons", false], [62418, 0.020434, " psychology", false], [51929, 0.018021, " history", false], [51832, 0.017524, " general", false], [47009, 0.015276, " reason", false], [64997, 0.013482, " psychological", false], [46642, 0.011549, " nature", false]]], "model_b": [45315, 24, 0.005056930240243673, [[52127, 0.277837, " lessons", false], [46430, 0.146436, " lesson", false], [40093, 0.028719, " value", false], [45184, 0.017779, " appeal", false], [61863, 0.013022, " difference", false], [21357, 0.012425, " big", false], [51929, 0.011917, " history", false], [40029, 0.010525, " truth", false], [52427, 0.008351, " pattern", false], [52654, 0.008336, " reasons", false]]]}, "raw_delta": -0.45535714285714285, "tuned_delta": -0.402502198958943}, {"byte_start": 5039, "byte_end": 5046, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 866, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21%", "model_b": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.6264867782592773]], "model_b": [[46430, " lesson", "normal", 0.8061118125915527]]}, "loss": {"model_a": 1.2126447574436392, "model_b": 0.5560051688693864}, "topk": {"model_a": [46430, 1, 0.6264867782592773, [[46430, 0.626487, " lesson", false], [52127, 0.307981, " lessons", false], [45, 0.013322, ",", false], [7513, 0.008584, "est", false], [40029, 0.007881, " truth", false], [21265, 0.004332, " and", false], [39899, 0.002758, " taste", false], [61979, 0.001223, " experience", false], [39831, 0.001204, " story", false], [51929, 0.001177, " history", false]]], "model_b": [46430, 1, 0.8061118125915527, [[46430, 0.806112, " lesson", false], [52127, 0.119506, " lessons", false], [39899, 0.011993, " taste", false], [46, 0.007919, "-", false], [40029, 0.005562, " truth", false], [7513, 0.004391, "est", false], [45, 0.004267, ",", false], [31683, 0.00214, " pill", false], [21265, 0.001453, " and", false], [61979, 0.001439, " experience", false]]]}, "raw_delta": 0.036411830357142856, "tuned_delta": 0.08926677425534268}, {"byte_start": 5046, "byte_end": 5051, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 867, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "7.89% 7.89% 7.89% 7.89% 7.89%", "model_b": "4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.11291148513555527]], "model_b": [[32227, " that", "normal", 0.2505127191543579]]}, "loss": {"model_a": 7.889738504861517, "model_b": 4.959264203055811}, "topk": {"model_a": [32227, 4, 0.11291148513555527, [[47, 0.286718, ".", false], [4706, 0.179901, " of", false], [45, 0.113558, ",", false], [32227, 0.112911, " that", false], [21265, 0.068962, " and", false], [59, 0.035873, ":", false], [37598, 0.023158, " about", false], [30917, 0.017132, " from", false], [5346, 0.016787, "---", false], [4596, 0.014065, " in", false]]], "model_b": [32227, 1, 0.2505127191543579, [[32227, 0.250513, " that", false], [47, 0.18129, ".", false], [4706, 0.14123, " of", false], [45, 0.134943, ",", false], [21265, 0.059613, " and", false], [4450, 0.036807, " by", false], [4596, 0.018782, " in", false], [37598, 0.018312, " about", false], [30917, 0.011599, " from", false], [4788, 0.010439, " so", false]]]}, "raw_delta": 0.16249999999999998, "tuned_delta": 0.2153549438981998}, {"byte_start": 5051, "byte_end": 5060, "display": {"text": " building", "kind": "normal"}, "is_word": true, "word_id": 868, "word_key": " building", "bytes_hex": "20 62 75 69 6c 64 69 6e 67", "compression": {"model_a": "19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54%", "model_b": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%"}, "model_tokens": {"model_a": [[55666, " building", "normal", 5.916264854022302e-05]], "model_b": [[55666, " building", "normal", 0.001178168342448771]]}, "loss": {"model_a": 19.536495345371375, "model_b": 13.52526600833403}, "topk": {"model_a": [55666, 591, 5.916264854022302e-05, [[22590, 0.10253, " the", false], [4858, 0.086312, " we", false], [51832, 0.064781, " general", false], [63370, 0.061776, " computation", false], [52195, 0.058306, " massive", false], [47202, 0.044315, " search", false], [45, 0.040041, ",", false], [37045, 0.039804, " Moore", false], [4601, 0.030606, " it", false], [39936, 0.018842, " these", false]]], "model_b": [55666, 96, 0.001178168342448771, [[22590, 0.110835, " the", false], [52195, 0.061399, " massive", false], [39936, 0.043393, " these", false], [51832, 0.038756, " general", false], [45, 0.035468, ",", false], [4858, 0.03341, " we", false], [39934, 0.028027, " there", false], [32465, 0.024091, " when", false], [32232, 0.018795, " they", false], [4600, 0.018325, " is", false]]]}, "raw_delta": 0.33333333333333326, "tuned_delta": 0.3861882772315331}, {"byte_start": 5060, "byte_end": 5063, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 869, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "28.74% 28.74% 28.74%", "model_b": "35.32% 35.32% 35.32%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.008519421331584454]], "model_b": [[4596, " in", "normal", 0.0028462193440645933]]}, "loss": {"model_a": 28.741190267709815, "model_b": 35.31597235509441}, "topk": {"model_a": [4596, 16, 0.008519421331584454, [[52224, 0.183673, " methods", false], [53087, 0.128683, " systems", false], [332, 0.109494, " a", false], [51832, 0.04904, " general", false], [4712, 0.046849, " on", false], [38720, 0.04122, " human", false], [22248, 0.040754, " our", false], [3609, 0.033288, " AI", false], [22590, 0.022746, " the", false], [4419, 0.015574, " an", false]]], "model_b": [4596, 52, 0.0028462193440645933, [[332, 0.132513, " a", false], [51832, 0.063713, " general", false], [53087, 0.059398, " systems", false], [3609, 0.043854, " AI", false], [52224, 0.042292, " methods", false], [52195, 0.035333, " massive", false], [4712, 0.033505, " on", false], [38864, 0.03234, " large", false], [4419, 0.031237, " an", false], [45301, 0.023538, " better", false]]]}, "raw_delta": -0.36458333333333326, "tuned_delta": -0.3117283894351334}, {"byte_start": 5063, "byte_end": 5067, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 870, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"model_a": "43.39% 43.39% 43.39% 43.39%", "model_b": "42.83% 42.83% 42.83% 42.83%"}, "model_tokens": {"model_a": [[21835, " how", "normal", 6.638034392381087e-05]], "model_b": [[21835, " how", "normal", 7.234295480884612e-05]]}, "loss": {"model_a": 43.393561776738345, "model_b": 42.830009026391096}, "topk": {"model_a": [21835, 346, 6.638034392381087e-05, [[38720, 0.419402, " human", false], [52195, 0.067899, " massive", false], [51832, 0.058733, " general", false], [22590, 0.044872, " the", false], [22248, 0.041722, " our", false], [332, 0.031358, " a", false], [59943, 0.027854, " knowledge", false], [31458, 0.020615, " more", false], [47202, 0.017742, " search", false], [63370, 0.012766, " computation", false]]], "model_b": [21835, 513, 7.234295480884612e-05, [[38720, 0.240491, " human", false], [51832, 0.098882, " general", false], [31458, 0.059464, " more", false], [52195, 0.047187, " massive", false], [22590, 0.036613, " the", false], [332, 0.03222, " a", false], [63370, 0.029948, " computation", false], [59943, 0.029572, " knowledge", false], [38864, 0.018932, " large", false], [64862, 0.013895, " computational", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 5067, "byte_end": 5070, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 871, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "7.23% 7.23% 7.23%", "model_b": "11.74% 11.74% 11.74%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.3014606833457947]], "model_b": [[4858, " we", "normal", 0.1433609127998352]]}, "loss": {"model_a": 7.232260296123059, "model_b": 11.740682298901067}, "topk": {"model_a": [4858, 1, 0.3014606833457947, [[4858, 0.301461, " we", false], [46227, 0.175537, " humans", false], [46787, 0.109064, " people", false], [22248, 0.061251, " our", false], [38720, 0.060643, " human", false], [22590, 0.05762, " the", false], [4811, 0.047691, " to", false], [332, 0.034245, " a", false], [22226, 0.02992, " one", false], [22799, 0.018622, " you", false]]], "model_b": [4858, 1, 0.1433609127998352, [[4858, 0.143361, " we", false], [4811, 0.129897, " to", false], [31466, 0.092133, " much", false], [22590, 0.084648, " the", false], [47539, 0.063606, " things", false], [46227, 0.040393, " humans", false], [332, 0.03939, " a", false], [22799, 0.031403, " you", false], [63370, 0.0296, " computation", false], [38720, 0.028084, " human", false]]]}, "raw_delta": -0.24999999999999992, "tuned_delta": -0.1971450561018001}, {"byte_start": 5070, "byte_end": 5076, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 872, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "2.18% 2.18% 2.18% 2.18% 2.18% 2.18%", "model_b": "5.12% 5.12% 5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.47932887077331543]], "model_b": [[39942, " think", "normal", 0.1816624402999878]]}, "loss": {"model_a": 2.1837669075955985, "model_b": 5.118937482320866}, "topk": {"model_a": [39942, 1, 0.47932887077331543, [[39942, 0.479329, " think", false], [62683, 0.1095, " understand", false], [31223, 0.074185, " know", false], [32435, 0.035106, " want", false], [45, 0.024176, ",", false], [60112, 0.023504, " ourselves", false], [22449, 0.018546, " see", false], [46227, 0.015112, " humans", false], [22681, 0.012186, " use", false], [51968, 0.011565, " imagine", false]]], "model_b": [39942, 2, 0.1816624402999878, [[22681, 0.182723, " use", false], [39942, 0.181662, " think", false], [4491, 0.110555, " do", false], [31358, 0.02823, " make", false], [32435, 0.026335, " want", false], [62683, 0.026043, " understand", false], [55532, 0.022498, " approach", false], [21286, 0.019917, " are", false], [21413, 0.018506, " can", false], [37923, 0.017136, " build", false]]]}, "raw_delta": -0.1627604166666667, "tuned_delta": -0.10990547276846689}, {"byte_start": 5076, "byte_end": 5079, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 873, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "10.28% 10.28% 10.28%", "model_b": "19.16% 19.16% 19.16%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.17868481576442719]], "model_b": [[4858, " we", "normal", 0.04153769090771675]]}, "loss": {"model_a": 10.284837693837336, "model_b": 19.160793511806542}, "topk": {"model_a": [4858, 2, 0.17868481576442719, [[37598, 0.188417, " about", false], [4858, 0.178685, " we", false], [4600, 0.171299, " is", false], [22248, 0.10836, " our", false], [45, 0.070836, ",", false], [21265, 0.028537, " and", false], [22590, 0.027367, " the", false], [5346, 0.021703, "---", false], [4706, 0.015264, " of", false], [47001, 0.011805, " rather", false]]], "model_b": [4858, 6, 0.04153769090771675, [[37598, 0.160517, " about", false], [4600, 0.157399, " is", false], [21265, 0.071787, " and", false], [45, 0.067255, ",", false], [4706, 0.061989, " of", false], [4858, 0.041538, " we", false], [21413, 0.030317, " can", false], [32475, 0.025004, " will", false], [38964, 0.017931, " makes", false], [22590, 0.017421, " the", false]]]}, "raw_delta": -0.4921875, "tuned_delta": -0.43933255610180016}, {"byte_start": 5079, "byte_end": 5085, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 874, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "2.29% 2.29% 2.29% 2.29% 2.29% 2.29%", "model_b": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.46850523352622986]], "model_b": [[39942, " think", "normal", 0.0945916548371315]]}, "loss": {"model_a": 2.289433048285708, "model_b": 7.044409379340641}, "topk": {"model_a": [39942, 1, 0.46850523352622986, [[39942, 0.468505, " think", false], [21286, 0.140268, " are", false], [47266, 0.062504, " should", false], [32475, 0.046204, " will", false], [31223, 0.032944, " know", false], [21413, 0.027356, " can", false], [62683, 0.026002, " understand", false], [4491, 0.017026, " do", false], [5230, 0.016507, "'re", false], [22449, 0.014994, " see", false]]], "model_b": [39942, 4, 0.0945916548371315, [[47266, 0.18119, " should", false], [21286, 0.174446, " are", false], [21413, 0.106328, " can", false], [39942, 0.094592, " think", false], [37923, 0.084667, " build", false], [32475, 0.057176, " will", false], [4491, 0.057069, " do", false], [32435, 0.027892, " want", false], [39196, 0.017717, " ought", false], [31223, 0.017321, " know", false]]]}, "raw_delta": -0.263671875, "tuned_delta": -0.21081693110180016}, {"byte_start": 5085, "byte_end": 5090, "display": {"text": " does", "kind": "normal"}, "is_word": true, "word_id": 875, "word_key": " does", "bytes_hex": "20 64 6f 65 73", "compression": {"model_a": "17.36% 17.36% 17.36% 17.36% 17.36%", "model_b": "20.74% 20.74% 20.74% 20.74% 20.74%"}, "model_tokens": {"model_a": [[30659, " does", "normal", 0.008288503624498844]], "model_b": [[30659, " does", "normal", 0.0032249775249511003]]}, "loss": {"model_a": 17.35742471069534, "model_b": 20.738741212778844}, "topk": {"model_a": [30659, 14, 0.008288503624498844, [[4600, 0.387533, " is", false], [45, 0.156047, ",", false], [5346, 0.045216, "---", false], [38964, 0.032437, " makes", false], [32475, 0.030613, " will", false], [38686, 0.029348, " helps", false], [37598, 0.024242, " about", false], [21265, 0.022825, " and", false], [275, 0.015988, " (", false], [4811, 0.015685, " to", false]]], "model_b": [30659, 32, 0.0032249775249511003, [[4600, 0.235916, " is", false], [45, 0.131282, ",", false], [4858, 0.056899, " we", false], [37598, 0.054531, " about", false], [32475, 0.052972, " will", false], [21265, 0.040283, " and", false], [21413, 0.03487, " can", false], [47, 0.026694, ".", false], [275, 0.02604, " (", false], [5346, 0.024952, "---", false]]]}, "raw_delta": -0.1874999999999999, "tuned_delta": -0.13464505610180005}, {"byte_start": 5090, "byte_end": 5094, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 876, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "0.25% 0.25% 0.25% 0.25%", "model_b": "0.55% 0.55% 0.55% 0.55%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.9461037516593933]], "model_b": [[22187, " not", "normal", 0.8862698674201965]]}, "loss": {"model_a": 0.24985639517348837, "model_b": 0.5459417268988996}, "topk": {"model_a": [22187, 1, 0.9461037516593933, [[22187, 0.946104, " not", false], [4835, 0.011891, " us", false], [31458, 0.007093, " more", false], [31466, 0.002963, " much", false], [4692, 0.002855, " no", false], [332, 0.001869, " a", false], [45, 0.00176, ",", false], [21660, 0.001728, " far", false], [4788, 0.001447, " so", false], [31277, 0.001225, " less", false]]], "model_b": [22187, 1, 0.8862698674201965, [[22187, 0.88627, " not", false], [46454, 0.016941, " little", false], [31458, 0.01043, " more", false], [52323, 0.009835, " nothing", false], [4692, 0.009091, " no", false], [31466, 0.003725, " much", false], [32386, 0.003556, " very", false], [45, 0.003174, ",", false], [55448, 0.002908, " actually", false], [31262, 0.002875, " lead", false]]]}, "raw_delta": -0.01641845703125, "tuned_delta": 0.03643648686694982}, {"byte_start": 5094, "byte_end": 5099, "display": {"text": " work", "kind": "normal"}, "is_word": true, "word_id": 877, "word_key": " work", "bytes_hex": "20 77 6f 72 6b", "compression": {"model_a": "4.28% 4.28% 4.28% 4.28% 4.28%", "model_b": "10.59% 10.59% 10.59% 10.59% 10.59%"}, "model_tokens": {"model_a": [[32499, " work", "normal", 0.30783069133758545]], "model_b": [[32499, " work", "normal", 0.05347270891070366]]}, "loss": {"model_a": 4.28300090263911, "model_b": 10.594791706528325}, "topk": {"model_a": [32499, 1, 0.30783069133758545, [[32499, 0.307831, " work", false], [31073, 0.14276, " help", false], [31358, 0.105909, " make", false], [31262, 0.054585, " lead", false], [22269, 0.045895, " pay", false], [51982, 0.020489, " improve", false], [40239, 0.017633, " yield", false], [63717, 0.01687, " necessarily", false], [45150, 0.015902, " always", false], [45851, 0.013907, " enable", false]]], "model_b": [32499, 6, 0.05347270891070366, [[31358, 0.130771, " make", false], [63717, 0.121208, " necessarily", false], [46530, 0.072827, " matter", false], [31073, 0.062868, " help", false], [45150, 0.056096, " always", false], [32499, 0.053473, " work", false], [31262, 0.052641, " lead", false], [4596, 0.026197, " in", false], [31391, 0.022333, " mean", false], [51982, 0.022149, " improve", false]]]}, "raw_delta": -0.35000000000000003, "tuned_delta": -0.2971450561018002}, {"byte_start": 5099, "byte_end": 5102, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 878, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "23.29% 23.29% 23.29%", "model_b": "14.56% 14.56% 14.56%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.021186070516705513]], "model_b": [[4596, " in", "normal", 0.08847399801015854]]}, "loss": {"model_a": 23.29351368101972, "model_b": 14.558446050637324}, "topk": {"model_a": [4596, 6, 0.021186070516705513, [[47, 0.567902, ".", false], [45, 0.174106, ",", false], [4423, 0.044469, " as", false], [21265, 0.03729, " and", false], [32458, 0.029235, " well", false], [4596, 0.021186, " in", false], [32386, 0.015328, " very", false], [21700, 0.01503, " for", false], [5346, 0.014628, "---", false], [60, 0.009324, ";", false]]], "model_b": [4596, 3, 0.08847399801015854, [[47, 0.337844, ".", false], [45, 0.220601, ",", false], [4596, 0.088474, " in", false], [32458, 0.059706, " well", false], [21700, 0.036834, " for", false], [21265, 0.033026, " and", false], [4423, 0.02704, " as", false], [32386, 0.025285, " very", false], [60, 0.018135, ";", false], [32465, 0.018064, " when", false]]]}, "raw_delta": 0.48437500000000017, "tuned_delta": 0.5372299438982}, {"byte_start": 5102, "byte_end": 5106, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 879, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.26% 7.26% 7.26% 7.26%", "model_b": "8.07% 8.07% 8.07% 8.07%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.19965291023254395]], "model_b": [[22590, " the", "normal", 0.16911444067955017]]}, "loss": {"model_a": 7.25574166072086, "model_b": 8.065848739345034}, "topk": {"model_a": [22590, 3, 0.19965291023254395, [[51832, 0.28306, " general", false], [3609, 0.205247, " AI", false], [22590, 0.199653, " the", false], [56901, 0.051394, " practice", false], [332, 0.042558, " a", false], [32234, 0.029728, " this", false], [31461, 0.020025, " most", false], [55809, 0.013791, " computer", false], [52167, 0.010014, " machine", false], [4419, 0.007569, " an", false]]], "model_b": [22590, 2, 0.16911444067955017, [[56901, 0.440426, " practice", false], [22590, 0.169114, " the", false], [3609, 0.052609, " AI", false], [51832, 0.04753, " general", false], [55809, 0.028794, " computer", false], [21273, 0.023927, " any", false], [31835, 0.017474, " real", false], [31461, 0.016446, " most", false], [332, 0.014336, " a", false], [31370, 0.014277, " many", false]]]}, "raw_delta": -0.044921875, "tuned_delta": 0.007933068898199822}, {"byte_start": 5106, "byte_end": 5111, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 880, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"model_a": "1.51% 1.51% 1.51% 1.51% 1.51%", "model_b": "2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"model_a": [[31323, " long", "normal", 0.6603017449378967]], "model_b": [[31323, " long", "normal", 0.4621831178665161]]}, "loss": {"model_a": 1.514548016558238, "model_b": 2.8036749329775748}, "topk": {"model_a": [31323, 1, 0.6603017449378967, [[31323, 0.660302, " long", false], [51832, 0.045995, " general", false], [21616, 0.03908, " end", false], [30807, 0.02882, " face", false], [31835, 0.027348, " real", false], [46470, 0.021761, " longer", false], [31937, 0.012985, " same", false], [22752, 0.010201, " way", false], [51310, 0.009492, " context", false], [56916, 0.008975, " presence", false]]], "model_b": [31323, 1, 0.4621831178665161, [[31323, 0.462183, " long", false], [31835, 0.184873, " real", false], [40213, 0.03709, " world", false], [22752, 0.035727, " way", false], [21616, 0.027734, " end", false], [30807, 0.022962, " face", false], [38478, 0.01598, " field", false], [55809, 0.015599, " computer", false], [51832, 0.012982, " general", false], [21357, 0.008937, " big", false]]]}, "raw_delta": -0.07148437499999999, "tuned_delta": -0.018629431101800167}, {"byte_start": 5111, "byte_end": 5115, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 881, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "0.56% 0.56% 0.56% 0.56%", "model_b": "0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.8830591440200806]], "model_b": [[22418, " run", "normal", 0.8901070356369019]]}, "loss": {"model_a": 0.5591499944851633, "model_b": 0.5239279475884602}, "topk": {"model_a": [22418, 1, 0.8830591440200806, [[22418, 0.883059, " run", false], [32219, 0.104951, " term", false], [46, 0.006562, "-", false], [31057, 0.002566, " haul", false], [45, 0.000418, ",", false], [21265, 0.000291, " and", false], [4715, 0.000291, " or", false], [39438, 0.00022, " range", false], [8661, 0.000135, "run", false], [27132, 8.5e-05, "term", false]]], "model_b": [22418, 1, 0.8901070356369019, [[22418, 0.890107, " run", false], [32219, 0.09376, " term", false], [46, 0.01041, "-", false], [31057, 0.00097, " haul", false], [39438, 0.000647, " range", false], [8661, 0.000495, "run", false], [31908, 0.000456, " runs", false], [39920, 0.000439, " terms", false], [30941, 0.000439, " game", false], [45, 0.000352, ",", false]]]}, "raw_delta": 0.001953125, "tuned_delta": 0.05480806889819982}, {"byte_start": 5115, "byte_end": 5116, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "6.13%", "model_b": "9.09%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7120217084884644]], "model_b": [[47, ".", "normal", 0.6046167016029358]]}, "loss": {"model_a": 6.128636160026358, "model_b": 9.087288099349427}, "topk": {"model_a": [47, 1, 0.7120217084884644, [[47, 0.712022, ".", false], [45, 0.181633, ",", false], [21265, 0.044661, " and", false], [5346, 0.01102, "---", false], [60, 0.009917, ";", false], [4423, 0.004019, " as", false], [275, 0.003542, " (", false], [4588, 0.003463, " if", false], [51018, 0.003014, " because", false], [4596, 0.002918, " in", false]]], "model_b": [47, 1, 0.6046167016029358, [[47, 0.604617, ".", false], [45, 0.266359, ",", false], [21265, 0.02605, " and", false], [5346, 0.022796, "---", false], [60, 0.01746, ";", false], [51018, 0.006953, " because", false], [4596, 0.006807, " in", false], [275, 0.006146, " (", false], [21700, 0.005893, " for", false], [32465, 0.005156, " when", false]]]}, "raw_delta": -0.1640625, "tuned_delta": -0.11120755610180018}, {"byte_start": 5116, "byte_end": 5120, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 882, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83%", "model_b": "12.89% 12.89% 12.89% 12.89%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.07224582135677338]], "model_b": [[20996, " The", "normal", 0.058125950396060944]]}, "loss": {"model_a": 11.834607757292277, "model_b": 12.891269164193373}, "topk": {"model_a": [20996, 3, 0.07224582135677338, [[261, 0.327795, "\n\n", false], [4331, 0.112431, " We", false], [20996, 0.072246, " The", false], [3918, 0.048057, " It", false], [29894, 0.031316, " This", false], [19417, 0.028893, " And", false], [3913, 0.021697, " In", false], [0, 0.021505, "[0]", false], [267, 0.019773, "  ", false], [19555, 0.017811, " But", false]]], "model_b": [20996, 3, 0.058125950396060944, [[4331, 0.24612, " We", false], [261, 0.120132, "\n\n", false], [20996, 0.058126, " The", false], [19417, 0.058107, " And", false], [29894, 0.038731, " This", false], [3918, 0.034043, " It", false], [11, 0.028809, "\n", false], [0, 0.022946, "[0]", false], [267, 0.021781, "  ", false], [3913, 0.021644, " In", false]]]}, "raw_delta": -0.05859375, "tuned_delta": -0.0057388061018001785}, {"byte_start": 5120, "byte_end": 5127, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 883, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "8.05% 8.05% 8.05% 8.05% 8.05% 8.05% 8.05%", "model_b": "6.92% 6.92% 6.92% 6.92% 6.92% 6.92% 6.92%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.04410020262002945]], "model_b": [[45315, " bitter", "normal", 0.06761566549539566]]}, "loss": {"model_a": 8.050753576389305, "model_b": 6.9236480756948025}, "topk": {"model_a": [45315, 3, 0.04410020262002945, [[46430, 0.073397, " lesson", false], [45184, 0.056872, " appeal", false], [45315, 0.0441, " bitter", false], [31461, 0.028038, " most", false], [47009, 0.025697, " reason", false], [31581, 0.025483, " only", false], [38720, 0.022675, " human", false], [21357, 0.017279, " big", false], [30273, 0.015737, " best", false], [52127, 0.014465, " lessons", false]]], "model_b": [45315, 1, 0.06761566549539566, [[45315, 0.067616, " bitter", false], [46430, 0.052968, " lesson", false], [31581, 0.044809, " only", false], [30273, 0.04376, " best", false], [31461, 0.037081, " most", false], [52127, 0.032481, " lessons", false], [21357, 0.021928, " big", false], [21952, 0.017595, " key", false], [38720, 0.014693, " human", false], [51039, 0.01281, " biggest", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 5127, "byte_end": 5134, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 884, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%", "model_b": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.8506177663803101]], "model_b": [[46430, " lesson", "normal", 0.9035728573799133]]}, "loss": {"model_a": 0.41511698128257357, "model_b": 0.25913363074003065}, "topk": {"model_a": [46430, 1, 0.8506177663803101, [[46430, 0.850618, " lesson", false], [52127, 0.046337, " lessons", false], [7513, 0.037166, "est", false], [31633, 0.009384, " part", false], [39899, 0.005847, " taste", false], [40029, 0.005836, " truth", false], [46, 0.002441, "-", false], [45, 0.002172, ",", false], [47009, 0.001968, " reason", false], [39941, 0.001618, " thing", false]]], "model_b": [46430, 1, 0.9035728573799133, [[46430, 0.903573, " lesson", false], [52127, 0.033317, " lessons", false], [7513, 0.02089, "est", false], [46, 0.00777, "-", false], [39899, 0.002451, " taste", false], [45, 0.001715, ",", false], [31333, 0.001368, " loss", false], [61979, 0.000979, " experience", false], [52221, 0.000948, " message", false], [65126, 0.000875, " disappointment", false]]]}, "raw_delta": 0.008649553571428574, "tuned_delta": 0.0615044974696284}, {"byte_start": 5134, "byte_end": 5137, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 885, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "2.85% 2.85% 2.85%", "model_b": "4.81% 4.81% 4.81%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.6231439709663391]], "model_b": [[4600, " is", "normal", 0.4486593008041382]]}, "loss": {"model_a": 2.8529857986329596, "model_b": 4.8136797425494375}, "topk": {"model_a": [4600, 1, 0.6231439709663391, [[4600, 0.623144, " is", false], [4706, 0.048335, " of", false], [32227, 0.039654, " that", false], [45, 0.033217, ",", false], [21800, 0.026234, " has", false], [30135, 0.019497, " also", false], [21413, 0.016248, " can", false], [4596, 0.009189, " in", false], [22748, 0.008408, " was", false], [50938, 0.007678, " applies", false]]], "model_b": [4600, 1, 0.4486593008041382, [[4600, 0.448659, " is", false], [32227, 0.083596, " that", false], [21800, 0.053711, " has", false], [4706, 0.037408, " of", false], [21413, 0.030209, " can", false], [30135, 0.026424, " also", false], [45, 0.023434, ",", false], [22748, 0.018499, " was", false], [38087, 0.016896, " comes", false], [4596, 0.016731, " in", false]]]}, "raw_delta": -0.10872395833333331, "tuned_delta": -0.05586901443513349}, {"byte_start": 5137, "byte_end": 5143, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 886, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "19.07% 19.07% 19.07% 19.07% 19.07% 19.07%", "model_b": "20.66% 20.66% 20.66% 20.66% 20.66% 20.66%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.0017648711800575256]], "model_b": [[37810, " based", "normal", 0.001031332416459918]]}, "loss": {"model_a": 19.066868053415337, "model_b": 20.66360084606588}, "topk": {"model_a": [37810, 40, 0.0017648711800575256, [[32227, 0.495382, " that", false], [22590, 0.055937, " the", false], [22187, 0.053349, " not", false], [30135, 0.034935, " also", false], [32234, 0.030311, " this", false], [332, 0.025008, " a", false], [4811, 0.019687, " to", false], [59, 0.017647, ":", false], [37598, 0.015264, " about", false], [45, 0.01513, ",", false]]], "model_b": [37810, 61, 0.001031332416459918, [[32227, 0.584053, " that", false], [22187, 0.054618, " not", false], [22590, 0.046165, " the", false], [30135, 0.024394, " also", false], [332, 0.017413, " a", false], [32234, 0.014775, " this", false], [4811, 0.014462, " to", false], [22226, 0.010413, " one", false], [45, 0.008403, ",", false], [4596, 0.007357, " in", false]]]}, "raw_delta": -0.08854166666666652, "tuned_delta": -0.0356867227684667}, {"byte_start": 5143, "byte_end": 5146, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 887, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.58% 0.58% 0.58%", "model_b": "1.07% 1.07% 1.07%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9087560176849365]], "model_b": [[4712, " on", "normal", 0.8363717794418335]]}, "loss": {"model_a": 0.5752934326461523, "model_b": 1.0742724303494477}, "topk": {"model_a": [4712, 1, 0.9087560176849365, [[4712, 0.908756, " on", false], [4596, 0.038599, " in", false], [22187, 0.013849, " not", false], [32350, 0.008711, " upon", false], [45, 0.007148, ",", false], [46768, 0.001741, " partly", false], [45202, 0.00167, " around", false], [30322, 0.001248, " both", false], [31458, 0.001054, " more", false], [52094, 0.000948, " largely", false]]], "model_b": [4712, 1, 0.8363717794418335, [[4712, 0.836372, " on", false], [4596, 0.07748, " in", false], [22187, 0.022995, " not", false], [32350, 0.022786, " upon", false], [45, 0.005899, ",", false], [52094, 0.003098, " largely", false], [46768, 0.001792, " partly", false], [31458, 0.001641, " more", false], [56131, 0.001633, " entirely", false], [60247, 0.001495, " primarily", false]]]}, "raw_delta": -0.027669270833333332, "tuned_delta": 0.02518567306486649}, {"byte_start": 5146, "byte_end": 5150, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 888, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "4.31% 4.31% 4.31% 4.31%", "model_b": "4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.38150322437286377]], "model_b": [[22590, " the", "normal", 0.3693031668663025]]}, "loss": {"model_a": 4.314700744846142, "model_b": 4.490810979329659}, "topk": {"model_a": [22590, 1, 0.38150322437286377, [[22590, 0.381503, " the", false], [332, 0.142719, " a", false], [37045, 0.079788, " Moore", false], [22638, 0.04746, " two", false], [4419, 0.029692, " an", false], [32234, 0.017501, " this", false], [32464, 0.017017, " what", false], [39946, 0.012842, " three", false], [56537, 0.012076, " learning", false], [21835, 0.011674, " how", false]]], "model_b": [22590, 1, 0.3693031668663025, [[22590, 0.369303, " the", false], [332, 0.158001, " a", false], [22638, 0.058696, " two", false], [4419, 0.031316, " an", false], [22248, 0.018184, " our", false], [32234, 0.014934, " this", false], [37045, 0.013183, " Moore", false], [39946, 0.013075, " three", false], [32464, 0.011829, " what", false], [57103, 0.01064, " research", false]]]}, "raw_delta": -0.009765625, "tuned_delta": 0.04308931889819982}, {"byte_start": 5150, "byte_end": 5161, "display": {"text": " historical", "kind": "normal"}, "is_word": true, "word_id": 889, "word_key": " historical", "bytes_hex": "20 68 69 73 74 6f 72 69 63 61 6c", "compression": {"model_a": "11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01%", "model_b": "10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55%"}, "model_tokens": {"model_a": [[62061, " historical", "normal", 0.0011994049418717623]], "model_b": [[62061, " historical", "normal", 0.001612336840480566]]}, "loss": {"model_a": 11.014894665878096, "model_b": 10.553806051957613}, "topk": {"model_a": [62061, 120, 0.0011994049418717623, [[30808, 0.115395, " fact", false], [63729, 0.059906, " observation", false], [59725, 0.056062, " following", false], [51832, 0.029873, " general", false], [61979, 0.019888, " experience", false], [31135, 0.019271, " idea", false], [60250, 0.017974, " principle", false], [47284, 0.015415, " simple", false], [46681, 0.014006, " notion", false], [31461, 0.013368, " most", false]]], "model_b": [62061, 77, 0.001612336840480566, [[30808, 0.111415, " fact", false], [63729, 0.066346, " observation", false], [61606, 0.027877, " assumption", false], [63820, 0.026319, " realization", false], [31135, 0.024879, " idea", false], [45294, 0.023406, " belief", false], [60250, 0.02261, " principle", false], [65034, 0.014619, " understanding", false], [31937, 0.014438, " same", false], [46681, 0.013923, " notion", false]]]}, "raw_delta": 0.02556818181818188, "tuned_delta": 0.0784231257163817}, {"byte_start": 5161, "byte_end": 5174, "display": {"text": " observations", "kind": "normal"}, "is_word": true, "word_id": 890, "word_key": " observations", "bytes_hex": "20 6f 62 73 65 72 76 61 74 69 6f 6e 73", "compression": {"model_a": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "model_b": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58%"}, "model_tokens": {"model_a": [[64495, " observations", "normal", 0.008211234584450722]], "model_b": [[64495, " observations", "normal", 0.0020737757440656424]]}, "loss": {"model_a": 6.675932581036667, "model_b": 8.583341889904288}, "topk": {"model_a": [64495, 16, 0.008211234584450722, [[52427, 0.176921, " pattern", false], [47024, 0.105113, " record", false], [30808, 0.086222, " fact", false], [61979, 0.069026, " experience", false], [56157, 0.065697, " evidence", false], [56162, 0.061462, " examples", false], [51668, 0.032822, " example", false], [52127, 0.02079, " lessons", false], [38440, 0.02055, " facts", false], [46430, 0.018407, " lesson", false]]], "model_b": [64495, 52, 0.0020737757440656424, [[52427, 0.138763, " pattern", false], [47024, 0.113858, " record", false], [30808, 0.112859, " fact", false], [61979, 0.078223, " experience", false], [53052, 0.034837, " success", false], [51708, 0.021428, " failure", false], [56157, 0.021077, " evidence", false], [38440, 0.02006, " facts", false], [56832, 0.016586, " patterns", false], [52127, 0.016575, " lessons", false]]]}, "raw_delta": -0.10576923076923074, "tuned_delta": -0.05291428687103092}, {"byte_start": 5174, "byte_end": 5179, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 891, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.48% 3.48% 3.48% 3.48% 3.48%", "model_b": "1.31% 1.31% 1.31% 1.31% 1.31%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.3825936019420624]], "model_b": [[32227, " that", "normal", 0.6979579329490662]]}, "loss": {"model_a": 3.4799382333942765, "model_b": 1.3102601445573594}, "topk": {"model_a": [32227, 1, 0.3825936019420624, [[32227, 0.382594, " that", false], [4706, 0.156848, " of", false], [45, 0.047983, ",", false], [37599, 0.042741, " above", false], [47, 0.036173, ".", false], [59488, 0.032056, " described", false], [4596, 0.026299, " in", false], [21265, 0.025754, " and", false], [37598, 0.02535, " about", false], [31351, 0.01995, " made", false]]], "model_b": [32227, 1, 0.6979579329490662, [[32227, 0.697958, " that", false], [4706, 0.111832, " of", false], [45, 0.029659, ",", false], [37599, 0.021577, " above", false], [21265, 0.016705, " and", false], [37598, 0.015338, " about", false], [4596, 0.009509, " in", false], [59488, 0.00943, " described", false], [31351, 0.008861, " made", false], [59, 0.006609, ":", false]]]}, "raw_delta": 0.1203125, "tuned_delta": 0.17316744389819982}, {"byte_start": 5179, "byte_end": 5181, "display": {"text": " 1", "kind": "normal"}, "is_word": true, "word_id": 892, "word_key": " 1", "bytes_hex": "20 31", "compression": {"model_a": "44.52% 44.52%", "model_b": "67.34% 67.34%"}, "model_tokens": {"model_a": [[284, " 1", "normal", 0.007249108981341124]], "model_b": [[284, " 1", "normal", 0.0005747947143390775]]}, "loss": {"model_a": 44.52066727743285, "model_b": 67.34455366649652}, "topk": {"model_a": [284, 24, 0.007249108981341124, [[22590, 0.102599, " the", false], [4858, 0.067912, " we", false], [59, 0.063488, ":", false], [45, 0.056471, ",", false], [47202, 0.03507, " search", false], [63370, 0.027385, " computation", false], [38720, 0.024776, " human", false], [52195, 0.024278, " massive", false], [275, 0.02388, " (", false], [39934, 0.022923, " there", false]]], "model_b": [284, 155, 0.0005747947143390775, [[22590, 0.116387, " the", false], [38720, 0.05816, " human", false], [4858, 0.057076, " we", false], [45, 0.053819, ",", false], [52195, 0.037853, " massive", false], [32465, 0.02819, " when", false], [39934, 0.018457, " there", false], [46227, 0.017793, " humans", false], [39936, 0.01765, " these", false], [332, 0.016701, " a", false]]]}, "raw_delta": -1.265625, "tuned_delta": -1.2127700561018002}, {"byte_start": 5181, "byte_end": 5182, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "1.52%", "model_b": "0.88%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.9202452898025513]], "model_b": [[42, ")", "normal", 0.9522035121917725]]}, "loss": {"model_a": 1.5233535282824135, "model_b": 0.884953928279668}, "topk": {"model_a": [42, 1, 0.9202452898025513, [[42, 0.920245, ")", false], [47, 0.054865, ".", false], [580, 0.007832, ".)", false], [48, 0.004129, "/", false], [45, 0.004127, ",", false], [46, 0.001542, "-", false], [499, 0.001016, ").", false], [59, 0.000905, ":", false], [276, 0.000405, " )", false], [98, 0.000376, "a", false]]], "model_b": [42, 1, 0.9522035121917725, [[42, 0.952204, ")", false], [47, 0.030034, ".", false], [580, 0.007377, ".)", false], [45, 0.002746, ",", false], [59, 0.001583, ":", false], [46, 0.000818, "-", false], [48, 0.000793, "/", false], [499, 0.000482, ").", false], [2195, 0.000375, "st", false], [1668, 0.000246, "\\.", false]]]}, "raw_delta": 0.035400390625, "tuned_delta": 0.08825533452319982}, {"byte_start": 5182, "byte_end": 5185, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 893, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "29.68% 29.68% 29.68%", "model_b": "24.42% 24.42% 24.42%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.007122568320482969]], "model_b": [[3609, " AI", "normal", 0.017233099788427353]]}, "loss": {"model_a": 29.6804448516219, "model_b": 24.420619181714223}, "topk": {"model_a": [3609, 24, 0.007122568320482969, [[22590, 0.114343, " the", false], [52195, 0.11373, " massive", false], [47202, 0.065668, " search", false], [63370, 0.050382, " computation", false], [52224, 0.036514, " methods", false], [38720, 0.034624, " human", false], [51832, 0.024076, " general", false], [39934, 0.023342, " there", false], [37045, 0.021751, " Moore", false], [4596, 0.019502, " in", false]]], "model_b": [3609, 13, 0.017233099788427353, [[22590, 0.130621, " the", false], [38720, 0.077728, " human", false], [4858, 0.049762, " we", false], [39934, 0.044545, " there", false], [4601, 0.027845, " it", false], [46227, 0.027731, " humans", false], [52195, 0.027448, " massive", false], [32465, 0.02314, " when", false], [31461, 0.022613, " most", false], [51832, 0.019704, " general", false]]]}, "raw_delta": 0.2916666666666665, "tuned_delta": 0.34452161056486635}, {"byte_start": 5185, "byte_end": 5197, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 894, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68%", "model_b": "3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.16714787483215332]], "model_b": [[63843, " researchers", "normal", 0.1198546439409256]]}, "loss": {"model_a": 2.6768755641494435, "model_b": 3.1934655853010896}, "topk": {"model_a": [63843, 2, 0.16714787483215332, [[57103, 0.34561, " research", false], [63843, 0.167148, " researchers", false], [52224, 0.109417, " methods", false], [53087, 0.050079, " systems", false], [4600, 0.041654, " is", false], [21800, 0.023598, " has", false], [56950, 0.019934, " progress", false], [56949, 0.015875, " programs", false], [62633, 0.012455, " techniques", false], [22748, 0.008354, " was", false]]], "model_b": [63843, 2, 0.1198546439409256, [[57103, 0.394819, " research", false], [63843, 0.119855, " researchers", false], [4600, 0.075718, " is", false], [52224, 0.053141, " methods", false], [21800, 0.04689, " has", false], [53087, 0.021688, " systems", false], [61590, 0.010815, " approaches", false], [22748, 0.010323, " was", false], [59758, 0.008887, " generally", false], [39914, 0.008886, " tends", false]]]}, "raw_delta": -0.028645833333333353, "tuned_delta": 0.02420911056486647}, {"byte_start": 5197, "byte_end": 5202, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 895, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "6.40% 6.40% 6.40% 6.40% 6.40%", "model_b": "7.66% 7.66% 7.66% 7.66% 7.66%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.1673399657011032]], "model_b": [[31059, " have", "normal", 0.12053146213293076]]}, "loss": {"model_a": 6.396323716441302, "model_b": 7.664317404722617}, "topk": {"model_a": [31059, 1, 0.1673399657011032, [[31059, 0.16734, " have", false], [40, 0.148581, "'", false], [21286, 0.098521, " are", false], [32216, 0.049265, " tend", false], [45, 0.031928, ",", false], [22762, 0.026523, " who", false], [4491, 0.022749, " do", false], [39171, 0.018627, " often", false], [45150, 0.014321, " always", false], [4596, 0.013971, " in", false]]], "model_b": [31059, 1, 0.12053146213293076, [[31059, 0.120531, " have", false], [21286, 0.079481, " are", false], [32216, 0.061018, " tend", false], [40, 0.052517, "'", false], [32462, 0.049706, " were", false], [45, 0.032782, ",", false], [22762, 0.031552, " who", false], [39171, 0.030386, " often", false], [45150, 0.019568, " always", false], [4596, 0.019281, " in", false]]]}, "raw_delta": -0.0703125, "tuned_delta": -0.01745755610180018}, {"byte_start": 5202, "byte_end": 5208, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 896, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"model_a": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%", "model_b": "10.66% 10.66% 10.66% 10.66% 10.66% 10.66%"}, "model_tokens": {"model_a": [[39171, " often", "normal", 0.016883186995983124]], "model_b": [[39171, " often", "normal", 0.0289636068046093]]}, "loss": {"model_a": 12.30423504924832, "model_b": 10.66053952740217}, "topk": {"model_a": [39171, 9, 0.016883186995983124, [[30259, 0.156254, " been", false], [22187, 0.081422, " not", false], [332, 0.072726, " a", false], [45150, 0.064169, " always", false], [47518, 0.029517, " tended", false], [21795, 0.024821, " had", false], [56495, 0.018679, " invested", false], [31351, 0.017605, " made", false], [39171, 0.016883, " often", false], [39762, 0.016444, " spent", false]]], "model_b": [39171, 7, 0.0289636068046093, [[30259, 0.149343, " been", false], [45150, 0.114232, " always", false], [332, 0.058166, " a", false], [47518, 0.049271, " tended", false], [22187, 0.048999, " not", false], [31351, 0.039643, " made", false], [39171, 0.028964, " often", false], [59758, 0.016461, " generally", false], [39115, 0.015971, " never", false], [39762, 0.014802, " spent", false]]]}, "raw_delta": 0.09114583333333326, "tuned_delta": 0.1440007772315331}, {"byte_start": 5208, "byte_end": 5214, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 897, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"model_a": "8.69% 8.69% 8.69% 8.69% 8.69% 8.69%", "model_b": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%"}, "model_tokens": {"model_a": [[40013, " tried", "normal", 0.055753011256456375]], "model_b": [[40013, " tried", "normal", 0.029330095276236534]]}, "loss": {"model_a": 8.68810490118679, "model_b": 10.613576798206566}, "topk": {"model_a": [40013, 3, 0.055753011256456375, [[30259, 0.184421, " been", false], [31351, 0.055819, " made", false], [40013, 0.055753, " tried", false], [21795, 0.038271, " had", false], [22187, 0.034231, " not", false], [45953, 0.028199, " failed", false], [53137, 0.025431, " thought", false], [37924, 0.023763, " built", false], [56495, 0.023123, " invested", false], [47340, 0.021271, " sought", false]]], "model_b": [40013, 4, 0.029330095276236534, [[30259, 0.235617, " been", false], [31351, 0.094101, " made", false], [52611, 0.035785, " pursued", false], [40013, 0.02933, " tried", false], [31601, 0.023822, " over", false], [45953, 0.023721, " failed", false], [22187, 0.020789, " not", false], [30666, 0.01761, " done", false], [65176, 0.017441, " underestimated", false], [32354, 0.01675, " used", false]]]}, "raw_delta": -0.1067708333333333, "tuned_delta": -0.05391588943513348}, {"byte_start": 5214, "byte_end": 5217, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 898, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.58% 1.58% 1.58%", "model_b": "0.67% 0.67% 0.67%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7676928043365479]], "model_b": [[4811, " to", "normal", 0.8940441608428955]]}, "loss": {"model_a": 1.5849921103516442, "model_b": 0.6692188910373609}, "topk": {"model_a": [4811, 1, 0.7676928043365479, [[4811, 0.767693, " to", false], [52224, 0.081842, " methods", false], [39931, 0.014052, " their", false], [45, 0.010307, ",", false], [22590, 0.009398, " the", false], [61590, 0.006137, " approaches", false], [38720, 0.005013, " human", false], [32448, 0.004145, " ways", false], [21700, 0.003663, " for", false], [22249, 0.003621, " out", false]]], "model_b": [4811, 1, 0.8940441608428955, [[4811, 0.894044, " to", false], [52224, 0.010511, " methods", false], [39931, 0.005805, " their", false], [31048, 0.005665, " hard", false], [61590, 0.005121, " approaches", false], [45, 0.004494, ",", false], [22614, 0.004352, " too", false], [22590, 0.003436, " the", false], [47539, 0.002477, " things", false], [21265, 0.002103, " and", false]]]}, "raw_delta": 0.05078125, "tuned_delta": 0.10363619389819982}, {"byte_start": 5217, "byte_end": 5223, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 899, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"model_a": "5.96% 5.96% 5.96% 5.96% 5.96% 5.96%", "model_b": "10.05% 10.05% 10.05% 10.05% 10.05% 10.05%"}, "model_tokens": {"model_a": [[37923, " build", "normal", 0.1381034106016159]], "model_b": [[37923, " build", "normal", 0.0352366603910923]]}, "loss": {"model_a": 5.964266607841743, "model_b": 10.050024047859313}, "topk": {"model_a": [37923, 1, 0.1381034106016159, [[37923, 0.138103, " build", false], [31358, 0.070516, " make", false], [22339, 0.067137, " put", false], [32187, 0.048363, " take", false], [22681, 0.048263, " use", false], [56540, 0.047405, " leverage", false], [51982, 0.028113, " improve", false], [4491, 0.0262, " do", false], [37730, 0.026041, " apply", false], [39740, 0.02448, " solve", false]]], "model_b": [37923, 7, 0.0352366603910923, [[22681, 0.103473, " use", false], [31358, 0.096861, " make", false], [39740, 0.056077, " solve", false], [56540, 0.054038, " leverage", false], [4491, 0.045234, " do", false], [37730, 0.040987, " apply", false], [37923, 0.035237, " build", false], [32187, 0.022546, " take", false], [51982, 0.022286, " improve", false], [22339, 0.016935, " put", false]]]}, "raw_delta": -0.22656249999999997, "tuned_delta": -0.17370755610180016}, {"byte_start": 5223, "byte_end": 5233, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 900, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "model_b": "10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.007902293466031551]], "model_b": [[59943, " knowledge", "normal", 0.0034443626645952463]]}, "loss": {"model_a": 8.735067630382394, "model_b": 10.256660056319971}, "topk": {"model_a": [59943, 13, 0.007902293466031551, [[4596, 0.166932, " in", false], [53087, 0.149469, " systems", false], [3609, 0.144871, " AI", false], [52224, 0.132661, " methods", false], [39931, 0.12251, " their", false], [332, 0.024452, " a", false], [64452, 0.022689, " intelligence", false], [22590, 0.018053, " the", false], [63659, 0.015378, " intelligent", false], [51832, 0.011774, " general", false]]], "model_b": [59943, 28, 0.0034443626645952463, [[4596, 0.403129, " in", false], [53087, 0.076017, " systems", false], [3609, 0.056226, " AI", false], [52224, 0.052723, " methods", false], [39931, 0.043898, " their", false], [4712, 0.025005, " on", false], [31162, 0.024469, " into", false], [332, 0.02078, " a", false], [51832, 0.018878, " general", false], [60521, 0.010292, " solutions", false]]]}, "raw_delta": -0.08437499999999998, "tuned_delta": -0.031520056101800156}, {"byte_start": 5233, "byte_end": 5238, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 901, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"model_a": "3.37% 3.37% 3.37% 3.37% 3.37%", "model_b": "3.37% 3.37% 3.37% 3.37% 3.37%"}, "model_tokens": {"model_a": [[31162, " into", "normal", 0.39185187220573425]], "model_b": [[31162, " into", "normal", 0.3904026448726654]]}, "loss": {"model_a": 3.3672276833248262, "model_b": 3.3672276833248262}, "topk": {"model_a": [31162, 1, 0.39185187220573425, [[31162, 0.391852, " into", false], [46, 0.32774, "-", false], [4706, 0.045519, " of", false], [53087, 0.031801, " systems", false], [21265, 0.030831, " and", false], [4596, 0.029904, " in", false], [37598, 0.017989, " about", false], [56003, 0.016015, " directly", false], [4715, 0.012068, " or", false], [45, 0.011356, ",", false]]], "model_b": [31162, 1, 0.3904026448726654, [[31162, 0.390403, " into", false], [46, 0.291939, "-", false], [4596, 0.052488, " in", false], [4706, 0.028362, " of", false], [32227, 0.024681, " that", false], [56003, 0.020381, " directly", false], [53087, 0.017799, " systems", false], [37810, 0.017249, " based", false], [30917, 0.01173, " from", false], [21265, 0.011453, " and", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 5238, "byte_end": 5244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 902, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "1.64% 1.64% 1.64% 1.64% 1.64% 1.64%", "model_b": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.5748592019081116]], "model_b": [[39931, " their", "normal", 0.5617438554763794]]}, "loss": {"model_a": 1.6436955218461495, "model_b": 1.7611023448351601}, "topk": {"model_a": [39931, 1, 0.5748592019081116, [[39931, 0.574859, " their", false], [3609, 0.130469, " AI", false], [22590, 0.069994, " the", false], [53087, 0.069991, " systems", false], [52224, 0.058335, " methods", false], [56949, 0.00896, " programs", false], [332, 0.008902, " a", false], [56567, 0.006214, " machines", false], [61559, 0.005006, " algorithms", false], [4419, 0.004201, " an", false]]], "model_b": [39931, 1, 0.5617438554763794, [[39931, 0.561744, " their", false], [3609, 0.190308, " AI", false], [22590, 0.056376, " the", false], [53087, 0.029268, " systems", false], [52224, 0.021943, " methods", false], [332, 0.014577, " a", false], [61559, 0.011758, " algorithms", false], [55809, 0.009182, " computer", false], [59345, 0.008482, " computers", false], [51832, 0.008227, " general", false]]]}, "raw_delta": -0.006510416666666671, "tuned_delta": 0.04634452723153315}, {"byte_start": 5244, "byte_end": 5251, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 903, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"model_a": "12.72% 12.72% 12.72% 12.72% 12.72% 12.72% 12.72%", "model_b": "15.46% 15.46% 15.46% 15.46% 15.46% 15.46% 15.46%"}, "model_tokens": {"model_a": [[45124, " agents", "normal", 0.007117672823369503]], "model_b": [[45124, " agents", "normal", 0.002509651007130742]]}, "loss": {"model_a": 12.720190650695104, "model_b": 15.45744686666746}, "topk": {"model_a": [45124, 11, 0.007117672823369503, [[53087, 0.385491, " systems", false], [52224, 0.307616, " methods", false], [3609, 0.086523, " AI", false], [56949, 0.04742, " programs", false], [61590, 0.022919, " approaches", false], [61559, 0.020063, " algorithms", false], [57103, 0.017808, " research", false], [46587, 0.013733, " models", false], [32499, 0.01145, " work", false], [56567, 0.007419, " machines", false]]], "model_b": [45124, 20, 0.002509651007130742, [[52224, 0.471205, " methods", false], [53087, 0.219157, " systems", false], [3609, 0.083869, " AI", false], [61590, 0.03064, " approaches", false], [61559, 0.025836, " algorithms", false], [57103, 0.022188, " research", false], [46587, 0.010499, " models", false], [62633, 0.010452, " techniques", false], [56949, 0.010309, " programs", false], [60521, 0.006603, " solutions", false]]]}, "raw_delta": -0.1517857142857142, "tuned_delta": -0.09893077038751437}, {"byte_start": 5251, "byte_end": 5252, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "14.23%", "model_b": "18.32%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.45620986819267273]], "model_b": [[45, ",", "normal", 0.36264654994010925]]}, "loss": {"model_a": 14.229706946268095, "model_b": 18.315464386285665}, "topk": {"model_a": [45, 1, 0.45620986819267273, [[45, 0.45621, ",", false], [21265, 0.133005, " and", false], [4596, 0.056448, " in", false], [4811, 0.047219, " to", false], [60, 0.046517, ";", false], [275, 0.03733, " (", false], [45285, 0.016459, " before", false], [5346, 0.016432, "---", false], [32227, 0.016094, " that", false], [21400, 0.015033, " but", false]]], "model_b": [45, 1, 0.36264654994010925, [[45, 0.362647, ",", false], [4596, 0.080076, " in", false], [21265, 0.068882, " and", false], [4450, 0.065342, " by", false], [4811, 0.044381, " to", false], [275, 0.037526, " (", false], [4715, 0.032949, " or", false], [32227, 0.023624, " that", false], [53356, 0.020972, " without", false], [60, 0.020163, ";", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17370755610180016}, {"byte_start": 5252, "byte_end": 5254, "display": {"text": " 2", "kind": "normal"}, "is_word": true, "word_id": 904, "word_key": " 2", "bytes_hex": "20 32", "compression": {"model_a": "19.30% 19.30%", "model_b": "32.40% 32.40%"}, "model_tokens": {"model_a": [[285, " 2", "normal", 0.1168658658862114]], "model_b": [[285, " 2", "normal", 0.0272633396089077]]}, "loss": {"model_a": 19.301681699393356, "model_b": 32.404283144966946}, "topk": {"model_a": [285, 2, 0.1168658658862114, [[21265, 0.427637, " and", false], [285, 0.116866, " 2", false], [21400, 0.063451, " but", false], [4596, 0.034, " in", false], [30788, 0.024756, " even", false], [4423, 0.024077, " as", false], [4715, 0.022186, " or", false], [40186, 0.017953, " which", false], [4811, 0.014842, " to", false], [32487, 0.013596, " with", false]]], "model_b": [285, 4, 0.0272633396089077, [[21265, 0.406147, " and", false], [21400, 0.121215, " but", false], [4715, 0.065361, " or", false], [285, 0.027263, " 2", false], [30788, 0.026324, " even", false], [31581, 0.026323, " only", false], [4811, 0.024387, " to", false], [47001, 0.020346, " rather", false], [4596, 0.015308, " in", false], [4423, 0.01427, " as", false]]]}, "raw_delta": -0.7265625, "tuned_delta": -0.6737075561018002}, {"byte_start": 5254, "byte_end": 5255, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "0.03%", "model_b": "0.02%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.9985468983650208]], "model_b": [[42, ")", "normal", 0.9988815188407898]]}, "loss": {"model_a": 0.02655412129321765, "model_b": 0.020225159741466294}, "topk": {"model_a": [42, 1, 0.9985468983650208, [[42, 0.998547, ")", false], [497, 0.000725, "),", false], [276, 0.000125, " )", false], [499, 9.8e-05, ").", false], [98, 9.2e-05, "a", false], [580, 7.2e-05, ".)", false], [47, 5.7e-05, ".", false], [48, 2.6e-05, "/", false], [45, 2.2e-05, ",", false], [46, 1.7e-05, "-", false]]], "model_b": [42, 1, 0.9988815188407898, [[42, 0.998882, ")", false], [276, 0.000183, " )", false], [497, 0.000166, "),", false], [47, 7.8e-05, ".", false], [45, 7.3e-05, ",", false], [499, 5.5e-05, ").", false], [580, 4.1e-05, ".)", false], [286, 2.4e-05, " 3", false], [46, 2.3e-05, "-", false], [489, 2.1e-05, ")\"", false]]]}, "raw_delta": 0.0003509521484375, "tuned_delta": 0.05320589604663732}, {"byte_start": 5255, "byte_end": 5260, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 905, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "8.17% 8.17% 8.17% 8.17% 8.17%", "model_b": "11.78% 11.78% 11.78% 11.78% 11.78%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.10269071161746979]], "model_b": [[32234, " this", "normal", 0.0379231832921505]]}, "loss": {"model_a": 8.171514880035144, "model_b": 11.778252482257551}, "topk": {"model_a": [32234, 2, 0.10269071161746979, [[32227, 0.188006, " that", false], [32234, 0.102691, " this", false], [22590, 0.092824, " the", false], [39936, 0.051265, " these", false], [32465, 0.043506, " when", false], [32232, 0.037963, " they", false], [59943, 0.031643, " knowledge", false], [32139, 0.030755, " such", false], [4596, 0.026504, " in", false], [21400, 0.019491, " but", false]]], "model_b": [32234, 5, 0.0379231832921505, [[3609, 0.20071, " AI", false], [22590, 0.115594, " the", false], [32232, 0.079027, " they", false], [39936, 0.045353, " these", false], [32234, 0.037923, " this", false], [39931, 0.036237, " their", false], [32227, 0.035232, " that", false], [32465, 0.032329, " when", false], [21265, 0.020016, " and", false], [45124, 0.018701, " agents", false]]]}, "raw_delta": -0.19999999999999996, "tuned_delta": -0.14714505610180012}, {"byte_start": 5260, "byte_end": 5267, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 906, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"model_a": "11.75% 11.75% 11.75% 11.75% 11.75% 11.75% 11.75%", "model_b": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%"}, "model_tokens": {"model_a": [[45150, " always", "normal", 0.010438967496156693]], "model_b": [[45150, " always", "normal", 0.005045089405030012]]}, "loss": {"model_a": 11.754100221528384, "model_b": 13.605773544097923}, "topk": {"model_a": [45150, 12, 0.010438967496156693, [[59943, 0.301007, " knowledge", false], [21800, 0.134708, " has", false], [4600, 0.079003, " is", false], [55532, 0.052734, " approach", false], [45829, 0.036793, " effort", false], [39171, 0.036092, " often", false], [30659, 0.024951, " does", false], [22748, 0.024325, " was", false], [38964, 0.017015, " makes", false], [38720, 0.014612, " human", false]]], "model_b": [45150, 27, 0.005045089405030012, [[21800, 0.199865, " has", false], [55532, 0.07615, " approach", false], [4600, 0.061248, " is", false], [39171, 0.052191, " often", false], [21532, 0.046801, " did", false], [39914, 0.045478, " tends", false], [21994, 0.03206, " led", false], [22748, 0.03041, " was", false], [59943, 0.027802, " knowledge", false], [38875, 0.018383, " leads", false]]]}, "raw_delta": -0.1026785714285714, "tuned_delta": -0.049823627530371575}, {"byte_start": 5267, "byte_end": 5273, "display": {"text": " helps", "kind": "normal"}, "is_word": true, "word_id": 907, "word_key": " helps", "bytes_hex": "20 68 65 6c 70 73", "compression": {"model_a": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42%", "model_b": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%"}, "model_tokens": {"model_a": [[38686, " helps", "normal", 0.0008085271110758185]], "model_b": [[38686, " helps", "normal", 0.0006232532323338091]]}, "loss": {"model_a": 21.415004513195548, "model_b": 22.166408180325217}, "topk": {"model_a": [38686, 106, 0.0008085271110758185, [[21800, 0.06052, " has", false], [38964, 0.059587, " makes", false], [38442, 0.057248, " fails", false], [40040, 0.056637, " turns", false], [46936, 0.050407, " proved", false], [38875, 0.049011, " leads", false], [39620, 0.035868, " seems", false], [39888, 0.035568, " takes", false], [40212, 0.032863, " works", false], [46938, 0.029812, " proves", false]]], "model_b": [38686, 102, 0.0006232532323338091, [[38442, 0.122931, " fails", false], [21994, 0.122602, " led", false], [45953, 0.097936, " failed", false], [38875, 0.066501, " leads", false], [46936, 0.057306, " proved", false], [31351, 0.043756, " made", false], [47812, 0.040553, " worked", false], [38964, 0.032757, " makes", false], [21532, 0.029149, " did", false], [40212, 0.02795, " works", false]]]}, "raw_delta": -0.04166666666666674, "tuned_delta": 0.01118827723153308}, {"byte_start": 5273, "byte_end": 5276, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 908, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "8.59% 8.59% 8.59%", "model_b": "23.76% 23.76% 23.76%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.2412131279706955]], "model_b": [[4596, " in", "normal", 0.01918860897421837]]}, "loss": {"model_a": 8.594179442795582, "model_b": 23.763140972975762}, "topk": {"model_a": [4596, 1, 0.2412131279706955, [[4596, 0.241213, " in", false], [32229, 0.084564, " them", false], [31581, 0.074659, " only", false], [45, 0.061364, ",", false], [332, 0.056458, " a", false], [4424, 0.045805, " at", false], [4811, 0.043645, " to", false], [22590, 0.042088, " the", false], [21700, 0.03969, " for", false], [31277, 0.025214, " less", false]]], "model_b": [4596, 7, 0.01918860897421837, [[45, 0.196504, ",", false], [22590, 0.193482, " the", false], [32229, 0.180915, " them", false], [4811, 0.058689, " to", false], [39931, 0.050486, " their", false], [3609, 0.020522, " AI", false], [4596, 0.019189, " in", false], [63750, 0.01272, " performance", false], [32487, 0.012078, " with", false], [275, 0.009089, " (", false]]]}, "raw_delta": -0.8411458333333334, "tuned_delta": -0.7882908894351336}, {"byte_start": 5276, "byte_end": 5280, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 909, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.27% 1.27% 1.27% 1.27%", "model_b": "1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.7545849084854126]], "model_b": [[22590, " the", "normal", 0.7791318297386169]]}, "loss": {"model_a": 1.2679936882813154, "model_b": 1.1359110124186784}, "topk": {"model_a": [22590, 1, 0.7545849084854126, [[22590, 0.754585, " the", false], [32074, 0.082781, " some", false], [39675, 0.026782, " short", false], [332, 0.013353, " a", false], [46639, 0.004812, " narrow", false], [39720, 0.004137, " small", false], [52964, 0.003061, " special", false], [22226, 0.003026, " one", false], [63875, 0.002966, " specialized", false], [38328, 0.002863, " early", false]]], "model_b": [22590, 1, 0.7791318297386169, [[22590, 0.779132, " the", false], [32074, 0.040786, " some", false], [39675, 0.015999, " short", false], [332, 0.014595, " a", false], [22226, 0.006176, " one", false], [39920, 0.005319, " terms", false], [56901, 0.0053, " practice", false], [31323, 0.005044, " long", false], [46500, 0.004312, " making", false], [38864, 0.003821, " large", false]]]}, "raw_delta": 0.00732421875, "tuned_delta": 0.06017916264819982}, {"byte_start": 5280, "byte_end": 5286, "display": {"text": " short", "kind": "normal"}, "is_word": true, "word_id": 910, "word_key": " short", "bytes_hex": "20 73 68 6f 72 74", "compression": {"model_a": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27%", "model_b": "2.63% 2.63% 2.63% 2.63% 2.63% 2.63%"}, "model_tokens": {"model_a": [[39675, " short", "normal", 0.9131085872650146]], "model_b": [[39675, " short", "normal", 0.42023706436157227]]}, "loss": {"model_a": 0.2715032781620872, "model_b": 2.6299128349538394}, "topk": {"model_a": [39675, 1, 0.9131085872650146, [[39675, 0.913109, " short", false], [52888, 0.013564, " shorter", false], [59220, 0.011799, " beginning", false], [38328, 0.008143, " early", false], [31323, 0.006482, " long", false], [38499, 0.004912, " first", false], [32386, 0.004892, " very", false], [31503, 0.00485, " near", false], [52013, 0.00386, " initial", false], [59816, 0.003839, " immediate", false]]], "model_b": [39675, 2, 0.42023706436157227, [[31323, 0.516137, " long", false], [39675, 0.420237, " short", false], [46470, 0.012704, " longer", false], [38328, 0.007976, " early", false], [21616, 0.003511, " end", false], [52013, 0.003091, " initial", false], [30807, 0.002274, " face", false], [32386, 0.001892, " very", false], [59816, 0.001568, " immediate", false], [59220, 0.001356, " beginning", false]]]}, "raw_delta": -0.1307779947916667, "tuned_delta": -0.07792305089346689}, {"byte_start": 5286, "byte_end": 5291, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 911, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"model_a": "3.58% 3.58% 3.58% 3.58% 3.58%", "model_b": "4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"model_a": [[32219, " term", "normal", 0.3706311881542206]], "model_b": [[32219, " term", "normal", 0.25318074226379395]]}, "loss": {"model_a": 3.5785599647050454, "model_b": 4.959264203055811}, "topk": {"model_a": [32219, 2, 0.3706311881542206, [[22418, 0.598936, " run", false], [32219, 0.370631, " term", false], [46, 0.025626, "-", false], [4715, 0.000633, " or", false], [4811, 0.000565, " to", false], [21265, 0.000496, " and", false], [8661, 0.000348, "run", false], [32251, 0.000256, " time", false], [45, 0.000192, ",", false], [31057, 0.000186, " haul", false]]], "model_b": [32219, 2, 0.25318074226379395, [[22418, 0.724421, " run", false], [32219, 0.253181, " term", false], [46, 0.016459, "-", false], [39920, 0.000955, " terms", false], [31908, 0.000636, " runs", false], [39438, 0.000519, " range", false], [21265, 0.000432, " and", false], [4811, 0.000316, " to", false], [32251, 0.000287, " time", false], [8661, 0.000248, "run", false]]]}, "raw_delta": -0.07656250000000003, "tuned_delta": -0.023707556101800212}, {"byte_start": 5291, "byte_end": 5292, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "4.54%", "model_b": "4.72%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.7774084210395813]], "model_b": [[45, ",", "normal", 0.7714399695396423]]}, "loss": {"model_a": 4.543644049674714, "model_b": 4.719754284158229}, "topk": {"model_a": [45, 1, 0.7774084210395813, [[45, 0.777408, ",", false], [21400, 0.10044, " but", false], [275, 0.033255, " (", false], [21265, 0.03286, " and", false], [32465, 0.007609, " when", false], [5346, 0.004334, "---", false], [4596, 0.003911, " in", false], [4450, 0.0036, " by", false], [31581, 0.002735, " only", false], [51018, 0.002565, " because", false]]], "model_b": [45, 1, 0.7714399695396423, [[45, 0.77144, ",", false], [21400, 0.081278, " but", false], [275, 0.027869, " (", false], [4811, 0.025754, " to", false], [21265, 0.021871, " and", false], [32465, 0.011544, " when", false], [4450, 0.00865, " by", false], [32487, 0.006654, " with", false], [4596, 0.003675, " in", false], [5346, 0.003167, "---", false]]]}, "raw_delta": -0.009765625, "tuned_delta": 0.04308931889819982}, {"byte_start": 5292, "byte_end": 5296, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 912, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "6.52% 6.52% 6.52% 6.52%", "model_b": "7.01% 7.01% 7.01% 7.01%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.23724249005317688]], "model_b": [[21265, " and", "normal", 0.2092275768518448]]}, "loss": {"model_a": 6.516078675890093, "model_b": 7.009187332443938}, "topk": {"model_a": [21265, 3, 0.23724249005317688, [[21400, 0.372369, " but", false], [286, 0.288768, " 3", false], [21265, 0.237242, " and", false], [30788, 0.006661, " even", false], [40076, 0.006458, " until", false], [4423, 0.006404, " as", false], [32465, 0.0064, " when", false], [51018, 0.004987, " because", false], [4596, 0.004566, " in", false], [39171, 0.004065, " often", false]]], "model_b": [21265, 2, 0.2092275768518448, [[21400, 0.543361, " but", false], [21265, 0.209228, " and", false], [286, 0.157301, " 3", false], [30788, 0.005291, " even", false], [32465, 0.004856, " when", false], [4423, 0.004417, " as", false], [4715, 0.003947, " or", false], [40076, 0.00372, " until", false], [51018, 0.00259, " because", false], [32230, 0.00232, " then", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.02551119389819982}, {"byte_start": 5296, "byte_end": 5299, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 913, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "34.56% 34.56% 34.56%", "model_b": "24.61% 24.61% 24.61%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.0031528789550065994]], "model_b": [[4600, " is", "normal", 0.01663871854543686]]}, "loss": {"model_a": 34.564568687964744, "model_b": 24.60847009849664}, "topk": {"model_a": [4600, 8, 0.0031528789550065994, [[286, 0.913054, " 3", false], [45, 0.009591, ",", false], [39171, 0.007465, " often", false], [60523, 0.005669, " sometimes", false], [31581, 0.004967, " only", false], [32227, 0.004297, " that", false], [4596, 0.004105, " in", false], [4600, 0.003153, " is", false], [32230, 0.002506, " then", false], [61959, 0.002092, " eventually", false]]], "model_b": [4600, 4, 0.01663871854543686, [[286, 0.688539, " 3", false], [61959, 0.035168, " eventually", false], [45, 0.025929, ",", false], [4600, 0.016639, " is", false], [32230, 0.010734, " then", false], [38875, 0.010159, " leads", false], [4596, 0.009388, " in", false], [39171, 0.007824, " often", false], [38442, 0.007822, " fails", false], [22187, 0.007409, " not", false]]]}, "raw_delta": 0.5520833333333335, "tuned_delta": 0.6049382772315333}, {"byte_start": 5299, "byte_end": 5310, "display": {"text": " personally", "kind": "normal"}, "is_word": true, "word_id": 914, "word_key": " personally", "bytes_hex": "20 70 65 72 73 6f 6e 61 6c 6c 79", "compression": {"model_a": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "model_b": "16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80%"}, "model_tokens": {"model_a": [[62309, " personally", "normal", 0.00037499581230804324]], "model_b": [[62309, " personally", "normal", 3.568957981769927e-05]]}, "loss": {"model_a": 12.96171325798678, "model_b": 16.804118373990764}, "topk": {"model_a": [62309, 211, 0.00037499581230804324, [[39171, 0.142439, " often", false], [332, 0.055391, " a", false], [60645, 0.038906, " therefore", false], [22187, 0.035886, " not", false], [60523, 0.033181, " sometimes", false], [45150, 0.028032, " always", false], [32386, 0.023923, " very", false], [57403, 0.020802, " tempting", false], [30724, 0.020626, " easy", false], [53248, 0.020399, " usually", false]]], "model_b": [62309, 897, 3.568957981769927e-05, [[22187, 0.122064, " not", false], [39171, 0.084578, " often", false], [51336, 0.064987, " counter", false], [332, 0.050766, " a", false], [59758, 0.028713, " generally", false], [62676, 0.025881, " ultimately", false], [60523, 0.022163, " sometimes", false], [53248, 0.019177, " usually", false], [39115, 0.018201, " never", false], [22590, 0.017031, " the", false]]]}, "raw_delta": -0.21306818181818168, "tuned_delta": -0.16021323791998188}, {"byte_start": 5310, "byte_end": 5321, "display": {"text": " satisfying", "kind": "normal"}, "is_word": true, "word_id": 915, "word_key": " satisfying", "bytes_hex": "20 73 61 74 69 73 66 79 69 6e 67", "compression": {"model_a": "1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33%", "model_b": "1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84%"}, "model_tokens": {"model_a": [[62527, " satisfying", "normal", 0.44267943501472473]], "model_b": [[62527, " satisfying", "normal", 0.3251973092556]]}, "loss": {"model_a": 1.325629765021375, "model_b": 1.8443544556819134}, "topk": {"model_a": [62527, 1, 0.44267943501472473, [[62527, 0.442679, " satisfying", false], [60428, 0.113433, " rewarding", false], [31004, 0.11089, " grat", false], [59154, 0.099145, " appealing", false], [61694, 0.028625, " comforting", false], [32386, 0.024179, " very", false], [21265, 0.023442, " and", false], [61617, 0.020291, " attractive", false], [56874, 0.01911, " pleasing", false], [62029, 0.006488, " fulfilling", false]]], "model_b": [62527, 1, 0.3251973092556, [[62527, 0.325197, " satisfying", false], [60428, 0.110326, " rewarding", false], [31004, 0.032396, " grat", false], [61617, 0.024928, " attractive", false], [51336, 0.024147, " counter", false], [59154, 0.023204, " appealing", false], [61636, 0.022481, " beneficial", false], [47687, 0.020739, " useful", false], [59636, 0.020493, " enjoyable", false], [31458, 0.02046, " more", false]]]}, "raw_delta": -0.028764204545454565, "tuned_delta": 0.024090739352745257}, {"byte_start": 5321, "byte_end": 5324, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 916, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "8.55% 8.55% 8.55%", "model_b": "12.87% 12.87% 12.87%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.24071618914604187]], "model_b": [[4811, " to", "normal", 0.11646636575460434]]}, "loss": {"model_a": 8.547216713599978, "model_b": 12.86778779959557}, "topk": {"model_a": [4811, 2, 0.24071618914604187, [[45, 0.581697, ",", false], [4811, 0.240716, " to", false], [21700, 0.051083, " for", false], [21265, 0.032757, " and", false], [4596, 0.023196, " in", false], [275, 0.011397, " (", false], [4423, 0.009719, " as", false], [51018, 0.008212, " because", false], [5346, 0.005623, "---", false], [47, 0.005075, ".", false]]], "model_b": [4811, 2, 0.11646636575460434, [[45, 0.657605, ",", false], [4811, 0.116466, " to", false], [21700, 0.074476, " for", false], [275, 0.035649, " (", false], [21265, 0.024786, " and", false], [4596, 0.014069, " in", false], [60, 0.013269, ";", false], [32465, 0.011202, " when", false], [21400, 0.009716, " but", false], [5346, 0.008416, "---", false]]]}, "raw_delta": -0.23958333333333334, "tuned_delta": -0.18672838943513353}, {"byte_start": 5324, "byte_end": 5328, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 917, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.59% 2.59% 2.59% 2.59%", "model_b": "3.19% 3.19% 3.19% 3.19%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.5647656321525574]], "model_b": [[22590, " the", "normal", 0.4871147572994232]]}, "loss": {"model_a": 2.5888204469076856, "model_b": 3.18759524415164}, "topk": {"model_a": [22590, 1, 0.5647656321525574, [[22590, 0.564766, " the", false], [63843, 0.08505, " researchers", false], [4491, 0.079757, " do", false], [39944, 0.052605, " those", false], [32229, 0.029836, " them", false], [31059, 0.015981, " have", false], [32499, 0.014091, " work", false], [31370, 0.010594, " many", false], [332, 0.007475, " a", false], [39931, 0.006626, " their", false]]], "model_b": [22590, 1, 0.4871147572994232, [[22590, 0.487115, " the", false], [22449, 0.076709, " see", false], [63843, 0.053493, " researchers", false], [32229, 0.033474, " them", false], [32074, 0.028798, " some", false], [39944, 0.026801, " those", false], [31223, 0.026273, " know", false], [332, 0.022602, " a", false], [31370, 0.018264, " many", false], [3609, 0.01081, " AI", false]]]}, "raw_delta": -0.033203125, "tuned_delta": 0.01965181889819982}, {"byte_start": 5328, "byte_end": 5339, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 918, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"model_a": "1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55%", "model_b": "2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78%"}, "model_tokens": {"model_a": [[62496, " researcher", "normal", 0.3905523717403412]], "model_b": [[62496, " researcher", "normal", 0.18503358960151672]]}, "loss": {"model_a": 1.549770063454941, "model_b": 2.779339700576216}, "topk": {"model_a": [62496, 1, 0.3905523717403412, [[62496, 0.390552, " researcher", false], [63843, 0.375702, " researchers", false], [37636, 0.06703, " agent", false], [3609, 0.035073, " AI", false], [45124, 0.018961, " agents", false], [38720, 0.014546, " human", false], [62105, 0.011832, " individual", false], [46787, 0.008724, " people", false], [46795, 0.005158, " person", false], [64951, 0.004536, " investigators", false]]], "model_b": [62496, 2, 0.18503358960151672, [[63843, 0.230718, " researchers", false], [62496, 0.185034, " researcher", false], [37636, 0.166019, " agent", false], [3609, 0.137714, " AI", false], [45124, 0.071079, " agents", false], [38720, 0.037695, " human", false], [62105, 0.017622, " individual", false], [57103, 0.015407, " research", false], [46787, 0.011403, " people", false], [46795, 0.006465, " person", false]]]}, "raw_delta": -0.06818181818181816, "tuned_delta": -0.015326874283618341}, {"byte_start": 5339, "byte_end": 5340, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.29%", "model_b": "3.82%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.83455491065979]], "model_b": [[45, ",", "normal", 0.8068479895591736]]}, "loss": {"model_a": 3.29326138484175, "model_b": 3.821592088292298}, "topk": {"model_a": [45, 1, 0.83455491065979, [[45, 0.834555, ",", false], [22762, 0.035729, " who", false], [21265, 0.019913, " and", false], [275, 0.017545, " (", false], [47, 0.009351, ".", false], [4811, 0.008962, " to", false], [4596, 0.008855, " in", false], [51018, 0.006993, " because", false], [286, 0.005292, " 3", false], [21700, 0.004763, " for", false]]], "model_b": [45, 1, 0.8068479895591736, [[45, 0.806848, ",", false], [275, 0.041571, " (", false], [22762, 0.026875, " who", false], [21265, 0.018391, " and", false], [60, 0.01521, ";", false], [47, 0.011316, ".", false], [4596, 0.007034, " in", false], [21400, 0.00606, " but", false], [32465, 0.005791, " when", false], [4424, 0.004872, " at", false]]]}, "raw_delta": -0.029296875, "tuned_delta": 0.02355806889819982}, {"byte_start": 5340, "byte_end": 5344, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 919, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "6.02% 6.02% 6.02% 6.02%", "model_b": "5.42% 5.42% 5.42% 5.42%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.2637294828891754]], "model_b": [[21400, " but", "normal", 0.3018230199813843]]}, "loss": {"model_a": 6.022970019336248, "model_b": 5.424195222092293}, "topk": {"model_a": [21400, 3, 0.2637294828891754, [[286, 0.407244, " 3", false], [21265, 0.285138, " and", false], [21400, 0.263729, " but", false], [22762, 0.007188, " who", false], [30788, 0.003868, " even", false], [51018, 0.003375, " because", false], [4423, 0.002707, " as", false], [40187, 0.00194, " while", false], [4788, 0.001859, " so", false], [55495, 0.001751, " although", false]]], "model_b": [21400, 2, 0.3018230199813843, [[21265, 0.445451, " and", false], [21400, 0.301823, " but", false], [286, 0.193622, " 3", false], [30788, 0.006811, " even", false], [40187, 0.006204, " while", false], [22762, 0.005069, " who", false], [62461, 0.002469, " regardless", false], [4715, 0.002263, " or", false], [22187, 0.001599, " not", false], [22797, 0.001546, " yet", false]]]}, "raw_delta": 0.033203125, "tuned_delta": 0.08605806889819982}, {"byte_start": 5344, "byte_end": 5346, "display": {"text": " 3", "kind": "normal"}, "is_word": true, "word_id": 920, "word_key": " 3", "bytes_hex": "20 33", "compression": {"model_a": "2.61% 2.61%", "model_b": "19.30% 19.30%"}, "model_tokens": {"model_a": [[286, " 3", "normal", 0.746444821357727]], "model_b": [[286, " 3", "normal", 0.11727403849363327]]}, "loss": {"model_a": 2.606431470356037, "model_b": 19.301681699393356}, "topk": {"model_a": [286, 1, 0.746444821357727, [[286, 0.746445, " 3", false], [45, 0.042478, ",", false], [4600, 0.022662, " is", false], [4596, 0.021105, " in", false], [4601, 0.016544, " it", false], [32227, 0.015763, " that", false], [62676, 0.012106, " ultimately", false], [31601, 0.011618, " over", false], [30659, 0.008569, " does", false], [61959, 0.008509, " eventually", false]]], "model_b": [286, 1, 0.11727403849363327, [[286, 0.117274, " 3", false], [4600, 0.090716, " is", false], [4601, 0.085785, " it", false], [61959, 0.064582, " eventually", false], [62676, 0.055315, " ultimately", false], [4596, 0.046424, " in", false], [30659, 0.046177, " does", false], [38442, 0.038159, " fails", false], [22187, 0.037002, " not", false], [45, 0.029397, ",", false]]]}, "raw_delta": -0.92578125, "tuned_delta": -0.8729263061018002}, {"byte_start": 5346, "byte_end": 5347, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "0.02%", "model_b": "0.03%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.9987402558326721]], "model_b": [[42, ")", "normal", 0.9982853531837463]]}, "loss": {"model_a": 0.02297688215527123, "model_b": 0.03095687715530555}, "topk": {"model_a": [42, 1, 0.9987402558326721, [[42, 0.99874, ")", false], [497, 0.000594, "),", false], [499, 8.5e-05, ").", false], [47, 7.3e-05, ".", false], [276, 6.4e-05, " )", false], [45, 5.8e-05, ",", false], [98, 4.6e-05, "a", false], [4600, 2.5e-05, " is", false], [492, 1.6e-05, ")'", false], [580, 1.5e-05, ".)", false]]], "model_b": [42, 1, 0.9982853531837463, [[42, 0.998285, ")", false], [497, 0.000354, "),", false], [45, 0.000261, ",", false], [276, 0.000132, " )", false], [499, 0.000106, ").", false], [47, 4.3e-05, ".", false], [46, 4.2e-05, "-", false], [4600, 3.1e-05, " is", false], [493, 2.9e-05, ")(", false], [98, 2.4e-05, "a", false]]]}, "raw_delta": -0.0004425048828125, "tuned_delta": 0.05241243901538732}, {"byte_start": 5347, "byte_end": 5350, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 921, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "12.02% 12.02% 12.02%", "model_b": "14.28% 14.28% 14.28%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.13363482058048248]], "model_b": [[4596, " in", "normal", 0.0911039486527443]]}, "loss": {"model_a": 12.022458674074693, "model_b": 14.276669675463697}, "topk": {"model_a": [4596, 2, 0.13363482058048248, [[4601, 0.217962, " it", false], [4596, 0.133635, " in", false], [22590, 0.111196, " the", false], [32234, 0.064051, " this", false], [31601, 0.043615, " over", false], [32227, 0.032741, " that", false], [32465, 0.025117, " when", false], [61959, 0.023342, " eventually", false], [4423, 0.015835, " as", false], [62676, 0.013959, " ultimately", false]]], "model_b": [4596, 3, 0.0911039486527443, [[4601, 0.325464, " it", false], [32234, 0.115428, " this", false], [4596, 0.091104, " in", false], [22590, 0.065696, " the", false], [31601, 0.050854, " over", false], [32465, 0.035607, " when", false], [32227, 0.021295, " that", false], [4423, 0.01855, " as", false], [39936, 0.016965, " these", false], [61959, 0.016826, " eventually", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 5350, "byte_end": 5354, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 922, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.57% 0.57% 0.57% 0.57%", "model_b": "0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.8821444511413574]], "model_b": [[22590, " the", "normal", 0.8033708333969116]]}, "loss": {"model_a": 0.5679555062093392, "model_b": 0.9906200689697776}, "topk": {"model_a": [22590, 1, 0.8821444511413574, [[22590, 0.882144, " the", false], [51832, 0.026633, " general", false], [56901, 0.018983, " practice", false], [332, 0.015514, " a", false], [31461, 0.007905, " most", false], [31323, 0.003302, " long", false], [45145, 0.00299, " almost", false], [39920, 0.002723, " terms", false], [30808, 0.002595, " fact", false], [31370, 0.002339, " many", false]]], "model_b": [22590, 1, 0.8033708333969116, [[22590, 0.803371, " the", false], [56901, 0.048825, " practice", false], [51832, 0.033012, " general", false], [31461, 0.012972, " most", false], [31323, 0.009248, " long", false], [31370, 0.008678, " many", false], [332, 0.007559, " a", false], [39920, 0.004081, " terms", false], [52652, 0.004075, " reality", false], [21256, 0.003864, " all", false]]]}, "raw_delta": -0.0234375, "tuned_delta": 0.02941744389819982}, {"byte_start": 5354, "byte_end": 5359, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 923, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"model_a": "0.51% 0.51% 0.51% 0.51% 0.51%", "model_b": "0.35% 0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"model_a": [[31323, " long", "normal", 0.8691374659538269]], "model_b": [[31323, " long", "normal", 0.9076931476593018]]}, "loss": {"model_a": 0.5071974753125261, "model_b": 0.3522204689670321}, "topk": {"model_a": [31323, 1, 0.8691374659538269, [[31323, 0.869137, " long", false], [46470, 0.094605, " longer", false], [21616, 0.008443, " end", false], [32386, 0.005919, " very", false], [46536, 0.001991, " medium", false], [31466, 0.001968, " much", false], [50837, 0.001484, " absence", false], [46397, 0.001106, " larger", false], [51310, 0.000752, " context", false], [30405, 0.000732, " case", false]]], "model_b": [31323, 1, 0.9076931476593018, [[31323, 0.907693, " long", false], [46470, 0.055758, " longer", false], [21616, 0.016914, " end", false], [46536, 0.001798, " medium", false], [39675, 0.000888, " short", false], [46064, 0.000742, " future", false], [51310, 0.000732, " context", false], [21357, 0.00069, " big", false], [38621, 0.000669, " grand", false], [51832, 0.000631, " general", false]]]}, "raw_delta": 0.00859375, "tuned_delta": 0.06144869389819982}, {"byte_start": 5359, "byte_end": 5363, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 924, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "1.54% 1.54% 1.54% 1.54%", "model_b": "1.00% 1.00% 1.00% 1.00%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.7096631526947021]], "model_b": [[22418, " run", "normal", 0.8015767931938171]]}, "loss": {"model_a": 1.5409645517307653, "model_b": 0.9950228248318655}, "topk": {"model_a": [22418, 1, 0.7096631526947021, [[22418, 0.709663, " run", false], [32219, 0.279357, " term", false], [46, 0.006419, "-", false], [31057, 0.001167, " haul", false], [45, 0.000312, ",", false], [32251, 0.000275, " time", false], [27132, 0.000238, "term", false], [39438, 0.000178, " range", false], [21265, 0.000134, " and", false], [8661, 0.000128, "run", false]]], "model_b": [22418, 1, 0.8015767931938171, [[22418, 0.801577, " run", false], [32219, 0.186583, " term", false], [46, 0.006717, "-", false], [45, 0.000583, ",", false], [31057, 0.000565, " haul", false], [30941, 0.00046, " game", false], [39438, 0.000366, " range", false], [39920, 0.000271, " terms", false], [31908, 0.000265, " runs", false], [32398, 0.000198, " view", false]]]}, "raw_delta": 0.0302734375, "tuned_delta": 0.08312838139819982}, {"byte_start": 5363, "byte_end": 5366, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 925, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "9.96% 9.96% 9.96%", "model_b": "9.53% 9.53% 9.53%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.18858477473258972]], "model_b": [[4601, " it", "normal", 0.20724616944789886]]}, "loss": {"model_a": 9.956098589468107, "model_b": 9.533434026707669}, "topk": {"model_a": [4601, 2, 0.18858477473258972, [[45, 0.589363, ",", false], [4601, 0.188585, " it", false], [32234, 0.062363, " this", false], [22590, 0.04317, " the", false], [32139, 0.011705, " such", false], [39936, 0.011586, " these", false], [275, 0.005838, " (", false], [32227, 0.004628, " that", false], [4600, 0.004369, " is", false], [63370, 0.004097, " computation", false]]], "model_b": [4601, 2, 0.20724616944789886, [[45, 0.535182, ",", false], [4601, 0.207246, " it", false], [32234, 0.0723, " this", false], [22590, 0.03778, " the", false], [39936, 0.014139, " these", false], [30659, 0.008527, " does", false], [4600, 0.007387, " is", false], [3609, 0.006653, " AI", false], [32227, 0.006169, " that", false], [52195, 0.004738, " massive", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07629244389819982}, {"byte_start": 5366, "byte_end": 5374, "display": {"text": " plateau", "kind": "normal"}, "is_word": true, "word_id": 926, "word_key": " plateau", "bytes_hex": "20 70 6c 61 74 65 61 75", "compression": {"model_a": "29.45% 29.45% 29.45% 29.45% 29.45% 29.45% 29.45% 29.45%", "model_b": "28.18% 28.18% 28.18% 28.18% 28.18% 28.18% 28.18% 28.18%"}, "model_tokens": {"model_a": [[52488, " plateau", "normal", 2.0826118998229504e-06]], "model_b": [[52488, " plateau", "normal", 3.7790293845318956e-06]]}, "loss": {"model_a": 29.445631205643878, "model_b": 28.177637517362562}, "topk": {"model_a": [52488, 1483, 2.0826118998229504e-06, [[4600, 0.30865, " is", false], [30659, 0.116086, " does", false], [45150, 0.056235, " always", false], [39115, 0.05354, " never", false], [21800, 0.028512, " has", false], [39914, 0.02179, " tends", false], [38964, 0.018677, " makes", false], [45145, 0.018071, " almost", false], [40040, 0.017267, " turns", false], [39171, 0.016274, " often", false]]], "model_b": [52488, 1269, 3.7790293845318956e-06, [[4600, 0.169707, " is", false], [30659, 0.162826, " does", false], [39115, 0.054043, " never", false], [38964, 0.048222, " makes", false], [45150, 0.047492, " always", false], [38875, 0.041253, " leads", false], [38442, 0.035432, " fails", false], [51019, 0.032904, " becomes", false], [21800, 0.030277, " has", false], [40212, 0.022499, " works", false]]]}, "raw_delta": 0.0703125, "tuned_delta": 0.12316744389819982}, {"byte_start": 5374, "byte_end": 5375, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 927, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.15%", "model_b": "0.06%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9919663667678833]], "model_b": [[116, "s", "normal", 0.9968969821929932]]}, "loss": {"model_a": 0.14639163241442268, "model_b": 0.05613513724162073}, "topk": {"model_a": [116, 1, 0.9919663667678833, [[116, 0.991966, "s", false], [1843, 0.006207, "ed", false], [460, 0.000402, "'s", false], [121, 0.000356, "x", false], [9091, 0.000119, "xes", false], [45, 0.000114, ",", false], [4715, 8.2e-05, " or", false], [4600, 6.6e-05, " is", false], [21265, 5.7e-05, " and", false], [46, 4.6e-05, "-", false]]], "model_b": [116, 1, 0.9968969821929932, [[116, 0.996897, "s", false], [121, 0.001192, "x", false], [1843, 0.000643, "ed", false], [45, 0.000178, ",", false], [21265, 0.000116, " and", false], [22249, 7.9e-05, " out", false], [4715, 7.3e-05, " or", false], [4596, 6.5e-05, " in", false], [47, 5.1e-05, ".", false], [460, 5.1e-05, "'s", false]]]}, "raw_delta": 0.0050048828125, "tuned_delta": 0.05785982671069982}, {"byte_start": 5375, "byte_end": 5379, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 928, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "6.20% 6.20% 6.20% 6.20%", "model_b": "7.96% 7.96% 7.96% 7.96%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.25260308384895325]], "model_b": [[21265, " and", "normal", 0.1735711246728897]]}, "loss": {"model_a": 6.199080253819764, "model_b": 7.960182598654924}, "topk": {"model_a": [21265, 2, 0.25260308384895325, [[45, 0.378567, ",", false], [21265, 0.252603, " and", false], [4715, 0.205441, " or", false], [22249, 0.036908, " out", false], [4596, 0.024797, " in", false], [275, 0.01395, " (", false], [4424, 0.012351, " at", false], [47, 0.012207, ".", false], [4423, 0.006188, " as", false], [5346, 0.004662, "---", false]]], "model_b": [21265, 2, 0.1735711246728897, [[45, 0.27842, ",", false], [21265, 0.173571, " and", false], [47, 0.095837, ".", false], [63750, 0.082231, " performance", false], [4715, 0.081027, " or", false], [22590, 0.060753, " the", false], [4596, 0.02827, " in", false], [4423, 0.01985, " as", false], [275, 0.014987, " (", false], [22249, 0.013751, " out", false]]]}, "raw_delta": -0.09765625, "tuned_delta": -0.04480130610180018}, {"byte_start": 5379, "byte_end": 5384, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 929, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "14.15% 14.15% 14.15% 14.15% 14.15%", "model_b": "10.26% 10.26% 10.26% 10.26% 10.26%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.019993936643004417]], "model_b": [[30788, " even", "normal", 0.05880230665206909]]}, "loss": {"model_a": 14.145174033716009, "model_b": 10.256660056319973}, "topk": {"model_a": [30788, 10, 0.019993936643004417, [[32230, 0.095664, " then", false], [4600, 0.090805, " is", false], [30659, 0.080777, " does", false], [51019, 0.057034, " becomes", false], [22590, 0.044803, " the", false], [61959, 0.040195, " eventually", false], [39115, 0.022556, " never", false], [38442, 0.021411, " fails", false], [39171, 0.021297, " often", false], [30788, 0.019994, " even", false]]], "model_b": [30788, 3, 0.05880230665206909, [[61959, 0.096449, " eventually", false], [30659, 0.062961, " does", false], [30788, 0.058802, " even", false], [38442, 0.057173, " fails", false], [4600, 0.048762, " is", false], [51019, 0.044917, " becomes", false], [32230, 0.036254, " then", false], [22590, 0.028768, " the", false], [39115, 0.028513, " never", false], [39171, 0.024968, " often", false]]]}, "raw_delta": 0.2156250000000001, "tuned_delta": 0.2684799438981999}, {"byte_start": 5384, "byte_end": 5392, "display": {"text": " inhibit", "kind": "normal"}, "is_word": true, "word_id": 930, "word_key": " inhibit", "bytes_hex": "20 69 6e 68 69 62 69 74", "compression": {"model_a": "10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71%", "model_b": "13.88% 13.88% 13.88% 13.88% 13.88% 13.88% 13.88% 13.88%"}, "model_tokens": {"model_a": [[52011, " inhibit", "normal", 0.008523152209818363]], "model_b": [[52011, " inhibit", "normal", 0.0021511260420084]]}, "loss": {"model_a": 10.707502256597774, "model_b": 13.877486477301062}, "topk": {"model_a": [52011, 30, 0.008523152209818363, [[38724, 0.078135, " hurts", false], [46201, 0.067064, " hinder", false], [55929, 0.067002, " declines", false], [52688, 0.057722, " regress", false], [51417, 0.040217, " degrade", false], [51019, 0.037557, " becomes", false], [47396, 0.031181, " starts", false], [38447, 0.029174, " falls", false], [40216, 0.025792, " worse", false], [39719, 0.024733, " slows", false]]], "model_b": [52011, 72, 0.0021511260420084, [[52748, 0.068634, " reverse", false], [38442, 0.066529, " fails", false], [55929, 0.044002, " declines", false], [38447, 0.038188, " falls", false], [60523, 0.03552, " sometimes", false], [40216, 0.033267, " worse", false], [38875, 0.027053, " leads", false], [52688, 0.026868, " regress", false], [51417, 0.024493, " degrade", false], [30965, 0.024418, " gets", false]]]}, "raw_delta": -0.17578125, "tuned_delta": -0.12292630610180018}, {"byte_start": 5392, "byte_end": 5393, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 931, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.01%", "model_b": "0.00%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9996360540390015]], "model_b": [[116, "s", "normal", 0.9997748732566833]]}, "loss": {"model_a": 0.006535340732786728, "model_b": 0.0040415922952760025}, "topk": {"model_a": [116, 1, 0.9996360540390015, [[116, 0.999636, "s", false], [56950, 6.8e-05, " progress", false], [56537, 3.4e-05, " learning", false], [7856, 3.2e-05, "ing", false], [63750, 3e-05, " performance", false], [22590, 3e-05, " the", false], [46132, 1.3e-05, " growth", false], [57103, 9e-06, " research", false], [7938, 8e-06, "ive", false], [63469, 7e-06, " development", false]]], "model_b": [116, 1, 0.9997748732566833, [[116, 0.999775, "s", false], [7856, 3.9e-05, "ing", false], [2184, 1.4e-05, "si", false], [8752, 1.2e-05, "sth", false], [2176, 1e-05, "sa", false], [7938, 9e-06, "ive", false], [22590, 9e-06, " the", false], [8705, 6e-06, "ses", false], [45, 5e-06, ",", false], [10402, 5e-06, "们", false]]]}, "raw_delta": 0.00013828277587890625, "tuned_delta": 0.05299322667407873}, {"byte_start": 5393, "byte_end": 5401, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 932, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"model_a": "6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55%", "model_b": "6.94% 6.94% 6.94% 6.94% 6.94% 6.94% 6.94% 6.94%"}, "model_tokens": {"model_a": [[51816, " further", "normal", 0.05504672974348068]], "model_b": [[51816, " further", "normal", 0.04612430930137634]]}, "loss": {"model_a": 6.551300722786796, "model_b": 6.938743238650531}, "topk": {"model_a": [51816, 4, 0.05504672974348068, [[56950, 0.648015, " progress", false], [63750, 0.062711, " performance", false], [22590, 0.058397, " the", false], [51816, 0.055047, " further", false], [56537, 0.025416, " learning", false], [63621, 0.025084, " improvement", false], [57103, 0.018263, " research", false], [45, 0.016254, ",", false], [63469, 0.005838, " development", false], [46064, 0.005497, " future", false]]], "model_b": [51816, 4, 0.04612430930137634, [[56950, 0.258362, " progress", false], [63750, 0.232161, " performance", false], [22590, 0.115315, " the", false], [51816, 0.046124, " further", false], [46132, 0.035524, " growth", false], [63621, 0.026632, " improvement", false], [56537, 0.021987, " learning", false], [57103, 0.018307, " research", false], [3609, 0.016189, " AI", false], [53052, 0.013832, " success", false]]]}, "raw_delta": -0.021484375, "tuned_delta": 0.03137056889819982}, {"byte_start": 5401, "byte_end": 5410, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 933, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"model_a": "0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47%", "model_b": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21%"}, "model_tokens": {"model_a": [[56950, " progress", "normal", 0.789636492729187]], "model_b": [[56950, " progress", "normal", 0.5445321798324585]]}, "loss": {"model_a": 0.4735408527223431, "model_b": 1.2132038375531107}, "topk": {"model_a": [56950, 1, 0.789636492729187, [[56950, 0.789636, " progress", false], [63621, 0.062161, " improvement", false], [63469, 0.023507, " development", false], [57103, 0.022632, " research", false], [63750, 0.016689, " performance", false], [56537, 0.015099, " learning", false], [64423, 0.009054, " improvements", false], [55465, 0.007005, " advances", false], [53052, 0.005407, " success", false], [50862, 0.004942, " advance", false]]], "model_b": [56950, 1, 0.5445321798324585, [[56950, 0.544532, " progress", false], [63621, 0.136027, " improvement", false], [46132, 0.051639, " growth", false], [63750, 0.027893, " performance", false], [38575, 0.026848, " gains", false], [63265, 0.024929, " advancement", false], [56537, 0.022304, " learning", false], [57103, 0.017195, " research", false], [53052, 0.017126, " success", false], [64423, 0.016987, " improvements", false]]]}, "raw_delta": -0.041015625, "tuned_delta": 0.011839318898199822}, {"byte_start": 5410, "byte_end": 5411, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "16.98%", "model_b": "32.26%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.3881472647190094]], "model_b": [[45, ",", "normal", 0.16725587844848633]]}, "loss": {"model_a": 16.977026604210945, "model_b": 32.263394957380136}, "topk": {"model_a": [45, 2, 0.3881472647190094, [[47, 0.440912, ".", false], [45, 0.388147, ",", false], [21265, 0.022601, " and", false], [5346, 0.018602, "---", false], [4450, 0.015193, " by", false], [4596, 0.014046, " in", false], [4423, 0.013955, " as", false], [51018, 0.013793, " because", false], [275, 0.013353, " (", false], [60, 0.011975, ";", false]]], "model_b": [45, 2, 0.16725587844848633, [[47, 0.662412, ".", false], [45, 0.167256, ",", false], [4596, 0.030271, " in", false], [51018, 0.025666, " because", false], [275, 0.014004, " (", false], [4450, 0.013803, " by", false], [21265, 0.0127, " and", false], [4423, 0.008189, " as", false], [32465, 0.008154, " when", false], [5346, 0.007063, "---", false]]]}, "raw_delta": -0.84765625, "tuned_delta": -0.7948013061018002}, {"byte_start": 5411, "byte_end": 5415, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 934, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "2.87% 2.87% 2.87% 2.87%", "model_b": "3.63% 3.63% 3.63% 3.63%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.5254503488540649]], "model_b": [[21265, " and", "normal", 0.4452229142189026]]}, "loss": {"model_a": 2.8705968220813114, "model_b": 3.62787083036043}, "topk": {"model_a": [21265, 1, 0.5254503488540649, [[21265, 0.52545, " and", false], [287, 0.149123, " 4", false], [40187, 0.048818, " while", false], [51018, 0.04701, " because", false], [4423, 0.032275, " as", false], [53339, 0.023386, " whereas", false], [4715, 0.008269, " or", false], [61953, 0.007746, " especially", false], [32465, 0.007296, " when", false], [40186, 0.0068, " which", false]]], "model_b": [21265, 1, 0.4452229142189026, [[21265, 0.445223, " and", false], [51018, 0.112964, " because", false], [287, 0.086072, " 4", false], [4423, 0.073744, " as", false], [32465, 0.015144, " when", false], [21572, 0.012936, " due", false], [4715, 0.011803, " or", false], [4788, 0.011763, " so", false], [4588, 0.008857, " if", false], [52107, 0.008597, " leading", false]]]}, "raw_delta": -0.0419921875, "tuned_delta": 0.010862756398199822}, {"byte_start": 5415, "byte_end": 5417, "display": {"text": " 4", "kind": "normal"}, "is_word": true, "word_id": 935, "word_key": " 4", "bytes_hex": "20 34", "compression": {"model_a": "1.29% 1.29%", "model_b": "4.97% 4.97%"}, "model_tokens": {"model_a": [[287, " 4", "normal", 0.8668489456176758]], "model_b": [[287, " 4", "normal", 0.5801259279251099]]}, "loss": {"model_a": 1.285604711729667, "model_b": 4.966308612435152}, "topk": {"model_a": [287, 1, 0.8668489456176758, [[287, 0.866849, " 4", false], [4600, 0.0103, " is", false], [32227, 0.009019, " that", false], [45, 0.008357, ",", false], [22590, 0.007527, " the", false], [51744, 0.006446, " finally", false], [61959, 0.005861, " eventually", false], [4601, 0.005507, " it", false], [4596, 0.00406, " in", false], [30788, 0.003195, " even", false]]], "model_b": [287, 1, 0.5801259279251099, [[287, 0.580126, " 4", false], [51744, 0.057454, " finally", false], [61959, 0.027027, " eventually", false], [45, 0.02438, ",", false], [62676, 0.02021, " ultimately", false], [22590, 0.020025, " the", false], [4600, 0.017413, " is", false], [4601, 0.015063, " it", false], [32227, 0.014568, " that", false], [4596, 0.010776, " in", false]]]}, "raw_delta": -0.2041015625, "tuned_delta": -0.15124661860180016}, {"byte_start": 5417, "byte_end": 5418, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "0.02%", "model_b": "0.02%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.9986403584480286]], "model_b": [[42, ")", "normal", 0.9987460374832153]]}, "loss": {"model_a": 0.0243527433621737, "model_b": 0.02256412379320049}, "topk": {"model_a": [42, 1, 0.9986403584480286, [[42, 0.99864, ")", false], [497, 0.000253, "),", false], [499, 0.000208, ").", false], [47, 0.00017, ".", false], [276, 0.000156, " )", false], [98, 9.2e-05, "a", false], [45, 8.2e-05, ",", false], [580, 5.3e-05, ".)", false], [22590, 3.5e-05, " the", false], [32227, 2.6e-05, " that", false]]], "model_b": [42, 1, 0.9987460374832153, [[42, 0.998746, ")", false], [497, 0.000316, "),", false], [499, 0.000149, ").", false], [45, 0.000108, ",", false], [276, 0.000108, " )", false], [564, 4.9e-05, "-)", false], [47, 3.2e-05, ".", false], [46, 2.6e-05, "-", false], [5308, 2.5e-05, ")--", false], [580, 2.4e-05, ".)", false]]]}, "raw_delta": 9.918212890625e-05, "tuned_delta": 0.05295412602710607}, {"byte_start": 5418, "byte_end": 5431, "display": {"text": " breakthrough", "kind": "normal"}, "is_word": true, "word_id": 936, "word_key": " breakthrough", "bytes_hex": "20 62 72 65 61 6b 74 68 72 6f 75 67 68", "compression": {"model_a": "12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92%", "model_b": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%"}, "model_tokens": {"model_a": [[64266, " breakthrough", "normal", 8.767345570959151e-05]], "model_b": [[64266, " breakthrough", "normal", 0.00017870469309855253]]}, "loss": {"model_a": 12.918363046421609, "model_b": 11.964658391987795}, "topk": {"model_a": [64266, 346, 8.767345570959151e-05, [[22590, 0.223736, " the", false], [4601, 0.067109, " it", false], [4596, 0.060295, " in", false], [52028, 0.055638, " instead", false], [39934, 0.033519, " there", false], [32234, 0.028395, " this", false], [52224, 0.025935, " methods", false], [32465, 0.024755, " when", false], [332, 0.02386, " a", false], [32227, 0.021687, " that", false]]], "model_b": [64266, 256, 0.00017870469309855253, [[22590, 0.203655, " the", false], [4601, 0.095474, " it", false], [32234, 0.072982, " this", false], [4596, 0.046852, " in", false], [32465, 0.04456, " when", false], [3609, 0.043638, " AI", false], [39934, 0.033207, " there", false], [32227, 0.022218, " that", false], [39936, 0.017176, " these", false], [4858, 0.01376, " we", false]]]}, "raw_delta": 0.05288461538461542, "tuned_delta": 0.10573955928281524}, {"byte_start": 5431, "byte_end": 5440, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 937, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"model_a": "5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01%", "model_b": "9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46%"}, "model_tokens": {"model_a": [[56950, " progress", "normal", 0.08279954642057419]], "model_b": [[56950, " progress", "normal", 0.009049524553120136]]}, "loss": {"model_a": 5.009357780864455, "model_b": 9.455162811381658}, "topk": {"model_a": [56950, 2, 0.08279954642057419, [[116, 0.767463, "s", false], [56950, 0.0828, " progress", false], [52224, 0.060839, " methods", false], [63750, 0.009698, " performance", false], [64423, 0.008952, " improvements", false], [62633, 0.007535, " techniques", false], [57103, 0.00728, " research", false], [52738, 0.006113, " results", false], [55465, 0.005914, " advances", false], [61590, 0.004575, " approaches", false]]], "model_b": [56950, 2, 0.009049524553120136, [[116, 0.882624, "s", false], [56950, 0.00905, " progress", false], [52738, 0.008718, " results", false], [57103, 0.007082, " research", false], [63484, 0.006885, " discoveries", false], [52224, 0.005479, " methods", false], [64423, 0.005442, " improvements", false], [63750, 0.003925, " performance", false], [55465, 0.003275, " advances", false], [60587, 0.003119, " successes", false]]]}, "raw_delta": -0.24652777777777773, "tuned_delta": -0.1936728338795779}, {"byte_start": 5440, "byte_end": 5451, "display": {"text": " eventually", "kind": "normal"}, "is_word": true, "word_id": 938, "word_key": " eventually", "bytes_hex": "20 65 76 65 6e 74 75 61 6c 6c 79", "compression": {"model_a": "11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12%", "model_b": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"model_a": [[61959, " eventually", "normal", 0.0011233455734327435]], "model_b": [[61959, " eventually", "normal", 0.007088968064635992]]}, "loss": {"model_a": 11.117358802304864, "model_b": 8.094666777715064}, "topk": {"model_a": [61959, 51, 0.0011233455734327435, [[4600, 0.271174, " is", false], [38087, 0.141363, " comes", false], [21800, 0.085821, " has", false], [4596, 0.071368, " in", false], [45150, 0.058056, " always", false], [21413, 0.050944, " can", false], [45, 0.026541, ",", false], [46697, 0.023706, " occurs", false], [57102, 0.022285, " requires", false], [45145, 0.017331, " almost", false]]], "model_b": [61959, 19, 0.007088968064635992, [[4600, 0.248987, " is", false], [4596, 0.161395, " in", false], [38087, 0.068235, " comes", false], [21800, 0.04492, " has", false], [39171, 0.035265, " often", false], [21413, 0.02843, " can", false], [45, 0.024241, ",", false], [46697, 0.022858, " occurs", false], [51896, 0.022739, " happens", false], [30659, 0.019764, " does", false]]]}, "raw_delta": 0.16761363636363633, "tuned_delta": 0.22046858026183613}, {"byte_start": 5451, "byte_end": 5459, "display": {"text": " arrives", "kind": "normal"}, "is_word": true, "word_id": 939, "word_key": " arrives", "bytes_hex": "20 61 72 72 69 76 65 73", "compression": {"model_a": "8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98%", "model_b": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%"}, "model_tokens": {"model_a": [[50956, " arrives", "normal", 0.01836257614195347]], "model_b": [[50956, " arrives", "normal", 0.02296433039009571]]}, "loss": {"model_a": 8.981621958659318, "model_b": 8.523735349002175}, "topk": {"model_a": [50956, 7, 0.01836257614195347, [[38087, 0.650356, " comes", false], [46697, 0.062907, " occurs", false], [57102, 0.038997, " requires", false], [51896, 0.032624, " happens", false], [30659, 0.020312, " does", false], [4600, 0.019042, " is", false], [50956, 0.018363, " arrives", false], [45199, 0.013405, " arises", false], [51586, 0.011251, " emerges", false], [52738, 0.008406, " results", false]]], "model_b": [50956, 10, 0.02296433039009571, [[38087, 0.289598, " comes", false], [46697, 0.103988, " occurs", false], [51896, 0.066013, " happens", false], [39828, 0.040898, " stops", false], [52488, 0.031788, " plateau", false], [51019, 0.026981, " becomes", false], [57102, 0.02367, " requires", false], [39888, 0.023204, " takes", false], [38875, 0.022995, " leads", false], [50956, 0.022964, " arrives", false]]]}, "raw_delta": 0.025390625, "tuned_delta": 0.07824556889819982}, {"byte_start": 5459, "byte_end": 5462, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 940, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "14.37% 14.37% 14.37%", "model_b": "19.63% 19.63% 19.63%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.09121424704790115]], "model_b": [[4450, " by", "normal", 0.03840164840221405]]}, "loss": {"model_a": 14.370595133854907, "model_b": 19.630420803762586}, "topk": {"model_a": [4450, 3, 0.09121424704790115, [[32465, 0.241468, " when", false], [30917, 0.147226, " from", false], [4450, 0.091214, " by", false], [31581, 0.084687, " only", false], [53140, 0.075515, " through", false], [45, 0.040869, ",", false], [32487, 0.031839, " with", false], [22705, 0.031656, " via", false], [32227, 0.029131, " that", false], [4423, 0.028353, " as", false]]], "model_b": [4450, 6, 0.03840164840221405, [[47, 0.207413, ".", false], [45, 0.207349, ",", false], [32465, 0.110717, " when", false], [4596, 0.07988, " in", false], [53140, 0.052335, " through", false], [4450, 0.038402, " by", false], [21265, 0.032371, " and", false], [30917, 0.02783, " from", false], [31581, 0.023201, " only", false], [4424, 0.01908, " at", false]]]}, "raw_delta": -0.29166666666666674, "tuned_delta": -0.2388117227684669}, {"byte_start": 5462, "byte_end": 5465, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 941, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"model_a": "35.50% 35.50% 35.50%", "model_b": "30.81% 30.81% 30.81%"}, "model_tokens": {"model_a": [[4419, " an", "normal", 0.0027575676795095205]], "model_b": [[4419, " an", "normal", 0.0058524818159639835]]}, "loss": {"model_a": 35.50382327187683, "model_b": 30.8075503523164}, "topk": {"model_a": [4419, 49, 0.0027575676795095205, [[38888, 0.125534, " lever", false], [40085, 0.080613, " using", false], [47497, 0.072147, " taking", false], [59611, 0.070695, " embracing", false], [46500, 0.045172, " making", false], [38989, 0.041409, " means", false], [55666, 0.038014, " building", false], [332, 0.025407, " a", false], [39193, 0.025322, " other", false], [22590, 0.016548, " the", false]]], "model_b": [4419, 25, 0.0058524818159639835, [[38888, 0.215584, " lever", false], [332, 0.056861, " a", false], [22590, 0.054658, " the", false], [38989, 0.05397, " means", false], [40085, 0.034778, " using", false], [47497, 0.028609, " taking", false], [56537, 0.021043, " learning", false], [55531, 0.02, " applying", false], [61984, 0.017756, " exploiting", false], [47285, 0.015181, " simply", false]]]}, "raw_delta": 0.26041666666666674, "tuned_delta": 0.3132716105648666}, {"byte_start": 5465, "byte_end": 5474, "display": {"text": " opposing", "kind": "normal"}, "is_word": true, "word_id": 942, "word_key": " opposing", "bytes_hex": "20 6f 70 70 6f 73 69 6e 67", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66%"}, "model_tokens": {"model_a": [[56766, " opposing", "normal", 0.0008981300634332001]], "model_b": [[56766, " opposing", "normal", 0.0002500218106433749]]}, "loss": {"model_a": 14.088818758681281, "model_b": 16.65611462137431}, "topk": {"model_a": [56766, 59, 0.0008981300634332001, [[63277, 0.39002, " alternative", false], [56131, 0.239348, " entirely", false], [55532, 0.098231, " approach", false], [59121, 0.01591, " alternate", false], [63627, 0.014923, " independent", false], [39193, 0.012271, " other", false], [56767, 0.008406, " opposite", false], [62688, 0.007653, " unexpected", false], [37636, 0.007501, " agent", false], [56438, 0.006043, " indirect", false]]], "model_b": [56766, 235, 0.0002500218106433749, [[56131, 0.471181, " entirely", false], [62688, 0.078722, " unexpected", false], [63627, 0.017513, " independent", false], [37636, 0.017392, " agent", false], [59113, 0.016331, " algorithm", false], [55430, 0.014577, " accident", false], [63277, 0.011766, " alternative", false], [61566, 0.011303, " altogether", false], [52391, 0.011237, " outside", false], [53235, 0.009373, " unknown", false]]]}, "raw_delta": -0.14236111111111116, "tuned_delta": -0.08950616721291134}, {"byte_start": 5474, "byte_end": 5483, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 943, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38%", "model_b": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.11291785538196564]], "model_b": [[55532, " approach", "normal", 0.014843225479125977]]}, "loss": {"model_a": 4.3831880582563985, "model_b": 8.45329125520877}, "topk": {"model_a": [55532, 3, 0.11291785538196564, [[39552, 0.382084, " route", false], [46561, 0.11372, " method", false], [55532, 0.112918, " approach", false], [31637, 0.068942, " path", false], [45, 0.059852, ",", false], [57317, 0.04228, " strategy", false], [38989, 0.026891, " means", false], [51832, 0.020824, " general", false], [38536, 0.019925, " force", false], [59526, 0.018227, " direction", false]]], "model_b": [55532, 12, 0.014843225479125977, [[38536, 0.180919, " force", false], [39552, 0.117344, " route", false], [59994, 0.11418, " mechanism", false], [46561, 0.089305, " method", false], [57317, 0.05123, " strategy", false], [45, 0.035886, ",", false], [31637, 0.035202, " path", false], [52571, 0.034749, " process", false], [40009, 0.03445, " trend", false], [38989, 0.032857, " means", false]]]}, "raw_delta": -0.22569444444444445, "tuned_delta": -0.17283950054624464}, {"byte_start": 5483, "byte_end": 5489, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 944, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "model_b": "12.87% 12.87% 12.87% 12.87% 12.87% 12.87%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.03023824654519558]], "model_b": [[37810, " based", "normal", 0.013707584701478481]]}, "loss": {"model_a": 10.472688610619752, "model_b": 12.86778779959557}, "topk": {"model_a": [37810, 5, 0.03023824654519558, [[32227, 0.342876, " that", false], [45, 0.246688, ",", false], [47, 0.132666, ".", false], [5346, 0.115348, "---", false], [37810, 0.030238, " based", false], [59, 0.020029, ":", false], [4706, 0.019678, " of", false], [275, 0.013884, " (", false], [21265, 0.011955, " and", false], [4811, 0.009926, " to", false]]], "model_b": [37810, 8, 0.013707584701478481, [[47, 0.370026, ".", false], [45, 0.228005, ",", false], [32227, 0.134062, " that", false], [5346, 0.104069, "---", false], [275, 0.027305, " (", false], [59, 0.016403, ":", false], [4811, 0.014847, " to", false], [37810, 0.013708, " based", false], [21265, 0.009173, " and", false], [568, 0.005919, "--", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07995755610180018}, {"byte_start": 5489, "byte_end": 5492, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 945, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.51% 0.51% 0.51%", "model_b": "0.57% 0.57% 0.57%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9193049669265747]], "model_b": [[4712, " on", "normal", 0.909875214099884]]}, "loss": {"model_a": 0.5077845094274712, "model_b": 0.5694230914967019}, "topk": {"model_a": [4712, 1, 0.9193049669265747, [[4712, 0.919305, " on", false], [31581, 0.014346, " only", false], [47330, 0.013137, " solely", false], [22187, 0.008035, " not", false], [31458, 0.007765, " more", false], [46957, 0.006237, " purely", false], [52028, 0.003362, " instead", false], [56131, 0.003359, " entirely", false], [4596, 0.003175, " in", false], [47285, 0.001917, " simply", false]]], "model_b": [4712, 1, 0.909875214099884, [[4712, 0.909875, " on", false], [4596, 0.021324, " in", false], [32350, 0.013442, " upon", false], [56131, 0.007959, " entirely", false], [47330, 0.00627, " solely", false], [31458, 0.005792, " more", false], [31581, 0.003822, " only", false], [46957, 0.003182, " purely", false], [45, 0.002831, ",", false], [52094, 0.002588, " largely", false]]]}, "raw_delta": -0.0034179687500000035, "tuned_delta": 0.04943697514819982}, {"byte_start": 5492, "byte_end": 5500, "display": {"text": " scaling", "kind": "normal"}, "is_word": true, "word_id": 946, "word_key": " scaling", "bytes_hex": "20 73 63 61 6c 69 6e 67", "compression": {"model_a": "16.13% 16.13% 16.13% 16.13% 16.13% 16.13% 16.13% 16.13%", "model_b": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%"}, "model_tokens": {"model_a": [[52805, " scaling", "normal", 0.0007733011734671891]], "model_b": [[52805, " scaling", "normal", 0.0009920340962707996]]}, "loss": {"model_a": 16.131697478690068, "model_b": 15.568144728342816}, "topk": {"model_a": [52805, 56, 0.0007733011734671891, [[52195, 0.464863, " massive", false], [63370, 0.173622, " computation", false], [59988, 0.040389, " massively", false], [38888, 0.034736, " lever", false], [22590, 0.032136, " the", false], [51832, 0.020182, " general", false], [47202, 0.017789, " search", false], [31458, 0.01221, " more", false], [332, 0.011054, " a", false], [31466, 0.009629, " much", false]]], "model_b": [52805, 69, 0.0009920340962707996, [[52195, 0.302584, " massive", false], [51832, 0.087174, " general", false], [38888, 0.059777, " lever", false], [56537, 0.057654, " learning", false], [22590, 0.054307, " the", false], [63370, 0.027445, " computation", false], [332, 0.023829, " a", false], [30597, 0.0167, " deep", false], [59346, 0.015604, " computing", false], [65135, 0.015323, " generalization", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08410494389819982}, {"byte_start": 5500, "byte_end": 5512, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 947, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02%", "model_b": "3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.506813108921051]], "model_b": [[63370, " computation", "normal", 0.09871537983417511]]}, "loss": {"model_a": 1.0155690188549422, "model_b": 3.4752419604747162}, "topk": {"model_a": [63370, 1, 0.506813108921051, [[63370, 0.506813, " computation", false], [4833, 0.248318, " up", false], [21265, 0.047897, " and", false], [45, 0.025378, ",", false], [52195, 0.020054, " massive", false], [47, 0.014108, ".", false], [4706, 0.012979, " of", false], [64862, 0.011904, " computational", false], [22590, 0.010527, " the", false], [46, 0.006845, "-", false]]], "model_b": [63370, 2, 0.09871537983417511, [[4833, 0.356973, " up", false], [63370, 0.098715, " computation", false], [30678, 0.066451, " down", false], [22590, 0.051615, " the", false], [21265, 0.046685, " and", false], [47, 0.030088, ".", false], [46, 0.025252, "-", false], [45, 0.023831, ",", false], [4811, 0.01922, " to", false], [30218, 0.014933, " back", false]]]}, "raw_delta": -0.1363932291666667, "tuned_delta": -0.08353828526846689}, {"byte_start": 5512, "byte_end": 5515, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 948, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "26.67% 26.67% 26.67%", "model_b": "27.80% 27.80% 27.80%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.011968706734478474]], "model_b": [[4450, " by", "normal", 0.009829221293330193]]}, "loss": {"model_a": 26.67483018310323, "model_b": 27.80193568379773}, "topk": {"model_a": [4450, 11, 0.011968706734478474, [[21265, 0.309914, " and", false], [47, 0.238352, ".", false], [45, 0.142668, ",", false], [4811, 0.059102, " to", false], [275, 0.025202, " (", false], [4833, 0.023403, " up", false], [47001, 0.020411, " rather", false], [4596, 0.018678, " in", false], [5346, 0.017122, "---", false], [4715, 0.013533, " or", false]]], "model_b": [4450, 13, 0.009829221293330193, [[47, 0.319527, ".", false], [21265, 0.203658, " and", false], [45, 0.12133, ",", false], [4811, 0.052727, " to", false], [47001, 0.033987, " rather", false], [4833, 0.031188, " up", false], [32487, 0.019978, " with", false], [4596, 0.019771, " in", false], [275, 0.019609, " (", false], [30678, 0.017582, " down", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 5515, "byte_end": 5522, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 949, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%", "model_b": "14.49% 14.49% 14.49% 14.49% 14.49% 14.49% 14.49%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.01159964594990015]], "model_b": [[47202, " search", "normal", 0.003589645028114319]]}, "loss": {"model_a": 11.512577614236704, "model_b": 14.49135643750075}, "topk": {"model_a": [47202, 11, 0.01159964594990015, [[37045, 0.257139, " Moore", false], [52195, 0.22534, " massive", false], [59988, 0.070571, " massively", false], [332, 0.06206, " a", false], [38888, 0.047516, " lever", false], [40085, 0.027166, " using", false], [22590, 0.018027, " the", false], [38989, 0.013977, " means", false], [4419, 0.013775, " an", false], [51832, 0.012269, " general", false]]], "model_b": [47202, 31, 0.003589645028114319, [[52195, 0.133972, " massive", false], [38888, 0.10828, " lever", false], [38989, 0.091481, " means", false], [332, 0.086192, " a", false], [22590, 0.064938, " the", false], [59988, 0.033708, " massively", false], [47497, 0.02664, " taking", false], [51832, 0.018934, " general", false], [37045, 0.017494, " Moore", false], [55531, 0.015809, " applying", false]]]}, "raw_delta": -0.16517857142857148, "tuned_delta": -0.11232362753037166}, {"byte_start": 5522, "byte_end": 5526, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 950, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.24% 4.24% 4.24% 4.24%", "model_b": "7.33% 7.33% 7.33% 7.33%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.3881458044052124]], "model_b": [[21265, " and", "normal", 0.19632764160633087]]}, "loss": {"model_a": 4.244256651052736, "model_b": 7.326185754514267}, "topk": {"model_a": [21265, 2, 0.3881458044052124, [[4715, 0.405685, " or", false], [21265, 0.388146, " and", false], [45, 0.087593, ",", false], [47, 0.050044, ".", false], [275, 0.025062, " (", false], [48, 0.008715, "/", false], [5346, 0.005305, "---", false], [4596, 0.004761, " in", false], [52224, 0.00218, " methods", false], [4811, 0.001786, " to", false]]], "model_b": [21265, 2, 0.19632764160633087, [[47, 0.34322, ".", false], [21265, 0.196328, " and", false], [45, 0.142498, ",", false], [4715, 0.108907, " or", false], [275, 0.028384, " (", false], [46, 0.027679, "-", false], [47001, 0.021832, " rather", false], [4596, 0.013271, " in", false], [52028, 0.012299, " instead", false], [52224, 0.01129, " methods", false]]]}, "raw_delta": -0.1708984375, "tuned_delta": -0.11804349360180018}, {"byte_start": 5526, "byte_end": 5535, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 951, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98%", "model_b": "1.61% 1.61% 1.61% 1.61% 1.61% 1.61% 1.61% 1.61% 1.61%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.6158739328384399]], "model_b": [[56537, " learning", "normal", 0.4473676085472107]]}, "loss": {"model_a": 0.9823037523413893, "model_b": 1.6123870357157468}, "topk": {"model_a": [56537, 1, 0.6158739328384399, [[56537, 0.615874, " learning", false], [48, 0.153189, "/", false], [4450, 0.078845, " by", false], [38888, 0.021924, " lever", false], [31978, 0.016814, " self", false], [62577, 0.008849, " statistics", false], [63885, 0.008646, " statistical", false], [56540, 0.006704, " leverage", false], [45, 0.006627, ",", false], [22590, 0.005086, " the", false]]], "model_b": [56537, 1, 0.4473676085472107, [[56537, 0.447368, " learning", false], [38888, 0.100571, " lever", false], [65135, 0.059654, " generalization", false], [4450, 0.054201, " by", false], [51832, 0.029917, " general", false], [30597, 0.022367, " deep", false], [48, 0.014097, "/", false], [39193, 0.013869, " other", false], [22590, 0.012718, " the", false], [40085, 0.011187, " using", false]]]}, "raw_delta": -0.03493923611111111, "tuned_delta": 0.01791570778708871}, {"byte_start": 5535, "byte_end": 5536, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "9.79%", "model_b": "9.65%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5853410959243774]], "model_b": [[47, ".", "normal", 0.5882070064544678]]}, "loss": {"model_a": 9.79172903728349, "model_b": 9.650840849696678}, "topk": {"model_a": [47, 1, 0.5853410959243774, [[47, 0.585341, ".", false], [45, 0.18044, ",", false], [5346, 0.051295, "---", false], [4450, 0.040386, " by", false], [21265, 0.026637, " and", false], [275, 0.019486, " (", false], [4596, 0.010836, " in", false], [4811, 0.008063, " to", false], [47001, 0.006385, " rather", false], [30917, 0.006127, " from", false]]], "model_b": [47, 1, 0.5882070064544678, [[47, 0.588207, ".", false], [45, 0.125995, ",", false], [4450, 0.071512, " by", false], [4712, 0.044546, " on", false], [4596, 0.024752, " in", false], [275, 0.013975, " (", false], [21265, 0.012848, " and", false], [4811, 0.011858, " to", false], [5346, 0.007518, "---", false], [32487, 0.005509, " with", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06066744389819982}, {"byte_start": 5536, "byte_end": 5540, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 952, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "11.41% 11.41% 11.41% 11.41%", "model_b": "10.36% 10.36% 10.36% 10.36%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.0790608823299408]], "model_b": [[20996, " The", "normal", 0.10263341665267944]]}, "loss": {"model_a": 11.411943194531839, "model_b": 10.355281787630743}, "topk": {"model_a": [20996, 2, 0.0790608823299408, [[261, 0.521215, "\n\n", false], [20996, 0.079061, " The", false], [29894, 0.04304, " This", false], [267, 0.038361, "  ", false], [4331, 0.032199, " We", false], [3918, 0.018546, " It", false], [3913, 0.017925, " In", false], [37453, 0.016501, " These", false], [0, 0.012201, "[0]", false], [3336, 0.009944, " \n\n", false]]], "model_b": [20996, 2, 0.10263341665267944, [[261, 0.302991, "\n\n", false], [20996, 0.102633, " The", false], [29894, 0.074797, " This", false], [267, 0.048001, "  ", false], [3913, 0.031745, " In", false], [11, 0.030649, "\n", false], [37453, 0.028891, " These", false], [3918, 0.02559, " It", false], [4331, 0.024429, " We", false], [19417, 0.014607, " And", false]]]}, "raw_delta": 0.05859375, "tuned_delta": 0.11144869389819982}, {"byte_start": 5540, "byte_end": 5549, "display": {"text": " eventual", "kind": "normal"}, "is_word": true, "word_id": 953, "word_key": " eventual", "bytes_hex": "20 65 76 65 6e 74 75 61 6c", "compression": {"model_a": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%", "model_b": "17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28%"}, "model_tokens": {"model_a": [[56154, " eventual", "normal", 0.0002810857549775392]], "model_b": [[56154, " eventual", "normal", 0.00017978671530727297]]}, "loss": {"model_a": 16.405646732331093, "model_b": 17.282284343982372}, "topk": {"model_a": [56154, 327, 0.0002810857549775392, [[45315, 0.238854, " bitter", false], [46430, 0.106555, " lesson", false], [45184, 0.022033, " appeal", false], [47009, 0.021458, " reason", false], [21952, 0.018025, " key", false], [52127, 0.017397, " lessons", false], [31461, 0.012533, " most", false], [38499, 0.010843, " first", false], [31581, 0.010621, " only", false], [21357, 0.010474, " big", false]]], "model_b": [56154, 379, 0.00017978671530727297, [[45315, 0.513794, " bitter", false], [46430, 0.014808, " lesson", false], [61640, 0.013501, " bitterness", false], [31461, 0.011341, " most", false], [21952, 0.011107, " key", false], [31581, 0.01007, " only", false], [38499, 0.008863, " first", false], [52127, 0.008118, " lessons", false], [21357, 0.007025, " big", false], [38720, 0.006903, " human", false]]]}, "raw_delta": -0.04861111111111116, "tuned_delta": 0.004243832787088661}, {"byte_start": 5549, "byte_end": 5557, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 954, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"model_a": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%", "model_b": "7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"model_a": [[53052, " success", "normal", 0.13621331751346588]], "model_b": [[53052, " success", "normal", 0.0381464846432209]]}, "loss": {"model_a": 4.490810979329659, "model_b": 7.361407801410969}, "topk": {"model_a": [53052, 1, 0.13621331751346588, [[53052, 0.136213, " success", false], [64266, 0.073289, " breakthrough", false], [57260, 0.038315, " solution", false], [53198, 0.033041, " triumph", false], [47798, 0.029689, " winner", false], [7933, 0.027677, "ity", false], [56950, 0.022749, " progress", false], [53283, 0.020035, " victory", false], [46430, 0.018792, " lesson", false], [52382, 0.014881, " outcome", false]]], "model_b": [53052, 4, 0.0381464846432209, [[47798, 0.161343, " winner", false], [46430, 0.081783, " lesson", false], [47092, 0.076889, " result", false], [53052, 0.038146, " success", false], [52382, 0.028275, " outcome", false], [53353, 0.02573, " winners", false], [64266, 0.023792, " breakthrough", false], [53283, 0.020265, " victory", false], [53198, 0.018395, " triumph", false], [31637, 0.018244, " path", false]]]}, "raw_delta": -0.1591796875, "tuned_delta": -0.10632474360180018}, {"byte_start": 5557, "byte_end": 5560, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 955, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "17.56% 17.56% 17.56%", "model_b": "16.91% 16.91% 16.91%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.05434781312942505]], "model_b": [[4600, " is", "normal", 0.059561144560575485]]}, "loss": {"model_a": 17.564060719156, "model_b": 16.90658251041754}, "topk": {"model_a": [4600, 2, 0.05434781312942505, [[4706, 0.793597, " of", false], [4600, 0.054348, " is", false], [4596, 0.030627, " in", false], [38087, 0.012735, " comes", false], [45, 0.007767, ",", false], [32475, 0.006353, " will", false], [51434, 0.006353, " depends", false], [21800, 0.005113, " has", false], [4450, 0.004919, " by", false], [22748, 0.004699, " was", false]]], "model_b": [4600, 2, 0.059561144560575485, [[4706, 0.711358, " of", false], [4600, 0.059561, " is", false], [4596, 0.048818, " in", false], [38087, 0.020594, " comes", false], [4715, 0.019867, " or", false], [39831, 0.012078, " story", false], [45, 0.011101, ",", false], [51434, 0.009026, " depends", false], [21265, 0.008624, " and", false], [32475, 0.008168, " will", false]]]}, "raw_delta": 0.03645833333333337, "tuned_delta": 0.08931327723153319}, {"byte_start": 5560, "byte_end": 5565, "display": {"text": " ting", "kind": "normal"}, "is_word": true, "word_id": 956, "word_key": " ting", "bytes_hex": "20 74 69 6e 67", "compression": {"model_a": "48.92% 48.92% 48.92% 48.92% 48.92%", "model_b": "48.24% 48.24% 48.24% 48.24% 48.24%"}, "model_tokens": {"model_a": [[32252, " ting", "normal", 1.2540949683170766e-06]], "model_b": [[32252, " ting", "normal", 1.5756770608277293e-06]]}, "loss": {"model_a": 48.91637873014141, "model_b": 48.2401154297247}, "topk": {"model_a": [32252, 4482, 1.2540949683170766e-06, [[22187, 0.136674, " not", false], [37810, 0.12397, " based", false], [45150, 0.077698, " always", false], [21572, 0.052864, " due", false], [332, 0.044098, " a", false], [22590, 0.036062, " the", false], [62109, 0.020334, " inevitable", false], [62046, 0.017329, " guaranteed", false], [4596, 0.015407, " in", false], [39171, 0.014764, " often", false]]], "model_b": [32252, 3951, 1.5756770608277293e-06, [[22187, 0.145104, " not", false], [22590, 0.091116, " the", false], [332, 0.083791, " a", false], [37810, 0.074785, " based", false], [21572, 0.068347, " due", false], [32227, 0.038097, " that", false], [45150, 0.021523, " always", false], [39171, 0.018907, " often", false], [4596, 0.018725, " in", false], [61853, 0.015816, " determined", false]]]}, "raw_delta": 0.03750000000000009, "tuned_delta": 0.09035494389819991}, {"byte_start": 5565, "byte_end": 5567, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 957, "word_key": "ed", "bytes_hex": "65 64", "compression": {"model_a": "0.01% 0.01%", "model_b": "0.03% 0.03%"}, "model_tokens": {"model_a": [[1843, "ed", "normal", 0.9994370341300964]], "model_b": [[1843, "ed", "normal", 0.996370792388916]]}, "loss": {"model_a": 0.005090686465539135, "model_b": 0.032883082844969005}, "topk": {"model_a": [1843, 1, 0.9994370341300964, [[1843, 0.999437, "ed", false], [1858, 9.5e-05, "es", false], [8067, 9e-05, "led", false], [25206, 8.5e-05, "eing", false], [7856, 6.7e-05, "ing", false], [102, 6.6e-05, "e", false], [2030, 2e-05, "ly", false], [101, 1.7e-05, "d", false], [26151, 1.6e-05, "ling", false], [7612, 1.3e-05, "ged", false]]], "model_b": [1843, 1, 0.996370792388916, [[1843, 0.996371, "ed", false], [8067, 0.000667, "led", false], [2030, 0.000592, "ly", false], [1858, 0.000545, "es", false], [102, 0.000469, "e", false], [26151, 0.000315, "ling", false], [7856, 0.00027, "ing", false], [25206, 0.000205, "eing", false], [34780, 9.1e-05, "ingly", false], [25195, 8.1e-05, "edly", false]]]}, "raw_delta": -0.0015411376953125, "tuned_delta": 0.05131380620288732}, {"byte_start": 5567, "byte_end": 5572, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 958, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "0.51% 0.51% 0.51% 0.51% 0.51%", "model_b": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.8696205019950867]], "model_b": [[32487, " with", "normal", 0.8236837387084961]]}, "loss": {"model_a": 0.5071974753125261, "model_b": 0.6973965285547234}, "topk": {"model_a": [32487, 1, 0.8696205019950867, [[32487, 0.869621, " with", false], [4450, 0.095439, " by", false], [45, 0.010596, ",", false], [4596, 0.007593, " in", false], [57263, 0.002091, " somewhat", false], [332, 0.002023, " a", false], [57245, 0.00126, " slightly", false], [22187, 0.000919, " not", false], [4706, 0.000762, " of", false], [30322, 0.000757, " both", false]]], "model_b": [32487, 1, 0.8236837387084961, [[32487, 0.823684, " with", false], [4450, 0.127868, " by", false], [45, 0.010039, ",", false], [4596, 0.008854, " in", false], [31458, 0.002661, " more", false], [22187, 0.002222, " not", false], [21265, 0.002126, " and", false], [21400, 0.001696, " but", false], [4706, 0.001376, " of", false], [4424, 0.001305, " at", false]]]}, "raw_delta": -0.010546875, "tuned_delta": 0.042308068898199824}, {"byte_start": 5572, "byte_end": 5583, "display": {"text": " bitterness", "kind": "normal"}, "is_word": true, "word_id": 959, "word_key": " bitterness", "bytes_hex": "20 62 69 74 74 65 72 6e 65 73 73", "compression": {"model_a": "3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97%", "model_b": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"model_a": [[61640, " bitterness", "normal", 0.08698030561208725]], "model_b": [[61640, " bitterness", "normal", 0.05831221863627434]]}, "loss": {"model_a": 3.9704852865374525, "model_b": 4.662118207418171}, "topk": {"model_a": [61640, 3, 0.08698030561208725, [[332, 0.148571, " a", false], [22590, 0.114089, " the", false], [61640, 0.08698, " bitterness", false], [45315, 0.086031, " bitter", false], [52793, 0.080018, " sadness", false], [47048, 0.056889, " regret", false], [65126, 0.051745, " disappointment", false], [53178, 0.046122, " tragedy", false], [38805, 0.043396, " irony", false], [63588, 0.024788, " frustration", false]]], "model_b": [61640, 4, 0.05831221863627434, [[332, 0.125423, " a", false], [22590, 0.11137, " the", false], [65126, 0.092464, " disappointment", false], [61640, 0.058312, " bitterness", false], [45315, 0.055581, " bitter", false], [63588, 0.053278, " frustration", false], [38805, 0.031247, " irony", false], [57361, 0.022622, " surprise", false], [47048, 0.019798, " regret", false], [52793, 0.017912, " sadness", false]]]}, "raw_delta": -0.03835227272727273, "tuned_delta": 0.014502671170927094}, {"byte_start": 5583, "byte_end": 5584, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "18.17%", "model_b": "17.47%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.36312466859817505]], "model_b": [[45, ",", "normal", 0.3822399377822876]]}, "loss": {"model_a": 18.174576198698855, "model_b": 17.47013526076479}, "topk": {"model_a": [45, 1, 0.36312466859817505, [[45, 0.363125, ",", false], [51018, 0.190955, " because", false], [21700, 0.114388, " for", false], [47, 0.0559, ".", false], [21265, 0.031092, " and", false], [5346, 0.030827, "---", false], [4423, 0.028048, " as", false], [32227, 0.025004, " that", false], [4596, 0.022121, " in", false], [59, 0.015739, ":", false]]], "model_b": [45, 1, 0.3822399377822876, [[45, 0.38224, ",", false], [47, 0.158381, ".", false], [51018, 0.063661, " because", false], [21700, 0.062245, " for", false], [21265, 0.058761, " and", false], [4596, 0.045561, " in", false], [4811, 0.03516, " to", false], [4450, 0.024117, " by", false], [32465, 0.021822, " when", false], [4423, 0.019755, " as", false]]]}, "raw_delta": 0.0390625, "tuned_delta": 0.09191744389819982}, {"byte_start": 5584, "byte_end": 5588, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 960, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "12.47% 12.47% 12.47% 12.47%", "model_b": "7.43% 7.43% 7.43% 7.43%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.06259933114051819]], "model_b": [[21265, " and", "normal", 0.19467103481292725]]}, "loss": {"model_a": 12.468604601432935, "model_b": 7.431851895204376}, "topk": {"model_a": [21265, 4, 0.06259933114051819, [[21400, 0.3183, " but", false], [51018, 0.254542, " because", false], [4423, 0.162206, " as", false], [21265, 0.062599, " and", false], [21700, 0.028915, " for", false], [4596, 0.021036, " in", false], [39690, 0.014661, " since", false], [22187, 0.01433, " not", false], [22590, 0.008579, " the", false], [40186, 0.008041, " which", false]]], "model_b": [21265, 2, 0.19467103481292725, [[21400, 0.309089, " but", false], [21265, 0.194671, " and", false], [4423, 0.103634, " as", false], [51018, 0.090012, " because", false], [4596, 0.019912, " in", false], [22187, 0.019857, " not", false], [40186, 0.018416, " which", false], [21700, 0.018235, " for", false], [30788, 0.013888, " even", false], [39690, 0.013328, " since", false]]]}, "raw_delta": 0.279296875, "tuned_delta": 0.33215181889819984}, {"byte_start": 5588, "byte_end": 5594, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 961, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"model_a": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93%", "model_b": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%"}, "model_tokens": {"model_a": [[39171, " often", "normal", 0.006934772711247206]], "model_b": [[39171, " often", "normal", 0.016824999824166298]]}, "loss": {"model_a": 14.934147884202158, "model_b": 12.30423504924832}, "topk": {"model_a": [39171, 21, 0.006934772711247206, [[22590, 0.172366, " the", false], [4601, 0.081691, " it", false], [4600, 0.064422, " is", false], [4858, 0.062589, " we", false], [32234, 0.049779, " this", false], [32227, 0.030264, " that", false], [63843, 0.023091, " researchers", false], [39934, 0.020607, " there", false], [4788, 0.019624, " so", false], [332, 0.018626, " a", false]]], "model_b": [39171, 10, 0.016824999824166298, [[22590, 0.151424, " the", false], [4600, 0.088762, " is", false], [4601, 0.076661, " it", false], [32234, 0.057752, " this", false], [4858, 0.032, " we", false], [32227, 0.023666, " that", false], [4596, 0.02173, " in", false], [332, 0.020934, " a", false], [39934, 0.018658, " there", false], [39171, 0.016825, " often", false]]]}, "raw_delta": 0.14583333333333337, "tuned_delta": 0.1986882772315332}, {"byte_start": 5594, "byte_end": 5605, "display": {"text": " incomplete", "kind": "normal"}, "is_word": true, "word_id": 962, "word_key": " incomplete", "bytes_hex": "20 69 6e 63 6f 6d 70 6c 65 74 65", "compression": {"model_a": "12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71%", "model_b": "13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32%"}, "model_tokens": {"model_a": [[62091, " incomplete", "normal", 0.00043250687303952873]], "model_b": [[62091, " incomplete", "normal", 0.00029930341406725347]]}, "loss": {"model_a": 12.70555291691985, "model_b": 13.32033773548048}, "topk": {"model_a": [62091, 225, 0.00043250687303952873, [[32487, 0.07944, " with", false], [22590, 0.070365, " the", false], [56501, 0.050676, " involves", false], [4600, 0.030867, " is", false], [4601, 0.027651, " it", false], [332, 0.025977, " a", false], [39934, 0.022004, " there", false], [38875, 0.021249, " leads", false], [38087, 0.020175, " comes", false], [39620, 0.019435, " seems", false]]], "model_b": [62091, 390, 0.00029930341406725347, [[32487, 0.125947, " with", false], [22590, 0.059558, " the", false], [4600, 0.032461, " is", false], [332, 0.023696, " a", false], [38087, 0.018386, " comes", false], [45, 0.015497, ",", false], [4601, 0.013173, " it", false], [21800, 0.012828, " has", false], [63250, 0.012512, " accompanied", false], [22187, 0.012352, " not", false]]]}, "raw_delta": -0.03409090909090906, "tuned_delta": 0.01876403480729076}, {"byte_start": 5605, "byte_end": 5607, "display": {"text": "ly", "kind": "normal"}, "is_word": true, "word_id": 963, "word_key": "ly", "bytes_hex": "6c 79", "compression": {"model_a": "13.53% 13.53%", "model_b": "22.26% 22.26%"}, "model_tokens": {"model_a": [[2030, "ly", "normal", 0.22152046859264374]], "model_b": [[2030, "ly", "normal", 0.08574552834033966]]}, "loss": {"model_a": 13.52526600833403, "model_b": 22.260333638716425}, "topk": {"model_a": [2030, 2, 0.22152046859264374, [[45, 0.289447, ",", false], [2030, 0.22152, "ly", false], [47, 0.077258, ".", false], [53052, 0.045553, " success", false], [21265, 0.042107, " and", false], [4596, 0.033969, " in", false], [65034, 0.033694, " understanding", false], [4715, 0.02749, " or", false], [64561, 0.02495, " satisfaction", false], [26307, 0.017007, "ness", false]]], "model_b": [2030, 4, 0.08574552834033966, [[45, 0.194161, ",", false], [47, 0.191433, ".", false], [65034, 0.122689, " understanding", false], [2030, 0.085746, "ly", false], [59943, 0.056563, " knowledge", false], [21265, 0.041037, " and", false], [4715, 0.040282, " or", false], [26307, 0.038381, "ness", false], [53052, 0.025824, " success", false], [4596, 0.009793, " in", false]]]}, "raw_delta": -0.484375, "tuned_delta": -0.43152005610180016}, {"byte_start": 5607, "byte_end": 5614, "display": {"text": " digest", "kind": "normal"}, "is_word": true, "word_id": 964, "word_key": " digest", "bytes_hex": "20 64 69 67 65 73 74", "compression": {"model_a": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47%", "model_b": "22.86% 22.86% 22.86% 22.86% 22.86% 22.86% 22.86%"}, "model_tokens": {"model_a": [[45746, " digest", "normal", 0.0011289140675216913]], "model_b": [[45746, " digest", "normal", 0.00014032830949872732]]}, "loss": {"model_a": 17.47013526076479, "model_b": 22.864140156945616}, "topk": {"model_a": [45746, 38, 0.0011289140675216913, [[62684, 0.486927, " understood", false], [63289, 0.247998, " appreciated", false], [62438, 0.054035, " recognized", false], [64238, 0.026, " acknowledged", false], [55428, 0.015443, " accepted", false], [57027, 0.012789, " realized", false], [38625, 0.008919, " grasp", false], [56098, 0.006516, " embraced", false], [52112, 0.006507, " learned", false], [59684, 0.00555, " explained", false]]], "model_b": [45746, 217, 0.00014032830949872732, [[62684, 0.494364, " understood", false], [59684, 0.167814, " explained", false], [59938, 0.062414, " justified", false], [63289, 0.023993, " appreciated", false], [56178, 0.012564, " explains", false], [62438, 0.007986, " recognized", false], [59488, 0.007929, " described", false], [64290, 0.006609, " communicated", false], [61618, 0.006546, " attributed", false], [21265, 0.005743, " and", false]]]}, "raw_delta": -0.2991071428571428, "tuned_delta": -0.24625219895894296}, {"byte_start": 5614, "byte_end": 5616, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 965, "word_key": "ed", "bytes_hex": "65 64", "compression": {"model_a": "0.03% 0.03%", "model_b": "0.16% 0.16%"}, "model_tokens": {"model_a": [[1843, "ed", "normal", 0.9963731169700623]], "model_b": [[1843, "ed", "normal", 0.982073187828064]]}, "loss": {"model_a": 0.03274549672427876, "model_b": 0.1629019668972523}, "topk": {"model_a": [1843, 1, 0.9963731169700623, [[1843, 0.996373, "ed", false], [25656, 0.00309, "ible", false], [7856, 0.000154, "ing", false], [116, 0.000141, "s", false], [24381, 7.9e-05, "able", false], [45, 2.3e-05, ",", false], [47, 1.8e-05, ".", false], [7779, 1.1e-05, "ied", false], [4450, 8e-06, " by", false], [46, 5e-06, "-", false]]], "model_b": [1843, 1, 0.982073187828064, [[1843, 0.982073, "ed", false], [25656, 0.015343, "ible", false], [7856, 0.000839, "ing", false], [24381, 0.000793, "able", false], [116, 0.000464, "s", false], [47, 0.000116, ".", false], [45, 6.2e-05, ",", false], [101, 2.1e-05, "d", false], [49224, 1.8e-05, "ibility", false], [4450, 1.8e-05, " by", false]]]}, "raw_delta": -0.0072174072265625, "tuned_delta": 0.04563753667163732}, {"byte_start": 5616, "byte_end": 5617, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "17.89%", "model_b": "30.57%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.3699078857898712]], "model_b": [[45, ",", "normal", 0.1826041042804718]]}, "loss": {"model_a": 17.892799823525227, "model_b": 30.572736706338382}, "topk": {"model_a": [45, 1, 0.3699078857898712, [[45, 0.369908, ",", false], [4450, 0.25617, " by", false], [47, 0.187156, ".", false], [4596, 0.021318, " in", false], [5346, 0.019447, "---", false], [21265, 0.017328, " and", false], [32465, 0.012849, " when", false], [4424, 0.010761, " at", false], [4423, 0.010698, " as", false], [40076, 0.010527, " until", false]]], "model_b": [45, 3, 0.1826041042804718, [[47, 0.400301, ".", false], [4450, 0.22053, " by", false], [45, 0.182604, ",", false], [21265, 0.036468, " and", false], [4596, 0.024431, " in", false], [4715, 0.014967, " or", false], [4423, 0.00813, " as", false], [31162, 0.007758, " into", false], [21700, 0.006634, " for", false], [40076, 0.006518, " until", false]]]}, "raw_delta": -0.703125, "tuned_delta": -0.6502700561018002}, {"byte_start": 5617, "byte_end": 5625, "display": {"text": " because", "kind": "normal"}, "is_word": true, "word_id": 966, "word_key": " because", "bytes_hex": "20 62 65 63 61 75 73 65", "compression": {"model_a": "3.68% 3.68% 3.68% 3.68% 3.68% 3.68% 3.68% 3.68%", "model_b": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[51018, " because", "normal", 0.19626040756702423]], "model_b": [[51018, " because", "normal", 0.13597191870212555]]}, "loss": {"model_a": 3.6807039007054847, "model_b": 4.490810979329659}, "topk": {"model_a": [51018, 2, 0.19626040756702423, [[21400, 0.363875, " but", false], [51018, 0.19626, " because", false], [4423, 0.098155, " as", false], [4450, 0.063619, " by", false], [21265, 0.046131, " and", false], [21700, 0.028844, " for", false], [4788, 0.019426, " so", false], [4596, 0.017545, " in", false], [32465, 0.016342, " when", false], [40076, 0.015883, " until", false]]], "model_b": [51018, 2, 0.13597191870212555, [[21400, 0.247077, " but", false], [51018, 0.135972, " because", false], [21265, 0.103139, " and", false], [4423, 0.096299, " as", false], [4450, 0.066969, " by", false], [21700, 0.05063, " for", false], [4596, 0.03065, " in", false], [32465, 0.019228, " when", false], [30788, 0.016087, " even", false], [39690, 0.013466, " since", false]]]}, "raw_delta": -0.044921875, "tuned_delta": 0.007933068898199822}, {"byte_start": 5625, "byte_end": 5628, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 967, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "10.28% 10.28% 10.28%", "model_b": "12.68% 12.68% 12.68%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.18280662596225739]], "model_b": [[4601, " it", "normal", 0.12248010188341141]]}, "loss": {"model_a": 10.284837693837336, "model_b": 12.679936882813154}, "topk": {"model_a": [4601, 2, 0.18280662596225739, [[22590, 0.334214, " the", false], [4601, 0.182807, " it", false], [4706, 0.088665, " of", false], [4858, 0.086721, " we", false], [63843, 0.047622, " researchers", false], [284, 0.01928, " 1", false], [39934, 0.015671, " there", false], [46787, 0.011049, " people", false], [4596, 0.009968, " in", false], [32234, 0.009265, " this", false]]], "model_b": [4601, 2, 0.12248010188341141, [[22590, 0.392797, " the", false], [4601, 0.12248, " it", false], [4706, 0.092981, " of", false], [4858, 0.043238, " we", false], [63843, 0.02567, " researchers", false], [39934, 0.020438, " there", false], [3609, 0.014837, " AI", false], [32234, 0.014827, " this", false], [39936, 0.011932, " these", false], [31461, 0.011845, " most", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07995755610180018}, {"byte_start": 5628, "byte_end": 5631, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 968, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "6.95% 6.95% 6.95%", "model_b": "4.91% 4.91% 4.91%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.31223273277282715]], "model_b": [[4600, " is", "normal", 0.4421278238296509]]}, "loss": {"model_a": 6.9504839209494325, "model_b": 4.907605200940647}, "topk": {"model_a": [4600, 1, 0.31223273277282715, [[4600, 0.312233, " is", false], [30659, 0.062437, " does", false], [22748, 0.055203, " was", false], [21800, 0.035783, " has", false], [38087, 0.034546, " comes", false], [56501, 0.034423, " involves", false], [39888, 0.030581, " takes", false], [39620, 0.024533, " seems", false], [57102, 0.024395, " requires", false], [31908, 0.015982, " runs", false]]], "model_b": [4600, 1, 0.4421278238296509, [[4600, 0.442128, " is", false], [30659, 0.067042, " does", false], [22748, 0.06235, " was", false], [39888, 0.032855, " takes", false], [21800, 0.025947, " has", false], [38087, 0.025394, " comes", false], [39620, 0.013348, " seems", false], [39115, 0.011137, " never", false], [56501, 0.010485, " involves", false], [45409, 0.010477, " cannot", false]]]}, "raw_delta": 0.11328125, "tuned_delta": 0.16613619389819984}, {"byte_start": 5631, "byte_end": 5639, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 969, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"model_a": "22.26% 22.26% 22.26% 22.26% 22.26% 22.26% 22.26% 22.26%", "model_b": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"model_a": [[53052, " success", "normal", 5.223894913797267e-05]], "model_b": [[53052, " success", "normal", 2.5472303605056368e-05]]}, "loss": {"model_a": 22.260333638716425, "model_b": 23.810103702171368}, "topk": {"model_a": [53052, 716, 5.223894913797267e-05, [[22187, 0.138884, " not", false], [4788, 0.100169, " so", false], [332, 0.077669, " a", false], [31048, 0.061809, " hard", false], [45315, 0.051675, " bitter", false], [22590, 0.044962, " the", false], [51336, 0.03983, " counter", false], [37810, 0.030901, " based", false], [59516, 0.026859, " difficult", false], [31968, 0.024107, " seen", false]]], "model_b": [53052, 1256, 2.5472303605056368e-05, [[22187, 0.249272, " not", false], [332, 0.077311, " a", false], [22590, 0.04709, " the", false], [31048, 0.044452, " hard", false], [4788, 0.039108, " so", false], [37810, 0.039034, " based", false], [22614, 0.029452, " too", false], [4419, 0.020179, " an", false], [59516, 0.017842, " difficult", false], [39115, 0.015624, " never", false]]]}, "raw_delta": -0.0859375, "tuned_delta": -0.03308255610180018}, {"byte_start": 5639, "byte_end": 5644, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 970, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "23.11% 23.11% 23.11% 23.11% 23.11%", "model_b": "17.92% 17.92% 17.92% 17.92% 17.92%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.001631698221899569]], "model_b": [[31601, " over", "normal", 0.006983359344303608]]}, "loss": {"model_a": 23.1056627642373, "model_b": 17.92097746104259}, "topk": {"model_a": [31601, 43, 0.001631698221899569, [[37810, 0.15397, " based", false], [32227, 0.119726, " that", false], [4596, 0.075271, " in", false], [4450, 0.07065, " by", false], [37634, 0.05486, " after", false], [4424, 0.041355, " at", false], [37924, 0.036753, " built", false], [55437, 0.034989, " achieved", false], [50870, 0.034904, " against", false], [31581, 0.034077, " only", false]]], "model_b": [31601, 21, 0.006983359344303608, [[32227, 0.177777, " that", false], [4596, 0.166345, " in", false], [37810, 0.095687, " based", false], [4712, 0.050553, " on", false], [4450, 0.049588, " by", false], [4424, 0.046085, " at", false], [4600, 0.037017, " is", false], [4706, 0.031531, " of", false], [21700, 0.018705, " for", false], [45, 0.017446, ",", false]]]}, "raw_delta": 0.2875, "tuned_delta": 0.3403549438981998}, {"byte_start": 5644, "byte_end": 5646, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 971, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "11.76% 11.76%", "model_b": "10.64% 10.64%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.2699261009693146]], "model_b": [[332, " a", "normal", 0.3095007538795471]]}, "loss": {"model_a": 11.76416366349887, "model_b": 10.637058162804367}, "topk": {"model_a": [332, 1, 0.2699261009693146, [[332, 0.269926, " a", false], [22590, 0.17514, " the", false], [38720, 0.06638, " human", false], [4419, 0.053975, " an", false], [60522, 0.024599, " something", false], [32464, 0.023522, " what", false], [32251, 0.022729, " time", false], [59943, 0.017814, " knowledge", false], [51396, 0.015432, " decades", false], [22248, 0.013415, " our", false]]], "model_b": [332, 1, 0.3095007538795471, [[332, 0.309501, " a", false], [22590, 0.157754, " the", false], [32251, 0.069427, " time", false], [4419, 0.042261, " an", false], [21265, 0.020543, " and", false], [31370, 0.019521, " many", false], [40186, 0.017869, " which", false], [51396, 0.015695, " decades", false], [40237, 0.015634, " years", false], [60522, 0.013249, " something", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 5646, "byte_end": 5654, "display": {"text": " favored", "kind": "normal"}, "is_word": true, "word_id": 972, "word_key": " favored", "bytes_hex": "20 66 61 76 6f 72 65 64", "compression": {"model_a": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "model_b": "25.36% 25.36% 25.36% 25.36% 25.36% 25.36% 25.36% 25.36%"}, "model_tokens": {"model_a": [[51722, " favored", "normal", 2.4341365133295767e-05]], "model_b": [[51722, " favored", "normal", 1.3200866305851378e-05]]}, "loss": {"model_a": 23.95099188975818, "model_b": 25.359873765626308}, "topk": {"model_a": [51722, 1063, 2.4341365133295767e-05, [[31323, 0.314257, " long", false], [46470, 0.090357, " longer", false], [31466, 0.086845, " much", false], [32386, 0.080617, " very", false], [31118, 0.014816, " huge", false], [38864, 0.014429, " large", false], [47708, 0.013791, " vastly", false], [46790, 0.013606, " period", false], [62471, 0.012715, " relatively", false], [39675, 0.012435, " short", false]]], "model_b": [51722, 1449, 1.3200866305851378e-05, [[31323, 0.322348, " long", false], [46790, 0.107053, " period", false], [39675, 0.08134, " short", false], [31466, 0.053327, " much", false], [46470, 0.0458, " longer", false], [32386, 0.034988, " very", false], [32251, 0.019746, " time", false], [56546, 0.016532, " lifetime", false], [62471, 0.011573, " relatively", false], [38720, 0.010905, " human", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.02527005610180018}, {"byte_start": 5654, "byte_end": 5655, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "63.96%", "model_b": "67.63%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.02850189059972763]], "model_b": [[45, ",", "normal", 0.02341831848025322]]}, "loss": {"model_a": 63.96323716441302, "model_b": 67.62633004167016}, "topk": {"model_a": [45, 6, 0.02850189059972763, [[55532, 0.468098, " approach", false], [46561, 0.132644, " method", false], [22752, 0.038385, " way", false], [38720, 0.034412, " human", false], [21400, 0.028642, " but", false], [45, 0.028502, ",", false], [21265, 0.019596, " and", false], [57317, 0.017333, " strategy", false], [63277, 0.010085, " alternative", false], [31135, 0.010061, " idea", false]]], "model_b": [45, 8, 0.02341831848025322, [[55532, 0.161313, " approach", false], [46561, 0.078737, " method", false], [31637, 0.078305, " path", false], [57317, 0.060175, " strategy", false], [56810, 0.03049, " paradigm", false], [39552, 0.026557, " route", false], [22752, 0.024621, " way", false], [45, 0.023418, ",", false], [38720, 0.02277, " human", false], [21400, 0.019571, " but", false]]]}, "raw_delta": -0.203125, "tuned_delta": -0.15027005610180016}, {"byte_start": 5655, "byte_end": 5661, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 973, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%", "model_b": "9.63% 9.63% 9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.1406121850013733]], "model_b": [[38720, " human", "normal", 0.04061727598309517]]}, "loss": {"model_a": 5.8938225140483365, "model_b": 9.627359485098875}, "topk": {"model_a": [38720, 2, 0.1406121850013733, [[21400, 0.225893, " but", false], [38720, 0.140612, " human", false], [21265, 0.070715, " and", false], [56847, 0.047999, " personal", false], [39675, 0.036481, " short", false], [31323, 0.02148, " long", false], [56205, 0.02001, " familiar", false], [47544, 0.018472, " though", false], [45132, 0.017131, " albeit", false], [62309, 0.015536, " personally", false]]], "model_b": [38720, 3, 0.04061727598309517, [[21400, 0.2456, " but", false], [21265, 0.066528, " and", false], [38720, 0.040617, " human", false], [31323, 0.028656, " long", false], [39675, 0.028265, " short", false], [31277, 0.018946, " less", false], [47001, 0.016217, " rather", false], [56205, 0.015914, " familiar", false], [22797, 0.013138, " yet", false], [39171, 0.012085, " often", false]]]}, "raw_delta": -0.20703124999999997, "tuned_delta": -0.15417630610180016}, {"byte_start": 5661, "byte_end": 5662, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "4.86%", "model_b": "0.92%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.7633634209632874]], "model_b": [[46, "-", "normal", 0.9506463408470154]]}, "loss": {"model_a": 4.8606424717450425, "model_b": 0.9201759751763712}, "topk": {"model_a": [46, 1, 0.7633634209632874, [[46, 0.763363, "-", false], [55532, 0.04569, " approach", false], [22752, 0.04332, " way", false], [45, 0.024073, ",", false], [2030, 0.022829, "ly", false], [34864, 0.015959, "istic", false], [59943, 0.008371, " knowledge", false], [46561, 0.00717, " method", false], [7919, 0.00711, "ist", false], [65034, 0.006926, " understanding", false]]], "model_b": [46, 1, 0.9506463408470154, [[46, 0.950646, "-", false], [59943, 0.011479, " knowledge", false], [55532, 0.002708, " approach", false], [38786, 0.002484, " input", false], [2030, 0.001868, "ly", false], [34864, 0.001207, "istic", false], [45, 0.001019, ",", false], [26031, 0.001009, "ized", false], [45775, 0.000862, " domain", false], [7919, 0.000845, "ist", false]]]}, "raw_delta": 0.218505859375, "tuned_delta": 0.27136080327319984}, {"byte_start": 5662, "byte_end": 5669, "display": {"text": "centric", "kind": "normal"}, "is_word": true, "word_id": 974, "word_key": "centric", "bytes_hex": "63 65 6e 74 72 69 63", "compression": {"model_a": "7.69% 7.69% 7.69% 7.69% 7.69% 7.69% 7.69%", "model_b": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%"}, "model_tokens": {"model_a": [[48948, "centric", "normal", 0.05066029727458954]], "model_b": [[48948, "centric", "normal", 0.07499963790178299]]}, "loss": {"model_a": 7.688469665451784, "model_b": 6.6821254684031235}, "topk": {"model_a": [48948, 3, 0.05066029727458954, [[58313, 0.55343, "knowledge", false], [34011, 0.063437, "based", false], [48948, 0.05066, "centric", false], [42430, 0.0426, "unders", false], [26148, 0.024364, "like", false], [54208, 0.022659, "oriented", false], [53835, 0.021787, "centered", false], [41273, 0.017554, "driven", false], [54087, 0.016843, "inspired", false], [49043, 0.012292, "derived", false]]], "model_b": [48948, 2, 0.07499963790178299, [[58313, 0.43173, "knowledge", false], [48948, 0.075, "centric", false], [34011, 0.07073, "based", false], [53835, 0.035267, "centered", false], [53908, 0.024097, "directed", false], [26085, 0.019617, "know", false], [49037, 0.01505, "defined", false], [34232, 0.014328, "domin", false], [34795, 0.013945, "input", false], [54359, 0.008906, "specific", false]]]}, "raw_delta": 0.0558035714285714, "tuned_delta": 0.10865851532677122}, {"byte_start": 5669, "byte_end": 5678, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 975, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22%", "model_b": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.5443591475486755]], "model_b": [[55532, " approach", "normal", 0.3070255219936371]]}, "loss": {"model_a": 1.221030959085711, "model_b": 2.3637907028454146}, "topk": {"model_a": [55532, 1, 0.5443591475486755, [[55532, 0.544359, " approach", false], [45, 0.120822, ",", false], [46561, 0.061693, " method", false], [22752, 0.039413, " way", false], [32398, 0.037207, " view", false], [57317, 0.015693, " strategy", false], [46681, 0.014377, " notion", false], [63708, 0.00899, " methodology", false], [56810, 0.008537, " paradigm", false], [31135, 0.008427, " idea", false]]], "model_b": [55532, 1, 0.3070255219936371, [[55532, 0.307026, " approach", false], [45, 0.114671, ",", false], [56810, 0.059006, " paradigm", false], [46561, 0.053211, " method", false], [57317, 0.051148, " strategy", false], [31637, 0.040796, " path", false], [22752, 0.035587, " way", false], [45775, 0.021689, " domain", false], [39043, 0.015533, " model", false], [32398, 0.012945, " view", false]]]}, "raw_delta": -0.06336805555555557, "tuned_delta": -0.010513111657355745}, {"byte_start": 5678, "byte_end": 5679, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "11.34%", "model_b": "14.16%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5361168384552002]], "model_b": [[47, ".", "normal", 0.4533803462982178]]}, "loss": {"model_a": 11.341499100738432, "model_b": 14.159262852474688}, "topk": {"model_a": [47, 1, 0.5361168384552002, [[47, 0.536117, ".", false], [32227, 0.159392, " that", false], [45, 0.150628, ",", false], [4811, 0.057714, " to", false], [21265, 0.015874, " and", false], [5346, 0.009687, "---", false], [47001, 0.008127, " rather", false], [60, 0.007287, ";", false], [4596, 0.005889, " in", false], [275, 0.005701, " (", false]]], "model_b": [47, 1, 0.4533803462982178, [[47, 0.45338, ".", false], [45, 0.222844, ",", false], [32227, 0.126112, " that", false], [4811, 0.056543, " to", false], [47001, 0.021133, " rather", false], [21265, 0.020674, " and", false], [5346, 0.0177, "---", false], [275, 0.009495, " (", false], [37810, 0.006391, " based", false], [60, 0.005107, ";", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 5679, "byte_end": 5680, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "9.79%", "model_b": "11.62%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.3343088626861572]], "model_b": [[261, "\n\n", "control", 0.2752617299556732]]}, "loss": {"model_a": 9.79172903728349, "model_b": 11.623275475912058}, "topk": {"model_a": [261, 1, 0.3343088626861572, [[261, 0.334309, "\n\n", false], [19555, 0.147468, " But", false], [20996, 0.094356, " The", false], [3918, 0.044073, " It", false], [29894, 0.04175, " This", false], [4331, 0.03526, " We", false], [267, 0.021818, "  ", false], [3913, 0.016295, " In", false], [19417, 0.011072, " And", false], [0, 0.010797, "[0]", false]]], "model_b": [261, 1, 0.2752617299556732, [[261, 0.275262, "\n\n", false], [20996, 0.097603, " The", false], [29894, 0.07245, " This", false], [19555, 0.072445, " But", false], [3918, 0.0456, " It", false], [11, 0.028037, "\n", false], [267, 0.027651, "  ", false], [4331, 0.027451, " We", false], [3913, 0.026779, " In", false], [19417, 0.019095, " And", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 5680, "byte_end": 5681, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "9.79%", "model_b": "11.62%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.3343088626861572]], "model_b": [[261, "\n\n", "control", 0.2752617299556732]]}, "loss": {"model_a": 9.79172903728349, "model_b": 11.623275475912058}, "topk": {"model_a": [261, 1, 0.3343088626861572, [[261, 0.334309, "\n\n", false], [19555, 0.147468, " But", false], [20996, 0.094356, " The", false], [3918, 0.044073, " It", false], [29894, 0.04175, " This", false], [4331, 0.03526, " We", false], [267, 0.021818, "  ", false], [3913, 0.016295, " In", false], [19417, 0.011072, " And", false], [0, 0.010797, "[0]", false]]], "model_b": [261, 1, 0.2752617299556732, [[261, 0.275262, "\n\n", false], [20996, 0.097603, " The", false], [29894, 0.07245, " This", false], [19555, 0.072445, " But", false], [3918, 0.0456, " It", false], [11, 0.028037, "\n", false], [267, 0.027651, "  ", false], [4331, 0.027451, " We", false], [3913, 0.026779, " In", false], [19417, 0.019095, " And", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 5681, "byte_end": 5684, "display": {"text": "One", "kind": "normal"}, "is_word": true, "word_id": 976, "word_key": "one", "bytes_hex": "4f 6e 65", "compression": {"model_a": "25.17% 25.17% 25.17%", "model_b": "27.05% 27.05% 27.05%"}, "model_tokens": {"model_a": [[6393, "One", "normal", 0.015050908550620079]], "model_b": [[6393, "One", "normal", 0.011030742898583412]]}, "loss": {"model_a": 25.172022848843888, "model_b": 27.05053201666806}, "topk": {"model_a": [6393, 13, 0.015050908550620079, [[6699, 0.177685, "The", false], [1136, 0.064493, "In", false], [24242, 0.059646, "This", false], [33504, 0.04453, "There", false], [1589, 0.043323, "We", false], [66, 0.03483, "A", false], [1141, 0.034018, "It", false], [1500, 0.031444, "To", false], [74, 0.026629, "I", false], [24326, 0.021604, "What", false]]], "model_b": [6393, 14, 0.011030742898583412, [[6699, 0.174873, "The", false], [24242, 0.069819, "This", false], [1136, 0.045399, "In", false], [33504, 0.039347, "There", false], [1141, 0.028028, "It", false], [1589, 0.028025, "We", false], [5658, 0.027596, "But", false], [1500, 0.017622, "To", false], [74, 0.017284, "I", false], [66, 0.016299, "A", false]]]}, "raw_delta": -0.10416666666666674, "tuned_delta": -0.05131172276846692}, {"byte_start": 5684, "byte_end": 5690, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 977, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"model_a": "11.46% 11.46% 11.46% 11.46% 11.46% 11.46%", "model_b": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02%"}, "model_tokens": {"model_a": [[39941, " thing", "normal", 0.022175639867782593]], "model_b": [[39941, " thing", "normal", 0.018186992034316063]]}, "loss": {"model_a": 11.458905923727443, "model_b": 12.022458674074693}, "topk": {"model_a": [39941, 7, 0.022175639867782593, [[4706, 0.170438, " of", false], [22752, 0.108849, " way", false], [47009, 0.064625, " reason", false], [21413, 0.045854, " can", false], [39021, 0.03549, " might", false], [46430, 0.024085, " lesson", false], [39941, 0.022176, " thing", false], [51668, 0.020439, " example", false], [59829, 0.017523, " important", false], [56895, 0.015965, " possible", false]]], "model_b": [39941, 9, 0.018186992034316063, [[4706, 0.230806, " of", false], [22752, 0.1064, " way", false], [21413, 0.050285, " can", false], [47009, 0.044247, " reason", false], [38491, 0.031379, " final", false], [39021, 0.027043, " might", false], [59829, 0.023367, " important", false], [51668, 0.02264, " example", false], [39941, 0.018187, " thing", false], [46430, 0.014988, " lesson", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 5690, "byte_end": 5695, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 978, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "2.52% 2.52% 2.52% 2.52% 2.52%", "model_b": "2.87% 2.87% 2.87% 2.87% 2.87%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.49280062317848206]], "model_b": [[32227, " that", "normal", 0.4525791108608246]]}, "loss": {"model_a": 2.5218985578039494, "model_b": 2.8741190267709813}, "topk": {"model_a": [32227, 1, 0.49280062317848206, [[32227, 0.492801, " that", false], [4858, 0.158727, " we", false], [4811, 0.096014, " to", false], [4600, 0.03451, " is", false], [32234, 0.030564, " this", false], [308, 0.02704, " I", false], [22590, 0.02395, " the", false], [37598, 0.01049, " about", false], [3609, 0.009143, " AI", false], [39936, 0.005701, " these", false]]], "model_b": [32227, 1, 0.4525791108608246, [[32227, 0.452579, " that", false], [4600, 0.126138, " is", false], [4858, 0.106203, " we", false], [4811, 0.049225, " to", false], [22590, 0.035975, " the", false], [308, 0.033473, " I", false], [3609, 0.026936, " AI", false], [32234, 0.018122, " this", false], [37598, 0.013129, " about", false], [21800, 0.010946, " has", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03332369389819982}, {"byte_start": 5695, "byte_end": 5702, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 979, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%", "model_b": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.013272942043840885]], "model_b": [[47266, " should", "normal", 0.014780030585825443]]}, "loss": {"model_a": 11.110039935417243, "model_b": 10.868517328125558}, "topk": {"model_a": [47266, 16, 0.013272942043840885, [[4600, 0.185279, " is", false], [21800, 0.081013, " has", false], [4858, 0.054314, " we", false], [38964, 0.049327, " makes", false], [21413, 0.047148, " can", false], [22590, 0.029851, " the", false], [22074, 0.022044, " may", false], [38686, 0.02118, " helps", false], [3609, 0.020754, " AI", false], [39021, 0.020189, " might", false]]], "model_b": [47266, 14, 0.014780030585825443, [[4600, 0.219838, " is", false], [21800, 0.115689, " has", false], [21413, 0.050468, " can", false], [4858, 0.042143, " we", false], [22590, 0.031374, " the", false], [38964, 0.030727, " makes", false], [22074, 0.025844, " may", false], [3609, 0.024024, " AI", false], [308, 0.020887, " I", false], [39620, 0.02078, " seems", false]]]}, "raw_delta": 0.013392857142857206, "tuned_delta": 0.06624780104105703}, {"byte_start": 5702, "byte_end": 5705, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 980, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "2.44% 2.44% 2.44%", "model_b": "4.46% 4.46% 4.46%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.662806510925293]], "model_b": [[4435, " be", "normal", 0.4726240932941437]]}, "loss": {"model_a": 2.442061918171422, "model_b": 4.461459273582406}, "topk": {"model_a": [4435, 1, 0.662806510925293, [[4435, 0.662807, " be", false], [31073, 0.069093, " help", false], [22187, 0.049603, " not", false], [31059, 0.02136, " have", false], [31358, 0.015835, " make", false], [30135, 0.015578, " also", false], [30482, 0.011283, " come", false], [45284, 0.01066, " become", false], [39797, 0.007296, " stand", false], [47428, 0.006829, " strike", false]]], "model_b": [4435, 1, 0.4726240932941437, [[4435, 0.472624, " be", false], [22187, 0.10081, " not", false], [31073, 0.060817, " help", false], [31059, 0.054067, " have", false], [31358, 0.027264, " make", false], [30482, 0.023442, " come", false], [47063, 0.014779, " remind", false], [46159, 0.012235, " happen", false], [47428, 0.0116, " strike", false], [45450, 0.009238, " change", false]]]}, "raw_delta": -0.11197916666666669, "tuned_delta": -0.059124222768466864}, {"byte_start": 5705, "byte_end": 5713, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 981, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"model_a": "4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83%", "model_b": "7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"model_a": [[52112, " learned", "normal", 0.11948658525943756]], "model_b": [[52112, " learned", "normal", 0.03853078931570053]]}, "loss": {"model_a": 4.825420424848339, "model_b": 7.361407801410969}, "topk": {"model_a": [52112, 2, 0.11948658525943756, [[38049, 0.263173, " clear", false], [52112, 0.119487, " learned", false], [39140, 0.071518, " noted", false], [52346, 0.046066, " obvious", false], [61934, 0.031661, " emphasized", false], [31207, 0.029328, " kept", false], [62684, 0.026553, " understood", false], [62479, 0.022931, " remembered", false], [55524, 0.019985, " apparent", false], [31351, 0.019849, " made", false]]], "model_b": [52112, 5, 0.03853078931570053, [[38049, 0.178091, " clear", false], [39140, 0.06547, " noted", false], [52346, 0.06436, " obvious", false], [61934, 0.061393, " emphasized", false], [52112, 0.038531, " learned", false], [37890, 0.036065, " borne", false], [30666, 0.034696, " done", false], [37620, 0.025057, " added", false], [52506, 0.021937, " pointed", false], [31929, 0.02136, " said", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08777005610180018}, {"byte_start": 5713, "byte_end": 5718, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 982, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"model_a": "2.07% 2.07% 2.07% 2.07% 2.07%", "model_b": "1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"model_a": [[30917, " from", "normal", 0.5585579872131348]], "model_b": [[30917, " from", "normal", 0.6450085043907166]]}, "loss": {"model_a": 2.0710563575261483, "model_b": 1.570903291592963}, "topk": {"model_a": [30917, 1, 0.5585579872131348, [[30917, 0.558558, " from", false], [4600, 0.269791, " is", false], [45, 0.042443, ",", false], [31077, 0.021606, " here", false], [37598, 0.016718, " about", false], [4450, 0.012164, " by", false], [4596, 0.011486, " in", false], [21265, 0.007243, " and", false], [32458, 0.007101, " well", false], [59, 0.004373, ":", false]]], "model_b": [30917, 1, 0.6450085043907166, [[30917, 0.645009, " from", false], [4600, 0.186247, " is", false], [4596, 0.032483, " in", false], [45, 0.02719, ",", false], [31077, 0.018396, " here", false], [37598, 0.015167, " about", false], [4450, 0.011644, " by", false], [21265, 0.004889, " and", false], [4423, 0.003803, " as", false], [59, 0.002956, ":", false]]]}, "raw_delta": 0.027734374999999988, "tuned_delta": 0.08058931889819981}, {"byte_start": 5718, "byte_end": 5722, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 983, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "6.30% 6.30% 6.30% 6.30%", "model_b": "5.88% 5.88% 5.88% 5.88%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.24672578275203705]], "model_b": [[22590, " the", "normal", 0.2745579779148102]]}, "loss": {"model_a": 6.304746394509873, "model_b": 5.882081831749435}, "topk": {"model_a": [22590, 2, 0.24672578275203705, [[32234, 0.372783, " this", false], [22590, 0.246726, " the", false], [39936, 0.196215, " these", false], [21256, 0.070858, " all", false], [3609, 0.02108, " AI", false], [45315, 0.010912, " bitter", false], [51929, 0.007206, " history", false], [55809, 0.004303, " computer", false], [3543, 0.003954, " 70", false], [57331, 0.003544, " studying", false]]], "model_b": [22590, 2, 0.2745579779148102, [[32234, 0.378935, " this", false], [22590, 0.274558, " the", false], [21256, 0.103133, " all", false], [39936, 0.068581, " these", false], [3609, 0.067152, " AI", false], [51929, 0.010893, " history", false], [55809, 0.010161, " computer", false], [45315, 0.004953, " bitter", false], [332, 0.00274, " a", false], [22248, 0.002733, " our", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07629244389819982}, {"byte_start": 5722, "byte_end": 5729, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 984, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75%", "model_b": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.7421367168426514]], "model_b": [[45315, " bitter", "normal", 0.8156770467758179]]}, "loss": {"model_a": 0.7547581477864971, "model_b": 0.5157514009874397}, "topk": {"model_a": [45315, 1, 0.7421367168426514, [[45315, 0.742137, " bitter", false], [51929, 0.045971, " history", false], [37599, 0.012061, " above", false], [3609, 0.010099, " AI", false], [31636, 0.008555, " past", false], [60587, 0.00829, " successes", false], [56162, 0.008018, " examples", false], [61640, 0.006769, " bitterness", false], [62061, 0.006483, " historical", false], [52127, 0.006214, " lessons", false]]], "model_b": [45315, 1, 0.8156770467758179, [[45315, 0.815677, " bitter", false], [51929, 0.047212, " history", false], [19523, 0.012799, " Bit", false], [37599, 0.011353, " above", false], [61640, 0.009898, " bitterness", false], [3609, 0.008693, " AI", false], [31636, 0.007824, " past", false], [56162, 0.003357, " examples", false], [52127, 0.002835, " lessons", false], [55809, 0.002485, " computer", false]]]}, "raw_delta": 0.013253348214285712, "tuned_delta": 0.06610829211248553}, {"byte_start": 5729, "byte_end": 5736, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 985, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "1.97% 1.97% 1.97% 1.97% 1.97% 1.97% 1.97%", "model_b": "0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.4661090075969696]], "model_b": [[46430, " lesson", "normal", 0.6845353841781616]]}, "loss": {"model_a": 1.9724346262153793, "model_b": 0.97112215015196}, "topk": {"model_a": [46430, 2, 0.4661090075969696, [[52127, 0.472814, " lessons", false], [46430, 0.466109, " lesson", false], [61979, 0.014762, " experience", false], [63558, 0.005088, " experiences", false], [46, 0.004753, "-", false], [51929, 0.004456, " history", false], [31636, 0.002177, " past", false], [39899, 0.001563, " taste", false], [45, 0.001297, ",", false], [56652, 0.001291, " mistakes", false]]], "model_b": [46430, 1, 0.6845353841781616, [[46430, 0.684535, " lesson", false], [52127, 0.188879, " lessons", false], [46, 0.03985, "-", false], [51929, 0.030076, " history", false], [61979, 0.014516, " experience", false], [7513, 0.002343, "est", false], [31333, 0.001925, " loss", false], [39831, 0.001752, " story", false], [65126, 0.001574, " disappointment", false], [53052, 0.001197, " success", false]]]}, "raw_delta": 0.05552455357142856, "tuned_delta": 0.10837949746962838}, {"byte_start": 5736, "byte_end": 5739, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 986, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "1.26% 1.26% 1.26%", "model_b": "1.22% 1.22% 1.22%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.8119887113571167]], "model_b": [[4600, " is", "normal", 0.8170072436332703]]}, "loss": {"model_a": 1.2562530059824142, "model_b": 1.2151606179362606}, "topk": {"model_a": [4600, 1, 0.8119887113571167, [[4600, 0.811989, " is", false], [4706, 0.069306, " of", false], [45, 0.046331, ",", false], [4596, 0.014451, " in", false], [32227, 0.010821, " that", false], [37598, 0.0108, " about", false], [59, 0.006137, ":", false], [21265, 0.004157, " and", false], [4712, 0.002779, " on", false], [5346, 0.002243, "---", false]]], "model_b": [4600, 1, 0.8170072436332703, [[4600, 0.817007, " is", false], [4706, 0.053004, " of", false], [45, 0.045489, ",", false], [5346, 0.014849, "---", false], [4596, 0.011126, " in", false], [32227, 0.010677, " that", false], [59, 0.006985, ":", false], [21265, 0.006857, " and", false], [37598, 0.006439, " about", false], [4712, 0.001985, " on", false]]]}, "raw_delta": 0.0022786458333333287, "tuned_delta": 0.05513358973153315}, {"byte_start": 5739, "byte_end": 5743, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 987, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.78% 10.78% 10.78% 10.78%", "model_b": "10.64% 10.64% 10.64% 10.64%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09193588048219681]], "model_b": [[22590, " the", "normal", 0.09512507915496826]]}, "loss": {"model_a": 10.777946350391181, "model_b": 10.637058162804367}, "topk": {"model_a": [22590, 3, 0.09193588048219681, [[32227, 0.673385, " that", false], [4811, 0.09697, " to", false], [22590, 0.091936, " the", false], [22187, 0.029321, " not", false], [21835, 0.023214, " how", false], [32234, 0.015229, " this", false], [332, 0.01295, " a", false], [59, 0.004957, ":", false], [45, 0.004581, ",", false], [32464, 0.004514, " what", false]]], "model_b": [22590, 2, 0.09512507915496826, [[32227, 0.676448, " that", false], [22590, 0.095125, " the", false], [4811, 0.07234, " to", false], [32234, 0.037054, " this", false], [21835, 0.029573, " how", false], [22187, 0.022881, " not", false], [332, 0.009424, " a", false], [32464, 0.005733, " what", false], [59, 0.002838, ":", false], [45, 0.002798, ",", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06066744389819982}, {"byte_start": 5743, "byte_end": 5749, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 988, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"model_a": "15.97% 15.97% 15.97% 15.97% 15.97% 15.97%", "model_b": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%"}, "model_tokens": {"model_a": [[38629, " great", "normal", 0.004896262194961309]], "model_b": [[38629, " great", "normal", 0.0036425036378204823]]}, "loss": {"model_a": 15.967327926505453, "model_b": 16.90658251041754}, "topk": {"model_a": [38629, 18, 0.004896262194961309, [[62079, 0.263492, " importance", false], [31506, 0.108256, " need", false], [40093, 0.037795, " value", false], [59725, 0.019692, " following", false], [45661, 0.014542, " danger", false], [21719, 0.013373, " fut", false], [30808, 0.012481, " fact", false], [63820, 0.010554, " realization", false], [31135, 0.008251, " idea", false], [39339, 0.007671, " power", false]]], "model_b": [38629, 29, 0.0036425036378204823, [[62079, 0.272124, " importance", false], [40093, 0.070946, " value", false], [31506, 0.050858, " need", false], [30808, 0.018133, " fact", false], [61863, 0.017828, " difference", false], [31894, 0.017554, " role", false], [39339, 0.014811, " power", false], [46430, 0.012003, " lesson", false], [60051, 0.010391, " necessity", false], [45661, 0.009915, " danger", false]]]}, "raw_delta": -0.05208333333333337, "tuned_delta": 0.0007716105648664512}, {"byte_start": 5749, "byte_end": 5755, "display": {"text": " power", "kind": "normal"}, "is_word": true, "word_id": 989, "word_key": " power", "bytes_hex": "20 70 6f 77 65 72", "compression": {"model_a": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "model_b": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83%"}, "model_tokens": {"model_a": [[39339, " power", "normal", 0.07024160027503967]], "model_b": [[39339, " power", "normal", 0.05299679934978485]]}, "loss": {"model_a": 7.983663963252726, "model_b": 8.828993088773602}, "topk": {"model_a": [39339, 3, 0.07024160027503967, [[62079, 0.317759, " importance", false], [40093, 0.174476, " value", false], [39339, 0.070242, " power", false], [60211, 0.027899, " potential", false], [59093, 0.024464, " advantage", false], [51030, 0.023209, " benefit", false], [45661, 0.020927, " danger", false], [31506, 0.017957, " need", false], [61865, 0.014665, " difficulty", false], [30510, 0.01198, " cost", false]]], "model_b": [39339, 3, 0.05299679934978485, [[40093, 0.158352, " value", false], [62079, 0.119425, " importance", false], [39339, 0.052997, " power", false], [45661, 0.044343, " danger", false], [60211, 0.034057, " potential", false], [51030, 0.03195, " benefit", false], [61865, 0.030171, " difficulty", false], [31506, 0.016955, " need", false], [61863, 0.014748, " difference", false], [59093, 0.013744, " advantage", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.0059799438981998215}, {"byte_start": 5755, "byte_end": 5758, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 990, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.19% 1.19% 1.19%", "model_b": "1.16% 1.16% 1.16%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8207558989524841]], "model_b": [[4706, " of", "normal", 0.8272742629051208]]}, "loss": {"model_a": 1.1916792533384586, "model_b": 1.1564572064417553}, "topk": {"model_a": [4706, 1, 0.8207558989524841, [[4706, 0.820756, " of", false], [32227, 0.06514, " that", false], [21265, 0.045903, " and", false], [4596, 0.014503, " in", false], [45, 0.00973, ",", false], [4811, 0.006957, " to", false], [4858, 0.003272, " we", false], [59206, 0.002996, " available", false], [56454, 0.00201, " inherent", false], [275, 0.00156, " (", false]]], "model_b": [4706, 1, 0.8272742629051208, [[4706, 0.827274, " of", false], [32227, 0.07818, " that", false], [21265, 0.032341, " and", false], [4596, 0.007528, " in", false], [45, 0.00653, ",", false], [4811, 0.004823, " to", false], [22590, 0.002489, " the", false], [56454, 0.002477, " inherent", false], [275, 0.001792, " (", false], [4858, 0.001404, " we", false]]]}, "raw_delta": 0.001953125, "tuned_delta": 0.05480806889819982}, {"byte_start": 5758, "byte_end": 5766, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 991, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01%", "model_b": "8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.04430420696735382]], "model_b": [[51832, " general", "normal", 0.019680190831422806]]}, "loss": {"model_a": 7.009187332443938, "model_b": 8.875955817969208}, "topk": {"model_a": [51832, 6, 0.04430420696735382, [[63370, 0.120057, " computation", false], [22590, 0.110868, " the", false], [47202, 0.078349, " search", false], [52195, 0.061203, " massive", false], [56537, 0.056924, " learning", false], [51832, 0.044304, " general", false], [37045, 0.038566, " Moore", false], [30597, 0.035247, " deep", false], [38888, 0.030758, " lever", false], [38720, 0.030664, " human", false]]], "model_b": [51832, 8, 0.019680190831422806, [[22590, 0.096556, " the", false], [38720, 0.068984, " human", false], [56537, 0.068204, " learning", false], [52805, 0.039087, " scaling", false], [65135, 0.025946, " generalization", false], [31978, 0.023359, " self", false], [332, 0.020946, " a", false], [51832, 0.01968, " general", false], [63370, 0.015114, " computation", false], [38888, 0.014645, " lever", false]]]}, "raw_delta": -0.103515625, "tuned_delta": -0.05066068110180018}, {"byte_start": 5766, "byte_end": 5774, "display": {"text": " purpose", "kind": "normal"}, "is_word": true, "word_id": 992, "word_key": " purpose", "bytes_hex": "20 70 75 72 70 6f 73 65", "compression": {"model_a": "15.71% 15.71% 15.71% 15.71% 15.71% 15.71% 15.71% 15.71%", "model_b": "18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60%"}, "model_tokens": {"model_a": [[52610, " purpose", "normal", 0.0009392458596266806]], "model_b": [[52610, " purpose", "normal", 0.0002528812037780881]]}, "loss": {"model_a": 15.70903291592963, "model_b": 18.597240761459293}, "topk": {"model_a": [52610, 25, 0.0009392458596266806, [[52224, 0.743039, " methods", false], [7933, 0.042492, "ity", false], [45, 0.035831, ",", false], [61590, 0.02665, " approaches", false], [47202, 0.024667, " search", false], [63370, 0.022236, " computation", false], [46, 0.012739, "-", false], [62633, 0.009637, " techniques", false], [64862, 0.006711, " computational", false], [61559, 0.005334, " algorithms", false]]], "model_b": [52610, 103, 0.0002528812037780881, [[52224, 0.567935, " methods", false], [45, 0.048378, ",", false], [46, 0.035781, "-", false], [56537, 0.03194, " learning", false], [34932, 0.024064, "izing", false], [61590, 0.023599, " approaches", false], [62370, 0.023576, " principles", false], [3609, 0.022001, " AI", false], [62581, 0.016756, " strategies", false], [47202, 0.014667, " search", false]]]}, "raw_delta": -0.16015625, "tuned_delta": -0.10730130610180018}, {"byte_start": 5774, "byte_end": 5782, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 993, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%", "model_b": "3.89% 3.89% 3.89% 3.89% 3.89% 3.89% 3.89% 3.89%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.2201198935508728]], "model_b": [[52224, " methods", "normal", 0.17806246876716614]]}, "loss": {"model_a": 3.3813165020835076, "model_b": 3.892036182085704}, "topk": {"model_a": [52224, 2, 0.2201198935508728, [[63370, 0.384273, " computation", false], [52224, 0.22012, " methods", false], [45, 0.075397, ",", false], [47202, 0.056132, " search", false], [59346, 0.033915, " computing", false], [56537, 0.020645, " learning", false], [61590, 0.018413, " approaches", false], [52167, 0.017347, " machine", false], [64862, 0.0154, " computational", false], [61559, 0.013282, " algorithms", false]]], "model_b": [52224, 1, 0.17806246876716614, [[52224, 0.178062, " methods", false], [3609, 0.095613, " AI", false], [45, 0.067559, ",", false], [47202, 0.051849, " search", false], [63370, 0.051303, " computation", false], [59346, 0.050886, " computing", false], [56537, 0.050013, " learning", false], [61559, 0.036276, " algorithms", false], [61590, 0.027818, " approaches", false], [62633, 0.021956, " techniques", false]]]}, "raw_delta": -0.0283203125, "tuned_delta": 0.02453463139819982}, {"byte_start": 5782, "byte_end": 5783, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "35.22%", "model_b": "30.01%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1402633935213089]], "model_b": [[45, ",", "normal", 0.19035430252552032]]}, "loss": {"model_a": 35.222046896703205, "model_b": 30.00918395599113}, "topk": {"model_a": [45, 3, 0.1402633935213089, [[47, 0.27583, ".", false], [32227, 0.186035, " that", false], [45, 0.140263, ",", false], [37810, 0.119603, " based", false], [38888, 0.030657, " lever", false], [21700, 0.029616, " for", false], [4811, 0.025913, " to", false], [31296, 0.0257, " like", false], [21265, 0.020502, " and", false], [4596, 0.020087, " in", false]]], "model_b": [45, 2, 0.19035430252552032, [[47, 0.322801, ".", false], [45, 0.190354, ",", false], [4811, 0.093301, " to", false], [32227, 0.071557, " that", false], [5346, 0.056546, "---", false], [4596, 0.038158, " in", false], [37810, 0.028878, " based", false], [21265, 0.027061, " and", false], [31601, 0.022343, " over", false], [275, 0.016784, " (", false]]]}, "raw_delta": 0.2890625, "tuned_delta": 0.34191744389819984}, {"byte_start": 5783, "byte_end": 5786, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 994, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "25.17% 25.17% 25.17%", "model_b": "31.00% 31.00% 31.00%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.01513650082051754]], "model_b": [[4706, " of", "normal", 0.005742176435887814]]}, "loss": {"model_a": 25.172022848843888, "model_b": 30.99540126909882}, "topk": {"model_a": [4706, 15, 0.01513650082051754, [[21265, 0.201004, " and", false], [40186, 0.081214, " which", false], [37810, 0.079138, " based", false], [32139, 0.055665, " such", false], [31296, 0.051053, " like", false], [61953, 0.045036, " especially", false], [4423, 0.029465, " as", false], [4596, 0.028353, " in", false], [32227, 0.021198, " that", false], [52224, 0.019327, " methods", false]]], "model_b": [4706, 28, 0.005742176435887814, [[21265, 0.200061, " and", false], [30788, 0.069876, " even", false], [37810, 0.053307, " based", false], [40186, 0.052455, " which", false], [32465, 0.043169, " when", false], [61953, 0.034159, " especially", false], [4596, 0.03266, " in", false], [32227, 0.029875, " that", false], [32139, 0.027058, " such", false], [4423, 0.025231, " as", false]]]}, "raw_delta": -0.32291666666666674, "tuned_delta": -0.2700617227684669}, {"byte_start": 5786, "byte_end": 5794, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 995, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31%", "model_b": "9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.35644426941871643]], "model_b": [[52224, " methods", "normal", 0.012439017184078693]]}, "loss": {"model_a": 2.30704407173406, "model_b": 9.932617224870304}, "topk": {"model_a": [52224, 1, 0.35644426941871643, [[52224, 0.356444, " methods", false], [63370, 0.060306, " computation", false], [51832, 0.056291, " general", false], [22590, 0.055614, " the", false], [47202, 0.045822, " search", false], [38888, 0.039021, " lever", false], [56537, 0.02057, " learning", false], [52195, 0.019121, " massive", false], [39944, 0.016459, " those", false], [59346, 0.013864, " computing", false]]], "model_b": [52224, 16, 0.012439017184078693, [[52195, 0.101128, " massive", false], [52805, 0.063346, " scaling", false], [51832, 0.05546, " general", false], [56537, 0.051596, " learning", false], [40186, 0.046681, " which", false], [22590, 0.041732, " the", false], [47202, 0.040414, " search", false], [38888, 0.036119, " lever", false], [63370, 0.028692, " computation", false], [39590, 0.019601, " scale", false]]]}, "raw_delta": -0.4228515625, "tuned_delta": -0.36999661860180016}, {"byte_start": 5794, "byte_end": 5799, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 996, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.18% 1.18% 1.18% 1.18% 1.18%", "model_b": "1.46% 1.46% 1.46% 1.46% 1.46%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.7168906331062317]], "model_b": [[32227, " that", "normal", 0.6696622371673584]]}, "loss": {"model_a": 1.176416366349887, "model_b": 1.4581927415235125}, "topk": {"model_a": [32227, 1, 0.7168906331062317, [[32227, 0.716891, " that", false], [37810, 0.109687, " based", false], [31296, 0.014968, " like", false], [22187, 0.014033, " not", false], [37924, 0.012525, " built", false], [38888, 0.009987, " lever", false], [4596, 0.0071, " in", false], [21700, 0.006573, " for", false], [55966, 0.006388, " designed", false], [32487, 0.006295, " with", false]]], "model_b": [32227, 1, 0.6696622371673584, [[32227, 0.669662, " that", false], [37810, 0.166664, " based", false], [32487, 0.015728, " with", false], [40191, 0.007735, " whose", false], [31296, 0.007427, " like", false], [21700, 0.005965, " for", false], [40185, 0.005925, " where", false], [22187, 0.005681, " not", false], [40186, 0.005294, " which", false], [37924, 0.005221, " built", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 5799, "byte_end": 5808, "display": {"text": " continue", "kind": "normal"}, "is_word": true, "word_id": 997, "word_key": " continue", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65", "compression": {"model_a": "20.66% 20.66% 20.66% 20.66% 20.66% 20.66% 20.66% 20.66% 20.66%", "model_b": "20.41% 20.41% 20.41% 20.41% 20.41% 20.41% 20.41% 20.41% 20.41%"}, "model_tokens": {"model_a": [[55851, " continue", "normal", 3.4100001357728615e-05]], "model_b": [[55851, " continue", "normal", 3.690290031954646e-05]]}, "loss": {"model_a": 20.66360084606588, "model_b": 20.413132957022658}, "topk": {"model_a": [55851, 543, 3.4100001357728615e-05, [[21286, 0.197369, " are", false], [21413, 0.129306, " can", false], [4491, 0.112376, " do", false], [56540, 0.080785, " leverage", false], [32499, 0.048057, " work", false], [22681, 0.0399, " use", false], [32187, 0.039287, " take", false], [31358, 0.036648, " make", false], [39590, 0.023734, " scale", false], [37730, 0.01443, " apply", false]]], "model_b": [55851, 630, 3.690290031954646e-05, [[21286, 0.156154, " are", false], [56540, 0.156023, " leverage", false], [21413, 0.144458, " can", false], [4491, 0.068109, " do", false], [32187, 0.043945, " take", false], [39590, 0.043452, " scale", false], [22681, 0.031968, " use", false], [32499, 0.027552, " work", false], [31856, 0.015526, " rely", false], [31059, 0.013772, " have", false]]]}, "raw_delta": 0.01388888888888884, "tuned_delta": 0.06674383278708866}, {"byte_start": 5808, "byte_end": 5811, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 998, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.50% 0.50% 0.50%", "model_b": "0.27% 0.27% 0.27%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9196329116821289]], "model_b": [[4811, " to", "normal", 0.9567081332206726]]}, "loss": {"model_a": 0.5019141682780207, "model_b": 0.2656329370126367}, "topk": {"model_a": [4811, 1, 0.9196329116821289, [[4811, 0.919633, " to", false], [38888, 0.007704, " lever", false], [22590, 0.004896, " the", false], [52805, 0.004568, " scaling", false], [45, 0.003514, ",", false], [4596, 0.002361, " in", false], [4712, 0.002336, " on", false], [60463, 0.002098, " searching", false], [39931, 0.001944, " their", false], [59832, 0.001894, " improving", false]]], "model_b": [4811, 1, 0.9567081332206726, [[4811, 0.956708, " to", false], [52805, 0.00418, " scaling", false], [22590, 0.003756, " the", false], [4712, 0.001707, " on", false], [45, 0.001532, ",", false], [4596, 0.001358, " in", false], [30788, 0.001103, " even", false], [21265, 0.001012, " and", false], [22187, 0.000924, " not", false], [59346, 0.000739, " computing", false]]]}, "raw_delta": 0.013102213541666666, "tuned_delta": 0.06595715743986649}, {"byte_start": 5811, "byte_end": 5817, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 999, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"model_a": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57%", "model_b": "5.71% 5.71% 5.71% 5.71% 5.71% 5.71%"}, "model_tokens": {"model_a": [[39590, " scale", "normal", 0.15863826870918274]], "model_b": [[39590, " scale", "normal", 0.1488090306520462]]}, "loss": {"model_a": 5.565083409679106, "model_b": 5.705971597265919}, "topk": {"model_a": [39590, 1, 0.15863826870918274, [[39590, 0.158638, " scale", false], [51982, 0.112899, " improve", false], [32499, 0.10068, " work", false], [4435, 0.079976, " be", false], [56540, 0.068653, " leverage", false], [38877, 0.022838, " learn", false], [31017, 0.022252, " grow", false], [31358, 0.021849, " make", false], [21751, 0.019851, " get", false], [52573, 0.017467, " produce", false]]], "model_b": [39590, 1, 0.1488090306520462, [[39590, 0.148809, " scale", false], [4435, 0.132966, " be", false], [51982, 0.064837, " improve", false], [56540, 0.030342, " leverage", false], [32499, 0.030155, " work", false], [45910, 0.027204, " evolve", false], [31358, 0.024289, " make", false], [31017, 0.02318, " grow", false], [56041, 0.022869, " dominate", false], [22681, 0.01541, " use", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04504244389819982}, {"byte_start": 5817, "byte_end": 5822, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 1000, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "7.02% 7.02% 7.02% 7.02% 7.02%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.14284653961658478]], "model_b": [[32487, " with", "normal", 0.1804630607366562]]}, "loss": {"model_a": 7.016231741823278, "model_b": 6.199080253819764}, "topk": {"model_a": [32487, 1, 0.14284653961658478, [[32487, 0.142847, " with", false], [63370, 0.098776, " computation", false], [4596, 0.095946, " in", false], [21265, 0.075648, " and", false], [45, 0.072032, ",", false], [4423, 0.071088, " as", false], [64911, 0.045427, " exponentially", false], [47, 0.037325, ".", false], [4833, 0.024998, " up", false], [59988, 0.021688, " massively", false]]], "model_b": [32487, 2, 0.1804630607366562, [[63370, 0.185081, " computation", false], [32487, 0.180463, " with", false], [64911, 0.079293, " exponentially", false], [32458, 0.049571, " well", false], [59988, 0.034906, " massively", false], [4811, 0.032499, " to", false], [4596, 0.032149, " in", false], [47, 0.026817, ".", false], [45, 0.026112, ",", false], [30788, 0.025339, " even", false]]]}, "raw_delta": 0.04531249999999998, "tuned_delta": 0.0981674438981998}, {"byte_start": 5822, "byte_end": 5832, "display": {"text": " increased", "kind": "normal"}, "is_word": true, "word_id": 1001, "word_key": " increased", "bytes_hex": "20 69 6e 63 72 65 61 73 65 64", "compression": {"model_a": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11%", "model_b": "9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[59846, " increased", "normal", 0.03438793867826462]], "model_b": [[59846, " increased", "normal", 0.004896621685475111]]}, "loss": {"model_a": 6.114547341267675, "model_b": 9.580396755903271}, "topk": {"model_a": [59846, 8, 0.03438793867826462, [[22590, 0.193636, " the", false], [63370, 0.156598, " computation", false], [31458, 0.067224, " more", false], [30789, 0.066241, " ever", false], [62092, 0.060614, " increasing", false], [37045, 0.043955, " Moore", false], [52195, 0.043565, " massive", false], [59846, 0.034388, " increased", false], [61535, 0.019675, " additional", false], [51816, 0.01832, " further", false]]], "model_b": [59846, 25, 0.004896621685475111, [[63370, 0.167779, " computation", false], [52195, 0.131501, " massive", false], [22590, 0.104534, " the", false], [62092, 0.057211, " increasing", false], [59346, 0.055336, " computing", false], [332, 0.030502, " a", false], [64911, 0.022719, " exponentially", false], [32251, 0.018296, " time", false], [52731, 0.017258, " respect", false], [38864, 0.016415, " large", false]]]}, "raw_delta": -0.19218749999999998, "tuned_delta": -0.13933255610180018}, {"byte_start": 5832, "byte_end": 5844, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 1002, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07%", "model_b": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.4895477890968323]], "model_b": [[63370, " computation", "normal", 0.4044737219810486]]}, "loss": {"model_a": 1.0742724303494477, "model_b": 1.3501784643736228}, "topk": {"model_a": [63370, 1, 0.4895477890968323, [[63370, 0.489548, " computation", false], [64862, 0.105092, " computational", false], [59346, 0.070708, " computing", false], [60406, 0.045169, " resources", false], [50897, 0.026294, " amounts", false], [51266, 0.022165, " compute", false], [59206, 0.013976, " available", false], [39339, 0.013104, " power", false], [56353, 0.011929, " hardware", false], [30579, 0.011643, " data", false]]], "model_b": [63370, 1, 0.4044737219810486, [[63370, 0.404474, " computation", false], [64862, 0.096341, " computational", false], [59346, 0.080655, " computing", false], [61720, 0.035001, " complexity", false], [30579, 0.030749, " data", false], [45157, 0.029381, " amount", false], [50897, 0.025754, " amounts", false], [51266, 0.017794, " compute", false], [32031, 0.017248, " size", false], [57453, 0.012027, " training", false]]]}, "raw_delta": -0.015299479166666676, "tuned_delta": 0.03755546473153314}, {"byte_start": 5844, "byte_end": 5849, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 1003, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "17.70% 17.70% 17.70% 17.70% 17.70%", "model_b": "16.12% 16.12% 16.12% 16.12% 16.12%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.00738136051222682]], "model_b": [[30788, " even", "normal", 0.011292358860373497]]}, "loss": {"model_a": 17.69555636090369, "model_b": 16.11760865993139}, "topk": {"model_a": [30788, 9, 0.00738136051222682, [[47, 0.432861, ".", false], [45, 0.273278, ",", false], [21265, 0.144218, " and", false], [5346, 0.013877, "---", false], [31601, 0.012073, " over", false], [275, 0.009163, " (", false], [4423, 0.008851, " as", false], [4596, 0.007822, " in", false], [30788, 0.007381, " even", false], [4450, 0.006698, " by", false]]], "model_b": [30788, 5, 0.011292358860373497, [[47, 0.487173, ".", false], [45, 0.261033, ",", false], [21265, 0.104812, " and", false], [275, 0.014031, " (", false], [30788, 0.011292, " even", false], [4596, 0.009357, " in", false], [5346, 0.008385, "---", false], [53356, 0.006647, " without", false], [4450, 0.006469, " by", false], [62461, 0.005027, " regardless", false]]]}, "raw_delta": 0.08749999999999991, "tuned_delta": 0.14035494389819975}, {"byte_start": 5849, "byte_end": 5852, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1004, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "7.33% 7.33% 7.33%", "model_b": "7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.29345259070396423]], "model_b": [[4423, " as", "normal", 0.30528897047042847]]}, "loss": {"model_a": 7.326185754514267, "model_b": 7.044409379340641}, "topk": {"model_a": [4423, 1, 0.29345259070396423, [[4423, 0.293453, " as", false], [32465, 0.260425, " when", false], [4596, 0.107043, " in", false], [4588, 0.075923, " if", false], [37634, 0.07347, " after", false], [47544, 0.068967, " though", false], [40187, 0.027339, " while", false], [31601, 0.007601, " over", false], [21700, 0.007546, " for", false], [50870, 0.005935, " against", false]]], "model_b": [4423, 1, 0.30528897047042847, [[4423, 0.305289, " as", false], [32465, 0.218397, " when", false], [47544, 0.157762, " though", false], [4596, 0.101826, " in", false], [4588, 0.054736, " if", false], [37634, 0.026758, " after", false], [40187, 0.019981, " while", false], [32487, 0.019165, " with", false], [53356, 0.014435, " without", false], [4424, 0.014387, " at", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06847994389819982}, {"byte_start": 5852, "byte_end": 5856, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1005, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.88% 5.88% 5.88% 5.88%", "model_b": "8.07% 8.07% 8.07% 8.07%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.2738429605960846]], "model_b": [[22590, " the", "normal", 0.16463494300842285]]}, "loss": {"model_a": 5.882081831749435, "model_b": 8.065848739345034}, "topk": {"model_a": [22590, 1, 0.2738429605960846, [[22590, 0.273843, " the", false], [32232, 0.190757, " they", false], [4858, 0.085906, " we", false], [38720, 0.060735, " human", false], [39931, 0.038152, " their", false], [39193, 0.02744, " other", false], [31458, 0.022442, " more", false], [63370, 0.01958, " computation", false], [22248, 0.016678, " our", false], [22168, 0.010046, " new", false]]], "model_b": [22590, 2, 0.16463494300842285, [[32232, 0.267723, " they", false], [22590, 0.164635, " the", false], [39931, 0.065515, " their", false], [31458, 0.038771, " more", false], [4858, 0.038482, " we", false], [63370, 0.029932, " computation", false], [38720, 0.029254, " human", false], [47202, 0.020168, " search", false], [39193, 0.019575, " other", false], [3609, 0.015121, " AI", false]]]}, "raw_delta": -0.12109375, "tuned_delta": -0.06823880610180018}, {"byte_start": 5856, "byte_end": 5866, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 1006, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40%", "model_b": "9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.009530733339488506]], "model_b": [[59206, " available", "normal", 0.006606848910450935]]}, "loss": {"model_a": 8.396935980174046, "model_b": 9.073199280590744}, "topk": {"model_a": [59206, 22, 0.009530733339488506, [[45775, 0.114093, " domain", false], [52569, 0.086557, " problem", false], [38720, 0.053422, " human", false], [52224, 0.040065, " methods", false], [62680, 0.029402, " underlying", false], [45157, 0.026116, " amount", false], [38478, 0.025058, " field", false], [57103, 0.020151, " research", false], [61720, 0.018814, " complexity", false], [62293, 0.018634, " particular", false]]], "model_b": [59206, 21, 0.006606848910450935, [[46685, 0.163365, " number", false], [45157, 0.082914, " amount", false], [64862, 0.050957, " computational", false], [63370, 0.043565, " computation", false], [30510, 0.042845, " cost", false], [61720, 0.028336, " complexity", false], [52569, 0.022476, " problem", false], [38720, 0.020906, " human", false], [32251, 0.016126, " time", false], [32031, 0.014076, " size", false]]]}, "raw_delta": -0.03750000000000003, "tuned_delta": 0.015354943898199788}, {"byte_start": 5866, "byte_end": 5878, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 1007, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48%", "model_b": "1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.09843704849481583]], "model_b": [[63370, " computation", "normal", 0.33823850750923157]]}, "loss": {"model_a": 3.4752419604747162, "model_b": 1.631954839547248}, "topk": {"model_a": [63370, 3, 0.09843704849481583, [[38720, 0.414505, " human", false], [59943, 0.215194, " knowledge", false], [63370, 0.098437, " computation", false], [30579, 0.050889, " data", false], [45775, 0.037924, " domain", false], [63637, 0.03553, " information", false], [64862, 0.008171, " computational", false], [45157, 0.007788, " amount", false], [60406, 0.007047, " resources", false], [22363, 0.006262, " raw", false]]], "model_b": [63370, 1, 0.33823850750923157, [[63370, 0.338239, " computation", false], [64862, 0.122806, " computational", false], [30579, 0.055708, " data", false], [63637, 0.042078, " information", false], [45157, 0.040587, " amount", false], [59943, 0.038906, " knowledge", false], [60406, 0.033514, " resources", false], [59346, 0.031786, " computing", false], [38720, 0.019141, " human", false], [32251, 0.018369, " time", false]]]}, "raw_delta": 0.10221354166666667, "tuned_delta": 0.1550684855648665}, {"byte_start": 5878, "byte_end": 5886, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 1008, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"model_a": "8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07%", "model_b": "6.02% 6.02% 6.02% 6.02% 6.02% 6.02% 6.02% 6.02%"}, "model_tokens": {"model_a": [[51019, " becomes", "normal", 0.027868805453181267]], "model_b": [[51019, " becomes", "normal", 0.06954191625118256]]}, "loss": {"model_a": 8.065848739345034, "model_b": 6.022970019336248}, "topk": {"model_a": [51019, 7, 0.027868805453181267, [[59847, 0.46205, " increases", false], [38642, 0.172917, " grows", false], [47181, 0.055605, " scales", false], [4600, 0.043152, " is", false], [46342, 0.039382, " itself", false], [59393, 0.029412, " continues", false], [51019, 0.027869, " becomes", false], [30659, 0.023704, " does", false], [39529, 0.008062, " rises", false], [51682, 0.007764, " expands", false]]], "model_b": [51019, 4, 0.06954191625118256, [[59847, 0.275121, " increases", false], [4600, 0.135981, " is", false], [38642, 0.120365, " grows", false], [51019, 0.069542, " becomes", false], [47181, 0.054568, " scales", false], [30965, 0.032458, " gets", false], [51521, 0.031248, " doubles", false], [59456, 0.025819, " decreases", false], [59393, 0.025064, " continues", false], [47273, 0.012728, " shrink", false]]]}, "raw_delta": 0.11328125, "tuned_delta": 0.16613619389819984}, {"byte_start": 5886, "byte_end": 5891, "display": {"text": " very", "kind": "normal"}, "is_word": true, "word_id": 1009, "word_key": " very", "bytes_hex": "20 76 65 72 79", "compression": {"model_a": "16.79% 16.79% 16.79% 16.79% 16.79%", "model_b": "24.01% 24.01% 24.01% 24.01% 24.01%"}, "model_tokens": {"model_a": [[32386, " very", "normal", 0.009424434043467045]], "model_b": [[32386, " very", "normal", 0.0012929176446050406]]}, "loss": {"model_a": 16.79387196034809, "model_b": 24.007347164792904}, "topk": {"model_a": [32386, 17, 0.009424434043467045, [[31458, 0.244896, " more", false], [64430, 0.082322, " increasingly", false], [51867, 0.04863, " greater", false], [30789, 0.04502, " ever", false], [59206, 0.044943, " available", false], [47708, 0.042764, " vastly", false], [51178, 0.041933, " cheaper", false], [46397, 0.038794, " larger", false], [59988, 0.033188, " massively", false], [32373, 0.030244, " vast", false]]], "model_b": [32386, 50, 0.0012929176446050406, [[31458, 0.196263, " more", false], [64911, 0.119086, " exponentially", false], [30789, 0.076658, " ever", false], [64430, 0.065054, " increasingly", false], [51867, 0.064711, " greater", false], [31277, 0.051354, " less", false], [31466, 0.043816, " much", false], [46397, 0.040961, " larger", false], [32373, 0.019087, " vast", false], [59988, 0.017067, " massively", false]]]}, "raw_delta": -0.4, "tuned_delta": -0.3471450561018002}, {"byte_start": 5891, "byte_end": 5897, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 1010, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"model_a": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%", "model_b": "8.92% 8.92% 8.92% 8.92% 8.92% 8.92%"}, "model_tokens": {"model_a": [[38629, " great", "normal", 0.005289455875754356]], "model_b": [[38629, " great", "normal", 0.05116667598485947]]}, "loss": {"model_a": 15.779477009723035, "model_b": 8.922918547164812}, "topk": {"model_a": [38629, 15, 0.005289455875754356, [[38864, 0.62691, " large", false], [31466, 0.050232, " much", false], [52195, 0.037726, " massive", false], [59682, 0.036221, " expensive", false], [38006, 0.029453, " cheap", false], [45, 0.023396, ",", false], [55425, 0.022466, " abundant", false], [52140, 0.020414, " limited", false], [31082, 0.01228, " high", false], [56900, 0.011446, " powerful", false]]], "model_b": [38629, 4, 0.05116667598485947, [[38864, 0.398158, " large", false], [31466, 0.202229, " much", false], [52195, 0.053145, " massive", false], [38629, 0.051167, " great", false], [52140, 0.049841, " limited", false], [45, 0.019734, ",", false], [39720, 0.018025, " small", false], [21357, 0.015587, " big", false], [59513, 0.011506, " different", false], [31118, 0.010629, " huge", false]]]}, "raw_delta": 0.3802083333333333, "tuned_delta": 0.43306327723153315}, {"byte_start": 5897, "byte_end": 5898, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "3.22%", "model_b": "5.28%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.835978090763092]], "model_b": [[47, ".", "normal", 0.746638298034668]]}, "loss": {"model_a": 3.2228172910483432, "model_b": 5.283307034505481}, "topk": {"model_a": [47, 1, 0.835978090763092, [[47, 0.835978, ".", false], [45, 0.097559, ",", false], [21265, 0.018007, " and", false], [5346, 0.014998, "---", false], [275, 0.009234, " (", false], [46272, 0.005245, " indeed", false], [4596, 0.003768, " in", false], [59, 0.00206, ":", false], [4715, 0.001534, " or", false], [57070, 0.001347, " relative", false]]], "model_b": [47, 1, 0.746638298034668, [[47, 0.746638, ".", false], [45, 0.12479, ",", false], [21265, 0.032502, " and", false], [5346, 0.018545, "---", false], [275, 0.014675, " (", false], [46272, 0.011562, " indeed", false], [21400, 0.007949, " but", false], [4596, 0.006562, " in", false], [57070, 0.00439, " relative", false], [37635, 0.003627, " again", false]]]}, "raw_delta": -0.1142578125, "tuned_delta": -0.06140286860180018}, {"byte_start": 5898, "byte_end": 5902, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 1011, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "8.91% 8.91% 8.91% 8.91%", "model_b": "8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.13893863558769226]], "model_b": [[20996, " The", "normal", 0.13883841037750244]]}, "loss": {"model_a": 8.91117786486591, "model_b": 8.875955817969208}, "topk": {"model_a": [20996, 1, 0.13893863558769226, [[20996, 0.138939, " The", false], [29894, 0.092007, " This", false], [37453, 0.079556, " These", false], [49964, 0.048616, " Another", false], [3913, 0.042191, " In", false], [3918, 0.039156, " It", false], [4331, 0.033864, " We", false], [300, 0.023888, " A", false], [37451, 0.022641, " There", false], [20556, 0.021518, " One", false]]], "model_b": [20996, 1, 0.13883841037750244, [[20996, 0.138838, " The", false], [29894, 0.125697, " This", false], [3913, 0.053278, " In", false], [37453, 0.050492, " These", false], [3918, 0.047602, " It", false], [37451, 0.032697, " There", false], [29834, 0.02457, " Such", false], [4331, 0.022575, " We", false], [300, 0.020023, " A", false], [29889, 0.01843, " That", false]]]}, "raw_delta": 0.001953125, "tuned_delta": 0.05480806889819982}, {"byte_start": 5902, "byte_end": 5906, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 1012, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"model_a": "25.64% 25.64% 25.64% 25.64%", "model_b": "25.92% 25.92% 25.92% 25.92%"}, "model_tokens": {"model_a": [[22638, " two", "normal", 0.003439505584537983]], "model_b": [[22638, " two", "normal", 0.0031534130685031414]]}, "loss": {"model_a": 25.641650140799932, "model_b": 25.92342651597356}, "topk": {"model_a": [22638, 46, 0.003439505584537983, [[45315, 0.05214, " bitter", false], [52224, 0.050568, " methods", false], [39193, 0.043092, " other", false], [51832, 0.031421, " general", false], [31461, 0.029041, " most", false], [46430, 0.026073, " lesson", false], [39339, 0.024314, " power", false], [38720, 0.02409, " human", false], [38629, 0.019845, " great", false], [31458, 0.013868, " more", false]]], "model_b": [22638, 46, 0.0031534130685031414, [[45315, 0.111914, " bitter", false], [51832, 0.032683, " general", false], [39339, 0.031557, " power", false], [38629, 0.029531, " great", false], [52224, 0.026168, " methods", false], [31461, 0.025873, " most", false], [38720, 0.017132, " human", false], [46430, 0.016857, " lesson", false], [30273, 0.01232, " best", false], [56331, 0.011739, " greatest", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 5906, "byte_end": 5914, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1013, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13%", "model_b": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.0659329891204834]], "model_b": [[52224, " methods", "normal", 0.041161324828863144]]}, "loss": {"model_a": 6.128636160026358, "model_b": 7.185297566927454}, "topk": {"model_a": [52224, 3, 0.0659329891204834, [[31461, 0.229599, " most", false], [56162, 0.097188, " examples", false], [52224, 0.065933, " methods", false], [61590, 0.053488, " approaches", false], [31356, 0.037607, " main", false], [51832, 0.037395, " general", false], [39193, 0.028713, " other", false], [21357, 0.025919, " big", false], [51200, 0.025231, " classes", false], [38841, 0.023008, " kinds", false]]], "model_b": [52224, 5, 0.041161324828863144, [[31461, 0.244422, " most", false], [61590, 0.073023, " approaches", false], [31356, 0.063172, " main", false], [38961, 0.041548, " major", false], [52224, 0.041161, " methods", false], [51200, 0.019709, " classes", false], [51832, 0.016396, " general", false], [59829, 0.015607, " important", false], [51039, 0.01405, " biggest", false], [46, 0.014009, "-", false]]]}, "raw_delta": -0.05859375, "tuned_delta": -0.0057388061018001785}, {"byte_start": 5914, "byte_end": 5919, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1014, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "2.07% 2.07% 2.07% 2.07% 2.07%", "model_b": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.5605869889259338]], "model_b": [[32227, " that", "normal", 0.5430541038513184]]}, "loss": {"model_a": 2.0710563575261483, "model_b": 2.141500451319555}, "topk": {"model_a": [32227, 1, 0.5605869889259338, [[32227, 0.560587, " that", false], [31461, 0.038841, " most", false], [45, 0.038774, ",", false], [4596, 0.036157, " in", false], [60003, 0.034913, " mentioned", false], [21286, 0.027814, " are", false], [4706, 0.026996, " of", false], [59546, 0.020205, " discussed", false], [5346, 0.016243, "---", false], [4858, 0.015334, " we", false]]], "model_b": [32227, 1, 0.5430541038513184, [[32227, 0.543054, " that", false], [4706, 0.059561, " of", false], [31461, 0.044783, " most", false], [4596, 0.034774, " in", false], [21286, 0.030687, " are", false], [45, 0.028833, ",", false], [60003, 0.026279, " mentioned", false], [4858, 0.011292, " we", false], [21700, 0.011172, " for", false], [59546, 0.009987, " discussed", false]]]}, "raw_delta": -0.00390625, "tuned_delta": 0.04894869389819982}, {"byte_start": 5919, "byte_end": 5924, "display": {"text": " seem", "kind": "normal"}, "is_word": true, "word_id": 1015, "word_key": " seem", "bytes_hex": "20 73 65 65 6d", "compression": {"model_a": "17.81% 17.81% 17.81% 17.81% 17.81%", "model_b": "18.94% 18.94% 18.94% 18.94% 18.94%"}, "model_tokens": {"model_a": [[31967, " seem", "normal", 0.007224781904369593]], "model_b": [[31967, " seem", "normal", 0.0053069875575602055]]}, "loss": {"model_a": 17.808266910973142, "model_b": 18.935372411667643}, "topk": {"model_a": [31967, 17, 0.007224781904369593, [[31059, 0.245231, " have", false], [21286, 0.092421, " are", false], [56041, 0.089449, " dominate", false], [22777, 0.043514, " won", false], [56540, 0.035016, " leverage", false], [22770, 0.023828, " win", false], [39590, 0.019967, " scale", false], [4491, 0.01991, " do", false], [31461, 0.016144, " most", false], [52597, 0.013332, " provide", false]]], "model_b": [31967, 30, 0.0053069875575602055, [[31059, 0.1188, " have", false], [21286, 0.086141, " are", false], [32462, 0.070374, " were", false], [31461, 0.048436, " most", false], [59572, 0.046493, " dominated", false], [30383, 0.02285, " came", false], [56041, 0.02215, " dominate", false], [21994, 0.021849, " led", false], [31351, 0.02161, " made", false], [32475, 0.016462, " will", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 5924, "byte_end": 5927, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1016, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "2.90% 2.90% 2.90%", "model_b": "2.08% 2.08% 2.08%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.6188631057739258]], "model_b": [[4811, " to", "normal", 0.7094117403030396]]}, "loss": {"model_a": 2.8999485278285637, "model_b": 2.078100766905489}, "topk": {"model_a": [4811, 1, 0.6188631057739258, [[4811, 0.618863, " to", false], [31461, 0.199723, " most", false], [30273, 0.020028, " best", false], [46439, 0.018644, " likely", false], [22590, 0.012985, " the", false], [31296, 0.009549, " like", false], [55971, 0.008532, " destined", false], [45, 0.007176, ",", false], [61953, 0.006018, " especially", false], [64507, 0.004086, " particularly", false]]], "model_b": [4811, 1, 0.7094117403030396, [[4811, 0.709412, " to", false], [31461, 0.131879, " most", false], [22590, 0.020382, " the", false], [30273, 0.013539, " best", false], [64507, 0.011202, " particularly", false], [46439, 0.010556, " likely", false], [31296, 0.009147, " like", false], [38879, 0.004853, " least", false], [61953, 0.004299, " especially", false], [55971, 0.003983, " destined", false]]]}, "raw_delta": 0.04557291666666666, "tuned_delta": 0.09842786056486648}, {"byte_start": 5927, "byte_end": 5933, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 1017, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"model_a": "13.90% 13.90% 13.90% 13.90% 13.90% 13.90%", "model_b": "20.01% 20.01% 20.01% 20.01% 20.01% 20.01%"}, "model_tokens": {"model_a": [[39590, " scale", "normal", 0.009887528605759144]], "model_b": [[39590, " scale", "normal", 0.0012743016704916954]]}, "loss": {"model_a": 13.900967841898865, "model_b": 20.00612263732742}, "topk": {"model_a": [39590, 12, 0.009887528605759144, [[4435, 0.224231, " be", false], [31059, 0.188983, " have", false], [56041, 0.087575, " dominate", false], [4491, 0.032721, " do", false], [22770, 0.029415, " win", false], [32499, 0.025858, " work", false], [52597, 0.02024, " provide", false], [39169, 0.016415, " offer", false], [4660, 0.015284, " me", false], [31461, 0.014894, " most", false]]], "model_b": [39590, 61, 0.0012743016704916954, [[4435, 0.335181, " be", false], [31059, 0.193648, " have", false], [56041, 0.097275, " dominate", false], [32499, 0.016571, " work", false], [31358, 0.012322, " make", false], [4491, 0.010988, " do", false], [31461, 0.010109, " most", false], [30482, 0.009574, " come", false], [39797, 0.009309, " stand", false], [30273, 0.008793, " best", false]]]}, "raw_delta": -0.3385416666666666, "tuned_delta": -0.28568672276846674}, {"byte_start": 5933, "byte_end": 5945, "display": {"text": " arbitrarily", "kind": "normal"}, "is_word": true, "word_id": 1018, "word_key": " arbitrarily", "bytes_hex": "20 61 72 62 69 74 72 61 72 69 6c 79", "compression": {"model_a": "16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34%", "model_b": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"model_a": [[63293, " arbitrarily", "normal", 1.8695352991926484e-05]], "model_b": [[63293, " arbitrarily", "normal", 0.00022085424279794097]]}, "loss": {"model_a": 16.343029760070287, "model_b": 12.679936882813154}, "topk": {"model_a": [63293, 485, 1.8695352991926484e-05, [[30273, 0.24762, " best", false], [31461, 0.1851, " most", false], [32487, 0.121535, " with", false], [22590, 0.087206, " the", false], [4596, 0.069772, " in", false], [21286, 0.030094, " are", false], [32234, 0.019556, " this", false], [4811, 0.017016, " to", false], [45, 0.012342, ",", false], [4788, 0.011947, " so", false]]], "model_b": [63293, 211, 0.00022085424279794097, [[30273, 0.162416, " best", false], [32458, 0.121651, " well", false], [22590, 0.110565, " the", false], [31461, 0.091273, " most", false], [32487, 0.089879, " with", false], [32386, 0.027849, " very", false], [4596, 0.024829, " in", false], [45301, 0.020598, " better", false], [51718, 0.020307, " fastest", false], [4423, 0.013413, " as", false]]]}, "raw_delta": 0.203125, "tuned_delta": 0.25597994389819984}, {"byte_start": 5945, "byte_end": 5948, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1019, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "25.36% 25.36% 25.36%", "model_b": "23.48% 23.48% 23.48%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.014601743780076504]], "model_b": [[4596, " in", "normal", 0.020022490993142128]]}, "loss": {"model_a": 25.359873765626308, "model_b": 23.481364597802134}, "topk": {"model_a": [4596, 7, 0.014601743780076504, [[32458, 0.53993, " well", false], [21286, 0.168564, " are", false], [45, 0.073744, ",", false], [32487, 0.065054, " with", false], [5346, 0.020241, "---", false], [30826, 0.016679, " fast", false], [4596, 0.014602, " in", false], [275, 0.010519, " (", false], [21265, 0.00855, " and", false], [31466, 0.006843, " much", false]]], "model_b": [4596, 6, 0.020022490993142128, [[32458, 0.639265, " well", false], [21286, 0.071104, " are", false], [32487, 0.055871, " with", false], [30826, 0.040919, " fast", false], [45, 0.025143, ",", false], [4596, 0.020022, " in", false], [52628, 0.014153, " quickly", false], [21265, 0.00746, " and", false], [4423, 0.007176, " as", false], [38864, 0.007099, " large", false]]]}, "raw_delta": 0.10416666666666674, "tuned_delta": 0.15702161056486658}, {"byte_start": 5948, "byte_end": 5953, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1020, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "1.87% 1.87% 1.87% 1.87% 1.87%", "model_b": "7.89% 7.89% 7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.5927859544754028]], "model_b": [[32234, " this", "normal", 0.11190338432788849]]}, "loss": {"model_a": 1.8738128949046107, "model_b": 7.889738504861517}, "topk": {"model_a": [32234, 1, 0.5927859544754028, [[32234, 0.592786, " this", false], [22590, 0.086025, " the", false], [32227, 0.037827, " that", false], [39339, 0.035355, " power", false], [332, 0.029056, " a", false], [21256, 0.017115, " all", false], [3609, 0.016043, " AI", false], [63370, 0.014001, " computation", false], [39931, 0.011707, " their", false], [39920, 0.011661, " terms", false]]], "model_b": [32234, 2, 0.11190338432788849, [[22590, 0.34562, " the", false], [32234, 0.111903, " this", false], [56901, 0.060235, " practice", false], [3609, 0.034883, " AI", false], [51832, 0.031766, " general", false], [32251, 0.031298, " time", false], [55809, 0.024486, " computer", false], [39920, 0.020089, " terms", false], [332, 0.019825, " a", false], [39339, 0.014915, " power", false]]]}, "raw_delta": -0.33359375, "tuned_delta": -0.2807388061018002}, {"byte_start": 5953, "byte_end": 5957, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 1021, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"model_a": "0.99% 0.99% 0.99% 0.99%", "model_b": "6.09% 6.09% 6.09% 6.09%"}, "model_tokens": {"model_a": [[22752, " way", "normal", 0.802659273147583]], "model_b": [[22752, " way", "normal", 0.2594517171382904]]}, "loss": {"model_a": 0.9906200689697776, "model_b": 6.093414113129654}, "topk": {"model_a": [22752, 1, 0.802659273147583, [[22752, 0.802659, " way", false], [51717, 0.053244, " fashion", false], [46505, 0.04428, " manner", false], [39631, 0.027316, " sense", false], [47043, 0.023033, " regard", false], [52731, 0.017141, " respect", false], [59526, 0.008744, " direction", false], [51310, 0.002876, " context", false], [32375, 0.002083, " vein", false], [30405, 0.001965, " case", false]]], "model_b": [22752, 1, 0.2594517171382904, [[22752, 0.259452, " way", false], [52731, 0.213546, " respect", false], [47043, 0.16237, " regard", false], [39631, 0.111307, " sense", false], [59526, 0.046427, " direction", false], [46505, 0.041878, " manner", false], [51717, 0.026391, " fashion", false], [51310, 0.024967, " context", false], [30405, 0.009652, " case", false], [47045, 0.007085, " regime", false]]]}, "raw_delta": -0.282958984375, "tuned_delta": -0.23010404047680016}, {"byte_start": 5957, "byte_end": 5961, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1022, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "0.91% 0.91% 0.91% 0.91%", "model_b": "1.88% 1.88% 1.88% 1.88%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.8155147433280945]], "model_b": [[21286, " are", "normal", 0.6551818251609802]]}, "loss": {"model_a": 0.9113704634521954, "model_b": 1.8843795089736215}, "topk": {"model_a": [21286, 1, 0.8155147433280945, [[21286, 0.815515, " are", false], [45, 0.088175, ",", false], [5346, 0.027272, "---", false], [4596, 0.012466, " in", false], [275, 0.011901, " (", false], [21265, 0.00843, " and", false], [31059, 0.003964, " have", false], [21700, 0.00193, " for", false], [32227, 0.001569, " that", false], [32462, 0.001541, " were", false]]], "model_b": [21286, 1, 0.6551818251609802, [[21286, 0.655182, " are", false], [45, 0.132472, ",", false], [5346, 0.0479, "---", false], [275, 0.022097, " (", false], [32462, 0.019868, " were", false], [31059, 0.018138, " have", false], [4596, 0.011671, " in", false], [568, 0.009593, "--", false], [21265, 0.007748, " and", false], [51987, 0.005461, " include", false]]]}, "raw_delta": -0.053955078125, "tuned_delta": -0.0011001342268001785}, {"byte_start": 5961, "byte_end": 5968, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1023, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "1.98% 1.98% 1.98% 1.98% 1.98% 1.98% 1.98%", "model_b": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.46652165055274963]], "model_b": [[47202, " search", "normal", 0.12801921367645264]]}, "loss": {"model_a": 1.9824980681858662, "model_b": 5.273243592534995}, "topk": {"model_a": [47202, 1, 0.46652165055274963, [[47202, 0.466522, " search", false], [56537, 0.209744, " learning", false], [30597, 0.063982, " deep", false], [22590, 0.024934, " the", false], [51832, 0.019645, " general", false], [52224, 0.013753, " methods", false], [59, 0.011958, ":", false], [275, 0.011808, " (", false], [284, 0.011792, " 1", false], [45, 0.009657, ",", false]]], "model_b": [47202, 2, 0.12801921367645264, [[30597, 0.305391, " deep", false], [47202, 0.128019, " search", false], [56537, 0.062627, " learning", false], [22590, 0.049917, " the", false], [46658, 0.035381, " neural", false], [51832, 0.021637, " general", false], [52167, 0.021371, " machine", false], [65003, 0.016191, " reinforcement", false], [52195, 0.013896, " massive", false], [28753, 0.010792, " Deep", false]]]}, "raw_delta": -0.1824776785714286, "tuned_delta": -0.12962273467322877}, {"byte_start": 5968, "byte_end": 5972, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1024, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "0.81% 0.81% 0.81% 0.81%", "model_b": "1.89% 1.89% 1.89% 1.89%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.8348367214202881]], "model_b": [[21265, " and", "normal", 0.6555535197257996]]}, "loss": {"model_a": 0.8101070786241737, "model_b": 1.8931850206977971}, "topk": {"model_a": [21265, 1, 0.8348367214202881, [[21265, 0.834837, " and", false], [45, 0.042921, ",", false], [275, 0.038238, " (", false], [4450, 0.016255, " by", false], [52224, 0.008695, " methods", false], [21700, 0.008643, " for", false], [4596, 0.007697, " in", false], [46, 0.007645, "-", false], [48, 0.007489, "/", false], [5346, 0.005259, "---", false]]], "model_b": [21265, 1, 0.6555535197257996, [[21265, 0.655554, " and", false], [4450, 0.107473, " by", false], [45, 0.062937, ",", false], [46, 0.037404, "-", false], [275, 0.03134, " (", false], [52224, 0.029604, " methods", false], [37810, 0.018898, " based", false], [4596, 0.006183, " in", false], [61559, 0.00507, " algorithms", false], [4423, 0.003749, " as", false]]]}, "raw_delta": -0.06005859375, "tuned_delta": -0.0072036498518001785}, {"byte_start": 5972, "byte_end": 5981, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 1025, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.952091634273529]], "model_b": [[56537, " learning", "normal", 0.7469292879104614]]}, "loss": {"model_a": 0.09881740934908398, "model_b": 0.5870341149450534}, "topk": {"model_a": [56537, 1, 0.952091634273529, [[56537, 0.952092, " learning", false], [30597, 0.008949, " deep", false], [31978, 0.007388, " self", false], [63885, 0.00371, " statistical", false], [63370, 0.002517, " computation", false], [22590, 0.00219, " the", false], [62577, 0.002126, " statistics", false], [52167, 0.001799, " machine", false], [45, 0.00138, ",", false], [51832, 0.000951, " general", false]]], "model_b": [56537, 1, 0.7469292879104614, [[56537, 0.746929, " learning", false], [30597, 0.083072, " deep", false], [65135, 0.030154, " generalization", false], [51832, 0.026597, " general", false], [52167, 0.011836, " machine", false], [31978, 0.010438, " self", false], [46658, 0.005244, " neural", false], [63370, 0.004824, " computation", false], [22590, 0.004709, " the", false], [63885, 0.003757, " statistical", false]]]}, "raw_delta": -0.02707248263888889, "tuned_delta": 0.02578246125931093}, {"byte_start": 5981, "byte_end": 5982, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "6.97%", "model_b": "9.58%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6799267530441284]], "model_b": [[47, ".", "normal", 0.5903457403182983]]}, "loss": {"model_a": 6.9739652855472345, "model_b": 9.580396755903271}, "topk": {"model_a": [47, 1, 0.6799267530441284, [[47, 0.679927, ".", false], [45, 0.129119, ",", false], [4450, 0.089637, " by", false], [5346, 0.043321, "---", false], [275, 0.021155, " (", false], [60, 0.007595, ";", false], [37810, 0.004295, " based", false], [4596, 0.002568, " in", false], [22705, 0.002472, " via", false], [59, 0.002444, ":", false]]], "model_b": [47, 1, 0.5903457403182983, [[47, 0.590346, ".", false], [4450, 0.157851, " by", false], [45, 0.151121, ",", false], [275, 0.018267, " (", false], [4596, 0.014825, " in", false], [5346, 0.00767, "---", false], [4712, 0.007089, " on", false], [4706, 0.005371, " of", false], [60, 0.004862, ";", false], [4423, 0.003983, " as", false]]]}, "raw_delta": -0.14453125, "tuned_delta": -0.09167630610180018}, {"byte_start": 5982, "byte_end": 5983, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "29.73%", "model_b": "31.42%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.03706193342804909]], "model_b": [[261, "\n\n", "control", 0.030500805005431175]]}, "loss": {"model_a": 29.727407580817506, "model_b": 31.41806583185926}, "topk": {"model_a": [261, 5, 0.03706193342804909, [[20996, 0.12684, " The", false], [44844, 0.076067, " Search", false], [37453, 0.073632, " These", false], [29893, 0.053759, " They", false], [261, 0.037062, "\n\n", false], [3913, 0.037005, " In", false], [28530, 0.032893, " Both", false], [29894, 0.031102, " This", false], [3918, 0.02905, " It", false], [37451, 0.027955, " There", false]]], "model_b": [261, 8, 0.030500805005431175, [[20996, 0.127131, " The", false], [44844, 0.066171, " Search", false], [37453, 0.059307, " These", false], [3913, 0.049243, " In", false], [29894, 0.045524, " This", false], [29893, 0.036254, " They", false], [3918, 0.031884, " It", false], [261, 0.030501, "\n\n", false], [19417, 0.023107, " And", false], [4331, 0.023058, " We", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.04089505610180018}, {"byte_start": 5983, "byte_end": 5984, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "29.73%", "model_b": "31.42%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.03706193342804909]], "model_b": [[261, "\n\n", "control", 0.030500805005431175]]}, "loss": {"model_a": 29.727407580817506, "model_b": 31.41806583185926}, "topk": {"model_a": [261, 5, 0.03706193342804909, [[20996, 0.12684, " The", false], [44844, 0.076067, " Search", false], [37453, 0.073632, " These", false], [29893, 0.053759, " They", false], [261, 0.037062, "\n\n", false], [3913, 0.037005, " In", false], [28530, 0.032893, " Both", false], [29894, 0.031102, " This", false], [3918, 0.02905, " It", false], [37451, 0.027955, " There", false]]], "model_b": [261, 8, 0.030500805005431175, [[20996, 0.127131, " The", false], [44844, 0.066171, " Search", false], [37453, 0.059307, " These", false], [3913, 0.049243, " In", false], [29894, 0.045524, " This", false], [29893, 0.036254, " They", false], [3918, 0.031884, " It", false], [261, 0.030501, "\n\n", false], [19417, 0.023107, " And", false], [4331, 0.023058, " We", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.04089505610180018}, {"byte_start": 5984, "byte_end": 5987, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 1026, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"model_a": "10.57% 10.57% 10.57%", "model_b": "12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[6699, "The", "normal", 0.17412428557872772]], "model_b": [[6699, "The", "normal", 0.12846434116363525]]}, "loss": {"model_a": 10.566614069010962, "model_b": 12.398160507639528}, "topk": {"model_a": [6699, 1, 0.17412428557872772, [[6699, 0.174124, "The", false], [48358, 0.078606, "Another", false], [1136, 0.063174, "In", false], [66, 0.06082, "A", false], [33504, 0.043227, "There", false], [40754, 0.040798, "Search", false], [24242, 0.031296, "This", false], [1141, 0.029763, "It", false], [1589, 0.025991, "We", false], [5658, 0.020829, "But", false]]], "model_b": [6699, 1, 0.12846434116363525, [[6699, 0.128464, "The", false], [24100, 0.052748, "Rich", false], [60897, 0.042348, "References", false], [40754, 0.036733, "Search", false], [1136, 0.034755, "In", false], [24242, 0.029958, "This", false], [33504, 0.022382, "There", false], [6393, 0.020846, "One", false], [66, 0.019672, "A", false], [1141, 0.012684, "It", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 5987, "byte_end": 5994, "display": {"text": " second", "kind": "normal"}, "is_word": true, "word_id": 1027, "word_key": " second", "bytes_hex": "20 73 65 63 6f 6e 64", "compression": {"model_a": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%", "model_b": "9.82% 9.82% 9.82% 9.82% 9.82% 9.82% 9.82%"}, "model_tokens": {"model_a": [[47205, " second", "normal", 0.07765278965234756]], "model_b": [[47205, " second", "normal", 0.022051727399230003]]}, "loss": {"model_a": 6.561364164757282, "model_b": 9.821919363194949}, "topk": {"model_a": [47205, 2, 0.07765278965234756, [[39193, 0.10866, " other", false], [47205, 0.077653, " second", false], [45315, 0.066224, " bitter", false], [47202, 0.027522, " search", false], [38499, 0.025176, " first", false], [46430, 0.024738, " lesson", false], [31515, 0.02133, " next", false], [19523, 0.018791, " Bit", false], [31461, 0.016931, " most", false], [45184, 0.016371, " appeal", false]]], "model_b": [47205, 5, 0.022051727399230003, [[45315, 0.190955, " bitter", false], [19523, 0.124299, " Bit", false], [39193, 0.033055, " other", false], [38499, 0.024276, " first", false], [47205, 0.022052, " second", false], [61640, 0.019732, " bitterness", false], [46430, 0.016931, " lesson", false], [31461, 0.016842, " most", false], [31515, 0.013313, " next", false], [22638, 0.011452, " two", false]]]}, "raw_delta": -0.1808035714285714, "tuned_delta": -0.12794862753037156}, {"byte_start": 5994, "byte_end": 6002, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 1028, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "12.47% 12.47% 12.47% 12.47% 12.47% 12.47% 12.47% 12.47%", "model_b": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.0040090857073664665]], "model_b": [[51832, " general", "normal", 0.006038366816937923]]}, "loss": {"model_a": 12.468604601432935, "model_b": 11.55283138211865}, "topk": {"model_a": [51832, 20, 0.0040090857073664665, [[46430, 0.424224, " lesson", false], [39941, 0.308201, " thing", false], [21357, 0.034534, " big", false], [59829, 0.028154, " important", false], [45, 0.024413, ",", false], [38629, 0.020566, " great", false], [45315, 0.015041, " bitter", false], [4600, 0.011395, " is", false], [38961, 0.011146, " major", false], [21365, 0.008417, " bit", false]]], "model_b": [51832, 24, 0.006038366816937923, [[46430, 0.161736, " lesson", false], [59829, 0.136222, " important", false], [39941, 0.086031, " thing", false], [21357, 0.035364, " big", false], [39310, 0.034302, " point", false], [38961, 0.033234, " major", false], [31633, 0.031134, " part", false], [4600, 0.026348, " is", false], [31461, 0.021473, " most", false], [32115, 0.016938, " step", false]]]}, "raw_delta": 0.05078125, "tuned_delta": 0.10363619389819982}, {"byte_start": 6002, "byte_end": 6008, "display": {"text": " point", "kind": "normal"}, "is_word": true, "word_id": 1029, "word_key": " point", "bytes_hex": "20 70 6f 69 6e 74", "compression": {"model_a": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "model_b": "20.10% 20.10% 20.10% 20.10% 20.10% 20.10%"}, "model_tokens": {"model_a": [[39310, " point", "normal", 0.014528748579323292]], "model_b": [[39310, " point", "normal", 0.0012440521968528628]]}, "loss": {"model_a": 12.679936882813154, "model_b": 20.100048095718627}, "topk": {"model_a": [39310, 5, 0.014528748579323292, [[46430, 0.812103, " lesson", false], [46561, 0.039196, " method", false], [60250, 0.018576, " principle", false], [63729, 0.016949, " observation", false], [39310, 0.014529, " point", false], [52022, 0.009583, " insight", false], [38046, 0.00708, " class", false], [46, 0.00582, "-", false], [61735, 0.005255, " conclusion", false], [52610, 0.00508, " purpose", false]]], "model_b": [39310, 29, 0.0012440521968528628, [[52610, 0.392581, " purpose", false], [46, 0.178759, "-", false], [46561, 0.162494, " method", false], [46430, 0.043698, " lesson", false], [60250, 0.04147, " principle", false], [55532, 0.018281, " approach", false], [45, 0.010862, ",", false], [22752, 0.006442, " way", false], [38046, 0.005975, " class", false], [7933, 0.005968, "ity", false]]]}, "raw_delta": -0.4114583333333332, "tuned_delta": -0.35860338943513337}, {"byte_start": 6008, "byte_end": 6011, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1030, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "12.87% 12.87% 12.87%", "model_b": "12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.1159430667757988]], "model_b": [[4811, " to", "normal", 0.1260164976119995]]}, "loss": {"model_a": 12.86778779959557, "model_b": 12.398160507639528}, "topk": {"model_a": [4811, 3, 0.1159430667757988, [[4600, 0.542428, " is", false], [32227, 0.152021, " that", false], [4811, 0.115943, " to", false], [45, 0.034817, ",", false], [4706, 0.029491, " of", false], [4858, 0.019619, " we", false], [30917, 0.018906, " from", false], [47266, 0.010903, " should", false], [37598, 0.010146, " about", false], [21800, 0.005024, " has", false]]], "model_b": [4811, 2, 0.1260164976119995, [[4600, 0.492258, " is", false], [4811, 0.126016, " to", false], [4706, 0.086831, " of", false], [32227, 0.083312, " that", false], [37598, 0.031041, " about", false], [45, 0.024347, ",", false], [30917, 0.023627, " from", false], [4596, 0.022776, " in", false], [4858, 0.009326, " we", false], [308, 0.009312, " I", false]]]}, "raw_delta": 0.02604166666666663, "tuned_delta": 0.07889661056486645}, {"byte_start": 6011, "byte_end": 6014, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1031, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "5.12% 5.12% 5.12%", "model_b": "5.80% 5.80% 5.80%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.4284442663192749]], "model_b": [[4435, " be", "normal", 0.38262802362442017]]}, "loss": {"model_a": 5.118937482320866, "model_b": 5.799897055657127}, "topk": {"model_a": [4435, 1, 0.4284442663192749, [[4435, 0.428444, " be", false], [38877, 0.246714, " learn", false], [32187, 0.118476, " take", false], [31539, 0.031807, " note", false], [31358, 0.029563, " make", false], [62683, 0.02096, " understand", false], [30681, 0.014464, " draw", false], [38625, 0.00856, " grasp", false], [45846, 0.008558, " emerge", false], [30482, 0.008042, " come", false]]], "model_b": [4435, 1, 0.38262802362442017, [[4435, 0.382628, " be", false], [32187, 0.138045, " take", false], [38877, 0.092672, " learn", false], [31358, 0.076718, " make", false], [30681, 0.04365, " draw", false], [31539, 0.037066, " note", false], [45846, 0.032117, " emerge", false], [57083, 0.021425, " remember", false], [55832, 0.01412, " consider", false], [22449, 0.012537, " see", false]]]}, "raw_delta": -0.03776041666666663, "tuned_delta": 0.015094527231533192}, {"byte_start": 6014, "byte_end": 6022, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 1032, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"model_a": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "model_b": "2.15% 2.15% 2.15% 2.15% 2.15% 2.15% 2.15% 2.15%"}, "model_tokens": {"model_a": [[52112, " learned", "normal", 0.824234664440155]], "model_b": [[52112, " learned", "normal", 0.3857969343662262]]}, "loss": {"model_a": 0.4336714524156582, "model_b": 2.1485448606988955}, "topk": {"model_a": [52112, 1, 0.824234664440155, [[52112, 0.824235, " learned", false], [31351, 0.074261, " made", false], [38297, 0.033836, " drawn", false], [51438, 0.011373, " derived", false], [39887, 0.009441, " taken", false], [62684, 0.006686, " understood", false], [59697, 0.006147, " extracted", false], [39140, 0.003698, " noted", false], [46071, 0.00298, " gained", false], [31968, 0.002094, " seen", false]]], "model_b": [52112, 1, 0.3857969343662262, [[52112, 0.385797, " learned", false], [31351, 0.311686, " made", false], [39887, 0.047178, " taken", false], [38297, 0.041412, " drawn", false], [39140, 0.019116, " noted", false], [61934, 0.017914, " emphasized", false], [21762, 0.015496, " gle", false], [62684, 0.008347, " understood", false], [61755, 0.007096, " considered", false], [62479, 0.006382, " remembered", false]]]}, "raw_delta": -0.0950927734375, "tuned_delta": -0.04223782953930018}, {"byte_start": 6022, "byte_end": 6027, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 1033, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"model_a": "3.34% 3.34% 3.34% 3.34% 3.34%", "model_b": "3.69% 3.69% 3.69% 3.69% 3.69%"}, "model_tokens": {"model_a": [[30917, " from", "normal", 0.3960491716861725]], "model_b": [[30917, " from", "normal", 0.359998881816864]]}, "loss": {"model_a": 3.339050045807464, "model_b": 3.6912705147744957}, "topk": {"model_a": [30917, 2, 0.3960491716861725, [[4600, 0.541153, " is", false], [30917, 0.396049, " from", false], [45, 0.020766, ",", false], [4450, 0.006813, " by", false], [37598, 0.004397, " about", false], [31077, 0.004173, " here", false], [4596, 0.003639, " in", false], [21800, 0.002632, " has", false], [47266, 0.002051, " should", false], [52694, 0.001588, " relates", false]]], "model_b": [30917, 2, 0.359998881816864, [[4600, 0.547813, " is", false], [30917, 0.359999, " from", false], [4596, 0.019646, " in", false], [45, 0.018889, ",", false], [37598, 0.008936, " about", false], [4450, 0.00467, " by", false], [31077, 0.003713, " here", false], [55817, 0.003186, " concerns", false], [5346, 0.002384, "---", false], [275, 0.002363, " (", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03332369389819982}, {"byte_start": 6027, "byte_end": 6031, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1034, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.01% 1.01% 1.01% 1.01%", "model_b": "1.89% 1.89% 1.89% 1.89%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.7996769547462463]], "model_b": [[22590, " the", "normal", 0.65935879945755]]}, "loss": {"model_a": 1.0082310924181292, "model_b": 1.8931850206977971}, "topk": {"model_a": [22590, 1, 0.7996769547462463, [[22590, 0.799677, " the", false], [32234, 0.126687, " this", false], [45315, 0.016075, " bitter", false], [39936, 0.012431, " these", false], [3609, 0.005838, " AI", false], [51929, 0.00381, " history", false], [3543, 0.003186, " 70", false], [21256, 0.002449, " all", false], [62061, 0.00193, " historical", false], [31636, 0.001773, " past", false]]], "model_b": [22590, 1, 0.65935879945755, [[22590, 0.659359, " the", false], [32234, 0.276609, " this", false], [3609, 0.012171, " AI", false], [39936, 0.01136, " these", false], [45315, 0.003199, " bitter", false], [21256, 0.001723, " all", false], [52195, 0.001426, " massive", false], [55809, 0.001336, " computer", false], [32227, 0.001328, " that", false], [51929, 0.00125, " history", false]]]}, "raw_delta": -0.049072265625, "tuned_delta": 0.0037826782731998215}, {"byte_start": 6031, "byte_end": 6038, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 1035, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09%", "model_b": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.9648310542106628]], "model_b": [[45315, " bitter", "normal", 0.908475935459137]]}, "loss": {"model_a": 0.0918289079806905, "model_b": 0.2503281190158549}, "topk": {"model_a": [45315, 1, 0.9648310542106628, [[45315, 0.964831, " bitter", false], [61640, 0.009503, " bitterness", false], [51929, 0.002831, " history", false], [21365, 0.001909, " bit", false], [62061, 0.001521, " historical", false], [19523, 0.00117, " Bit", false], [31636, 0.001156, " past", false], [52127, 0.001067, " lessons", false], [46430, 0.000922, " lesson", false], [52427, 0.000573, " pattern", false]]], "model_b": [45315, 1, 0.908475935459137, [[45315, 0.908476, " bitter", false], [19523, 0.013777, " Bit", false], [61640, 0.010368, " bitterness", false], [51929, 0.00867, " history", false], [46430, 0.004193, " lesson", false], [3609, 0.003232, " AI", false], [21365, 0.002868, " bit", false], [37599, 0.002789, " above", false], [31636, 0.002537, " past", false], [52127, 0.001607, " lessons", false]]]}, "raw_delta": -0.0087890625, "tuned_delta": 0.04406588139819982}, {"byte_start": 6038, "byte_end": 6045, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 1036, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%", "model_b": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.9476190209388733]], "model_b": [[46430, " lesson", "normal", 0.9774532318115234]]}, "loss": {"model_a": 0.13774336197103573, "model_b": 0.05880823901503125}, "topk": {"model_a": [46430, 1, 0.9476190209388733, [[46430, 0.947619, " lesson", false], [52127, 0.046093, " lessons", false], [61979, 0.002733, " experience", false], [46, 0.000518, "-", false], [26127, 0.000192, "less", false], [39899, 0.000164, " taste", false], [31636, 0.00013, " past", false], [51929, 0.000115, " history", false], [39831, 0.000109, " story", false], [4600, 0.000105, " is", false]]], "model_b": [46430, 1, 0.9774532318115234, [[46430, 0.977453, " lesson", false], [46, 0.006995, "-", false], [52127, 0.005646, " lessons", false], [61979, 0.002277, " experience", false], [51929, 0.000815, " history", false], [31333, 0.000622, " loss", false], [26127, 0.000256, "less", false], [65126, 0.000231, " disappointment", false], [31277, 0.000216, " less", false], [45, 0.000201, ",", false]]]}, "raw_delta": 0.004377092633928571, "tuned_delta": 0.05723203653212839}, {"byte_start": 6045, "byte_end": 6048, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1037, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "0.31% 0.31% 0.31%", "model_b": "0.55% 0.55% 0.55%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.9492695927619934]], "model_b": [[4600, " is", "normal", 0.9125254154205322]]}, "loss": {"model_a": 0.3125956662082409, "model_b": 0.5518120680483501}, "topk": {"model_a": [4600, 1, 0.9492695927619934, [[4600, 0.94927, " is", false], [45, 0.017873, ",", false], [21800, 0.004211, " has", false], [4706, 0.004073, " of", false], [55817, 0.003416, " concerns", false], [4596, 0.002434, " in", false], [47266, 0.002244, " should", false], [37598, 0.001397, " about", false], [32227, 0.001281, " that", false], [275, 0.001245, " (", false]]], "model_b": [4600, 1, 0.9125254154205322, [[4600, 0.912525, " is", false], [4706, 0.020361, " of", false], [45, 0.018265, ",", false], [52694, 0.006189, " relates", false], [55817, 0.004713, " concerns", false], [4596, 0.004494, " in", false], [37598, 0.003289, " about", false], [5346, 0.003194, "---", false], [275, 0.001943, " (", false], [21800, 0.001939, " has", false]]]}, "raw_delta": -0.013264973958333334, "tuned_delta": 0.039589969939866486}, {"byte_start": 6048, "byte_end": 6053, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1038, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.08% 1.08% 1.08% 1.08% 1.08%", "model_b": "1.20% 1.20% 1.20% 1.20% 1.20%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.7404853701591492]], "model_b": [[32227, " that", "normal", 0.7134303450584412]]}, "loss": {"model_a": 1.077794635039118, "model_b": 1.2045940038672498}, "topk": {"model_a": [32227, 1, 0.7404853701591492, [[32227, 0.740485, " that", false], [22590, 0.151242, " the", false], [21835, 0.018109, " how", false], [4811, 0.016803, " to", false], [32234, 0.011967, " this", false], [332, 0.010373, " a", false], [37598, 0.005974, " about", false], [45, 0.005306, ",", false], [32464, 0.004766, " what", false], [4419, 0.002472, " an", false]]], "model_b": [32227, 1, 0.7134303450584412, [[32227, 0.71343, " that", false], [22590, 0.150942, " the", false], [4811, 0.043339, " to", false], [32234, 0.017664, " this", false], [21835, 0.009953, " how", false], [22187, 0.006641, " not", false], [332, 0.006151, " a", false], [37598, 0.003754, " about", false], [32464, 0.002511, " what", false], [45, 0.001971, ",", false]]]}, "raw_delta": -0.007031250000000003, "tuned_delta": 0.04582369389819982}, {"byte_start": 6053, "byte_end": 6057, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1039, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.89% 7.89% 7.89% 7.89%", "model_b": "8.38% 8.38% 8.38% 8.38%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.1748410016298294]], "model_b": [[22590, " the", "normal", 0.15479716658592224]]}, "loss": {"model_a": 7.889738504861517, "model_b": 8.382847161415363}, "topk": {"model_a": [22590, 1, 0.1748410016298294, [[22590, 0.174841, " the", false], [45, 0.060123, ",", false], [4601, 0.059038, " it", false], [38720, 0.054901, " human", false], [39934, 0.051321, " there", false], [4858, 0.03502, " we", false], [4596, 0.0242, " in", false], [52224, 0.019709, " methods", false], [332, 0.017632, " a", false], [56537, 0.015693, " learning", false]]], "model_b": [22590, 1, 0.15479716658592224, [[22590, 0.154797, " the", false], [39934, 0.055198, " there", false], [4601, 0.052815, " it", false], [3609, 0.051109, " AI", false], [4858, 0.041662, " we", false], [45, 0.034385, ",", false], [4596, 0.021727, " in", false], [38720, 0.020338, " human", false], [32465, 0.018241, " when", false], [332, 0.016659, " a", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.02551119389819982}, {"byte_start": 6057, "byte_end": 6064, "display": {"text": " actual", "kind": "normal"}, "is_word": true, "word_id": 1040, "word_key": " actual", "bytes_hex": "20 61 63 74 75 61 6c", "compression": {"model_a": "18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60%", "model_b": "19.89% 19.89% 19.89% 19.89% 19.89% 19.89% 19.89%"}, "model_tokens": {"model_a": [[45098, " actual", "normal", 0.0007230545161291957]], "model_b": [[45098, " actual", "normal", 0.0004469075647648424]]}, "loss": {"model_a": 18.597240761459293, "model_b": 19.88536133368158}, "topk": {"model_a": [45098, 203, 0.0007230545161291957, [[38720, 0.100432, " human", false], [52224, 0.044905, " methods", false], [31461, 0.032328, " most", false], [22638, 0.028217, " two", false], [45184, 0.022037, " appeal", false], [47202, 0.017538, " search", false], [30273, 0.016056, " best", false], [22752, 0.013919, " way", false], [45315, 0.011766, " bitter", false], [22681, 0.011552, " use", false]]], "model_b": [45098, 338, 0.0004469075647648424, [[38720, 0.058655, " human", false], [30273, 0.036407, " best", false], [31461, 0.034876, " most", false], [52224, 0.024133, " methods", false], [22681, 0.022929, " use", false], [31458, 0.014815, " more", false], [22638, 0.01344, " two", false], [38629, 0.013129, " great", false], [56331, 0.010691, " greatest", false], [22752, 0.010675, " way", false]]]}, "raw_delta": -0.0714285714285714, "tuned_delta": -0.018573627530371575}, {"byte_start": 6064, "byte_end": 6073, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1041, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"model_a": "13.27% 13.27% 13.27% 13.27% 13.27% 13.27% 13.27% 13.27% 13.27%", "model_b": "17.16% 17.16% 17.16% 17.16% 17.16% 17.16% 17.16% 17.16% 17.16%"}, "model_tokens": {"model_a": [[55847, " contents", "normal", 0.0013142244424670935]], "model_b": [[55847, " contents", "normal", 0.00019002864428330213]]}, "loss": {"model_a": 13.274798119290809, "model_b": 17.157050399460765}, "topk": {"model_a": [55847, 127, 0.0013142244424670935, [[52224, 0.087561, " methods", false], [56950, 0.024465, " progress", false], [38720, 0.023851, " human", false], [57103, 0.022045, " research", false], [53052, 0.02002, " success", false], [51308, 0.019181, " content", false], [62633, 0.018838, " techniques", false], [63370, 0.016573, " computation", false], [60572, 0.014549, " structure", false], [22752, 0.014447, " way", false]]], "model_b": [55847, 535, 0.00019002864428330213, [[52224, 0.044025, " methods", false], [22681, 0.031992, " use", false], [40093, 0.029674, " value", false], [63287, 0.020079, " application", false], [57103, 0.019206, " research", false], [38720, 0.018215, " human", false], [46642, 0.017722, " nature", false], [53052, 0.014999, " success", false], [63750, 0.014494, " performance", false], [65137, 0.012823, " implementation", false]]]}, "raw_delta": -0.21527777777777768, "tuned_delta": -0.16242283387957784}, {"byte_start": 6073, "byte_end": 6076, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1042, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.23% 0.23% 0.23%", "model_b": "0.28% 0.28% 0.28%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.962536633014679]], "model_b": [[4706, " of", "normal", 0.9546859860420227]]}, "loss": {"model_a": 0.22747571954120818, "model_b": 0.280308789886263}, "topk": {"model_a": [4706, 1, 0.962536633014679, [[4706, 0.962537, " of", false], [21265, 0.014143, " and", false], [45, 0.004757, ",", false], [32227, 0.004194, " that", false], [4715, 0.003819, " or", false], [275, 0.001489, " (", false], [4596, 0.001083, " in", false], [21286, 0.000899, " are", false], [5346, 0.000847, "---", false], [46530, 0.000842, " matter", false]]], "model_b": [4706, 1, 0.9546859860420227, [[4706, 0.954686, " of", false], [21265, 0.018824, " and", false], [45, 0.004695, ",", false], [32227, 0.003541, " that", false], [275, 0.003206, " (", false], [4715, 0.002991, " or", false], [21286, 0.002871, " are", false], [4596, 0.000983, " in", false], [46530, 0.000571, " matter", false], [4858, 0.000507, " we", false]]]}, "raw_delta": -0.0029296875, "tuned_delta": 0.04992525639819982}, {"byte_start": 6076, "byte_end": 6082, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1043, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"model_a": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "model_b": "19.35% 19.35% 19.35% 19.35% 19.35% 19.35%"}, "model_tokens": {"model_a": [[39026, " minds", "normal", 0.000510960235260427]], "model_b": [[39026, " minds", "normal", 0.0015786489238962531]]}, "loss": {"model_a": 22.823886389063677, "model_b": 19.348644428588962}, "topk": {"model_a": [39026, 66, 0.000510960235260427, [[22590, 0.359717, " the", false], [332, 0.095102, " a", false], [59943, 0.082342, " knowledge", false], [38720, 0.064509, " human", false], [3609, 0.061252, " AI", false], [32464, 0.030682, " what", false], [22248, 0.029596, " our", false], [39936, 0.025075, " these", false], [52224, 0.024153, " methods", false], [4419, 0.023399, " an", false]]], "model_b": [39026, 43, 0.0015786489238962531, [[22590, 0.340837, " the", false], [22248, 0.107207, " our", false], [332, 0.09652, " a", false], [59943, 0.05291, " knowledge", false], [3609, 0.045529, " AI", false], [38720, 0.038732, " human", false], [57103, 0.029437, " research", false], [4419, 0.028578, " an", false], [32464, 0.019534, " what", false], [22226, 0.015216, " one", false]]]}, "raw_delta": 0.19270833333333326, "tuned_delta": 0.2455632772315331}, {"byte_start": 6082, "byte_end": 6086, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1044, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "5.85% 5.85% 5.85% 5.85%", "model_b": "4.47% 4.47% 4.47% 4.47%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.27479615807533264]], "model_b": [[21286, " are", "normal", 0.37576478719711304]]}, "loss": {"model_a": 5.846859784852732, "model_b": 4.473199955881307}, "topk": {"model_a": [21286, 1, 0.27479615807533264, [[21286, 0.274796, " are", false], [45, 0.179216, ",", false], [21265, 0.080195, " and", false], [5346, 0.068497, "---", false], [4600, 0.052511, " is", false], [4491, 0.043966, " do", false], [4706, 0.028087, " of", false], [4715, 0.023878, " or", false], [275, 0.023178, " (", false], [46530, 0.02307, " matter", false]]], "model_b": [21286, 1, 0.37576478719711304, [[21286, 0.375765, " are", false], [45, 0.083798, ",", false], [4491, 0.068886, " do", false], [4600, 0.060064, " is", false], [21265, 0.042067, " and", false], [21413, 0.029307, " can", false], [47266, 0.027702, " should", false], [46530, 0.024246, " matter", false], [275, 0.024025, " (", false], [45409, 0.020087, " cannot", false]]]}, "raw_delta": 0.076171875, "tuned_delta": 0.12902681889819984}, {"byte_start": 6086, "byte_end": 6097, "display": {"text": " tremendous", "kind": "normal"}, "is_word": true, "word_id": 1045, "word_key": " tremendous", "bytes_hex": "20 74 72 65 6d 65 6e 64 6f 75 73", "compression": {"model_a": "14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14%", "model_b": "13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94%"}, "model_tokens": {"model_a": [[62670, " tremendous", "normal", 0.0001751370436977595]], "model_b": [[62670, " tremendous", "normal", 0.00020859426876995713]]}, "loss": {"model_a": 14.140050826894667, "model_b": 13.93512255404112}, "topk": {"model_a": [62670, 252, 0.0001751370436977595, [[22187, 0.257466, " not", false], [62161, 0.10494, " irrelevant", false], [32386, 0.04031, " very", false], [39171, 0.034316, " often", false], [31466, 0.032905, " much", false], [31277, 0.026565, " less", false], [4706, 0.021336, " of", false], [332, 0.018659, " a", false], [59516, 0.018521, " difficult", false], [45, 0.01603, ",", false]]], "model_b": [62670, 273, 0.00020859426876995713, [[22187, 0.372409, " not", false], [62161, 0.028799, " irrelevant", false], [39171, 0.026646, " often", false], [31277, 0.022723, " less", false], [32386, 0.021618, " very", false], [52094, 0.018516, " largely", false], [21660, 0.015849, " far", false], [31466, 0.015658, " much", false], [332, 0.015646, " a", false], [46999, 0.013262, " rarely", false]]]}, "raw_delta": 0.011363636363636354, "tuned_delta": 0.06421858026183618}, {"byte_start": 6097, "byte_end": 6099, "display": {"text": "ly", "kind": "normal"}, "is_word": true, "word_id": 1046, "word_key": "ly", "bytes_hex": "6c 79", "compression": {"model_a": "0.06% 0.06%", "model_b": "0.11% 0.11%"}, "model_tokens": {"model_a": [[2030, "ly", "normal", 0.9933493733406067]], "model_b": [[2030, "ly", "normal", 0.9877553582191467]]}, "loss": {"model_a": 0.05998754862094764, "model_b": 0.1111695855177195}, "topk": {"model_a": [2030, 1, 0.9933493733406067, [[2030, 0.993349, "ly", false], [60081, 0.001, " obstacles", false], [52957, 0.00072, " sources", false], [60042, 0.0003, " mysteries", false], [45, 0.000278, ",", false], [55600, 0.000235, " barriers", false], [61669, 0.00022, " challenges", false], [40166, 0.000179, " waste", false], [31601, 0.000157, " over", false], [122, 0.000142, "y", false]]], "model_b": [2030, 1, 0.9877553582191467, [[2030, 0.987755, "ly", false], [45, 0.001052, ",", false], [21265, 0.000714, " and", false], [61669, 0.00047, " challenges", false], [47, 0.000431, ".", false], [52957, 0.000373, " sources", false], [50897, 0.000364, " amounts", false], [63637, 0.000316, " information", false], [60042, 0.000225, " mysteries", false], [61720, 0.000193, " complexity", false]]]}, "raw_delta": -0.002838134765625, "tuned_delta": 0.05001680913257482}, {"byte_start": 6099, "byte_end": 6100, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "99.19%", "model_b": "93.55%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.004099441226571798]], "model_b": [[45, ",", "normal", 0.005597678478807211]]}, "loss": {"model_a": 99.18528406111622, "model_b": 93.54975655764372}, "topk": {"model_a": [45, 15, 0.004099441226571798, [[59516, 0.202784, " difficult", false], [51258, 0.199874, " complex", false], [63366, 0.159224, " complicated", false], [31048, 0.11287, " hard", false], [31458, 0.043709, " more", false], [59829, 0.030992, " important", false], [51507, 0.025995, " diverse", false], [57518, 0.019725, " variable", false], [31277, 0.018485, " less", false], [47705, 0.018152, " varied", false]]], "model_b": [45, 23, 0.005597678478807211, [[51258, 0.165356, " complex", false], [59829, 0.129949, " important", false], [59516, 0.100227, " difficult", false], [31458, 0.069649, " more", false], [31048, 0.055625, " hard", false], [63366, 0.043306, " complicated", false], [31277, 0.03579, " less", false], [59513, 0.0234, " different", false], [51507, 0.021419, " diverse", false], [57518, 0.014062, " variable", false]]]}, "raw_delta": 0.3125, "tuned_delta": 0.36535494389819984}, {"byte_start": 6100, "byte_end": 6105, "display": {"text": " irre", "kind": "normal"}, "is_word": true, "word_id": 1047, "word_key": " irre", "bytes_hex": "20 69 72 72 65", "compression": {"model_a": "19.61% 19.61% 19.61% 19.61% 19.61%", "model_b": "18.94% 18.94% 18.94% 18.94% 18.94%"}, "model_tokens": {"model_a": [[31170, " irre", "normal", 0.004343354608863592]], "model_b": [[31170, " irre", "normal", 0.005171467550098896]]}, "loss": {"model_a": 19.611635712084343, "model_b": 18.935372411667643}, "topk": {"model_a": [31170, 45, 0.004343354608863592, [[21265, 0.084817, " and", false], [46269, 0.05788, " incomp", false], [52448, 0.037836, " perhaps", false], [30788, 0.031121, " even", false], [59988, 0.02943, " massively", false], [47708, 0.026518, " vastly", false], [64911, 0.021479, " exponentially", false], [45145, 0.020292, " almost", false], [21400, 0.019449, " but", false], [31427, 0.015917, " mind", false]]], "model_b": [31170, 30, 0.005171467550098896, [[21265, 0.16667, " and", false], [56125, 0.064894, " enormous", false], [62670, 0.045657, " tremendous", false], [59988, 0.031598, " massively", false], [21400, 0.031306, " but", false], [4596, 0.024208, " in", false], [62388, 0.021387, " profoundly", false], [52448, 0.020605, " perhaps", false], [59699, 0.016522, " extremely", false], [30788, 0.016352, " even", false]]]}, "raw_delta": 0.03749999999999987, "tuned_delta": 0.09035494389819969}, {"byte_start": 6105, "byte_end": 6108, "display": {"text": "dee", "kind": "normal"}, "is_word": true, "word_id": 1048, "word_key": "dee", "bytes_hex": "64 65 65", "compression": {"model_a": "21.60% 21.60% 21.60%", "model_b": "23.39% 23.39% 23.39%"}, "model_tokens": {"model_a": [[7333, "dee", "normal", 0.02744680643081665]], "model_b": [[7333, "dee", "normal", 0.020415039733052254]]}, "loss": {"model_a": 21.602855429977968, "model_b": 23.38743913941093}, "topk": {"model_a": [7333, 5, 0.02744680643081665, [[7387, 0.716223, "duc", false], [27190, 0.072552, "trie", false], [27418, 0.055665, "vers", false], [35986, 0.033324, "vocab", false], [7333, 0.027447, "dee", false], [34176, 0.014905, "cover", false], [35389, 0.013173, "place", false], [25053, 0.010901, "conc", false], [26645, 0.00876, "para", false], [35054, 0.008165, "media", false]]], "model_b": [7333, 8, 0.020415039733052254, [[7387, 0.507765, "duc", false], [35986, 0.150297, "vocab", false], [27418, 0.057865, "vers", false], [35389, 0.052378, "place", false], [34176, 0.040072, "cover", false], [27190, 0.039981, "trie", false], [7595, 0.022164, "fut", false], [7333, 0.020415, "dee", false], [35054, 0.016646, "media", false], [26645, 0.015069, "para", false]]]}, "raw_delta": -0.09895833333333326, "tuned_delta": -0.04610338943513344}, {"byte_start": 6108, "byte_end": 6110, "display": {"text": "ma", "kind": "normal"}, "is_word": true, "word_id": 1049, "word_key": "ma", "bytes_hex": "6d 61", "compression": {"model_a": "0.05% 0.05%", "model_b": "0.01% 0.01%"}, "model_tokens": {"model_a": [[2034, "ma", "normal", 0.9943073391914368]], "model_b": [[2034, "ma", "normal", 0.998660683631897]]}, "loss": {"model_a": 0.051182036896771844, "model_b": 0.012107578620741726}, "topk": {"model_a": [2034, 1, 0.9943073391914368, [[2034, 0.994307, "ma", false], [26251, 0.001552, "ming", false], [110, 0.000893, "m", false], [2045, 0.00084, "ml", false], [2035, 0.000745, "mb", false], [8157, 0.000316, "med", false], [2049, 0.000283, "mp", false], [8179, 7.9e-05, "mma", false], [2042, 7.4e-05, "mi", false], [26202, 7.3e-05, "mall", false]]], "model_b": [2034, 1, 0.998660683631897, [[2034, 0.998661, "ma", false], [1814, 0.000545, "da", false], [2049, 0.000111, "mp", false], [8179, 7e-05, "mma", false], [8050, 6.5e-05, "lab", false], [8144, 5.3e-05, "mai", false], [2111, 4.9e-05, "pa", false], [2042, 4.6e-05, "mi", false], [2035, 3e-05, "mb", false], [8193, 2.6e-05, "mpl", false]]]}, "raw_delta": 0.002166748046875, "tuned_delta": 0.05502169194507482}, {"byte_start": 6110, "byte_end": 6113, "display": {"text": "bly", "kind": "normal"}, "is_word": true, "word_id": 1050, "word_key": "bly", "bytes_hex": "62 6c 79", "compression": {"model_a": "0.02% 0.02% 0.02%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[7166, "bly", "normal", 0.9962118864059448]], "model_b": [[7166, "bly", "normal", 0.9965394735336304]]}, "loss": {"model_a": 0.022472399712740326, "model_b": 0.020821366264457363}, "topk": {"model_a": [7166, 1, 0.9962118864059448, [[7166, 0.996212, "bly", false], [7162, 0.003715, "ble", false], [1770, 2.7e-05, "bl", false], [7154, 1.4e-05, "bil", false], [24890, 6e-06, "blem", false], [7141, 3e-06, "bel", false], [1925, 2e-06, "hl", false], [46, 2e-06, "-", false], [34005, 2e-06, "bably", false], [24383, 2e-06, "ably", false]]], "model_b": [7166, 1, 0.9965394735336304, [[7166, 0.996539, "bly", false], [7162, 0.003311, "ble", false], [1770, 6.7e-05, "bl", false], [24890, 5.2e-05, "blem", false], [7154, 1.4e-05, "bil", false], [24383, 1e-05, "ably", false], [7141, 3e-06, "bel", false], [1925, 1e-06, "hl", false], [24892, 1e-06, "bles", false], [1782, 0.0, "by", false]]]}, "raw_delta": 9.1552734375e-05, "tuned_delta": 0.05294649663257482}, {"byte_start": 6113, "byte_end": 6121, "display": {"text": " complex", "kind": "normal"}, "is_word": true, "word_id": 1051, "word_key": " complex", "bytes_hex": "20 63 6f 6d 70 6c 65 78", "compression": {"model_a": "4.75% 4.75% 4.75% 4.75% 4.75% 4.75% 4.75% 4.75%", "model_b": "5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32%"}, "model_tokens": {"model_a": [[51258, " complex", "normal", 0.12180574983358383]], "model_b": [[51258, " complex", "normal", 0.09542275220155716]]}, "loss": {"model_a": 4.754976331054933, "model_b": 5.3185290814021835}, "topk": {"model_a": [51258, 3, 0.12180574983358383, [[59516, 0.194431, " difficult", false], [31048, 0.123883, " hard", false], [51258, 0.121806, " complex", false], [63366, 0.096199, " complicated", false], [45, 0.095088, ",", false], [39011, 0.078053, " messy", false], [59829, 0.02069, " important", false], [46706, 0.018994, " opaque", false], [62234, 0.013268, " mysterious", false], [51507, 0.008602, " diverse", false]]], "model_b": [51258, 2, 0.09542275220155716, [[45, 0.22942, ",", false], [51258, 0.095423, " complex", false], [46706, 0.04907, " opaque", false], [40090, 0.036077, " vague", false], [63366, 0.035279, " complicated", false], [59513, 0.031628, " different", false], [62091, 0.022277, " incomplete", false], [59516, 0.020512, " difficult", false], [39011, 0.020357, " messy", false], [52140, 0.016796, " limited", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 6121, "byte_end": 6122, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"model_a": "84.53%", "model_b": "84.53%"}, "model_tokens": {"model_a": [[60, ";", "normal", 0.009526293724775314]], "model_b": [[60, ";", "normal", 0.009243614040315151]]}, "loss": {"model_a": 84.5329125520877, "model_b": 84.5329125520877}, "topk": {"model_a": [60, 5, 0.009526293724775314, [[47, 0.449881, ".", false], [45, 0.299116, ",", false], [5346, 0.099773, "---", false], [21265, 0.081344, " and", false], [60, 0.009526, ";", false], [275, 0.008199, " (", false], [4811, 0.008149, " to", false], [4596, 0.008125, " in", false], [21700, 0.005763, " for", false], [59, 0.004539, ":", false]]], "model_b": [60, 5, 0.009243614040315151, [[47, 0.522248, ".", false], [45, 0.293426, ",", false], [21265, 0.090052, " and", false], [5346, 0.01239, "---", false], [60, 0.009244, ";", false], [53087, 0.007762, " systems", false], [275, 0.007438, " (", false], [4596, 0.005834, " in", false], [4811, 0.004016, " to", false], [47539, 0.003018, " things", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 6122, "byte_end": 6125, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1052, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "17.47% 17.47% 17.47%", "model_b": "17.66% 17.66% 17.66%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.05461563542485237]], "model_b": [[4858, " we", "normal", 0.0536351203918457]]}, "loss": {"model_a": 17.47013526076479, "model_b": 17.657986177547205}, "topk": {"model_a": [4858, 6, 0.05461563542485237, [[32232, 0.102469, " they", false], [22590, 0.088076, " the", false], [21265, 0.084861, " and", false], [39934, 0.064301, " there", false], [32227, 0.062176, " that", false], [4858, 0.054616, " we", false], [4601, 0.046997, " it", false], [32234, 0.032904, " this", false], [4596, 0.027406, " in", false], [4692, 0.021625, " no", false]]], "model_b": [4858, 5, 0.0536351203918457, [[21265, 0.133405, " and", false], [32227, 0.09854, " that", false], [32232, 0.094843, " they", false], [22590, 0.055273, " the", false], [4858, 0.053635, " we", false], [39934, 0.036603, " there", false], [4601, 0.035188, " it", false], [30788, 0.034039, " even", false], [4596, 0.024216, " in", false], [32234, 0.019053, " this", false]]]}, "raw_delta": -0.01041666666666663, "tuned_delta": 0.04243827723153319}, {"byte_start": 6125, "byte_end": 6132, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1053, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22%", "model_b": "9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.028033364564180374]], "model_b": [[47266, " should", "normal", 0.02549530752003193]]}, "loss": {"model_a": 9.218112844965754, "model_b": 9.45963545225743}, "topk": {"model_a": [47266, 8, 0.028033364564180374, [[4491, 0.166599, " do", false], [31059, 0.151215, " have", false], [21286, 0.104555, " are", false], [45409, 0.100942, " cannot", false], [21413, 0.09111, " can", false], [32475, 0.045839, " will", false], [31223, 0.035558, " know", false], [47266, 0.028033, " should", false], [46227, 0.02461, " humans", false], [47285, 0.023203, " simply", false]]], "model_b": [47266, 10, 0.02549530752003193, [[45409, 0.167376, " cannot", false], [4491, 0.152936, " do", false], [21413, 0.105049, " can", false], [31059, 0.099424, " have", false], [31223, 0.079568, " know", false], [21286, 0.078647, " are", false], [47285, 0.045156, " simply", false], [32475, 0.038683, " will", false], [21556, 0.028628, " don", false], [47266, 0.025495, " should", false]]]}, "raw_delta": -0.013392857142857095, "tuned_delta": 0.039462086755342726}, {"byte_start": 6132, "byte_end": 6137, "display": {"text": " stop", "kind": "normal"}, "is_word": true, "word_id": 1054, "word_key": " stop", "bytes_hex": "20 73 74 6f 70", "compression": {"model_a": "15.89% 15.89% 15.89% 15.89% 15.89%", "model_b": "16.57% 16.57% 16.57% 16.57% 16.57%"}, "model_tokens": {"model_a": [[32122, " stop", "normal", 0.012202269397675991]], "model_b": [[32122, " stop", "normal", 0.010112185962498188]]}, "loss": {"model_a": 15.892187559792486, "model_b": 16.568450860209186}, "topk": {"model_a": [32122, 9, 0.012202269397675991, [[22187, 0.428189, " not", false], [39115, 0.11365, " never", false], [45926, 0.063481, " expect", false], [4435, 0.059984, " be", false], [60645, 0.02521, " therefore", false], [31059, 0.019113, " have", false], [45084, 0.017836, " accept", false], [45150, 0.017279, " always", false], [32122, 0.012202, " stop", false], [38877, 0.008744, " learn", false]]], "model_b": [32122, 9, 0.010112185962498188, [[22187, 0.477783, " not", false], [39115, 0.135274, " never", false], [4435, 0.053413, " be", false], [60645, 0.022949, " therefore", false], [37786, 0.014123, " avoid", false], [38877, 0.013876, " learn", false], [45150, 0.01321, " always", false], [40007, 0.012131, " treat", false], [32122, 0.010112, " stop", false], [45926, 0.007682, " expect", false]]]}, "raw_delta": -0.03749999999999998, "tuned_delta": 0.015354943898199844}, {"byte_start": 6137, "byte_end": 6144, "display": {"text": " trying", "kind": "normal"}, "is_word": true, "word_id": 1055, "word_key": " trying", "bytes_hex": "20 74 72 79 69 6e 67", "compression": {"model_a": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "model_b": "2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17%"}, "model_tokens": {"model_a": [[47629, " trying", "normal", 0.5588558316230774]], "model_b": [[47629, " trying", "normal", 0.4303467571735382]]}, "loss": {"model_a": 1.4893894116320212, "model_b": 2.173703465625112}, "topk": {"model_a": [47629, 1, 0.5588558316230774, [[47629, 0.558856, " trying", false], [57419, 0.098311, " thinking", false], [62360, 0.046329, " pretending", false], [53320, 0.01844, " wasting", false], [46500, 0.016038, " making", false], [59681, 0.015956, " expecting", false], [52157, 0.015261, " looking", false], [59224, 0.011838, " believing", false], [46217, 0.009313, " hoping", false], [55562, 0.008585, " assuming", false]]], "model_b": [47629, 1, 0.4303467571735382, [[47629, 0.430347, " trying", false], [57419, 0.100668, " thinking", false], [52157, 0.032723, " looking", false], [62360, 0.023229, " pretending", false], [57577, 0.020825, " worrying", false], [55562, 0.015385, " assuming", false], [52834, 0.014787, " seeking", false], [46500, 0.013612, " making", false], [60463, 0.0128, " searching", false], [57463, 0.010612, " treating", false]]]}, "raw_delta": -0.03794642857142857, "tuned_delta": 0.014908515326771253}, {"byte_start": 6144, "byte_end": 6147, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1056, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.18% 0.18% 0.18%", "model_b": "0.12% 0.12% 0.12%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9704799056053162]], "model_b": [[4811, " to", "normal", 0.9807488918304443]]}, "loss": {"model_a": 0.1797791977019226, "model_b": 0.11740682298901069}, "topk": {"model_a": [4811, 1, 0.9704799056053162, [[4811, 0.97048, " to", false], [47, 0.005504, ".", false], [4788, 0.004868, " so", false], [45, 0.004468, ",", false], [4596, 0.001767, " in", false], [21265, 0.001755, " and", false], [21700, 0.000926, " for", false], [63461, 0.000831, " desperately", false], [275, 0.000759, " (", false], [31048, 0.000545, " hard", false]]], "model_b": [4811, 1, 0.9807488918304443, [[4811, 0.980749, " to", false], [22614, 0.002585, " too", false], [45, 0.002192, ",", false], [21700, 0.002108, " for", false], [4788, 0.001463, " so", false], [31048, 0.000945, " hard", false], [4596, 0.000725, " in", false], [21265, 0.000711, " and", false], [63461, 0.000703, " desperately", false], [47, 0.000594, ".", false]]]}, "raw_delta": 0.0034586588541666665, "tuned_delta": 0.056313602752366486}, {"byte_start": 6147, "byte_end": 6152, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1057, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"model_a": "17.58% 17.58% 17.58% 17.58% 17.58%", "model_b": "15.44% 15.44% 15.44% 15.44% 15.44%"}, "model_tokens": {"model_a": [[30858, " find", "normal", 0.007666742894798517]], "model_b": [[30858, " find", "normal", 0.013792444951832294]]}, "loss": {"model_a": 17.58284581083424, "model_b": 15.441345359514685}, "topk": {"model_a": [30858, 26, 0.007666742894798517, [[62683, 0.090653, " understand", false], [39043, 0.079389, " model", false], [37923, 0.076387, " build", false], [22339, 0.060166, " put", false], [31358, 0.044674, " make", false], [47030, 0.029202, " reduce", false], [39025, 0.019377, " mimic", false], [51133, 0.019052, " capture", false], [63292, 0.018321, " approximate", false], [60386, 0.018082, " replicate", false]]], "model_b": [30858, 9, 0.013792444951832294, [[62683, 0.339641, " understand", false], [39043, 0.036773, " model", false], [37923, 0.029776, " build", false], [31358, 0.02941, " make", false], [38877, 0.024958, " learn", false], [51133, 0.020414, " capture", false], [31223, 0.019619, " know", false], [51698, 0.014046, " extract", false], [30858, 0.013792, " find", false], [22339, 0.013228, " put", false]]]}, "raw_delta": 0.11875000000000002, "tuned_delta": 0.17160494389819986}, {"byte_start": 6152, "byte_end": 6159, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1058, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"model_a": "6.40% 6.40% 6.40% 6.40% 6.40% 6.40% 6.40%", "model_b": "12.16% 12.16% 12.16% 12.16% 12.16% 12.16% 12.16%"}, "model_tokens": {"model_a": [[47284, " simple", "normal", 0.08274747431278229]], "model_b": [[47284, " simple", "normal", 0.008955161087214947]]}, "loss": {"model_a": 6.400349093229498, "model_b": 12.156637900347851}, "topk": {"model_a": [47284, 3, 0.08274747431278229, [[332, 0.136403, " a", false], [32448, 0.10713, " ways", false], [47284, 0.082747, " simple", false], [22590, 0.068402, " the", false], [22249, 0.047246, " out", false], [51832, 0.032437, " general", false], [32229, 0.026639, " them", false], [4419, 0.023933, " an", false], [30724, 0.021575, " easy", false], [21265, 0.018438, " and", false]]], "model_b": [47284, 13, 0.008955161087214947, [[22249, 0.159289, " out", false], [22590, 0.159008, " the", false], [332, 0.097493, " a", false], [32229, 0.086038, " them", false], [32448, 0.062825, " ways", false], [32464, 0.027799, " what", false], [32074, 0.017478, " some", false], [56832, 0.017307, " patterns", false], [21265, 0.016444, " and", false], [47539, 0.011876, " things", false]]]}, "raw_delta": -0.31919642857142855, "tuned_delta": -0.2663414846732287}, {"byte_start": 6159, "byte_end": 6164, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1059, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "7.72% 7.72% 7.72% 7.72% 7.72%", "model_b": "8.85% 8.85% 8.85% 8.85% 8.85%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.1175675094127655]], "model_b": [[32448, " ways", "normal", 0.08646023273468018]]}, "loss": {"model_a": 7.720672679757342, "model_b": 8.847778180451845}, "topk": {"model_a": [32448, 2, 0.1175675094127655, [[45, 0.199164, ",", false], [32448, 0.117568, " ways", false], [64392, 0.068426, " explanations", false], [39558, 0.060706, " rules", false], [46587, 0.055927, " models", false], [64351, 0.034902, " descriptions", false], [65275, 0.034696, " representations", false], [60521, 0.032307, " solutions", false], [51832, 0.021598, " general", false], [38720, 0.015742, " human", false]]], "model_b": [32448, 2, 0.08646023273468018, [[45, 0.140434, ",", false], [32448, 0.08646, " ways", false], [60521, 0.056974, " solutions", false], [56832, 0.047862, " patterns", false], [64392, 0.038162, " explanations", false], [50921, 0.037529, " answers", false], [46587, 0.032264, " models", false], [39558, 0.031717, " rules", false], [65275, 0.026727, " representations", false], [21265, 0.024851, " and", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.009645056101800178}, {"byte_start": 6164, "byte_end": 6167, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1060, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.68% 1.68% 1.68%", "model_b": "1.56% 1.56% 1.56%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.757064938545227]], "model_b": [[4811, " to", "normal", 0.771757960319519]]}, "loss": {"model_a": 1.6789175687428526, "model_b": 1.5615107457538422}, "topk": {"model_a": [4811, 1, 0.757064938545227, [[4811, 0.757065, " to", false], [4706, 0.182493, " of", false], [21700, 0.021049, " for", false], [4596, 0.012991, " in", false], [45202, 0.005866, " around", false], [32227, 0.004293, " that", false], [45, 0.003274, ",", false], [22249, 0.002382, " out", false], [31162, 0.002118, " into", false], [275, 0.001988, " (", false]]], "model_b": [4811, 1, 0.771757960319519, [[4811, 0.771758, " to", false], [4706, 0.194793, " of", false], [32227, 0.005725, " that", false], [21700, 0.004519, " for", false], [4596, 0.004191, " in", false], [45, 0.003174, ",", false], [22249, 0.002996, " out", false], [45202, 0.002536, " around", false], [31162, 0.001646, " into", false], [275, 0.001474, " (", false]]]}, "raw_delta": 0.006510416666666657, "tuned_delta": 0.05936536056486648}, {"byte_start": 6167, "byte_end": 6173, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1061, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "15.69% 15.69% 15.69% 15.69% 15.69% 15.69%", "model_b": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.005354481749236584]], "model_b": [[39942, " think", "normal", 0.01265944167971611]]}, "loss": {"model_a": 15.685551551331827, "model_b": 13.149564174769196}, "topk": {"model_a": [39942, 24, 0.005354481749236584, [[60389, 0.136737, " represent", false], [55961, 0.109027, " describe", false], [39043, 0.087679, " model", false], [51133, 0.059309, " capture", false], [22339, 0.057766, " put", false], [62683, 0.050469, " understand", false], [51688, 0.03761, " explain", false], [37923, 0.030223, " build", false], [45854, 0.025115, " encode", false], [31358, 0.024918, " make", false]]], "model_b": [39942, 12, 0.01265944167971611, [[62683, 0.201703, " understand", false], [31358, 0.062455, " make", false], [51133, 0.050918, " capture", false], [60389, 0.03772, " represent", false], [39043, 0.034275, " model", false], [51698, 0.02085, " extract", false], [55961, 0.017061, " describe", false], [22681, 0.016939, " use", false], [37923, 0.016437, " build", false], [39740, 0.013792, " solve", false]]]}, "raw_delta": 0.140625, "tuned_delta": 0.19347994389819984}, {"byte_start": 6173, "byte_end": 6179, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1062, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"model_a": "1.78% 1.78% 1.78% 1.78% 1.78% 1.78%", "model_b": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05%"}, "model_tokens": {"model_a": [[37598, " about", "normal", 0.5546380281448364]], "model_b": [[37598, " about", "normal", 0.36165663599967957]]}, "loss": {"model_a": 1.7845837094329622, "model_b": 3.052577397714278}, "topk": {"model_a": [37598, 1, 0.5546380281448364, [[37598, 0.554638, " about", false], [31296, 0.173434, " like", false], [4706, 0.040848, " of", false], [47, 0.034427, ".", false], [21265, 0.032462, " and", false], [32227, 0.030477, " that", false], [45, 0.027151, ",", false], [4596, 0.015153, " in", false], [4715, 0.009506, " or", false], [22248, 0.007199, " our", false]]], "model_b": [37598, 1, 0.36165663599967957, [[37598, 0.361657, " about", false], [47, 0.148879, ".", false], [45, 0.082195, ",", false], [4706, 0.056886, " of", false], [31296, 0.045901, " like", false], [21265, 0.040731, " and", false], [4596, 0.034046, " in", false], [32227, 0.026283, " that", false], [4715, 0.023914, " or", false], [45301, 0.022267, " better", false]]]}, "raw_delta": -0.07031250000000001, "tuned_delta": -0.017457556101800192}, {"byte_start": 6179, "byte_end": 6183, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1063, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "9.72% 9.72% 9.72% 9.72%", "model_b": "12.40% 12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.11386032402515411]], "model_b": [[22590, " the", "normal", 0.06507348269224167]]}, "loss": {"model_a": 9.721284943490085, "model_b": 12.398160507639528}, "topk": {"model_a": [22590, 3, 0.11386032402515411, [[32229, 0.419121, " them", false], [39026, 0.125669, " minds", false], [22590, 0.11386, " the", false], [21835, 0.055404, " how", false], [4601, 0.031658, " it", false], [32464, 0.024429, " what", false], [21265, 0.022676, " and", false], [22248, 0.020634, " our", false], [51258, 0.017868, " complex", false], [47539, 0.017024, " things", false]]], "model_b": [22590, 2, 0.06507348269224167, [[32229, 0.501081, " them", false], [22590, 0.065073, " the", false], [51258, 0.047483, " complex", false], [4601, 0.039828, " it", false], [39936, 0.031246, " these", false], [47539, 0.026156, " things", false], [22248, 0.023069, " our", false], [39026, 0.021438, " minds", false], [21265, 0.019386, " and", false], [21835, 0.015373, " how", false]]]}, "raw_delta": -0.1484375, "tuned_delta": -0.09558255610180018}, {"byte_start": 6183, "byte_end": 6192, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1064, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"model_a": "4.32% 4.32% 4.32% 4.32% 4.32% 4.32% 4.32% 4.32% 4.32%", "model_b": "5.64% 5.64% 5.64% 5.64% 5.64% 5.64% 5.64% 5.64% 5.64%"}, "model_tokens": {"model_a": [[55847, " contents", "normal", 0.11623040586709976]], "model_b": [[55847, " contents", "normal", 0.05913321673870087]]}, "loss": {"model_a": 4.320571085995593, "model_b": 5.635527503472513}, "topk": {"model_a": [55847, 3, 0.11623040586709976, [[31427, 0.277653, " mind", false], [40213, 0.23286, " world", false], [55847, 0.11623, " contents", false], [39026, 0.074656, " minds", false], [38720, 0.041644, " human", false], [51258, 0.039217, " complex", false], [61720, 0.029453, " complexity", false], [22752, 0.012546, " way", false], [37898, 0.012007, " brain", false], [47539, 0.007251, " things", false]]], "model_b": [55847, 3, 0.05913321673870087, [[40213, 0.365807, " world", false], [31427, 0.204147, " mind", false], [55847, 0.059133, " contents", false], [51258, 0.031935, " complex", false], [39026, 0.031611, " minds", false], [38720, 0.024944, " human", false], [46545, 0.014422, " mental", false], [61720, 0.013257, " complexity", false], [37898, 0.012476, " brain", false], [47539, 0.01089, " things", false]]]}, "raw_delta": -0.07291666666666664, "tuned_delta": -0.020061722768466822}, {"byte_start": 6192, "byte_end": 6195, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1065, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.50% 0.50% 0.50%", "model_b": "0.78% 0.78% 0.78%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.921164333820343]], "model_b": [[4706, " of", "normal", 0.8789111375808716]]}, "loss": {"model_a": 0.49604382712857015, "model_b": 0.7807553728769211}, "topk": {"model_a": [4706, 1, 0.921164333820343, [[4706, 0.921164, " of", false], [47, 0.028999, ".", false], [45, 0.016989, ",", false], [21265, 0.014194, " and", false], [4596, 0.003427, " in", false], [32227, 0.002375, " that", false], [60, 0.001972, ";", false], [4715, 0.001541, " or", false], [275, 0.00116, " (", false], [4450, 0.001035, " by", false]]], "model_b": [4706, 1, 0.8789111375808716, [[4706, 0.878911, " of", false], [47, 0.061291, ".", false], [45, 0.02444, ",", false], [21265, 0.010185, " and", false], [4715, 0.003075, " or", false], [275, 0.002984, " (", false], [4596, 0.002317, " in", false], [32227, 0.002232, " that", false], [4450, 0.002082, " by", false], [4858, 0.000847, " we", false]]]}, "raw_delta": -0.015787760416666668, "tuned_delta": 0.03706718348153315}, {"byte_start": 6195, "byte_end": 6201, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1066, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"model_a": "0.39% 0.39% 0.39% 0.39% 0.39% 0.39%", "model_b": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"model_a": [[39026, " minds", "normal", 0.877874493598938]], "model_b": [[39026, " minds", "normal", 0.6757315397262573]]}, "loss": {"model_a": 0.39331285701318575, "model_b": 1.1564572064417553}, "topk": {"model_a": [39026, 1, 0.877874493598938, [[39026, 0.877874, " minds", false], [22248, 0.029887, " our", false], [22590, 0.022268, " the", false], [38720, 0.014043, " human", false], [332, 0.012643, " a", false], [39193, 0.007269, " other", false], [31427, 0.003025, " mind", false], [39931, 0.002623, " their", false], [45124, 0.002111, " agents", false], [39944, 0.001973, " those", false]]], "model_b": [39026, 1, 0.6757315397262573, [[39026, 0.675732, " minds", false], [22248, 0.144836, " our", false], [22590, 0.051884, " the", false], [31427, 0.016338, " mind", false], [332, 0.012474, " a", false], [46787, 0.009988, " people", false], [38720, 0.008475, " human", false], [39193, 0.007555, " other", false], [39936, 0.00683, " these", false], [39931, 0.006538, " their", false]]]}, "raw_delta": -0.04231770833333334, "tuned_delta": 0.010537235564866479}, {"byte_start": 6201, "byte_end": 6202, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "25.08%", "model_b": "29.87%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.24913270771503448]], "model_b": [[45, ",", "normal", 0.18801335990428925]]}, "loss": {"model_a": 25.078097390452683, "model_b": 29.868295768404316}, "topk": {"model_a": [45, 2, 0.24913270771503448, [[47, 0.440822, ".", false], [45, 0.249133, ",", false], [21265, 0.127508, " and", false], [32227, 0.034135, " that", false], [60, 0.025304, ";", false], [4596, 0.0226, " in", false], [275, 0.016498, " (", false], [4423, 0.012536, " as", false], [5346, 0.011902, "---", false], [51018, 0.006202, " because", false]]], "model_b": [45, 2, 0.18801335990428925, [[47, 0.589083, ".", false], [45, 0.188013, ",", false], [21265, 0.077078, " and", false], [275, 0.016849, " (", false], [4596, 0.014734, " in", false], [32227, 0.013703, " that", false], [4450, 0.013271, " by", false], [4715, 0.011981, " or", false], [5346, 0.010373, "---", false], [4423, 0.007524, " as", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21277005610180016}, {"byte_start": 6202, "byte_end": 6207, "display": {"text": " such", "kind": "normal"}, "is_word": true, "word_id": 1067, "word_key": " such", "bytes_hex": "20 73 75 63 68", "compression": {"model_a": "17.13% 17.13% 17.13% 17.13% 17.13%", "model_b": "19.39% 19.39% 19.39% 19.39% 19.39%"}, "model_tokens": {"model_a": [[32139, " such", "normal", 0.008582547307014465]], "model_b": [[32139, " such", "normal", 0.0047678533010184765]]}, "loss": {"model_a": 17.13200361055644, "model_b": 19.386214611945444}, "topk": {"model_a": [32139, 12, 0.008582547307014465, [[21265, 0.593643, " and", false], [4715, 0.053734, " or", false], [51018, 0.053488, " because", false], [4423, 0.026306, " as", false], [21400, 0.018013, " but", false], [4811, 0.016168, " to", false], [4596, 0.015621, " in", false], [4858, 0.015603, " we", false], [40186, 0.015232, " which", false], [30788, 0.011755, " even", false]]], "model_b": [32139, 14, 0.0047678533010184765, [[21265, 0.612814, " and", false], [4715, 0.073326, " or", false], [51018, 0.04163, " because", false], [40186, 0.033134, " which", false], [21400, 0.026562, " but", false], [4423, 0.016692, " as", false], [4811, 0.011527, " to", false], [61953, 0.011255, " especially", false], [30788, 0.011133, " even", false], [4596, 0.010087, " in", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 6207, "byte_end": 6210, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1068, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "0.15% 0.15% 0.15%", "model_b": "0.25% 0.25% 0.25%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.9752819538116455]], "model_b": [[4423, " as", "normal", 0.9595021605491638]]}, "loss": {"model_a": 0.1496936993109886, "model_b": 0.2494894988516477}, "topk": {"model_a": [4423, 1, 0.9752819538116455, [[4423, 0.975282, " as", false], [32227, 0.018731, " that", false], [4450, 0.000825, " by", false], [332, 0.000705, " a", false], [52224, 0.000447, " methods", false], [32448, 0.000371, " ways", false], [4419, 0.000331, " an", false], [4600, 0.000203, " is", false], [47284, 0.000203, " simple", false], [22590, 0.000202, " the", false]]], "model_b": [4423, 1, 0.9595021605491638, [[4423, 0.959502, " as", false], [32227, 0.0263, " that", false], [332, 0.002319, " a", false], [52224, 0.001224, " methods", false], [47539, 0.001046, " things", false], [57419, 0.000606, " thinking", false], [61590, 0.000458, " approaches", false], [32448, 0.000339, " ways", false], [4419, 0.000273, " an", false], [51566, 0.000272, " efforts", false]]]}, "raw_delta": -0.005533854166666667, "tuned_delta": 0.04732108973153316}, {"byte_start": 6210, "byte_end": 6217, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1069, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"model_a": "8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98%", "model_b": "11.43% 11.43% 11.43% 11.43% 11.43% 11.43% 11.43%"}, "model_tokens": {"model_a": [[47284, " simple", "normal", 0.030458124354481697]], "model_b": [[47284, " simple", "normal", 0.011646258644759655]]}, "loss": {"model_a": 8.976590237674074, "model_b": 11.432070078472808}, "topk": {"model_a": [47284, 6, 0.030458124354481697, [[4450, 0.187784, " by", false], [4596, 0.103162, " in", false], [22590, 0.082597, " the", false], [4404, 0.047952, " ``", false], [53140, 0.034104, " through", false], [47284, 0.030458, " simple", false], [55666, 0.02322, " building", false], [47629, 0.021969, " trying", false], [40085, 0.021514, " using", false], [38720, 0.017094, " human", false]]], "model_b": [47284, 15, 0.011646258644759655, [[22590, 0.10855, " the", false], [4404, 0.066077, " ``", false], [4596, 0.054936, " in", false], [4450, 0.046657, " by", false], [38720, 0.035511, " human", false], [60463, 0.026024, " searching", false], [39944, 0.025243, " those", false], [40085, 0.019172, " using", false], [59943, 0.017592, " knowledge", false], [53140, 0.016148, " through", false]]]}, "raw_delta": -0.13616071428571422, "tuned_delta": -0.0833057703875144}, {"byte_start": 6217, "byte_end": 6222, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1070, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "12.62% 12.62% 12.62% 12.62% 12.62%", "model_b": "14.88% 14.88% 14.88% 14.88% 14.88%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.030196072533726692]], "model_b": [[32448, " ways", "normal", 0.01601019687950611]]}, "loss": {"model_a": 12.623581607778428, "model_b": 14.877792609167432}, "topk": {"model_a": [32448, 6, 0.030196072533726692, [[65275, 0.088014, " representations", false], [46587, 0.072726, " models", false], [39558, 0.054941, " rules", false], [59943, 0.041793, " knowledge", false], [46658, 0.030701, " neural", false], [32448, 0.030196, " ways", false], [45, 0.029637, ",", false], [57375, 0.02267, " symbolic", false], [38720, 0.020683, " human", false], [46545, 0.015814, " mental", false]]], "model_b": [32448, 10, 0.01601019687950611, [[65275, 0.073761, " representations", false], [46587, 0.032793, " models", false], [59943, 0.029271, " knowledge", false], [47202, 0.028657, " search", false], [39558, 0.023779, " rules", false], [46658, 0.023352, " neural", false], [52224, 0.021068, " methods", false], [46545, 0.016467, " mental", false], [45, 0.016183, ",", false], [32448, 0.01601, " ways", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 6222, "byte_end": 6225, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1071, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.15% 1.15% 1.15%", "model_b": "2.10% 2.10% 2.10%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8262966275215149]], "model_b": [[4811, " to", "normal", 0.7045447826385498]]}, "loss": {"model_a": 1.1505868652923046, "model_b": 2.101582131503291}, "topk": {"model_a": [4811, 1, 0.8262966275215149, [[4811, 0.826297, " to", false], [4706, 0.149473, " of", false], [21700, 0.014067, " for", false], [32227, 0.00323, " that", false], [4596, 0.002299, " in", false], [275, 0.000481, " (", false], [45, 0.000481, ",", false], [31296, 0.000384, " like", false], [37810, 0.000376, " based", false], [4858, 0.000257, " we", false]]], "model_b": [4811, 1, 0.7045447826385498, [[4811, 0.704545, " to", false], [4706, 0.245795, " of", false], [32227, 0.020152, " that", false], [37810, 0.005725, " based", false], [21700, 0.003351, " for", false], [4596, 0.002184, " in", false], [31296, 0.002073, " like", false], [4858, 0.001992, " we", false], [40085, 0.001028, " using", false], [45, 0.000895, ",", false]]]}, "raw_delta": -0.052734375, "tuned_delta": 0.00012056889819982153}, {"byte_start": 6225, "byte_end": 6231, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1072, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "6.34% 6.34% 6.34% 6.34% 6.34% 6.34%", "model_b": "4.86% 4.86% 4.86% 4.86% 4.86% 4.86%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.12134646624326706]], "model_b": [[39942, " think", "normal", 0.19595016539096832]]}, "loss": {"model_a": 6.339968441406577, "model_b": 4.8606424717450425}, "topk": {"model_a": [39942, 2, 0.12134646624326706, [[60389, 0.133519, " represent", false], [39942, 0.121346, " think", false], [37923, 0.052185, " build", false], [55961, 0.051046, " describe", false], [22339, 0.039438, " put", false], [39043, 0.036304, " model", false], [45688, 0.03117, " define", false], [45854, 0.024355, " encode", false], [62683, 0.022214, " understand", false], [64276, 0.016644, " characterize", false]]], "model_b": [39942, 1, 0.19595016539096832, [[39942, 0.19595, " think", false], [60389, 0.05535, " represent", false], [62683, 0.037924, " understand", false], [31358, 0.031327, " make", false], [37923, 0.026439, " build", false], [39043, 0.024074, " model", false], [30858, 0.023455, " find", false], [22681, 0.021201, " use", false], [4491, 0.01677, " do", false], [55961, 0.015401, " describe", false]]]}, "raw_delta": 0.08203125, "tuned_delta": 0.13488619389819984}, {"byte_start": 6231, "byte_end": 6237, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1073, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"model_a": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21%", "model_b": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68%"}, "model_tokens": {"model_a": [[37598, " about", "normal", 0.9315695762634277]], "model_b": [[37598, " about", "normal", 0.7993412613868713]]}, "loss": {"model_a": 0.21279986666758188, "model_b": 0.6780244027615366}, "topk": {"model_a": [37598, 1, 0.9315695762634277, [[37598, 0.93157, " about", false], [4706, 0.037801, " of", false], [32227, 0.009826, " that", false], [4596, 0.00698, " in", false], [32464, 0.000889, " what", false], [31296, 0.000851, " like", false], [21835, 0.000692, " how", false], [21265, 0.000617, " and", false], [45, 0.000414, ",", false], [4858, 0.000378, " we", false]]], "model_b": [37598, 1, 0.7993412613868713, [[37598, 0.799341, " about", false], [4706, 0.038099, " of", false], [4596, 0.033663, " in", false], [32227, 0.021379, " that", false], [31296, 0.015301, " like", false], [45, 0.006746, ",", false], [47, 0.005113, ".", false], [31581, 0.003726, " only", false], [4715, 0.003163, " or", false], [32487, 0.003129, " with", false]]]}, "raw_delta": -0.02579752604166666, "tuned_delta": 0.02705741785653316}, {"byte_start": 6237, "byte_end": 6243, "display": {"text": " space", "kind": "normal"}, "is_word": true, "word_id": 1074, "word_key": " space", "bytes_hex": "20 73 70 61 63 65", "compression": {"model_a": "21.79% 21.79% 21.79% 21.79% 21.79% 21.79%", "model_b": "20.29% 20.29% 20.29% 20.29% 20.29% 20.29%"}, "model_tokens": {"model_a": [[39750, " space", "normal", 0.0007154013146646321]], "model_b": [[39750, " space", "normal", 0.0011665511410683393]]}, "loss": {"model_a": 21.79070634676038, "model_b": 20.287899012501047}, "topk": {"model_a": [39750, 117, 0.0007154013146646321, [[22590, 0.233173, " the", false], [21835, 0.136948, " how", false], [32464, 0.078844, " what", false], [38720, 0.043935, " human", false], [47732, 0.036514, " vision", false], [59943, 0.03212, " knowledge", false], [4404, 0.019466, " ``", false], [62300, 0.017582, " perception", false], [56529, 0.010885, " language", false], [332, 0.01021, " a", false]]], "model_b": [39750, 104, 0.0011665511410683393, [[22590, 0.221669, " the", false], [21835, 0.061872, " how", false], [59943, 0.041899, " knowledge", false], [332, 0.030619, " a", false], [32464, 0.028897, " what", false], [38720, 0.016669, " human", false], [40210, 0.01582, " words", false], [52333, 0.012043, " numbers", false], [47539, 0.011956, " things", false], [39931, 0.009695, " their", false]]]}, "raw_delta": 0.08333333333333326, "tuned_delta": 0.1361882772315331}, {"byte_start": 6243, "byte_end": 6244, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "19.30%", "model_b": "22.12%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.3421191871166229]], "model_b": [[45, ",", "normal", 0.2936798632144928]]}, "loss": {"model_a": 19.301681699393356, "model_b": 22.11944545112961}, "topk": {"model_a": [45, 1, 0.3421191871166229, [[45, 0.342119, ",", false], [21265, 0.19502, " and", false], [4715, 0.193126, " or", false], [47, 0.144844, ".", false], [4596, 0.020364, " in", false], [275, 0.019517, " (", false], [4423, 0.017375, " as", false], [46, 0.007237, "-", false], [32227, 0.00532, " that", false], [5346, 0.005038, "---", false]]], "model_b": [45, 1, 0.2936798632144928, [[45, 0.29368, ",", false], [21265, 0.260394, " and", false], [47, 0.178787, ".", false], [4715, 0.176623, " or", false], [275, 0.017334, " (", false], [46, 0.012282, "-", false], [4596, 0.011862, " in", false], [27165, 0.007631, "time", false], [60, 0.005865, ";", false], [4423, 0.002765, " as", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 6244, "byte_end": 6252, "display": {"text": " objects", "kind": "normal"}, "is_word": true, "word_id": 1075, "word_key": " objects", "bytes_hex": "20 6f 62 6a 65 63 74 73", "compression": {"model_a": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[52342, " objects", "normal", 0.009126161225140095]], "model_b": [[52342, " objects", "normal", 0.003143582958728075]]}, "loss": {"model_a": 10.566614069010962, "model_b": 12.96171325798678}, "topk": {"model_a": [52342, 11, 0.009126161225140095, [[4715, 0.364549, " or", false], [21265, 0.128043, " and", false], [47284, 0.102214, " simple", false], [37598, 0.056185, " about", false], [32251, 0.040379, " time", false], [32139, 0.031933, " such", false], [4423, 0.02324, " as", false], [4811, 0.017825, " to", false], [51018, 0.012152, " because", false], [31296, 0.009653, " like", false]]], "model_b": [52342, 20, 0.003143582958728075, [[4715, 0.273911, " or", false], [32251, 0.188297, " time", false], [21265, 0.117869, " and", false], [47284, 0.106087, " simple", false], [21700, 0.035293, " for", false], [4423, 0.016421, " as", false], [32139, 0.014527, " such", false], [51018, 0.013939, " because", false], [4811, 0.01028, " to", false], [22590, 0.00897, " the", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07995755610180018}, {"byte_start": 6252, "byte_end": 6253, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.24%", "model_b": "1.96%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9333276748657227]], "model_b": [[45, ",", "normal", 0.897297739982605]]}, "loss": {"model_a": 1.241577153108788, "model_b": 1.9636291144912037}, "topk": {"model_a": [45, 1, 0.9333276748657227, [[45, 0.933328, ",", false], [21265, 0.035675, " and", false], [4715, 0.011996, " or", false], [4596, 0.011143, " in", false], [275, 0.001511, " (", false], [4706, 0.001208, " of", false], [32227, 0.000572, " that", false], [32487, 0.000505, " with", false], [4423, 0.000437, " as", false], [21643, 0.000333, " etc", false]]], "model_b": [45, 1, 0.897297739982605, [[45, 0.897298, ",", false], [21265, 0.062745, " and", false], [4715, 0.017632, " or", false], [4596, 0.011473, " in", false], [275, 0.00194, " (", false], [21643, 0.00188, " etc", false], [4706, 0.0008, " of", false], [47, 0.000799, ".", false], [32227, 0.00066, " that", false], [48, 0.000219, "/", false]]]}, "raw_delta": -0.0400390625, "tuned_delta": 0.012815881398199822}, {"byte_start": 6253, "byte_end": 6262, "display": {"text": " multiple", "kind": "normal"}, "is_word": true, "word_id": 1076, "word_key": " multiple", "bytes_hex": "20 6d 75 6c 74 69 70 6c 65", "compression": {"model_a": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%", "model_b": "19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41%"}, "model_tokens": {"model_a": [[56679, " multiple", "normal", 2.3495298592024483e-05]], "model_b": [[56679, " multiple", "normal", 6.331051554298028e-05]]}, "loss": {"model_a": 21.415004513195548, "model_b": 19.41126140084977}, "topk": {"model_a": [56679, 795, 2.3495298592024483e-05, [[21265, 0.14862, " and", false], [4715, 0.125518, " or", false], [50851, 0.106239, " actions", false], [38604, 0.041454, " goals", false], [45909, 0.037262, " events", false], [21643, 0.031879, " etc", false], [46606, 0.024755, " motion", false], [61661, 0.023531, " categories", false], [55816, 0.021772, " concepts", false], [47184, 0.021755, " scenes", false]]], "model_b": [56679, 600, 6.331051554298028e-05, [[21265, 0.237593, " and", false], [4715, 0.12759, " or", false], [21643, 0.061543, " etc", false], [32251, 0.056206, " time", false], [45909, 0.024363, " events", false], [46787, 0.02236, " people", false], [52333, 0.021197, " numbers", false], [50851, 0.019606, " actions", false], [22590, 0.018816, " the", false], [45519, 0.018733, " colors", false]]]}, "raw_delta": 0.11111111111111116, "tuned_delta": 0.163966055009311}, {"byte_start": 6262, "byte_end": 6269, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1077, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"model_a": "9.62% 9.62% 9.62% 9.62% 9.62% 9.62% 9.62%", "model_b": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"model_a": [[45124, " agents", "normal", 0.02382061630487442]], "model_b": [[45124, " agents", "normal", 0.07870946079492569]]}, "loss": {"model_a": 9.62065052378522, "model_b": 6.561364164757282}, "topk": {"model_a": [45124, 3, 0.02382061630487442, [[52342, 0.696441, " objects", false], [46691, 0.034512, " object", false], [45124, 0.023821, " agents", false], [47539, 0.017023, " things", false], [38604, 0.010764, " goals", false], [46, 0.010403, "-", false], [56606, 0.010091, " meanings", false], [55816, 0.008463, " concepts", false], [65275, 0.008271, " representations", false], [61867, 0.006349, " dimensions", false]]], "model_b": [45124, 2, 0.07870946079492569, [[52342, 0.094085, " objects", false], [45124, 0.078709, " agents", false], [61867, 0.047188, " dimensions", false], [65275, 0.046373, " representations", false], [46, 0.045273, "-", false], [47398, 0.039364, " states", false], [47814, 0.031878, " worlds", false], [60725, 0.01973, " variables", false], [46297, 0.019027, " inputs", false], [47539, 0.015876, " things", false]]]}, "raw_delta": 0.1696428571428572, "tuned_delta": 0.22249780104105704}, {"byte_start": 6269, "byte_end": 6270, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.87%", "model_b": "3.35%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8532267212867737]], "model_b": [[45, ",", "normal", 0.8318135142326355]]}, "loss": {"model_a": 2.8705968220813114, "model_b": 3.3460944551868046}, "topk": {"model_a": [45, 1, 0.8532267212867737, [[45, 0.853227, ",", false], [21265, 0.027403, " and", false], [63662, 0.026601, " interacting", false], [4596, 0.015871, " in", false], [47, 0.013555, ".", false], [4715, 0.010275, " or", false], [45094, 0.008728, " acting", false], [45580, 0.004688, " cooper", false], [21643, 0.00383, " etc", false], [53362, 0.003624, " working", false]]], "model_b": [45, 1, 0.8318135142326355, [[45, 0.831814, ",", false], [47, 0.034729, ".", false], [21265, 0.025945, " and", false], [4596, 0.022985, " in", false], [63662, 0.018519, " interacting", false], [4715, 0.011896, " or", false], [21643, 0.009255, " etc", false], [275, 0.005833, " (", false], [32487, 0.002652, " with", false], [60, 0.002254, ";", false]]]}, "raw_delta": -0.0263671875, "tuned_delta": 0.02648775639819982}, {"byte_start": 6270, "byte_end": 6273, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 1078, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "13.34% 13.34% 13.34%", "model_b": "11.55% 11.55% 11.55%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.10893495380878448]], "model_b": [[4715, " or", "normal", 0.14381541311740875]]}, "loss": {"model_a": 13.337415091551614, "model_b": 11.55283138211865}, "topk": {"model_a": [4715, 3, 0.10893495380878448, [[21643, 0.168282, " etc", false], [21265, 0.130906, " and", false], [4715, 0.108935, " or", false], [38604, 0.047593, " goals", false], [50851, 0.03606, " actions", false], [45432, 0.021087, " causal", false], [56529, 0.01665, " language", false], [32251, 0.012806, " time", false], [22590, 0.012435, " the", false], [45095, 0.011523, " action", false]]], "model_b": [4715, 3, 0.14381541311740875, [[21643, 0.267488, " etc", false], [21265, 0.212959, " and", false], [4715, 0.143815, " or", false], [47284, 0.017277, " simple", false], [22590, 0.015382, " the", false], [56679, 0.01402, " multiple", false], [32251, 0.007998, " time", false], [38604, 0.005504, " goals", false], [52342, 0.004647, " objects", false], [59943, 0.004391, " knowledge", false]]]}, "raw_delta": 0.09895833333333337, "tuned_delta": 0.1518132772315332}, {"byte_start": 6273, "byte_end": 6280, "display": {"text": " symmet", "kind": "normal"}, "is_word": true, "word_id": 1079, "word_key": " symmet", "bytes_hex": "20 73 79 6d 6d 65 74", "compression": {"model_a": "25.44% 25.44% 25.44% 25.44% 25.44% 25.44% 25.44%", "model_b": "20.21% 20.21% 20.21% 20.21% 20.21% 20.21% 20.21%"}, "model_tokens": {"model_a": [[47484, " symmet", "normal", 5.052498454460874e-05]], "model_b": [[47484, " symmet", "normal", 0.0003942466573789716]]}, "loss": {"model_a": 25.440381301390207, "model_b": 20.20739147673715}, "topk": {"model_a": [47484, 969, 5.052498454460874e-05, [[30788, 0.078685, " even", false], [22590, 0.076452, " the", false], [45432, 0.03184, " causal", false], [38604, 0.029695, " goals", false], [47284, 0.026993, " simple", false], [39193, 0.025683, " other", false], [50851, 0.024819, " actions", false], [38720, 0.020936, " human", false], [56529, 0.019862, " language", false], [55816, 0.016114, " concepts", false]]], "model_b": [47484, 282, 0.0003942466573789716, [[30788, 0.079024, " even", false], [22590, 0.071227, " the", false], [47284, 0.056024, " simple", false], [39193, 0.044038, " other", false], [56679, 0.023925, " multiple", false], [32251, 0.014491, " time", false], [21835, 0.014256, " how", false], [55521, 0.01421, " anything", false], [31370, 0.013188, " many", false], [21273, 0.012577, " any", false]]]}, "raw_delta": 0.2901785714285716, "tuned_delta": 0.34303351532677145}, {"byte_start": 6280, "byte_end": 6284, "display": {"text": "ries", "kind": "normal"}, "is_word": true, "word_id": 1080, "word_key": "ries", "bytes_hex": "72 69 65 73", "compression": {"model_a": "0.01% 0.01% 0.01% 0.01%", "model_b": "0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"model_a": [[26892, "ries", "normal", 0.9985963702201843]], "model_b": [[26892, "ries", "normal", 0.9974856376647949]]}, "loss": {"model_a": 0.006294565021578795, "model_b": 0.011488441077635615}, "topk": {"model_a": [26892, 1, 0.9985963702201843, [[26892, 0.998596, "ries", false], [8623, 0.000666, "riz", false], [7789, 0.000275, "ies", false], [122, 7.9e-05, "y", false], [1939, 6.6e-05, "ic", false], [8619, 3e-05, "ris", false], [26910, 3e-05, "rise", false], [8608, 3e-05, "rie", false], [8562, 1.6e-05, "ral", false], [2159, 1.3e-05, "ri", false]]], "model_b": [26892, 1, 0.9974856376647949, [[26892, 0.997486, "ries", false], [8623, 0.001648, "riz", false], [2174, 9.4e-05, "ry", false], [8604, 8.4e-05, "ria", false], [8562, 5.9e-05, "ral", false], [34367, 4.2e-05, "eries", false], [8619, 4e-05, "ris", false], [8608, 3.7e-05, "rie", false], [7503, 3.2e-05, "ery", false], [115, 2.7e-05, "r", false]]]}, "raw_delta": -0.0002880096435546875, "tuned_delta": 0.052566934254645134}, {"byte_start": 6284, "byte_end": 6285, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "9.93%", "model_b": "12.26%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5768051147460938]], "model_b": [[47, ".", "normal", 0.5059229731559753]]}, "loss": {"model_a": 9.932617224870304, "model_b": 12.257272320052715}, "topk": {"model_a": [47, 1, 0.5768051147460938, [[47, 0.576805, ".", false], [45, 0.290256, ",", false], [4706, 0.02608, " of", false], [4596, 0.025316, " in", false], [60, 0.016649, ";", false], [21265, 0.013815, " and", false], [4715, 0.013222, " or", false], [275, 0.011696, " (", false], [5346, 0.00602, "---", false], [32227, 0.003859, " that", false]]], "model_b": [47, 1, 0.5059229731559753, [[47, 0.505923, ".", false], [45, 0.288255, ",", false], [4706, 0.059319, " of", false], [4596, 0.046065, " in", false], [60, 0.020716, ";", false], [21265, 0.016995, " and", false], [4715, 0.01667, " or", false], [275, 0.011619, " (", false], [5346, 0.010407, "---", false], [21643, 0.003215, " etc", false]]]}, "raw_delta": -0.12890625, "tuned_delta": -0.07605130610180018}, {"byte_start": 6285, "byte_end": 6289, "display": {"text": " All", "kind": "normal"}, "is_word": true, "word_id": 1081, "word_key": " all", "bytes_hex": "20 41 6c 6c", "compression": {"model_a": "20.99% 20.99% 20.99% 20.99%", "model_b": "19.44% 19.44% 19.44% 19.44%"}, "model_tokens": {"model_a": [[19407, " All", "normal", 0.009454779326915741]], "model_b": [[19407, " All", "normal", 0.013401389122009277]]}, "loss": {"model_a": 20.99233995043511, "model_b": 19.44256988698017}, "topk": {"model_a": [19407, 16, 0.009454779326915741, [[20996, 0.16562, " The", false], [4331, 0.110095, " We", false], [37453, 0.057347, " These", false], [29894, 0.050447, " This", false], [50342, 0.050221, " Instead", false], [261, 0.040863, "\n\n", false], [3918, 0.032445, " It", false], [37451, 0.030086, " There", false], [3913, 0.028734, " In", false], [29834, 0.022689, " Such", false]]], "model_b": [19407, 13, 0.013401389122009277, [[4331, 0.118807, " We", false], [20996, 0.113571, " The", false], [50342, 0.079823, " Instead", false], [261, 0.070687, "\n\n", false], [29894, 0.046043, " This", false], [37453, 0.039638, " These", false], [29834, 0.036767, " Such", false], [3918, 0.033268, " It", false], [3913, 0.023347, " In", false], [37451, 0.022648, " There", false]]]}, "raw_delta": 0.0859375, "tuned_delta": 0.13879244389819984}, {"byte_start": 6289, "byte_end": 6295, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1082, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "4.25% 4.25% 4.25% 4.25% 4.25% 4.25%", "model_b": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.2438395619392395]], "model_b": [[39936, " these", "normal", 0.13651275634765625]]}, "loss": {"model_a": 4.250126992202187, "model_b": 6.011229337037347}, "topk": {"model_a": [39936, 2, 0.2438395619392395, [[4706, 0.33131, " of", false], [39936, 0.24384, " these", false], [32139, 0.113905, " such", false], [22590, 0.071002, " the", false], [32234, 0.036246, " this", false], [39944, 0.031499, " those", false], [32227, 0.018973, " that", false], [22248, 0.016006, " our", false], [4858, 0.015094, " we", false], [38720, 0.008961, " human", false]]], "model_b": [39936, 2, 0.13651275634765625, [[4706, 0.259507, " of", false], [39936, 0.136513, " these", false], [4858, 0.074053, " we", false], [22590, 0.07082, " the", false], [32227, 0.057931, " that", false], [32139, 0.052531, " such", false], [32234, 0.035066, " this", false], [22614, 0.018745, " too", false], [51258, 0.016805, " complex", false], [55572, 0.016382, " attempts", false]]]}, "raw_delta": -0.09765624999999999, "tuned_delta": -0.044801306101800165}, {"byte_start": 6295, "byte_end": 6299, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1083, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "7.11% 7.11% 7.11% 7.11%", "model_b": "7.64% 7.64% 7.64% 7.64%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.20627470314502716]], "model_b": [[21286, " are", "normal", 0.1855344921350479]]}, "loss": {"model_a": 7.114853473134048, "model_b": 7.643184176584596}, "topk": {"model_a": [21286, 1, 0.20627470314502716, [[21286, 0.206275, " are", false], [47539, 0.129968, " things", false], [47284, 0.080017, " simple", false], [32448, 0.039883, " ways", false], [61590, 0.036222, " approaches", false], [51566, 0.031937, " efforts", false], [38735, 0.031696, " ideas", false], [55572, 0.029944, " attempts", false], [52326, 0.028261, " notions", false], [55816, 0.023095, " concepts", false]]], "model_b": [21286, 2, 0.1855344921350479, [[47539, 0.206066, " things", false], [21286, 0.185534, " are", false], [61590, 0.046857, " approaches", false], [47284, 0.031225, " simple", false], [52224, 0.028617, " methods", false], [32448, 0.026453, " ways", false], [21413, 0.020001, " can", false], [38735, 0.018738, " ideas", false], [56939, 0.016775, " problems", false], [31059, 0.015534, " have", false]]]}, "raw_delta": -0.029296875, "tuned_delta": 0.02355806889819982}, {"byte_start": 6299, "byte_end": 6304, "display": {"text": " part", "kind": "normal"}, "is_word": true, "word_id": 1084, "word_key": " part", "bytes_hex": "20 70 61 72 74", "compression": {"model_a": "20.63% 20.63% 20.63% 20.63% 20.63%", "model_b": "20.74% 20.74% 20.74% 20.74% 20.74%"}, "model_tokens": {"model_a": [[31633, " part", "normal", 0.003264595055952668]], "model_b": [[31633, " part", "normal", 0.003138284431770444]]}, "loss": {"model_a": 20.626030662709397, "model_b": 20.738741212778844}, "topk": {"model_a": [31633, 55, 0.003264595055952668, [[32386, 0.057129, " very", false], [51258, 0.040381, " complex", false], [47284, 0.039417, " simple", false], [22614, 0.036206, " too", false], [59829, 0.032996, " important", false], [32448, 0.024985, " ways", false], [47687, 0.0205, " useful", false], [59699, 0.017606, " extremely", false], [30992, 0.017008, " good", false], [47539, 0.015304, " things", false]]], "model_b": [31633, 60, 0.003138284431770444, [[59829, 0.035443, " important", false], [32386, 0.029244, " very", false], [51258, 0.02484, " complex", false], [47284, 0.02152, " simple", false], [22614, 0.021368, " too", false], [31198, 0.020861, " just", false], [47687, 0.019867, " useful", false], [22187, 0.019012, " not", false], [53199, 0.014752, " trivial", false], [63667, 0.013222, " interesting", false]]]}, "raw_delta": -0.006249999999999867, "tuned_delta": 0.046604943898199955}, {"byte_start": 6304, "byte_end": 6307, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1085, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.07% 0.07% 0.07%", "model_b": "0.19% 0.19% 0.19%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9886198043823242]], "model_b": [[4706, " of", "normal", 0.9693933725357056]]}, "loss": {"model_a": 0.06934340482788444, "model_b": 0.18711712413873577}, "topk": {"model_a": [4706, 1, 0.9886198043823242, [[4706, 0.98862, " of", false], [21265, 0.007997, " and", false], [46, 0.000928, "-", false], [45, 0.000809, ",", false], [22590, 0.000305, " the", false], [275, 0.000103, " (", false], [4596, 9.4e-05, " in", false], [38720, 6.5e-05, " human", false], [4715, 6.2e-05, " or", false], [32464, 4.4e-05, " what", false]]], "model_b": [4706, 1, 0.9693933725357056, [[4706, 0.969393, " of", false], [21265, 0.025955, " and", false], [45, 0.001918, ",", false], [46, 0.000735, "-", false], [4715, 0.000266, " or", false], [22590, 0.000176, " the", false], [4811, 0.000165, " to", false], [275, 0.000147, " (", false], [21400, 9.6e-05, " but", false], [4596, 8.3e-05, " in", false]]]}, "raw_delta": -0.00653076171875, "tuned_delta": 0.04632418217944982}, {"byte_start": 6307, "byte_end": 6311, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1086, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.62% 2.62% 2.62% 2.62%", "model_b": "2.57% 2.57% 2.57% 2.57%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.5518704652786255]], "model_b": [[22590, " the", "normal", 0.5661008954048157]]}, "loss": {"model_a": 2.6240424938043887, "model_b": 2.571209423459334}, "topk": {"model_a": [22590, 1, 0.5518704652786255, [[22590, 0.55187, " the", false], [32464, 0.081082, " what", false], [22248, 0.049199, " our", false], [38720, 0.042775, " human", false], [332, 0.034769, " a", false], [39026, 0.034717, " minds", false], [21835, 0.032961, " how", false], [52652, 0.025567, " reality", false], [51258, 0.014128, " complex", false], [57419, 0.012332, " thinking", false]]], "model_b": [22590, 1, 0.5661008954048157, [[22590, 0.566101, " the", false], [332, 0.072277, " a", false], [22248, 0.046247, " our", false], [32464, 0.037108, " what", false], [31427, 0.031537, " mind", false], [51258, 0.025248, " complex", false], [38720, 0.016677, " human", false], [4419, 0.012696, " an", false], [39026, 0.011429, " minds", false], [21835, 0.008753, " how", false]]]}, "raw_delta": 0.0029296875, "tuned_delta": 0.05578463139819982}, {"byte_start": 6311, "byte_end": 6321, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1087, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"model_a": "18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60%", "model_b": "21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19%"}, "model_tokens": {"model_a": [[59163, " arbitrary", "normal", 3.2954776543192565e-05]], "model_b": [[59163, " arbitrary", "normal", 8.092461030173581e-06]]}, "loss": {"model_a": 18.597240761459293, "model_b": 21.189583413056653}, "topk": {"model_a": [59163, 989, 3.2954776543192565e-05, [[61720, 0.189838, " complexity", false], [55847, 0.125843, " contents", false], [31427, 0.064222, " mind", false], [38720, 0.061051, " human", false], [51258, 0.034489, " complex", false], [52569, 0.034392, " problem", false], [31835, 0.029809, " real", false], [45098, 0.02618, " actual", false], [51308, 0.024316, " content", false], [22752, 0.023266, " way", false]]], "model_b": [59163, 3266, 8.092461030173581e-06, [[31427, 0.111659, " mind", false], [52569, 0.058696, " problem", false], [38720, 0.058473, " human", false], [51258, 0.035318, " complex", false], [61720, 0.033678, " complexity", false], [46545, 0.031795, " mental", false], [55847, 0.031329, " contents", false], [51832, 0.023493, " general", false], [31937, 0.018202, " same", false], [60572, 0.017647, " structure", false]]]}, "raw_delta": -0.14375000000000004, "tuned_delta": -0.09089505610180022}, {"byte_start": 6321, "byte_end": 6322, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "44.24%", "model_b": "42.27%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.08709270507097244]], "model_b": [[45, ",", "normal", 0.09600146859884262]]}, "loss": {"model_a": 44.23889090225922, "model_b": 42.26645627604385}, "topk": {"model_a": [45, 2, 0.08709270507097244, [[61720, 0.559498, " complexity", false], [45, 0.087093, ",", false], [60572, 0.027163, " structure", false], [21265, 0.0266, " and", false], [64294, 0.023058, " complexities", false], [55847, 0.020693, " contents", false], [51308, 0.014577, " content", false], [46642, 0.011248, " nature", false], [22752, 0.009168, " way", false], [38720, 0.008917, " human", false]]], "model_b": [45, 2, 0.09600146859884262, [[61720, 0.124122, " complexity", false], [45, 0.096001, ",", false], [21265, 0.059999, " and", false], [60572, 0.042285, " structure", false], [38720, 0.029692, " human", false], [22459, 0.02368, " set", false], [46545, 0.021885, " mental", false], [62586, 0.013014, " structures", false], [46642, 0.012459, " nature", false], [31427, 0.011565, " mind", false]]]}, "raw_delta": 0.109375, "tuned_delta": 0.16222994389819984}, {"byte_start": 6322, "byte_end": 6332, "display": {"text": " intrinsic", "kind": "normal"}, "is_word": true, "word_id": 1088, "word_key": " intrinsic", "bytes_hex": "20 69 6e 74 72 69 6e 73 69 63", "compression": {"model_a": "10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76%", "model_b": "13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19%"}, "model_tokens": {"model_a": [[59914, " intrinsic", "normal", 0.00257006729952991]], "model_b": [[59914, " intrinsic", "normal", 0.0006655046599917114]]}, "loss": {"model_a": 10.763857531632498, "model_b": 13.18713435812568}, "topk": {"model_a": [59914, 41, 0.00257006729952991, [[51258, 0.168112, " complex", false], [38720, 0.120729, " human", false], [39011, 0.039742, " messy", false], [63366, 0.037008, " complicated", false], [21265, 0.023765, " and", false], [62590, 0.013957, " subjective", false], [21400, 0.012166, " but", false], [22184, 0.012023, " non", false], [31170, 0.011246, " irre", false], [47284, 0.009976, " simple", false]]], "model_b": [59914, 211, 0.0006655046599917114, [[51258, 0.09761, " complex", false], [38720, 0.074974, " human", false], [21265, 0.051943, " and", false], [22184, 0.039278, " non", false], [21400, 0.025588, " but", false], [63366, 0.023766, " complicated", false], [62590, 0.01542, " subjective", false], [39011, 0.009646, " messy", false], [4832, 0.009573, " un", false], [46199, 0.008962, " highly", false]]]}, "raw_delta": -0.1343749999999999, "tuned_delta": -0.08152005610180009}, {"byte_start": 6332, "byte_end": 6336, "display": {"text": "ally", "kind": "normal"}, "is_word": true, "word_id": 1089, "word_key": "ally", "bytes_hex": "61 6c 6c 79", "compression": {"model_a": "6.52% 6.52% 6.52% 6.52%", "model_b": "9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[24525, "ally", "normal", 0.2388787418603897]], "model_b": [[24525, "ally", "normal", 0.12008100003004074]]}, "loss": {"model_a": 6.516078675890093, "model_b": 9.580396755903271}, "topk": {"model_a": [24525, 2, 0.2388787418603897, [[61720, 0.561462, " complexity", false], [24525, 0.238879, "ally", false], [45, 0.052743, ",", false], [60572, 0.038875, " structure", false], [64294, 0.015643, " complexities", false], [57141, 0.007964, " richness", false], [51308, 0.004677, " content", false], [61865, 0.004196, " difficulty", false], [46642, 0.003498, " nature", false], [64295, 0.003459, " complication", false]]], "model_b": [24525, 2, 0.12008100003004074, [[61720, 0.236419, " complexity", false], [24525, 0.120081, "ally", false], [60572, 0.116478, " structure", false], [45, 0.101052, ",", false], [46642, 0.028703, " nature", false], [62404, 0.021471, " properties", false], [31633, 0.016099, " part", false], [64294, 0.015654, " complexities", false], [51308, 0.014679, " content", false], [56215, 0.013182, " features", false]]]}, "raw_delta": -0.169921875, "tuned_delta": -0.11706693110180018}, {"byte_start": 6336, "byte_end": 6337, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "73.26%", "model_b": "82.28%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.017100265249609947]], "model_b": [[46, "-", "normal", 0.010312858037650585]]}, "loss": {"model_a": 73.26185754514266, "model_b": 82.27870155069868}, "topk": {"model_a": [46, 8, 0.017100265249609947, [[51258, 0.392322, " complex", false], [63366, 0.07073, " complicated", false], [39011, 0.063155, " messy", false], [59516, 0.038032, " difficult", false], [38720, 0.033667, " human", false], [31048, 0.02772, " hard", false], [38797, 0.017816, " intra", false], [46, 0.0171, "-", false], [63667, 0.013607, " interesting", false], [47284, 0.012087, " simple", false]]], "model_b": [46, 7, 0.010312858037650585, [[51258, 0.485884, " complex", false], [63366, 0.15364, " complicated", false], [22184, 0.021109, " non", false], [38720, 0.019111, " human", false], [59516, 0.015276, " difficult", false], [39011, 0.010394, " messy", false], [46, 0.010313, "-", false], [46992, 0.0099, " random", false], [47284, 0.00798, " simple", false], [62234, 0.007844, " mysterious", false]]]}, "raw_delta": -0.5, "tuned_delta": -0.44714505610180016}, {"byte_start": 6337, "byte_end": 6344, "display": {"text": "complex", "kind": "normal"}, "is_word": true, "word_id": 1090, "word_key": "complex", "bytes_hex": "63 6f 6d 70 6c 65 78", "compression": {"model_a": "1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90%", "model_b": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"model_a": [[48997, "complex", "normal", 0.48026081919670105]], "model_b": [[48997, "complex", "normal", 0.5431040525436401]]}, "loss": {"model_a": 1.901990532421973, "model_b": 1.569896947395914}, "topk": {"model_a": [48997, 1, 0.48026081919670105, [[48997, 0.480261, "complex", false], [34165, 0.025834, "compl", false], [25136, 0.021619, "diff", false], [1954, 0.017103, "ir", false], [60985, 0.016859, "determined", false], [2239, 0.016233, "un", false], [25554, 0.015143, "hard", false], [25888, 0.014504, "intr", false], [58259, 0.013899, "generated", false], [8188, 0.012373, "mot", false]]], "model_b": [48997, 1, 0.5431040525436401, [[48997, 0.543104, "complex", false], [34165, 0.043051, "compl", false], [1954, 0.030008, "ir", false], [25136, 0.023231, "diff", false], [2239, 0.02293, "un", false], [8256, 0.015176, "non", false], [7852, 0.011135, "inc", false], [7857, 0.007401, "inh", false], [7855, 0.007307, "inf", false], [8943, 0.006266, "uns", false]]]}, "raw_delta": 0.018415178571428575, "tuned_delta": 0.0712701224696284}, {"byte_start": 6344, "byte_end": 6345, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "45.65%", "model_b": "38.60%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.08097254484891891]], "model_b": [[45, ",", "normal", 0.11626581102609634]]}, "loss": {"model_a": 45.647772778127354, "model_b": 38.60336339878671}, "topk": {"model_a": [45, 4, 0.08097254484891891, [[55847, 0.368191, " contents", false], [46642, 0.144451, " nature", false], [60572, 0.091373, " structure", false], [45, 0.080973, ",", false], [51308, 0.060029, " content", false], [38720, 0.013545, " human", false], [61720, 0.013356, " complexity", false], [52652, 0.011121, " reality", false], [56480, 0.010663, " internal", false], [46, 0.007485, "-", false]]], "model_b": [45, 1, 0.11626581102609634, [[45, 0.116266, ",", false], [60572, 0.114351, " structure", false], [46642, 0.107379, " nature", false], [62586, 0.031687, " structures", false], [55847, 0.03087, " contents", false], [38720, 0.026619, " human", false], [40213, 0.023597, " world", false], [46545, 0.020805, " mental", false], [31633, 0.018071, " part", false], [21265, 0.013869, " and", false]]]}, "raw_delta": 0.390625, "tuned_delta": 0.44347994389819984}, {"byte_start": 6345, "byte_end": 6353, "display": {"text": " outside", "kind": "normal"}, "is_word": true, "word_id": 1091, "word_key": " outside", "bytes_hex": "20 6f 75 74 73 69 64 65", "compression": {"model_a": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[52391, " outside", "normal", 2.4207374735851772e-05]], "model_b": [[52391, " outside", "normal", 0.000163972785230726]]}, "loss": {"model_a": 23.95099188975818, "model_b": 19.724346262153794}, "topk": {"model_a": [52391, 1737, 2.4207374735851772e-05, [[55847, 0.092141, " contents", false], [21265, 0.066423, " and", false], [38720, 0.055793, " human", false], [60572, 0.032053, " structure", false], [39011, 0.031904, " messy", false], [46642, 0.026401, " nature", false], [51308, 0.02518, " content", false], [56480, 0.021106, " internal", false], [31835, 0.020792, " real", false], [63682, 0.020069, " irreducible", false]]], "model_b": [52391, 624, 0.000163972785230726, [[21265, 0.212024, " and", false], [60572, 0.030113, " structure", false], [38720, 0.029599, " human", false], [31427, 0.023046, " mind", false], [22184, 0.022534, " non", false], [31633, 0.019582, " part", false], [56480, 0.015355, " internal", false], [46545, 0.015069, " mental", false], [21400, 0.013077, " but", false], [55847, 0.011727, " contents", false]]]}, "raw_delta": 0.234375, "tuned_delta": 0.28722994389819984}, {"byte_start": 6353, "byte_end": 6359, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 1092, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"model_a": "6.39% 6.39% 6.39% 6.39% 6.39% 6.39%", "model_b": "4.91% 4.91% 4.91% 4.91% 4.91% 4.91%"}, "model_tokens": {"model_a": [[40213, " world", "normal", 0.12151630222797394]], "model_b": [[40213, " world", "normal", 0.19624193012714386]]}, "loss": {"model_a": 6.386931170602182, "model_b": 4.907605200940647}, "topk": {"model_a": [40213, 2, 0.12151630222797394, [[46, 0.661598, "-", false], [40213, 0.121516, " world", false], [22590, 0.019796, " the", false], [52652, 0.016935, " reality", false], [4706, 0.016761, " of", false], [46642, 0.012924, " nature", false], [63536, 0.011069, " environment", false], [63637, 0.006784, " information", false], [60572, 0.006285, " structure", false], [32398, 0.006103, " view", false]]], "model_b": [40213, 2, 0.19624193012714386, [[46, 0.365903, "-", false], [40213, 0.196242, " world", false], [4706, 0.067014, " of", false], [22590, 0.030281, " the", false], [60572, 0.020643, " structure", false], [115, 0.019933, "r", false], [63536, 0.01282, " environment", false], [45, 0.011169, ",", false], [32398, 0.009627, " view", false], [63637, 0.00917, " information", false]]]}, "raw_delta": 0.08203125, "tuned_delta": 0.13488619389819984}, {"byte_start": 6359, "byte_end": 6360, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "19.44%", "model_b": "28.46%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.33790165185928345]], "model_b": [[47, ".", "normal", 0.20563165843486786]]}, "loss": {"model_a": 19.44256988698017, "model_b": 28.45941389253619}, "topk": {"model_a": [47, 1, 0.33790165185928345, [[47, 0.337902, ".", false], [45, 0.240342, ",", false], [32227, 0.111731, " that", false], [4706, 0.060144, " of", false], [4858, 0.055727, " we", false], [60, 0.038773, ";", false], [5346, 0.031326, "---", false], [21265, 0.027216, " and", false], [4596, 0.020275, " in", false], [4811, 0.009836, " to", false]]], "model_b": [47, 2, 0.20563165843486786, [[45, 0.253004, ",", false], [47, 0.205632, ".", false], [32227, 0.186502, " that", false], [4706, 0.152375, " of", false], [4858, 0.039173, " we", false], [60, 0.029136, ";", false], [4811, 0.019161, " to", false], [21265, 0.013748, " and", false], [4596, 0.013518, " in", false], [275, 0.010636, " (", false]]]}, "raw_delta": -0.5, "tuned_delta": -0.44714505610180016}, {"byte_start": 6360, "byte_end": 6365, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 1093, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"model_a": "10.65% 10.65% 10.65% 10.65% 10.65%", "model_b": "13.36% 13.36% 13.36% 13.36% 13.36%"}, "model_tokens": {"model_a": [[29893, " They", "normal", 0.052063412964344025]], "model_b": [[29893, " They", "normal", 0.0244978629052639]]}, "loss": {"model_a": 10.651146981563048, "model_b": 13.356200183229856}, "topk": {"model_a": [29893, 3, 0.052063412964344025, [[20996, 0.167592, " The", false], [4331, 0.125362, " We", false], [29893, 0.052063, " They", false], [50342, 0.037181, " Instead", false], [30031, 0.036277, " What", false], [261, 0.036057, "\n\n", false], [19555, 0.034961, " But", false], [3918, 0.032141, " It", false], [37451, 0.027166, " There", false], [20571, 0.026627, " Our", false]]], "model_b": [29893, 9, 0.0244978629052639, [[20996, 0.128955, " The", false], [4331, 0.123136, " We", false], [261, 0.053078, "\n\n", false], [19555, 0.049723, " But", false], [19407, 0.037249, " All", false], [19417, 0.028631, " And", false], [3918, 0.028004, " It", false], [3913, 0.024734, " In", false], [29893, 0.024498, " They", false], [37451, 0.02287, " There", false]]]}, "raw_delta": -0.15000000000000002, "tuned_delta": -0.0971450561018002}, {"byte_start": 6365, "byte_end": 6369, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1094, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "3.08% 3.08% 3.08% 3.08%", "model_b": "2.76% 2.76% 2.76% 2.76%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.5015393495559692]], "model_b": [[21286, " are", "normal", 0.5470673441886902]]}, "loss": {"model_a": 3.0819291034615306, "model_b": 2.7649306813912014}, "topk": {"model_a": [21286, 1, 0.5015393495559692, [[21286, 0.501539, " are", false], [4491, 0.077681, " do", false], [47266, 0.054977, " should", false], [31059, 0.048038, " have", false], [21413, 0.040852, " can", false], [45409, 0.038683, " cannot", false], [22074, 0.019346, " may", false], [21256, 0.015873, " all", false], [32475, 0.015828, " will", false], [31506, 0.011301, " need", false]]], "model_b": [21286, 1, 0.5470673441886902, [[21286, 0.547067, " are", false], [4491, 0.095347, " do", false], [47266, 0.07655, " should", false], [45409, 0.043867, " cannot", false], [21413, 0.038354, " can", false], [31059, 0.034671, " have", false], [22074, 0.010998, " may", false], [21256, 0.009159, " all", false], [32475, 0.00876, " will", false], [31506, 0.008616, " need", false]]]}, "raw_delta": 0.017578125, "tuned_delta": 0.07043306889819982}, {"byte_start": 6369, "byte_end": 6373, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1095, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "5.71% 5.71% 5.71% 5.71%", "model_b": "5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.28315263986587524]], "model_b": [[22187, " not", "normal", 0.28380754590034485]]}, "loss": {"model_a": 5.705971597265919, "model_b": 5.670749550369216}, "topk": {"model_a": [22187, 1, 0.28315263986587524, [[22187, 0.283153, " not", false], [31633, 0.052959, " part", false], [21256, 0.046857, " all", false], [22590, 0.046311, " the", false], [332, 0.016409, " a", false], [31198, 0.013404, " just", false], [31296, 0.012964, " like", false], [45, 0.012488, ",", false], [32464, 0.011116, " what", false], [47687, 0.010121, " useful", false]]], "model_b": [22187, 1, 0.28380754590034485, [[22187, 0.283808, " not", false], [21256, 0.043251, " all", false], [31633, 0.043105, " part", false], [22590, 0.037616, " the", false], [31198, 0.026589, " just", false], [47285, 0.017917, " simply", false], [52391, 0.017075, " outside", false], [4692, 0.014967, " no", false], [332, 0.014375, " a", false], [31581, 0.013478, " only", false]]]}, "raw_delta": 0.001953125, "tuned_delta": 0.05480806889819982}, {"byte_start": 6373, "byte_end": 6378, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1096, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"model_a": "16.68% 16.68% 16.68% 16.68% 16.68%", "model_b": "14.88% 14.88% 14.88% 14.88% 14.88%"}, "model_tokens": {"model_a": [[32464, " what", "normal", 0.009767157025635242]], "model_b": [[32464, " what", "normal", 0.016299165785312653]]}, "loss": {"model_a": 16.681161410278637, "model_b": 14.877792609167432}, "topk": {"model_a": [32464, 13, 0.009767157025635242, [[31633, 0.125699, " part", false], [22590, 0.104922, " the", false], [59914, 0.099353, " intrinsic", false], [47284, 0.045616, " simple", false], [45, 0.026272, ",", false], [4596, 0.021291, " in", false], [47539, 0.016635, " things", false], [63591, 0.013779, " fundamental", false], [332, 0.012337, " a", false], [4811, 0.011596, " to", false]]], "model_b": [32464, 8, 0.016299165785312653, [[22590, 0.135856, " the", false], [31633, 0.08837, " part", false], [39239, 0.033019, " parts", false], [47539, 0.02499, " things", false], [45, 0.023574, ",", false], [47284, 0.016965, " simple", false], [31198, 0.016805, " just", false], [32464, 0.016299, " what", false], [47687, 0.015355, " useful", false], [332, 0.014812, " a", false]]]}, "raw_delta": 0.10000000000000009, "tuned_delta": 0.15285494389819992}, {"byte_start": 6378, "byte_end": 6385, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1097, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.009509346447885036]], "model_b": [[47266, " should", "normal", 0.00651921983808279]]}, "loss": {"model_a": 11.99562282882006, "model_b": 12.96171325798678}, "topk": {"model_a": [47266, 15, 0.009509346447885036, [[4858, 0.245569, " we", false], [4600, 0.137036, " is", false], [39026, 0.12414, " minds", false], [22590, 0.097321, " the", false], [3609, 0.038226, " AI", false], [38964, 0.023178, " makes", false], [21286, 0.016222, " are", false], [52201, 0.014551, " matters", false], [22248, 0.01279, " our", false], [31358, 0.01176, " make", false]]], "model_b": [47266, 21, 0.00651921983808279, [[4858, 0.345438, " we", false], [22590, 0.09852, " the", false], [39026, 0.059116, " minds", false], [4600, 0.04466, " is", false], [22799, 0.033688, " you", false], [21286, 0.027676, " are", false], [52201, 0.026611, " matters", false], [46787, 0.024403, " people", false], [31427, 0.021059, " mind", false], [332, 0.021024, " a", false]]]}, "raw_delta": -0.0535714285714286, "tuned_delta": -0.0007164846732287816}, {"byte_start": 6385, "byte_end": 6388, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1098, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "0.91% 0.91% 0.91%", "model_b": "0.86% 0.86% 0.86%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.8579688668251038]], "model_b": [[4435, " be", "normal", 0.8666996359825134]]}, "loss": {"model_a": 0.9099028781648327, "model_b": 0.8629401489692285}, "topk": {"model_a": [4435, 1, 0.8579688668251038, [[4435, 0.857969, " be", false], [46530, 0.01667, " matter", false], [38306, 0.015391, " drive", false], [38649, 0.012407, " guide", false], [51273, 0.008099, " concern", false], [4715, 0.005676, " or", false], [38377, 0.004288, " enter", false], [46286, 0.003808, " inform", false], [56675, 0.003457, " motivate", false], [4559, 0.003118, " go", false]]], "model_b": [4435, 1, 0.8666996359825134, [[4435, 0.8667, " be", false], [46530, 0.031652, " matter", false], [51273, 0.010099, " concern", false], [56477, 0.005399, " interest", false], [56675, 0.005304, " motivate", false], [4715, 0.004459, " or", false], [38649, 0.004344, " guide", false], [38129, 0.003953, " count", false], [38377, 0.003841, " enter", false], [38306, 0.003588, " drive", false]]]}, "raw_delta": 0.0026041666666666644, "tuned_delta": 0.055459110564866486}, {"byte_start": 6388, "byte_end": 6394, "display": {"text": " built", "kind": "normal"}, "is_word": true, "word_id": 1099, "word_key": " built", "bytes_hex": "20 62 75 69 6c 74", "compression": {"model_a": "10.75% 10.75% 10.75% 10.75% 10.75% 10.75%", "model_b": "17.38% 17.38% 17.38% 17.38% 17.38% 17.38%"}, "model_tokens": {"model_a": [[37924, " built", "normal", 0.027898862957954407]], "model_b": [[37924, " built", "normal", 0.0030444329604506493]]}, "loss": {"model_a": 10.754464985793378, "model_b": 17.37620980237358}, "topk": {"model_a": [37924, 8, 0.027898862957954407, [[22339, 0.098334, " put", false], [22590, 0.084747, " the", false], [53137, 0.060074, " thought", false], [53035, 0.050332, " studied", false], [52249, 0.037992, " modeled", false], [52112, 0.036045, " learned", false], [4596, 0.034163, " in", false], [37924, 0.027899, " built", false], [32354, 0.025557, " used", false], [61755, 0.0234, " considered", false]]], "model_b": [37924, 40, 0.0030444329604506493, [[53137, 0.18473, " thought", false], [22590, 0.097333, " the", false], [53035, 0.049439, " studied", false], [61755, 0.047753, " considered", false], [47340, 0.043364, " sought", false], [52112, 0.034839, " learned", false], [57173, 0.026424, " searched", false], [51770, 0.025646, " focused", false], [64466, 0.02126, " investigated", false], [59080, 0.019911, " addressed", false]]]}, "raw_delta": -0.3671875, "tuned_delta": -0.31433255610180016}, {"byte_start": 6394, "byte_end": 6397, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1100, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "16.53% 16.53% 16.53%", "model_b": "10.05% 10.05% 10.05%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.06395498663187027]], "model_b": [[4596, " in", "normal", 0.18705400824546814]]}, "loss": {"model_a": 16.530880676852703, "model_b": 10.050024047859313}, "topk": {"model_a": [4596, 2, 0.06395498663187027, [[31162, 0.887248, " into", false], [4596, 0.063955, " in", false], [46, 0.007633, "-", false], [46301, 0.005777, " inside", false], [4450, 0.004352, " by", false], [47, 0.003867, ".", false], [45, 0.003111, ",", false], [4712, 0.002163, " on", false], [21265, 0.002148, " and", false], [4423, 0.001869, " as", false]]], "model_b": [4596, 2, 0.18705400824546814, [[31162, 0.764708, " into", false], [4596, 0.187054, " in", false], [4712, 0.006951, " on", false], [4833, 0.006522, " up", false], [46, 0.006364, "-", false], [32350, 0.00372, " upon", false], [45, 0.0021, ",", false], [46301, 0.001784, " inside", false], [4423, 0.001773, " as", false], [47, 0.001767, ".", false]]]}, "raw_delta": 0.359375, "tuned_delta": 0.41222994389819984}, {"byte_start": 6397, "byte_end": 6398, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "40.86%", "model_b": "35.22%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.10300812125205994]], "model_b": [[45, ",", "normal", 0.14022842049598694]]}, "loss": {"model_a": 40.857574400175714, "model_b": 35.222046896703205}, "topk": {"model_a": [45, 3, 0.10300812125205994, [[4811, 0.450276, " to", false], [47, 0.232219, ".", false], [45, 0.103008, ",", false], [4423, 0.044338, " as", false], [4450, 0.018468, " by", false], [60, 0.015844, ";", false], [21265, 0.01479, " and", false], [4715, 0.01246, " or", false], [22590, 0.012325, " the", false], [5346, 0.010281, "---", false]]], "model_b": [45, 3, 0.14022842049598694, [[47, 0.224094, ".", false], [4811, 0.195724, " to", false], [45, 0.140228, ",", false], [3609, 0.052707, " AI", false], [60, 0.039483, ";", false], [4423, 0.037077, " as", false], [22590, 0.031068, " the", false], [22248, 0.028916, " our", false], [45124, 0.017316, " agents", false], [31162, 0.016302, " into", false]]]}, "raw_delta": 0.3125, "tuned_delta": 0.36535494389819984}, {"byte_start": 6398, "byte_end": 6401, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1101, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "16.06% 16.06% 16.06%", "model_b": "20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.06949476897716522]], "model_b": [[4423, " as", "normal", 0.031737927347421646]]}, "loss": {"model_a": 16.061253384896663, "model_b": 20.851451762848296}, "topk": {"model_a": [4423, 5, 0.06949476897716522, [[21265, 0.190713, " and", false], [21400, 0.189232, " but", false], [4715, 0.096492, " or", false], [32232, 0.075727, " they", false], [4423, 0.069495, " as", false], [22185, 0.035437, " nor", false], [51018, 0.034658, " because", false], [4596, 0.032904, " in", false], [4811, 0.016522, " to", false], [22187, 0.012724, " not", false]]], "model_b": [4423, 6, 0.031737927347421646, [[21265, 0.278308, " and", false], [21400, 0.185147, " but", false], [4715, 0.177852, " or", false], [22185, 0.047072, " nor", false], [51018, 0.038965, " because", false], [4423, 0.031738, " as", false], [32232, 0.020835, " they", false], [22187, 0.013806, " not", false], [4596, 0.010812, " in", false], [40186, 0.009334, " which", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21277005610180016}, {"byte_start": 6401, "byte_end": 6407, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 1102, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "15.97% 15.97% 15.97% 15.97% 15.97% 15.97%", "model_b": "18.32% 18.32% 18.32% 18.32% 18.32% 18.32%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.004956191871315241]], "model_b": [[39931, " their", "normal", 0.00223975395783782]]}, "loss": {"model_a": 15.967327926505453, "model_b": 18.315464386285665}, "topk": {"model_a": [39931, 31, 0.004956191871315241, [[32232, 0.158113, " they", false], [22590, 0.068888, " the", false], [332, 0.066142, " a", false], [31633, 0.051093, " part", false], [4858, 0.041154, " we", false], [4601, 0.032295, " it", false], [4588, 0.029713, " if", false], [55666, 0.026474, " building", false], [52369, 0.022488, " opposed", false], [4600, 0.018126, " is", false]]], "model_b": [39931, 49, 0.00223975395783782, [[332, 0.101566, " a", false], [22590, 0.085453, " the", false], [32232, 0.080176, " they", false], [4858, 0.069637, " we", false], [4588, 0.053242, " if", false], [31633, 0.030433, " part", false], [4596, 0.027324, " in", false], [4419, 0.025698, " an", false], [4601, 0.022165, " it", false], [47284, 0.019287, " simple", false]]]}, "raw_delta": -0.13020833333333337, "tuned_delta": -0.07735338943513355}, {"byte_start": 6407, "byte_end": 6418, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1103, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"model_a": "3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46%", "model_b": "5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23%"}, "model_tokens": {"model_a": [[61720, " complexity", "normal", 0.11990325152873993]], "model_b": [[61720, " complexity", "normal", 0.04138169437646866]]}, "loss": {"model_a": 3.458164604403588, "model_b": 5.225670957765423}, "topk": {"model_a": [61720, 1, 0.11990325152873993, [[61720, 0.119903, " complexity", false], [55847, 0.069264, " contents", false], [56916, 0.051108, " presence", false], [22681, 0.033647, " use", false], [32386, 0.027639, " very", false], [59914, 0.021764, " intrinsic", false], [59677, 0.021245, " existence", false], [51308, 0.015142, " content", false], [45098, 0.014203, " actual", false], [31894, 0.012041, " role", false]]], "model_b": [61720, 2, 0.04138169437646866, [[56916, 0.058357, " presence", false], [61720, 0.041382, " complexity", false], [59914, 0.027206, " intrinsic", false], [59677, 0.026961, " existence", false], [22681, 0.021438, " use", false], [40093, 0.018432, " value", false], [56480, 0.018247, " internal", false], [55666, 0.016791, " building", false], [31410, 0.016573, " mere", false], [22251, 0.015248, " own", false]]]}, "raw_delta": -0.09801136363636363, "tuned_delta": -0.04515641973816381}, {"byte_start": 6418, "byte_end": 6421, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1104, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "7.47% 7.47% 7.47%", "model_b": "7.09% 7.09% 7.09%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.2851680815219879]], "model_b": [[4600, " is", "normal", 0.3053942322731018]]}, "loss": {"model_a": 7.467073942101079, "model_b": 7.0913721085362456}, "topk": {"model_a": [4600, 1, 0.2851680815219879, [[4600, 0.285168, " is", false], [38964, 0.077583, " makes", false], [40219, 0.050165, " would", false], [32475, 0.045758, " will", false], [21265, 0.044136, " and", false], [45409, 0.030682, " cannot", false], [21413, 0.029812, " can", false], [30659, 0.023042, " does", false], [47266, 0.019247, " should", false], [21800, 0.017056, " has", false]]], "model_b": [4600, 1, 0.3053942322731018, [[4600, 0.305394, " is", false], [38964, 0.091797, " makes", false], [21265, 0.062869, " and", false], [40219, 0.033211, " would", false], [21413, 0.029448, " can", false], [47266, 0.01817, " should", false], [30659, 0.017897, " does", false], [32475, 0.016788, " will", false], [45, 0.014677, ",", false], [45409, 0.014378, " cannot", false]]]}, "raw_delta": 0.020833333333333315, "tuned_delta": 0.07368827723153314}, {"byte_start": 6421, "byte_end": 6429, "display": {"text": " endless", "kind": "normal"}, "is_word": true, "word_id": 1105, "word_key": " endless", "bytes_hex": "20 65 6e 64 6c 65 73 73", "compression": {"model_a": "18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[51607, " endless", "normal", 0.0003396036918275058]], "model_b": [[51607, " endless", "normal", 0.00015300532686524093]]}, "loss": {"model_a": 18.03368801111204, "model_b": 19.724346262153794}, "topk": {"model_a": [51607, 249, 0.0003396036918275058, [[22187, 0.173715, " not", false], [332, 0.068451, " a", false], [22614, 0.064905, " too", false], [4419, 0.040421, " an", false], [45302, 0.029566, " beyond", false], [31581, 0.023512, " only", false], [62161, 0.020926, " irrelevant", false], [31633, 0.020267, " part", false], [47285, 0.019136, " simply", false], [22590, 0.017136, " the", false]]], "model_b": [51607, 454, 0.00015300532686524093, [[22187, 0.14609, " not", false], [22614, 0.069662, " too", false], [59914, 0.041591, " intrinsic", false], [45302, 0.036831, " beyond", false], [47285, 0.035641, " simply", false], [332, 0.027518, " a", false], [4788, 0.023186, " so", false], [62161, 0.022301, " irrelevant", false], [56454, 0.021485, " inherent", false], [22590, 0.020371, " the", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.04089505610180018}, {"byte_start": 6429, "byte_end": 6430, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"model_a": "81.72%", "model_b": "95.24%"}, "model_tokens": {"model_a": [[60, ";", "normal", 0.010762616991996765]], "model_b": [[60, ";", "normal", 0.004989249631762505]]}, "loss": {"model_a": 81.71514880035143, "model_b": 95.24041480868547}, "topk": {"model_a": [60, 5, 0.010762616991996765, [[2030, 0.5095, "ly", false], [47, 0.192344, ".", false], [21265, 0.139689, " and", false], [45, 0.118806, ",", false], [60, 0.010763, ";", false], [4596, 0.005694, " in", false], [5346, 0.003441, "---", false], [275, 0.002819, " (", false], [4811, 0.001525, " to", false], [55794, 0.001422, " compared", false]]], "model_b": [60, 6, 0.004989249631762505, [[2030, 0.564235, "ly", false], [47, 0.215706, ".", false], [45, 0.091124, ",", false], [21265, 0.090656, " and", false], [4596, 0.006071, " in", false], [60, 0.004989, ";", false], [275, 0.003537, " (", false], [4811, 0.003304, " to", false], [45302, 0.002354, " beyond", false], [4715, 0.00147, " or", false]]]}, "raw_delta": -0.75, "tuned_delta": -0.6971450561018002}, {"byte_start": 6430, "byte_end": 6438, "display": {"text": " instead", "kind": "normal"}, "is_word": true, "word_id": 1106, "word_key": " instead", "bytes_hex": "20 69 6e 73 74 65 61 64", "compression": {"model_a": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "model_b": "4.19% 4.19% 4.19% 4.19% 4.19% 4.19% 4.19% 4.19%"}, "model_tokens": {"model_a": [[52028, " instead", "normal", 0.09278695285320282]], "model_b": [[52028, " instead", "normal", 0.1568000614643097]]}, "loss": {"model_a": 5.353751128298887, "model_b": 4.191423580707681}, "topk": {"model_a": [52028, 3, 0.09278695285320282, [[32232, 0.280362, " they", false], [4858, 0.118927, " we", false], [52028, 0.092787, " instead", false], [22590, 0.077168, " the", false], [32464, 0.058902, " what", false], [4601, 0.041245, " it", false], [47001, 0.036929, " rather", false], [21265, 0.028704, " and", false], [39931, 0.022382, " their", false], [21256, 0.016498, " all", false]]], "model_b": [52028, 2, 0.1568000614643097, [[32232, 0.227774, " they", false], [52028, 0.1568, " instead", false], [4858, 0.084703, " we", false], [22590, 0.058013, " the", false], [47001, 0.041544, " rather", false], [21265, 0.04094, " and", false], [4601, 0.034678, " it", false], [21256, 0.025717, " all", false], [39931, 0.022529, " their", false], [32464, 0.01926, " what", false]]]}, "raw_delta": 0.064453125, "tuned_delta": 0.11730806889819982}, {"byte_start": 6438, "byte_end": 6441, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1107, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "9.02% 9.02% 9.02%", "model_b": "11.79% 11.79% 11.79%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.225086972117424]], "model_b": [[4858, " we", "normal", 0.1405961960554123]]}, "loss": {"model_a": 9.01684400555602, "model_b": 11.787645028096673}, "topk": {"model_a": [4858, 2, 0.225086972117424, [[45, 0.59832, ",", false], [4858, 0.225087, " we", false], [32232, 0.065118, " they", false], [22590, 0.027785, " the", false], [32464, 0.017297, " what", false], [4706, 0.013835, " of", false], [22226, 0.005706, " one", false], [4601, 0.005062, " it", false], [21256, 0.003536, " all", false], [22248, 0.003487, " our", false]]], "model_b": [4858, 2, 0.1405961960554123, [[45, 0.728288, ",", false], [4858, 0.140596, " we", false], [32232, 0.049672, " they", false], [22590, 0.015996, " the", false], [4706, 0.01047, " of", false], [4601, 0.007, " it", false], [21256, 0.004624, " all", false], [39936, 0.004618, " these", false], [22248, 0.002869, " our", false], [32464, 0.002846, " what", false]]]}, "raw_delta": -0.15364583333333337, "tuned_delta": -0.10079088943513355}, {"byte_start": 6441, "byte_end": 6448, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1108, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%", "model_b": "0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.9046232104301453]], "model_b": [[47266, " should", "normal", 0.8708916902542114]]}, "loss": {"model_a": 0.25787570049371983, "model_b": 0.3522204689670321}, "topk": {"model_a": [47266, 1, 0.9046232104301453, [[47266, 0.904623, " should", false], [31475, 0.029229, " must", false], [31506, 0.019525, " need", false], [31059, 0.010758, " have", false], [21286, 0.005716, " are", false], [39196, 0.004474, " ought", false], [21413, 0.003611, " can", false], [37923, 0.001965, " build", false], [32435, 0.001395, " want", false], [22626, 0.001112, " try", false]]], "model_b": [47266, 1, 0.8708916902542114, [[47266, 0.870892, " should", false], [31506, 0.052343, " need", false], [31475, 0.023585, " must", false], [31059, 0.014998, " have", false], [21286, 0.009796, " are", false], [21413, 0.003751, " can", false], [32435, 0.003155, " want", false], [39196, 0.002566, " ought", false], [37923, 0.001661, " build", false], [32475, 0.001368, " will", false]]]}, "raw_delta": -0.005231584821428571, "tuned_delta": 0.04762335907677125}, {"byte_start": 6448, "byte_end": 6454, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 1109, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"model_a": "5.47% 5.47% 5.47% 5.47% 5.47% 5.47%", "model_b": "4.18% 4.18% 4.18% 4.18% 4.18% 4.18%"}, "model_tokens": {"model_a": [[37923, " build", "normal", 0.16256456077098846]], "model_b": [[37923, " build", "normal", 0.25247105956077576]]}, "loss": {"model_a": 5.471157951287898, "model_b": 4.179682898408781}, "topk": {"model_a": [37923, 1, 0.16256456077098846, [[37923, 0.162565, " build", false], [38530, 0.107315, " focus", false], [4435, 0.092197, " be", false], [38877, 0.050963, " learn", false], [22626, 0.048028, " try", false], [31966, 0.03456, " seek", false], [63373, 0.027311, " concentrate", false], [32122, 0.02306, " stop", false], [22681, 0.021543, " use", false], [39942, 0.018536, " think", false]]], "model_b": [37923, 1, 0.25247105956077576, [[37923, 0.252471, " build", false], [4435, 0.11638, " be", false], [38530, 0.083869, " focus", false], [38877, 0.061984, " learn", false], [22626, 0.053088, " try", false], [22681, 0.037038, " use", false], [31966, 0.035156, " seek", false], [39942, 0.025552, " think", false], [39801, 0.020159, " start", false], [31324, 0.012899, " look", false]]]}, "raw_delta": 0.07161458333333336, "tuned_delta": 0.12446952723153318}, {"byte_start": 6454, "byte_end": 6457, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1110, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "8.74% 8.74% 8.74%", "model_b": "4.77% 4.77% 4.77%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.23339763283729553]], "model_b": [[4596, " in", "normal", 0.4502284526824951]]}, "loss": {"model_a": 8.735067630382394, "model_b": 4.766717013353834}, "topk": {"model_a": [4596, 1, 0.23339763283729553, [[4596, 0.233398, " in", false], [52224, 0.115297, " methods", false], [53087, 0.076517, " systems", false], [22590, 0.041105, " the", false], [45124, 0.039255, " agents", false], [332, 0.028688, " a", false], [22248, 0.025575, " our", false], [56567, 0.022148, " machines", false], [51258, 0.019313, " complex", false], [51832, 0.017407, " general", false]]], "model_b": [4596, 1, 0.4502284526824951, [[4596, 0.450228, " in", false], [52224, 0.064811, " methods", false], [53087, 0.039067, " systems", false], [51832, 0.02709, " general", false], [332, 0.026059, " a", false], [22590, 0.017122, " the", false], [47284, 0.016846, " simple", false], [31162, 0.016203, " into", false], [3609, 0.012395, " AI", false], [22248, 0.011912, " our", false]]]}, "raw_delta": 0.22005208333333334, "tuned_delta": 0.27290702723153315}, {"byte_start": 6457, "byte_end": 6462, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1111, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "15.55% 15.55% 15.55% 15.55% 15.55%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.020120054483413696]], "model_b": [[31581, " only", "normal", 0.013624908402562141]]}, "loss": {"model_a": 14.088818758681281, "model_b": 15.554055909584136}, "topk": {"model_a": [31581, 10, 0.020120054483413696, [[22590, 0.165143, " the", false], [52224, 0.091122, " methods", false], [63370, 0.051963, " computation", false], [332, 0.044219, " a", false], [51832, 0.037135, " general", false], [32464, 0.034414, " what", false], [64862, 0.022889, " computational", false], [32448, 0.022471, " ways", false], [52195, 0.022044, " massive", false], [31581, 0.02012, " only", false]]], "model_b": [31581, 9, 0.013624908402562141, [[22590, 0.160676, " the", false], [51832, 0.096966, " general", false], [52224, 0.080463, " methods", false], [332, 0.0638, " a", false], [32464, 0.0254, " what", false], [47284, 0.023154, " simple", false], [56900, 0.022515, " powerful", false], [32448, 0.019659, " ways", false], [31581, 0.013625, " only", false], [4419, 0.013077, " an", false]]]}, "raw_delta": -0.08125000000000004, "tuned_delta": -0.028395056101800223}, {"byte_start": 6462, "byte_end": 6466, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1112, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "4.58% 4.58% 4.58% 4.58%", "model_b": "4.05% 4.05% 4.05% 4.05%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.36237138509750366]], "model_b": [[22590, " the", "normal", 0.40691736340522766]]}, "loss": {"model_a": 4.578866096571416, "model_b": 4.050535393120868}, "topk": {"model_a": [22590, 1, 0.36237138509750366, [[22590, 0.362371, " the", false], [32464, 0.250409, " what", false], [332, 0.04651, " a", false], [39944, 0.035939, " those", false], [47284, 0.03561, " simple", false], [32227, 0.025152, " that", false], [4423, 0.024181, " as", false], [39931, 0.014073, " their", false], [21835, 0.011588, " how", false], [45865, 0.011292, " enough", false]]], "model_b": [22590, 1, 0.40691736340522766, [[22590, 0.406917, " the", false], [32464, 0.233602, " what", false], [39944, 0.148495, " those", false], [32227, 0.030755, " that", false], [332, 0.018116, " a", false], [52224, 0.014862, " methods", false], [47284, 0.00952, " simple", false], [32139, 0.00861, " such", false], [51832, 0.008318, " general", false], [4423, 0.005873, " as", false]]]}, "raw_delta": 0.029296875, "tuned_delta": 0.08215181889819982}, {"byte_start": 6466, "byte_end": 6471, "display": {"text": " meta", "kind": "normal"}, "is_word": true, "word_id": 1113, "word_key": " meta", "bytes_hex": "20 6d 65 74 61", "compression": {"model_a": "36.52% 36.52% 36.52% 36.52% 36.52%", "model_b": "34.04% 34.04% 34.04% 34.04% 34.04%"}, "model_tokens": {"model_a": [[31416, " meta", "normal", 3.984987051808275e-05]], "model_b": [[31416, " meta", "normal", 7.876606832724065e-05]]}, "loss": {"model_a": 36.51821822250188, "model_b": 34.038586120973974}, "topk": {"model_a": [31416, 1042, 3.984987051808275e-05, [[57234, 0.061023, " simplest", false], [47284, 0.056931, " simple", false], [52236, 0.049452, " minimal", false], [32386, 0.040343, " very", false], [47539, 0.036873, " things", false], [61720, 0.033382, " complexity", false], [59644, 0.029384, " essential", false], [60050, 0.027863, " necessary", false], [52237, 0.026598, " minimum", false], [64862, 0.024904, " computational", false]]], "model_b": [31416, 692, 7.876606832724065e-05, [[31461, 0.087997, " most", false], [47539, 0.087296, " things", false], [52224, 0.056433, " methods", false], [57234, 0.052172, " simplest", false], [47284, 0.044938, " simple", false], [38841, 0.024545, " kinds", false], [39239, 0.024472, " parts", false], [60050, 0.02431, " necessary", false], [39979, 0.021226, " tools", false], [51832, 0.019263, " general", false]]]}, "raw_delta": 0.13749999999999996, "tuned_delta": 0.1903549438981998}, {"byte_start": 6471, "byte_end": 6472, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "4.14%", "model_b": "4.47%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.796599805355072]], "model_b": [[46, "-", "normal", 0.7813253998756409]]}, "loss": {"model_a": 4.138590510362627, "model_b": 4.473199955881307}, "topk": {"model_a": [46, 1, 0.796599805355072, [[46, 0.7966, "-", false], [58313, 0.018248, "knowledge", false], [1798, 0.018139, "co", false], [59943, 0.011431, " knowledge", false], [58449, 0.009784, "structure", false], [63039, 0.009269, "computation", false], [38887, 0.007528, " level", false], [45, 0.005498, ",", false], [65275, 0.00422, " representations", false], [65062, 0.003953, "representation", false]]], "model_b": [46, 1, 0.7813253998756409, [[46, 0.781325, "-", false], [59943, 0.04773, " knowledge", false], [58313, 0.017234, "knowledge", false], [1798, 0.017024, "co", false], [63637, 0.007215, " information", false], [38887, 0.007157, " level", false], [34991, 0.00691, "level", false], [58257, 0.004613, "functions", false], [42364, 0.003727, "theory", false], [35074, 0.0036, "model", false]]]}, "raw_delta": -0.0185546875, "tuned_delta": 0.03430025639819982}, {"byte_start": 6472, "byte_end": 6479, "display": {"text": "methods", "kind": "normal"}, "is_word": true, "word_id": 1114, "word_key": "methods", "bytes_hex": "6d 65 74 68 6f 64 73", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "12.08% 12.08% 12.08% 12.08% 12.08% 12.08% 12.08%"}, "model_tokens": {"model_a": [[49411, "methods", "normal", 0.004223444499075413]], "model_b": [[49411, "methods", "normal", 0.009321354329586029]]}, "loss": {"model_a": 14.088818758681281, "model_b": 12.076130364583953}, "topk": {"model_a": [49411, 30, 0.004223444499075413, [[34991, 0.252817, "level", false], [58313, 0.11494, "knowledge", false], [58449, 0.060543, "structure", false], [61110, 0.038584, "structures", false], [61078, 0.030329, "properties", false], [49000, 0.029133, "concept", false], [63039, 0.027878, "computation", false], [48997, 0.02559, "complex", false], [35596, 0.022949, "rules", false], [1798, 0.021988, "co", false]]], "model_b": [49411, 17, 0.009321354329586029, [[34991, 0.293571, "level", false], [58313, 0.166369, "knowledge", false], [1798, 0.042067, "co", false], [63069, 0.030269, "information", false], [8801, 0.01746, "the", false], [53988, 0.015645, "features", false], [63039, 0.014396, "computation", false], [42364, 0.012858, "theory", false], [58257, 0.011854, "functions", false], [33992, 0.011726, "aware", false]]]}, "raw_delta": 0.1116071428571429, "tuned_delta": 0.16446208675534274}, {"byte_start": 6479, "byte_end": 6484, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1115, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "2.51% 2.51% 2.51% 2.51% 2.51%", "model_b": "2.78% 2.78% 2.78% 2.78% 2.78%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.49592798948287964]], "model_b": [[32227, " that", "normal", 0.46446260809898376]]}, "loss": {"model_a": 2.5078097390452685, "model_b": 2.7754972954602124}, "topk": {"model_a": [32227, 1, 0.49592798948287964, [[32227, 0.495928, " that", false], [45, 0.153088, ",", false], [21700, 0.067381, " for", false], [4706, 0.049, " of", false], [21265, 0.038538, " and", false], [4811, 0.033764, " to", false], [5346, 0.028882, "---", false], [46650, 0.027138, " needed", false], [4858, 0.012509, " we", false], [47, 0.012496, ".", false]]], "model_b": [32227, 1, 0.46446260809898376, [[32227, 0.464463, " that", false], [45, 0.133062, ",", false], [4706, 0.055353, " of", false], [5346, 0.049022, "---", false], [60050, 0.04747, " necessary", false], [21265, 0.045329, " and", false], [46650, 0.044001, " needed", false], [275, 0.025968, " (", false], [4858, 0.022126, " we", false], [4811, 0.016805, " to", false]]]}, "raw_delta": -0.014843749999999989, "tuned_delta": 0.03801119389819983}, {"byte_start": 6484, "byte_end": 6488, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1116, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "10.92% 10.92% 10.92% 10.92%", "model_b": "10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.08990895003080368]], "model_b": [[21413, " can", "normal", 0.09972461313009262]]}, "loss": {"model_a": 10.918834537977993, "model_b": 10.425725881424148}, "topk": {"model_a": [21413, 3, 0.08990895003080368, [[21286, 0.129939, " are", false], [45851, 0.12884, " enable", false], [21413, 0.089909, " can", false], [39590, 0.069381, " scale", false], [37675, 0.068671, " allow", false], [56540, 0.04463, " leverage", false], [31358, 0.03934, " make", false], [4858, 0.02903, " we", false], [32475, 0.022038, " will", false], [31073, 0.01681, " help", false]]], "model_b": [21413, 2, 0.09972461313009262, [[21286, 0.159571, " are", false], [21413, 0.099725, " can", false], [45851, 0.086815, " enable", false], [4858, 0.074008, " we", false], [37675, 0.066487, " allow", false], [31358, 0.044713, " make", false], [39590, 0.025917, " scale", false], [31073, 0.019496, " help", false], [32475, 0.017347, " will", false], [31059, 0.016314, " have", false]]]}, "raw_delta": 0.02734375, "tuned_delta": 0.08019869389819982}, {"byte_start": 6488, "byte_end": 6493, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1117, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"model_a": "18.71% 18.71% 18.71% 18.71% 18.71%", "model_b": "21.75% 21.75% 21.75% 21.75% 21.75%"}, "model_tokens": {"model_a": [[30858, " find", "normal", 0.005635255016386509]], "model_b": [[30858, " find", "normal", 0.002400430617853999]]}, "loss": {"model_a": 18.709951311528744, "model_b": 21.7531361634039}, "topk": {"model_a": [30858, 24, 0.005635255016386509, [[39590, 0.169386, " scale", false], [4435, 0.110111, " be", false], [56540, 0.073163, " leverage", false], [32187, 0.045735, " take", false], [46158, 0.035232, " handle", false], [38877, 0.032738, " learn", false], [31358, 0.032578, " make", false], [30587, 0.029644, " deal", false], [22681, 0.025093, " use", false], [31073, 0.016514, " help", false]]], "model_b": [30858, 59, 0.002400430617853999, [[4435, 0.227059, " be", false], [32187, 0.046731, " take", false], [39590, 0.045397, " scale", false], [46158, 0.037581, " handle", false], [31073, 0.027903, " help", false], [31358, 0.02513, " make", false], [63507, 0.023163, " effectively", false], [30587, 0.02203, " deal", false], [4491, 0.018764, " do", false], [22681, 0.014903, " use", false]]]}, "raw_delta": -0.16874999999999996, "tuned_delta": -0.11589505610180013}, {"byte_start": 6493, "byte_end": 6497, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1118, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "10.71% 10.71% 10.71% 10.71%", "model_b": "12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.09246404469013214]], "model_b": [[21265, " and", "normal", 0.06313180178403854]]}, "loss": {"model_a": 10.707502256597774, "model_b": 12.468604601432935}, "topk": {"model_a": [21265, 2, 0.09246404469013214, [[22590, 0.156998, " the", false], [21265, 0.092464, " and", false], [32448, 0.066924, " ways", false], [332, 0.052704, " a", false], [60521, 0.051232, " solutions", false], [39931, 0.038006, " their", false], [47284, 0.034711, " simple", false], [51832, 0.032497, " general", false], [56832, 0.026873, " patterns", false], [45, 0.022569, ",", false]]], "model_b": [21265, 2, 0.06313180178403854, [[22590, 0.155057, " the", false], [21265, 0.063132, " and", false], [32229, 0.05966, " them", false], [332, 0.058604, " a", false], [32448, 0.053463, " ways", false], [47284, 0.044162, " simple", false], [39931, 0.038607, " their", false], [39936, 0.038573, " these", false], [56832, 0.025977, " patterns", false], [51832, 0.025348, " general", false]]]}, "raw_delta": -0.09765625, "tuned_delta": -0.04480130610180018}, {"byte_start": 6497, "byte_end": 6505, "display": {"text": " capture", "kind": "normal"}, "is_word": true, "word_id": 1119, "word_key": " capture", "bytes_hex": "20 63 61 70 74 75 72 65", "compression": {"model_a": "13.81% 13.81% 13.81% 13.81% 13.81% 13.81% 13.81% 13.81%", "model_b": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"model_a": [[51133, " capture", "normal", 0.0021711860317736864]], "model_b": [[51133, " capture", "normal", 0.00839635543525219]]}, "loss": {"model_a": 13.807042383507657, "model_b": 10.777946350391181}, "topk": {"model_a": [51133, 41, 0.0021711860317736864, [[51690, 0.221346, " exploit", false], [22681, 0.169166, " use", false], [38877, 0.060183, " learn", false], [56540, 0.043563, " leverage", false], [53251, 0.041547, " utilize", false], [32187, 0.029985, " take", false], [31358, 0.028075, " make", false], [39590, 0.027811, " scale", false], [37923, 0.017156, " build", false], [30587, 0.016644, " deal", false]]], "model_b": [51133, 22, 0.00839635543525219, [[22681, 0.129816, " use", false], [37730, 0.076201, " apply", false], [51690, 0.051966, " exploit", false], [47009, 0.041096, " reason", false], [62683, 0.034191, " understand", false], [38877, 0.033924, " learn", false], [62193, 0.028079, " manipulate", false], [53251, 0.023744, " utilize", false], [55961, 0.022007, " describe", false], [51688, 0.019947, " explain", false]]]}, "raw_delta": 0.16796875, "tuned_delta": 0.22082369389819984}, {"byte_start": 6505, "byte_end": 6510, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1120, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "16.34% 16.34% 16.34% 16.34% 16.34%", "model_b": "11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.01097183022648096]], "model_b": [[32234, " this", "normal", 0.03937821835279465]]}, "loss": {"model_a": 16.343029760070287, "model_b": 11.6655419321881}, "topk": {"model_a": [32234, 15, 0.01097183022648096, [[22590, 0.395307, " the", false], [39936, 0.06662, " these", false], [51832, 0.042566, " general", false], [39931, 0.042204, " their", false], [56832, 0.03066, " patterns", false], [21256, 0.024165, " all", false], [32464, 0.019884, " what", false], [32229, 0.019346, " them", false], [21273, 0.018484, " any", false], [21265, 0.016529, " and", false]]], "model_b": [32234, 5, 0.03937821835279465, [[22590, 0.301355, " the", false], [39936, 0.149466, " these", false], [32229, 0.05391, " them", false], [39944, 0.049965, " those", false], [32234, 0.039378, " this", false], [39931, 0.031507, " their", false], [32139, 0.029348, " such", false], [32464, 0.024175, " what", false], [332, 0.019321, " a", false], [32227, 0.016902, " that", false]]]}, "raw_delta": 0.259375, "tuned_delta": 0.31222994389819986}, {"byte_start": 6510, "byte_end": 6520, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1121, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"model_a": "7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44%", "model_b": "9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75%"}, "model_tokens": {"model_a": [[59163, " arbitrary", "normal", 0.016140908002853394]], "model_b": [[59163, " arbitrary", "normal", 0.004454689100384712]]}, "loss": {"model_a": 7.438896304583716, "model_b": 9.74946258100745}, "topk": {"model_a": [59163, 5, 0.016140908002853394, [[61720, 0.632029, " complexity", false], [51607, 0.076052, " endless", false], [51258, 0.036809, " complex", false], [59914, 0.03348, " intrinsic", false], [59163, 0.016141, " arbitrary", false], [56454, 0.0111, " inherent", false], [62680, 0.009028, " underlying", false], [51832, 0.007883, " general", false], [51970, 0.007631, " immense", false], [56125, 0.005321, " enormous", false]]], "model_b": [59163, 15, 0.004454689100384712, [[61720, 0.562641, " complexity", false], [51258, 0.077921, " complex", false], [52391, 0.032897, " outside", false], [60572, 0.014279, " structure", false], [59914, 0.013711, " intrinsic", false], [62555, 0.011779, " simplicity", false], [47284, 0.011557, " simple", false], [47, 0.010936, ".", false], [40213, 0.008724, " world", false], [56191, 0.007098, " external", false]]]}, "raw_delta": -0.12812500000000004, "tuned_delta": -0.07527005610180022}, {"byte_start": 6520, "byte_end": 6531, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1122, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"model_a": "0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46%", "model_b": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[61720, " complexity", "normal", 0.7533266544342041]], "model_b": [[61720, " complexity", "normal", 0.7788721919059753]]}, "loss": {"model_a": 0.46108861392047834, "model_b": 0.4098565457070919}, "topk": {"model_a": [61720, 1, 0.7533266544342041, [[61720, 0.753327, " complexity", false], [45, 0.170575, ",", false], [21265, 0.011136, " and", false], [51258, 0.006059, " complex", false], [52391, 0.005973, " outside", false], [59914, 0.005633, " intrinsic", false], [51308, 0.004076, " content", false], [56191, 0.002231, " external", false], [57141, 0.00192, " richness", false], [46301, 0.001835, " inside", false]]], "model_b": [61720, 1, 0.7788721919059753, [[61720, 0.778872, " complexity", false], [45, 0.077852, ",", false], [60572, 0.021152, " structure", false], [57141, 0.015602, " richness", false], [51258, 0.013216, " complex", false], [21265, 0.00899, " and", false], [51308, 0.007234, " content", false], [52391, 0.004387, " outside", false], [59914, 0.004257, " intrinsic", false], [46, 0.004142, "-", false]]]}, "raw_delta": 0.0028409090909090923, "tuned_delta": 0.05569585298910892}, {"byte_start": 6531, "byte_end": 6532, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "14.58%", "model_b": "10.07%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.4453999698162079]], "model_b": [[47, ".", "normal", 0.5704280734062195]]}, "loss": {"model_a": 14.581927415235127, "model_b": 10.073505412457116}, "topk": {"model_a": [47, 1, 0.4453999698162079, [[47, 0.4454, ".", false], [45, 0.261975, ",", false], [21265, 0.058394, " and", false], [4596, 0.048518, " in", false], [5346, 0.027024, "---", false], [4423, 0.014651, " as", false], [4450, 0.009557, " by", false], [53356, 0.009502, " without", false], [275, 0.009477, " (", false], [4706, 0.009375, " of", false]]], "model_b": [47, 1, 0.5704280734062195, [[47, 0.570428, ".", false], [45, 0.170882, ",", false], [4596, 0.068942, " in", false], [21265, 0.028186, " and", false], [5346, 0.019216, "---", false], [4706, 0.016798, " of", false], [275, 0.015338, " (", false], [47806, 0.009967, " within", false], [53356, 0.009321, " without", false], [4450, 0.00616, " by", false]]]}, "raw_delta": 0.25, "tuned_delta": 0.30285494389819984}, {"byte_start": 6532, "byte_end": 6536, "display": {"text": " Ess", "kind": "normal"}, "is_word": true, "word_id": 1123, "word_key": " ess", "bytes_hex": "20 45 73 73", "compression": {"model_a": "53.26% 53.26% 53.26% 53.26%", "model_b": "52.13% 52.13% 52.13% 52.13%"}, "model_tokens": {"model_a": [[19840, " Ess", "normal", 7.355121397267794e-06]], "model_b": [[19840, " Ess", "normal", 9.41731377679389e-06]]}, "loss": {"model_a": 53.255734907815246, "model_b": 52.12862940712074}, "topk": {"model_a": [19840, 1247, 7.355121397267794e-06, [[261, 0.259146, "\n\n", false], [20996, 0.119164, " The", false], [29894, 0.063429, " This", false], [37453, 0.058481, " These", false], [3913, 0.043353, " In", false], [4331, 0.041702, " We", false], [29889, 0.020874, " That", false], [19417, 0.020421, " And", false], [3918, 0.017923, " It", false], [44844, 0.017732, " Search", false]]], "model_b": [19840, 1194, 9.41731377679389e-06, [[261, 0.259948, "\n\n", false], [20996, 0.090349, " The", false], [29894, 0.089715, " This", false], [37453, 0.051331, " These", false], [4331, 0.043517, " We", false], [3913, 0.034944, " In", false], [267, 0.019289, "  ", false], [29386, 0.018712, " Meta", false], [29834, 0.017458, " Such", false], [29889, 0.015811, " That", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11535494389819982}, {"byte_start": 6536, "byte_end": 6542, "display": {"text": "ential", "kind": "normal"}, "is_word": true, "word_id": 1124, "word_key": "ential", "bytes_hex": "65 6e 74 69 61 6c", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"model_a": [[41342, "ential", "normal", 0.967919647693634]], "model_b": [[41342, "ential", "normal", 0.9260962009429932]]}, "loss": {"model_a": 0.09906200689697776, "model_b": 0.23041089011593346}, "topk": {"model_a": [41342, 1, 0.967919647693634, [[41342, 0.96792, "ential", false], [25250, 0.012159, "ence", false], [49107, 0.010073, "entials", false], [53953, 0.006909, "entially", false], [34307, 0.000816, "ences", false], [25288, 0.000476, "enti", false], [1853, 0.000296, "en", false], [7473, 0.00016, "ent", false], [34340, 6.9e-05, "ental", false], [41317, 6.9e-05, "encial", false]]], "model_b": [41342, 1, 0.9260962009429932, [[41342, 0.926096, "ential", false], [49107, 0.031629, "entials", false], [53953, 0.020026, "entially", false], [25250, 0.015675, "ence", false], [25288, 0.002095, "enti", false], [1853, 0.001338, "en", false], [34307, 0.000531, "ences", false], [7473, 0.000517, "ent", false], [7472, 0.000145, "ens", false], [7464, 0.000128, "ene", false]]]}, "raw_delta": -0.007283528645833335, "tuned_delta": 0.045571415252366486}, {"byte_start": 6542, "byte_end": 6545, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1125, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "3.94% 3.94% 3.94%", "model_b": "6.76% 6.76% 6.76%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.5194181799888611]], "model_b": [[4811, " to", "normal", 0.3221414387226105]]}, "loss": {"model_a": 3.9448692524307587, "model_b": 6.762633004167015}, "topk": {"model_a": [4811, 1, 0.5194181799888611, [[4811, 0.519418, " to", false], [37694, 0.096426, " among", false], [39239, 0.042605, " parts", false], [31416, 0.027149, " meta", false], [52224, 0.027041, " methods", false], [56089, 0.024305, " elements", false], [31077, 0.021138, " here", false], [4600, 0.021037, " is", false], [21700, 0.018038, " for", false], [4596, 0.017694, " in", false]]], "model_b": [4811, 1, 0.3221414387226105, [[4811, 0.322141, " to", false], [52224, 0.071543, " methods", false], [21700, 0.055804, " for", false], [45, 0.037219, ",", false], [31416, 0.032524, " meta", false], [39239, 0.020744, " parts", false], [4600, 0.020305, " is", false], [4596, 0.017272, " in", false], [56089, 0.014163, " elements", false], [59943, 0.013643, " knowledge", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10339505610180018}, {"byte_start": 6545, "byte_end": 6551, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1126, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "model_b": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.07584591209888458]], "model_b": [[39936, " these", "normal", 0.04735719785094261]]}, "loss": {"model_a": 7.748850317274705, "model_b": 9.11076946394723}, "topk": {"model_a": [39936, 3, 0.07584591209888458, [[32234, 0.528698, " this", false], [22590, 0.109217, " the", false], [39936, 0.075846, " these", false], [32227, 0.042329, " that", false], [55666, 0.031001, " building", false], [32139, 0.026706, " such", false], [38279, 0.016205, " doing", false], [21256, 0.01447, " all", false], [21273, 0.010253, " any", false], [22248, 0.008433, " our", false]]], "model_b": [39936, 3, 0.04735719785094261, [[32234, 0.626186, " this", false], [22590, 0.08517, " the", false], [39936, 0.047357, " these", false], [55666, 0.032903, " building", false], [21256, 0.032485, " all", false], [32227, 0.017142, " that", false], [32139, 0.01626, " such", false], [56537, 0.0135, " learning", false], [38279, 0.010818, " doing", false], [21273, 0.008298, " any", false]]]}, "raw_delta": -0.07552083333333337, "tuned_delta": -0.02266588943513355}, {"byte_start": 6551, "byte_end": 6559, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1127, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%", "model_b": "1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.3362106680870056]], "model_b": [[52224, " methods", "normal", 0.42409810423851013]]}, "loss": {"model_a": 2.4655432827692243, "model_b": 1.9372125793186763}, "topk": {"model_a": [52224, 2, 0.3362106680870056, [[31416, 0.366396, " meta", false], [52224, 0.336211, " methods", false], [21286, 0.142133, " are", false], [51832, 0.053155, " general", false], [22638, 0.014933, " two", false], [4600, 0.013569, " is", false], [51258, 0.005078, " complex", false], [61590, 0.003796, " approaches", false], [45, 0.002796, ",", false], [59163, 0.002555, " arbitrary", false]]], "model_b": [52224, 1, 0.42409810423851013, [[52224, 0.424098, " methods", false], [31416, 0.311151, " meta", false], [4600, 0.060227, " is", false], [21286, 0.057758, " are", false], [51566, 0.010231, " efforts", false], [22168, 0.005958, " new", false], [61590, 0.005681, " approaches", false], [51832, 0.005555, " general", false], [45, 0.004582, ",", false], [47266, 0.003637, " should", false]]]}, "raw_delta": 0.029296875, "tuned_delta": 0.08215181889819982}, {"byte_start": 6559, "byte_end": 6562, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1128, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "5.03% 5.03% 5.03%", "model_b": "3.87% 3.87% 3.87%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.4312137961387634]], "model_b": [[4600, " is", "normal", 0.5204273462295532]]}, "loss": {"model_a": 5.025012023929657, "model_b": 3.8744251586373526}, "topk": {"model_a": [4600, 2, 0.4312137961387634, [[21286, 0.478565, " are", false], [4600, 0.431214, " is", false], [45, 0.034258, ",", false], [32475, 0.015883, " will", false], [4706, 0.008986, " of", false], [40219, 0.003924, " would", false], [21700, 0.003673, " for", false], [4596, 0.002801, " in", false], [21265, 0.002626, " and", false], [47266, 0.002606, " should", false]]], "model_b": [4600, 1, 0.5204273462295532, [[4600, 0.520427, " is", false], [21286, 0.275943, " are", false], [45, 0.059421, ",", false], [47266, 0.037921, " should", false], [32475, 0.0354, " will", false], [40219, 0.016288, " would", false], [5346, 0.01343, "---", false], [31475, 0.005547, " must", false], [4706, 0.00534, " of", false], [32227, 0.003964, " that", false]]]}, "raw_delta": 0.06380208333333331, "tuned_delta": 0.11665702723153314}, {"byte_start": 6562, "byte_end": 6567, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1129, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "9.52% 9.52% 9.52% 9.52% 9.52%", "model_b": "9.97% 9.97% 9.97% 9.97% 9.97%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.07150499522686005]], "model_b": [[32227, " that", "normal", 0.06255469471216202]]}, "loss": {"model_a": 9.524041480868545, "model_b": 9.974883681146347}, "topk": {"model_a": [32227, 3, 0.07150499522686005, [[22590, 0.289062, " the", false], [56537, 0.132633, " learning", false], [32227, 0.071505, " that", false], [332, 0.054224, " a", false], [52195, 0.038265, " massive", false], [63370, 0.021919, " computation", false], [4811, 0.018009, " to", false], [47202, 0.014364, " search", false], [51832, 0.014102, " general", false], [4419, 0.013178, " an", false]]], "model_b": [32227, 4, 0.06255469471216202, [[22590, 0.373344, " the", false], [332, 0.086519, " a", false], [56537, 0.070469, " learning", false], [32227, 0.062555, " that", false], [4419, 0.021904, " an", false], [47202, 0.017553, " search", false], [52805, 0.017288, " scaling", false], [30597, 0.011975, " deep", false], [65034, 0.011931, " understanding", false], [39931, 0.011405, " their", false]]]}, "raw_delta": -0.025000000000000022, "tuned_delta": 0.0278549438981998}, {"byte_start": 6567, "byte_end": 6572, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 1130, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"model_a": "0.82% 0.82% 0.82% 0.82% 0.82%", "model_b": "1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"model_a": [[32232, " they", "normal", 0.7950537204742432]], "model_b": [[32232, " they", "normal", 0.6539618968963623]]}, "loss": {"model_a": 0.8171514880035143, "model_b": 1.5215924259375786}, "topk": {"model_a": [32232, 1, 0.7950537204742432, [[32232, 0.795054, " they", false], [4858, 0.050943, " we", false], [22590, 0.034654, " the", false], [39931, 0.017465, " their", false], [45, 0.013836, ",", false], [39934, 0.011988, " there", false], [4706, 0.005195, " of", false], [63370, 0.003587, " computation", false], [21256, 0.003424, " all", false], [22226, 0.003333, " one", false]]], "model_b": [32232, 1, 0.6539618968963623, [[32232, 0.653962, " they", false], [4858, 0.08155, " we", false], [22590, 0.069111, " the", false], [4706, 0.026546, " of", false], [39931, 0.021329, " their", false], [21256, 0.016169, " all", false], [39934, 0.009984, " there", false], [45, 0.008997, ",", false], [39936, 0.008354, " these", false], [4601, 0.003466, " it", false]]]}, "raw_delta": -0.03906250000000001, "tuned_delta": 0.013792443898199815}, {"byte_start": 6572, "byte_end": 6576, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1131, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "11.13% 11.13% 11.13% 11.13%", "model_b": "15.85% 15.85% 15.85% 15.85%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.08541898429393768]], "model_b": [[21413, " can", "normal", 0.02996295504271984]]}, "loss": {"model_a": 11.130166819358212, "model_b": 15.849921103516442}, "topk": {"model_a": [21413, 4, 0.08541898429393768, [[39590, 0.140765, " scale", false], [21286, 0.129975, " are", false], [4435, 0.11445, " be", false], [21413, 0.085419, " can", false], [22681, 0.032041, " use", false], [31059, 0.025783, " have", false], [56540, 0.024464, " leverage", false], [47266, 0.024231, " should", false], [4491, 0.021471, " do", false], [38877, 0.018663, " learn", false]]], "model_b": [21413, 5, 0.02996295504271984, [[4435, 0.238135, " be", false], [21286, 0.12445, " are", false], [47266, 0.109681, " should", false], [4491, 0.032387, " do", false], [21413, 0.029963, " can", false], [22681, 0.028644, " use", false], [32187, 0.022654, " take", false], [22187, 0.022185, " not", false], [31059, 0.021961, " have", false], [31475, 0.020662, " must", false]]]}, "raw_delta": -0.26171875, "tuned_delta": -0.20886380610180016}, {"byte_start": 6576, "byte_end": 6581, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1132, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"model_a": "12.34% 12.34% 12.34% 12.34% 12.34%", "model_b": "12.91% 12.91% 12.91% 12.91% 12.91%"}, "model_tokens": {"model_a": [[30858, " find", "normal", 0.03286619111895561]], "model_b": [[30858, " find", "normal", 0.02808455564081669]]}, "loss": {"model_a": 12.341805232604802, "model_b": 12.905357982952053}, "topk": {"model_a": [30858, 5, 0.03286619111895561, [[39590, 0.245418, " scale", false], [4435, 0.132087, " be", false], [38877, 0.081592, " learn", false], [56540, 0.053152, " leverage", false], [30858, 0.032866, " find", false], [22681, 0.02315, " use", false], [32187, 0.022318, " take", false], [51133, 0.020498, " capture", false], [46158, 0.01748, " handle", false], [31358, 0.015736, " make", false]]], "model_b": [30858, 5, 0.02808455564081669, [[4435, 0.37558, " be", false], [51133, 0.039607, " capture", false], [39590, 0.038255, " scale", false], [32187, 0.030612, " take", false], [30858, 0.028085, " find", false], [38877, 0.027758, " learn", false], [22681, 0.024445, " use", false], [32499, 0.016237, " work", false], [4491, 0.015294, " do", false], [31581, 0.01316, " only", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 6581, "byte_end": 6586, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 1133, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"model_a": "22.54% 22.54% 22.54% 22.54% 22.54%", "model_b": "25.81% 25.81% 25.81% 25.81% 25.81%"}, "model_tokens": {"model_a": [[30992, " good", "normal", 0.0019435964059084654]], "model_b": [[30992, " good", "normal", 0.0007694609230384231]]}, "loss": {"model_a": 22.542110013890053, "model_b": 25.810715965904105}, "topk": {"model_a": [30992, 45, 0.0019435964059084654, [[21265, 0.347782, " and", false], [22590, 0.077422, " the", false], [59163, 0.065804, " arbitrary", false], [45, 0.038407, ",", false], [63293, 0.038036, " arbitrarily", false], [32448, 0.020353, " ways", false], [332, 0.017295, " a", false], [56832, 0.017031, " patterns", false], [22168, 0.01591, " new", false], [60572, 0.015899, " structure", false]]], "model_b": [30992, 85, 0.0007694609230384231, [[21265, 0.3593, " and", false], [22590, 0.07697, " the", false], [332, 0.049907, " a", false], [45, 0.031108, ",", false], [59163, 0.028737, " arbitrary", false], [32234, 0.026611, " this", false], [39936, 0.024702, " these", false], [47284, 0.021668, " simple", false], [51832, 0.020891, " general", false], [32448, 0.018919, " ways", false]]]}, "raw_delta": -0.1812499999999999, "tuned_delta": -0.12839505610180008}, {"byte_start": 6586, "byte_end": 6600, "display": {"text": " approximation", "kind": "normal"}, "is_word": true, "word_id": 1134, "word_key": " approximation", "bytes_hex": "20 61 70 70 72 6f 78 69 6d 61 74 69 6f 6e", "compression": {"model_a": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%", "model_b": "2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92%"}, "model_tokens": {"model_a": [[64831, " approximation", "normal", 0.1297345757484436]], "model_b": [[64831, " approximation", "normal", 0.10401476174592972]]}, "loss": {"model_a": 2.6366217962674976, "model_b": 2.9183981714411233}, "topk": {"model_a": [64831, 1, 0.1297345757484436, [[64831, 0.129735, " approximation", false], [32448, 0.121486, " ways", false], [65275, 0.093937, " representations", false], [60521, 0.079533, " solutions", false], [45, 0.064058, ",", false], [63245, 0.050646, " abstraction", false], [65135, 0.023984, " generalization", false], [45865, 0.02109, " enough", false], [63292, 0.016466, " approximate", false], [51832, 0.013099, " general", false]]], "model_b": [64831, 2, 0.10401476174592972, [[32448, 0.147748, " ways", false], [64831, 0.104015, " approximation", false], [52224, 0.089219, " methods", false], [65135, 0.044832, " generalization", false], [60521, 0.039986, " solutions", false], [31416, 0.039682, " meta", false], [51832, 0.037761, " general", false], [45, 0.035852, ",", false], [65275, 0.022791, " representations", false], [45865, 0.015867, " enough", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03722994389819982}, {"byte_start": 6600, "byte_end": 6601, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 1135, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.17%", "model_b": "0.21%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9907426238059998]], "model_b": [[116, "s", "normal", 0.9885990619659424]]}, "loss": {"model_a": 0.16730472275934022, "model_b": 0.2080302144836533}, "topk": {"model_a": [116, 1, 0.9907426238059998, [[116, 0.990743, "s", false], [4811, 0.00352, " to", false], [4706, 0.000829, " of", false], [60521, 0.000825, " solutions", false], [52224, 0.000721, " methods", false], [45, 0.000444, ",", false], [61559, 0.000185, " algorithms", false], [4596, 0.000168, " in", false], [21265, 0.000131, " and", false], [59751, 0.000116, " functions", false]]], "model_b": [116, 1, 0.9885990619659424, [[116, 0.988599, "s", false], [4811, 0.002745, " to", false], [4706, 0.001607, " of", false], [52224, 0.001607, " methods", false], [21700, 0.000432, " for", false], [45, 0.000406, ",", false], [61559, 0.000306, " algorithms", false], [62581, 0.000287, " strategies", false], [52811, 0.000277, " schemes", false], [4596, 0.000216, " in", false]]]}, "raw_delta": -0.00225830078125, "tuned_delta": 0.05059664311694982}, {"byte_start": 6601, "byte_end": 6602, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "42.55%", "model_b": "48.75%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.09255068749189377]], "model_b": [[45, ",", "normal", 0.06780724227428436]]}, "loss": {"model_a": 42.54823265121747, "model_b": 48.747312905037234}, "topk": {"model_a": [45, 3, 0.09255068749189377, [[4811, 0.580132, " to", false], [4706, 0.097475, " of", false], [45, 0.092551, ",", false], [32227, 0.028419, " that", false], [4596, 0.025407, " in", false], [21700, 0.019691, " for", false], [47, 0.019201, ".", false], [21265, 0.01801, " and", false], [5346, 0.013103, "---", false], [275, 0.012328, " (", false]]], "model_b": [45, 3, 0.06780724227428436, [[4811, 0.478021, " to", false], [4706, 0.219155, " of", false], [45, 0.067807, ",", false], [21700, 0.067409, " for", false], [32227, 0.028048, " that", false], [275, 0.017175, " (", false], [4596, 0.016892, " in", false], [47, 0.016377, ".", false], [21265, 0.013876, " and", false], [5346, 0.012421, "---", false]]]}, "raw_delta": -0.34375, "tuned_delta": -0.29089505610180016}, {"byte_start": 6602, "byte_end": 6606, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 1136, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "20.85% 20.85% 20.85% 20.85%", "model_b": "15.29% 15.29% 15.29% 15.29%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.009839987382292747]], "model_b": [[21400, " but", "normal", 0.03358496353030205]]}, "loss": {"model_a": 20.851451762848296, "model_b": 15.286368353169191}, "topk": {"model_a": [21400, 21, 0.009839987382292747, [[21265, 0.180016, " and", false], [4715, 0.088607, " or", false], [4596, 0.058533, " in", false], [30788, 0.050832, " even", false], [22187, 0.044708, " not", false], [32227, 0.043643, " that", false], [4788, 0.034359, " so", false], [32487, 0.024708, " with", false], [4423, 0.020107, " as", false], [47001, 0.019113, " rather", false]]], "model_b": [21400, 8, 0.03358496353030205, [[21265, 0.166691, " and", false], [4715, 0.085767, " or", false], [32227, 0.045087, " that", false], [30788, 0.043943, " even", false], [40186, 0.042233, " which", false], [22187, 0.034163, " not", false], [4596, 0.034112, " in", false], [21400, 0.033585, " but", false], [4423, 0.028837, " as", false], [32139, 0.027813, " such", false]]]}, "raw_delta": 0.30859375, "tuned_delta": 0.36144869389819984}, {"byte_start": 6606, "byte_end": 6610, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1137, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "16.91% 16.91% 16.91% 16.91%", "model_b": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.023803692311048508]], "model_b": [[22590, " the", "normal", 0.0772312730550766]]}, "loss": {"model_a": 16.90658251041754, "model_b": 11.623275475912058}, "topk": {"model_a": [22590, 9, 0.023803692311048508, [[22187, 0.216313, " not", false], [32232, 0.165504, " they", false], [32227, 0.063869, " that", false], [39115, 0.046973, " never", false], [4692, 0.042079, " no", false], [45409, 0.037314, " cannot", false], [30135, 0.03441, " also", false], [21413, 0.031123, " can", false], [22590, 0.023804, " the", false], [21286, 0.023436, " are", false]]], "model_b": [22590, 3, 0.0772312730550766, [[32232, 0.14138, " they", false], [22187, 0.107709, " not", false], [22590, 0.077231, " the", false], [39936, 0.065337, " these", false], [32227, 0.061315, " that", false], [32234, 0.047941, " this", false], [31581, 0.040356, " only", false], [4601, 0.025506, " it", false], [4596, 0.024791, " in", false], [4858, 0.021724, " we", false]]]}, "raw_delta": 0.29296875, "tuned_delta": 0.34582369389819984}, {"byte_start": 6610, "byte_end": 6617, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1138, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "model_b": "12.40% 12.40% 12.40% 12.40% 12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.010242145508527756]], "model_b": [[47202, " search", "normal", 0.008173836395144463]]}, "loss": {"model_a": 11.834607757292277, "model_b": 12.398160507639528}, "topk": {"model_a": [47202, 11, 0.010242145508527756, [[64831, 0.364622, " approximation", false], [52224, 0.073882, " methods", false], [30992, 0.037612, " good", false], [30273, 0.036568, " best", false], [31458, 0.024773, " more", false], [21952, 0.015541, " key", false], [61720, 0.012345, " complexity", false], [31461, 0.011925, " most", false], [31581, 0.011908, " only", false], [45098, 0.010371, " actual", false]]], "model_b": [47202, 20, 0.008173836395144463, [[64831, 0.065013, " approximation", false], [52224, 0.051809, " methods", false], [45098, 0.03771, " actual", false], [31458, 0.028871, " more", false], [30992, 0.028552, " good", false], [61720, 0.023908, " complexity", false], [31416, 0.021839, " meta", false], [30273, 0.019426, " best", false], [38419, 0.017812, " exact", false], [46561, 0.017576, " method", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 6617, "byte_end": 6621, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 1139, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "9.23% 9.23% 9.23% 9.23%", "model_b": "11.48% 11.48% 11.48% 11.48%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.12873318791389465]], "model_b": [[21700, " for", "normal", 0.07979524880647659]]}, "loss": {"model_a": 9.22817628693624, "model_b": 11.482387288325246}, "topk": {"model_a": [21700, 2, 0.12873318791389465, [[21265, 0.16269, " and", false], [21700, 0.128733, " for", false], [4600, 0.089759, " is", false], [39750, 0.057025, " space", false], [31475, 0.056437, " must", false], [52224, 0.056422, " methods", false], [4715, 0.04538, " or", false], [47266, 0.032136, " should", false], [46, 0.028564, "-", false], [21413, 0.025788, " can", false]]], "model_b": [21700, 4, 0.07979524880647659, [[21265, 0.330968, " and", false], [52224, 0.098755, " methods", false], [46, 0.08921, "-", false], [21700, 0.079795, " for", false], [4600, 0.04821, " is", false], [4715, 0.038105, " or", false], [47266, 0.02708, " should", false], [46561, 0.019566, " method", false], [45, 0.017743, ",", false], [52571, 0.016782, " process", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07214505610180018}, {"byte_start": 6621, "byte_end": 6626, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 1140, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"model_a": "12.45% 12.45% 12.45% 12.45% 12.45%", "model_b": "14.88% 14.88% 14.88% 14.88% 14.88%"}, "model_tokens": {"model_a": [[32229, " them", "normal", 0.03112850710749626]], "model_b": [[32229, " them", "normal", 0.015942580997943878]]}, "loss": {"model_a": 12.454515782674253, "model_b": 14.877792609167432}, "topk": {"model_a": [32229, 7, 0.03112850710749626, [[30992, 0.339901, " good", false], [64831, 0.113961, " approximation", false], [39936, 0.107803, " these", false], [22590, 0.084286, " the", false], [32139, 0.072933, " such", false], [45301, 0.035328, " better", false], [32229, 0.031129, " them", false], [39944, 0.027383, " those", false], [332, 0.026662, " a", false], [63292, 0.015308, " approximate", false]]], "model_b": [32229, 11, 0.015942580997943878, [[39936, 0.163754, " these", false], [30992, 0.147761, " good", false], [64831, 0.137453, " approximation", false], [32139, 0.103121, " such", false], [22590, 0.064668, " the", false], [38419, 0.039068, " exact", false], [39944, 0.036164, " those", false], [332, 0.032478, " a", false], [32234, 0.018344, " this", false], [21265, 0.018267, " and", false]]]}, "raw_delta": -0.1343749999999999, "tuned_delta": -0.08152005610180009}, {"byte_start": 6626, "byte_end": 6633, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1141, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "5.84% 5.84% 5.84% 5.84% 5.84% 5.84% 5.84%", "model_b": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.10364801436662674]], "model_b": [[47266, " should", "normal", 0.1771937906742096]]}, "loss": {"model_a": 5.836796342882247, "model_b": 4.488295118837037}, "topk": {"model_a": [47266, 3, 0.10364801436662674, [[4600, 0.298511, " is", false], [31475, 0.190521, " must", false], [47266, 0.103648, " should", false], [21800, 0.052637, " has", false], [21413, 0.0521, " can", false], [32475, 0.032246, " will", false], [45409, 0.031016, " cannot", false], [30659, 0.025341, " does", false], [45, 0.022651, ",", false], [39105, 0.022128, " needs", false]]], "model_b": [47266, 2, 0.1771937906742096, [[4600, 0.43126, " is", false], [47266, 0.177194, " should", false], [31475, 0.045265, " must", false], [21413, 0.041717, " can", false], [21265, 0.038899, " and", false], [45, 0.034057, ",", false], [57102, 0.024104, " requires", false], [32475, 0.019661, " will", false], [21800, 0.017318, " has", false], [22074, 0.01155, " may", false]]]}, "raw_delta": 0.07477678571428571, "tuned_delta": 0.12763172961248553}, {"byte_start": 6633, "byte_end": 6636, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1142, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "6.29% 6.29% 6.29%", "model_b": "4.25% 4.25% 4.25%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.34870123863220215]], "model_b": [[4435, " be", "normal", 0.4975404739379883]]}, "loss": {"model_a": 6.293005712210972, "model_b": 4.250126992202187}, "topk": {"model_a": [4435, 2, 0.34870123863220215, [[22187, 0.349701, " not", false], [4435, 0.348701, " be", false], [39115, 0.062855, " never", false], [45150, 0.026983, " always", false], [55851, 0.016838, " continue", false], [31581, 0.013219, " only", false], [52570, 0.013001, " proceed", false], [32122, 0.011866, " stop", false], [52051, 0.009384, " involve", false], [31059, 0.00849, " have", false]]], "model_b": [4435, 1, 0.4975404739379883, [[4435, 0.49754, " be", false], [22187, 0.222004, " not", false], [32122, 0.048689, " stop", false], [39115, 0.032498, " never", false], [55851, 0.013038, " continue", false], [32187, 0.01242, " take", false], [31581, 0.010286, " only", false], [37982, 0.009159, " cease", false], [45150, 0.009137, " always", false], [21616, 0.008367, " end", false]]]}, "raw_delta": 0.11328124999999996, "tuned_delta": 0.16613619389819978}, {"byte_start": 6636, "byte_end": 6639, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1143, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "29.87% 29.87% 29.87%", "model_b": "38.51% 38.51% 38.51%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.006882506888359785]], "model_b": [[4450, " by", "normal", 0.001659934874624014]]}, "loss": {"model_a": 29.868295768404316, "model_b": 38.5094379403955}, "topk": {"model_a": [4450, 24, 0.006882506888359785, [[37810, 0.077796, " based", false], [46141, 0.067956, " guided", false], [30666, 0.049359, " done", false], [37862, 0.026134, " blind", false], [332, 0.023582, " a", false], [45796, 0.021656, " driven", false], [4423, 0.016234, " as", false], [31269, 0.014002, " left", false], [64862, 0.012265, " computational", false], [4596, 0.011855, " in", false]]], "model_b": [4450, 79, 0.001659934874624014, [[30666, 0.128099, " done", false], [53017, 0.039624, " stopped", false], [52140, 0.038689, " limited", false], [332, 0.035178, " a", false], [37810, 0.031093, " based", false], [52611, 0.02663, " pursued", false], [22590, 0.024904, " the", false], [45796, 0.021703, " driven", false], [59051, 0.020304, " abandoned", false], [4423, 0.019235, " as", false]]]}, "raw_delta": -0.4791666666666665, "tuned_delta": -0.4263117227684667}, {"byte_start": 6639, "byte_end": 6643, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1144, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"model_a": "38.89% 38.89% 38.89% 38.89%", "model_b": "31.14% 31.14% 31.14% 31.14%"}, "model_tokens": {"model_a": [[22248, " our", "normal", 0.00017572223441675305]], "model_b": [[22248, " our", "normal", 0.0010137023637071252]]}, "loss": {"model_a": 38.88513977396034, "model_b": 31.13628945668563}, "topk": {"model_a": [22248, 401, 0.00017572223441675305, [[37920, 0.103837, " brute", false], [38989, 0.058257, " means", false], [332, 0.046134, " a", false], [52195, 0.041049, " massive", false], [52224, 0.038828, " methods", false], [56537, 0.037187, " learning", false], [22590, 0.036963, " the", false], [38888, 0.025153, " lever", false], [47202, 0.024959, " search", false], [63370, 0.024668, " computation", false]]], "model_b": [22248, 117, 0.0010137023637071252, [[38989, 0.074853, " means", false], [46342, 0.05959, " itself", false], [22590, 0.054064, " the", false], [332, 0.044797, " a", false], [46, 0.030378, "-", false], [52224, 0.029902, " methods", false], [47202, 0.021461, " search", false], [56537, 0.020601, " learning", false], [21265, 0.016776, " and", false], [4692, 0.016032, " no", false]]]}, "raw_delta": 0.4296875, "tuned_delta": 0.48254244389819984}, {"byte_start": 6643, "byte_end": 6651, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1145, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61%", "model_b": "7.47% 7.47% 7.47% 7.47% 7.47% 7.47% 7.47% 7.47%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.034680359065532684]], "model_b": [[52224, " methods", "normal", 0.03672027215361595]]}, "loss": {"model_a": 7.607962129687892, "model_b": 7.467073942101079}, "topk": {"model_a": [52224, 5, 0.034680359065532684, [[22251, 0.172577, " own", false], [30273, 0.10965, " best", false], [31461, 0.058648, " most", false], [39026, 0.052117, " minds", false], [52224, 0.03468, " methods", false], [45124, 0.032291, " agents", false], [56567, 0.020129, " machines", false], [51832, 0.013952, " general", false], [59345, 0.00941, " computers", false], [38989, 0.008589, " means", false]]], "model_b": [52224, 4, 0.03672027215361595, [[22251, 0.216851, " own", false], [30273, 0.048249, " best", false], [39026, 0.03751, " minds", false], [52224, 0.03672, " methods", false], [51832, 0.030478, " general", false], [65034, 0.023191, " understanding", false], [45124, 0.022479, " agents", false], [50836, 0.021075, " ability", false], [38720, 0.017008, " human", false], [38989, 0.014784, " means", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06066744389819982}, {"byte_start": 6651, "byte_end": 6652, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "14.65%", "model_b": "10.50%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.44375190138816833]], "model_b": [[45, ",", "normal", 0.5560961961746216]]}, "loss": {"model_a": 14.652371509028534, "model_b": 10.496169975217555}, "topk": {"model_a": [45, 1, 0.44375190138816833, [[45, 0.443752, ",", false], [4706, 0.104686, " of", false], [40, 0.048938, "'", false], [21265, 0.040952, " and", false], [47, 0.038513, ".", false], [32227, 0.033652, " that", false], [47001, 0.032465, " rather", false], [22187, 0.028773, " not", false], [5346, 0.021571, "---", false], [21700, 0.019591, " for", false]]], "model_b": [45, 1, 0.5560961961746216, [[45, 0.556096, ",", false], [47, 0.098212, ".", false], [4706, 0.068008, " of", false], [21265, 0.038346, " and", false], [5346, 0.034876, "---", false], [62643, 0.024008, " themselves", false], [47001, 0.020011, " rather", false], [275, 0.018572, " (", false], [32227, 0.01708, " that", false], [60, 0.012547, ";", false]]]}, "raw_delta": 0.23046875, "tuned_delta": 0.28332369389819984}, {"byte_start": 6652, "byte_end": 6656, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1146, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "1.81% 1.81% 1.81% 1.81%", "model_b": "3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.6701511740684509]], "model_b": [[22187, " not", "normal", 0.4872523248195648]]}, "loss": {"model_a": 1.8051299034560393, "model_b": 3.275650361393398}, "topk": {"model_a": [22187, 1, 0.6701511740684509, [[22187, 0.670151, " not", false], [21265, 0.109385, " and", false], [47001, 0.032279, " rather", false], [40186, 0.019984, " which", false], [4450, 0.018982, " by", false], [4423, 0.009663, " as", false], [40085, 0.006972, " using", false], [4596, 0.006773, " in", false], [32487, 0.006487, " with", false], [53356, 0.005776, " without", false]]], "model_b": [22187, 1, 0.4872523248195648, [[22187, 0.487252, " not", false], [21265, 0.150234, " and", false], [47001, 0.043585, " rather", false], [4423, 0.035366, " as", false], [40186, 0.026515, " which", false], [4596, 0.018619, " in", false], [4715, 0.015693, " or", false], [4450, 0.014448, " by", false], [37810, 0.013135, " based", false], [40085, 0.010924, " using", false]]]}, "raw_delta": -0.08154296875, "tuned_delta": -0.02868802485180018}, {"byte_start": 6656, "byte_end": 6659, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1147, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "2.11% 2.11% 2.11%", "model_b": "4.60% 4.60% 4.60%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.7054336071014404]], "model_b": [[4450, " by", "normal", 0.46313583850860596]]}, "loss": {"model_a": 2.1133228138021924, "model_b": 4.602347461169218}, "topk": {"model_a": [4450, 1, 0.7054336071014404, [[4450, 0.705434, " by", false], [22590, 0.081872, " the", false], [22248, 0.048407, " our", false], [31597, 0.016694, " ours", false], [4596, 0.013091, " in", false], [38720, 0.008677, " human", false], [53140, 0.007893, " through", false], [39944, 0.006471, " those", false], [37924, 0.005713, " built", false], [21700, 0.00514, " for", false]]], "model_b": [4450, 1, 0.46313583850860596, [[4450, 0.463136, " by", false], [22590, 0.119297, " the", false], [31597, 0.060535, " ours", false], [22248, 0.044549, " our", false], [39944, 0.028738, " those", false], [38720, 0.026317, " human", false], [4596, 0.015126, " in", false], [47533, 0.01231, " theirs", false], [39931, 0.012054, " their", false], [21700, 0.01182, " for", false]]]}, "raw_delta": -0.13802083333333331, "tuned_delta": -0.0851658894351335}, {"byte_start": 6659, "byte_end": 6662, "display": {"text": " us", "kind": "normal"}, "is_word": true, "word_id": 1148, "word_key": " us", "bytes_hex": "20 75 73", "compression": {"model_a": "32.31% 32.31% 32.31%", "model_b": "37.76% 37.76% 37.76%"}, "model_tokens": {"model_a": [[4835, " us", "normal", 0.004650012124329805]], "model_b": [[4835, " us", "normal", 0.0018961166497319937]]}, "loss": {"model_a": 32.31035768657574, "model_b": 37.758034273265835}, "topk": {"model_a": [4835, 20, 0.004650012124329805, [[22590, 0.274335, " the", false], [22248, 0.136093, " our", false], [38720, 0.108349, " human", false], [31597, 0.029068, " ours", false], [21273, 0.02526, " any", false], [52224, 0.024696, " methods", false], [47629, 0.021388, " trying", false], [55666, 0.01915, " building", false], [31044, 0.018624, " hand", false], [39944, 0.015058, " those", false]]], "model_b": [4835, 39, 0.0018961166497319937, [[22590, 0.15904, " the", false], [22248, 0.102534, " our", false], [38720, 0.079382, " human", false], [39944, 0.055191, " those", false], [52224, 0.053181, " methods", false], [39193, 0.052233, " other", false], [31597, 0.051563, " ours", false], [46227, 0.0505, " humans", false], [46726, 0.037634, " others", false], [21273, 0.023799, " any", false]]]}, "raw_delta": -0.30208333333333326, "tuned_delta": -0.24922838943513342}, {"byte_start": 6662, "byte_end": 6663, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "14.44%", "model_b": "9.23%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.44986504316329956]], "model_b": [[47, ".", "normal", 0.6027293801307678]]}, "loss": {"model_a": 14.441039227648314, "model_b": 9.22817628693624}, "topk": {"model_a": [47, 1, 0.44986504316329956, [[47, 0.449865, ".", false], [45, 0.147026, ",", false], [47629, 0.0488, " trying", false], [57419, 0.023866, " thinking", false], [55666, 0.020158, " building", false], [60, 0.016601, ";", false], [52157, 0.013814, " looking", false], [46227, 0.011987, " humans", false], [52614, 0.010683, " putting", false], [5346, 0.009696, "---", false]]], "model_b": [47, 1, 0.6027293801307678, [[47, 0.602729, ".", false], [45, 0.101886, ",", false], [46227, 0.04032, " humans", false], [4423, 0.039096, " as", false], [47629, 0.031636, " trying", false], [60, 0.015828, ";", false], [275, 0.008998, " (", false], [40085, 0.008043, " using", false], [60463, 0.007573, " searching", false], [4596, 0.007469, " in", false]]]}, "raw_delta": 0.2890625, "tuned_delta": 0.34191744389819984}, {"byte_start": 6663, "byte_end": 6666, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 1149, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"model_a": "15.97% 15.97% 15.97%", "model_b": "15.97% 15.97% 15.97%"}, "model_tokens": {"model_a": [[4331, " We", "normal", 0.06995029002428055]], "model_b": [[4331, " We", "normal", 0.06958331912755966]]}, "loss": {"model_a": 15.967327926505453, "model_b": 15.967327926505453}, "topk": {"model_a": [4331, 3, 0.06995029002428055, [[261, 0.32492, "\n\n", false], [20996, 0.102782, " The", false], [4331, 0.06995, " We", false], [29894, 0.065244, " This", false], [3913, 0.03047, " In", false], [37453, 0.024223, " These", false], [20571, 0.023633, " Our", false], [3918, 0.019177, " It", false], [19417, 0.015377, " And", false], [3908, 0.0128, " If", false]]], "model_b": [4331, 3, 0.06958331912755966, [[261, 0.300483, "\n\n", false], [20996, 0.096308, " The", false], [4331, 0.069583, " We", false], [29894, 0.068996, " This", false], [3913, 0.030618, " In", false], [37453, 0.026581, " These", false], [267, 0.018079, "  ", false], [19417, 0.017108, " And", false], [11, 0.015377, "\n", false], [3918, 0.015344, " It", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 6666, "byte_end": 6671, "display": {"text": " want", "kind": "normal"}, "is_word": true, "word_id": 1150, "word_key": " want", "bytes_hex": "20 77 61 6e 74", "compression": {"model_a": "17.13% 17.13% 17.13% 17.13% 17.13%", "model_b": "17.81% 17.81% 17.81% 17.81% 17.81%"}, "model_tokens": {"model_a": [[32435, " want", "normal", 0.008509294129908085]], "model_b": [[32435, " want", "normal", 0.007189247291535139]]}, "loss": {"model_a": 17.13200361055644, "model_b": 17.808266910973142}, "topk": {"model_a": [32435, 11, 0.008509294129908085, [[47266, 0.572821, " should", false], [21286, 0.059149, " are", false], [21413, 0.054245, " can", false], [31059, 0.047191, " have", false], [31475, 0.032528, " must", false], [4491, 0.032117, " do", false], [31506, 0.028109, " need", false], [45409, 0.022205, " cannot", false], [32475, 0.018088, " will", false], [46227, 0.008578, " humans", false]]], "model_b": [32435, 12, 0.007189247291535139, [[47266, 0.630574, " should", false], [21286, 0.049952, " are", false], [21413, 0.049179, " can", false], [31059, 0.042266, " have", false], [31506, 0.034601, " need", false], [4491, 0.024134, " do", false], [31475, 0.02027, " must", false], [45409, 0.018247, " cannot", false], [22074, 0.011065, " may", false], [32475, 0.007582, " will", false]]]}, "raw_delta": -0.03750000000000009, "tuned_delta": 0.015354943898199733}, {"byte_start": 6671, "byte_end": 6674, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 1151, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "33.63% 33.63% 33.63%", "model_b": "31.37% 31.37% 31.37%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.003760707564651966]], "model_b": [[3609, " AI", "normal", 0.005401396658271551]]}, "loss": {"model_a": 33.625314104052656, "model_b": 31.371103102663653}, "topk": {"model_a": [3609, 19, 0.003760707564651966, [[4811, 0.381438, " to", false], [22248, 0.168507, " our", false], [52224, 0.097623, " methods", false], [22590, 0.06869, " the", false], [332, 0.041422, " a", false], [30992, 0.023749, " good", false], [39936, 0.018056, " these", false], [32229, 0.016651, " them", false], [47202, 0.010847, " search", false], [4419, 0.00818, " an", false]]], "model_b": [3609, 16, 0.005401396658271551, [[4811, 0.340378, " to", false], [52224, 0.132836, " methods", false], [22248, 0.072672, " our", false], [22590, 0.060302, " the", false], [32229, 0.036429, " them", false], [39936, 0.032443, " these", false], [332, 0.02744, " a", false], [51832, 0.015779, " general", false], [31416, 0.014543, " meta", false], [30992, 0.012802, " good", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17785494389819984}, {"byte_start": 6674, "byte_end": 6681, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1152, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"model_a": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03% 5.03%", "model_b": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"model_a": [[45124, " agents", "normal", 0.1399744600057602]], "model_b": [[45124, " agents", "normal", 0.12804022431373596]]}, "loss": {"model_a": 5.031720985243315, "model_b": 5.273243592534995}, "topk": {"model_a": [45124, 4, 0.1399744600057602, [[53087, 0.242502, " systems", false], [4811, 0.199609, " to", false], [52224, 0.194399, " methods", false], [45124, 0.139974, " agents", false], [63843, 0.051099, " researchers", false], [57103, 0.044614, " research", false], [32227, 0.022472, " that", false], [56949, 0.01724, " programs", false], [116, 0.013439, "s", false], [45, 0.010417, ",", false]]], "model_b": [45124, 3, 0.12804022431373596, [[4811, 0.325599, " to", false], [52224, 0.160268, " methods", false], [45124, 0.12804, " agents", false], [53087, 0.103678, " systems", false], [57103, 0.089948, " research", false], [63843, 0.067823, " researchers", false], [32227, 0.01213, " that", false], [22187, 0.01172, " not", false], [116, 0.006778, "s", false], [39979, 0.0061, " tools", false]]]}, "raw_delta": -0.01339285714285715, "tuned_delta": 0.03946208675534267}, {"byte_start": 6681, "byte_end": 6686, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1153, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.92% 3.92% 3.92% 3.92% 3.92%", "model_b": "4.54% 4.54% 4.54% 4.54% 4.54%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.33919060230255127]], "model_b": [[32227, " that", "normal", 0.2834429442882538]]}, "loss": {"model_a": 3.9166916149133963, "model_b": 4.536599640295373}, "topk": {"model_a": [32227, 2, 0.33919060230255127, [[4811, 0.520668, " to", false], [32227, 0.339191, " that", false], [22762, 0.032211, " who", false], [45, 0.029602, ",", false], [32487, 0.014748, " with", false], [40191, 0.008318, " whose", false], [51127, 0.005618, " capable", false], [21265, 0.004605, " and", false], [4596, 0.003761, " in", false], [275, 0.003637, " (", false]]], "model_b": [32227, 2, 0.2834429442882538, [[4811, 0.549134, " to", false], [32227, 0.283443, " that", false], [45, 0.023855, ",", false], [32487, 0.016307, " with", false], [37924, 0.013614, " built", false], [21265, 0.012173, " and", false], [22187, 0.009831, " not", false], [40191, 0.007915, " whose", false], [37810, 0.007106, " based", false], [4423, 0.005008, " as", false]]]}, "raw_delta": -0.03437500000000002, "tuned_delta": 0.018479943898199805}, {"byte_start": 6686, "byte_end": 6690, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1154, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "4.68% 4.68% 4.68% 4.68%", "model_b": "6.34% 6.34% 6.34% 6.34%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.3550959825515747]], "model_b": [[21413, " can", "normal", 0.24692228436470032]]}, "loss": {"model_a": 4.684532237261526, "model_b": 6.339968441406577}, "topk": {"model_a": [21413, 1, 0.3550959825515747, [[21413, 0.355096, " can", false], [21286, 0.168078, " are", false], [30858, 0.051808, " find", false], [31059, 0.036422, " have", false], [4491, 0.035775, " do", false], [38877, 0.02443, " learn", false], [47202, 0.020374, " search", false], [32475, 0.019544, " will", false], [22681, 0.017564, " use", false], [39942, 0.01729, " think", false]]], "model_b": [21413, 1, 0.24692228436470032, [[21413, 0.246922, " can", false], [21286, 0.210794, " are", false], [4491, 0.041124, " do", false], [22681, 0.03312, " use", false], [31059, 0.029968, " have", false], [38877, 0.028413, " learn", false], [32499, 0.021762, " work", false], [32475, 0.021259, " will", false], [30858, 0.018576, " find", false], [39942, 0.018389, " think", false]]]}, "raw_delta": -0.091796875, "tuned_delta": -0.03894193110180018}, {"byte_start": 6690, "byte_end": 6699, "display": {"text": " discover", "kind": "normal"}, "is_word": true, "word_id": 1155, "word_key": " discover", "bytes_hex": "20 64 69 73 63 6f 76 65 72", "compression": {"model_a": "7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95%", "model_b": "7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51%"}, "model_tokens": {"model_a": [[56010, " discover", "normal", 0.018892979249358177]], "model_b": [[56010, " discover", "normal", 0.023604130372405052]]}, "loss": {"model_a": 7.952355477122325, "model_b": 7.514036671296683}, "topk": {"model_a": [56010, 7, 0.018892979249358177, [[30858, 0.27055, " find", false], [38877, 0.074919, " learn", false], [4491, 0.049321, " do", false], [47202, 0.045693, " search", false], [39942, 0.032728, " think", false], [4435, 0.027714, " be", false], [56010, 0.018893, " discover", false], [63292, 0.018513, " approximate", false], [22681, 0.018304, " use", false], [37923, 0.016654, " build", false]]], "model_b": [56010, 9, 0.023604130372405052, [[30858, 0.126856, " find", false], [38877, 0.072631, " learn", false], [4491, 0.0616, " do", false], [39942, 0.047469, " think", false], [4435, 0.044435, " be", false], [22681, 0.039728, " use", false], [47009, 0.031288, " reason", false], [47202, 0.025897, " search", false], [56010, 0.023604, " discover", false], [37923, 0.022824, " build", false]]]}, "raw_delta": 0.024305555555555525, "tuned_delta": 0.07716049945375535}, {"byte_start": 6699, "byte_end": 6704, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 1156, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"model_a": "36.07% 36.07% 36.07% 36.07% 36.07%", "model_b": "32.91% 32.91% 32.91% 32.91% 32.91%"}, "model_tokens": {"model_a": [[31296, " like", "normal", 4.6584904339397326e-05]], "model_b": [[31296, " like", "normal", 0.00010660818952601403]]}, "loss": {"model_a": 36.06737602222408, "model_b": 32.91148062027948}, "topk": {"model_a": [31296, 497, 4.6584904339397326e-05, [[22590, 0.147892, " the", false], [21265, 0.084655, " and", false], [30992, 0.066648, " good", false], [45, 0.060637, ",", false], [39931, 0.056924, " their", false], [39936, 0.053667, " these", false], [22168, 0.044699, " new", false], [52224, 0.036966, " methods", false], [21835, 0.036459, " how", false], [32464, 0.031666, " what", false]]], "model_b": [31296, 355, 0.00010660818952601403, [[21265, 0.14099, " and", false], [22590, 0.130123, " the", false], [39936, 0.081343, " these", false], [45, 0.043921, ",", false], [51832, 0.038535, " general", false], [39931, 0.034699, " their", false], [32234, 0.033049, " this", false], [59163, 0.025606, " arbitrary", false], [32464, 0.022976, " what", false], [30992, 0.018181, " good", false]]]}, "raw_delta": 0.17500000000000004, "tuned_delta": 0.22785494389819988}, {"byte_start": 6704, "byte_end": 6707, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1157, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "12.68% 12.68% 12.68%", "model_b": "20.10% 20.10% 20.10%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.12293319404125214]], "model_b": [[4858, " we", "normal", 0.035303108394145966]]}, "loss": {"model_a": 12.679936882813154, "model_b": 20.100048095718627}, "topk": {"model_a": [4858, 2, 0.12293319404125214, [[4835, 0.445539, " us", false], [4858, 0.122933, " we", false], [46227, 0.075263, " humans", false], [52224, 0.040122, " methods", false], [32234, 0.033084, " this", false], [46, 0.032214, "-", false], [38720, 0.02475, " human", false], [22248, 0.021068, " our", false], [22590, 0.020151, " the", false], [26307, 0.019696, "ness", false]]], "model_b": [4858, 5, 0.035303108394145966, [[46, 0.098422, "-", false], [22590, 0.084608, " the", false], [46227, 0.07663, " humans", false], [332, 0.045861, " a", false], [4858, 0.035303, " we", false], [32234, 0.035123, " this", false], [4835, 0.026458, " us", false], [38720, 0.016619, " human", false], [21273, 0.014751, " any", false], [60112, 0.014718, " ourselves", false]]]}, "raw_delta": -0.41145833333333326, "tuned_delta": -0.3586033894351334}, {"byte_start": 6707, "byte_end": 6711, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1158, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "15.50% 15.50% 15.50% 15.50%", "model_b": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.03212219104170799]], "model_b": [[21413, " can", "normal", 0.07588315010070801]]}, "loss": {"model_a": 15.49770063454941, "model_b": 11.623275475912058}, "topk": {"model_a": [21413, 3, 0.03212219104170799, [[4491, 0.852939, " do", false], [56010, 0.05113, " discover", false], [21413, 0.032122, " can", false], [31059, 0.011253, " have", false], [21532, 0.00928, " did", false], [46227, 0.007689, " humans", false], [40219, 0.006771, " would", false], [60112, 0.003744, " ourselves", false], [39021, 0.003565, " might", false], [61885, 0.002275, " discovered", false]]], "model_b": [21413, 3, 0.07588315010070801, [[4491, 0.352417, " do", false], [56010, 0.312373, " discover", false], [21413, 0.075883, " can", false], [30858, 0.044453, " find", false], [46227, 0.018916, " humans", false], [40219, 0.017476, " would", false], [21532, 0.013869, " did", false], [61885, 0.013184, " discovered", false], [31059, 0.01273, " have", false], [22449, 0.011261, " see", false]]]}, "raw_delta": 0.21484375, "tuned_delta": 0.26769869389819984}, {"byte_start": 6711, "byte_end": 6712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "11.41%", "model_b": "22.54%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5289064049720764]], "model_b": [[45, ",", "normal", 0.2890419661998749]]}, "loss": {"model_a": 11.411943194531839, "model_b": 22.542110013890053}, "topk": {"model_a": [45, 1, 0.5289064049720764, [[45, 0.528906, ",", false], [47, 0.181639, ".", false], [56010, 0.06384, " discover", false], [5346, 0.063762, "---", false], [60, 0.035638, ";", false], [21265, 0.021945, " and", false], [4596, 0.013222, " in", false], [59, 0.011791, ":", false], [275, 0.009209, " (", false], [21400, 0.004757, " but", false]]], "model_b": [45, 1, 0.2890419661998749, [[45, 0.289042, ",", false], [56010, 0.209486, " discover", false], [47, 0.119284, ".", false], [30858, 0.078899, " find", false], [60, 0.034697, ";", false], [4596, 0.020341, " in", false], [21265, 0.018861, " and", false], [47202, 0.013848, " search", false], [39942, 0.013234, " think", false], [22449, 0.012177, " see", false]]]}, "raw_delta": -0.6171875, "tuned_delta": -0.5643325561018002}, {"byte_start": 6712, "byte_end": 6716, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1159, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "7.64% 7.64% 7.64% 7.64%", "model_b": "11.41% 11.41% 11.41% 11.41%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.18526971340179443]], "model_b": [[22187, " not", "normal", 0.08069377392530441]]}, "loss": {"model_a": 7.643184176584596, "model_b": 11.411943194531839}, "topk": {"model_a": [22187, 2, 0.18526971340179443, [[21265, 0.188898, " and", false], [22187, 0.18527, " not", false], [21400, 0.145465, " but", false], [47001, 0.046234, " rather", false], [32227, 0.040212, " that", false], [4450, 0.030805, " by", false], [4596, 0.027682, " in", false], [4788, 0.026189, " so", false], [4715, 0.025331, " or", false], [4811, 0.017496, " to", false]]], "model_b": [22187, 3, 0.08069377392530441, [[21400, 0.323052, " but", false], [21265, 0.184992, " and", false], [22187, 0.080694, " not", false], [4450, 0.043472, " by", false], [32227, 0.042436, " that", false], [4596, 0.026953, " in", false], [4715, 0.022931, " or", false], [53356, 0.022919, " without", false], [47001, 0.019048, " rather", false], [4423, 0.014045, " as", false]]]}, "raw_delta": -0.208984375, "tuned_delta": -0.15612943110180016}, {"byte_start": 6716, "byte_end": 6722, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 1160, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"model_a": "22.45% 22.45% 22.45% 22.45% 22.45% 22.45%", "model_b": "24.80% 24.80% 24.80% 24.80% 24.80% 24.80%"}, "model_tokens": {"model_a": [[40186, " which", "normal", 0.0005667924997396767]], "model_b": [[40186, " which", "normal", 0.00026276372955180705]]}, "loss": {"model_a": 22.448184555498845, "model_b": 24.796321015279055}, "topk": {"model_a": [40186, 74, 0.0005667924997396767, [[31296, 0.348727, " like", false], [32227, 0.16236, " that", false], [31580, 0.067522, " ones", false], [31198, 0.052766, " just", false], [3609, 0.038088, " AI", false], [45124, 0.036987, " agents", false], [56010, 0.032506, " discover", false], [22590, 0.01857, " the", false], [39944, 0.016601, " those", false], [4423, 0.015503, " as", false]]], "model_b": [40186, 118, 0.00026276372955180705, [[31296, 0.455174, " like", false], [32227, 0.091195, " that", false], [22590, 0.058147, " the", false], [4450, 0.028813, " by", false], [4423, 0.020843, " as", false], [56010, 0.019964, " discover", false], [4811, 0.015832, " to", false], [31198, 0.01414, " just", false], [4835, 0.013856, " us", false], [38720, 0.011784, " human", false]]]}, "raw_delta": -0.13020833333333326, "tuned_delta": -0.07735338943513344}, {"byte_start": 6722, "byte_end": 6730, "display": {"text": " contain", "kind": "normal"}, "is_word": true, "word_id": 1161, "word_key": " contain", "bytes_hex": "20 63 6f 6e 74 61 69 6e", "compression": {"model_a": "19.02% 19.02% 19.02% 19.02% 19.02% 19.02% 19.02% 19.02%", "model_b": "24.37% 24.37% 24.37% 24.37% 24.37% 24.37% 24.37% 24.37%"}, "model_tokens": {"model_a": [[51306, " contain", "normal", 0.00022376440756488591]], "model_b": [[51306, " contain", "normal", 1.960609915840905e-05]]}, "loss": {"model_a": 19.01990532421973, "model_b": 24.373656452518617}, "topk": {"model_a": [51306, 151, 0.00022376440756488591, [[4858, 0.307145, " we", false], [21413, 0.286255, " can", false], [4706, 0.028424, " of", false], [31296, 0.027398, " like", false], [21286, 0.027122, " are", false], [22752, 0.020349, " way", false], [31580, 0.018615, " ones", false], [31059, 0.015789, " have", false], [56010, 0.015693, " discover", false], [4600, 0.009122, " is", false]]], "model_b": [51306, 643, 1.960609915840905e-05, [[4858, 0.573315, " we", false], [31296, 0.133563, " like", false], [32232, 0.034744, " they", false], [22752, 0.018644, " way", false], [21413, 0.017571, " can", false], [4600, 0.017338, " is", false], [4706, 0.015058, " of", false], [21286, 0.014754, " are", false], [52224, 0.013452, " methods", false], [31580, 0.008656, " ones", false]]]}, "raw_delta": -0.296875, "tuned_delta": -0.24402005610180016}, {"byte_start": 6730, "byte_end": 6735, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1162, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"model_a": "9.41% 9.41% 9.41% 9.41% 9.41%", "model_b": "15.10% 15.10% 15.10% 15.10% 15.10%"}, "model_tokens": {"model_a": [[32464, " what", "normal", 0.07396214455366135]], "model_b": [[32464, " what", "normal", 0.015182634815573692]]}, "loss": {"model_a": 9.411330930799096, "model_b": 15.103213709306335}, "topk": {"model_a": [32464, 4, 0.07396214455366135, [[31296, 0.360174, " like", false], [22248, 0.126501, " our", false], [22590, 0.089253, " the", false], [32464, 0.073962, " what", false], [59943, 0.060057, " knowledge", false], [4596, 0.025612, " in", false], [38720, 0.021304, " human", false], [4835, 0.019227, " us", false], [32227, 0.018806, " that", false], [332, 0.015148, " a", false]]], "model_b": [32464, 11, 0.015182634815573692, [[31296, 0.225525, " like", false], [22248, 0.111414, " our", false], [22590, 0.106017, " the", false], [332, 0.044817, " a", false], [32139, 0.042281, " such", false], [32074, 0.022443, " some", false], [59943, 0.020157, " knowledge", false], [32234, 0.018146, " this", false], [38720, 0.017949, " human", false], [4835, 0.015555, " us", false]]]}, "raw_delta": -0.31562500000000004, "tuned_delta": -0.2627700561018002}, {"byte_start": 6735, "byte_end": 6738, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1163, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "0.65% 0.65% 0.65%", "model_b": "3.90% 3.90% 3.90%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.8968513011932373]], "model_b": [[4858, " we", "normal", 0.5201384425163269]]}, "loss": {"model_a": 0.6516078675890092, "model_b": 3.8979065232351546}, "topk": {"model_a": [4858, 1, 0.8968513011932373, [[4858, 0.896851, " we", false], [31296, 0.020356, " like", false], [22248, 0.008127, " our", false], [4600, 0.00737, " is", false], [21413, 0.005825, " can", false], [32232, 0.005258, " they", false], [46227, 0.003963, " humans", false], [332, 0.00354, " a", false], [22590, 0.003478, " the", false], [4601, 0.002226, " it", false]]], "model_b": [4858, 1, 0.5201384425163269, [[4858, 0.520138, " we", false], [31296, 0.150877, " like", false], [47, 0.062803, ".", false], [31214, 0.023393, " kind", false], [45, 0.021114, ",", false], [4600, 0.019552, " is", false], [21286, 0.009734, " are", false], [38720, 0.006117, " human", false], [38841, 0.005754, " kinds", false], [59943, 0.005233, " knowledge", false]]]}, "raw_delta": -0.18001302083333334, "tuned_delta": -0.12715807693513353}, {"byte_start": 6738, "byte_end": 6743, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 1164, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "10.71% 10.71% 10.71% 10.71% 10.71%", "model_b": "10.71% 10.71% 10.71% 10.71% 10.71%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.050879254937171936]], "model_b": [[31059, " have", "normal", 0.051535069942474365]]}, "loss": {"model_a": 10.707502256597774, "model_b": 10.707502256597774}, "topk": {"model_a": [31059, 5, 0.050879254937171936, [[21413, 0.228571, " can", false], [39942, 0.158661, " think", false], [31223, 0.152265, " know", false], [4491, 0.097188, " do", false], [31059, 0.050879, " have", false], [31296, 0.039003, " like", false], [32435, 0.022002, " want", false], [39021, 0.018444, " might", false], [50888, 0.016436, " already", false], [51025, 0.016132, " believe", false]]], "model_b": [31059, 4, 0.051535069942474365, [[32435, 0.26411, " want", false], [39942, 0.219942, " think", false], [31296, 0.098017, " like", false], [31059, 0.051535, " have", false], [30858, 0.04383, " find", false], [51025, 0.025439, " believe", false], [21413, 0.021277, " can", false], [40219, 0.019873, " would", false], [31223, 0.018523, " know", false], [32486, 0.014993, " wish", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05285494389819982}, {"byte_start": 6743, "byte_end": 6754, "display": {"text": " discovered", "kind": "normal"}, "is_word": true, "word_id": 1165, "word_key": " discovered", "bytes_hex": "20 64 69 73 63 6f 76 65 72 65 64", "compression": {"model_a": "2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46%", "model_b": "2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27%"}, "model_tokens": {"model_a": [[61885, " discovered", "normal", 0.2222803235054016]], "model_b": [[61885, " discovered", "normal", 0.24874432384967804]]}, "loss": {"model_a": 2.4591392742425504, "model_b": 2.2670190184423515}, "topk": {"model_a": [61885, 1, 0.2222803235054016, [[61885, 0.22228, " discovered", false], [47, 0.141644, ".", false], [52112, 0.104162, " learned", false], [4596, 0.073449, " in", false], [50888, 0.065892, " already", false], [4811, 0.041626, " to", false], [38547, 0.032957, " found", false], [53137, 0.031178, " thought", false], [45, 0.019424, ",", false], [22339, 0.017038, " put", false]]], "model_b": [61885, 1, 0.24874432384967804, [[61885, 0.248744, " discovered", false], [37924, 0.084991, " built", false], [47, 0.078684, ".", false], [4596, 0.072541, " in", false], [52112, 0.069173, " learned", false], [38547, 0.04662, " found", false], [53137, 0.036707, " thought", false], [50888, 0.022666, " already", false], [4811, 0.022109, " to", false], [56492, 0.01854, " invented", false]]]}, "raw_delta": 0.010653409090909088, "tuned_delta": 0.06350835298910891}, {"byte_start": 6754, "byte_end": 6755, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "4.72%", "model_b": "5.67%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.771290123462677]], "model_b": [[47, ".", "normal", 0.7287857532501221]]}, "loss": {"model_a": 4.719754284158229, "model_b": 5.670749550369216}, "topk": {"model_a": [47, 1, 0.771290123462677, [[47, 0.77129, ".", false], [45, 0.064693, ",", false], [4596, 0.019019, " in", false], [31296, 0.018397, " like", false], [21265, 0.013926, " and", false], [21700, 0.012867, " for", false], [50888, 0.01286, " already", false], [60, 0.010726, ";", false], [5346, 0.008973, "---", false], [60112, 0.008936, " ourselves", false]]], "model_b": [47, 1, 0.7287857532501221, [[47, 0.728786, ".", false], [45, 0.101784, ",", false], [4788, 0.018202, " so", false], [4596, 0.01634, " in", false], [37598, 0.01219, " about", false], [60, 0.012096, ";", false], [21265, 0.011765, " and", false], [31296, 0.010456, " like", false], [4715, 0.008238, " or", false], [275, 0.007451, " (", false]]]}, "raw_delta": -0.052734375, "tuned_delta": 0.00012056889819982153}, {"byte_start": 6755, "byte_end": 6764, "display": {"text": " Building", "kind": "normal"}, "is_word": true, "word_id": 1166, "word_key": " building", "bytes_hex": "20 42 75 69 6c 64 69 6e 67", "compression": {"model_a": "13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%", "model_b": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%"}, "model_tokens": {"model_a": [[54879, " Building", "normal", 0.0012416080571711063]], "model_b": [[54879, " Building", "normal", 0.0011506275041028857]]}, "loss": {"model_a": 13.400032063812418, "model_b": 13.52526600833403}, "topk": {"model_a": [54879, 50, 0.0012416080571711063, [[261, 0.480431, "\n\n", false], [20996, 0.06535, " The", false], [4331, 0.061794, " We", false], [29894, 0.058216, " This", false], [0, 0.020259, "[0]", false], [19417, 0.01834, " And", false], [3913, 0.017177, " In", false], [37453, 0.015619, " These", false], [20571, 0.01341, " Our", false], [3918, 0.013253, " It", false]]], "model_b": [54879, 47, 0.0011506275041028857, [[261, 0.390897, "\n\n", false], [4331, 0.105886, " We", false], [29894, 0.072985, " This", false], [20996, 0.062186, " The", false], [3913, 0.024141, " In", false], [19417, 0.019491, " And", false], [11, 0.015856, "\n", false], [267, 0.013909, "  ", false], [29889, 0.013428, " That", false], [3918, 0.011811, " It", false]]]}, "raw_delta": -0.00694444444444442, "tuned_delta": 0.0459104994537554}, {"byte_start": 6764, "byte_end": 6767, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1167, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "4.30% 4.30% 4.30%", "model_b": "3.66% 3.66% 3.66%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.4901551902294159]], "model_b": [[4596, " in", "normal", 0.5395276546478271]]}, "loss": {"model_a": 4.297089721397791, "model_b": 3.6630928772571334}, "topk": {"model_a": [4596, 1, 0.4901551902294159, [[4596, 0.490155, " in", false], [52224, 0.065005, " methods", false], [3609, 0.055092, " AI", false], [39936, 0.03906, " these", false], [32139, 0.036149, " such", false], [32234, 0.027693, " this", false], [22248, 0.022638, " our", false], [332, 0.017127, " a", false], [31162, 0.0149, " into", false], [22590, 0.014686, " the", false]]], "model_b": [4596, 1, 0.5395276546478271, [[4596, 0.539528, " in", false], [32139, 0.044973, " such", false], [52224, 0.038377, " methods", false], [39936, 0.030221, " these", false], [332, 0.027408, " a", false], [3609, 0.024307, " AI", false], [22590, 0.015138, " the", false], [31162, 0.014289, " into", false], [59943, 0.012318, " knowledge", false], [32229, 0.012038, " them", false]]]}, "raw_delta": 0.03515625, "tuned_delta": 0.08801119389819982}, {"byte_start": 6767, "byte_end": 6771, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1168, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"model_a": "7.57% 7.57% 7.57% 7.57%", "model_b": "12.33% 12.33% 12.33% 12.33%"}, "model_tokens": {"model_a": [[22248, " our", "normal", 0.1880008727312088]], "model_b": [[22248, " our", "normal", 0.0645064190030098]]}, "loss": {"model_a": 7.572740082791189, "model_b": 12.327716413846122}, "topk": {"model_a": [22248, 1, 0.1880008727312088, [[22248, 0.188001, " our", false], [38720, 0.144361, " human", false], [32464, 0.110388, " what", false], [22590, 0.095063, " the", false], [59943, 0.07566, " knowledge", false], [21835, 0.064079, " how", false], [332, 0.032888, " a", false], [32234, 0.020948, " this", false], [39936, 0.016435, " these", false], [32139, 0.012728, " such", false]]], "model_b": [22248, 3, 0.0645064190030098, [[59943, 0.088358, " knowledge", false], [22590, 0.07409, " the", false], [22248, 0.064506, " our", false], [32139, 0.056225, " such", false], [39936, 0.051963, " these", false], [38720, 0.051076, " human", false], [59163, 0.038897, " arbitrary", false], [52224, 0.038269, " methods", false], [32234, 0.03678, " this", false], [332, 0.033384, " a", false]]]}, "raw_delta": -0.263671875, "tuned_delta": -0.21081693110180016}, {"byte_start": 6771, "byte_end": 6783, "display": {"text": " discoveries", "kind": "normal"}, "is_word": true, "word_id": 1169, "word_key": " discoveries", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 65 73", "compression": {"model_a": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "model_b": "10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75%"}, "model_tokens": {"model_a": [[63484, " discoveries", "normal", 0.004326296970248222]], "model_b": [[63484, " discoveries", "normal", 0.0007805246277712286]]}, "loss": {"model_a": 8.171514880035144, "model_b": 10.75446498579338}, "topk": {"model_a": [63484, 25, 0.004326296970248222, [[59943, 0.232111, " knowledge", false], [22251, 0.132656, " own", false], [65034, 0.061273, " understanding", false], [38720, 0.055981, " human", false], [52224, 0.050118, " methods", false], [38735, 0.029319, " ideas", false], [32448, 0.02707, " ways", false], [39026, 0.025039, " minds", false], [57419, 0.017071, " thinking", false], [57422, 0.015383, " thoughts", false]]], "model_b": [63484, 95, 0.0007805246277712286, [[52224, 0.236164, " methods", false], [22251, 0.147148, " own", false], [59943, 0.12182, " knowledge", false], [38720, 0.036992, " human", false], [31416, 0.0365, " meta", false], [65034, 0.024606, " understanding", false], [32448, 0.016313, " ways", false], [46545, 0.0132, " mental", false], [46561, 0.013088, " method", false], [31427, 0.013084, " mind", false]]]}, "raw_delta": -0.1432291666666666, "tuned_delta": -0.09037422276846678}, {"byte_start": 6783, "byte_end": 6788, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1170, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "18.26% 18.26% 18.26% 18.26% 18.26%", "model_b": "20.29% 20.29% 20.29% 20.29% 20.29%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.006370143964886665]], "model_b": [[31581, " only", "normal", 0.003631850006058812]]}, "loss": {"model_a": 18.25910911125094, "model_b": 20.287899012501047}, "topk": {"model_a": [31581, 21, 0.006370143964886665, [[4600, 0.255097, " is", false], [4706, 0.1171, " of", false], [45, 0.080397, ",", false], [37598, 0.057938, " about", false], [32475, 0.039059, " will", false], [30659, 0.038065, " does", false], [4811, 0.036144, " to", false], [21265, 0.032342, " and", false], [38964, 0.019073, " makes", false], [4596, 0.015779, " in", false]]], "model_b": [31581, 27, 0.003631850006058812, [[4600, 0.331937, " is", false], [45, 0.079242, ",", false], [4811, 0.059643, " to", false], [47266, 0.050476, " should", false], [32475, 0.037996, " will", false], [21265, 0.035739, " and", false], [4706, 0.035516, " of", false], [31162, 0.029175, " into", false], [4423, 0.023905, " as", false], [275, 0.019076, " (", false]]]}, "raw_delta": -0.11250000000000004, "tuned_delta": -0.05964505610180022}, {"byte_start": 6788, "byte_end": 6794, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 1171, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"model_a": "5.85% 5.85% 5.85% 5.85% 5.85% 5.85%", "model_b": "5.68% 5.68% 5.68% 5.68% 5.68% 5.68%"}, "model_tokens": {"model_a": [[38964, " makes", "normal", 0.1435735672712326]], "model_b": [[38964, " makes", "normal", 0.1504160612821579]]}, "loss": {"model_a": 5.846859784852732, "model_b": 5.682490232668117}, "topk": {"model_a": [38964, 1, 0.1435735672712326, [[38964, 0.143574, " makes", false], [38875, 0.106222, " leads", false], [40212, 0.037512, " works", false], [39719, 0.029747, " slows", false], [45691, 0.027132, " delays", false], [30109, 0.023721, " adds", false], [30965, 0.022295, " gets", false], [38686, 0.020486, " helps", false], [47237, 0.02036, " serves", false], [38989, 0.018903, " means", false]]], "model_b": [38964, 1, 0.1504160612821579, [[38964, 0.150416, " makes", false], [38875, 0.056091, " leads", false], [4811, 0.034148, " to", false], [40212, 0.027159, " works", false], [30109, 0.025677, " adds", false], [59847, 0.025392, " increases", false], [47237, 0.023039, " serves", false], [47769, 0.022996, " wastes", false], [32465, 0.016544, " when", false], [38686, 0.01638, " helps", false]]]}, "raw_delta": 0.009114583333333315, "tuned_delta": 0.061969527231533136}, {"byte_start": 6794, "byte_end": 6797, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 1172, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "10.66% 10.66% 10.66%", "model_b": "12.49% 12.49% 12.49%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.17133721709251404]], "model_b": [[4601, " it", "normal", 0.12644612789154053]]}, "loss": {"model_a": 10.66053952740217, "model_b": 12.492085966030738}, "topk": {"model_a": [4601, 2, 0.17133721709251404, [[22590, 0.197584, " the", false], [4601, 0.171337, " it", false], [32229, 0.122272, " them", false], [47539, 0.105951, " things", false], [4835, 0.079731, " us", false], [22248, 0.062105, " our", false], [21700, 0.042001, " for", false], [32234, 0.024939, " this", false], [39936, 0.014955, " these", false], [39931, 0.014597, " their", false]]], "model_b": [4601, 3, 0.12644612789154053, [[32229, 0.254589, " them", false], [22590, 0.20988, " the", false], [4601, 0.126446, " it", false], [47539, 0.077772, " things", false], [22248, 0.050657, " our", false], [4835, 0.050341, " us", false], [32234, 0.030213, " this", false], [3609, 0.029523, " AI", false], [39936, 0.013351, " these", false], [52201, 0.012807, " matters", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04870755610180018}, {"byte_start": 6797, "byte_end": 6804, "display": {"text": " harder", "kind": "normal"}, "is_word": true, "word_id": 1173, "word_key": " harder", "bytes_hex": "20 68 61 72 64 65 72", "compression": {"model_a": "1.62% 1.62% 1.62% 1.62% 1.62% 1.62% 1.62%", "model_b": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"model_a": [[46162, " harder", "normal", 0.5326055288314819]], "model_b": [[46162, " harder", "normal", 0.559077799320221]]}, "loss": {"model_a": 1.6202141572483475, "model_b": 1.4893894116320212}, "topk": {"model_a": [46162, 1, 0.5326055288314819, [[46162, 0.532606, " harder", false], [31458, 0.134851, " more", false], [31048, 0.050604, " hard", false], [45819, 0.049416, " easier", false], [59516, 0.031625, " difficult", false], [62082, 0.030636, " impossible", false], [56895, 0.017559, " possible", false], [31277, 0.013399, " less", false], [30788, 0.011633, " even", false], [40216, 0.010945, " worse", false]]], "model_b": [46162, 1, 0.559077799320221, [[46162, 0.559078, " harder", false], [31458, 0.195937, " more", false], [40216, 0.033581, " worse", false], [31048, 0.028091, " hard", false], [45819, 0.023452, " easier", false], [59516, 0.019225, " difficult", false], [31466, 0.019204, " much", false], [31277, 0.013823, " less", false], [30788, 0.013775, " even", false], [62082, 0.010114, " impossible", false]]]}, "raw_delta": 0.007254464285714288, "tuned_delta": 0.06010940818391411}, {"byte_start": 6804, "byte_end": 6807, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1174, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "3.36% 3.36% 3.36%", "model_b": "3.57% 3.57% 3.57%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.5702154636383057]], "model_b": [[4811, " to", "normal", 0.5526409149169922]]}, "loss": {"model_a": 3.357835137485705, "model_b": 3.5691674188659244}, "topk": {"model_a": [4811, 1, 0.5702154636383057, [[4811, 0.570215, " to", false], [21700, 0.347331, " for", false], [21265, 0.025766, " and", false], [45, 0.023029, ",", false], [47, 0.010901, ".", false], [38869, 0.005975, " later", false], [4596, 0.004291, " in", false], [22187, 0.001156, " not", false], [5346, 0.001038, "---", false], [275, 0.000921, " (", false]]], "model_b": [4811, 1, 0.5526409149169922, [[4811, 0.552641, " to", false], [45, 0.152112, ",", false], [21700, 0.116023, " for", false], [47, 0.089906, ".", false], [21265, 0.027325, " and", false], [60, 0.019381, ";", false], [32226, 0.006359, " than", false], [5346, 0.005573, "---", false], [4596, 0.004557, " in", false], [51018, 0.003318, " because", false]]]}, "raw_delta": -0.01171875, "tuned_delta": 0.04113619389819982}, {"byte_start": 6807, "byte_end": 6811, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 1175, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"model_a": "20.71% 20.71% 20.71% 20.71%", "model_b": "29.16% 29.16% 29.16% 29.16%"}, "model_tokens": {"model_a": [[22449, " see", "normal", 0.010286270640790462]], "model_b": [[22449, " see", "normal", 0.0015698439674451947]]}, "loss": {"model_a": 20.710563575261485, "model_b": 29.163854830470253}, "topk": {"model_a": [22449, 10, 0.010286270640790462, [[56010, 0.348179, " discover", false], [30858, 0.28432, " find", false], [31358, 0.049123, " make", false], [37923, 0.041945, " build", false], [4491, 0.027143, " do", false], [38877, 0.025571, " learn", false], [21751, 0.015759, " get", false], [55851, 0.010823, " continue", false], [31205, 0.010527, " keep", false], [22449, 0.010286, " see", false]]], "model_b": [22449, 35, 0.0015698439674451947, [[56010, 0.369328, " discover", false], [30858, 0.214237, " find", false], [37923, 0.093945, " build", false], [4491, 0.059129, " do", false], [38877, 0.02745, " learn", false], [31358, 0.016732, " make", false], [50848, 0.010805, " achieve", false], [21751, 0.009958, " get", false], [51133, 0.009385, " capture", false], [22681, 0.007382, " use", false]]]}, "raw_delta": -0.46875, "tuned_delta": -0.41589505610180016}, {"byte_start": 6811, "byte_end": 6815, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 1176, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"model_a": "10.85% 10.85% 10.85% 10.85%", "model_b": "10.21% 10.21% 10.21% 10.21%"}, "model_tokens": {"model_a": [[21835, " how", "normal", 0.09116177260875702]], "model_b": [[21835, " how", "normal", 0.10259241610765457]]}, "loss": {"model_a": 10.848390444184586, "model_b": 10.214393600043929}, "topk": {"model_a": [21835, 3, 0.09116177260875702, [[22590, 0.211943, " the", false], [32464, 0.182443, " what", false], [21835, 0.091162, " how", false], [32229, 0.090144, " them", false], [22168, 0.057789, " new", false], [32227, 0.029298, " that", false], [21265, 0.026005, " and", false], [22248, 0.018847, " our", false], [39936, 0.017489, " these", false], [51816, 0.016837, " further", false]]], "model_b": [21835, 3, 0.10259241610765457, [[32464, 0.273792, " what", false], [22590, 0.196324, " the", false], [21835, 0.102592, " how", false], [40185, 0.051778, " where", false], [32227, 0.049429, " that", false], [32229, 0.041989, " them", false], [21265, 0.031436, " and", false], [39931, 0.017872, " their", false], [45, 0.016357, ",", false], [4588, 0.014694, " if", false]]]}, "raw_delta": 0.03515625, "tuned_delta": 0.08801119389819982}, {"byte_start": 6815, "byte_end": 6819, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1177, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.41% 11.41% 11.41% 11.41%", "model_b": "11.98% 11.98% 11.98% 11.98%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.0800740048289299]], "model_b": [[22590, " the", "normal", 0.07069667428731918]]}, "loss": {"model_a": 11.411943194531839, "model_b": 11.97549594487909}, "topk": {"model_a": [22590, 2, 0.0800740048289299, [[4811, 0.457365, " to", false], [22590, 0.080074, " the", false], [32232, 0.079312, " they", false], [4858, 0.072639, " we", false], [22248, 0.053443, " our", false], [31466, 0.046823, " much", false], [39936, 0.020099, " these", false], [3609, 0.017004, " AI", false], [39944, 0.011843, " those", false], [21660, 0.007374, " far", false]]], "model_b": [22590, 4, 0.07069667428731918, [[4811, 0.278216, " to", false], [32232, 0.182754, " they", false], [4858, 0.087238, " we", false], [22590, 0.070697, " the", false], [22248, 0.046883, " our", false], [39936, 0.026123, " these", false], [32234, 0.017958, " this", false], [21265, 0.016927, " and", false], [31466, 0.010399, " much", false], [3609, 0.010355, " AI", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.02160494389819982}, {"byte_start": 6819, "byte_end": 6831, "display": {"text": " discovering", "kind": "normal"}, "is_word": true, "word_id": 1178, "word_key": " discovering", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 6e 67", "compression": {"model_a": "10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85%", "model_b": "11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08%"}, "model_tokens": {"model_a": [[63485, " discovering", "normal", 0.000732090265955776]], "model_b": [[63485, " discovering", "normal", 0.0006235298351384699]]}, "loss": {"model_a": 10.848390444184586, "model_b": 11.083204090162607}, "topk": {"model_a": [63485, 102, 0.000732090265955776, [[37636, 0.163121, " agent", false], [40213, 0.103612, " world", false], [45124, 0.068925, " agents", false], [52224, 0.054678, " methods", false], [3609, 0.04211, " AI", false], [59544, 0.039181, " discovery", false], [63484, 0.035616, " discoveries", false], [31427, 0.032576, " mind", false], [52391, 0.032253, " outside", false], [31835, 0.02154, " real", false]]], "model_b": [63485, 147, 0.0006235298351384699, [[63484, 0.09845, " discoveries", false], [59544, 0.089199, " discovery", false], [37636, 0.060225, " agent", false], [40213, 0.05665, " world", false], [52224, 0.045301, " methods", false], [3609, 0.03067, " AI", false], [45124, 0.028949, " agents", false], [61885, 0.027659, " discovered", false], [31416, 0.024194, " meta", false], [52391, 0.023713, " outside", false]]]}, "raw_delta": -0.01302083333333337, "tuned_delta": 0.03983411056486645}, {"byte_start": 6831, "byte_end": 6839, "display": {"text": " process", "kind": "normal"}, "is_word": true, "word_id": 1179, "word_key": " process", "bytes_hex": "20 70 72 6f 63 65 73 73", "compression": {"model_a": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%", "model_b": "5.25% 5.25% 5.25% 5.25% 5.25% 5.25% 5.25% 5.25%"}, "model_tokens": {"model_a": [[52571, " process", "normal", 0.04531576484441757]], "model_b": [[52571, " process", "normal", 0.09781959652900696]]}, "loss": {"model_a": 6.9739652855472345, "model_b": 5.248084987608777}, "topk": {"model_a": [52571, 4, 0.04531576484441757, [[4600, 0.148359, " is", false], [21413, 0.124032, " can", false], [37636, 0.113327, " agent", false], [52571, 0.045316, " process", false], [51896, 0.044143, " happens", false], [38128, 0.032347, " could", false], [40212, 0.032036, " works", false], [22748, 0.031812, " was", false], [39021, 0.027612, " might", false], [52224, 0.02573, " methods", false]]], "model_b": [52571, 2, 0.09781959652900696, [[21413, 0.115633, " can", false], [52571, 0.09782, " process", false], [4600, 0.091025, " is", false], [52224, 0.075582, " methods", false], [37636, 0.070996, " agent", false], [46561, 0.045247, " method", false], [51896, 0.037193, " happens", false], [3609, 0.036474, " AI", false], [21265, 0.023193, " and", false], [40212, 0.021397, " works", false]]]}, "raw_delta": 0.095703125, "tuned_delta": 0.14855806889819984}, {"byte_start": 6839, "byte_end": 6843, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1180, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "8.28% 8.28% 8.28% 8.28%", "model_b": "10.57% 10.57% 10.57% 10.57%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.16019323468208313]], "model_b": [[21413, " can", "normal", 0.09757031500339508]]}, "loss": {"model_a": 8.277181020725253, "model_b": 10.566614069010962}, "topk": {"model_a": [21413, 2, 0.16019323468208313, [[40212, 0.253306, " works", false], [21413, 0.160193, " can", false], [46342, 0.117424, " itself", false], [38128, 0.086728, " could", false], [39021, 0.077251, " might", false], [4600, 0.044465, " is", false], [47266, 0.024825, " should", false], [55448, 0.017539, " actually", false], [22074, 0.017034, " may", false], [30988, 0.016146, " goes", false]]], "model_b": [21413, 3, 0.09757031500339508, [[40212, 0.382169, " works", false], [4600, 0.101876, " is", false], [21413, 0.09757, " can", false], [46342, 0.073217, " itself", false], [47266, 0.054673, " should", false], [55448, 0.041218, " actually", false], [38128, 0.026932, " could", false], [39021, 0.021897, " might", false], [22074, 0.011382, " may", false], [30868, 0.010295, " fits", false]]]}, "raw_delta": -0.126953125, "tuned_delta": -0.07409818110180018}, {"byte_start": 6843, "byte_end": 6846, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1181, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "4.98% 4.98% 4.98%", "model_b": "2.98% 2.98% 2.98%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.4363786578178406]], "model_b": [[4435, " be", "normal", 0.6121557354927063]]}, "loss": {"model_a": 4.9780492947340536, "model_b": 2.9821333039208713}, "topk": {"model_a": [4435, 1, 0.4363786578178406, [[4435, 0.436379, " be", false], [32499, 0.126246, " work", false], [52570, 0.067917, " proceed", false], [55851, 0.054353, " continue", false], [4559, 0.047789, " go", false], [39590, 0.029026, " scale", false], [46342, 0.015794, " itself", false], [46159, 0.015218, " happen", false], [39166, 0.01187, " occur", false], [32187, 0.009245, " take", false]]], "model_b": [4435, 1, 0.6121557354927063, [[4435, 0.612156, " be", false], [32499, 0.045816, " work", false], [46342, 0.01854, " itself", false], [51982, 0.018252, " improve", false], [55448, 0.016839, " actually", false], [45284, 0.016739, " become", false], [52570, 0.013729, " proceed", false], [31262, 0.0119, " lead", false], [55851, 0.010883, " continue", false], [4559, 0.010581, " go", false]]]}, "raw_delta": 0.11067708333333333, "tuned_delta": 0.16353202723153315}, {"byte_start": 6846, "byte_end": 6851, "display": {"text": " done", "kind": "normal"}, "is_word": true, "word_id": 1182, "word_key": " done", "bytes_hex": "20 64 6f 6e 65", "compression": {"model_a": "10.43% 10.43% 10.43% 10.43% 10.43%", "model_b": "8.68% 8.68% 8.68% 8.68% 8.68%"}, "model_tokens": {"model_a": [[30666, " done", "normal", 0.05511769279837608]], "model_b": [[30666, " done", "normal", 0.08892758190631866]]}, "loss": {"model_a": 10.425725881424148, "model_b": 8.67871235534767}, "topk": {"model_a": [30666, 4, 0.05511769279837608, [[59203, 0.203805, " automated", false], [31351, 0.105263, " made", false], [56418, 0.091931, " improved", false], [30666, 0.055118, " done", false], [63594, 0.03889, " generalized", false], [56189, 0.033822, " extended", false], [50937, 0.019193, " applied", false], [63246, 0.01874, " accelerated", false], [38547, 0.018107, " found", false], [55689, 0.016281, " captured", false]]], "model_b": [30666, 2, 0.08892758190631866, [[56418, 0.145395, " improved", false], [30666, 0.088928, " done", false], [31351, 0.056813, " made", false], [59203, 0.034044, " automated", false], [60101, 0.024859, " optimized", false], [47687, 0.016327, " useful", false], [63594, 0.016262, " generalized", false], [52112, 0.015924, " learned", false], [50937, 0.014213, " applied", false], [32354, 0.01412, " used", false]]]}, "raw_delta": 0.09687499999999999, "tuned_delta": 0.14972994389819982}, {"byte_start": 6851, "byte_end": 6852, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "28.88%", "model_b": "25.36%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.2023681104183197]], "model_b": [[47, ".", "normal", 0.24795278906822205]]}, "loss": {"model_a": 28.88207845529663, "model_b": 25.359873765626308}, "topk": {"model_a": [47, 1, 0.2023681104183197, [[47, 0.202368, ".", false], [4450, 0.151416, " by", false], [4596, 0.091885, " in", false], [45301, 0.091735, " better", false], [45, 0.086847, ",", false], [31458, 0.039052, " more", false], [4424, 0.026907, " at", false], [32458, 0.022975, " well", false], [64839, 0.021832, " automatically", false], [63507, 0.01626, " effectively", false]]], "model_b": [47, 1, 0.24795278906822205, [[47, 0.247953, ".", false], [45, 0.150302, ",", false], [4450, 0.113059, " by", false], [4596, 0.076627, " in", false], [45301, 0.047464, " better", false], [63508, 0.043576, " efficiently", false], [32458, 0.035337, " well", false], [31458, 0.03016, " more", false], [63507, 0.021408, " effectively", false], [53356, 0.02, " without", false]]]}, "raw_delta": 0.1953125, "tuned_delta": 0.24816744389819984}, {"byte_start": 6852, "byte_end": 6853, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "96.37%", "model_b": "72.70%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.0046869907528162]], "model_b": [[11, "\n", "control", 0.017434781417250633]]}, "loss": {"model_a": 96.36752030937997, "model_b": 72.69830479479542}, "topk": {"model_a": [11, 21, 0.0046869907528162, [[261, 0.523535, "\n\n", false], [20996, 0.06174, " The", false], [4331, 0.054458, " We", false], [3918, 0.035179, " It", false], [29894, 0.031489, " This", false], [19417, 0.021281, " And", false], [0, 0.016206, "[0]", false], [20571, 0.013208, " Our", false], [3913, 0.013201, " In", false], [3908, 0.010284, " If", false]]], "model_b": [11, 8, 0.017434781417250633, [[261, 0.397328, "\n\n", false], [4331, 0.082781, " We", false], [20996, 0.055552, " The", false], [3918, 0.044314, " It", false], [29894, 0.030437, " This", false], [19417, 0.022065, " And", false], [3913, 0.02076, " In", false], [11, 0.017435, "\n", false], [50342, 0.016884, " Instead", false], [267, 0.015407, "  ", false]]]}, "raw_delta": 1.3125, "tuned_delta": 1.3653549438981998}], "meta": {"model_a": "RWKV7-G1D-1.5B", "model_b": "RWKV7-G1D-0.4B", "avg_compression": {"model_a": 9.337770518398914, "model_b": 10.290940086503847}, "avg_delta": -0.05285494389819982, "avg_delta_compression": -0.9531695681049657}}</script>
+    <script id="render-model" type="application/json">{"text": "The Bitter Lesson\nRich Sutton\nMarch 13, 2019\nThe biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research project, massively more computation inevitably becomes available. Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation. These two need not run counter to each other, but in practice they tend to. Time spent on one is time not spent on the other. There are psychological commitments to investment in one approach or the other. And the human-knowledge approach tends to complicate methods in ways that make them less suited to taking advantage of general methods leveraging computation.  There were many examples of AI researchers' belated learning of this bitter lesson, and it is instructive to review some of the most prominent.\n\nIn computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search. At the time, this was looked upon with dismay by the majority of computer-chess researchers who had pursued methods that leveraged human understanding of the special structure of chess. When a simpler, search-based approach with special hardware and software proved vastly more effective, these human-knowledge-based chess researchers were not good losers. They said that ``brute force\" search may have won this time, but it was not a general strategy, and anyway it was not how people played chess. These researchers wanted methods based on human input to win and were disappointed when they did not.\n\nA similar pattern of research progress was seen in computer Go, only delayed by a further 20 years. Enormous initial efforts went into avoiding search by taking advantage of human knowledge, or of the special features of the game, but all those efforts proved irrelevant, or worse, once search was applied effectively at scale. Also important was the use of learning by self play to learn a value function (as it was in many other games and even in chess, although learning did not play a big role in the 1997 program that first beat a world champion). Learning by self play, and learning in general, is like search in that it enables massive computation to be brought to bear. Search and learning are the two most important classes of techniques for utilizing massive amounts of computation in AI research. In computer Go, as in computer chess, researchers' initial effort was directed towards utilizing human understanding (so that less search was needed) and only much later was much greater success had by embracing search and learning.\n\nIn speech recognition, there was an early competition, sponsored by DARPA, in the 1970s. Entrants included a host of special methods that took advantage of human knowledge---knowledge of words, of phonemes, of the human vocal tract, etc. On the other side were newer methods that were more statistical in nature and did much more computation, based on hidden Markov models (HMMs). Again, the statistical methods won out over the human-knowledge-based methods. This led to a major change in all of natural language processing, gradually over decades, where statistics and computation came to dominate the field. The recent rise of deep learning in speech recognition is the most recent step in this consistent direction. Deep learning methods rely even less on human knowledge, and use even more computation, together with learning on huge training sets, to produce dramatically better speech recognition systems. As in the games, researchers always tried to make systems that worked the way the researchers thought their own minds worked---they tried to put that knowledge in their systems---but it proved ultimately counterproductive, and a colossal waste of researcher's time, when, through Moore's law, massive computation became available and a means was found to put it to good use.\n\nIn computer vision, there has been a similar pattern. Early methods conceived of vision as searching for edges, or generalized cylinders, or in terms of SIFT features. But today all this is discarded. Modern deep-learning neural networks use only the notions of convolution and certain kinds of invariances, and perform much better.\n\nThis is a big lesson. As a field, we still have not thoroughly learned it, as we are continuing to make the same kind of mistakes. To see this, and to effectively resist it, we have to understand the appeal of these mistakes. We have to learn the bitter lesson that building in how we think we think does not work in the long run. The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhibits further progress, and 4) breakthrough progress eventually arrives by an opposing approach based on scaling computation by search and learning. The eventual success is tinged with bitterness, and often incompletely digested, because it is success over a favored, human-centric approach.\n\nOne thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.\n\nThe second general point to be learned from the bitter lesson is that the actual contents of minds are tremendously, irredeemably complex; we should stop trying to find simple ways to think about the contents of minds, such as simple ways to think about space, objects, multiple agents, or symmetries. All these are part of the arbitrary, intrinsically-complex, outside world. They are not what should be built in, as their complexity is endless; instead we should build in only the meta-methods that can find and capture this arbitrary complexity. Essential to these methods is that they can find good approximations, but the search for them should be by our methods, not by us. We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done.\n", "tokens": [{"byte_start": 0, "byte_end": 3, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 0, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"model_a": "21.88% 21.88% 21.88%", "model_b": "20.38% 20.38% 20.38%"}, "model_tokens": {"model_a": [[6699, "The", "normal", 0.026203298941254616]], "model_b": [[6699, "The", "normal", 0.03371196612715721]]}, "loss": {"model_a": 21.884631805151592, "model_b": 20.38182447089225}, "topk": {"model_a": [6699, 7, 0.026203298941254616, [[41775, 0.062368, "length", false], [34579, 0.049356, "https", false], [897, 0.046897, "CC", false], [24281, 0.043908, "User", false], [36, 0.035981, "#", false], [82, 0.03298, "Q", false], [6699, 0.026203, "The", false], [520, 0.020542, "**", false], [25623, 0.019473, "http", false], [1136, 0.018912, "In", false]]], "model_b": [6699, 2, 0.03371196612715721, [[24281, 0.036707, "User", false], [6699, 0.033712, "The", false], [36, 0.032265, "#", false], [34579, 0.031346, "https", false], [520, 0.021285, "**", false], [53648, 0.018388, "Question", false], [1136, 0.014396, "In", false], [5201, 0.014314, "###", false], [23672, 0.011537, "From", false], [82, 0.011417, "Q", false]]]}, "raw_delta": 0.08333333333333348, "tuned_delta": 0.13742293074840906}, {"byte_start": 3, "byte_end": 7, "display": {"text": " Bit", "kind": "normal"}, "is_word": true, "word_id": 1, "word_key": " bit", "bytes_hex": "20 42 69 74", "compression": {"model_a": "40.58% 40.58% 40.58% 40.58%", "model_b": "42.55% 42.55% 42.55% 42.55%"}, "model_tokens": {"model_a": [[19523, " Bit", "normal", 0.00012164174404460937]], "model_b": [[19523, " Bit", "normal", 8.066837472142652e-05]]}, "loss": {"model_a": 40.57579802500209, "model_b": 42.54823265121747}, "topk": {"model_a": [19523, 1280, 0.00012164174404460937, [[32355, 0.028185, " user", false], [52569, 0.014494, " problem", false], [331, 0.012293, " `", false], [57009, 0.009806, " question", false], [45242, 0.008977, " author", false], [45010, 0.00747, " United", false], [32224, 0.007319, " text", false], [31894, 0.00697, " role", false], [39840, 0.006303, " study", false], [269, 0.005951, " \"", false]]], "model_b": [19523, 2250, 8.066837472142652e-05, [[331, 0.010424, " `", false], [32355, 0.008742, " user", false], [38499, 0.007124, " first", false], [44419, 0.006925, " Import", false], [269, 0.006826, " \"", false], [32224, 0.006172, " text", false], [32219, 0.005894, " term", false], [59725, 0.005804, " following", false], [29689, 0.005782, " Role", false], [52569, 0.005131, " problem", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05528540258492441}, {"byte_start": 7, "byte_end": 10, "display": {"text": "ter", "kind": "normal"}, "is_word": true, "word_id": 2, "word_key": "ter", "bytes_hex": "74 65 72", "compression": {"model_a": "8.97% 8.97% 8.97%", "model_b": "8.78% 8.78% 8.78%"}, "model_tokens": {"model_a": [[8795, "ter", "normal", 0.2274768203496933]], "model_b": [[8795, "ter", "normal", 0.2319023162126541]]}, "loss": {"model_a": 8.969881276360416, "model_b": 8.782030359578}, "topk": {"model_a": [8795, 1, 0.2274768203496933, [[8795, 0.227477, "ter", false], [102, 0.140274, "e", false], [27491, 0.042812, "wise", false], [48761, 0.035318, "Torrent", false], [27135, 0.030176, "ters", false], [116, 0.022352, "s", false], [27133, 0.018771, "tern", false], [41127, 0.018145, "bucket", false], [1791, 0.017253, "ch", false], [27299, 0.015422, "umen", false]]], "model_b": [8795, 1, 0.2319023162126541, [[8795, 0.231902, "ter", false], [102, 0.09113, "e", false], [116, 0.046393, "s", false], [48761, 0.043744, "Torrent", false], [27135, 0.023984, "ters", false], [2206, 0.019373, "te", false], [7856, 0.018095, "ing", false], [4706, 0.017608, " of", false], [46, 0.015887, "-", false], [25038, 0.015283, "coin", false]]]}, "raw_delta": 0.01041666666666663, "tuned_delta": 0.06450626408174222}, {"byte_start": 10, "byte_end": 15, "display": {"text": " Less", "kind": "normal"}, "is_word": true, "word_id": 3, "word_key": " less", "bytes_hex": "20 4c 65 73 73", "compression": {"model_a": "19.61% 19.61% 19.61% 19.61% 19.61%", "model_b": "21.64% 21.64% 21.64% 21.64% 21.64%"}, "model_tokens": {"model_a": [[29273, " Less", "normal", 0.004347627982497215]], "model_b": [[29273, " Less", "normal", 0.002490060869604349]]}, "loss": {"model_a": 19.611635712084343, "model_b": 21.640425613334447}, "topk": {"model_a": [29273, 22, 0.004347627982497215, [[37496, 0.206492, " Truth", false], [29584, 0.105174, " Pill", false], [26939, 0.042943, "root", false], [19826, 0.030786, " End", false], [29694, 0.029046, " Root", false], [44502, 0.025203, " Legacy", false], [44014, 0.021993, " Battle", false], [20979, 0.012415, " Tas", false], [46, 0.010383, "-", false], [21265, 0.009432, " and", false]]], "model_b": [29273, 43, 0.002490060869604349, [[19826, 0.065806, " End", false], [37496, 0.060229, " Truth", false], [46, 0.022982, "-", false], [29694, 0.020777, " Root", false], [36711, 0.019261, " Fruit", false], [19898, 0.01685, " Fla", false], [61369, 0.016179, " Experience", false], [37421, 0.013073, " Sweet", false], [29863, 0.012863, " Tale", false], [21265, 0.011283, " and", false]]]}, "raw_delta": -0.11250000000000004, "tuned_delta": -0.058410402584924456}, {"byte_start": 15, "byte_end": 17, "display": {"text": "on", "kind": "normal"}, "is_word": true, "word_id": 4, "word_key": "on", "bytes_hex": "6f 6e", "compression": {"model_a": "0.36% 0.36%", "model_b": "0.28% 0.28%"}, "model_tokens": {"model_a": [[2098, "on", "normal", 0.9603351354598999]], "model_b": [[2098, "on", "normal", 0.9695522785186768]]}, "loss": {"model_a": 0.3588246027601639, "model_b": 0.2784743082770597}, "topk": {"model_a": [2098, 1, 0.9603351354598999, [[2098, 0.960335, "on", false], [8371, 0.036158, "ons", false], [34326, 0.000281, "ening", false], [7874, 0.000169, "ion", false], [37581, 0.000149, " Wrong", false], [29888, 0.000146, " Than", false], [1853, 0.000129, "en", false], [32226, 0.000126, " than", false], [1844, 0.000116, "ee", false], [2101, 0.000114, "or", false]]], "model_b": [2098, 1, 0.9695522785186768, [[2098, 0.969552, "on", false], [8371, 0.030243, "ons", false], [7874, 2.5e-05, "ion", false], [7856, 2.4e-05, "ing", false], [36923, 8e-06, " Learn", false], [8373, 6e-06, "ony", false], [8363, 5e-06, "ona", false], [29888, 5e-06, " Than", false], [8366, 5e-06, "one", false], [1950, 4e-06, "in", false]]]}, "raw_delta": 0.00445556640625, "tuned_delta": 0.05854516382132559}, {"byte_start": 17, "byte_end": 18, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "33.67%", "model_b": "52.97%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.1527043581008911]], "model_b": [[11, "\n", "control", 0.053535096347332]]}, "loss": {"model_a": 33.67227683324826, "model_b": 52.97395853264162}, "topk": {"model_a": [11, 2, 0.1527043581008911, [[59, 0.368519, ":", false], [11, 0.152704, "\n", false], [261, 0.110118, "\n\n", false], [4600, 0.03812, " is", false], [4706, 0.029825, " of", false], [4450, 0.028067, " by", false], [275, 0.026209, " (", false], [280, 0.020331, " -", false], [45, 0.020245, ",", false], [3339, 0.012901, "  \n", false]]], "model_b": [11, 3, 0.053535096347332, [[4706, 0.592784, " of", false], [59, 0.160058, ":", false], [11, 0.053535, "\n", false], [261, 0.035347, "\n\n", false], [275, 0.016666, " (", false], [4089, 0.009909, " Of", false], [4600, 0.007953, " is", false], [21265, 0.007183, " and", false], [45, 0.006672, ",", false], [4596, 0.004557, " in", false]]]}, "raw_delta": -1.0703125, "tuned_delta": -1.0162229025849243}, {"byte_start": 18, "byte_end": 22, "display": {"text": "Rich", "kind": "normal"}, "is_word": true, "word_id": 5, "word_key": "rich", "bytes_hex": "52 69 63 68", "compression": {"model_a": "42.55% 42.55% 42.55% 42.55%", "model_b": "41.98% 41.98% 41.98% 41.98%"}, "model_tokens": {"model_a": [[24100, "Rich", "normal", 7.995641499292105e-05]], "model_b": [[24100, "Rich", "normal", 9.215204045176506e-05]]}, "loss": {"model_a": 42.54823265121747, "model_b": 41.98467990087022}, "topk": {"model_a": [24100, 1367, 7.995641499292105e-05, [[6699, 0.09671, "The", false], [1782, 0.036423, "by", false], [66, 0.034416, "A", false], [1136, 0.030641, "In", false], [894, 0.02219, "By", false], [24242, 0.019256, "This", false], [74, 0.019003, "I", false], [35, 0.016756, "\"", false], [6018, 0.013143, "How", false], [24326, 0.011633, "What", false]]], "model_b": [24100, 1208, 9.215204045176506e-05, [[6699, 0.102655, "The", false], [1136, 0.031903, "In", false], [894, 0.029661, "By", false], [66, 0.025294, "A", false], [74, 0.025139, "I", false], [1782, 0.021771, "by", false], [1141, 0.019034, "It", false], [1589, 0.017246, "We", false], [24327, 0.017022, "When", false], [35, 0.015403, "\"", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08533959741507559}, {"byte_start": 22, "byte_end": 29, "display": {"text": " Sutton", "kind": "normal"}, "is_word": true, "word_id": 6, "word_key": " sutton", "bytes_hex": "20 53 75 74 74 6f 6e", "compression": {"model_a": "21.09% 21.09% 21.09% 21.09% 21.09% 21.09% 21.09%", "model_b": "20.05% 20.05% 20.05% 20.05% 20.05% 20.05% 20.05%"}, "model_tokens": {"model_a": [[44940, " Sutton", "normal", 0.00026984905707649887]], "model_b": [[44940, " Sutton", "normal", 0.0004142566176597029]]}, "loss": {"model_a": 21.09297437013998, "model_b": 20.04637640520936}, "topk": {"model_a": [44940, 420, 0.00026984905707649887, [[46787, 0.056964, " people", false], [19712, 0.050819, " Dad", false], [21265, 0.048479, " and", false], [26269, 0.037071, "mond", false], [1941, 0.036013, "ie", false], [1858, 0.026592, "es", false], [8795, 0.025062, "ter", false], [4600, 0.023162, " is", false], [45, 0.02242, ",", false], [50202, 0.018359, " Epstein", false]]], "model_b": [44940, 196, 0.0004142566176597029, [[26269, 0.183218, "mond", false], [46787, 0.05846, " people", false], [45, 0.03947, ",", false], [21265, 0.039051, " and", false], [1858, 0.037005, "es", false], [1941, 0.026738, "ie", false], [8795, 0.018366, "ter", false], [4596, 0.015894, " in", false], [19712, 0.013771, " Dad", false], [7513, 0.010657, "est", false]]]}, "raw_delta": 0.05803571428571441, "tuned_delta": 0.11212531170079}, {"byte_start": 29, "byte_end": 30, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "36.91%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.12926216423511505]], "model_b": [[11, "\n", "control", 0.2021895796060562]]}, "loss": {"model_a": 36.91270514774496, "model_b": 28.600302080123}, "topk": {"model_a": [11, 3, 0.12926216423511505, [[45, 0.205069, ",", false], [21265, 0.136185, " and", false], [11, 0.129262, "\n", false], [4600, 0.094519, " is", false], [460, 0.059615, "'s", false], [28309, 0.032636, "’s", false], [21800, 0.029014, " has", false], [59, 0.020669, ":", false], [4712, 0.016245, " on", false], [275, 0.015072, " (", false]]], "model_b": [11, 2, 0.2021895796060562, [[45, 0.215921, ",", false], [11, 0.20219, "\n", false], [4600, 0.062694, " is", false], [460, 0.051548, "'s", false], [28309, 0.035716, "’s", false], [21265, 0.033008, " and", false], [261, 0.027343, "\n\n", false], [21800, 0.016091, " has", false], [275, 0.015733, " (", false], [47819, 0.013605, " writes", false]]]}, "raw_delta": 0.4609375, "tuned_delta": 0.5150270974150756}, {"byte_start": 30, "byte_end": 35, "display": {"text": "March", "kind": "normal"}, "is_word": true, "word_id": 7, "word_key": "march", "bytes_hex": "4d 61 72 63 68", "compression": {"model_a": "21.19% 21.19% 21.19% 21.19% 21.19%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[33258, "March", "normal", 0.002797103952616453]], "model_b": [[33258, "March", "normal", 0.006689136847853661]]}, "loss": {"model_a": 21.18958341305665, "model_b": 18.03368801111204}, "topk": {"model_a": [33258, 55, 0.002797103952616453, [[6699, 0.059922, "The", false], [640, 0.033635, "20", false], [66, 0.028625, "A", false], [58068, 0.027932, "Publisher", false], [1136, 0.02649, "In", false], [125, 0.018289, "|", false], [24242, 0.016773, "This", false], [41, 0.014946, "(", false], [37, 0.012467, "$", false], [58067, 0.011857, "Published", false]]], "model_b": [33258, 21, 0.006689136847853661, [[6699, 0.080425, "The", false], [74, 0.021537, "I", false], [1136, 0.020863, "In", false], [66, 0.017205, "A", false], [35, 0.012378, "\"", false], [24100, 0.011415, "Rich", false], [24327, 0.011236, "When", false], [853, 0.010141, "As", false], [24242, 0.009833, "This", false], [1336, 0.009566, "On", false]]]}, "raw_delta": 0.17500000000000004, "tuned_delta": 0.22908959741507562}, {"byte_start": 35, "byte_end": 38, "display": {"text": " 13", "kind": "normal"}, "is_word": true, "word_id": 8, "word_key": " 13", "bytes_hex": "20 31 33", "compression": {"model_a": "23.29% 23.29% 23.29%", "model_b": "21.13% 21.13% 21.13%"}, "model_tokens": {"model_a": [[3486, " 13", "normal", 0.020677877590060234]], "model_b": [[3486, " 13", "normal", 0.029522651806473732]]}, "loss": {"model_a": 23.29351368101972, "model_b": 21.133228138021924}, "topk": {"model_a": [3486, 14, 0.020677877590060234, [[3493, 0.283004, " 20", false], [3492, 0.054418, " 19", false], [284, 0.033968, " 1", false], [3502, 0.025711, " 29", false], [3501, 0.025462, " 28", false], [3504, 0.023139, " 31", false], [3503, 0.022768, " 30", false], [290, 0.022622, " 7", false], [3487, 0.022213, " 14", false], [3485, 0.021901, " 12", false]]], "model_b": [3486, 13, 0.029522651806473732, [[3493, 0.070176, " 20", false], [284, 0.044874, " 1", false], [3488, 0.035085, " 15", false], [3492, 0.034471, " 19", false], [3494, 0.033572, " 21", false], [3485, 0.031079, " 12", false], [3501, 0.031073, " 28", false], [291, 0.030999, " 8", false], [3484, 0.030667, " 11", false], [3504, 0.030465, " 31", false]]]}, "raw_delta": 0.11979166666666674, "tuned_delta": 0.17388126408174231}, {"byte_start": 38, "byte_end": 39, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.04%", "model_b": "1.70%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8922017812728882]], "model_b": [[45, ",", "normal", 0.9101293087005615]]}, "loss": {"model_a": 2.042878720008786, "model_b": 1.6994637627659297}, "topk": {"model_a": [45, 1, 0.8922017812728882, [[45, 0.892202, ",", false], [2209, 0.07081, "th", false], [3493, 0.014269, " 20", false], [11, 0.007555, "\n", false], [261, 0.002672, "\n\n", false], [46, 0.001494, "-", false], [9815, 0.001411, "–", false], [47, 0.001032, ".", false], [280, 0.000825, " -", false], [22897, 0.000727, " –", false]]], "model_b": [45, 1, 0.9101293087005615, [[45, 0.910129, ",", false], [2209, 0.055964, "th", false], [11, 0.008816, "\n", false], [3493, 0.008088, " 20", false], [46, 0.002581, "-", false], [261, 0.001473, "\n\n", false], [280, 0.000877, " -", false], [4600, 0.000706, " is", false], [299, 0.000565, " @", false], [47, 0.000549, ".", false]]]}, "raw_delta": 0.01904296875, "tuned_delta": 0.07313256616507559}, {"byte_start": 39, "byte_end": 42, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 9, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"model_a": "0.32% 0.32% 0.32%", "model_b": "0.11% 0.11% 0.11%"}, "model_tokens": {"model_a": [[3493, " 20", "normal", 0.9474717378616333]], "model_b": [[3493, " 20", "normal", 0.9814662933349609]]}, "loss": {"model_a": 0.32433634850714205, "model_b": 0.11153648183956014}, "topk": {"model_a": [3493, 1, 0.9474717378616333, [[3493, 0.947472, " 20", false], [3492, 0.048254, " 19", false], [11, 0.00068, "\n", false], [3491, 0.000552, " 18", false], [640, 0.000524, "20", false], [3490, 0.000169, " 17", false], [285, 8.2e-05, " 2", false], [284, 7.4e-05, " 1", false], [3485, 7.4e-05, " 12", false], [2430, 7e-05, " ", false]]], "model_b": [3493, 1, 0.9814662933349609, [[3493, 0.981466, " 20", false], [3492, 0.013505, " 19", false], [640, 0.000691, "20", false], [3491, 0.000385, " 18", false], [285, 0.000217, " 2", false], [3494, 0.000209, " 21", false], [3490, 0.000179, " 17", false], [11, 0.000173, "\n", false], [3485, 0.000142, " 12", false], [3484, 0.000134, " 11", false]]]}, "raw_delta": 0.011800130208333336, "tuned_delta": 0.06588972762340892}, {"byte_start": 42, "byte_end": 44, "display": {"text": "19", "kind": "normal"}, "is_word": true, "word_id": 10, "word_key": "19", "bytes_hex": "31 39", "compression": {"model_a": "26.63% 26.63%", "model_b": "23.11% 23.11%"}, "model_tokens": {"model_a": [[639, "19", "normal", 0.052171628922224045]], "model_b": [[639, "19", "normal", 0.07687697559595108]]}, "loss": {"model_a": 26.627867453907623, "model_b": 23.1056627642373}, "topk": {"model_a": [639, 8, 0.052171628922224045, [[636, 0.073967, "16", false], [637, 0.067844, "17", false], [638, 0.067624, "18", false], [635, 0.065077, "15", false], [634, 0.060304, "14", false], [633, 0.059129, "13", false], [640, 0.053509, "20", false], [639, 0.052172, "19", false], [632, 0.042047, "12", false], [641, 0.04079, "21", false]]], "model_b": [639, 1, 0.07687697559595108, [[639, 0.076877, "19", false], [638, 0.073605, "18", false], [641, 0.072436, "21", false], [640, 0.069955, "20", false], [637, 0.069857, "17", false], [634, 0.060354, "14", false], [633, 0.058082, "13", false], [636, 0.054728, "16", false], [632, 0.053173, "12", false], [642, 0.052269, "22", false]]]}, "raw_delta": 0.1953125, "tuned_delta": 0.24940209741507557}, {"byte_start": 44, "byte_end": 45, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "9.72%", "model_b": "7.47%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.5851910710334778]], "model_b": [[11, "\n", "control", 0.6637576222419739]]}, "loss": {"model_a": 9.721284943490085, "model_b": 7.467073942101079}, "topk": {"model_a": [11, 1, 0.5851910710334778, [[11, 0.585191, "\n", false], [261, 0.248785, "\n\n", false], [45, 0.017942, ",", false], [280, 0.011406, " -", false], [4932, 0.010541, " ·", false], [359, 0.010516, " |", false], [22907, 0.00919, " •", false], [275, 0.005888, " (", false], [4424, 0.005582, " at", false], [3328, 0.003885, "\n\n\n", false]]], "model_b": [11, 1, 0.6637576222419739, [[11, 0.663758, "\n", false], [261, 0.116362, "\n\n", false], [45, 0.037467, ",", false], [4424, 0.024256, " at", false], [359, 0.012481, " |", false], [22907, 0.009595, " •", false], [0, 0.008143, "[0]", false], [280, 0.007714, " -", false], [299, 0.003791, " @", false], [284, 0.003705, " 1", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17908959741507557}, {"byte_start": 45, "byte_end": 48, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 11, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"model_a": "15.12% 15.12% 15.12%", "model_b": "13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[6699, "The", "normal", 0.08107690513134003]], "model_b": [[6699, "The", "normal", 0.10210046172142029]]}, "loss": {"model_a": 15.121998800984576, "model_b": 13.713116925116447}, "topk": {"model_a": [6699, 1, 0.08107690513134003, [[6699, 0.081077, "The", false], [74, 0.04096, "I", false], [1136, 0.03956, "In", false], [24242, 0.029413, "This", false], [66, 0.024711, "A", false], [1141, 0.014467, "It", false], [35, 0.014443, "\"", false], [1589, 0.012034, "We", false], [24326, 0.011705, "What", false], [48743, 0.011603, "Summary", false]]], "model_b": [6699, 1, 0.10210046172142029, [[6699, 0.1021, "The", false], [1136, 0.041851, "In", false], [74, 0.027426, "I", false], [66, 0.027134, "A", false], [894, 0.018916, "By", false], [24327, 0.018687, "When", false], [1141, 0.016549, "It", false], [853, 0.015824, "As", false], [24242, 0.015213, "This", false], [33504, 0.014919, "There", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13221459741507557}, {"byte_start": 48, "byte_end": 56, "display": {"text": " biggest", "kind": "normal"}, "is_word": true, "word_id": 12, "word_key": " biggest", "bytes_hex": "20 62 69 67 67 65 73 74", "compression": {"model_a": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "model_b": "14.79% 14.79% 14.79% 14.79% 14.79% 14.79% 14.79% 14.79%"}, "model_tokens": {"model_a": [[51039, " biggest", "normal", 0.0012460439465939999]], "model_b": [[51039, " biggest", "normal", 0.0014241255121305585]]}, "loss": {"model_a": 15.075036071788972, "model_b": 14.793259696615346}, "topk": {"model_a": [51039, 78, 0.0012460439465939999, [[19523, 0.219893, " Bit", false], [30314, 0.013021, " book", false], [31461, 0.012643, " most", false], [59725, 0.012402, " following", false], [45315, 0.011792, " bitter", false], [46430, 0.011685, " lesson", false], [39966, 0.011423, " title", false], [21365, 0.010079, " bit", false], [39831, 0.009246, " story", false], [52569, 0.008596, " problem", false]]], "model_b": [51039, 62, 0.0014241255121305585, [[19523, 0.220535, " Bit", false], [45315, 0.017632, " bitter", false], [31461, 0.012267, " most", false], [21365, 0.011996, " bit", false], [39831, 0.009362, " story", false], [46430, 0.009235, " lesson", false], [38499, 0.006573, " first", false], [22903, 0.006563, " “", false], [31254, 0.006416, " last", false], [47014, 0.006059, " recent", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 56, "byte_end": 63, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 13, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%", "model_b": "4.27% 4.27% 4.27% 4.27% 4.27% 4.27% 4.27%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.15862658619880676]], "model_b": [[46430, " lesson", "normal", 0.1917613446712494]]}, "loss": {"model_a": 4.729817726128715, "model_b": 4.26689939548633}, "topk": {"model_a": [46430, 1, 0.15862658619880676, [[46430, 0.158627, " lesson", false], [52569, 0.092084, " problem", false], [59281, 0.053773, " challenge", false], [52245, 0.042922, " mistake", false], [47009, 0.029373, " reason", false], [56739, 0.023609, " obstacle", false], [39941, 0.01927, " thing", false], [31887, 0.018967, " risk", false], [47546, 0.011069, " threat", false], [52127, 0.010451, " lessons", false]]], "model_b": [46430, 1, 0.1917613446712494, [[46430, 0.191761, " lesson", false], [52569, 0.063724, " problem", false], [52245, 0.04675, " mistake", false], [39941, 0.040969, " thing", false], [59281, 0.035323, " challenge", false], [47546, 0.020079, " threat", false], [38809, 0.015631, " issue", false], [31514, 0.013613, " news", false], [32187, 0.013201, " take", false], [21265, 0.011063, " and", false]]]}, "raw_delta": 0.02566964285714285, "tuned_delta": 0.07975924027221844}, {"byte_start": 63, "byte_end": 68, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 14, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "9.58% 9.58% 9.58% 9.58% 9.58%", "model_b": "9.30% 9.30% 9.30% 9.30% 9.30%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.07134293019771576]], "model_b": [[32227, " that", "normal", 0.07561083883047104]]}, "loss": {"model_a": 9.580396755903271, "model_b": 9.298620380729647}, "topk": {"model_a": [32227, 3, 0.07134293019771576, [[308, 0.386223, " I", false], [4706, 0.107096, " of", false], [32227, 0.071343, " that", false], [4858, 0.06312, " we", false], [30917, 0.056591, " from", false], [4596, 0.049923, " in", false], [4811, 0.044091, " to", false], [22799, 0.033403, " you", false], [21700, 0.017966, " for", false], [4600, 0.013859, " is", false]]], "model_b": [32227, 5, 0.07561083883047104, [[308, 0.293648, " I", false], [4858, 0.120844, " we", false], [4706, 0.096622, " of", false], [30917, 0.077914, " from", false], [32227, 0.075611, " that", false], [4811, 0.037113, " to", false], [4596, 0.034125, " in", false], [4600, 0.024778, " is", false], [52112, 0.022758, " learned", false], [21700, 0.018998, " for", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 68, "byte_end": 72, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 15, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "15.92% 15.92% 15.92% 15.92%", "model_b": "17.33% 17.33% 17.33% 17.33%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.029297227039933205]], "model_b": [[21413, " can", "normal", 0.021276982501149178]]}, "loss": {"model_a": 15.920365197309849, "model_b": 17.329247073177978}, "topk": {"model_a": [21413, 7, 0.029297227039933205, [[308, 0.297925, " I", false], [52167, 0.06851, " machine", false], [3609, 0.05162, " AI", false], [22590, 0.036706, " the", false], [4858, 0.034413, " we", false], [61594, 0.029794, " artificial", false], [21413, 0.029297, " can", false], [332, 0.017781, " a", false], [22799, 0.017455, " you", false], [30597, 0.015215, " deep", false]]], "model_b": [21413, 5, 0.021276982501149178, [[308, 0.394986, " I", false], [4858, 0.113293, " we", false], [22590, 0.042331, " the", false], [38087, 0.040097, " comes", false], [21413, 0.021277, " can", false], [31461, 0.018156, " most", false], [22799, 0.018035, " you", false], [46787, 0.012317, " people", false], [30383, 0.011895, " came", false], [45178, 0.008748, " anyone", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.024035402584924412}, {"byte_start": 72, "byte_end": 75, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 16, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "0.73% 0.73% 0.73%", "model_b": "0.79% 0.79% 0.79%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.8857272863388062]], "model_b": [[4435, " be", "normal", 0.8764384388923645]]}, "loss": {"model_a": 0.7308574731065915, "model_b": 0.7866257140263715}, "topk": {"model_a": [4435, 1, 0.8857272863388062, [[4435, 0.885727, " be", false], [30482, 0.03963, " come", false], [31073, 0.010376, " help", false], [39903, 0.009478, " teach", false], [30789, 0.00811, " ever", false], [56896, 0.006009, " possibly", false], [28310, 0.002412, "’t", false], [461, 0.002379, "'t", false], [45846, 0.00181, " emerge", false], [31946, 0.001196, " save", false]]], "model_b": [4435, 1, 0.8764384388923645, [[4435, 0.876438, " be", false], [30482, 0.027921, " come", false], [39903, 0.012219, " teach", false], [30789, 0.010338, " ever", false], [28310, 0.006371, "’t", false], [31073, 0.003973, " help", false], [21265, 0.003401, " and", false], [46159, 0.003082, " happen", false], [47008, 0.002745, " really", false], [56896, 0.002634, " possibly", false]]]}, "raw_delta": -0.0030924479166666644, "tuned_delta": 0.050997149498408924}, {"byte_start": 75, "byte_end": 80, "display": {"text": " read", "kind": "normal"}, "is_word": true, "word_id": 17, "word_key": " read", "bytes_hex": "20 72 65 61 64", "compression": {"model_a": "26.15% 26.15% 26.15% 26.15% 26.15%", "model_b": "30.21% 30.21% 30.21% 30.21% 30.21%"}, "model_tokens": {"model_a": [[31834, " read", "normal", 0.0006952342810109258]], "model_b": [[31834, " read", "normal", 0.00022634358901996166]]}, "loss": {"model_a": 26.14884761611246, "model_b": 30.20642741861267}, "topk": {"model_a": [31834, 15, 0.0006952342810109258, [[52112, 0.718141, " learned", false], [38297, 0.112894, " drawn", false], [39887, 0.04311, " taken", false], [47512, 0.02621, " taught", false], [46418, 0.022067, " learnt", false], [21762, 0.018003, " gle", false], [51438, 0.01264, " derived", false], [59697, 0.010629, " extracted", false], [46071, 0.005063, " gained", false], [50937, 0.001483, " applied", false]]], "model_b": [31834, 56, 0.00022634358901996166, [[52112, 0.718347, " learned", false], [38297, 0.071769, " drawn", false], [47512, 0.035584, " taught", false], [39887, 0.034445, " taken", false], [46418, 0.028286, " learnt", false], [21762, 0.024337, " gle", false], [46071, 0.010733, " gained", false], [51438, 0.008607, " derived", false], [59697, 0.006532, " extracted", false], [50937, 0.004654, " applied", false]]]}, "raw_delta": -0.2250000000000001, "tuned_delta": -0.17091040258492451}, {"byte_start": 80, "byte_end": 85, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 18, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"model_a": "2.56% 2.56% 2.56% 2.56% 2.56%", "model_b": "1.20% 1.20% 1.20% 1.20% 1.20%"}, "model_tokens": {"model_a": [[30917, " from", "normal", 0.491812527179718]], "model_b": [[30917, " from", "normal", 0.7149670720100403]]}, "loss": {"model_a": 2.564165014079993, "model_b": 1.2045940038672498}, "topk": {"model_a": [30917, 1, 0.491812527179718, [[30917, 0.491813, " from", false], [31162, 0.325114, " into", false], [51035, 0.05571, " between", false], [4596, 0.047439, " in", false], [22249, 0.03067, " out", false], [22218, 0.006695, " off", false], [4450, 0.005362, " by", false], [4811, 0.003151, " to", false], [4712, 0.002252, " on", false], [11, 0.001954, "\n", false]]], "model_b": [30917, 1, 0.7149670720100403, [[30917, 0.714967, " from", false], [4596, 0.097086, " in", false], [31162, 0.037588, " into", false], [22249, 0.027044, " out", false], [37598, 0.024087, " about", false], [21265, 0.011847, " and", false], [4450, 0.009474, " by", false], [4712, 0.006235, " on", false], [53140, 0.005798, " through", false], [4600, 0.005277, " is", false]]]}, "raw_delta": 0.07539062499999999, "tuned_delta": 0.12948022241507556}, {"byte_start": 85, "byte_end": 88, "display": {"text": " 70", "kind": "normal"}, "is_word": true, "word_id": 19, "word_key": " 70", "bytes_hex": "20 37 30", "compression": {"model_a": "63.12% 63.12% 63.12%", "model_b": "66.12% 66.12% 66.12%"}, "model_tokens": {"model_a": [[3543, " 70", "normal", 2.7540681912796572e-05]], "model_b": [[3543, " 70", "normal", 1.7101432604249567e-05]]}, "loss": {"model_a": 63.11790803889214, "model_b": 66.12352270741081}, "topk": {"model_a": [3543, 1343, 2.7540681912796572e-05, [[22590, 0.397948, " the", false], [32234, 0.092111, " this", false], [332, 0.029461, " a", false], [44940, 0.016768, " Sutton", false], [28753, 0.015545, " Deep", false], [51929, 0.015387, " history", false], [3609, 0.014973, " AI", false], [4677, 0.014567, " my", false], [52167, 0.011005, " machine", false], [21256, 0.009521, " all", false]]], "model_b": [3543, 2400, 1.7101432604249567e-05, [[22590, 0.422966, " the", false], [32234, 0.122498, " this", false], [332, 0.028716, " a", false], [20996, 0.025583, " The", false], [51929, 0.023669, " history", false], [22903, 0.011191, " “", false], [22248, 0.00979, " our", false], [21273, 0.009624, " any", false], [57552, 0.008488, " watching", false], [21256, 0.008146, " all", false]]]}, "raw_delta": -0.16666666666666652, "tuned_delta": -0.11257706925159093}, {"byte_start": 88, "byte_end": 94, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 20, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"model_a": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94%", "model_b": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"model_a": [[40237, " years", "normal", 0.7334799766540527]], "model_b": [[40237, " years", "normal", 0.6282573938369751]]}, "loss": {"model_a": 0.9392545839120855, "model_b": 1.4206225581670293}, "topk": {"model_a": [40237, 1, 0.7334799766540527, [[40237, 0.73348, " years", false], [49, 0.083016, "0", false], [44, 0.033759, "+", false], [45, 0.019636, ",", false], [46, 0.019306, "-", false], [620, 0.016608, "00", false], [38, 0.015833, "%", false], [52232, 0.007649, " million", false], [116, 0.004217, "s", false], [51041, 0.004031, " billion", false]]], "model_b": [40237, 1, 0.6282573938369751, [[40237, 0.628257, " years", false], [49, 0.109079, "0", false], [45, 0.024265, ",", false], [620, 0.022521, "00", false], [38, 0.019764, "%", false], [52232, 0.017159, " million", false], [46, 0.0166, "-", false], [37583, 0.013984, " Years", false], [52238, 0.009422, " minutes", false], [44, 0.008507, "+", false]]]}, "raw_delta": -0.02669270833333334, "tuned_delta": 0.02739688908174225}, {"byte_start": 94, "byte_end": 97, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 21, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.25% 0.25% 0.25%", "model_b": "0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9601571559906006]], "model_b": [[4706, " of", "normal", 0.9345970153808594]]}, "loss": {"model_a": 0.2450867429895598, "model_b": 0.40798870988681213}, "topk": {"model_a": [4706, 1, 0.9601571559906006, [[4706, 0.960157, " of", false], [4596, 0.009767, " in", false], [40218, 0.005726, " worth", false], [9820, 0.003616, "’", false], [40, 0.00344, "'", false], [4715, 0.002236, " or", false], [21240, 0.00155, " ago", false], [21265, 0.001358, " and", false], [11, 0.001258, "\n", false], [32487, 0.00109, " with", false]]], "model_b": [4706, 1, 0.9345970153808594, [[4706, 0.934597, " of", false], [4596, 0.012373, " in", false], [21265, 0.005161, " and", false], [9820, 0.004905, "’", false], [40218, 0.004342, " worth", false], [4712, 0.00334, " on", false], [21240, 0.003203, " ago", false], [4600, 0.002566, " is", false], [37634, 0.00211, " after", false], [39690, 0.001953, " since", false]]]}, "raw_delta": -0.009033203125000002, "tuned_delta": 0.04505639429007559}, {"byte_start": 97, "byte_end": 100, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 22, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "9.16% 9.16% 9.16%", "model_b": "47.71% 47.71% 47.71%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.21808527410030365]], "model_b": [[3609, " AI", "normal", 0.00035615393426269293]]}, "loss": {"model_a": 9.157732193142833, "model_b": 47.71413286273394}, "topk": {"model_a": [3609, 1, 0.21808527410030365, [[3609, 0.218085, " AI", false], [61594, 0.101622, " artificial", false], [52167, 0.064662, " machine", false], [51929, 0.050904, " history", false], [59346, 0.042182, " computing", false], [55809, 0.034715, " computer", false], [57103, 0.033097, " research", false], [22590, 0.023331, " the", false], [56950, 0.017641, " progress", false], [61290, 0.015472, " Artificial", false]]], "model_b": [3609, 338, 0.00035615393426269293, [[57103, 0.059866, " research", false], [61979, 0.057594, " experience", false], [51929, 0.056688, " history", false], [22590, 0.042384, " the", false], [57396, 0.017133, " teaching", false], [31293, 0.014033, " life", false], [46946, 0.011315, " public", false], [57331, 0.011119, " studying", false], [54830, 0.010932, " American", false], [46456, 0.010306, " living", false]]]}, "raw_delta": -2.1380208333333335, "tuned_delta": -2.083931235918258}, {"byte_start": 100, "byte_end": 109, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 23, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "model_b": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.5041630268096924]], "model_b": [[57103, " research", "normal", 0.21367034316062927]]}, "loss": {"model_a": 1.3775733897377254, "model_b": 3.099540126909882}, "topk": {"model_a": [57103, 1, 0.5041630268096924, [[57103, 0.504163, " research", false], [4600, 0.147673, " is", false], [63469, 0.086549, " development", false], [56950, 0.071011, " progress", false], [51929, 0.057797, " history", false], [32499, 0.012227, " work", false], [21265, 0.006548, " and", false], [45, 0.006184, ",", false], [59, 0.005794, ":", false], [62183, 0.00323, " literature", false]]], "model_b": [57103, 1, 0.21367034316062927, [[57103, 0.21367, " research", false], [4600, 0.124507, " is", false], [63469, 0.068991, " development", false], [51929, 0.047575, " history", false], [21265, 0.035654, " and", false], [78, 0.030881, "M", false], [4596, 0.02689, " in", false], [45, 0.023199, ",", false], [61979, 0.017454, " experience", false], [85, 0.015811, "T", false]]]}, "raw_delta": -0.0954861111111111, "tuned_delta": -0.04139651369603552}, {"byte_start": 109, "byte_end": 112, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 24, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "1.34% 1.34% 1.34%", "model_b": "2.22% 2.22% 2.22%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.800688624382019]], "model_b": [[4600, " is", "normal", 0.6907477378845215]]}, "loss": {"model_a": 1.3384377820747217, "model_b": 2.218988954492302}, "topk": {"model_a": [4600, 1, 0.800688624382019, [[4600, 0.800689, " is", false], [45, 0.045093, ",", false], [59, 0.029849, ":", false], [21265, 0.016647, " and", false], [11, 0.007777, "\n", false], [275, 0.007463, " (", false], [4596, 0.007396, " in", false], [64, 0.004961, "?", false], [47, 0.004035, ".", false], [32227, 0.003329, " that", false]]], "model_b": [4600, 1, 0.6907477378845215, [[4600, 0.690748, " is", false], [21265, 0.064368, " and", false], [45, 0.048913, ",", false], [4424, 0.019643, " at", false], [21800, 0.016062, " has", false], [4596, 0.013981, " in", false], [32227, 0.012919, " that", false], [275, 0.006553, " (", false], [59, 0.005268, ":", false], [64, 0.004992, "?", false]]]}, "raw_delta": -0.048828125, "tuned_delta": 0.005261472415075588}, {"byte_start": 112, "byte_end": 117, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 25, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.85% 1.85% 1.85% 1.85% 1.85%", "model_b": "1.83% 1.83% 1.83% 1.83% 1.83%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.5976323485374451]], "model_b": [[32227, " that", "normal", 0.6009541749954224]]}, "loss": {"model_a": 1.8456352573872479, "model_b": 1.8315464386285667}, "topk": {"model_a": [32227, 1, 0.5976323485374451, [[32227, 0.597632, " that", false], [32234, 0.139602, " this", false], [22187, 0.042725, " not", false], [59, 0.036704, ":", false], [22590, 0.035134, " the", false], [332, 0.011383, " a", false], [4811, 0.009509, " to", false], [21835, 0.008283, " how", false], [45, 0.007729, ",", false], [269, 0.006636, " \"", false]]], "model_b": [32227, 1, 0.6009541749954224, [[32227, 0.600954, " that", false], [32234, 0.089134, " this", false], [22590, 0.063231, " the", false], [59, 0.045194, ":", false], [4811, 0.032695, " to", false], [22226, 0.015156, " one", false], [22187, 0.014742, " not", false], [22903, 0.013954, " “", false], [21835, 0.009658, " how", false], [45, 0.009101, ",", false]]]}, "raw_delta": 0.0007812499999999972, "tuned_delta": 0.054870847415075585}, {"byte_start": 117, "byte_end": 125, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 26, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.0019046157831326127]], "model_b": [[51832, " general", "normal", 0.0003328181046526879]]}, "loss": {"model_a": 14.088818758681281, "model_b": 18.03368801111204}, "topk": {"model_a": [51832, 69, 0.0019046157831326127, [[22590, 0.104384, " the", false], [4601, 0.10392, " it", false], [4858, 0.056042, " we", false], [3609, 0.054266, " AI", false], [39934, 0.032553, " there", false], [45, 0.027136, ",", false], [22799, 0.021851, " you", false], [56950, 0.021794, " progress", false], [269, 0.018809, " \"", false], [4588, 0.018808, " if", false]]], "model_b": [51832, 244, 0.0003328181046526879, [[22590, 0.095881, " the", false], [4858, 0.090017, " we", false], [3609, 0.079867, " AI", false], [4601, 0.072226, " it", false], [39934, 0.031943, " there", false], [22799, 0.02897, " you", false], [22903, 0.019063, " “", false], [332, 0.016151, " a", false], [46227, 0.01607, " humans", false], [45, 0.014906, ",", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 125, "byte_end": 133, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 27, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "model_b": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.0059340461157262325]], "model_b": [[52224, " methods", "normal", 0.0010102905798703432]]}, "loss": {"model_a": 11.55283138211865, "model_b": 15.568144728342816}, "topk": {"model_a": [52224, 13, 0.0059340461157262325, [[64452, 0.322388, " intelligence", false], [3609, 0.237909, " AI", false], [46, 0.129946, "-", false], [61594, 0.064977, " artificial", false], [52610, 0.041545, " purpose", false], [45, 0.022353, ",", false], [7919, 0.019636, "ist", false], [7933, 0.012819, "ity", false], [63659, 0.010023, " intelligent", false], [52167, 0.009209, " machine", false]]], "model_b": [52224, 42, 0.0010102905798703432, [[3609, 0.25423, " AI", false], [64452, 0.233024, " intelligence", false], [46, 0.082612, "-", false], [34932, 0.079748, "izing", false], [61594, 0.069661, " artificial", false], [52610, 0.067648, " purpose", false], [52167, 0.018234, " machine", false], [56537, 0.016246, " learning", false], [7933, 0.010727, "ity", false], [45, 0.007886, ",", false]]]}, "raw_delta": -0.22265625, "tuned_delta": -0.16856665258492443}, {"byte_start": 133, "byte_end": 138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 28, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99% 10.99%", "model_b": "12.51% 12.51% 12.51% 12.51% 12.51%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.04722457751631737]], "model_b": [[32227, " that", "normal", 0.03054685704410076]]}, "loss": {"model_a": 10.9892786317714, "model_b": 12.510871057708977}, "topk": {"model_a": [32227, 4, 0.04722457751631737, [[21286, 0.158583, " are", false], [21700, 0.137361, " for", false], [4706, 0.104041, " of", false], [32227, 0.047225, " that", false], [21265, 0.044263, " and", false], [21413, 0.039054, " can", false], [21556, 0.03469, " don", false], [32475, 0.034499, " will", false], [45, 0.029011, ",", false], [4491, 0.0267, " do", false]]], "model_b": [32227, 7, 0.03054685704410076, [[21286, 0.209222, " are", false], [4706, 0.124202, " of", false], [21700, 0.118055, " for", false], [21413, 0.051991, " can", false], [32499, 0.040053, " work", false], [21265, 0.030913, " and", false], [32227, 0.030547, " that", false], [21556, 0.028471, " don", false], [4491, 0.026241, " do", false], [45, 0.026097, ",", false]]]}, "raw_delta": -0.08437499999999998, "tuned_delta": -0.03028540258492439}, {"byte_start": 138, "byte_end": 147, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 29, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"model_a": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%", "model_b": "14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34%"}, "model_tokens": {"model_a": [[56540, " leverage", "normal", 0.0007237948011606932]], "model_b": [[56540, " leverage", "normal", 0.0007704097661189735]]}, "loss": {"model_a": 14.464520592246116, "model_b": 14.339286647724503}, "topk": {"model_a": [56540, 96, 0.0007237948011606932, [[32499, 0.409284, " work", false], [21286, 0.063323, " are", false], [31967, 0.047712, " seem", false], [31059, 0.02765, " have", false], [31324, 0.027242, " look", false], [21413, 0.023612, " can", false], [45185, 0.01999, " appear", false], [32462, 0.013896, " were", false], [39740, 0.01338, " solve", false], [53051, 0.013376, " succeed", false]]], "model_b": [56540, 105, 0.0007704097661189735, [[32499, 0.313023, " work", false], [21286, 0.106157, " are", false], [31059, 0.048272, " have", false], [21413, 0.043895, " can", false], [31358, 0.017772, " make", false], [52573, 0.014921, " produce", false], [32462, 0.013889, " were", false], [39740, 0.013545, " solve", false], [21751, 0.011041, " get", false], [47812, 0.01085, " worked", false]]]}, "raw_delta": 0.006944444444444531, "tuned_delta": 0.06103404185952012}, {"byte_start": 147, "byte_end": 159, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 30, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97%", "model_b": "10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52% 10.52%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.002536177635192871]], "model_b": [[63370, " computation", "normal", 0.0009243216481991112]]}, "loss": {"model_a": 8.969881276360415, "model_b": 10.519651339815356}, "topk": {"model_a": [63370, 65, 0.002536177635192871, [[22590, 0.130945, " the", false], [30597, 0.045286, " deep", false], [63885, 0.044737, " statistical", false], [332, 0.031537, " a", false], [30579, 0.027136, " data", false], [52167, 0.023547, " machine", false], [38864, 0.02346, " large", false], [52195, 0.022602, " massive", false], [55465, 0.019176, " advances", false], [38720, 0.019159, " human", false]]], "model_b": [63370, 134, 0.0009243216481991112, [[22590, 0.111544, " the", false], [38864, 0.075627, " large", false], [332, 0.052737, " a", false], [30579, 0.030986, " data", false], [52167, 0.029087, " machine", false], [51832, 0.024394, " general", false], [30597, 0.024189, " deep", false], [38720, 0.022122, " human", false], [52195, 0.02185, " massive", false], [63885, 0.01586, " statistical", false]]]}, "raw_delta": -0.08593750000000004, "tuned_delta": -0.031847902584924453}, {"byte_start": 159, "byte_end": 163, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 31, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "9.09% 9.09% 9.09% 9.09%", "model_b": "9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.13226008415222168]], "model_b": [[21286, " are", "normal", 0.13138771057128906]]}, "loss": {"model_a": 9.087288099349427, "model_b": 9.157732193142833}, "topk": {"model_a": [21286, 3, 0.13226008415222168, [[4811, 0.149732, " to", false], [21265, 0.141678, " and", false], [21286, 0.13226, " are", false], [32475, 0.041961, " will", false], [45, 0.040492, ",", false], [4596, 0.035777, " in", false], [21413, 0.034579, " can", false], [39339, 0.033575, " power", false], [31059, 0.03172, " have", false], [4491, 0.016033, " do", false]]], "model_b": [21286, 3, 0.13138771057128906, [[4811, 0.193564, " to", false], [21265, 0.189561, " and", false], [21286, 0.131388, " are", false], [21413, 0.051587, " can", false], [45, 0.044893, ",", false], [21700, 0.030807, " for", false], [39339, 0.026555, " power", false], [4491, 0.022584, " do", false], [275, 0.021956, " (", false], [4712, 0.019071, " on", false]]]}, "raw_delta": -0.00390625, "tuned_delta": 0.05018334741507559}, {"byte_start": 163, "byte_end": 174, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 32, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"model_a": "9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38%", "model_b": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84% 7.84%"}, "model_tokens": {"model_a": [[62676, " ultimately", "normal", 0.0032697974238544703]], "model_b": [[62676, " ultimately", "normal", 0.008340721018612385]]}, "loss": {"model_a": 9.375468483049724, "model_b": 7.838506436648131}, "topk": {"model_a": [62676, 53, 0.0032697974238544703, [[22590, 0.120008, " the", false], [22187, 0.062472, " not", false], [31458, 0.057449, " more", false], [46439, 0.040575, " likely", false], [31466, 0.038421, " much", false], [21660, 0.037073, " far", false], [332, 0.028238, " a", false], [38606, 0.027552, " going", false], [45145, 0.020359, " almost", false], [45301, 0.020349, " better", false]]], "model_b": [62676, 25, 0.008340721018612385, [[22187, 0.217726, " not", false], [39171, 0.034031, " often", false], [332, 0.025979, " a", false], [64916, 0.022368, " fundamentally", false], [59758, 0.021077, " generally", false], [45301, 0.019983, " better", false], [31581, 0.019241, " only", false], [62117, 0.018877, " inherently", false], [4692, 0.017443, " no", false], [22590, 0.0165, " the", false]]]}, "raw_delta": 0.08522727272727275, "tuned_delta": 0.13931687014234834}, {"byte_start": 174, "byte_end": 178, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 33, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "9.79% 9.79% 9.79% 9.79%", "model_b": "19.30% 19.30% 19.30% 19.30%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.11399377882480621]], "model_b": [[22590, " the", "normal", 0.013834351673722267]]}, "loss": {"model_a": 9.79172903728349, "model_b": 19.301681699393356}, "topk": {"model_a": [22590, 2, 0.11399377882480621, [[31458, 0.160758, " more", false], [22590, 0.113994, " the", false], [45301, 0.055493, " better", false], [38606, 0.047442, " going", false], [45781, 0.043193, " doomed", false], [31466, 0.035475, " much", false], [31277, 0.033992, " less", false], [52140, 0.033616, " limited", false], [22187, 0.029268, " not", false], [57350, 0.027639, " superior", false]]], "model_b": [22590, 17, 0.013834351673722267, [[22187, 0.115123, " not", false], [22525, 0.048876, " sub", false], [52140, 0.047028, " limited", false], [31277, 0.041075, " less", false], [45781, 0.031913, " doomed", false], [56445, 0.028525, " inferior", false], [31458, 0.027171, " more", false], [63631, 0.023184, " ineffective", false], [21325, 0.022757, " bad", false], [53247, 0.022537, " useless", false]]]}, "raw_delta": -0.52734375, "tuned_delta": -0.4732541525849244}, {"byte_start": 178, "byte_end": 183, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 34, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "3.63% 3.63% 3.63% 3.63% 3.63%", "model_b": "5.41% 5.41% 5.41% 5.41% 5.41%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.35932987928390503]], "model_b": [[31461, " most", "normal", 0.2244265377521515]]}, "loss": {"model_a": 3.634915239739771, "model_b": 5.410106403333612}, "topk": {"model_a": [31461, 1, 0.35932987928390503, [[31461, 0.35933, " most", false], [30273, 0.174263, " best", false], [31581, 0.123636, " only", false], [22752, 0.088107, " way", false], [21952, 0.051324, " key", false], [31580, 0.019204, " ones", false], [31637, 0.015273, " path", false], [39523, 0.011476, " right", false], [38879, 0.007943, " least", false], [51900, 0.006363, " hardest", false]]], "model_b": [31461, 1, 0.2244265377521515, [[31461, 0.224427, " most", false], [30273, 0.131602, " best", false], [40229, 0.101791, " wrong", false], [38879, 0.0547, " least", false], [31937, 0.052168, " same", false], [32449, 0.047363, " weak", false], [40217, 0.041684, " worst", false], [31581, 0.025357, " only", false], [22752, 0.015987, " way", false], [39523, 0.008448, " right", false]]]}, "raw_delta": -0.09843749999999998, "tuned_delta": -0.044347902584924395}, {"byte_start": 183, "byte_end": 193, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 35, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"model_a": "3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49%", "model_b": "3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32% 3.32%"}, "model_tokens": {"model_a": [[59593, " effective", "normal", 0.14336887001991272]], "model_b": [[59593, " effective", "normal", 0.15985460579395294]]}, "loss": {"model_a": 3.4940270521529584, "model_b": 3.324961227048782}, "topk": {"model_a": [59593, 2, 0.14336887001991272, [[56900, 0.390074, " powerful", false], [59593, 0.143369, " effective", false], [60274, 0.102955, " promising", false], [59829, 0.102474, " important", false], [47687, 0.047406, " useful", false], [62603, 0.030807, " successful", false], [59594, 0.020389, " efficient", false], [56290, 0.020055, " fruitful", false], [47129, 0.013589, " robust", false], [57516, 0.012725, " valuable", false]]], "model_b": [59593, 2, 0.15985460579395294, [[56900, 0.254533, " powerful", false], [59593, 0.159855, " effective", false], [59594, 0.068102, " efficient", false], [59829, 0.055225, " important", false], [47687, 0.040186, " useful", false], [57516, 0.0271, " valuable", false], [62603, 0.026859, " successful", false], [60274, 0.022403, " promising", false], [59516, 0.016303, " difficult", false], [57075, 0.015805, " reliable", false]]]}, "raw_delta": 0.009374999999999994, "tuned_delta": 0.06346459741507558}, {"byte_start": 193, "byte_end": 194, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "48.18%", "model_b": "53.26%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.06937381625175476]], "model_b": [[45, ",", "normal", 0.051931943744421005]]}, "loss": {"model_a": 48.183760154689985, "model_b": 53.255734907815246}, "topk": {"model_a": [45, 3, 0.06937381625175476, [[47, 0.354282, ".", false], [22752, 0.212705, " way", false], [45, 0.069374, ",", false], [21700, 0.042457, " for", false], [21265, 0.039353, " and", false], [55532, 0.036333, " approach", false], [4424, 0.027216, " at", false], [31580, 0.024867, " ones", false], [32448, 0.020431, " ways", false], [39979, 0.015784, " tools", false]]], "model_b": [45, 3, 0.051931943744421005, [[22752, 0.250825, " way", false], [47, 0.238859, ".", false], [45, 0.051932, ",", false], [32448, 0.050986, " ways", false], [21265, 0.043598, " and", false], [21700, 0.04179, " for", false], [55532, 0.030406, " approach", false], [39979, 0.025233, " tools", false], [52224, 0.022046, " methods", false], [4596, 0.019013, " in", false]]]}, "raw_delta": -0.28125, "tuned_delta": -0.22716040258492443}, {"byte_start": 194, "byte_end": 198, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 36, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "5.42% 5.42% 5.42% 5.42%", "model_b": "6.80% 6.80% 6.80% 6.80%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.3004497289657593]], "model_b": [[21265, " and", "normal", 0.2203141450881958]]}, "loss": {"model_a": 5.424195222092293, "model_b": 6.797855051063719}, "topk": {"model_a": [21265, 1, 0.3004497289657593, [[21265, 0.30045, " and", false], [21400, 0.151419, " but", false], [40187, 0.091621, " while", false], [30788, 0.060656, " even", false], [22187, 0.02638, " not", false], [53339, 0.017655, " whereas", false], [51018, 0.015803, " because", false], [61953, 0.015454, " especially", false], [4423, 0.015271, " as", false], [51450, 0.012333, " despite", false]]], "model_b": [21265, 1, 0.2203141450881958, [[21265, 0.220314, " and", false], [21400, 0.117667, " but", false], [30788, 0.075319, " even", false], [40187, 0.04933, " while", false], [62461, 0.039453, " regardless", false], [22187, 0.038911, " not", false], [4423, 0.027971, " as", false], [4692, 0.026028, " no", false], [61953, 0.022519, " especially", false], [51018, 0.022118, " because", false]]]}, "raw_delta": -0.076171875, "tuned_delta": -0.022082277584924412}, {"byte_start": 198, "byte_end": 201, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 37, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "38.32% 38.32% 38.32%", "model_b": "39.45% 39.45% 39.45%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.001680772635154426]], "model_b": [[4450, " by", "normal", 0.001388857839629054]]}, "loss": {"model_a": 38.321587023613084, "model_b": 39.44869252430759}, "topk": {"model_a": [4450, 55, 0.001680772635154426, [[32227, 0.390343, " that", false], [22590, 0.074397, " the", false], [32232, 0.029054, " they", false], [4858, 0.019176, " we", false], [4601, 0.014805, " it", false], [4788, 0.01335, " so", false], [4596, 0.010892, " in", false], [32239, 0.010173, " thus", false], [31461, 0.009507, " most", false], [32234, 0.009465, " this", false]]], "model_b": [4450, 68, 0.001388857839629054, [[32227, 0.293956, " that", false], [22590, 0.123588, " the", false], [32232, 0.032504, " they", false], [21286, 0.024883, " are", false], [4858, 0.017577, " we", false], [21413, 0.015593, " can", false], [39934, 0.015364, " there", false], [39171, 0.014059, " often", false], [22187, 0.013068, " not", false], [47266, 0.013027, " should", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.008410402584924412}, {"byte_start": 201, "byte_end": 203, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 38, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "17.82% 17.82%", "model_b": "39.45% 39.45%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.13725578784942627]], "model_b": [[332, " a", "normal", 0.012435732409358025]]}, "loss": {"model_a": 17.82235572973182, "model_b": 39.44869252430759}, "topk": {"model_a": [332, 2, 0.13725578784942627, [[21660, 0.43749, " far", false], [332, 0.137256, " a", false], [59695, 0.057826, " extension", false], [22590, 0.019556, " the", false], [63617, 0.019521, " implication", false], [22190, 0.019466, " now", false], [21265, 0.014707, " and", false], [55856, 0.013896, " contrast", false], [38888, 0.011271, " lever", false], [32234, 0.010589, " this", false]]], "model_b": [332, 10, 0.012435732409358025, [[59695, 0.444996, " extension", false], [21660, 0.117038, " far", false], [31461, 0.045813, " most", false], [4692, 0.032471, " no", false], [22590, 0.027286, " the", false], [45717, 0.016046, " design", false], [59856, 0.014158, " inference", false], [61822, 0.013947, " definition", false], [21256, 0.013116, " all", false], [332, 0.012436, " a", false]]]}, "raw_delta": -1.19921875, "tuned_delta": -1.1451291525849243}, {"byte_start": 203, "byte_end": 209, "display": {"text": " large", "kind": "normal"}, "is_word": true, "word_id": 39, "word_key": " large", "bytes_hex": "20 6c 61 72 67 65", "compression": {"model_a": "5.10% 5.10% 5.10% 5.10% 5.10% 5.10%", "model_b": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93%"}, "model_tokens": {"model_a": [[38864, " large", "normal", 0.18366272747516632]], "model_b": [[38864, " large", "normal", 0.19559744000434875]]}, "loss": {"model_a": 5.095456117723063, "model_b": 4.931086565538449}, "topk": {"model_a": [38864, 2, 0.18366272747516632, [[32470, 0.397292, " wide", false], [38864, 0.183663, " large", false], [31323, 0.096898, " long", false], [31118, 0.093839, " huge", false], [32386, 0.053658, " very", false], [22031, 0.027433, " lot", false], [63870, 0.019972, " significant", false], [64313, 0.013458, " considerable", false], [21357, 0.012689, " big", false], [63893, 0.009749, " substantial", false]]], "model_b": [38864, 2, 0.19559744000434875, [[31323, 0.23635, " long", false], [38864, 0.195597, " large", false], [32470, 0.13022, " wide", false], [63870, 0.063665, " significant", false], [22031, 0.057519, " lot", false], [32386, 0.055733, " very", false], [31118, 0.024442, " huge", false], [64313, 0.021317, " considerable", false], [45950, 0.019903, " factor", false], [45954, 0.014321, " fairly", false]]]}, "raw_delta": 0.009114583333333315, "tuned_delta": 0.0632041807484089}, {"byte_start": 209, "byte_end": 216, "display": {"text": " margin", "kind": "normal"}, "is_word": true, "word_id": 40, "word_key": " margin", "bytes_hex": "20 6d 61 72 67 69 6e", "compression": {"model_a": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%", "model_b": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%"}, "model_tokens": {"model_a": [[46513, " margin", "normal", 0.9230954051017761]], "model_b": [[46513, " margin", "normal", 0.9432636499404907]]}, "loss": {"model_a": 0.20630056039497588, "model_b": 0.15032266443414405}, "topk": {"model_a": [46513, 1, 0.9230954051017761, [[46513, 0.923095, " margin", false], [45950, 0.014245, " factor", false], [45157, 0.014148, " amount", false], [39189, 0.013748, " order", false], [45690, 0.005961, " degree", false], [56024, 0.005351, " distance", false], [61863, 0.002691, " difference", false], [21732, 0.002382, " gap", false], [45865, 0.001953, " enough", false], [52208, 0.001923, " measure", false]]], "model_b": [46513, 1, 0.9432636499404907, [[46513, 0.943264, " margin", false], [45157, 0.015223, " amount", false], [45690, 0.009404, " degree", false], [45950, 0.004679, " factor", false], [45, 0.002988, ",", false], [52208, 0.002415, " measure", false], [45865, 0.002124, " enough", false], [45939, 0.001674, " extent", false], [56573, 0.00163, " majority", false], [52186, 0.001325, " margins", false]]]}, "raw_delta": 0.0031040736607142842, "tuned_delta": 0.057193671075789876}, {"byte_start": 216, "byte_end": 217, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "2.25%", "model_b": "4.61%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8820807337760925]], "model_b": [[47, ".", "normal", 0.7725769281387329]]}, "loss": {"model_a": 2.254211001389005, "model_b": 4.61408814346812}, "topk": {"model_a": [47, 1, 0.8820807337760925, [[47, 0.882081, ".", false], [45, 0.056219, ",", false], [59, 0.012809, ":", false], [275, 0.005843, " (", false], [60, 0.005022, ";", false], [11, 0.004298, "\n", false], [31601, 0.002773, " over", false], [9816, 0.002703, "—", false], [22590, 0.002614, " the", false], [34, 0.002302, "!", false]]], "model_b": [47, 1, 0.7725769281387329, [[47, 0.772577, ".", false], [45, 0.163213, ",", false], [22590, 0.013378, " the", false], [59, 0.006773, ":", false], [22898, 0.002667, " —", false], [32227, 0.002532, " that", false], [60, 0.00243, ";", false], [275, 0.002342, " (", false], [11, 0.002097, "\n", false], [31601, 0.001863, " over", false]]]}, "raw_delta": -0.130859375, "tuned_delta": -0.07676977758492441}, {"byte_start": 217, "byte_end": 221, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 41, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55%", "model_b": "12.12% 12.12% 12.12% 12.12%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.07694127410650253]], "model_b": [[20996, " The", "normal", 0.06753067672252655]]}, "loss": {"model_a": 11.55283138211865, "model_b": 12.116384132465903}, "topk": {"model_a": [20996, 2, 0.07694127410650253, [[11, 0.224108, "\n", false], [20996, 0.076941, " The", false], [29894, 0.071442, " This", false], [261, 0.058636, "\n\n", false], [3913, 0.035882, " In", false], [19555, 0.028653, " But", false], [3918, 0.021731, " It", false], [29889, 0.020379, " That", false], [37451, 0.016261, " There", false], [4331, 0.015068, " We", false]]], "model_b": [20996, 3, 0.06753067672252655, [[11, 0.243319, "\n", false], [29894, 0.084448, " This", false], [20996, 0.067531, " The", false], [3913, 0.046246, " In", false], [261, 0.022813, "\n\n", false], [19555, 0.02069, " But", false], [29889, 0.019316, " That", false], [3609, 0.018169, " AI", false], [4331, 0.017245, " We", false], [3918, 0.015961, " It", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 221, "byte_end": 230, "display": {"text": " ultimate", "kind": "normal"}, "is_word": true, "word_id": 42, "word_key": " ultimate", "bytes_hex": "20 75 6c 74 69 6d 61 74 65", "compression": {"model_a": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "model_b": "13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21%"}, "model_tokens": {"model_a": [[57481, " ultimate", "normal", 0.0008178133866749704]], "model_b": [[57481, " ultimate", "normal", 0.0013890094123780727]]}, "loss": {"model_a": 14.214052703202896, "model_b": 13.212181147030002}, "topk": {"model_a": [57481, 205, 0.0008178133866749704, [[31461, 0.033933, " most", false], [39193, 0.033696, " other", false], [47205, 0.030411, " second", false], [3609, 0.018932, " AI", false], [31581, 0.017685, " only", false], [46430, 0.017439, " lesson", false], [30273, 0.015236, " best", false], [47009, 0.01198, " reason", false], [38499, 0.011897, " first", false], [51929, 0.010594, " history", false]]], "model_b": [57481, 120, 0.0013890094123780727, [[31461, 0.033931, " most", false], [31581, 0.023434, " only", false], [30273, 0.020756, " best", false], [47009, 0.018466, " reason", false], [52569, 0.016887, " problem", false], [3609, 0.016807, " AI", false], [31458, 0.014114, " more", false], [39193, 0.013615, " other", false], [38499, 0.011552, " first", false], [51039, 0.011156, " biggest", false]]]}, "raw_delta": 0.05555555555555558, "tuned_delta": 0.10964515297063117}, {"byte_start": 230, "byte_end": 237, "display": {"text": " reason", "kind": "normal"}, "is_word": true, "word_id": 43, "word_key": " reason", "bytes_hex": "20 72 65 61 73 6f 6e", "compression": {"model_a": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%", "model_b": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"model_a": [[47009, " reason", "normal", 0.018070142716169357]], "model_b": [[47009, " reason", "normal", 0.013261908665299416]]}, "loss": {"model_a": 10.304964577778307, "model_b": 11.110039935417243}, "topk": {"model_a": [47009, 6, 0.018070142716169357, [[46430, 0.213371, " lesson", false], [30985, 0.0703, " goal", false], [32223, 0.023901, " test", false], [53052, 0.021456, " success", false], [39365, 0.021441, " proof", false], [47009, 0.01807, " reason", false], [51668, 0.017161, " example", false], [57009, 0.014925, " question", false], [3609, 0.014616, " AI", false], [22269, 0.012595, " pay", false]]], "model_b": [47009, 10, 0.013261908665299416, [[30985, 0.18847, " goal", false], [46430, 0.053679, " lesson", false], [53052, 0.027886, " success", false], [57009, 0.020206, " question", false], [40093, 0.019083, " value", false], [32223, 0.018961, " test", false], [39339, 0.018817, " power", false], [59281, 0.018468, " challenge", false], [52569, 0.014158, " problem", false], [47009, 0.013262, " reason", false]]]}, "raw_delta": -0.044642857142857206, "tuned_delta": 0.009446740272218382}, {"byte_start": 237, "byte_end": 241, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 44, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "6.09% 6.09% 6.09% 6.09%", "model_b": "3.03% 3.03% 3.03% 3.03%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.2587900459766388]], "model_b": [[21700, " for", "normal", 0.5107178092002869]]}, "loss": {"model_a": 6.093414113129654, "model_b": 3.029096033116476}, "topk": {"model_a": [21700, 2, 0.2587900459766388, [[32227, 0.277901, " that", false], [21700, 0.25879, " for", false], [22763, 0.09179, " why", false], [4600, 0.074122, " is", false], [4858, 0.051622, " we", false], [4811, 0.046548, " to", false], [3609, 0.032191, " AI", false], [32234, 0.023367, " this", false], [22590, 0.019209, " the", false], [45290, 0.008831, " behind", false]]], "model_b": [21700, 1, 0.5107178092002869, [[21700, 0.510718, " for", false], [4600, 0.205497, " is", false], [22763, 0.067882, " why", false], [32227, 0.053406, " that", false], [45290, 0.022385, " behind", false], [4811, 0.016073, " to", false], [32234, 0.014104, " this", false], [4858, 0.01114, " we", false], [45, 0.010105, ",", false], [3609, 0.00923, " AI", false]]]}, "raw_delta": 0.169921875, "tuned_delta": 0.22401147241507557}, {"byte_start": 241, "byte_end": 246, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 45, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "2.80% 2.80% 2.80% 2.80% 2.80%", "model_b": "0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.4604005217552185]], "model_b": [[32234, " this", "normal", 0.7727261185646057]]}, "loss": {"model_a": 2.8036749329775748, "model_b": 0.9228176286936239}, "topk": {"model_a": [32234, 1, 0.4604005217552185, [[32234, 0.460401, " this", false], [22590, 0.238819, " the", false], [32227, 0.073167, " that", false], [3609, 0.033307, " AI", false], [53052, 0.016651, " success", false], [22248, 0.010162, " our", false], [21256, 0.007483, " all", false], [56950, 0.006149, " progress", false], [4677, 0.004905, " my", false], [39936, 0.00456, " these", false]]], "model_b": [32234, 1, 0.7727261185646057, [[32234, 0.772726, " this", false], [32227, 0.059621, " that", false], [22590, 0.054127, " the", false], [3609, 0.008292, " AI", false], [39936, 0.007123, " these", false], [39931, 0.005956, " their", false], [53052, 0.005476, " success", false], [40085, 0.003288, " using", false], [22763, 0.00301, " why", false], [22248, 0.002843, " our", false]]]}, "raw_delta": 0.10429687499999998, "tuned_delta": 0.15838647241507559}, {"byte_start": 246, "byte_end": 249, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 46, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "1.70% 1.70% 1.70%", "model_b": "2.28% 2.28% 2.28%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.75510174036026]], "model_b": [[4600, " is", "normal", 0.680104672908783]]}, "loss": {"model_a": 1.702398933340655, "model_b": 2.2776923659868076}, "topk": {"model_a": [4600, 1, 0.75510174036026, [[4600, 0.755102, " is", false], [45, 0.028254, ",", false], [53052, 0.021732, " success", false], [46430, 0.012572, " lesson", false], [31291, 0.011227, " lies", false], [21800, 0.011028, " has", false], [22748, 0.008541, " was", false], [47092, 0.007684, " result", false], [30808, 0.006521, " fact", false], [21413, 0.006098, " can", false]]], "model_b": [4600, 1, 0.680104672908783, [[4600, 0.680105, " is", false], [45, 0.027816, ",", false], [61735, 0.025626, " conclusion", false], [38087, 0.019373, " comes", false], [53052, 0.017097, " success", false], [31291, 0.013708, " lies", false], [21800, 0.009314, " has", false], [22748, 0.008702, " was", false], [21413, 0.006412, " can", false], [63729, 0.006337, " observation", false]]]}, "raw_delta": -0.03190104166666667, "tuned_delta": 0.022188555748408917}, {"byte_start": 249, "byte_end": 255, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 47, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"model_a": "20.66% 20.66% 20.66% 20.66% 20.66% 20.66%", "model_b": "25.55% 25.55% 25.55% 25.55% 25.55% 25.55%"}, "model_tokens": {"model_a": [[37045, " Moore", "normal", 0.0010319792199879885]], "model_b": [[37045, " Moore", "normal", 0.00020921749819535762]]}, "loss": {"model_a": 20.66360084606588, "model_b": 25.547724682408727}, "topk": {"model_a": [37045, 43, 0.0010319792199879885, [[32227, 0.64783, " that", false], [22590, 0.066861, " the", false], [51018, 0.038809, " because", false], [47284, 0.03059, " simple", false], [22187, 0.017243, " not", false], [47285, 0.015204, " simply", false], [332, 0.013898, " a", false], [45, 0.008819, ",", false], [56937, 0.004951, " probably", false], [4706, 0.004746, " of", false]]], "model_b": [37045, 146, 0.00020921749819535762, [[32227, 0.598319, " that", false], [22590, 0.113234, " the", false], [47284, 0.042415, " simple", false], [51018, 0.023947, " because", false], [22187, 0.016884, " not", false], [332, 0.015546, " a", false], [22638, 0.008627, " two", false], [47285, 0.007558, " simply", false], [62555, 0.005519, " simplicity", false], [21572, 0.005444, " due", false]]]}, "raw_delta": -0.2708333333333335, "tuned_delta": -0.2167437359182579}, {"byte_start": 255, "byte_end": 257, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 48, "word_key": "'s", "bytes_hex": "27 73", "compression": {"model_a": "6.62% 6.62%", "model_b": "10.07% 10.07%"}, "model_tokens": {"model_a": [[460, "'s", "normal", 0.48003950715065]], "model_b": [[460, "'s", "normal", 0.3261600434780121]]}, "loss": {"model_a": 6.621744816580202, "model_b": 10.073505412457116}, "topk": {"model_a": [460, 2, 0.48003950715065, [[28309, 0.510863, "’s", false], [460, 0.48004, "'s", false], [116, 0.005299, "s", false], [45, 0.000361, ",", false], [21265, 0.000338, " and", false], [9819, 0.000336, "‘", false], [2496, 0.000312, "â", false], [46, 0.000228, "-", false], [47, 0.00013, ".", false], [9222, 0.000128, "´s", false]]], "model_b": [460, 2, 0.3261600434780121, [[28309, 0.669668, "’s", false], [460, 0.32616, "'s", false], [116, 0.001549, "s", false], [9819, 0.000279, "‘", false], [46, 0.000256, "-", false], [45, 0.000179, ",", false], [2496, 0.000162, "â", false], [21265, 0.000144, " and", false], [9222, 0.000129, "´s", false], [9825, 7.3e-05, "‟", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13731665258492443}, {"byte_start": 257, "byte_end": 261, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 49, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"model_a": "4.39% 4.39% 4.39% 4.39%", "model_b": "5.14% 5.14% 5.14% 5.14%"}, "model_tokens": {"model_a": [[21988, " law", "normal", 0.3774595856666565]], "model_b": [[21988, " law", "normal", 0.31862205266952515]]}, "loss": {"model_a": 4.385144838639549, "model_b": 5.142418846918668}, "topk": {"model_a": [21988, 2, 0.3774595856666565, [[20267, 0.617231, " Law", false], [21988, 0.37746, " law", false], [21265, 0.000485, " and", false], [45958, 0.000474, " famous", false], [275, 0.000372, " (", false], [47205, 0.000313, " second", false], [31259, 0.000256, " laws", false], [29262, 0.000249, " Laws", false], [53127, 0.000206, " theorem", false], [44847, 0.000162, " Second", false]]], "model_b": [21988, 2, 0.31862205266952515, [[20267, 0.654602, " Law", false], [21988, 0.318622, " law", false], [31907, 0.003081, " rule", false], [21265, 0.001755, " and", false], [47205, 0.001491, " second", false], [29701, 0.001256, " Rule", false], [55836, 0.001096, " constant", false], [29262, 0.000901, " Laws", false], [269, 0.000769, " \"", false], [44847, 0.000733, " Second", false]]]}, "raw_delta": -0.0419921875, "tuned_delta": 0.012097409915075588}, {"byte_start": 261, "byte_end": 262, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "14.72%", "model_b": "13.74%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.4372738301753998]], "model_b": [[45, ",", "normal", 0.46106842160224915]]}, "loss": {"model_a": 14.722815602821939, "model_b": 13.73659828971425}, "topk": {"model_a": [45, 1, 0.4372738301753998, [[45, 0.437274, ",", false], [59, 0.225301, ":", false], [47, 0.130315, ".", false], [21265, 0.030338, " and", false], [275, 0.022843, " (", false], [9816, 0.01929, "—", false], [280, 0.018051, " -", false], [60, 0.014288, ";", false], [43274, 0.013256, "—the", false], [22898, 0.01146, " —", false]]], "model_b": [45, 1, 0.46106842160224915, [[45, 0.461068, ",", false], [47, 0.204318, ".", false], [59, 0.091937, ":", false], [21265, 0.049159, " and", false], [275, 0.023412, " (", false], [22898, 0.018618, " —", false], [9816, 0.018014, "—", false], [60, 0.016853, ";", false], [40186, 0.01568, " which", false], [22897, 0.010871, " –", false]]]}, "raw_delta": 0.0546875, "tuned_delta": 0.10877709741507559}, {"byte_start": 262, "byte_end": 265, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 50, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "27.05% 27.05% 27.05%", "model_b": "26.11% 26.11% 26.11%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.010971490293741226]], "model_b": [[4715, " or", "normal", 0.012737814337015152]]}, "loss": {"model_a": 27.05053201666806, "model_b": 26.111277432755976}, "topk": {"model_a": [4715, 8, 0.010971490293741226, [[40186, 0.541628, " which", false], [21400, 0.117319, " but", false], [21265, 0.08488, " and", false], [22590, 0.079104, " the", false], [32227, 0.01547, " that", false], [332, 0.012908, " a", false], [340, 0.011832, " i", false], [4715, 0.010971, " or", false], [4596, 0.01015, " in", false], [4423, 0.008524, " as", false]]], "model_b": [4715, 7, 0.012737814337015152, [[40186, 0.595431, " which", false], [22590, 0.087901, " the", false], [21265, 0.069982, " and", false], [332, 0.041623, " a", false], [21400, 0.021335, " but", false], [32227, 0.020823, " that", false], [4715, 0.012738, " or", false], [4596, 0.012053, " in", false], [40185, 0.009988, " where", false], [4423, 0.00856, " as", false]]]}, "raw_delta": 0.05208333333333326, "tuned_delta": 0.10617293074840885}, {"byte_start": 265, "byte_end": 272, "display": {"text": " rather", "kind": "normal"}, "is_word": true, "word_id": 51, "word_key": " rather", "bytes_hex": "20 72 61 74 68 65 72", "compression": {"model_a": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "model_b": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%"}, "model_tokens": {"model_a": [[47001, " rather", "normal", 0.10089293122291565]], "model_b": [[47001, " rather", "normal", 0.01163689699023962]]}, "loss": {"model_a": 5.9173038786461385, "model_b": 11.512577614236704}, "topk": {"model_a": [47001, 4, 0.10089293122291565, [[22590, 0.238373, " the", false], [31458, 0.166759, " more", false], [4424, 0.123038, " at", false], [47001, 0.100893, " rather", false], [45, 0.038933, ",", false], [4596, 0.02585, " in", false], [52448, 0.019623, " perhaps", false], [332, 0.01609, " a", false], [37045, 0.013577, " Moore", false], [32074, 0.01318, " some", false]]], "model_b": [47001, 11, 0.01163689699023962, [[22590, 0.508008, " the", false], [37045, 0.06011, " Moore", false], [63563, 0.041474, " exponential", false], [21835, 0.034592, " how", false], [4424, 0.024096, " at", false], [31458, 0.023623, " more", false], [45, 0.016261, ",", false], [332, 0.016219, " a", false], [4596, 0.015859, " in", false], [32227, 0.015779, " that", false]]]}, "raw_delta": -0.31026785714285715, "tuned_delta": -0.2561782597277816}, {"byte_start": 272, "byte_end": 276, "display": {"text": " its", "kind": "normal"}, "is_word": true, "word_id": 52, "word_key": " its", "bytes_hex": "20 69 74 73", "compression": {"model_a": "10.14% 10.14% 10.14% 10.14%", "model_b": "10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"model_a": [[21902, " its", "normal", 0.1046118214726448]], "model_b": [[21902, " its", "normal", 0.08749260753393173]]}, "loss": {"model_a": 10.143949506250523, "model_b": 10.918834537977993}, "topk": {"model_a": [21902, 3, 0.1046118214726448, [[45, 0.325682, ",", false], [22590, 0.303766, " the", false], [21902, 0.104612, " its", false], [32227, 0.04556, " that", false], [332, 0.037101, " a", false], [37045, 0.027419, " Moore", false], [21835, 0.011125, " how", false], [31458, 0.008867, " more", false], [4419, 0.006958, " an", false], [32464, 0.006922, " what", false]]], "model_b": [21902, 3, 0.08749260753393173, [[22590, 0.307025, " the", false], [45, 0.296092, ",", false], [21902, 0.087493, " its", false], [37045, 0.066977, " Moore", false], [332, 0.029275, " a", false], [21835, 0.017293, " how", false], [32227, 0.011625, " that", false], [31458, 0.009777, " more", false], [32464, 0.009433, " what", false], [59, 0.009002, ":", false]]]}, "raw_delta": -0.04296875, "tuned_delta": 0.011120847415075588}, {"byte_start": 276, "byte_end": 291, "display": {"text": " generalization", "kind": "normal"}, "is_word": true, "word_id": 53, "word_key": " generalization", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 61 74 69 6f 6e", "compression": {"model_a": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%", "model_b": "5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"model_a": [[65135, " generalization", "normal", 0.0022984459064900875]], "model_b": [[65135, " generalization", "normal", 0.009007502347230911]]}, "loss": {"model_a": 7.288615571157784, "model_b": 5.673097686828995}, "topk": {"model_a": [65135, 65, 0.0022984459064900875, [[52046, 0.062569, " inverse", false], [60588, 0.03859, " successor", false], [45606, 0.037796, " cousin", false], [21458, 0.037154, " cor", false], [63563, 0.029451, " exponential", false], [63774, 0.0237, " predecessor", false], [45828, 0.017706, " effect", false], [61841, 0.01581, " derivative", false], [31458, 0.014963, " more", false], [63454, 0.011169, " derivatives", false]]], "model_b": [65135, 16, 0.009007502347230911, [[60588, 0.047284, " successor", false], [51708, 0.027823, " failure", false], [22525, 0.024198, " sub", false], [31237, 0.02372, " lack", false], [55500, 0.018704, " analogue", false], [52046, 0.01832, " inverse", false], [61952, 0.018125, " equivalent", false], [38059, 0.01809, " close", false], [59695, 0.012117, " extension", false], [63774, 0.011978, " predecessor", false]]]}, "raw_delta": 0.08958333333333335, "tuned_delta": 0.14367293074840892}, {"byte_start": 291, "byte_end": 294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 54, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "30.62% 30.62% 30.62%", "model_b": "22.07% 22.07% 22.07%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.006099262274801731]], "model_b": [[4706, " of", "normal", 0.025396397337317467]]}, "loss": {"model_a": 30.619699435533988, "model_b": 22.07248272193401}, "topk": {"model_a": [4706, 16, 0.006099262274801731, [[45, 0.249957, ",", false], [4811, 0.172878, " to", false], [116, 0.15567, "s", false], [59, 0.093979, ":", false], [32227, 0.058063, " that", false], [47, 0.057963, ".", false], [37045, 0.020132, " Moore", false], [38848, 0.014051, " known", false], [4596, 0.013601, " in", false], [4450, 0.01326, " by", false]]], "model_b": [4706, 8, 0.025396397337317467, [[47, 0.193045, ".", false], [45, 0.162158, ",", false], [116, 0.129079, "s", false], [59, 0.124979, ":", false], [4811, 0.088794, " to", false], [32227, 0.059209, " that", false], [4596, 0.025812, " in", false], [4706, 0.025396, " of", false], [30917, 0.021348, " from", false], [4423, 0.017172, " as", false]]]}, "raw_delta": 0.4739583333333335, "tuned_delta": 0.5280479307484091}, {"byte_start": 294, "byte_end": 304, "display": {"text": " continued", "kind": "normal"}, "is_word": true, "word_id": 55, "word_key": " continued", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65 64", "compression": {"model_a": "12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[59392, " continued", "normal", 0.0008488447056151927]], "model_b": [[59392, " continued", "normal", 6.133855640655383e-05]]}, "loss": {"model_a": 12.736292157847878, "model_b": 17.47013526076479}, "topk": {"model_a": [59392, 111, 0.0008488447056151927, [[22590, 0.228477, " the", false], [37045, 0.13122, " Moore", false], [63563, 0.044104, " exponential", false], [269, 0.031326, " \"", false], [32227, 0.024856, " that", false], [332, 0.021657, " a", false], [32234, 0.017551, " this", false], [4601, 0.012254, " it", false], [52805, 0.010373, " scaling", false], [62659, 0.010169, " transistor", false]]], "model_b": [59392, 867, 6.133855640655383e-05, [[22590, 0.267069, " the", false], [4601, 0.234722, " it", false], [37045, 0.093576, " Moore", false], [32227, 0.03739, " that", false], [32234, 0.016987, " this", false], [332, 0.016682, " a", false], [21118, 0.010851, " Von", false], [63563, 0.010276, " exponential", false], [269, 0.007642, " \"", false], [22723, 0.006295, " von", false]]]}, "raw_delta": -0.2625, "tuned_delta": -0.20841040258492444}, {"byte_start": 304, "byte_end": 318, "display": {"text": " exponentially", "kind": "normal"}, "is_word": true, "word_id": 56, "word_key": " exponentially", "bytes_hex": "20 65 78 70 6f 6e 65 6e 74 69 61 6c 6c 79", "compression": {"model_a": "8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98%", "model_b": "9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22%"}, "model_tokens": {"model_a": [[64911, " exponentially", "normal", 0.0009393105865456164]], "model_b": [[64911, " exponentially", "normal", 0.0007888447144068778]]}, "loss": {"model_a": 8.976590237674072, "model_b": 9.218112844965754}, "topk": {"model_a": [64911, 39, 0.0009393105865456164, [[63563, 0.67353, " exponential", false], [46132, 0.05828, " growth", false], [63621, 0.032522, " improvement", false], [64423, 0.028943, " improvements", false], [56950, 0.018912, " progress", false], [59847, 0.013396, " increases", false], [46, 0.01233, "-", false], [37045, 0.012265, " Moore", false], [56045, 0.011355, " doubling", false], [52805, 0.008522, " scaling", false]]], "model_b": [64911, 99, 0.0007888447144068778, [[63563, 0.219346, " exponential", false], [46132, 0.089638, " growth", false], [56950, 0.078458, " progress", false], [63621, 0.050336, " improvement", false], [64423, 0.047048, " improvements", false], [37045, 0.017416, " Moore", false], [60348, 0.017393, " reduction", false], [59847, 0.01561, " increases", false], [65024, 0.015069, " technological", false], [39441, 0.013946, " rapid", false]]]}, "raw_delta": -0.01339285714285715, "tuned_delta": 0.04069674027221844}, {"byte_start": 318, "byte_end": 326, "display": {"text": " falling", "kind": "normal"}, "is_word": true, "word_id": 57, "word_key": " falling", "bytes_hex": "20 66 61 6c 6c 69 6e 67", "compression": {"model_a": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[51709, " falling", "normal", 0.004628258291631937]], "model_b": [[51709, " falling", "normal", 0.00042826199205592275]]}, "loss": {"model_a": 12.116384132465903, "model_b": 17.47013526076479}, "topk": {"model_a": [51709, 19, 0.004628258291631937, [[62092, 0.341356, " increasing", false], [46, 0.12203, "-", false], [61816, 0.0991, " decreasing", false], [51876, 0.095055, " growing", false], [45961, 0.030608, " faster", false], [46132, 0.030241, " growth", false], [59832, 0.029976, " improving", false], [64230, 0.026563, " accelerating", false], [59453, 0.018792, " declining", false], [47122, 0.018043, " rising", false]]], "model_b": [51709, 90, 0.00042826199205592275, [[62092, 0.181275, " increasing", false], [46, 0.109521, "-", false], [52805, 0.086499, " scaling", false], [46132, 0.082512, " growth", false], [51876, 0.073124, " growing", false], [61816, 0.052311, " decreasing", false], [47122, 0.041588, " rising", false], [59832, 0.032673, " improving", false], [63621, 0.026424, " improvement", false], [56045, 0.026057, " doubling", false]]]}, "raw_delta": -0.296875, "tuned_delta": -0.24278540258492443}, {"byte_start": 326, "byte_end": 331, "display": {"text": " cost", "kind": "normal"}, "is_word": true, "word_id": 58, "word_key": " cost", "bytes_hex": "20 63 6f 73 74", "compression": {"model_a": "8.00% 8.00% 8.00% 8.00% 8.00%", "model_b": "9.35% 9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"model_a": [[30510, " cost", "normal", 0.10817506164312363]], "model_b": [[30510, " cost", "normal", 0.07550650835037231]]}, "loss": {"model_a": 8.002449054930967, "model_b": 9.354975655764372}, "topk": {"model_a": [30510, 2, 0.10817506164312363, [[38124, 0.515085, " costs", false], [30510, 0.108175, " cost", false], [45860, 0.039054, " energy", false], [39339, 0.024575, " power", false], [46900, 0.024467, " prices", false], [56353, 0.022709, " hardware", false], [62659, 0.020326, " transistor", false], [22278, 0.016284, " per", false], [52805, 0.013065, " scaling", false], [32343, 0.0113, " unit", false]]], "model_b": [30510, 2, 0.07550650835037231, [[38124, 0.172323, " costs", false], [30510, 0.075507, " cost", false], [56353, 0.046071, " hardware", false], [46900, 0.042761, " prices", false], [62634, 0.030982, " technology", false], [63750, 0.030516, " performance", false], [64957, 0.03028, " manufacturing", false], [52805, 0.029751, " scaling", false], [39349, 0.023285, " price", false], [62382, 0.022026, " production", false]]]}, "raw_delta": -0.07500000000000007, "tuned_delta": -0.02091040258492448}, {"byte_start": 331, "byte_end": 335, "display": {"text": " per", "kind": "normal"}, "is_word": true, "word_id": 59, "word_key": " per", "bytes_hex": "20 70 65 72", "compression": {"model_a": "5.28% 5.28% 5.28% 5.28%", "model_b": "8.00% 8.00% 8.00% 8.00%"}, "model_tokens": {"model_a": [[22278, " per", "normal", 0.306733101606369]], "model_b": [[22278, " per", "normal", 0.1713150441646576]]}, "loss": {"model_a": 5.283307034505481, "model_b": 7.995404645551628}, "topk": {"model_a": [22278, 1, 0.306733101606369, [[22278, 0.306733, " per", false], [47, 0.147779, ".", false], [4706, 0.123265, " of", false], [45, 0.076877, ",", false], [21700, 0.058715, " for", false], [45644, 0.038794, " curves", false], [4811, 0.031063, " to", false], [4596, 0.020581, " in", false], [21265, 0.019129, " and", false], [59, 0.016463, ":", false]]], "model_b": [22278, 2, 0.1713150441646576, [[47, 0.274977, ".", false], [22278, 0.171315, " per", false], [4706, 0.151417, " of", false], [21265, 0.071516, " and", false], [45, 0.05656, ",", false], [21700, 0.039314, " for", false], [4596, 0.026064, " in", false], [59, 0.015774, ":", false], [4423, 0.014906, " as", false], [62450, 0.01302, " reductions", false]]]}, "raw_delta": -0.150390625, "tuned_delta": -0.09630102758492441}, {"byte_start": 335, "byte_end": 340, "display": {"text": " unit", "kind": "normal"}, "is_word": true, "word_id": 60, "word_key": " unit", "bytes_hex": "20 75 6e 69 74", "compression": {"model_a": "4.51% 4.51% 4.51% 4.51% 4.51%", "model_b": "7.83% 7.83% 7.83% 7.83% 7.83%"}, "model_tokens": {"model_a": [[32343, " unit", "normal", 0.2844639718532562]], "model_b": [[32343, " unit", "normal", 0.1165042296051979]]}, "loss": {"model_a": 4.50842200277801, "model_b": 7.833383229826793}, "topk": {"model_a": [32343, 1, 0.2844639718532562, [[32343, 0.284464, " unit", false], [63370, 0.099996, " computation", false], [62659, 0.099452, " transistor", false], [60096, 0.055853, " operation", false], [21365, 0.055329, " bit", false], [3806, 0.035438, " FL", false], [64862, 0.030839, " computational", false], [51266, 0.02392, " compute", false], [59346, 0.023771, " computing", false], [63750, 0.017952, " performance", false]]], "model_b": [32343, 2, 0.1165042296051979, [[62659, 0.248872, " transistor", false], [32343, 0.116504, " unit", false], [30442, 0.070824, " chip", false], [21365, 0.056372, " bit", false], [60262, 0.054942, " processor", false], [62378, 0.035549, " processing", false], [39018, 0.030174, " micro", false], [19602, 0.018667, " CPU", false], [63370, 0.017128, " computation", false], [59346, 0.013348, " computing", false]]]}, "raw_delta": -0.184375, "tuned_delta": -0.13028540258492444}, {"byte_start": 340, "byte_end": 343, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 61, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "2.79% 2.79% 2.79%", "model_b": "3.69% 3.69% 3.69%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.6250545382499695]], "model_b": [[4706, " of", "normal", 0.538613498210907]]}, "loss": {"model_a": 2.794282387138454, "model_b": 3.6865742418549354}, "topk": {"model_a": [4706, 1, 0.6250545382499695, [[4706, 0.625055, " of", false], [47, 0.089064, ".", false], [32251, 0.052469, " time", false], [45, 0.036225, ",", false], [63370, 0.027617, " computation", false], [59346, 0.009312, " computing", false], [63750, 0.008982, " performance", false], [275, 0.008307, " (", false], [21700, 0.00738, " for", false], [30173, 0.006321, " area", false]]], "model_b": [4706, 1, 0.538613498210907, [[4706, 0.538613, " of", false], [47, 0.063815, ".", false], [63370, 0.048996, " computation", false], [32251, 0.044386, " time", false], [62378, 0.042578, " processing", false], [64862, 0.024995, " computational", false], [30173, 0.017314, " area", false], [46543, 0.01227, " memory", false], [45, 0.008986, ",", false], [63750, 0.008448, " performance", false]]]}, "raw_delta": -0.049479166666666685, "tuned_delta": 0.004610430748408903}, {"byte_start": 343, "byte_end": 355, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 62, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "model_b": "2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22% 2.22%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.37295469641685486]], "model_b": [[63370, " computation", "normal", 0.22751452028751373]]}, "loss": {"model_a": 1.4851963108109854, "model_b": 2.218988954492302}, "topk": {"model_a": [63370, 1, 0.37295469641685486, [[63370, 0.372955, " computation", false], [59346, 0.166053, " computing", false], [51266, 0.089957, " compute", false], [64862, 0.068879, " computational", false], [63750, 0.03173, " performance", false], [62378, 0.026331, " processing", false], [39339, 0.017784, " power", false], [63637, 0.01707, " information", false], [55809, 0.01283, " computer", false], [56353, 0.011179, " hardware", false]]], "model_b": [63370, 1, 0.22751452028751373, [[63370, 0.227515, " computation", false], [62378, 0.097376, " processing", false], [64862, 0.067754, " computational", false], [59346, 0.063572, " computing", false], [51266, 0.051858, " compute", false], [63750, 0.03558, " performance", false], [39339, 0.031426, " power", false], [52905, 0.030223, " silicon", false], [56353, 0.030027, " hardware", false], [32251, 0.026692, " time", false]]]}, "raw_delta": -0.04069010416666668, "tuned_delta": 0.01339949324840891}, {"byte_start": 355, "byte_end": 356, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "10.71%", "model_b": "8.70%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5602073669433594]], "model_b": [[47, ".", "normal", 0.6192847490310669]]}, "loss": {"model_a": 10.707502256597774, "model_b": 8.699845583485692}, "topk": {"model_a": [47, 1, 0.5602073669433594, [[47, 0.560207, ".", false], [45, 0.163868, ",", false], [275, 0.035099, " (", false], [31601, 0.03259, " over", false], [59, 0.025043, ":", false], [4811, 0.018427, " to", false], [21265, 0.018182, " and", false], [39339, 0.017679, " power", false], [4423, 0.008745, " as", false], [4596, 0.008233, " in", false]]], "model_b": [47, 1, 0.6192847490310669, [[47, 0.619285, ".", false], [45, 0.086218, ",", false], [39339, 0.044029, " power", false], [275, 0.029323, " (", false], [59, 0.018836, ":", false], [22278, 0.018566, " per", false], [21265, 0.017655, " and", false], [32251, 0.01705, " time", false], [4423, 0.01474, " as", false], [32227, 0.012765, " that", false]]]}, "raw_delta": 0.111328125, "tuned_delta": 0.16541772241507557}, {"byte_start": 356, "byte_end": 361, "display": {"text": " Most", "kind": "normal"}, "is_word": true, "word_id": 63, "word_key": " most", "bytes_hex": "20 4d 6f 73 74", "compression": {"model_a": "21.30% 21.30% 21.30% 21.30% 21.30%", "model_b": "22.77% 22.77% 22.77% 22.77% 22.77%"}, "model_tokens": {"model_a": [[29425, " Most", "normal", 0.0027175736613571644]], "model_b": [[29425, " Most", "normal", 0.001813532435335219]]}, "loss": {"model_a": 21.302293963126097, "model_b": 22.76753111402895}, "topk": {"model_a": [29425, 49, 0.0027175736613571644, [[11, 0.159345, "\n", false], [20996, 0.101765, " The", false], [29894, 0.094614, " This", false], [261, 0.040463, "\n\n", false], [3913, 0.038089, " In", false], [19555, 0.037748, " But", false], [37045, 0.032184, " Moore", false], [3918, 0.029862, " It", false], [3641, 0.026704, " As", false], [3908, 0.021178, " If", false]]], "model_b": [29425, 60, 0.001813532435335219, [[11, 0.248197, "\n", false], [29894, 0.088336, " This", false], [20996, 0.079691, " The", false], [37045, 0.042153, " Moore", false], [3913, 0.038288, " In", false], [261, 0.037347, "\n\n", false], [3918, 0.021361, " It", false], [3641, 0.020984, " As", false], [37564, 0.014825, " While", false], [19555, 0.014556, " But", false]]]}, "raw_delta": -0.08125000000000004, "tuned_delta": -0.027160402584924456}, {"byte_start": 361, "byte_end": 364, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 64, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "13.06% 13.06% 13.06%", "model_b": "13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.11316458135843277]], "model_b": [[3609, " AI", "normal", 0.10222864151000977]]}, "loss": {"model_a": 13.055638716377988, "model_b": 13.713116925116447}, "topk": {"model_a": [3609, 2, 0.11316458135843277, [[4706, 0.296412, " of", false], [3609, 0.113165, " AI", false], [46787, 0.059094, " people", false], [39193, 0.034889, " other", false], [52224, 0.024476, " methods", false], [57103, 0.02051, " research", false], [47539, 0.010789, " things", false], [52167, 0.010439, " machine", false], [46588, 0.009972, " modern", false], [2030, 0.009561, "ly", false]]], "model_b": [3609, 2, 0.10222864151000977, [[4706, 0.256989, " of", false], [3609, 0.102229, " AI", false], [46787, 0.054001, " people", false], [39193, 0.043361, " other", false], [57103, 0.018363, " research", false], [51832, 0.013115, " general", false], [63843, 0.012691, " researchers", false], [52167, 0.011768, " machine", false], [47014, 0.010898, " recent", false], [2030, 0.009827, "ly", false]]]}, "raw_delta": -0.03645833333333326, "tuned_delta": 0.01763126408174233}, {"byte_start": 364, "byte_end": 373, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 65, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "model_b": "2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.24100203812122345]], "model_b": [[57103, " research", "normal", 0.23750528693199158]]}, "loss": {"model_a": 2.8647264809318607, "model_b": 2.896034967062264}, "topk": {"model_a": [57103, 1, 0.24100203812122345, [[57103, 0.241002, " research", false], [63843, 0.178493, " researchers", false], [52224, 0.077356, " methods", false], [53087, 0.07643, " systems", false], [62633, 0.025532, " techniques", false], [32499, 0.022854, " work", false], [56950, 0.022285, " progress", false], [61559, 0.020193, " algorithms", false], [64251, 0.019879, " applications", false], [4600, 0.016739, " is", false]]], "model_b": [57103, 1, 0.23750528693199158, [[57103, 0.237505, " research", false], [63843, 0.142287, " researchers", false], [53087, 0.076786, " systems", false], [52224, 0.075276, " methods", false], [62633, 0.029192, " techniques", false], [61559, 0.025899, " algorithms", false], [4600, 0.025097, " is", false], [61590, 0.021385, " approaches", false], [46587, 0.015838, " models", false], [32499, 0.014671, " work", false]]]}, "raw_delta": -0.0017361111111111327, "tuned_delta": 0.052353486303964455}, {"byte_start": 373, "byte_end": 377, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 66, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"model_a": "7.57% 7.57% 7.57% 7.57%", "model_b": "7.54% 7.54% 7.54% 7.54%"}, "model_tokens": {"model_a": [[21800, " has", "normal", 0.18468452990055084]], "model_b": [[21800, " has", "normal", 0.18908379971981049]]}, "loss": {"model_a": 7.572740082791189, "model_b": 7.537518035894486}, "topk": {"model_a": [21800, 1, 0.18468452990055084, [[21800, 0.184685, " has", false], [4600, 0.112504, " is", false], [4596, 0.045841, " in", false], [45, 0.045161, ",", false], [39971, 0.037255, " today", false], [31601, 0.026654, " over", false], [32227, 0.025539, " that", false], [56952, 0.024692, " projects", false], [46750, 0.023426, " papers", false], [51566, 0.020506, " efforts", false]]], "model_b": [21800, 1, 0.18908379971981049, [[21800, 0.189084, " has", false], [4600, 0.112842, " is", false], [39971, 0.045574, " today", false], [4596, 0.044151, " in", false], [45, 0.043948, ",", false], [51771, 0.022605, " focuses", false], [31601, 0.022531, " over", false], [32227, 0.016201, " that", false], [46750, 0.015786, " papers", false], [21265, 0.015578, " and", false]]]}, "raw_delta": 0.001953125, "tuned_delta": 0.05604272241507559}, {"byte_start": 377, "byte_end": 382, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 67, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"model_a": "3.92% 3.92% 3.92% 3.92% 3.92%", "model_b": "4.68% 4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"model_a": [[30259, " been", "normal", 0.3382815420627594]], "model_b": [[30259, " been", "normal", 0.2724875509738922]]}, "loss": {"model_a": 3.9166916149133963, "model_b": 4.677487827882186}, "topk": {"model_a": [30259, 1, 0.3382815420627594, [[30259, 0.338282, " been", false], [51770, 0.149863, " focused", false], [56255, 0.021524, " followed", false], [39887, 0.021269, " taken", false], [22187, 0.016171, " not", false], [40013, 0.016112, " tried", false], [45953, 0.012666, " failed", false], [56540, 0.011556, " leverage", false], [64300, 0.011408, " concentrated", false], [56500, 0.011216, " involved", false]]], "model_b": [30259, 1, 0.2724875509738922, [[30259, 0.272488, " been", false], [51770, 0.188777, " focused", false], [56255, 0.026269, " followed", false], [22187, 0.016309, " not", false], [47054, 0.013667, " relied", false], [45150, 0.013612, " always", false], [39887, 0.012542, " taken", false], [39071, 0.011197, " moved", false], [32354, 0.010605, " used", false], [30991, 0.009535, " gone", false]]]}, "raw_delta": -0.04218750000000002, "tuned_delta": 0.011902097415075572}, {"byte_start": 382, "byte_end": 392, "display": {"text": " conducted", "kind": "normal"}, "is_word": true, "word_id": 68, "word_key": " conducted", "bytes_hex": "20 63 6f 6e 64 75 63 74 65 64", "compression": {"model_a": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "model_b": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%"}, "model_tokens": {"model_a": [[59355, " conducted", "normal", 0.025281056761741638]], "model_b": [[59355, " conducted", "normal", 0.010643674060702324]]}, "loss": {"model_a": 6.621744816580202, "model_b": 8.171514880035144}, "topk": {"model_a": [59355, 8, 0.025281056761741638, [[51770, 0.113002, " focused", false], [30666, 0.066695, " done", false], [45796, 0.035702, " driven", false], [37598, 0.034683, " about", false], [51459, 0.032152, " devoted", false], [37810, 0.028903, " based", false], [4596, 0.028449, " in", false], [59355, 0.025281, " conducted", false], [4712, 0.024528, " on", false], [332, 0.022119, " a", false]]], "model_b": [59355, 17, 0.010643674060702324, [[51770, 0.136989, " focused", false], [45796, 0.124348, " driven", false], [37598, 0.047849, " about", false], [37810, 0.030493, " based", false], [51459, 0.029887, " devoted", false], [30666, 0.026724, " done", false], [59349, 0.013962, " concerned", false], [4596, 0.013936, " in", false], [55706, 0.01344, " centered", false], [56002, 0.0128, " directed", false]]]}, "raw_delta": -0.0859375, "tuned_delta": -0.03184790258492441}, {"byte_start": 392, "byte_end": 395, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 69, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "31.18% 31.18% 31.18%", "model_b": "21.79% 21.79% 21.79%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.005548461806029081]], "model_b": [[4423, " as", "normal", 0.02681073360145092]]}, "loss": {"model_a": 31.183252185881237, "model_b": 21.79070634676038}, "topk": {"model_a": [4423, 14, 0.005548461806029081, [[4596, 0.222587, " in", false], [4712, 0.203379, " on", false], [32487, 0.118062, " with", false], [40085, 0.102983, " using", false], [4450, 0.086894, " by", false], [47806, 0.042485, " within", false], [40062, 0.034336, " under", false], [4424, 0.033606, " at", false], [31601, 0.012565, " over", false], [53356, 0.008114, " without", false]]], "model_b": [4423, 10, 0.02681073360145092, [[4596, 0.215994, " in", false], [4712, 0.140479, " on", false], [32487, 0.101656, " with", false], [40085, 0.074271, " using", false], [4450, 0.059113, " by", false], [40062, 0.056369, " under", false], [4424, 0.052032, " at", false], [4811, 0.035761, " to", false], [47806, 0.027429, " within", false], [4423, 0.026811, " as", false]]]}, "raw_delta": 0.5208333333333335, "tuned_delta": 0.5749229307484091}, {"byte_start": 395, "byte_end": 398, "display": {"text": " if", "kind": "normal"}, "is_word": true, "word_id": 70, "word_key": " if", "bytes_hex": "20 69 66", "compression": {"model_a": "9.11% 9.11% 9.11%", "model_b": "18.50% 18.50% 18.50%"}, "model_tokens": {"model_a": [[4588, " if", "normal", 0.22035817801952362]], "model_b": [[4588, " if", "normal", 0.046107854694128036]]}, "loss": {"model_a": 9.11076946394723, "model_b": 18.503315303068085}, "topk": {"model_a": [4588, 2, 0.22035817801952362, [[332, 0.289672, " a", false], [4588, 0.220358, " if", false], [4419, 0.105092, " an", false], [31633, 0.062675, " part", false], [47544, 0.060681, " though", false], [22590, 0.020766, " the", false], [269, 0.012641, " \"", false], [32074, 0.005624, " some", false], [57103, 0.005179, " research", false], [63625, 0.004966, " incremental", false]]], "model_b": [4588, 4, 0.046107854694128036, [[332, 0.412543, " a", false], [4419, 0.130427, " an", false], [31633, 0.118349, " part", false], [4588, 0.046108, " if", false], [22590, 0.019729, " the", false], [45833, 0.010648, " either", false], [51832, 0.006795, " general", false], [269, 0.006672, " \"", false], [63625, 0.00615, " incremental", false], [64498, 0.005087, " optimization", false]]]}, "raw_delta": -0.5208333333333334, "tuned_delta": -0.4667437359182578}, {"byte_start": 398, "byte_end": 402, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 71, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "8.00% 8.00% 8.00% 8.00%", "model_b": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.17217271029949188]], "model_b": [[22590, " the", "normal", 0.14814676344394684]]}, "loss": {"model_a": 7.995404645551628, "model_b": 8.594179442795582}, "topk": {"model_a": [22590, 1, 0.17217271029949188, [[22590, 0.172173, " the", false], [32234, 0.123909, " this", false], [4601, 0.080611, " it", false], [4858, 0.077304, " we", false], [39934, 0.062592, " there", false], [37045, 0.0502, " Moore", false], [3609, 0.034168, " AI", false], [63370, 0.025696, " computation", false], [22226, 0.024657, " one", false], [51832, 0.016894, " general", false]]], "model_b": [22590, 1, 0.14814676344394684, [[22590, 0.148147, " the", false], [37045, 0.098204, " Moore", false], [4601, 0.090299, " it", false], [4858, 0.087942, " we", false], [32234, 0.086118, " this", false], [63370, 0.058549, " computation", false], [39934, 0.037254, " there", false], [59346, 0.027911, " computing", false], [3609, 0.025707, " AI", false], [332, 0.02352, " a", false]]]}, "raw_delta": -0.033203125, "tuned_delta": 0.020886472415075588}, {"byte_start": 402, "byte_end": 414, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 72, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%", "model_b": "6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15% 6.15%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.008208324201405048]], "model_b": [[63370, " computation", "normal", 0.01650926284492016]]}, "loss": {"model_a": 7.232260296123059, "model_b": 6.1521175246241615}, "topk": {"model_a": [63370, 15, 0.008208324201405048, [[30510, 0.16907, " cost", false], [31581, 0.043765, " only", false], [30985, 0.039155, " goal", false], [40213, 0.028927, " world", false], [52569, 0.027766, " problem", false], [64862, 0.021806, " computational", false], [57481, 0.018901, " ultimate", false], [46064, 0.017141, " future", false], [38124, 0.013501, " costs", false], [55809, 0.013307, " computer", false]]], "model_b": [63370, 10, 0.01650926284492016, [[30510, 0.095202, " cost", false], [30985, 0.030291, " goal", false], [31581, 0.023738, " only", false], [37045, 0.023383, " Moore", false], [57481, 0.021478, " ultimate", false], [40213, 0.020808, " world", false], [51832, 0.019904, " general", false], [64862, 0.018084, " computational", false], [52167, 0.017948, " machine", false], [63370, 0.016509, " computation", false]]]}, "raw_delta": 0.05989583333333337, "tuned_delta": 0.11398543074840896}, {"byte_start": 414, "byte_end": 424, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 73, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66%", "model_b": "10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59% 10.59%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.014257945120334625]], "model_b": [[59206, " available", "normal", 0.0028407196514308453]]}, "loss": {"model_a": 7.664317404722616, "model_b": 10.594791706528326}, "topk": {"model_a": [59206, 11, 0.014257945120334625, [[22748, 0.226967, " was", false], [32462, 0.14286, " were", false], [4600, 0.099516, " is", false], [30510, 0.056174, " cost", false], [40219, 0.050933, " would", false], [38128, 0.036869, " could", false], [46342, 0.027247, " itself", false], [4706, 0.015667, " of", false], [52569, 0.015122, " problem", false], [21795, 0.014863, " had", false]]], "model_b": [59206, 53, 0.0028407196514308453, [[30510, 0.103272, " cost", false], [4600, 0.097031, " is", false], [38124, 0.064815, " costs", false], [22748, 0.055678, " was", false], [46, 0.042428, "-", false], [4706, 0.039195, " of", false], [46650, 0.0302, " needed", false], [39339, 0.028116, " power", false], [61643, 0.026583, " bottleneck", false], [32462, 0.015819, " were", false]]]}, "raw_delta": -0.16250000000000006, "tuned_delta": -0.10841040258492447}, {"byte_start": 424, "byte_end": 427, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 74, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "6.95% 6.95% 6.95%", "model_b": "7.94% 7.94% 7.94%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.3134537637233734]], "model_b": [[4811, " to", "normal", 0.26666611433029175]]}, "loss": {"model_a": 6.9504839209494325, "model_b": 7.936701234057122}, "topk": {"model_a": [4811, 1, 0.3134537637233734, [[4811, 0.313454, " to", false], [32462, 0.14886, " were", false], [22748, 0.139885, " was", false], [21700, 0.090638, " for", false], [4600, 0.084194, " is", false], [4596, 0.03288, " in", false], [40219, 0.024019, " would", false], [39971, 0.022133, " today", false], [4712, 0.020225, " on", false], [4424, 0.017158, " at", false]]], "model_b": [4811, 1, 0.26666611433029175, [[4811, 0.266666, " to", false], [4600, 0.179903, " is", false], [39971, 0.175317, " today", false], [22748, 0.066229, " was", false], [21700, 0.050174, " for", false], [4424, 0.041636, " at", false], [4596, 0.031317, " in", false], [4712, 0.019694, " on", false], [32462, 0.01699, " were", false], [21800, 0.015286, " has", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 427, "byte_end": 431, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 75, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.76% 11.76% 11.76% 11.76%", "model_b": "8.77% 8.77% 8.77% 8.77%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.0742250308394432]], "model_b": [[22590, " the", "normal", 0.14242425560951233]]}, "loss": {"model_a": 11.76416366349887, "model_b": 8.770289677279099}, "topk": {"model_a": [22590, 5, 0.0742250308394432, [[63843, 0.190292, " researchers", false], [3609, 0.155574, " AI", false], [4835, 0.111417, " us", false], [4601, 0.082772, " it", false], [22590, 0.074225, " the", false], [332, 0.040541, " a", false], [39740, 0.034152, " solve", false], [4419, 0.025745, " an", false], [46227, 0.023081, " humans", false], [4491, 0.017032, " do", false]]], "model_b": [22590, 2, 0.14242425560951233, [[4835, 0.293193, " us", false], [22590, 0.142424, " the", false], [63843, 0.062914, " researchers", false], [332, 0.062103, " a", false], [3609, 0.051944, " AI", false], [4435, 0.032936, " be", false], [4419, 0.031147, " an", false], [4601, 0.020131, " it", false], [32229, 0.018733, " them", false], [22799, 0.015655, " you", false]]]}, "raw_delta": 0.166015625, "tuned_delta": 0.22010522241507557}, {"byte_start": 431, "byte_end": 437, "display": {"text": " agent", "kind": "normal"}, "is_word": true, "word_id": 76, "word_key": " agent", "bytes_hex": "20 61 67 65 6e 74", "compression": {"model_a": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[37636, " agent", "normal", 0.011057370342314243]], "model_b": [[37636, " agent", "normal", 0.0029966472648084164]]}, "loss": {"model_a": 13.52526600833403, "model_b": 17.47013526076479}, "topk": {"model_a": [37636, 12, 0.011057370342314243, [[3609, 0.261469, " AI", false], [62496, 0.185476, " researcher", false], [63843, 0.140816, " researchers", false], [57103, 0.038766, " research", false], [52569, 0.030162, " problem", false], [59113, 0.022393, " algorithm", false], [52581, 0.0223, " project", false], [47487, 0.018635, " system", false], [40213, 0.016146, " world", false], [38478, 0.014444, " field", false]]], "model_b": [37636, 37, 0.0029966472648084164, [[62496, 0.161237, " researcher", false], [63843, 0.13496, " researchers", false], [3609, 0.132122, " AI", false], [57103, 0.039921, " research", false], [32355, 0.036655, " user", false], [38720, 0.026195, " human", false], [52167, 0.023267, " machine", false], [60455, 0.020888, " scientist", false], [59324, 0.020833, " community", false], [39043, 0.016283, " model", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 437, "byte_end": 442, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 77, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "6.06% 6.06% 6.06% 6.06% 6.06%", "model_b": "14.99% 14.99% 14.99% 14.99% 14.99%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.18527035415172577]], "model_b": [[32462, " were", "normal", 0.015663277357816696]]}, "loss": {"model_a": 6.058192066232952, "model_b": 14.990503159236885}, "topk": {"model_a": [32462, 3, 0.18527035415172577, [[22748, 0.263561, " was", false], [4600, 0.210757, " is", false], [32462, 0.18527, " were", false], [40219, 0.064466, " would", false], [38128, 0.030505, " could", false], [4596, 0.021048, " in", false], [275, 0.018034, " (", false], [32475, 0.014222, " will", false], [21265, 0.010929, " and", false], [45, 0.010603, ",", false]]], "model_b": [32462, 7, 0.015663277357816696, [[4600, 0.481387, " is", false], [22748, 0.201778, " was", false], [275, 0.02305, " (", false], [32475, 0.020294, " will", false], [4596, 0.017475, " in", false], [21800, 0.01592, " has", false], [32462, 0.015663, " were", false], [40219, 0.012704, " would", false], [4715, 0.012014, " or", false], [21265, 0.011647, " and", false]]]}, "raw_delta": -0.4953125, "tuned_delta": -0.4412229025849244}, {"byte_start": 442, "byte_end": 451, "display": {"text": " constant", "kind": "normal"}, "is_word": true, "word_id": 78, "word_key": " constant", "bytes_hex": "20 63 6f 6e 73 74 61 6e 74", "compression": {"model_a": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "model_b": "7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51%"}, "model_tokens": {"model_a": [[55836, " constant", "normal", 0.026913397014141083]], "model_b": [[55836, " constant", "normal", 0.02354644052684307]]}, "loss": {"model_a": 7.2635687822534605, "model_b": 7.514036671296683}, "topk": {"model_a": [55836, 8, 0.026913397014141083, [[38501, 0.153262, " fixed", false], [30911, 0.112204, " free", false], [56447, 0.110923, " infinite", false], [60706, 0.072948, " unlimited", false], [332, 0.043242, " a", false], [63507, 0.040686, " effectively", false], [22590, 0.029057, " the", false], [55836, 0.026913, " constant", false], [38594, 0.019031, " given", false], [22187, 0.016382, " not", false]]], "model_b": [55836, 9, 0.02354644052684307, [[56447, 0.045464, " infinite", false], [22590, 0.04208, " the", false], [38501, 0.041296, " fixed", false], [52140, 0.040936, " limited", false], [332, 0.036065, " a", false], [60706, 0.035398, " unlimited", false], [4811, 0.030699, " to", false], [52951, 0.027278, " somehow", false], [55836, 0.023546, " constant", false], [22187, 0.01572, " not", false]]]}, "raw_delta": -0.013888888888888895, "tuned_delta": 0.04020070852618669}, {"byte_start": 451, "byte_end": 453, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "29.87% 29.87%", "model_b": "30.43% 30.43%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.03586556017398834]], "model_b": [[275, " (", "normal", 0.034951068460941315]]}, "loss": {"model_a": 29.868295768404316, "model_b": 30.43184851875157}, "topk": {"model_a": [275, 4, 0.03586556017398834, [[45, 0.506669, ",", false], [47, 0.216995, ".", false], [60, 0.040546, ";", false], [275, 0.035866, " (", false], [4715, 0.034542, " or", false], [31601, 0.033976, " over", false], [21265, 0.030495, " and", false], [4596, 0.017488, " in", false], [59, 0.007921, ":", false], [45093, 0.006493, " across", false]]], "model_b": [275, 4, 0.034951068460941315, [[45, 0.391801, ",", false], [47, 0.196286, ".", false], [21265, 0.143474, " and", false], [275, 0.034951, " (", false], [4596, 0.026735, " in", false], [60, 0.019542, ";", false], [4715, 0.018244, " or", false], [9816, 0.016237, "—", false], [31601, 0.014301, " over", false], [62650, 0.010546, " throughout", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 453, "byte_end": 455, "display": {"text": "in", "kind": "normal"}, "is_word": true, "word_id": 79, "word_key": "in", "bytes_hex": "69 6e", "compression": {"model_a": "27.75% 27.75%", "model_b": "31.84% 31.84%"}, "model_tokens": {"model_a": [[1950, "in", "normal", 0.046454381197690964]], "model_b": [[1950, "in", "normal", 0.02932688780128956]]}, "loss": {"model_a": 27.754972954602124, "model_b": 31.840730394619698}, "topk": {"model_a": [1950, 4, 0.046454381197690964, [[2101, 0.249234, "or", false], [7005, 0.057784, "and", false], [106, 0.047246, "i", false], [1950, 0.046454, "in", false], [102, 0.035355, "e", false], [98, 0.031601, "a", false], [1751, 0.029916, "as", false], [36003, 0.027355, "which", false], [8801, 0.023637, "the", false], [1752, 0.017978, "at", false]]], "model_b": [1950, 6, 0.02932688780128956, [[2101, 0.095155, "or", false], [102, 0.076019, "e", false], [106, 0.07488, "i", false], [7005, 0.059197, "and", false], [36003, 0.030445, "which", false], [1950, 0.029327, "in", false], [1751, 0.029039, "as", false], [8801, 0.025703, "the", false], [98, 0.024642, "a", false], [7579, 0.019254, "for", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17247290258492443}, {"byte_start": 455, "byte_end": 461, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 80, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"model_a": "17.75% 17.75% 17.75% 17.75% 17.75% 17.75%", "model_b": "14.28% 14.28% 14.28% 14.28% 14.28% 14.28%"}, "model_tokens": {"model_a": [[40186, " which", "normal", 0.0027163508348166943]], "model_b": [[40186, " which", "normal", 0.008699914440512657]]}, "loss": {"model_a": 17.751911635938416, "model_b": 14.276669675463697}, "topk": {"model_a": [40186, 45, 0.0027163508348166943, [[22590, 0.177608, " the", false], [30808, 0.075171, " fact", false], [39920, 0.073222, " terms", false], [62293, 0.069717, " particular", false], [32074, 0.042744, " some", false], [39193, 0.040109, " other", false], [332, 0.036753, " a", false], [32251, 0.031779, " time", false], [56901, 0.025685, " practice", false], [55856, 0.025613, " contrast", false]]], "model_b": [40186, 18, 0.008699914440512657, [[22590, 0.236591, " the", false], [55856, 0.054553, " contrast", false], [39920, 0.053101, " terms", false], [332, 0.049717, " a", false], [39193, 0.049438, " other", false], [56901, 0.047442, " practice", false], [30808, 0.043166, " fact", false], [32074, 0.03139, " some", false], [32251, 0.022732, " time", false], [32234, 0.015672, " this", false]]]}, "raw_delta": 0.19270833333333337, "tuned_delta": 0.24679793074840894}, {"byte_start": 461, "byte_end": 466, "display": {"text": " case", "kind": "normal"}, "is_word": true, "word_id": 81, "word_key": " case", "bytes_hex": "20 63 61 73 65", "compression": {"model_a": "0.13% 0.13% 0.13% 0.13% 0.13%", "model_b": "0.15% 0.15% 0.15% 0.15% 0.15%"}, "model_tokens": {"model_a": [[30405, " case", "normal", 0.9655082821846008]], "model_b": [[30405, " case", "normal", 0.9594584107398987]]}, "loss": {"model_a": 0.12591881765571397, "model_b": 0.1496936993109886}, "topk": {"model_a": [30405, 1, 0.9655082821846008, [[30405, 0.965508, " case", false], [22590, 0.005911, " the", false], [4601, 0.00319, " it", false], [4858, 0.001724, " we", false], [37045, 0.001544, " Moore", false], [37970, 0.001112, " cases", false], [39631, 0.000927, " sense", false], [39934, 0.000776, " there", false], [332, 0.000761, " a", false], [45, 0.000534, ",", false]]], "model_b": [30405, 1, 0.9594584107398987, [[30405, 0.959458, " case", false], [22590, 0.008016, " the", false], [4601, 0.004906, " it", false], [37970, 0.004835, " cases", false], [4858, 0.002568, " we", false], [39934, 0.001635, " there", false], [45, 0.000939, ",", false], [4692, 0.000821, " no", false], [21256, 0.000795, " all", false], [60511, 0.00071, " situation", false]]]}, "raw_delta": -0.0013183593749999997, "tuned_delta": 0.05277123804007559}, {"byte_start": 466, "byte_end": 472, "display": {"text": " lever", "kind": "normal"}, "is_word": true, "word_id": 82, "word_key": " lever", "bytes_hex": "20 6c 65 76 65 72", "compression": {"model_a": "25.92% 25.92% 25.92% 25.92% 25.92% 25.92%", "model_b": "30.24% 30.24% 30.24% 30.24% 30.24% 30.24%"}, "model_tokens": {"model_a": [[38888, " lever", "normal", 0.00018302799435332417]], "model_b": [[38888, " lever", "normal", 4.187525701127015e-05]]}, "loss": {"model_a": 25.92342651597356, "model_b": 30.243997601969152}, "topk": {"model_a": [38888, 281, 0.00018302799435332417, [[22590, 0.243117, " the", false], [45, 0.114183, ",", false], [4601, 0.110919, " it", false], [4858, 0.044102, " we", false], [39934, 0.037523, " there", false], [22799, 0.02861, " you", false], [332, 0.020253, " a", false], [22226, 0.018473, " one", false], [3609, 0.013339, " AI", false], [21273, 0.012267, " any", false]]], "model_b": [38888, 620, 4.187525701127015e-05, [[22590, 0.230122, " the", false], [45, 0.173445, ",", false], [4601, 0.112131, " it", false], [4858, 0.104617, " we", false], [39934, 0.028059, " there", false], [37045, 0.022133, " Moore", false], [3609, 0.019621, " AI", false], [22799, 0.015857, " you", false], [332, 0.015461, " a", false], [22226, 0.011441, " one", false]]]}, "raw_delta": -0.23958333333333326, "tuned_delta": -0.18549373591825769}, {"byte_start": 472, "byte_end": 477, "display": {"text": "aging", "kind": "normal"}, "is_word": true, "word_id": 83, "word_key": "aging", "bytes_hex": "61 67 69 6e 67", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12% 0.12%", "model_b": "0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"model_a": [[33672, "aging", "normal", 0.9668365120887756]], "model_b": [[33672, "aging", "normal", 0.9968733191490173]]}, "loss": {"model_a": 0.12239661296604364, "model_b": 0.011282061896600245}, "topk": {"model_a": [33672, 1, 0.9668365120887756, [[33672, 0.966837, "aging", false], [116, 0.018875, "s", false], [7856, 0.013303, "ing", false], [46, 0.000199, "-", false], [1739, 9e-05, "ag", false], [1843, 6.8e-05, "ed", false], [33943, 5.5e-05, "ating", false], [25504, 3.7e-05, "ging", false], [6934, 2.3e-05, "aga", false], [41631, 1.2e-05, "inging", false]]], "model_b": [33672, 1, 0.9968733191490173, [[33672, 0.996873, "aging", false], [7856, 0.001115, "ing", false], [116, 0.00063, "s", false], [1843, 0.000451, "ed", false], [46, 7.5e-05, "-", false], [6935, 6.6e-05, "age", false], [24566, 2.9e-05, "ance", false], [25504, 2.5e-05, "ging", false], [21289, 2.4e-05, " arm", false], [24451, 2.2e-05, "aged", false]]]}, "raw_delta": 0.0061614990234375, "tuned_delta": 0.06025109643851309}, {"byte_start": 477, "byte_end": 483, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 84, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "17.38% 17.38% 17.38% 17.38% 17.38% 17.38%", "model_b": "23.48% 23.48% 23.48% 23.48% 23.48% 23.48%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.0030587823130190372]], "model_b": [[38720, " human", "normal", 0.0003984128125011921]]}, "loss": {"model_a": 17.37620980237358, "model_b": 23.481364597802134}, "topk": {"model_a": [38720, 22, 0.0030587823130190372, [[63370, 0.494007, " computation", false], [22590, 0.091681, " the", false], [4601, 0.030275, " it", false], [51832, 0.028739, " general", false], [31458, 0.026942, " more", false], [64862, 0.018743, " computational", false], [32227, 0.016501, " that", false], [37045, 0.015856, " Moore", false], [3609, 0.010519, " AI", false], [51266, 0.009519, " compute", false]]], "model_b": [38720, 184, 0.0003984128125011921, [[51832, 0.20193, " general", false], [63370, 0.114776, " computation", false], [22590, 0.105769, " the", false], [4601, 0.040183, " it", false], [32234, 0.026748, " this", false], [332, 0.025327, " a", false], [59346, 0.020904, " computing", false], [37045, 0.020593, " Moore", false], [3609, 0.018556, " AI", false], [32227, 0.015117, " that", false]]]}, "raw_delta": -0.3385416666666666, "tuned_delta": -0.284452069251591}, {"byte_start": 483, "byte_end": 493, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 85, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%", "model_b": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.06464724987745285]], "model_b": [[59943, " knowledge", "normal", 0.05314521864056587]]}, "loss": {"model_a": 4.931086565538449, "model_b": 5.297395853264163}, "topk": {"model_a": [59943, 3, 0.06464724987745285, [[64452, 0.161429, " intelligence", false], [46, 0.126777, "-", false], [59943, 0.064647, " knowledge", false], [63370, 0.054055, " computation", false], [38853, 0.05125, " labor", false], [59917, 0.04144, " intuition", false], [59683, 0.02794, " expertise", false], [52022, 0.02161, " insight", false], [38775, 0.019138, " ingen", false], [59304, 0.018953, " cognition", false]]], "model_b": [59943, 4, 0.05314521864056587, [[46, 0.216237, "-", false], [64452, 0.105285, " intelligence", false], [59683, 0.064382, " expertise", false], [59943, 0.053145, " knowledge", false], [59304, 0.043249, " cognition", false], [61979, 0.023957, " experience", false], [60323, 0.02315, " reasoning", false], [59917, 0.022394, " intuition", false], [63370, 0.022163, " computation", false], [4715, 0.017547, " or", false]]]}, "raw_delta": -0.02031250000000001, "tuned_delta": 0.03377709741507558}, {"byte_start": 493, "byte_end": 499, "display": {"text": " would", "kind": "normal"}, "is_word": true, "word_id": 86, "word_key": " would", "bytes_hex": "20 77 6f 75 6c 64", "compression": {"model_a": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84%", "model_b": "4.53% 4.53% 4.53% 4.53% 4.53% 4.53%"}, "model_tokens": {"model_a": [[40219, " would", "normal", 0.07254761457443237]], "model_b": [[40219, " would", "normal", 0.22177395224571228]]}, "loss": {"model_a": 7.842775775665913, "model_b": 4.531903367375812}, "topk": {"model_a": [40219, 3, 0.07254761457443237, [[4600, 0.283654, " is", false], [21265, 0.121108, " and", false], [40219, 0.072548, " would", false], [4811, 0.044603, " to", false], [45, 0.034357, ",", false], [22748, 0.029148, " was", false], [4715, 0.02871, " or", false], [4596, 0.027646, " in", false], [4706, 0.021113, " of", false], [21413, 0.020752, " can", false]]], "model_b": [40219, 1, 0.22177395224571228, [[40219, 0.221774, " would", false], [21265, 0.162887, " and", false], [4600, 0.138199, " is", false], [4811, 0.047178, " to", false], [4715, 0.036995, " or", false], [45, 0.036742, ",", false], [4706, 0.024215, " of", false], [4423, 0.020496, " as", false], [21700, 0.01908, " for", false], [38128, 0.017879, " could", false]]]}, "raw_delta": 0.18359375, "tuned_delta": 0.23768334741507557}, {"byte_start": 499, "byte_end": 502, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 87, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "2.61% 2.61% 2.61%", "model_b": "4.39% 4.39% 4.39%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.6493578553199768]], "model_b": [[4435, " be", "normal", 0.4763592779636383]]}, "loss": {"model_a": 2.606431470356037, "model_b": 4.391015179789}, "topk": {"model_a": [4435, 1, 0.6493578553199768, [[4435, 0.649358, " be", false], [31059, 0.078901, " have", false], [22187, 0.022228, " not", false], [31358, 0.014631, " make", false], [39820, 0.013749, " still", false], [45150, 0.013105, " always", false], [31967, 0.012157, " seem", false], [31581, 0.008333, " only", false], [52724, 0.006661, " require", false], [53056, 0.005835, " suffice", false]]], "model_b": [4435, 1, 0.4763592779636383, [[4435, 0.476359, " be", false], [31059, 0.076468, " have", false], [31358, 0.043797, " make", false], [22187, 0.040431, " not", false], [39820, 0.018949, " still", false], [45150, 0.018423, " always", false], [53056, 0.01761, " suffice", false], [46439, 0.014728, " likely", false], [32499, 0.014215, " work", false], [40239, 0.011674, " yield", false]]]}, "raw_delta": -0.09895833333333333, "tuned_delta": -0.04486873591825774}, {"byte_start": 502, "byte_end": 506, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 88, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"model_a": "25.92% 25.92% 25.92% 25.92%", "model_b": "31.56% 31.56% 31.56% 31.56%"}, "model_tokens": {"model_a": [[22226, " one", "normal", 0.003145243041217327]], "model_b": [[22226, " one", "normal", 0.0009174319566227496]]}, "loss": {"model_a": 25.92342651597356, "model_b": 31.55895401944607}, "topk": {"model_a": [22226, 47, 0.003145243041217327, [[22590, 0.309162, " the", false], [332, 0.095442, " a", false], [52371, 0.032758, " optimal", false], [31458, 0.032095, " more", false], [31461, 0.028556, " most", false], [4419, 0.023288, " an", false], [31466, 0.016389, " much", false], [62606, 0.015595, " sufficient", false], [32386, 0.015147, " very", false], [59829, 0.013637, " important", false]]], "model_b": [22226, 123, 0.0009174319566227496, [[22590, 0.220126, " the", false], [332, 0.079204, " a", false], [31458, 0.045096, " more", false], [62606, 0.025165, " sufficient", false], [4419, 0.018391, " an", false], [60186, 0.01702, " pointless", false], [52371, 0.016324, " optimal", false], [62082, 0.015004, " impossible", false], [31466, 0.014277, " much", false], [4706, 0.012141, " of", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.2584104025849244}, {"byte_start": 506, "byte_end": 509, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 89, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "3.05% 3.05% 3.05%", "model_b": "9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.6023615598678589]], "model_b": [[4706, " of", "normal", 0.21685448288917542]]}, "loss": {"model_a": 3.052577397714278, "model_b": 9.157732193142833}, "topk": {"model_a": [4706, 1, 0.6023615598678589, [[4706, 0.602362, " of", false], [22752, 0.073385, " way", false], [39941, 0.05559, " thing", false], [460, 0.03488, "'s", false], [55532, 0.028022, " approach", false], [56895, 0.0144, " possible", false], [46713, 0.012885, " option", false], [46561, 0.01138, " method", false], [57260, 0.010802, " solution", false], [57317, 0.007598, " strategy", false]]], "model_b": [4706, 1, 0.21685448288917542, [[4706, 0.216854, " of", false], [22752, 0.204437, " way", false], [46713, 0.062772, " option", false], [56895, 0.042045, " possible", false], [57260, 0.041434, " solution", false], [55532, 0.031019, " approach", false], [63770, 0.018349, " possibility", false], [39941, 0.016005, " thing", false], [47284, 0.012605, " simple", false], [46561, 0.011881, " method", false]]]}, "raw_delta": -0.3385416666666667, "tuned_delta": -0.2844520692515911}, {"byte_start": 509, "byte_end": 513, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 90, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.20% 0.20% 0.20% 0.20%", "model_b": "0.53% 0.53% 0.53% 0.53%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.9564296007156372]], "model_b": [[22590, " the", "normal", 0.8889596462249756]]}, "loss": {"model_a": 0.20142608069052145, "model_b": 0.5327334593126359}, "topk": {"model_a": [22590, 1, 0.9564296007156372, [[22590, 0.95643, " the", false], [21902, 0.006275, " its", false], [52869, 0.005485, " several", false], [31370, 0.00482, " many", false], [22638, 0.003368, " two", false], [31581, 0.002841, " only", false], [21674, 0.002612, " few", false], [332, 0.002472, " a", false], [45, 0.00179, ",", false], [22248, 0.001758, " our", false]]], "model_b": [22590, 1, 0.8889596462249756, [[22590, 0.88896, " the", false], [21902, 0.043021, " its", false], [31370, 0.02138, " many", false], [22248, 0.00864, " our", false], [52869, 0.007842, " several", false], [332, 0.004375, " a", false], [31581, 0.002479, " only", false], [32515, 0.001966, " your", false], [22638, 0.00189, " two", false], [37045, 0.001185, " Moore", false]]]}, "raw_delta": -0.01837158203125, "tuned_delta": 0.03571801538382559}, {"byte_start": 513, "byte_end": 518, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 91, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "12.74% 12.74% 12.74% 12.74% 12.74%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.02967231720685959]], "model_b": [[31581, " only", "normal", 0.02747766301035881]]}, "loss": {"model_a": 12.73629215784788, "model_b": 12.96171325798678}, "topk": {"model_a": [31581, 6, 0.02967231720685959, [[31461, 0.423654, " most", false], [30273, 0.101899, " best", false], [21674, 0.072791, " few", false], [51039, 0.051311, " biggest", false], [31458, 0.032277, " more", false], [31581, 0.029672, " only", false], [31356, 0.026761, " main", false], [51900, 0.013557, " hardest", false], [38879, 0.013002, " least", false], [51718, 0.012076, " fastest", false]]], "model_b": [31581, 5, 0.02747766301035881, [[31461, 0.291003, " most", false], [30273, 0.195332, " best", false], [21674, 0.050891, " few", false], [51039, 0.041364, " biggest", false], [31581, 0.027478, " only", false], [31458, 0.022115, " more", false], [56331, 0.01852, " greatest", false], [31356, 0.018079, " main", false], [45301, 0.0172, " better", false], [32448, 0.015963, " ways", false]]]}, "raw_delta": -0.012499999999999956, "tuned_delta": 0.04158959741507563}, {"byte_start": 518, "byte_end": 523, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 92, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "3.66% 3.66% 3.66% 3.66% 3.66%", "model_b": "5.75% 5.75% 5.75% 5.75% 5.75%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.36083072423934937]], "model_b": [[32448, " ways", "normal", 0.20203453302383423]]}, "loss": {"model_a": 3.6630928772571334, "model_b": 5.748238053541963}, "topk": {"model_a": [32448, 1, 0.36083072423934937, [[32448, 0.360831, " ways", false], [59593, 0.078728, " effective", false], [47539, 0.069458, " things", false], [52373, 0.038043, " options", false], [52957, 0.023711, " sources", false], [56895, 0.02279, " possible", false], [47720, 0.021107, " viable", false], [52224, 0.020653, " methods", false], [60376, 0.019046, " remaining", false], [56212, 0.009926, " feasible", false]]], "model_b": [32448, 1, 0.20203453302383423, [[32448, 0.202035, " ways", false], [47720, 0.113719, " viable", false], [52373, 0.073724, " options", false], [59593, 0.066909, " effective", false], [47539, 0.037817, " things", false], [60521, 0.029596, " solutions", false], [60212, 0.028567, " practical", false], [62431, 0.028522, " reasonable", false], [56895, 0.018644, " possible", false], [51185, 0.016201, " choices", false]]]}, "raw_delta": -0.11562499999999998, "tuned_delta": -0.06153540258492439}, {"byte_start": 523, "byte_end": 526, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 93, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.25% 1.25% 1.25%", "model_b": "1.50% 1.50% 1.50%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8142113089561462]], "model_b": [[4811, " to", "normal", 0.7791807651519775]]}, "loss": {"model_a": 1.2503826648329637, "model_b": 1.5028073342593367}, "topk": {"model_a": [4811, 1, 0.8142113089561462, [[4811, 0.814211, " to", false], [4706, 0.04424, " of", false], [21700, 0.041475, " for", false], [4596, 0.02162, " in", false], [32227, 0.014735, " that", false], [22590, 0.010563, " the", false], [22799, 0.00714, " you", false], [51791, 0.005268, " forward", false], [4601, 0.004944, " it", false], [4858, 0.004208, " we", false]]], "model_b": [4811, 1, 0.7791807651519775, [[4811, 0.779181, " to", false], [4706, 0.044776, " of", false], [51791, 0.044331, " forward", false], [21700, 0.022193, " for", false], [32227, 0.01524, " that", false], [499, 0.009438, ").", false], [4858, 0.009118, " we", false], [22249, 0.008284, " out", false], [22590, 0.007879, " the", false], [45202, 0.004898, " around", false]]]}, "raw_delta": -0.013997395833333329, "tuned_delta": 0.04009220158174226}, {"byte_start": 526, "byte_end": 534, "display": {"text": " improve", "kind": "normal"}, "is_word": true, "word_id": 94, "word_key": " improve", "bytes_hex": "20 69 6d 70 72 6f 76 65", "compression": {"model_a": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15%", "model_b": "4.24% 4.24% 4.24% 4.24% 4.24% 4.24% 4.24% 4.24%"}, "model_tokens": {"model_a": [[51982, " improve", "normal", 0.24621953070163727]], "model_b": [[51982, " improve", "normal", 0.1509026437997818]]}, "loss": {"model_a": 3.1523731972549367, "model_b": 4.244256651052736}, "topk": {"model_a": [51982, 1, 0.24621953070163727, [[51982, 0.24622, " improve", false], [21751, 0.111641, " get", false], [31358, 0.076892, " make", false], [30938, 0.068315, " gain", false], [56433, 0.067356, " increase", false], [50848, 0.02381, " achieve", false], [37886, 0.019291, " boost", false], [39590, 0.016851, " scale", false], [46694, 0.014257, " obtain", false], [56950, 0.011286, " progress", false]]], "model_b": [51982, 1, 0.1509026437997818, [[51982, 0.150903, " improve", false], [21751, 0.101106, " get", false], [50848, 0.08956, " achieve", false], [31358, 0.051881, " make", false], [56433, 0.045323, " increase", false], [39740, 0.029983, " solve", false], [39590, 0.026553, " scale", false], [30938, 0.023184, " gain", false], [4491, 0.020356, " do", false], [47030, 0.019581, " reduce", false]]]}, "raw_delta": -0.060546875, "tuned_delta": -0.006457277584924412}, {"byte_start": 534, "byte_end": 546, "display": {"text": " performance", "kind": "normal"}, "is_word": true, "word_id": 95, "word_key": " performance", "bytes_hex": "20 70 65 72 66 6f 72 6d 61 6e 63 65", "compression": {"model_a": "1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50%", "model_b": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"model_a": [[63750, " performance", "normal", 0.36821308732032776]], "model_b": [[63750, " performance", "normal", 0.4797111451625824]]}, "loss": {"model_a": 1.4969369931098861, "model_b": 1.1153648183956018}, "topk": {"model_a": [63750, 1, 0.36821308732032776, [[63750, 0.368213, " performance", false], [22590, 0.107144, " the", false], [499, 0.100461, ").", false], [497, 0.084869, "),", false], [37636, 0.040538, " agent", false], [21902, 0.026867, " its", false], [42, 0.024772, ")", false], [3609, 0.021786, " AI", false], [52738, 0.016742, " results", false], [4712, 0.014022, " on", false]]], "model_b": [63750, 1, 0.4797111451625824, [[63750, 0.479711, " performance", false], [22590, 0.152669, " the", false], [499, 0.030851, ").", false], [52738, 0.023203, " results", false], [61923, 0.016509, " efficiency", false], [4419, 0.014732, " an", false], [21902, 0.01388, " its", false], [32350, 0.012724, " upon", false], [3609, 0.012117, " AI", false], [497, 0.0118, "),", false]]]}, "raw_delta": 0.02115885416666666, "tuned_delta": 0.07524845158174225}, {"byte_start": 546, "byte_end": 547, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "52.13%", "model_b": "45.65%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.05620365962386131]], "model_b": [[42, ")", "normal", 0.08062120527029037]]}, "loss": {"model_a": 52.12862940712074, "model_b": 45.647772778127354}, "topk": {"model_a": [42, 3, 0.05620365962386131, [[499, 0.436642, ").", false], [497, 0.350471, "),", false], [42, 0.056204, ")", false], [45, 0.039232, ",", false], [502, 0.022127, ");", false], [580, 0.012594, ".)", false], [31601, 0.004716, " over", false], [4712, 0.004529, " on", false], [45302, 0.003999, " beyond", false], [53356, 0.003695, " without", false]]], "model_b": [42, 3, 0.08062120527029037, [[499, 0.460893, ").", false], [497, 0.289097, "),", false], [42, 0.080621, ")", false], [45, 0.029059, ",", false], [53356, 0.014699, " without", false], [31601, 0.010458, " over", false], [21265, 0.009615, " and", false], [4596, 0.00795, " in", false], [502, 0.007486, ");", false], [4712, 0.006267, " on", false]]]}, "raw_delta": 0.359375, "tuned_delta": 0.4134645974150756}, {"byte_start": 547, "byte_end": 551, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 96, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "6.97% 6.97% 6.97% 6.97%", "model_b": "7.15% 7.15% 7.15% 7.15%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.21142247319221497]], "model_b": [[21400, " but", "normal", 0.20521263778209686]]}, "loss": {"model_a": 6.9739652855472345, "model_b": 7.15007552003075}, "topk": {"model_a": [21400, 3, 0.21142247319221497, [[4715, 0.267768, " or", false], [21265, 0.226245, " and", false], [21400, 0.211422, " but", false], [47001, 0.030983, " rather", false], [40187, 0.030587, " while", false], [32465, 0.027229, " when", false], [53339, 0.01865, " whereas", false], [280, 0.015949, " -", false], [40186, 0.015909, " which", false], [4788, 0.014765, " so", false]]], "model_b": [21400, 3, 0.20521263778209686, [[21265, 0.315356, " and", false], [4715, 0.271999, " or", false], [21400, 0.205213, " but", false], [47001, 0.025807, " rather", false], [40187, 0.023741, " while", false], [53339, 0.015101, " whereas", false], [22898, 0.009727, " —", false], [22897, 0.00962, " –", false], [3460, 0.009014, " --", false], [52028, 0.00779, " instead", false]]]}, "raw_delta": -0.009765625, "tuned_delta": 0.04432397241507559}, {"byte_start": 551, "byte_end": 552, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "71.01%", "model_b": "66.50%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.01958964765071869]], "model_b": [[45, ",", "normal", 0.025223104283213615]]}, "loss": {"model_a": 71.00764654375367, "model_b": 66.49922454097565}, "topk": {"model_a": [45, 9, 0.01958964765071869, [[4596, 0.17061, " in", false], [32234, 0.147972, " this", false], [22590, 0.133822, " the", false], [32227, 0.077687, " that", false], [37045, 0.043538, " Moore", false], [4601, 0.039977, " it", false], [4423, 0.029204, " as", false], [4858, 0.026044, " we", false], [45, 0.01959, ",", false], [39934, 0.011875, " there", false]]], "model_b": [45, 7, 0.025223104283213615, [[4596, 0.19518, " in", false], [32234, 0.122398, " this", false], [22590, 0.119, " the", false], [4601, 0.049701, " it", false], [4423, 0.044667, " as", false], [32227, 0.042026, " that", false], [45, 0.025223, ",", false], [4858, 0.017608, " we", false], [32487, 0.016267, " with", false], [37045, 0.015465, " Moore", false]]]}, "raw_delta": 0.25, "tuned_delta": 0.3040895974150756}, {"byte_start": 552, "byte_end": 557, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 97, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "19.16% 19.16% 19.16% 19.16% 19.16%", "model_b": "17.81% 17.81% 17.81% 17.81% 17.81%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.004932222422212362]], "model_b": [[31601, " over", "normal", 0.007031806278973818]]}, "loss": {"model_a": 19.160793511806542, "model_b": 17.808266910973142}, "topk": {"model_a": [31601, 21, 0.004932222422212362, [[4596, 0.326112, " in", false], [4423, 0.296477, " as", false], [4706, 0.035262, " of", false], [32487, 0.018424, " with", false], [47532, 0.01812, " thanks", false], [21700, 0.016462, " for", false], [4588, 0.011504, " if", false], [4450, 0.009814, " by", false], [4811, 0.009197, " to", false], [4424, 0.008497, " at", false]]], "model_b": [31601, 18, 0.007031806278973818, [[4596, 0.351457, " in", false], [4423, 0.242373, " as", false], [4706, 0.015839, " of", false], [32487, 0.015109, " with", false], [4424, 0.013581, " at", false], [4588, 0.012681, " if", false], [21700, 0.012108, " for", false], [22590, 0.011567, " the", false], [38594, 0.010908, " given", false], [32465, 0.010246, " when", false]]]}, "raw_delta": 0.07499999999999996, "tuned_delta": 0.12908959741507553}, {"byte_start": 557, "byte_end": 559, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 98, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "40.86% 40.86%", "model_b": "41.14% 41.14%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.010926105082035065]], "model_b": [[332, " a", "normal", 0.01030950527638197]]}, "loss": {"model_a": 40.857574400175714, "model_b": 41.13935077534934}, "topk": {"model_a": [332, 5, 0.010926105082035065, [[22590, 0.661074, " the", false], [32251, 0.19141, " time", false], [3543, 0.027993, " 70", false], [51396, 0.013112, " decades", false], [332, 0.010926, " a", false], [32234, 0.0098, " this", false], [21265, 0.007761, " and", false], [37045, 0.005412, " Moore", false], [21256, 0.004755, " all", false], [31370, 0.004583, " many", false]]], "model_b": [332, 3, 0.01030950527638197, [[22590, 0.624184, " the", false], [32251, 0.28875, " time", false], [332, 0.01031, " a", false], [3543, 0.008533, " 70", false], [21265, 0.008254, " and", false], [47014, 0.007861, " recent", false], [51396, 0.006274, " decades", false], [31370, 0.00464, " many", false], [32234, 0.003786, " this", false], [39936, 0.002084, " these", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 559, "byte_end": 568, "display": {"text": " slightly", "kind": "normal"}, "is_word": true, "word_id": 99, "word_key": " slightly", "bytes_hex": "20 73 6c 69 67 68 74 6c 79", "compression": {"model_a": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%", "model_b": "18.53% 18.53% 18.53% 18.53% 18.53% 18.53% 18.53% 18.53% 18.53%"}, "model_tokens": {"model_a": [[57245, " slightly", "normal", 0.00027180774486623704]], "model_b": [[57245, " slightly", "normal", 9.719048830447719e-05]]}, "loss": {"model_a": 16.405646732331093, "model_b": 18.534623789198484}, "topk": {"model_a": [57245, 160, 0.00027180774486623704, [[3543, 0.352651, " 70", false], [46790, 0.081259, " period", false], [31323, 0.072853, " long", false], [32251, 0.028968, " time", false], [32386, 0.028762, " very", false], [51158, 0.027304, " century", false], [46470, 0.024455, " longer", false], [32470, 0.019755, " wide", false], [39962, 0.019684, " times", false], [38864, 0.017952, " large", false]]], "model_b": [57245, 296, 9.719048830447719e-05, [[46790, 0.189173, " period", false], [31323, 0.134184, " long", false], [38864, 0.056474, " large", false], [51158, 0.056362, " century", false], [45674, 0.049264, " decade", false], [46470, 0.042823, " longer", false], [32386, 0.026357, " very", false], [32470, 0.023927, " wide", false], [3543, 0.023562, " 70", false], [32091, 0.02303, " span", false]]]}, "raw_delta": -0.11805555555555546, "tuned_delta": -0.06396595814047987}, {"byte_start": 568, "byte_end": 575, "display": {"text": " longer", "kind": "normal"}, "is_word": true, "word_id": 100, "word_key": " longer", "bytes_hex": "20 6c 6f 6e 67 65 72", "compression": {"model_a": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "model_b": "1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22%"}, "model_tokens": {"model_a": [[46470, " longer", "normal", 0.8115249872207642]], "model_b": [[46470, " longer", "normal", 0.622844934463501]]}, "loss": {"model_a": 0.5409100059136565, "model_b": 1.2176764784288818}, "topk": {"model_a": [46470, 1, 0.8115249872207642, [[46470, 0.811525, " longer", false], [52888, 0.062396, " shorter", false], [46397, 0.029515, " larger", false], [31458, 0.02152, " more", false], [40192, 0.012926, " wider", false], [59513, 0.008585, " different", false], [51093, 0.007774, " broader", false], [31277, 0.007634, " less", false], [52932, 0.006084, " smaller", false], [56189, 0.005376, " extended", false]]], "model_b": [46470, 1, 0.622844934463501, [[46470, 0.622845, " longer", false], [52888, 0.081618, " shorter", false], [46397, 0.065655, " larger", false], [31458, 0.056163, " more", false], [59513, 0.022367, " different", false], [40192, 0.015843, " wider", false], [56189, 0.013212, " extended", false], [31277, 0.01243, " less", false], [52932, 0.011536, " smaller", false], [51093, 0.009459, " broader", false]]]}, "raw_delta": -0.03752790178571428, "tuned_delta": 0.016561695629361307}, {"byte_start": 575, "byte_end": 580, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 101, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "2.86% 2.86% 2.86% 2.86% 2.86%", "model_b": "3.41% 3.41% 3.41% 3.41% 3.41%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.45157119631767273]], "model_b": [[32251, " time", "normal", 0.3899119198322296]]}, "loss": {"model_a": 2.8600302080123003, "model_b": 3.40949413960087}, "topk": {"model_a": [32251, 1, 0.45157119631767273, [[32251, 0.451571, " time", false], [46790, 0.231621, " period", false], [39962, 0.15603, " times", false], [51940, 0.057501, " horizon", false], [51929, 0.012244, " history", false], [57431, 0.010235, " timeline", false], [32219, 0.009432, " term", false], [32091, 0.006999, " span", false], [62061, 0.004207, " historical", false], [46, 0.004151, "-", false]]], "model_b": [32251, 1, 0.3899119198322296, [[32251, 0.389912, " time", false], [46790, 0.206663, " period", false], [51940, 0.111585, " horizon", false], [39962, 0.066644, " times", false], [22418, 0.018283, " run", false], [57431, 0.018002, " timeline", false], [47797, 0.01551, " window", false], [51929, 0.015161, " history", false], [32219, 0.014328, " term", false], [39438, 0.014041, " range", false]]]}, "raw_delta": -0.03046874999999999, "tuned_delta": 0.0236208474150756}, {"byte_start": 580, "byte_end": 585, "display": {"text": " than", "kind": "normal"}, "is_word": true, "word_id": 102, "word_key": " than", "bytes_hex": "20 74 68 61 6e", "compression": {"model_a": "18.71% 18.71% 18.71% 18.71% 18.71%", "model_b": "21.53% 21.53% 21.53% 21.53% 21.53%"}, "model_tokens": {"model_a": [[32226, " than", "normal", 0.005589666310697794]], "model_b": [[32226, " than", "normal", 0.0025489346589893103]]}, "loss": {"model_a": 18.709951311528744, "model_b": 21.527715063265}, "topk": {"model_a": [32226, 11, 0.005589666310697794, [[51940, 0.228612, " horizon", false], [38549, 0.175132, " frame", false], [39590, 0.152856, " scale", false], [46790, 0.144326, " period", false], [34478, 0.11341, "frame", false], [32091, 0.061881, " span", false], [46, 0.059069, "-", false], [45, 0.023141, ",", false], [47797, 0.00688, " window", false], [56485, 0.006755, " interval", false]]], "model_b": [32226, 12, 0.0025489346589893103, [[51940, 0.231179, " horizon", false], [34478, 0.206717, "frame", false], [38549, 0.166634, " frame", false], [39590, 0.137143, " scale", false], [46790, 0.074921, " period", false], [32091, 0.068249, " span", false], [46, 0.053194, "-", false], [45, 0.018885, ",", false], [47797, 0.011668, " window", false], [39438, 0.005271, " range", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10216040258492441}, {"byte_start": 585, "byte_end": 587, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 103, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "33.11% 33.11%", "model_b": "37.19% 37.19%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.025658704340457916]], "model_b": [[332, " a", "normal", 0.01650160364806652]]}, "loss": {"model_a": 33.10872408290101, "model_b": 37.194481522918586}, "topk": {"model_a": [332, 8, 0.025658704340457916, [[22590, 0.213247, " the", false], [37045, 0.177998, " Moore", false], [32227, 0.119683, " that", false], [3543, 0.097836, " 70", false], [32234, 0.036235, " this", false], [4858, 0.034825, " we", false], [4601, 0.030683, " it", false], [332, 0.025659, " a", false], [22799, 0.02395, " you", false], [22226, 0.014899, " one", false]]], "model_b": [332, 12, 0.01650160364806652, [[37045, 0.089588, " Moore", false], [32227, 0.088009, " that", false], [4858, 0.078353, " we", false], [22590, 0.076212, " the", false], [31461, 0.058427, " most", false], [32234, 0.053512, " this", false], [4600, 0.04992, " is", false], [3543, 0.029607, " 70", false], [56175, 0.029218, " expected", false], [46227, 0.022025, " humans", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17247290258492443}, {"byte_start": 587, "byte_end": 595, "display": {"text": " typical", "kind": "normal"}, "is_word": true, "word_id": 104, "word_key": " typical", "bytes_hex": "20 74 79 70 69 63 61 6c", "compression": {"model_a": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "model_b": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"model_a": [[53216, " typical", "normal", 0.05195503309369087]], "model_b": [[53216, " typical", "normal", 0.04979708790779114]]}, "loss": {"model_a": 6.656966863476906, "model_b": 6.762633004167015}, "topk": {"model_a": [53216, 5, 0.05195503309369087, [[38720, 0.225584, " human", false], [51158, 0.140021, " century", false], [45674, 0.123761, " decade", false], [47289, 0.055681, " single", false], [53216, 0.051955, " typical", false], [3543, 0.046264, " 70", false], [32512, 0.041299, " year", false], [21674, 0.026703, " few", false], [62035, 0.023279, " generation", false], [56546, 0.022834, " lifetime", false]]], "model_b": [53216, 6, 0.04979708790779114, [[21674, 0.150948, " few", false], [38720, 0.14288, " human", false], [32512, 0.121647, " year", false], [45674, 0.116825, " decade", false], [47289, 0.064888, " single", false], [53216, 0.049797, " typical", false], [46677, 0.022993, " normal", false], [45602, 0.018266, " couple", false], [62035, 0.017435, " generation", false], [51158, 0.013141, " century", false]]]}, "raw_delta": -0.005859375, "tuned_delta": 0.04823022241507559}, {"byte_start": 595, "byte_end": 604, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 105, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60%", "model_b": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.10117557644844055]], "model_b": [[57103, " research", "normal", 0.08086008578538895]]}, "loss": {"model_a": 4.602347461169218, "model_b": 5.040666266994859}, "topk": {"model_a": [57103, 3, 0.10117557644844055, [[38720, 0.224203, " human", false], [3609, 0.155414, " AI", false], [57103, 0.101176, " research", false], [45418, 0.064269, " career", false], [56546, 0.034277, " lifetime", false], [37636, 0.032286, " agent", false], [46795, 0.023784, " person", false], [55427, 0.022258, " academic", false], [62496, 0.017639, " researcher", false], [31293, 0.016912, " life", false]]], "model_b": [57103, 3, 0.08086008578538895, [[38720, 0.162298, " human", false], [3609, 0.103938, " AI", false], [57103, 0.08086, " research", false], [55809, 0.039197, " computer", false], [37045, 0.034223, " Moore", false], [46795, 0.024908, " person", false], [37636, 0.01892, " agent", false], [3543, 0.015191, " 70", false], [32512, 0.013258, " year", false], [62496, 0.012746, " researcher", false]]]}, "raw_delta": -0.02430555555555558, "tuned_delta": 0.029784041859520008}, {"byte_start": 604, "byte_end": 612, "display": {"text": " project", "kind": "normal"}, "is_word": true, "word_id": 106, "word_key": " project", "bytes_hex": "20 70 72 6f 6a 65 63 74", "compression": {"model_a": "6.87% 6.87% 6.87% 6.87% 6.87% 6.87% 6.87% 6.87%", "model_b": "2.02% 2.02% 2.02% 2.02% 2.02% 2.02% 2.02% 2.02%"}, "model_tokens": {"model_a": [[52581, " project", "normal", 0.04778331145644188]], "model_b": [[52581, " project", "normal", 0.4112006425857544]]}, "loss": {"model_a": 6.868299144857125, "model_b": 2.0164621848362585}, "topk": {"model_a": [52581, 3, 0.04778331145644188, [[45418, 0.69158, " career", false], [56546, 0.070966, " lifetime", false], [52581, 0.047783, " project", false], [38172, 0.040292, " cycle", false], [46790, 0.021795, " period", false], [31293, 0.017644, " life", false], [52580, 0.012708, " program", false], [56545, 0.010023, " lifespan", false], [39227, 0.008893, " paper", false], [51136, 0.004323, " careers", false]]], "model_b": [52581, 1, 0.4112006425857544, [[52581, 0.411201, " project", false], [46790, 0.08986, " period", false], [39227, 0.048813, " paper", false], [52580, 0.048518, " program", false], [45418, 0.041319, " career", false], [32512, 0.035189, " year", false], [31293, 0.029746, " life", false], [38172, 0.026944, " cycle", false], [51940, 0.016751, " horizon", false], [60455, 0.014366, " scientist", false]]]}, "raw_delta": 0.26904296875, "tuned_delta": 0.3231325661650756}, {"byte_start": 612, "byte_end": 613, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "4.51%", "model_b": "3.70%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.7766553163528442]], "model_b": [[45, ",", "normal", 0.8142263889312744]]}, "loss": {"model_a": 4.50842200277801, "model_b": 3.6983149241538364}, "topk": {"model_a": [45, 1, 0.7766553163528442, [[45, 0.776655, ",", false], [38867, 0.031888, " lasts", false], [40219, 0.021599, " would", false], [275, 0.019371, " (", false], [39751, 0.016786, " spans", false], [460, 0.012185, "'s", false], [4600, 0.007147, " is", false], [4596, 0.006393, " in", false], [39021, 0.006077, " might", false], [32091, 0.006073, " span", false]]], "model_b": [45, 1, 0.8142263889312744, [[45, 0.814226, ",", false], [275, 0.025381, " (", false], [40219, 0.019554, " would", false], [4596, 0.011509, " in", false], [39021, 0.00803, " might", false], [21413, 0.007948, " can", false], [4600, 0.007197, " is", false], [4706, 0.005356, " of", false], [21800, 0.005119, " has", false], [39971, 0.005085, " today", false]]]}, "raw_delta": 0.044921875, "tuned_delta": 0.09901147241507559}, {"byte_start": 613, "byte_end": 623, "display": {"text": " massively", "kind": "normal"}, "is_word": true, "word_id": 107, "word_key": " massively", "bytes_hex": "20 6d 61 73 73 69 76 65 6c 79", "compression": {"model_a": "15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44%", "model_b": "15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55% 15.55%"}, "model_tokens": {"model_a": [[59988, " massively", "normal", 0.00019152526510879397]], "model_b": [[59988, " massively", "normal", 0.00017751925042830408]]}, "loss": {"model_a": 15.441345359514685, "model_b": 15.554055909584136}, "topk": {"model_a": [59988, 216, 0.00019152526510879397, [[22590, 0.256342, " the", false], [63370, 0.097579, " computation", false], [32234, 0.088188, " this", false], [37045, 0.069253, " Moore", false], [4858, 0.068895, " we", false], [4601, 0.035164, " it", false], [32227, 0.034894, " that", false], [39934, 0.025479, " there", false], [59346, 0.017852, " computing", false], [3609, 0.015093, " AI", false]]], "model_b": [59988, 249, 0.00017751925042830408, [[22590, 0.256063, " the", false], [32234, 0.095693, " this", false], [4858, 0.086209, " we", false], [4601, 0.064041, " it", false], [37045, 0.049764, " Moore", false], [3609, 0.038718, " AI", false], [32227, 0.022909, " that", false], [31461, 0.015561, " most", false], [332, 0.015343, " a", false], [39934, 0.013068, " there", false]]]}, "raw_delta": -0.006250000000000089, "tuned_delta": 0.0478395974150755}, {"byte_start": 623, "byte_end": 628, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 108, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "5.27% 5.27% 5.27% 5.27% 5.27%", "model_b": "10.43% 10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.23121775686740875]], "model_b": [[31458, " more", "normal", 0.05581330135464668]]}, "loss": {"model_a": 5.2692182157467995, "model_b": 10.425725881424148}, "topk": {"model_a": [31458, 2, 0.23121775686740875, [[56812, 0.313952, " parallel", false], [31458, 0.231218, " more", false], [62092, 0.072949, " increasing", false], [59846, 0.053951, " increased", false], [56418, 0.049645, " improved", false], [56900, 0.023781, " powerful", false], [51178, 0.017607, " cheaper", false], [45301, 0.017191, " better", false], [45961, 0.01161, " faster", false], [59832, 0.011259, " improving", false]]], "model_b": [31458, 3, 0.05581330135464668, [[56812, 0.439301, " parallel", false], [59846, 0.076666, " increased", false], [31458, 0.055813, " more", false], [62092, 0.049708, " increasing", false], [56418, 0.037491, " improved", false], [47180, 0.034398, " scaled", false], [46, 0.024587, "-", false], [59847, 0.022329, " increases", false], [52805, 0.011684, " scaling", false], [57160, 0.010569, " scalable", false]]]}, "raw_delta": -0.2859375, "tuned_delta": -0.23184790258492444}, {"byte_start": 628, "byte_end": 640, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 109, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75%", "model_b": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.3156513571739197]], "model_b": [[63370, " computation", "normal", 0.30992835760116577]]}, "loss": {"model_a": 1.7493616625362591, "model_b": 1.7611023448351601}, "topk": {"model_a": [63370, 1, 0.3156513571739197, [[63370, 0.315651, " computation", false], [59346, 0.137415, " computing", false], [51266, 0.083689, " compute", false], [64862, 0.048811, " computational", false], [56900, 0.037103, " powerful", false], [60406, 0.033935, " resources", false], [39339, 0.021235, " power", false], [21265, 0.016942, " and", false], [4600, 0.015517, " is", false], [59345, 0.014426, " computers", false]]], "model_b": [63370, 1, 0.30992835760116577, [[63370, 0.309928, " computation", false], [59346, 0.189154, " computing", false], [56900, 0.096591, " powerful", false], [64862, 0.090666, " computational", false], [51266, 0.034684, " compute", false], [21265, 0.022035, " and", false], [30579, 0.019527, " data", false], [59594, 0.016508, " efficient", false], [60406, 0.010071, " resources", false], [39339, 0.009971, " power", false]]]}, "raw_delta": -0.0006510416666666713, "tuned_delta": 0.05343855574840892}, {"byte_start": 640, "byte_end": 651, "display": {"text": " inevitably", "kind": "normal"}, "is_word": true, "word_id": 110, "word_key": " inevitably", "bytes_hex": "20 69 6e 65 76 69 74 61 62 6c 79", "compression": {"model_a": "19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78%", "model_b": "14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55% 14.55%"}, "model_tokens": {"model_a": [[62110, " inevitably", "normal", 5.769015842815861e-06]], "model_b": [[62110, " inevitably", "normal", 0.00013813683472108096]]}, "loss": {"model_a": 19.775578330367185, "model_b": 14.549907372601758}, "topk": {"model_a": [62110, 463, 5.769015842815861e-06, [[21800, 0.462911, " has", false], [4600, 0.279003, " is", false], [45283, 0.052535, " became", false], [22748, 0.036816, " was", false], [51019, 0.033473, " becomes", false], [21265, 0.022726, " and", false], [32475, 0.015381, " will", false], [275, 0.012254, " (", false], [22278, 0.011554, " per", false], [45, 0.007277, ",", false]]], "model_b": [62110, 132, 0.00013813683472108096, [[4600, 0.27901, " is", false], [21800, 0.19108, " has", false], [51019, 0.145703, " becomes", false], [21413, 0.081405, " can", false], [45283, 0.034499, " became", false], [32475, 0.031488, " will", false], [22748, 0.030319, " was", false], [21265, 0.018362, " and", false], [39339, 0.018093, " power", false], [30965, 0.014382, " gets", false]]]}, "raw_delta": 0.28977272727272746, "tuned_delta": 0.34386232468780303}, {"byte_start": 651, "byte_end": 659, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 111, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"model_a": "0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74%", "model_b": "1.36% 1.36% 1.36% 1.36% 1.36% 1.36% 1.36% 1.36%"}, "model_tokens": {"model_a": [[51019, " becomes", "normal", 0.7213101983070374]], "model_b": [[51019, " becomes", "normal", 0.5490264892578125]]}, "loss": {"model_a": 0.7440657406928552, "model_b": 1.3560488055230733}, "topk": {"model_a": [51019, 1, 0.7213101983070374, [[51019, 0.72131, " becomes", false], [45283, 0.117142, " became", false], [38087, 0.01949, " comes", false], [50956, 0.017396, " arrives", false], [21800, 0.016516, " has", false], [4600, 0.008403, " is", false], [30965, 0.007021, " gets", false], [45199, 0.006348, " arises", false], [50935, 0.004519, " appears", false], [32475, 0.004497, " will", false]]], "model_b": [51019, 1, 0.5490264892578125, [[51019, 0.549026, " becomes", false], [38087, 0.064727, " comes", false], [45283, 0.057821, " became", false], [50956, 0.054065, " arrives", false], [30965, 0.033175, " gets", false], [51586, 0.019307, " emerges", false], [50935, 0.012908, " appears", false], [45871, 0.010969, " enters", false], [51775, 0.008913, " follows", false], [61525, 0.00721, " accumulate", false]]]}, "raw_delta": -0.033935546875, "tuned_delta": 0.020154050540075588}, {"byte_start": 659, "byte_end": 669, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 112, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.9487120509147644]], "model_b": [[59206, " available", "normal", 0.9495458602905273]]}, "loss": {"model_a": 0.09553980220730743, "model_b": 0.09201759751763713}, "topk": {"model_a": [59206, 1, 0.9487120509147644, [[59206, 0.948712, " available", false], [56895, 0.006483, " possible", false], [61551, 0.005481, " affordable", false], [51178, 0.004853, " cheaper", false], [38006, 0.004825, " cheap", false], [61519, 0.004383, " accessible", false], [56212, 0.00248, " feasible", false], [31458, 0.002234, " more", false], [30911, 0.001406, " free", false], [46042, 0.001353, " freely", false]]], "model_b": [59206, 1, 0.9495458602905273, [[59206, 0.949546, " available", false], [61519, 0.005374, " accessible", false], [31458, 0.005223, " more", false], [56895, 0.004086, " possible", false], [332, 0.002013, " a", false], [56212, 0.00187, " feasible", false], [51178, 0.001692, " cheaper", false], [22590, 0.001473, " the", false], [52648, 0.001212, " readily", false], [31633, 0.001148, " part", false]]]}, "raw_delta": 0.00019531250000000017, "tuned_delta": 0.05428490991507559}, {"byte_start": 669, "byte_end": 670, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "9.51%", "model_b": "11.27%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.592117428779602]], "model_b": [[47, ".", "normal", 0.5384531021118164]]}, "loss": {"model_a": 9.509952662109866, "model_b": 11.271055006945026}, "topk": {"model_a": [47, 1, 0.592117428779602, [[47, 0.592117, ".", false], [45, 0.158111, ",", false], [4811, 0.064404, " to", false], [21265, 0.028117, " and", false], [275, 0.02226, " (", false], [4423, 0.016115, " as", false], [4424, 0.011413, " at", false], [21700, 0.01025, " for", false], [32226, 0.007665, " than", false], [4596, 0.006672, " in", false]]], "model_b": [47, 1, 0.5384531021118164, [[47, 0.538453, ".", false], [45, 0.083335, ",", false], [4811, 0.078304, " to", false], [21265, 0.048123, " and", false], [275, 0.044029, " (", false], [4423, 0.02396, " as", false], [21700, 0.015196, " for", false], [4424, 0.013816, " at", false], [21572, 0.011621, " due", false], [32226, 0.011207, " than", false]]]}, "raw_delta": -0.09765625, "tuned_delta": -0.04356665258492441}, {"byte_start": 670, "byte_end": 675, "display": {"text": " Seek", "kind": "normal"}, "is_word": true, "word_id": 113, "word_key": " seek", "bytes_hex": "20 53 65 65 6b", "compression": {"model_a": "39.45% 39.45% 39.45% 39.45% 39.45%", "model_b": "39.90% 39.90% 39.90% 39.90% 39.90%"}, "model_tokens": {"model_a": [[29753, " Seek", "normal", 1.7948577806237154e-05]], "model_b": [[29753, " Seek", "normal", 1.5750472812214866e-05]]}, "loss": {"model_a": 39.44869252430759, "model_b": 39.899534724585386}, "topk": {"model_a": [29753, 976, 1.7948577806237154e-05, [[11, 0.250401, "\n", false], [29894, 0.107308, " This", false], [20996, 0.08133, " The", false], [261, 0.076909, "\n\n", false], [3913, 0.032213, " In", false], [3918, 0.022645, " It", false], [3641, 0.021672, " As", false], [19417, 0.018662, " And", false], [19907, 0.017877, " For", false], [4217, 0.015427, " So", false]]], "model_b": [29753, 1114, 1.5750472812214866e-05, [[11, 0.203931, "\n", false], [29894, 0.116088, " This", false], [20996, 0.099082, " The", false], [3913, 0.044174, " In", false], [261, 0.041504, "\n\n", false], [3641, 0.026683, " As", false], [19907, 0.017362, " For", false], [3918, 0.016623, " It", false], [3908, 0.014244, " If", false], [4217, 0.013712, " So", false]]]}, "raw_delta": -0.02499999999999991, "tuned_delta": 0.029089597415075677}, {"byte_start": 675, "byte_end": 678, "display": {"text": "ing", "kind": "normal"}, "is_word": true, "word_id": 114, "word_key": "ing", "bytes_hex": "69 6e 67", "compression": {"model_a": "0.28% 0.28% 0.28%", "model_b": "0.12% 0.12% 0.12%"}, "model_tokens": {"model_a": [[7856, "ing", "normal", 0.9542503952980042]], "model_b": [[7856, "ing", "normal", 0.9796226620674133]]}, "loss": {"model_a": 0.28177637517362564, "model_b": 0.12401095678214254}, "topk": {"model_a": [7856, 1, 0.9542503952980042, [[7856, 0.95425, "ing", false], [4811, 0.008674, " to", false], [22249, 0.008496, " out", false], [7500, 0.005057, "ers", false], [22590, 0.001892, " the", false], [332, 0.001526, " a", false], [21265, 0.000909, " and", false], [1857, 0.000888, "er", false], [116, 0.000688, "s", false], [21700, 0.000491, " for", false]]], "model_b": [7856, 1, 0.9796226620674133, [[7856, 0.979623, "ing", false], [22249, 0.004579, " out", false], [4811, 0.002479, " to", false], [7500, 0.001431, "ers", false], [22590, 0.001137, " the", false], [37634, 0.000821, " after", false], [31458, 0.000602, " more", false], [4601, 0.000564, " it", false], [21265, 0.000507, " and", false], [332, 0.000469, " a", false]]]}, "raw_delta": 0.008748372395833332, "tuned_delta": 0.06283796981090892}, {"byte_start": 678, "byte_end": 681, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 115, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"model_a": "26.30% 26.30% 26.30%", "model_b": "26.11% 26.11% 26.11%"}, "model_tokens": {"model_a": [[4419, " an", "normal", 0.01238006167113781]], "model_b": [[4419, " an", "normal", 0.012927494011819363]]}, "loss": {"model_a": 26.299128349538393, "model_b": 26.111277432755976}, "topk": {"model_a": [4419, 11, 0.01238006167113781, [[4811, 0.391225, " to", false], [22249, 0.066677, " out", false], [332, 0.05737, " a", false], [52224, 0.042022, " methods", false], [51832, 0.038991, " general", false], [22590, 0.038221, " the", false], [32448, 0.037766, " ways", false], [30789, 0.015751, " ever", false], [59943, 0.014556, " knowledge", false], [31458, 0.013507, " more", false]]], "model_b": [4419, 9, 0.012927494011819363, [[4811, 0.492216, " to", false], [22590, 0.045277, " the", false], [332, 0.044369, " a", false], [22249, 0.035407, " out", false], [31458, 0.030987, " more", false], [32448, 0.021506, " ways", false], [32234, 0.021295, " this", false], [30789, 0.013811, " ever", false], [4419, 0.012927, " an", false], [45301, 0.012166, " better", false]]]}, "raw_delta": 0.010416666666666519, "tuned_delta": 0.0645062640817421}, {"byte_start": 681, "byte_end": 693, "display": {"text": " improvement", "kind": "normal"}, "is_word": true, "word_id": 116, "word_key": " improvement", "bytes_hex": "20 69 6d 70 72 6f 76 65 6d 65 6e 74", "compression": {"model_a": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%", "model_b": "3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"model_a": [[63621, " improvement", "normal", 0.038731444627046585]], "model_b": [[63621, " improvement", "normal", 0.1079857274889946]]}, "loss": {"model_a": 4.884123836342845, "model_b": 3.3343537728879036}, "topk": {"model_a": [63621, 6, 0.038731444627046585, [[59093, 0.06188, " advantage", false], [3609, 0.052639, " AI", false], [63277, 0.046593, " alternative", false], [37636, 0.041842, " agent", false], [30729, 0.040861, " edge", false], [63621, 0.038731, " improvement", false], [55532, 0.033366, " approach", false], [30789, 0.033068, " ever", false], [52371, 0.029619, " optimal", false], [63560, 0.027929, " explanation", false]]], "model_b": [63621, 1, 0.1079857274889946, [[63621, 0.107986, " improvement", false], [30789, 0.084942, " ever", false], [63563, 0.047507, " exponential", false], [59594, 0.040879, " efficient", false], [63560, 0.036387, " explanation", false], [52371, 0.035341, " optimal", false], [56433, 0.029344, " increase", false], [59593, 0.025246, " effective", false], [59113, 0.021777, " algorithm", false], [30788, 0.019989, " even", false]]]}, "raw_delta": 0.08593749999999999, "tuned_delta": 0.14002709741507557}, {"byte_start": 693, "byte_end": 698, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 117, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "12.79% 12.79% 12.79% 12.79% 12.79%", "model_b": "11.38% 11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.02857709303498268]], "model_b": [[32227, " that", "normal", 0.043011624366045]]}, "loss": {"model_a": 12.792647432882603, "model_b": 11.383765557014476}, "topk": {"model_a": [32227, 4, 0.02857709303498268, [[4596, 0.465974, " in", false], [4706, 0.139946, " of", false], [4450, 0.128926, " by", false], [32227, 0.028577, " that", false], [31601, 0.024199, " over", false], [4811, 0.022141, " to", false], [4712, 0.021024, " on", false], [30917, 0.01734, " from", false], [32487, 0.014041, " with", false], [53140, 0.009575, " through", false]]], "model_b": [32227, 5, 0.043011624366045, [[4596, 0.466543, " in", false], [31601, 0.092325, " over", false], [4600, 0.066472, " is", false], [4712, 0.055311, " on", false], [32227, 0.043012, " that", false], [45, 0.03117, ",", false], [4706, 0.02306, " of", false], [4811, 0.020753, " to", false], [38989, 0.00787, " means", false], [4450, 0.00779, " by", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13221459741507557}, {"byte_start": 698, "byte_end": 704, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 118, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"model_a": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03%", "model_b": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"model_a": [[38964, " makes", "normal", 0.006612562574446201]], "model_b": [[38964, " makes", "normal", 0.014538269490003586]]}, "loss": {"model_a": 15.028073342593368, "model_b": 12.679936882813154}, "topk": {"model_a": [38964, 22, 0.006612562574446201, [[4600, 0.234174, " is", false], [56540, 0.084545, " leverage", false], [57102, 0.057831, " requires", false], [21413, 0.043576, " can", false], [40219, 0.03494, " would", false], [38278, 0.028772, " doesn", false], [30659, 0.026621, " does", false], [47181, 0.026218, " scales", false], [31581, 0.025952, " only", false], [38087, 0.023144, " comes", false]]], "model_b": [38964, 12, 0.014538269490003586, [[4600, 0.145969, " is", false], [56540, 0.121731, " leverage", false], [21413, 0.064271, " can", false], [47181, 0.043312, " scales", false], [57102, 0.037699, " requires", false], [40219, 0.028408, " would", false], [38278, 0.026713, " doesn", false], [30659, 0.020343, " does", false], [32356, 0.02, " uses", false], [39888, 0.016898, " takes", false]]]}, "raw_delta": 0.13020833333333337, "tuned_delta": 0.18429793074840894}, {"byte_start": 704, "byte_end": 706, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 119, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "27.33% 27.33%", "model_b": "31.28% 31.28%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.04826342687010765]], "model_b": [[332, " a", "normal", 0.03094947524368763]]}, "loss": {"model_a": 27.332308391841686, "model_b": 31.277177644272445}, "topk": {"model_a": [332, 4, 0.04826342687010765, [[22681, 0.277007, " use", false], [22590, 0.117123, " the", false], [4692, 0.051472, " no", false], [332, 0.048263, " a", false], [45301, 0.028659, " better", false], [30992, 0.026593, " good", false], [4601, 0.02471, " it", false], [22799, 0.019972, " you", false], [30923, 0.014912, " full", false], [39631, 0.014822, " sense", false]]], "model_b": [332, 4, 0.03094947524368763, [[22681, 0.272129, " use", false], [22590, 0.231689, " the", false], [32234, 0.064964, " this", false], [332, 0.030949, " a", false], [4833, 0.025961, " up", false], [4601, 0.025811, " it", false], [30923, 0.022306, " full", false], [45301, 0.01727, " better", false], [63370, 0.016822, " computation", false], [31458, 0.01351, " more", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 706, "byte_end": 717, "display": {"text": " difference", "kind": "normal"}, "is_word": true, "word_id": 120, "word_key": " difference", "bytes_hex": "20 64 69 66 66 65 72 65 6e 63 65", "compression": {"model_a": "4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76%", "model_b": "3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41% 3.41%"}, "model_tokens": {"model_a": [[61863, " difference", "normal", 0.0547851137816906]], "model_b": [[61863, " difference", "normal", 0.1263003945350647]]}, "loss": {"model_a": 4.764582343844943, "model_b": 3.406932536190201}, "topk": {"model_a": [61863, 1, 0.0547851137816906, [[61863, 0.054785, " difference", false], [38594, 0.053527, " given", false], [52232, 0.042096, " million", false], [3483, 0.037914, " 10", false], [39720, 0.035245, " small", false], [38864, 0.023804, " large", false], [21357, 0.023661, " big", false], [63870, 0.020131, " significant", false], [56587, 0.018945, " marginal", false], [47487, 0.014988, " system", false]]], "model_b": [61863, 1, 0.1263003945350647, [[61863, 0.1263, " difference", false], [63870, 0.056766, " significant", false], [39720, 0.036531, " small", false], [47289, 0.035455, " single", false], [63370, 0.02528, " computation", false], [38594, 0.024183, " given", false], [38864, 0.024181, " large", false], [52167, 0.019965, " machine", false], [21357, 0.016688, " big", false], [31458, 0.015196, " more", false]]]}, "raw_delta": 0.07528409090909093, "tuned_delta": 0.1293736883241665}, {"byte_start": 717, "byte_end": 720, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 121, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "10.24% 10.24% 10.24%", "model_b": "10.61% 10.61% 10.61%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.17996846139431]], "model_b": [[4596, " in", "normal", 0.17110073566436768]]}, "loss": {"model_a": 10.237874964641732, "model_b": 10.613576798206566}, "topk": {"model_a": [4596, 1, 0.17996846139431, [[4596, 0.179968, " in", false], [4811, 0.127566, " to", false], [4600, 0.08251, " is", false], [45, 0.061347, ",", false], [57102, 0.047158, " requires", false], [39971, 0.0367, " today", false], [4450, 0.029391, " by", false], [4712, 0.026849, " on", false], [32475, 0.02497, " will", false], [31601, 0.023289, " over", false]]], "model_b": [4596, 1, 0.17110073566436768, [[4596, 0.171101, " in", false], [4600, 0.108452, " is", false], [45, 0.05479, ",", false], [4712, 0.048443, " on", false], [57102, 0.046695, " requires", false], [31601, 0.041971, " over", false], [32487, 0.039053, " with", false], [4811, 0.034412, " to", false], [4424, 0.024666, " at", false], [32465, 0.020107, " when", false]]]}, "raw_delta": -0.02083333333333326, "tuned_delta": 0.03325626408174233}, {"byte_start": 720, "byte_end": 724, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 122, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "4.86% 4.86% 4.86% 4.86%", "model_b": "6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.3386668860912323]], "model_b": [[22590, " the", "normal", 0.22262263298034668]]}, "loss": {"model_a": 4.8606424717450425, "model_b": 6.833077097960421}, "topk": {"model_a": [22590, 1, 0.3386668860912323, [[22590, 0.338667, " the", false], [332, 0.136816, " a", false], [39920, 0.057402, " terms", false], [32234, 0.052054, " this", false], [31835, 0.032513, " real", false], [56901, 0.025827, " practice", false], [4419, 0.019037, " an", false], [63750, 0.017274, " performance", false], [38720, 0.014218, " human", false], [3483, 0.011752, " 10", false]]], "model_b": [22590, 1, 0.22262263298034668, [[22590, 0.222623, " the", false], [332, 0.108459, " a", false], [32234, 0.084596, " this", false], [63750, 0.066647, " performance", false], [39920, 0.043111, " terms", false], [32227, 0.040515, " that", false], [63370, 0.027681, " computation", false], [4419, 0.024204, " an", false], [32251, 0.014177, " time", false], [30510, 0.011093, " cost", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05528540258492441}, {"byte_start": 724, "byte_end": 732, "display": {"text": " shorter", "kind": "normal"}, "is_word": true, "word_id": 123, "word_key": " shorter", "bytes_hex": "20 73 68 6f 72 74 65 72", "compression": {"model_a": "16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84%", "model_b": "19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"model_a": [[52888, " shorter", "normal", 0.0005724717047996819]], "model_b": [[52888, " shorter", "normal", 0.00021023189765401185]]}, "loss": {"model_a": 16.83613841662413, "model_b": 19.160793511806542}, "topk": {"model_a": [52888, 159, 0.0005724717047996819, [[31835, 0.144439, " real", false], [31323, 0.082976, " long", false], [40213, 0.079928, " world", false], [30807, 0.059039, " face", false], [39675, 0.048322, " short", false], [32251, 0.029652, " time", false], [31515, 0.029592, " next", false], [31503, 0.026197, " near", false], [46064, 0.01899, " future", false], [38621, 0.017262, " grand", false]]], "model_b": [52888, 439, 0.00021023189765401185, [[63370, 0.08135, " computation", false], [45157, 0.050776, " amount", false], [30510, 0.043752, " cost", false], [46685, 0.040027, " number", false], [31323, 0.034041, " long", false], [40213, 0.028839, " world", false], [63750, 0.020107, " performance", false], [39590, 0.01757, " scale", false], [32373, 0.0165, " vast", false], [51310, 0.015685, " context", false]]]}, "raw_delta": -0.12890625, "tuned_delta": -0.07481665258492441}, {"byte_start": 732, "byte_end": 737, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 124, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"model_a": "1.29% 1.29% 1.29% 1.29% 1.29%", "model_b": "1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"model_a": [[32219, " term", "normal", 0.700069785118103]], "model_b": [[32219, " term", "normal", 0.6267225742340088]]}, "loss": {"model_a": 1.2891269164193373, "model_b": 1.6977026604210945}, "topk": {"model_a": [32219, 1, 0.700069785118103, [[32219, 0.70007, " term", false], [22418, 0.13028, " run", false], [32251, 0.061417, " time", false], [46, 0.051884, "-", false], [4715, 0.006238, " or", false], [51940, 0.006192, " horizon", false], [21265, 0.004017, " and", false], [39962, 0.003759, " times", false], [39920, 0.003246, " terms", false], [45, 0.002884, ",", false]]], "model_b": [32219, 1, 0.6267225742340088, [[32219, 0.626723, " term", false], [32251, 0.109744, " time", false], [22418, 0.095135, " run", false], [46, 0.044843, "-", false], [39962, 0.015796, " times", false], [39438, 0.014662, " range", false], [39920, 0.009554, " terms", false], [45157, 0.008426, " amount", false], [45, 0.005743, ",", false], [46790, 0.005405, " period", false]]]}, "raw_delta": -0.022656250000000003, "tuned_delta": 0.031433347415075585}, {"byte_start": 737, "byte_end": 738, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "40.58%", "model_b": "41.98%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.10559233278036118]], "model_b": [[45, ",", "normal", 0.09833226352930069]]}, "loss": {"model_a": 40.57579802500209, "model_b": 41.98467990087022}, "topk": {"model_a": [45, 2, 0.10559233278036118, [[4600, 0.294404, " is", false], [45, 0.105592, ",", false], [275, 0.043816, " (", false], [32475, 0.042771, " will", false], [22074, 0.037044, " may", false], [21413, 0.035054, " can", false], [4450, 0.031371, " by", false], [57102, 0.028618, " requires", false], [40187, 0.020229, " while", false], [53356, 0.018118, " without", false]]], "model_b": [45, 2, 0.09833226352930069, [[4600, 0.343255, " is", false], [45, 0.098332, ",", false], [57102, 0.048077, " requires", false], [21413, 0.040561, " can", false], [275, 0.036537, " (", false], [32475, 0.029583, " will", false], [38989, 0.023944, " means", false], [21800, 0.022101, " has", false], [22074, 0.019614, " may", false], [51019, 0.016072, " becomes", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.024035402584924412}, {"byte_start": 738, "byte_end": 750, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 125, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21%", "model_b": "4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70% 4.70%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.03088589571416378]], "model_b": [[63843, " researchers", "normal", 0.04390420392155647]]}, "loss": {"model_a": 5.212862940712074, "model_b": 4.6962729195604265}, "topk": {"model_a": [63843, 8, 0.03088589571416378, [[22590, 0.053903, " the", false], [40187, 0.053659, " while", false], [4858, 0.048107, " we", false], [21265, 0.048091, " and", false], [21400, 0.042607, " but", false], [4601, 0.033219, " it", false], [22226, 0.032401, " one", false], [63843, 0.030886, " researchers", false], [53356, 0.027334, " without", false], [32230, 0.025364, " then", false]]], "model_b": [63843, 4, 0.04390420392155647, [[22590, 0.131028, " the", false], [4858, 0.068622, " we", false], [3609, 0.068544, " AI", false], [63843, 0.043904, " researchers", false], [21265, 0.035981, " and", false], [332, 0.033678, " a", false], [4419, 0.032044, " an", false], [22226, 0.026515, " one", false], [31461, 0.023659, " most", false], [45124, 0.020433, " agents", false]]]}, "raw_delta": 0.028645833333333315, "tuned_delta": 0.0827354307484089}, {"byte_start": 750, "byte_end": 755, "display": {"text": " seek", "kind": "normal"}, "is_word": true, "word_id": 126, "word_key": " seek", "bytes_hex": "20 73 65 65 6b", "compression": {"model_a": "22.32% 22.32% 22.32% 22.32% 22.32%", "model_b": "16.79% 16.79% 16.79% 16.79% 16.79%"}, "model_tokens": {"model_a": [[31966, " seek", "normal", 0.0020592890214174986]], "model_b": [[31966, " seek", "normal", 0.009521298110485077]]}, "loss": {"model_a": 22.31668891375115, "model_b": 16.79387196034809}, "topk": {"model_a": [31966, 47, 0.0020592890214174986, [[31059, 0.204132, " have", false], [39171, 0.084378, " often", false], [32475, 0.064248, " will", false], [21286, 0.055041, " are", false], [32216, 0.046471, " tend", false], [21413, 0.03194, " can", false], [47266, 0.030567, " should", false], [22074, 0.023417, " may", false], [60687, 0.02341, " typically", false], [4596, 0.015502, " in", false]]], "model_b": [31966, 15, 0.009521298110485077, [[31059, 0.175198, " have", false], [39171, 0.069177, " often", false], [21286, 0.067641, " are", false], [32475, 0.055887, " will", false], [32216, 0.026889, " tend", false], [21413, 0.021828, " can", false], [60687, 0.019658, " typically", false], [32230, 0.017155, " then", false], [38530, 0.01567, " focus", false], [31475, 0.014021, " must", false]]]}, "raw_delta": 0.30625, "tuned_delta": 0.3603395974150756}, {"byte_start": 755, "byte_end": 758, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 127, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "6.86% 6.86% 6.86%", "model_b": "5.26% 5.26% 5.26%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.3204927444458008]], "model_b": [[4811, " to", "normal", 0.41991060972213745]]}, "loss": {"model_a": 6.856558462558223, "model_b": 5.259825669907679}, "topk": {"model_a": [4811, 1, 0.3204927444458008, [[4811, 0.320493, " to", false], [332, 0.108657, " a", false], [52224, 0.06442, " methods", false], [22249, 0.05465, " out", false], [32448, 0.036887, " ways", false], [4419, 0.035138, " an", false], [22590, 0.033257, " the", false], [64423, 0.021824, " improvements", false], [22168, 0.013475, " new", false], [31458, 0.010424, " more", false]]], "model_b": [4811, 1, 0.41991060972213745, [[4811, 0.419911, " to", false], [332, 0.068311, " a", false], [22249, 0.04502, " out", false], [22590, 0.037962, " the", false], [32448, 0.033553, " ways", false], [4419, 0.025449, " an", false], [51832, 0.020662, " general", false], [52224, 0.020035, " methods", false], [31458, 0.017561, " more", false], [60521, 0.010948, " solutions", false]]]}, "raw_delta": 0.08854166666666663, "tuned_delta": 0.1426312640817422}, {"byte_start": 758, "byte_end": 767, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 128, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"model_a": "4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48%", "model_b": "3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96%"}, "model_tokens": {"model_a": [[56540, " leverage", "normal", 0.10792125761508942]], "model_b": [[56540, " leverage", "normal", 0.1397588700056076]]}, "loss": {"model_a": 4.4771135166476075, "model_b": 3.9605234954959605}, "topk": {"model_a": [56540, 2, 0.10792125761508942, [[51982, 0.134886, " improve", false], [56540, 0.107921, " leverage", false], [51690, 0.049896, " exploit", false], [30858, 0.043265, " find", false], [31358, 0.036314, " make", false], [22681, 0.032648, " use", false], [37730, 0.025428, " apply", false], [4491, 0.019004, " do", false], [56433, 0.018679, " increase", false], [37923, 0.016749, " build", false]]], "model_b": [56540, 1, 0.1397588700056076, [[56540, 0.139759, " leverage", false], [51982, 0.050235, " improve", false], [22681, 0.049306, " use", false], [30858, 0.047346, " find", false], [31358, 0.035336, " make", false], [51690, 0.026679, " exploit", false], [37730, 0.02595, " apply", false], [56769, 0.020028, " optimize", false], [56604, 0.019047, " maximize", false], [56433, 0.018653, " increase", false]]]}, "raw_delta": 0.028645833333333346, "tuned_delta": 0.08273543074840893}, {"byte_start": 767, "byte_end": 773, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 129, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00%", "model_b": "13.43% 13.43% 13.43% 13.43% 13.43% 13.43%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.03585086762905121]], "model_b": [[39931, " their", "normal", 0.011649243533611298]]}, "loss": {"model_a": 10.00306131866371, "model_b": 13.43134054994282}, "topk": {"model_a": [39931, 5, 0.03585086762905121, [[22590, 0.205718, " the", false], [38720, 0.135048, " human", false], [32234, 0.09498, " this", false], [32227, 0.064918, " that", false], [39931, 0.035851, " their", false], [32464, 0.034969, " what", false], [56173, 0.032333, " existing", false], [63370, 0.023644, " computation", false], [57564, 0.021696, " whatever", false], [31458, 0.019699, " more", false]]], "model_b": [39931, 14, 0.011649243533611298, [[22590, 0.199124, " the", false], [32234, 0.105042, " this", false], [32227, 0.037533, " that", false], [332, 0.030904, " a", false], [31458, 0.02948, " more", false], [38720, 0.027725, " human", false], [63370, 0.027714, " computation", false], [56173, 0.027229, " existing", false], [4423, 0.021769, " as", false], [39936, 0.017476, " these", false]]]}, "raw_delta": -0.19010416666666663, "tuned_delta": -0.13601456925159106}, {"byte_start": 773, "byte_end": 779, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 130, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "model_b": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.05500245839357376]], "model_b": [[38720, " human", "normal", 0.017653323709964752]]}, "loss": {"model_a": 8.735067630382394, "model_b": 12.116384132465903}, "topk": {"model_a": [38720, 6, 0.05500245839357376, [[52140, 0.143004, " limited", false], [56173, 0.094856, " existing", false], [59943, 0.086163, " knowledge", false], [51372, 0.080133, " current", false], [22251, 0.061264, " own", false], [38720, 0.055002, " human", false], [59206, 0.024007, " available", false], [39720, 0.016505, " small", false], [65034, 0.015487, " understanding", false], [50888, 0.011818, " already", false]]], "model_b": [38720, 10, 0.017653323709964752, [[51372, 0.088062, " current", false], [59943, 0.07964, " knowledge", false], [64862, 0.063871, " computational", false], [56173, 0.05605, " existing", false], [59206, 0.040655, " available", false], [52140, 0.035224, " limited", false], [63370, 0.025844, " computation", false], [59346, 0.024109, " computing", false], [60406, 0.020413, " resources", false], [38720, 0.017653, " human", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13341040258492443}, {"byte_start": 779, "byte_end": 789, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 131, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "model_b": "0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.77864009141922]], "model_b": [[59943, " knowledge", "normal", 0.6465831995010376]]}, "loss": {"model_a": 0.450842200277801, "model_b": 0.7784072364171407}, "topk": {"model_a": [59943, 1, 0.77864009141922, [[59943, 0.77864, " knowledge", false], [64452, 0.026841, " intelligence", false], [46, 0.021343, "-", false], [59683, 0.02036, " expertise", false], [59917, 0.01509, " intuition", false], [65034, 0.013241, " understanding", false], [59305, 0.006079, " cognitive", false], [45346, 0.005684, " brains", false], [39356, 0.003994, " prior", false], [21265, 0.00361, " and", false]]], "model_b": [59943, 1, 0.6465831995010376, [[59943, 0.646583, " knowledge", false], [59683, 0.048308, " expertise", false], [46, 0.047439, "-", false], [59917, 0.016071, " intuition", false], [60406, 0.015702, " resources", false], [65034, 0.015638, " understanding", false], [64452, 0.012009, " intelligence", false], [61979, 0.010952, " experience", false], [47297, 0.010292, " skills", false], [21265, 0.007444, " and", false]]]}, "raw_delta": -0.018164062499999998, "tuned_delta": 0.035925534915075594}, {"byte_start": 789, "byte_end": 792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 132, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "20.38% 20.38% 20.38%", "model_b": "20.48% 20.48% 20.48%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.0335969440639019]], "model_b": [[4706, " of", "normal", 0.033065322786569595]]}, "loss": {"model_a": 20.38182447089225, "model_b": 20.475749929283463}, "topk": {"model_a": [4706, 7, 0.0335969440639019, [[45, 0.190964, ",", false], [47, 0.143869, ".", false], [4811, 0.140904, " to", false], [21265, 0.096775, " and", false], [4596, 0.074511, " in", false], [275, 0.034033, " (", false], [4706, 0.033597, " of", false], [4423, 0.027631, " as", false], [4450, 0.027111, " by", false], [60, 0.021583, ";", false]]], "model_b": [4706, 8, 0.033065322786569595, [[4811, 0.145731, " to", false], [4596, 0.125336, " in", false], [47, 0.115867, ".", false], [45, 0.106885, ",", false], [4423, 0.066701, " as", false], [21265, 0.057862, " and", false], [31458, 0.036554, " more", false], [4706, 0.033065, " of", false], [275, 0.026789, " (", false], [4450, 0.024859, " by", false]]]}, "raw_delta": -0.005208333333333481, "tuned_delta": 0.04888126408174211}, {"byte_start": 792, "byte_end": 796, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 133, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.57% 2.57% 2.57% 2.57%", "model_b": "2.52% 2.52% 2.52% 2.52%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.5697708129882812]], "model_b": [[22590, " the", "normal", 0.5733007192611694]]}, "loss": {"model_a": 2.571209423459334, "model_b": 2.518376353114279}, "topk": {"model_a": [22590, 1, 0.5697708129882812, [[22590, 0.569771, " the", false], [21835, 0.092198, " how", false], [32464, 0.048099, " what", false], [332, 0.047394, " a", false], [40186, 0.009853, " which", false], [3609, 0.008663, " AI", false], [39931, 0.007546, " their", false], [32074, 0.007401, " some", false], [4419, 0.006931, " an", false], [56939, 0.005957, " problems", false]]], "model_b": [22590, 1, 0.5733007192611694, [[22590, 0.573301, " the", false], [21835, 0.050713, " how", false], [332, 0.045431, " a", false], [32464, 0.030332, " what", false], [39931, 0.023992, " their", false], [4419, 0.008516, " an", false], [32227, 0.007881, " that", false], [32234, 0.006204, " this", false], [47539, 0.006111, " things", false], [62293, 0.005569, " particular", false]]]}, "raw_delta": 0.0029296875, "tuned_delta": 0.05701928491507559}, {"byte_start": 796, "byte_end": 803, "display": {"text": " domain", "kind": "normal"}, "is_word": true, "word_id": 134, "word_key": " domain", "bytes_hex": "20 64 6f 6d 61 69 6e", "compression": {"model_a": "5.15% 5.15% 5.15% 5.15% 5.15% 5.15% 5.15%", "model_b": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"model_a": [[45775, " domain", "normal", 0.1363827884197235]], "model_b": [[45775, " domain", "normal", 0.014745749533176422]]}, "loss": {"model_a": 5.1524822888891535, "model_b": 10.868517328125558}, "topk": {"model_a": [45775, 3, 0.1363827884197235, [[40213, 0.312212, " world", false], [52569, 0.229817, " problem", false], [45775, 0.136383, " domain", false], [32202, 0.071761, " task", false], [63536, 0.032826, " environment", false], [57074, 0.017141, " relevant", false], [60511, 0.012049, " situation", false], [47506, 0.010262, " target", false], [56939, 0.009762, " problems", false], [57271, 0.009494, " specific", false]]], "model_b": [45775, 7, 0.014745749533176422, [[40213, 0.37934, " world", false], [63536, 0.130995, " environment", false], [52569, 0.097011, " problem", false], [37636, 0.034627, " agent", false], [47487, 0.027117, " system", false], [32202, 0.025746, " task", false], [45775, 0.014746, " domain", false], [51372, 0.012662, " current", false], [31461, 0.009616, " most", false], [46064, 0.008883, " future", false]]]}, "raw_delta": -0.31696428571428564, "tuned_delta": -0.26287468829921007}, {"byte_start": 803, "byte_end": 804, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "27.61%", "model_b": "36.91%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.2151898294687271]], "model_b": [[45, ",", "normal", 0.13006660342216492]]}, "loss": {"model_a": 27.614084767015314, "model_b": 36.91270514774496}, "topk": {"model_a": [45, 1, 0.2151898294687271, [[45, 0.21519, ",", false], [47, 0.18634, ".", false], [4811, 0.090568, " to", false], [4596, 0.083972, " in", false], [21265, 0.076304, " and", false], [32232, 0.048032, " they", false], [4706, 0.042126, " of", false], [275, 0.032307, " (", false], [60, 0.020903, ";", false], [4424, 0.020117, " at", false]]], "model_b": [45, 3, 0.13006660342216492, [[4811, 0.194306, " to", false], [47, 0.143957, ".", false], [45, 0.130067, ",", false], [4596, 0.098641, " in", false], [21265, 0.079383, " and", false], [4423, 0.037438, " as", false], [275, 0.03456, " (", false], [4715, 0.028791, " or", false], [4706, 0.020239, " of", false], [4450, 0.018189, " by", false]]]}, "raw_delta": -0.515625, "tuned_delta": -0.4615354025849244}, {"byte_start": 804, "byte_end": 808, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 135, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "6.20% 6.20% 6.20% 6.20%", "model_b": "10.99% 10.99% 10.99% 10.99%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.24974967539310455]], "model_b": [[21400, " but", "normal", 0.08774559944868088]]}, "loss": {"model_a": 6.199080253819764, "model_b": 10.9892786317714}, "topk": {"model_a": [21400, 1, 0.24974967539310455, [[21400, 0.24975, " but", false], [21265, 0.137721, " and", false], [40186, 0.103089, " which", false], [40187, 0.046215, " while", false], [4715, 0.035718, " or", false], [47001, 0.020354, " rather", false], [22590, 0.018736, " the", false], [4811, 0.017924, " to", false], [4596, 0.015757, " in", false], [53339, 0.014284, " whereas", false]]], "model_b": [21400, 3, 0.08774559944868088, [[21265, 0.137566, " and", false], [40186, 0.094434, " which", false], [21400, 0.087746, " but", false], [4715, 0.0737, " or", false], [39931, 0.027892, " their", false], [22590, 0.024585, " the", false], [47001, 0.023902, " rather", false], [40187, 0.020141, " while", false], [30788, 0.019843, " even", false], [4423, 0.019134, " as", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21153540258492443}, {"byte_start": 808, "byte_end": 812, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 136, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.85% 10.85% 10.85% 10.85%", "model_b": "10.14% 10.14% 10.14% 10.14%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09046445041894913]], "model_b": [[22590, " the", "normal", 0.10498224198818207]]}, "loss": {"model_a": 10.848390444184586, "model_b": 10.143949506250523}, "topk": {"model_a": [22590, 3, 0.09046445041894913, [[32234, 0.127832, " this", false], [4596, 0.110596, " in", false], [22590, 0.090464, " the", false], [31601, 0.051364, " over", false], [32227, 0.050588, " that", false], [4423, 0.036298, " as", false], [4588, 0.026089, " if", false], [4601, 0.025836, " it", false], [32232, 0.023972, " they", false], [45, 0.018252, ",", false]]], "model_b": [22590, 1, 0.10498224198818207, [[22590, 0.104982, " the", false], [32234, 0.104047, " this", false], [4596, 0.066064, " in", false], [4423, 0.057097, " as", false], [32227, 0.031445, " that", false], [45, 0.02628, ",", false], [32232, 0.025373, " they", false], [4601, 0.022414, " it", false], [61959, 0.019917, " eventually", false], [62676, 0.018216, " ultimately", false]]]}, "raw_delta": 0.0390625, "tuned_delta": 0.09315209741507559}, {"byte_start": 812, "byte_end": 817, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 137, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "12.51% 12.51% 12.51% 12.51% 12.51%", "model_b": "19.05% 19.05% 19.05% 19.05% 19.05%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.03128838539123535]], "model_b": [[31581, " only", "normal", 0.005107465200126171]]}, "loss": {"model_a": 12.510871057708977, "model_b": 19.04808296173709}, "topk": {"model_a": [31581, 4, 0.03128838539123535, [[46470, 0.078024, " longer", false], [31323, 0.068596, " long", false], [57481, 0.032231, " ultimate", false], [31581, 0.031288, " only", false], [31461, 0.029091, " most", false], [31835, 0.024336, " real", false], [30510, 0.019972, " cost", false], [31458, 0.019332, " more", false], [30273, 0.015125, " best", false], [30808, 0.013432, " fact", false]]], "model_b": [31581, 27, 0.005107465200126171, [[46470, 0.137408, " longer", false], [31458, 0.043496, " more", false], [38720, 0.031943, " human", false], [45775, 0.028748, " domain", false], [31323, 0.024188, " long", false], [30510, 0.018756, " cost", false], [47092, 0.013578, " result", false], [52569, 0.013305, " problem", false], [30808, 0.011456, " fact", false], [46397, 0.01132, " larger", false]]]}, "raw_delta": -0.36249999999999993, "tuned_delta": -0.30841040258492436}, {"byte_start": 817, "byte_end": 823, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 138, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"model_a": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%", "model_b": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%"}, "model_tokens": {"model_a": [[39941, " thing", "normal", 0.043682076036930084]], "model_b": [[39941, " thing", "normal", 0.04799336567521095]]}, "loss": {"model_a": 9.392545839120855, "model_b": 9.11076946394723}, "topk": {"model_a": [39941, 2, 0.043682076036930084, [[22752, 0.554354, " way", false], [39941, 0.043682, " thing", false], [47009, 0.025316, " reason", false], [31323, 0.020507, " long", false], [31835, 0.01794, " real", false], [59593, 0.013501, " effective", false], [51832, 0.010951, " general", false], [56540, 0.008277, " leverage", false], [57075, 0.00795, " reliable", false], [31104, 0.007377, " hope", false]]], "model_b": [39941, 2, 0.04799336567521095, [[22752, 0.426255, " way", false], [39941, 0.047993, " thing", false], [32251, 0.026831, " time", false], [47009, 0.025694, " reason", false], [31835, 0.022928, " real", false], [59593, 0.01839, " effective", false], [38720, 0.014209, " human", false], [52569, 0.009684, " problem", false], [45775, 0.008708, " domain", false], [32313, 0.007953, " true", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 823, "byte_end": 828, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 139, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.53% 1.53% 1.53% 1.53% 1.53%", "model_b": "2.56% 2.56% 2.56% 2.56% 2.56%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.652611255645752]], "model_b": [[32227, " that", "normal", 0.49834901094436646]]}, "loss": {"model_a": 1.528636835316919, "model_b": 2.564165014079993}, "topk": {"model_a": [32227, 1, 0.652611255645752, [[32227, 0.652611, " that", false], [32232, 0.093333, " they", false], [4858, 0.022613, " we", false], [32234, 0.01926, " this", false], [22799, 0.011452, " you", false], [52072, 0.010524, " keeping", false], [31458, 0.009231, " more", false], [4811, 0.009198, " to", false], [62364, 0.009072, " preventing", false], [59206, 0.008492, " available", false]]], "model_b": [32227, 1, 0.49834901094436646, [[32227, 0.498349, " that", false], [32232, 0.210379, " they", false], [4811, 0.026294, " to", false], [32234, 0.021366, " this", false], [4858, 0.016788, " we", false], [31458, 0.01215, " more", false], [22799, 0.011228, " you", false], [22590, 0.010246, " the", false], [46227, 0.00981, " humans", false], [31269, 0.009746, " left", false]]]}, "raw_delta": -0.057421875, "tuned_delta": -0.003332277584924409}, {"byte_start": 828, "byte_end": 836, "display": {"text": " matters", "kind": "normal"}, "is_word": true, "word_id": 140, "word_key": " matters", "bytes_hex": "20 6d 61 74 74 65 72 73", "compression": {"model_a": "4.05% 4.05% 4.05% 4.05% 4.05% 4.05% 4.05% 4.05%", "model_b": "7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15%"}, "model_tokens": {"model_a": [[52201, " matters", "normal", 0.16600041091442108]], "model_b": [[52201, " matters", "normal", 0.042006853967905045]]}, "loss": {"model_a": 4.050535393120868, "model_b": 7.15007552003075}, "topk": {"model_a": [52201, 1, 0.16600041091442108, [[52201, 0.166, " matters", false], [21413, 0.114239, " can", false], [4600, 0.06301, " is", false], [32475, 0.061078, " will", false], [38964, 0.050549, " makes", false], [47008, 0.036114, " really", false], [460, 0.033469, "'s", false], [56925, 0.021555, " prevents", false], [52701, 0.018729, " remains", false], [62047, 0.018302, " guarantees", false]]], "model_b": [52201, 4, 0.042006853967905045, [[21413, 0.317466, " can", false], [4600, 0.061082, " is", false], [32232, 0.060769, " they", false], [52201, 0.042007, " matters", false], [47008, 0.036688, " really", false], [38964, 0.033597, " makes", false], [32475, 0.030067, " will", false], [40024, 0.017198, " truly", false], [56419, 0.016773, " improves", false], [460, 0.012999, "'s", false]]]}, "raw_delta": -0.171875, "tuned_delta": -0.11778540258492441}, {"byte_start": 836, "byte_end": 839, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 141, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "2.78% 2.78% 2.78%", "model_b": "9.67% 9.67% 9.67%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.6330277919769287]], "model_b": [[4596, " in", "normal", 0.19967585802078247]]}, "loss": {"model_a": 2.782541704839553, "model_b": 9.674322214294481}, "topk": {"model_a": [4596, 1, 0.6330277919769287, [[4596, 0.633028, " in", false], [4600, 0.082556, " is", false], [21700, 0.069619, " for", false], [31323, 0.05688, " long", false], [31601, 0.048866, " over", false], [4811, 0.010968, " to", false], [4712, 0.008525, " on", false], [46470, 0.008246, " longer", false], [4424, 0.007736, " at", false], [31458, 0.007216, " more", false]]], "model_b": [4596, 2, 0.19967585802078247, [[4600, 0.452571, " is", false], [4596, 0.199676, " in", false], [21700, 0.05296, " for", false], [4811, 0.042076, " to", false], [31461, 0.025693, " most", false], [4424, 0.020049, " at", false], [21286, 0.019004, " are", false], [37598, 0.016087, " about", false], [32465, 0.014449, " when", false], [62676, 0.014143, " ultimately", false]]]}, "raw_delta": -0.3821614583333333, "tuned_delta": -0.32807186091825774}, {"byte_start": 839, "byte_end": 843, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 142, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.14% 0.14% 0.14% 0.14%", "model_b": "1.29% 1.29% 1.29% 1.29%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.9696335196495056]], "model_b": [[22590, " the", "normal", 0.7525882124900818]]}, "loss": {"model_a": 0.13923715413852986, "model_b": 1.285604711729667}, "topk": {"model_a": [22590, 1, 0.9696335196495056, [[22590, 0.969634, " the", false], [332, 0.005256, " a", false], [56901, 0.003081, " practice", false], [32234, 0.002627, " this", false], [39920, 0.002346, " terms", false], [31323, 0.001343, " long", false], [3609, 0.001281, " AI", false], [32227, 0.001277, " that", false], [46470, 0.001018, " longer", false], [4419, 0.001008, " an", false]]], "model_b": [22590, 1, 0.7525882124900818, [[22590, 0.752588, " the", false], [32234, 0.037005, " this", false], [39920, 0.034409, " terms", false], [332, 0.025431, " a", false], [56901, 0.024137, " practice", false], [31323, 0.01567, " long", false], [32227, 0.012871, " that", false], [3609, 0.007868, " AI", false], [4419, 0.005413, " an", false], [39936, 0.004936, " these", false]]]}, "raw_delta": -0.063568115234375, "tuned_delta": -0.009478517819299412}, {"byte_start": 843, "byte_end": 848, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 143, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"model_a": "1.78% 1.78% 1.78% 1.78% 1.78%", "model_b": "0.94% 0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"model_a": [[31323, " long", "normal", 0.6108350157737732]], "model_b": [[31323, " long", "normal", 0.7691910266876221]]}, "loss": {"model_a": 1.7822355729731822, "model_b": 0.9439508568316459}, "topk": {"model_a": [31323, 1, 0.6108350157737732, [[31323, 0.610835, " long", false], [46470, 0.35425, " longer", false], [21616, 0.008056, " end", false], [32386, 0.003407, " very", false], [39675, 0.003014, " short", false], [46536, 0.002008, " medium", false], [52888, 0.001715, " shorter", false], [46064, 0.001254, " future", false], [51310, 0.001077, " context", false], [46397, 0.000997, " larger", false]]], "model_b": [31323, 1, 0.7691910266876221, [[31323, 0.769191, " long", false], [46470, 0.13437, " longer", false], [21616, 0.030921, " end", false], [39675, 0.011648, " short", false], [38491, 0.002543, " final", false], [32386, 0.002282, " very", false], [21357, 0.002238, " big", false], [51310, 0.001669, " context", false], [31503, 0.001624, " near", false], [46536, 0.001547, " medium", false]]]}, "raw_delta": 0.046484375, "tuned_delta": 0.1005739724150756}, {"byte_start": 848, "byte_end": 852, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 144, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "3.21% 3.21% 3.21% 3.21%", "model_b": "4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.4916808307170868]], "model_b": [[22418, " run", "normal", 0.36995312571525574]]}, "loss": {"model_a": 3.2052062675999915, "model_b": 4.490810979329659}, "topk": {"model_a": [22418, 1, 0.4916808307170868, [[22418, 0.491681, " run", false], [32219, 0.473208, " term", false], [46, 0.024563, "-", false], [31057, 0.003239, " haul", false], [27132, 0.001216, "term", false], [30941, 0.0012, " game", false], [32186, 0.00047, " tail", false], [32398, 0.00035, " view", false], [8661, 0.000324, "run", false], [45, 0.000261, ",", false]]], "model_b": [22418, 2, 0.36995312571525574, [[32219, 0.585919, " term", false], [22418, 0.369953, " run", false], [46, 0.032094, "-", false], [31057, 0.001661, " haul", false], [39920, 0.00109, " terms", false], [27132, 0.000968, "term", false], [32186, 0.000541, " tail", false], [39438, 0.000536, " range", false], [32398, 0.000512, " view", false], [30941, 0.000436, " game", false]]]}, "raw_delta": -0.0712890625, "tuned_delta": -0.017199465084924412}, {"byte_start": 852, "byte_end": 855, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 145, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "0.40% 0.40% 0.40%", "model_b": "0.71% 0.71% 0.71%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.9357764720916748]], "model_b": [[4600, " is", "normal", 0.8883108496665955]]}, "loss": {"model_a": 0.39918319816263637, "model_b": 0.7073761085087893}, "topk": {"model_a": [4600, 1, 0.9357764720916748, [[4600, 0.935776, " is", false], [21286, 0.023424, " are", false], [45, 0.015538, ",", false], [275, 0.006279, " (", false], [21700, 0.003928, " for", false], [4596, 0.002353, " in", false], [32475, 0.001746, " will", false], [37598, 0.001062, " about", false], [4601, 0.000875, " it", false], [4706, 0.00058, " of", false]]], "model_b": [4600, 1, 0.8883108496665955, [[4600, 0.888311, " is", false], [21286, 0.056527, " are", false], [45, 0.012721, ",", false], [21700, 0.008229, " for", false], [275, 0.005513, " (", false], [4596, 0.003003, " in", false], [32475, 0.001761, " will", false], [4811, 0.001747, " to", false], [32465, 0.001605, " when", false], [21265, 0.000941, " and", false]]]}, "raw_delta": -0.017089843749999997, "tuned_delta": 0.03699975366507559}, {"byte_start": 855, "byte_end": 859, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 146, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.60% 5.60% 5.60% 5.60%", "model_b": "5.49% 5.49% 5.49% 5.49%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.28981590270996094]], "model_b": [[22590, " the", "normal", 0.302146852016449]]}, "loss": {"model_a": 5.60030545657581, "model_b": 5.4946393158857}, "topk": {"model_a": [22590, 1, 0.28981590270996094, [[22590, 0.289816, " the", false], [21835, 0.173152, " how", false], [32227, 0.114558, " that", false], [53342, 0.077344, " whether", false], [32464, 0.042637, " what", false], [38888, 0.028964, " lever", false], [40186, 0.017427, " which", false], [332, 0.013229, " a", false], [59832, 0.009594, " improving", false], [4811, 0.009205, " to", false]]], "model_b": [22590, 1, 0.302146852016449, [[22590, 0.302147, " the", false], [21835, 0.15613, " how", false], [32227, 0.102641, " that", false], [32464, 0.054298, " what", false], [4811, 0.043874, " to", false], [53342, 0.041879, " whether", false], [332, 0.016319, " a", false], [51844, 0.014105, " getting", false], [59346, 0.013328, " computing", false], [63370, 0.011248, " computation", false]]]}, "raw_delta": 0.005859375, "tuned_delta": 0.05994897241507559}, {"byte_start": 859, "byte_end": 865, "display": {"text": " lever", "kind": "normal"}, "is_word": true, "word_id": 147, "word_key": " lever", "bytes_hex": "20 6c 65 76 65 72", "compression": {"model_a": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03%", "model_b": "24.98% 24.98% 24.98% 24.98% 24.98% 24.98%"}, "model_tokens": {"model_a": [[38888, " lever", "normal", 0.006754220928996801]], "model_b": [[38888, " lever", "normal", 0.00024282241065520793]]}, "loss": {"model_a": 15.028073342593368, "model_b": 24.984171932061475}, "topk": {"model_a": [38888, 29, 0.006754220928996801, [[50836, 0.084235, " ability", false], [30510, 0.061397, " cost", false], [45157, 0.042197, " amount", false], [63621, 0.032166, " improvement", false], [51832, 0.020987, " general", false], [56540, 0.019203, " leverage", false], [63370, 0.018766, " computation", false], [64862, 0.017476, " computational", false], [57481, 0.017034, " ultimate", false], [39984, 0.01658, " total", false]]], "model_b": [38888, 392, 0.00024282241065520793, [[50836, 0.066566, " ability", false], [45157, 0.059078, " amount", false], [39759, 0.038038, " speed", false], [63621, 0.037719, " improvement", false], [30510, 0.031379, " cost", false], [63750, 0.020754, " performance", false], [63563, 0.020294, " exponential", false], [64862, 0.020226, " computational", false], [30808, 0.017376, " fact", false], [63370, 0.016973, " computation", false]]]}, "raw_delta": -0.5520833333333334, "tuned_delta": -0.4979937359182578}, {"byte_start": 865, "byte_end": 870, "display": {"text": "aging", "kind": "normal"}, "is_word": true, "word_id": 148, "word_key": "aging", "bytes_hex": "61 67 69 6e 67", "compression": {"model_a": "0.92% 0.92% 0.92% 0.92% 0.92%", "model_b": "0.50% 0.50% 0.50% 0.50% 0.50%"}, "model_tokens": {"model_a": [[33672, "aging", "normal", 0.7784444093704224]], "model_b": [[33672, "aging", "normal", 0.8712981939315796]]}, "loss": {"model_a": 0.9157732193142833, "model_b": 0.4966308612435152}, "topk": {"model_a": [33672, 1, 0.7784444093704224, [[33672, 0.778444, "aging", false], [32227, 0.056514, " that", false], [116, 0.042542, "s", false], [4706, 0.030483, " of", false], [1843, 0.010271, "ed", false], [22799, 0.008708, " you", false], [59206, 0.008635, " available", false], [7856, 0.008585, "ing", false], [32232, 0.00828, " they", false], [6934, 0.002499, "aga", false]]], "model_b": [33672, 1, 0.8712981939315796, [[33672, 0.871298, "aging", false], [7856, 0.030571, "ing", false], [1843, 0.025312, "ed", false], [32227, 0.018324, " that", false], [460, 0.005598, "'s", false], [116, 0.004414, "s", false], [4706, 0.004366, " of", false], [21289, 0.003716, " arm", false], [46, 0.00249, "-", false], [48811, 0.002273, "ability", false]]]}, "raw_delta": 0.0232421875, "tuned_delta": 0.07733178491507559}, {"byte_start": 870, "byte_end": 873, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 149, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.18% 0.18% 0.18%", "model_b": "0.80% 0.80% 0.80%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9712008237838745]], "model_b": [[4706, " of", "normal", 0.8750953674316406]]}, "loss": {"model_a": 0.17611023448351604, "model_b": 0.8042367374747231}, "topk": {"model_a": [4706, 1, 0.9712008237838745, [[4706, 0.971201, " of", false], [22590, 0.003842, " the", false], [63370, 0.003557, " computation", false], [32227, 0.003371, " that", false], [31458, 0.001212, " more", false], [21265, 0.001107, " and", false], [59206, 0.00097, " available", false], [51832, 0.000649, " general", false], [275, 0.000576, " (", false], [38720, 0.000543, " human", false]]], "model_b": [4706, 1, 0.8750953674316406, [[4706, 0.875095, " of", false], [32227, 0.027318, " that", false], [45828, 0.016795, " effect", false], [39339, 0.008208, " power", false], [47, 0.005568, ".", false], [22590, 0.004437, " the", false], [4450, 0.003303, " by", false], [21265, 0.002359, " and", false], [4596, 0.001898, " in", false], [61923, 0.001857, " efficiency", false]]]}, "raw_delta": -0.034830729166666664, "tuned_delta": 0.019258868248408924}, {"byte_start": 873, "byte_end": 885, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 150, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88%", "model_b": "3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.2883734107017517]], "model_b": [[63370, " computation", "normal", 0.08924080431461334]]}, "loss": {"model_a": 1.878509167824171, "model_b": 3.6161301480615293}, "topk": {"model_a": [63370, 1, 0.2883734107017517, [[63370, 0.288373, " computation", false], [22590, 0.129442, " the", false], [30789, 0.054575, " ever", false], [31458, 0.04456, " more", false], [51832, 0.038161, " general", false], [64862, 0.03177, " computational", false], [59988, 0.030973, " massively", false], [52195, 0.021507, " massive", false], [64430, 0.018577, " increasingly", false], [37045, 0.017253, " Moore", false]]], "model_b": [63370, 2, 0.08924080431461334, [[22590, 0.212819, " the", false], [63370, 0.089241, " computation", false], [64862, 0.061971, " computational", false], [31458, 0.052129, " more", false], [332, 0.037915, " a", false], [39931, 0.037331, " their", false], [59346, 0.033518, " computing", false], [38720, 0.029532, " human", false], [32227, 0.021172, " that", false], [64911, 0.020313, " exponentially", false]]]}, "raw_delta": -0.09635416666666667, "tuned_delta": -0.04226456925159108}, {"byte_start": 885, "byte_end": 886, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "9.09%", "model_b": "12.26%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6067418456077576]], "model_b": [[47, ".", "normal", 0.5058995485305786]]}, "loss": {"model_a": 9.087288099349427, "model_b": 12.257272320052715}, "topk": {"model_a": [47, 1, 0.6067418456077576, [[47, 0.606742, ".", false], [45, 0.129655, ",", false], [32227, 0.037035, " that", false], [4811, 0.03598, " to", false], [21265, 0.020088, " and", false], [59206, 0.017486, " available", false], [275, 0.016574, " (", false], [4596, 0.014383, " in", false], [31601, 0.009885, " over", false], [46342, 0.009815, " itself", false]]], "model_b": [47, 1, 0.5058995485305786, [[47, 0.5059, ".", false], [45, 0.07046, ",", false], [32227, 0.069067, " that", false], [4811, 0.062494, " to", false], [21265, 0.028212, " and", false], [4450, 0.025956, " by", false], [4596, 0.02355, " in", false], [21700, 0.015127, " for", false], [59206, 0.014799, " available", false], [275, 0.013825, " (", false]]]}, "raw_delta": -0.17578125, "tuned_delta": -0.12169165258492441}, {"byte_start": 886, "byte_end": 892, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 151, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"model_a": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "model_b": "18.22% 18.22% 18.22% 18.22% 18.22% 18.22%"}, "model_tokens": {"model_a": [[37453, " These", "normal", 0.0006322221015579998]], "model_b": [[37453, " These", "normal", 0.002346208319067955]]}, "loss": {"model_a": 22.166408180325217, "model_b": 18.22153892789446}, "topk": {"model_a": [37453, 90, 0.0006322221015579998, [[11, 0.361544, "\n", false], [261, 0.140946, "\n\n", false], [20996, 0.066386, " The", false], [29894, 0.047772, " This", false], [3913, 0.024106, " In", false], [3908, 0.017849, " If", false], [3918, 0.017349, " It", false], [3641, 0.01397, " As", false], [19417, 0.013264, " And", false], [0, 0.010645, "[0]", false]]], "model_b": [37453, 32, 0.002346208319067955, [[11, 0.394843, "\n", false], [261, 0.082366, "\n\n", false], [29894, 0.069066, " This", false], [20996, 0.059172, " The", false], [3913, 0.029432, " In", false], [0, 0.019692, "[0]", false], [3908, 0.016345, " If", false], [3641, 0.012959, " As", false], [3918, 0.012793, " It", false], [29889, 0.01105, " That", false]]]}, "raw_delta": 0.21875, "tuned_delta": 0.2728395974150756}, {"byte_start": 892, "byte_end": 896, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 152, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"model_a": "9.30% 9.30% 9.30% 9.30%", "model_b": "13.81% 13.81% 13.81% 13.81%"}, "model_tokens": {"model_a": [[22638, " two", "normal", 0.12694168090820312]], "model_b": [[22638, " two", "normal", 0.04687315225601196]]}, "loss": {"model_a": 9.298620380729647, "model_b": 13.807042383507657}, "topk": {"model_a": [22638, 1, 0.12694168090820312, [[22638, 0.126942, " two", false], [52127, 0.116239, " lessons", false], [21286, 0.112441, " are", false], [30582, 0.077645, " days", false], [52738, 0.042056, " results", false], [64495, 0.024045, " observations", false], [47539, 0.02168, " things", false], [38735, 0.020151, " ideas", false], [56463, 0.019488, " insights", false], [38440, 0.018844, " facts", false]]], "model_b": [22638, 4, 0.04687315225601196, [[21286, 0.120923, " are", false], [30582, 0.094749, " days", false], [52127, 0.054329, " lessons", false], [22638, 0.046873, " two", false], [52738, 0.027918, " results", false], [65135, 0.023512, " generalization", false], [52224, 0.022424, " methods", false], [51832, 0.021718, " general", false], [56237, 0.018321, " findings", false], [56463, 0.016093, " insights", false]]]}, "raw_delta": -0.25, "tuned_delta": -0.19591040258492443}, {"byte_start": 896, "byte_end": 901, "display": {"text": " need", "kind": "normal"}, "is_word": true, "word_id": 153, "word_key": " need", "bytes_hex": "20 6e 65 65 64", "compression": {"model_a": "38.77% 38.77% 38.77% 38.77% 38.77%", "model_b": "36.74% 36.74% 36.74% 36.74% 36.74%"}, "model_tokens": {"model_a": [[31506, " need", "normal", 2.2071797502576374e-05]], "model_b": [[31506, " need", "normal", 3.747626760741696e-05]]}, "loss": {"model_a": 38.77242922389089, "model_b": 36.74363932264078}, "topk": {"model_a": [31506, 1015, 2.2071797502576374e-05, [[52127, 0.144082, " lessons", false], [46853, 0.092754, " points", false], [38440, 0.089346, " facts", false], [47539, 0.052153, " things", false], [38735, 0.044716, " ideas", false], [51703, 0.041901, " factors", false], [64495, 0.035346, " observations", false], [47613, 0.035015, " trends", false], [56463, 0.024941, " insights", false], [46022, 0.022422, " forces", false]]], "model_b": [31506, 907, 3.747626760741696e-05, [[51703, 0.125693, " factors", false], [47539, 0.074349, " things", false], [38440, 0.045588, " facts", false], [52127, 0.039639, " lessons", false], [61590, 0.035251, " approaches", false], [46853, 0.034078, " points", false], [62370, 0.031727, " principles", false], [38604, 0.019714, " goals", false], [64495, 0.018267, " observations", false], [38735, 0.016521, " ideas", false]]]}, "raw_delta": 0.11249999999999982, "tuned_delta": 0.1665895974150754}, {"byte_start": 901, "byte_end": 905, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 154, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "2.50% 2.50% 2.50% 2.50%", "model_b": "4.28% 4.28% 4.28% 4.28%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.5746027827262878]], "model_b": [[22187, " not", "normal", 0.3872634768486023]]}, "loss": {"model_a": 2.5007653296659274, "model_b": 4.27947869794944}, "topk": {"model_a": [22187, 1, 0.5746027827262878, [[22187, 0.574603, " not", false], [4811, 0.347578, " to", false], [111, 0.041622, "n", false], [30719, 0.016453, " each", false], [122, 0.003112, "y", false], [4435, 0.002024, " be", false], [7592, 0.001194, "ful", false], [31581, 0.000894, " only", false], [4692, 0.000877, " no", false], [332, 0.000782, " a", false]]], "model_b": [22187, 2, 0.3872634768486023, [[4811, 0.482854, " to", false], [22187, 0.387263, " not", false], [111, 0.036906, "n", false], [46, 0.035106, "-", false], [31581, 0.01077, " only", false], [30719, 0.006424, " each", false], [39115, 0.005812, " never", false], [4435, 0.00269, " be", false], [26151, 0.001523, "ling", false], [45150, 0.001457, " always", false]]]}, "raw_delta": -0.0986328125, "tuned_delta": -0.04454321508492441}, {"byte_start": 905, "byte_end": 909, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 155, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "28.88% 28.88% 28.88% 28.88%", "model_b": "29.16% 29.16% 29.16% 29.16%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.0016512158326804638]], "model_b": [[22418, " run", "normal", 0.0015667503466829658]]}, "loss": {"model_a": 28.88207845529663, "model_b": 29.163854830470253}, "topk": {"model_a": [22418, 25, 0.0016512158326804638, [[4435, 0.698907, " be", false], [55824, 0.089738, " conflict", false], [4559, 0.023159, " go", false], [51255, 0.022956, " compete", false], [63717, 0.020847, " necessarily", false], [61779, 0.014937, " contradict", false], [45150, 0.013822, " always", false], [30788, 0.00674, " even", false], [30482, 0.005506, " come", false], [55769, 0.004843, " coincide", false]]], "model_b": [22418, 25, 0.0015667503466829658, [[4435, 0.667069, " be", false], [55824, 0.065278, " conflict", false], [4559, 0.04693, " go", false], [61779, 0.040173, " contradict", false], [45150, 0.024797, " always", false], [63717, 0.012554, " necessarily", false], [4811, 0.007549, " to", false], [32499, 0.006716, " work", false], [21265, 0.006476, " and", false], [55769, 0.00611, " coincide", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 909, "byte_end": 917, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 156, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"model_a": "8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49%", "model_b": "8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49%"}, "model_tokens": {"model_a": [[51336, " counter", "normal", 0.023207833990454674]], "model_b": [[51336, " counter", "normal", 0.023257697001099586]]}, "loss": {"model_a": 8.488513302105472, "model_b": 8.488513302105472}, "topk": {"model_a": [51336, 6, 0.023207833990454674, [[4596, 0.684405, " in", false], [64301, 0.070829, " concurrently", false], [57435, 0.055325, " together", false], [56812, 0.051997, " parallel", false], [65167, 0.034097, " simultaneously", false], [51336, 0.023208, " counter", false], [4424, 0.014395, " at", false], [31162, 0.006264, " into", false], [32011, 0.005742, " side", false], [31044, 0.005019, " hand", false]]], "model_b": [51336, 6, 0.023257697001099586, [[4596, 0.631153, " in", false], [57435, 0.094611, " together", false], [56812, 0.050046, " parallel", false], [65167, 0.03942, " simultaneously", false], [4424, 0.023925, " at", false], [51336, 0.023258, " counter", false], [64301, 0.020477, " concurrently", false], [31162, 0.015543, " into", false], [64930, 0.012043, " independently", false], [32011, 0.007406, " side", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 917, "byte_end": 920, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 157, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.07% 1.07% 1.07%", "model_b": "1.57% 1.57% 1.57%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8370802402496338]], "model_b": [[4811, " to", "normal", 0.7693809270858765]]}, "loss": {"model_a": 1.0684020891999972, "model_b": 1.573251428052743}, "topk": {"model_a": [4811, 1, 0.8370802402496338, [[4811, 0.83708, " to", false], [45, 0.046543, ",", false], [46, 0.03329, "-", false], [60, 0.017668, ";", false], [59, 0.014434, ":", false], [47, 0.011907, ".", false], [30719, 0.006606, " each", false], [4596, 0.002597, " in", false], [21400, 0.00197, " but", false], [35408, 0.001863, "point", false]]], "model_b": [4811, 1, 0.7693809270858765, [[4811, 0.769381, " to", false], [45, 0.078048, ",", false], [47, 0.034191, ".", false], [46, 0.026197, "-", false], [60, 0.018993, ";", false], [59, 0.015454, ":", false], [4596, 0.007048, " in", false], [21400, 0.006863, " but", false], [61076, 0.003584, "productive", false], [21265, 0.002609, " and", false]]]}, "raw_delta": -0.027994791666666668, "tuned_delta": 0.02609480574840892}, {"byte_start": 920, "byte_end": 925, "display": {"text": " each", "kind": "normal"}, "is_word": true, "word_id": 158, "word_key": " each", "bytes_hex": "20 65 61 63 68", "compression": {"model_a": "1.20% 1.20% 1.20% 1.20% 1.20%", "model_b": "1.27% 1.27% 1.27% 1.27% 1.27%"}, "model_tokens": {"model_a": [[30719, " each", "normal", 0.7160350680351257]], "model_b": [[30719, " each", "normal", 0.704334020614624]]}, "loss": {"model_a": 1.2045940038672498, "model_b": 1.2679936882813154}, "topk": {"model_a": [30719, 1, 0.7160350680351257, [[30719, 0.716035, " each", false], [22226, 0.280017, " one", false], [22590, 0.001423, " the", false], [332, 0.000392, " a", false], [50919, 0.000242, " another", false], [45, 0.000173, ",", false], [39193, 0.000154, " other", false], [21273, 0.000147, " any", false], [62643, 0.000101, " themselves", false], [4715, 6.5e-05, " or", false]]], "model_b": [30719, 1, 0.704334020614624, [[30719, 0.704334, " each", false], [22226, 0.286537, " one", false], [22590, 0.002126, " the", false], [332, 0.000734, " a", false], [4715, 0.000692, " or", false], [21273, 0.00052, " any", false], [32464, 0.000234, " what", false], [45, 0.000232, ",", false], [21265, 0.000163, " and", false], [4435, 0.000147, " be", false]]]}, "raw_delta": -0.0035156249999999944, "tuned_delta": 0.050573972415075594}, {"byte_start": 925, "byte_end": 931, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 159, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%", "model_b": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.9946094751358032]], "model_b": [[39193, " other", "normal", 0.9922688603401184]]}, "loss": {"model_a": 0.016235162241449132, "model_b": 0.023206192356421643}, "topk": {"model_a": [39193, 1, 0.9946094751358032, [[39193, 0.994609, " other", false], [46, 0.001437, "-", false], [35297, 0.001021, "other", false], [50919, 0.000863, " another", false], [46726, 0.000635, " others", false], [45, 0.000382, ",", false], [47, 0.000115, ".", false], [11, 7.3e-05, "\n", false], [4596, 6.4e-05, " in", false], [4811, 5.9e-05, " to", false]]], "model_b": [39193, 1, 0.9922688603401184, [[39193, 0.992269, " other", false], [46, 0.003447, "-", false], [50919, 0.001272, " another", false], [35297, 0.000786, "other", false], [46726, 0.000733, " others", false], [45, 0.000305, ",", false], [22590, 0.00025, " the", false], [11, 8.4e-05, "\n", false], [47, 8.4e-05, ".", false], [4717, 7.1e-05, " ot", false]]]}, "raw_delta": -0.00038655598958333326, "tuned_delta": 0.05370304142549225}, {"byte_start": 931, "byte_end": 932, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "18.60%", "model_b": "16.91%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.34999677538871765]], "model_b": [[45, ",", "normal", 0.393478661775589]]}, "loss": {"model_a": 18.597240761459293, "model_b": 16.90658251041754}, "topk": {"model_a": [45, 1, 0.34999677538871765, [[45, 0.349997, ",", false], [47, 0.20553, ".", false], [59, 0.148101, ":", false], [60, 0.105455, ";", false], [21400, 0.015337, " but", false], [4596, 0.01408, " in", false], [51018, 0.013786, " because", false], [275, 0.013734, " (", false], [4424, 0.013089, " at", false], [280, 0.013078, " -", false]]], "model_b": [45, 1, 0.393478661775589, [[45, 0.393479, ",", false], [47, 0.20308, ".", false], [59, 0.090557, ":", false], [60, 0.088143, ";", false], [21400, 0.042775, " but", false], [21265, 0.025263, " and", false], [4596, 0.018448, " in", false], [275, 0.014086, " (", false], [4423, 0.012189, " as", false], [280, 0.010152, " -", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 932, "byte_end": 936, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 160, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "5.25% 5.25% 5.25% 5.25%", "model_b": "4.35% 4.35% 4.35% 4.35%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.3121977150440216]], "model_b": [[21400, " but", "normal", 0.3881939947605133]]}, "loss": {"model_a": 5.248084987608777, "model_b": 4.349922791742846}, "topk": {"model_a": [21400, 1, 0.3121977150440216, [[21400, 0.312198, " but", false], [4423, 0.149926, " as", false], [21265, 0.095056, " and", false], [51948, 0.061952, " however", false], [39690, 0.061606, " since", false], [4596, 0.052091, " in", false], [51018, 0.047472, " because", false], [47544, 0.043504, " though", false], [4706, 0.021436, " of", false], [21700, 0.012967, " for", false]]], "model_b": [21400, 1, 0.3881939947605133, [[21400, 0.388194, " but", false], [21265, 0.172627, " and", false], [4423, 0.082562, " as", false], [4596, 0.055798, " in", false], [32232, 0.031073, " they", false], [47544, 0.023466, " though", false], [22185, 0.019587, " nor", false], [51948, 0.017792, " however", false], [51018, 0.016075, " because", false], [39690, 0.010918, " since", false]]]}, "raw_delta": 0.0498046875, "tuned_delta": 0.10389428491507559}, {"byte_start": 936, "byte_end": 939, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 161, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "19.44% 19.44% 19.44%", "model_b": "18.79% 18.79% 18.79%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.03985238075256348]], "model_b": [[4596, " in", "normal", 0.04404280334711075]]}, "loss": {"model_a": 19.44256988698017, "model_b": 18.78509167824171}, "topk": {"model_a": [4596, 4, 0.03985238075256348, [[32232, 0.228443, " they", false], [4601, 0.112102, " it", false], [22590, 0.076137, " the", false], [4596, 0.039852, " in", false], [4588, 0.027184, " if", false], [21286, 0.022559, " are", false], [39934, 0.02241, " there", false], [21700, 0.017828, " for", false], [47001, 0.016026, " rather", false], [22226, 0.015842, " one", false]]], "model_b": [4596, 4, 0.04404280334711075, [[32232, 0.206448, " they", false], [47001, 0.094663, " rather", false], [22590, 0.077789, " the", false], [4596, 0.044043, " in", false], [4601, 0.040444, " it", false], [52028, 0.03116, " instead", false], [4588, 0.026886, " if", false], [32465, 0.023481, " when", false], [47266, 0.01938, " should", false], [21413, 0.016935, " can", false]]]}, "raw_delta": 0.03645833333333326, "tuned_delta": 0.09054793074840885}, {"byte_start": 939, "byte_end": 948, "display": {"text": " practice", "kind": "normal"}, "is_word": true, "word_id": 162, "word_key": " practice", "bytes_hex": "20 70 72 61 63 74 69 63 65", "compression": {"model_a": "2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41%", "model_b": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"model_a": [[56901, " practice", "normal", 0.3012830317020416]], "model_b": [[56901, " practice", "normal", 0.18307575583457947]]}, "loss": {"model_a": 2.410753432041019, "model_b": 3.3813165020835076}, "topk": {"model_a": [56901, 2, 0.3012830317020416, [[22590, 0.319479, " the", false], [56901, 0.301283, " practice", false], [30808, 0.047371, " fact", false], [31370, 0.036926, " many", false], [31461, 0.028251, " most", false], [39189, 0.02413, " order", false], [51832, 0.019897, " general", false], [32074, 0.018274, " some", false], [332, 0.017392, " a", false], [32234, 0.015541, " this", false]]], "model_b": [56901, 2, 0.18307575583457947, [[22590, 0.201188, " the", false], [56901, 0.183076, " practice", false], [51832, 0.081298, " general", false], [30808, 0.057596, " fact", false], [31370, 0.048445, " many", false], [31461, 0.047674, " most", false], [332, 0.041524, " a", false], [39189, 0.024207, " order", false], [3609, 0.024037, " AI", false], [52652, 0.02341, " reality", false]]]}, "raw_delta": -0.053819444444444434, "tuned_delta": 0.0002701529706311545}, {"byte_start": 948, "byte_end": 953, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 163, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"model_a": "3.92% 3.92% 3.92% 3.92% 3.92%", "model_b": "2.90% 2.90% 2.90% 2.90% 2.90%"}, "model_tokens": {"model_a": [[32232, " they", "normal", 0.3347264230251312]], "model_b": [[32232, " they", "normal", 0.44213178753852844]]}, "loss": {"model_a": 3.9166916149133963, "model_b": 2.902296664288344}, "topk": {"model_a": [32232, 1, 0.3347264230251312, [[32232, 0.334726, " they", false], [45, 0.116147, ",", false], [22590, 0.097098, " the", false], [4601, 0.07882, " it", false], [39934, 0.034956, " there", false], [32234, 0.023624, " this", false], [63843, 0.021321, " researchers", false], [31461, 0.019253, " most", false], [4858, 0.016567, " we", false], [31370, 0.015238, " many", false]]], "model_b": [32232, 1, 0.44213178753852844, [[32232, 0.442132, " they", false], [45, 0.159466, ",", false], [22590, 0.065786, " the", false], [4601, 0.027451, " it", false], [31461, 0.0227, " most", false], [32234, 0.021304, " this", false], [32216, 0.019507, " tend", false], [21286, 0.017535, " are", false], [39934, 0.012571, " there", false], [32227, 0.01229, " that", false]]]}, "raw_delta": 0.05625, "tuned_delta": 0.1103395974150756}, {"byte_start": 953, "byte_end": 958, "display": {"text": " tend", "kind": "normal"}, "is_word": true, "word_id": 164, "word_key": " tend", "bytes_hex": "20 74 65 6e 64", "compression": {"model_a": "11.38% 11.38% 11.38% 11.38% 11.38%", "model_b": "9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[32216, " tend", "normal", 0.04244176670908928]], "model_b": [[32216, " tend", "normal", 0.07021617889404297]]}, "loss": {"model_a": 11.383765557014476, "model_b": 9.580396755903271}, "topk": {"model_a": [32216, 5, 0.04244176670908928, [[4491, 0.258109, " do", false], [31059, 0.177194, " have", false], [39171, 0.160973, " often", false], [21286, 0.098834, " are", false], [32216, 0.042442, " tend", false], [21413, 0.030162, " can", false], [31967, 0.02112, " seem", false], [60523, 0.020637, " sometimes", false], [53248, 0.013855, " usually", false], [45145, 0.010364, " almost", false]]], "model_b": [32216, 3, 0.07021617889404297, [[4491, 0.370085, " do", false], [39171, 0.204496, " often", false], [32216, 0.070216, " tend", false], [45145, 0.068245, " almost", false], [21286, 0.051925, " are", false], [45150, 0.024242, " always", false], [62024, 0.021901, " frequently", false], [53248, 0.017831, " usually", false], [21413, 0.015764, " can", false], [31059, 0.015614, " have", false]]]}, "raw_delta": 0.09999999999999998, "tuned_delta": 0.15408959741507555}, {"byte_start": 958, "byte_end": 961, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 165, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.10% 0.10% 0.10%", "model_b": "0.16% 0.16% 0.16%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9841216802597046]], "model_b": [[4811, " to", "normal", 0.9732500910758972]]}, "loss": {"model_a": 0.0961268363222525, "model_b": 0.1629019668972523}, "topk": {"model_a": [4811, 1, 0.9841216802597046, [[4811, 0.984122, " to", false], [22187, 0.009021, " not", false], [4491, 0.000918, " do", false], [53169, 0.00074, " towards", false], [47585, 0.000636, " toward", false], [4596, 0.000334, " in", false], [22418, 0.000317, " run", false], [45, 0.000246, ",", false], [21700, 0.000188, " for", false], [22614, 0.000153, " too", false]]], "model_b": [4811, 1, 0.9732500910758972, [[4811, 0.97325, " to", false], [22187, 0.009809, " not", false], [47585, 0.004526, " toward", false], [53169, 0.003622, " towards", false], [4596, 0.000914, " in", false], [4491, 0.000824, " do", false], [31458, 0.000386, " more", false], [45, 0.000344, ",", false], [30322, 0.000303, " both", false], [32386, 0.00028, " very", false]]]}, "raw_delta": -0.0037027994791666665, "tuned_delta": 0.050386797935908924}, {"byte_start": 961, "byte_end": 962, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "30.15%", "model_b": "37.48%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.18680818378925323]], "model_b": [[47, ".", "normal", 0.12596148252487183]]}, "loss": {"model_a": 30.150072143577944, "model_b": 37.47625789809221}, "topk": {"model_a": [47, 1, 0.18680818378925323, [[47, 0.186808, ".", false], [4491, 0.14348, " do", false], [4435, 0.140456, " be", false], [22418, 0.075125, " run", false], [51255, 0.038406, " compete", false], [45, 0.036937, ",", false], [55824, 0.027529, " conflict", false], [4559, 0.021421, " go", false], [31059, 0.019723, " have", false], [59, 0.018619, ":", false]]], "model_b": [47, 2, 0.12596148252487183, [[4491, 0.288234, " do", false], [47, 0.125961, ".", false], [4435, 0.072639, " be", false], [22418, 0.065671, " run", false], [4559, 0.040625, " go", false], [45, 0.030292, ",", false], [56475, 0.0234, " interact", false], [51255, 0.011541, " compete", false], [59, 0.010395, ":", false], [51233, 0.010187, " collide", false]]]}, "raw_delta": -0.40625, "tuned_delta": -0.3521604025849244}, {"byte_start": 962, "byte_end": 967, "display": {"text": " Time", "kind": "normal"}, "is_word": true, "word_id": 166, "word_key": " time", "bytes_hex": "20 54 69 6d 65", "compression": {"model_a": "31.56% 31.56% 31.56% 31.56% 31.56%", "model_b": "34.94% 34.94% 34.94% 34.94% 34.94%"}, "model_tokens": {"model_a": [[29904, " Time", "normal", 0.00015415129018947482]], "model_b": [[29904, " Time", "normal", 6.0473808844108135e-05]]}, "loss": {"model_a": 31.55895401944607, "model_b": 34.94027052152958}, "topk": {"model_a": [29904, 259, 0.00015415129018947482, [[11, 0.384399, "\n", false], [261, 0.132226, "\n\n", false], [20996, 0.067632, " The", false], [19907, 0.024179, " For", false], [3913, 0.023985, " In", false], [29894, 0.020572, " This", false], [3918, 0.017416, " It", false], [3908, 0.01347, " If", false], [300, 0.01145, " A", false], [3641, 0.0101, " As", false]]], "model_b": [29904, 474, 6.0473808844108135e-05, [[11, 0.414235, "\n", false], [261, 0.095585, "\n\n", false], [20996, 0.065731, " The", false], [29894, 0.033232, " This", false], [3913, 0.027642, " In", false], [19907, 0.023054, " For", false], [0, 0.016162, "[0]", false], [3641, 0.012748, " As", false], [300, 0.010777, " A", false], [3918, 0.009055, " It", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13341040258492443}, {"byte_start": 967, "byte_end": 973, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 167, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"model_a": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "model_b": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%"}, "model_tokens": {"model_a": [[39762, " spent", "normal", 0.06628917157649994]], "model_b": [[39762, " spent", "normal", 0.04816161096096039]]}, "loss": {"model_a": 8.171514880035144, "model_b": 9.11076946394723}, "topk": {"model_a": [39762, 4, 0.06628917157649994, [[21265, 0.224257, " and", false], [32475, 0.173081, " will", false], [4600, 0.143911, " is", false], [39762, 0.066289, " spent", false], [4811, 0.046215, " to", false], [62307, 0.045497, " permitting", false], [46, 0.038669, "-", false], [21800, 0.019, " has", false], [45, 0.017429, ",", false], [63396, 0.013565, " constraints", false]]], "model_b": [39762, 4, 0.04816161096096039, [[4600, 0.224307, " is", false], [21265, 0.193488, " and", false], [4811, 0.076808, " to", false], [39762, 0.048162, " spent", false], [46, 0.035874, "-", false], [45, 0.030951, ",", false], [32475, 0.029982, " will", false], [21700, 0.028943, " for", false], [21800, 0.02319, " has", false], [2030, 0.021557, "ly", false]]]}, "raw_delta": -0.05208333333333337, "tuned_delta": 0.002006264081742218}, {"byte_start": 973, "byte_end": 976, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 168, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "9.67% 9.67% 9.67%", "model_b": "7.56% 7.56% 7.56%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.20093382894992828]], "model_b": [[4712, " on", "normal", 0.28450098633766174]]}, "loss": {"model_a": 9.674322214294481, "model_b": 7.560999400492288}, "topk": {"model_a": [4712, 1, 0.20093382894992828, [[4712, 0.200934, " on", false], [4596, 0.047296, " in", false], [47629, 0.041765, " trying", false], [61857, 0.030057, " developing", false], [52834, 0.029152, " seeking", false], [38888, 0.028236, " lever", false], [59832, 0.02465, " improving", false], [56537, 0.023161, " learning", false], [60463, 0.020666, " searching", false], [57419, 0.019835, " thinking", false]]], "model_b": [4712, 1, 0.28450098633766174, [[4712, 0.284501, " on", false], [4596, 0.08565, " in", false], [56537, 0.03912, " learning", false], [62271, 0.027539, " optimizing", false], [38279, 0.027122, " doing", false], [38888, 0.019382, " lever", false], [63844, 0.017251, " researching", false], [60463, 0.016315, " searching", false], [4450, 0.015782, " by", false], [47629, 0.014967, " trying", false]]]}, "raw_delta": 0.11718750000000006, "tuned_delta": 0.17127709741507563}, {"byte_start": 976, "byte_end": 980, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 169, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"model_a": "20.71% 20.71% 20.71% 20.71%", "model_b": "26.35% 26.35% 26.35% 26.35%"}, "model_tokens": {"model_a": [[22226, " one", "normal", 0.010251494124531746]], "model_b": [[22226, " one", "normal", 0.002868288429453969]]}, "loss": {"model_a": 20.710563575261485, "model_b": 26.346091078734}, "topk": {"model_a": [22226, 11, 0.010251494124531746, [[22590, 0.10022, " the", false], [38720, 0.068896, " human", false], [332, 0.053036, " a", false], [57103, 0.036788, " research", false], [38888, 0.029657, " lever", false], [59832, 0.023433, " improving", false], [45775, 0.014009, " domain", false], [45490, 0.012178, " clever", false], [61857, 0.01184, " developing", false], [55666, 0.011527, " building", false]]], "model_b": [22226, 54, 0.002868288429453969, [[38720, 0.072529, " human", false], [332, 0.055935, " a", false], [22590, 0.055625, " the", false], [51832, 0.027165, " general", false], [57103, 0.021865, " research", false], [63370, 0.018895, " computation", false], [56537, 0.014635, " learning", false], [59832, 0.014526, " improving", false], [45775, 0.014243, " domain", false], [59346, 0.011403, " computing", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.2584104025849244}, {"byte_start": 980, "byte_end": 983, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 170, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "11.04% 11.04% 11.04%", "model_b": "13.81% 13.81% 13.81%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.15896400809288025]], "model_b": [[4600, " is", "normal", 0.10053083300590515]]}, "loss": {"model_a": 11.036241360967004, "model_b": 13.807042383507657}, "topk": {"model_a": [4600, 1, 0.15896400809288025, [[4600, 0.158964, " is", false], [21413, 0.055196, " can", false], [32475, 0.03613, " will", false], [39914, 0.034497, " tends", false], [4715, 0.031097, " or", false], [39941, 0.024198, " thing", false], [30659, 0.022441, " does", false], [4424, 0.019978, " at", false], [32202, 0.019124, " task", false], [22074, 0.018737, " may", false]]], "model_b": [4600, 1, 0.10053083300590515, [[4600, 0.100531, " is", false], [32202, 0.0642, " task", false], [21413, 0.038729, " can", false], [45775, 0.032313, " domain", false], [4706, 0.032044, " of", false], [39941, 0.029427, " thing", false], [32475, 0.029275, " will", false], [39914, 0.024312, " tends", false], [4715, 0.020168, " or", false], [30173, 0.01839, " area", false]]]}, "raw_delta": -0.15364583333333337, "tuned_delta": -0.09955623591825778}, {"byte_start": 983, "byte_end": 988, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 171, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "2.16% 2.16% 2.16% 2.16% 2.16%", "model_b": "7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.5482905507087708]], "model_b": [[32251, " time", "normal", 0.12457092106342316]]}, "loss": {"model_a": 2.155589270078236, "model_b": 7.551606854653167}, "topk": {"model_a": [32251, 1, 0.5482905507087708, [[32251, 0.548291, " time", false], [62110, 0.095722, " inevitably", false], [39762, 0.038598, " spent", false], [39171, 0.022766, " often", false], [332, 0.021824, " a", false], [63717, 0.019603, " necessarily", false], [47768, 0.012613, " wasted", false], [53248, 0.012257, " usually", false], [22187, 0.010862, " not", false], [46439, 0.010774, " likely", false]]], "model_b": [32251, 3, 0.12457092106342316, [[39762, 0.167135, " spent", false], [39171, 0.12784, " often", false], [32251, 0.124571, " time", false], [22187, 0.036299, " not", false], [47768, 0.032974, " wasted", false], [53248, 0.023989, " usually", false], [31458, 0.018776, " more", false], [60687, 0.014959, " typically", false], [45150, 0.013011, " always", false], [32354, 0.012487, " used", false]]]}, "raw_delta": -0.29921875, "tuned_delta": -0.2451291525849244}, {"byte_start": 988, "byte_end": 992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 172, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "2.85% 2.85% 2.85% 2.85%", "model_b": "8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.5307666063308716]], "model_b": [[22187, " not", "normal", 0.16022205352783203]]}, "loss": {"model_a": 2.8529857986329596, "model_b": 8.24195897382855}, "topk": {"model_a": [22187, 1, 0.5307666063308716, [[22187, 0.530767, " not", false], [39762, 0.19014, " spent", false], [31334, 0.082802, " lost", false], [32227, 0.055468, " that", false], [47768, 0.02939, " wasted", false], [30211, 0.028751, " away", false], [39887, 0.020838, " taken", false], [63954, 0.008373, " unavailable", false], [31277, 0.00542, " less", false], [22218, 0.002672, " off", false]]], "model_b": [22187, 2, 0.16022205352783203, [[39762, 0.311299, " spent", false], [22187, 0.160222, " not", false], [39586, 0.141841, " saved", false], [31334, 0.083017, " lost", false], [47768, 0.051624, " wasted", false], [38554, 0.035618, " freed", false], [32227, 0.033503, " that", false], [39887, 0.027904, " taken", false], [56495, 0.013306, " invested", false], [32458, 0.011497, " well", false]]]}, "raw_delta": -0.298828125, "tuned_delta": -0.24473852758492443}, {"byte_start": 992, "byte_end": 998, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 173, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"model_a": [[39762, " spent", "normal", 0.9659992456436157]], "model_b": [[39762, " spent", "normal", 0.9116665124893188]]}, "loss": {"model_a": 0.10419855540274699, "model_b": 0.27737361931153776}, "topk": {"model_a": [39762, 1, 0.9659992456436157, [[39762, 0.965999, " spent", false], [59206, 0.018936, " available", false], [51459, 0.002126, " devoted", false], [4712, 0.002086, " on", false], [56495, 0.001979, " invested", false], [32354, 0.00123, " used", false], [39761, 0.001206, " spend", false], [57278, 0.000584, " spending", false], [22339, 0.000523, " put", false], [38594, 0.000351, " given", false]]], "model_b": [39762, 1, 0.9116665124893188, [[39762, 0.911667, " spent", false], [47768, 0.013793, " wasted", false], [56495, 0.0105, " invested", false], [46650, 0.008741, " needed", false], [39887, 0.005418, " taken", false], [31334, 0.004739, " lost", false], [59206, 0.004041, " available", false], [32354, 0.003911, " used", false], [45927, 0.001898, " expend", false], [39761, 0.001812, " spend", false]]]}, "raw_delta": -0.00960286458333333, "tuned_delta": 0.04448673283174226}, {"byte_start": 998, "byte_end": 1001, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 174, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.19% 0.19% 0.19%", "model_b": "0.58% 0.58% 0.58%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9695765972137451]], "model_b": [[4712, " on", "normal", 0.908633291721344]]}, "loss": {"model_a": 0.18564953885137314, "model_b": 0.5752934326461523}, "topk": {"model_a": [4712, 1, 0.9695765972137451, [[4712, 0.969577, " on", false], [38279, 0.002605, " doing", false], [22590, 0.002081, " the", false], [4596, 0.001891, " in", false], [38888, 0.001312, " lever", false], [61857, 0.001299, " developing", false], [59832, 0.001283, " improving", false], [21700, 0.001013, " for", false], [53362, 0.000967, " working", false], [59608, 0.000956, " elsewhere", false]]], "model_b": [4712, 1, 0.908633291721344, [[4712, 0.908633, " on", false], [38279, 0.00833, " doing", false], [38888, 0.006853, " lever", false], [59346, 0.00628, " computing", false], [59608, 0.00627, " elsewhere", false], [59686, 0.00316, " exploring", false], [4596, 0.002668, " in", false], [21700, 0.002282, " for", false], [55666, 0.002193, " building", false], [59832, 0.001847, " improving", false]]]}, "raw_delta": -0.0216064453125, "tuned_delta": 0.03248315210257559}, {"byte_start": 1001, "byte_end": 1005, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 175, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10%", "model_b": "0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.9790688157081604]], "model_b": [[22590, " the", "normal", 0.8157058358192444]]}, "loss": {"model_a": 0.09575994000041184, "model_b": 0.9245787310384591}, "topk": {"model_a": [22590, 1, 0.9790688157081604, [[22590, 0.979069, " the", false], [50919, 0.009265, " another", false], [39193, 0.001319, " other", false], [59832, 0.001289, " improving", false], [38888, 0.00061, " lever", false], [45833, 0.000422, " either", false], [30322, 0.000383, " both", false], [332, 0.000368, " a", false], [31458, 0.000266, " more", false], [32464, 0.000255, " what", false]]], "model_b": [22590, 1, 0.8157058358192444, [[22590, 0.815706, " the", false], [50919, 0.07644, " another", false], [39193, 0.029463, " other", false], [55521, 0.013846, " anything", false], [45833, 0.006978, " either", false], [21273, 0.006838, " any", false], [60522, 0.004438, " something", false], [332, 0.003753, " a", false], [59346, 0.00371, " computing", false], [46726, 0.002761, " others", false]]]}, "raw_delta": -0.04595947265625, "tuned_delta": 0.008130124758825588}, {"byte_start": 1005, "byte_end": 1011, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 176, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%", "model_b": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.9952180981636047]], "model_b": [[39193, " other", "normal", 0.9534317255020142]]}, "loss": {"model_a": 0.014400680632245842, "model_b": 0.14382335816153807}, "topk": {"model_a": [39193, 1, 0.9952180981636047, [[39193, 0.995218, " other", false], [31515, 0.000768, " next", false], [46726, 0.000403, " others", false], [46405, 0.000402, " latter", false], [45301, 0.000374, " better", false], [31458, 0.000253, " more", false], [47205, 0.000222, " second", false], [45961, 0.000105, " faster", false], [31323, 0.000104, " long", false], [56767, 7.7e-05, " opposite", false]]], "model_b": [39193, 1, 0.9534317255020142, [[39193, 0.953432, " other", false], [31515, 0.012905, " next", false], [47205, 0.006461, " second", false], [31458, 0.00326, " more", false], [46405, 0.002393, " latter", false], [46470, 0.001864, " longer", false], [45301, 0.001515, " better", false], [38888, 0.000925, " lever", false], [46726, 0.00073, " others", false], [31277, 0.00071, " less", false]]]}, "raw_delta": -0.007176717122395833, "tuned_delta": 0.04691288029267975}, {"byte_start": 1011, "byte_end": 1012, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "8.49%", "model_b": "9.23%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6266527771949768]], "model_b": [[47, ".", "normal", 0.5966031551361084]]}, "loss": {"model_a": 8.488513302105472, "model_b": 9.22817628693624}, "topk": {"model_a": [47, 1, 0.6266527771949768, [[47, 0.626653, ".", false], [45, 0.302841, ",", false], [60, 0.016374, ";", false], [21265, 0.015433, " and", false], [275, 0.01133, " (", false], [59, 0.002982, ":", false], [34, 0.001864, "!", false], [9816, 0.001804, "—", false], [4596, 0.001661, " in", false], [280, 0.001412, " -", false]]], "model_b": [47, 1, 0.5966031551361084, [[47, 0.596603, ".", false], [45, 0.269219, ",", false], [21265, 0.05112, " and", false], [60, 0.017549, ";", false], [275, 0.015881, " (", false], [59, 0.005404, ":", false], [9816, 0.00304, "—", false], [21400, 0.002372, " but", false], [4596, 0.002339, " in", false], [32227, 0.002286, " that", false]]]}, "raw_delta": -0.041015625, "tuned_delta": 0.013073972415075588}, {"byte_start": 1012, "byte_end": 1018, "display": {"text": " There", "kind": "normal"}, "is_word": true, "word_id": 177, "word_key": " there", "bytes_hex": "20 54 68 65 72 65", "compression": {"model_a": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "model_b": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%"}, "model_tokens": {"model_a": [[37451, " There", "normal", 0.00949584599584341]], "model_b": [[37451, " There", "normal", 0.006199849769473076]]}, "loss": {"model_a": 13.994893300290073, "model_b": 15.309849717766994}, "topk": {"model_a": [37451, 14, 0.00949584599584341, [[11, 0.367848, "\n", false], [261, 0.106152, "\n\n", false], [20996, 0.067001, " The", false], [29894, 0.032806, " This", false], [3913, 0.025539, " In", false], [19555, 0.021221, " But", false], [3918, 0.017725, " It", false], [19417, 0.016521, " And", false], [3908, 0.015247, " If", false], [4217, 0.011594, " So", false]]], "model_b": [37451, 17, 0.006199849769473076, [[11, 0.433917, "\n", false], [261, 0.0944, "\n\n", false], [20996, 0.055114, " The", false], [29894, 0.038743, " This", false], [0, 0.027041, "[0]", false], [3913, 0.024729, " In", false], [3908, 0.012997, " If", false], [3918, 0.012881, " It", false], [19907, 0.011934, " For", false], [19417, 0.010877, " And", false]]]}, "raw_delta": -0.07291666666666674, "tuned_delta": -0.018827069251591153}, {"byte_start": 1018, "byte_end": 1022, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 178, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "6.06% 6.06% 6.06% 6.06%", "model_b": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.26257655024528503]], "model_b": [[21286, " are", "normal", 0.3585837185382843]]}, "loss": {"model_a": 6.058192066232952, "model_b": 4.649310190364823}, "topk": {"model_a": [21286, 2, 0.26257655024528503, [[4600, 0.48708, " is", false], [21286, 0.262577, " are", false], [460, 0.125651, "'s", false], [32475, 0.018146, " will", false], [21800, 0.01806, " has", false], [31059, 0.016646, " have", false], [22074, 0.010557, " may", false], [22748, 0.006616, " was", false], [21413, 0.005096, " can", false], [21896, 0.003484, " isn", false]]], "model_b": [21286, 2, 0.3585837185382843, [[4600, 0.456135, " is", false], [21286, 0.358584, " are", false], [460, 0.054129, "'s", false], [32475, 0.022148, " will", false], [21800, 0.013455, " has", false], [31059, 0.013409, " have", false], [22074, 0.013024, " may", false], [22748, 0.008022, " was", false], [21413, 0.007783, " can", false], [1950, 0.004104, "in", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13221459741507557}, {"byte_start": 1022, "byte_end": 1036, "display": {"text": " psychological", "kind": "normal"}, "is_word": true, "word_id": 179, "word_key": " psychological", "bytes_hex": "20 70 73 79 63 68 6f 6c 6f 67 69 63 61 6c", "compression": {"model_a": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%", "model_b": "13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77%"}, "model_tokens": {"model_a": [[64997, " psychological", "normal", 2.0256720745237544e-05]], "model_b": [[64997, " psychological", "normal", 2.266145202156622e-05]]}, "loss": {"model_a": 13.927803687153498, "model_b": 13.766788615625709}, "topk": {"model_a": [64997, 1190, 2.0256720745237544e-05, [[31370, 0.112075, " many", false], [332, 0.061086, " a", false], [22638, 0.058616, " two", false], [32074, 0.057009, " some", false], [61963, 0.039627, " exceptions", false], [45, 0.028475, ",", false], [4692, 0.024944, " no", false], [32448, 0.023521, " ways", false], [39193, 0.022537, " other", false], [46844, 0.021992, " plenty", false]]], "model_b": [64997, 964, 2.266145202156622e-05, [[31370, 0.14531, " many", false], [332, 0.104148, " a", false], [22638, 0.072213, " two", false], [32074, 0.045251, " some", false], [39193, 0.039535, " other", false], [45, 0.030469, ",", false], [52869, 0.028285, " several", false], [30135, 0.026007, " also", false], [61963, 0.02345, " exceptions", false], [4692, 0.022523, " no", false]]]}, "raw_delta": 0.008928571428571508, "tuned_delta": 0.0630181688436471}, {"byte_start": 1036, "byte_end": 1048, "display": {"text": " commitments", "kind": "normal"}, "is_word": true, "word_id": 180, "word_key": " commitments", "bytes_hex": "20 63 6f 6d 6d 69 74 6d 65 6e 74 73", "compression": {"model_a": "11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60%", "model_b": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%"}, "model_tokens": {"model_a": [[63351, " commitments", "normal", 0.0004456617753021419]], "model_b": [[63351, " commitments", "normal", 8.507529128110036e-05]]}, "loss": {"model_a": 11.599794111314257, "model_b": 14.088818758681281}, "topk": {"model_a": [63351, 78, 0.0004456617753021419, [[52654, 0.273222, " reasons", false], [21265, 0.212049, " and", false], [55600, 0.049575, " barriers", false], [45304, 0.042014, " biases", false], [45, 0.039875, ",", false], [51703, 0.034032, " factors", false], [2030, 0.031716, "ly", false], [64392, 0.01762, " explanations", false], [38124, 0.01718, " costs", false], [62202, 0.015761, " mechanisms", false]]], "model_b": [63351, 302, 8.507529128110036e-05, [[52654, 0.349402, " reasons", false], [21265, 0.149205, " and", false], [51703, 0.047547, " factors", false], [55600, 0.041739, " barriers", false], [45, 0.028529, ",", false], [51565, 0.028508, " effects", false], [55621, 0.023061, " benefits", false], [2030, 0.020814, "ly", false], [50964, 0.017405, " aspects", false], [38124, 0.016043, " costs", false]]]}, "raw_delta": -0.1380208333333334, "tuned_delta": -0.08393123591825781}, {"byte_start": 1048, "byte_end": 1051, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 181, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "7.37% 7.37% 7.37%", "model_b": "5.52% 5.52% 5.52%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.2906183898448944]], "model_b": [[4811, " to", "normal", 0.4000721871852875]]}, "loss": {"model_a": 7.373148483709871, "model_b": 5.518120680483502}, "topk": {"model_a": [4811, 2, 0.2906183898448944, [[32227, 0.315365, " that", false], [4811, 0.290618, " to", false], [21265, 0.070367, " and", false], [45, 0.052378, ",", false], [56500, 0.037443, " involved", false], [4596, 0.021359, " in", false], [4712, 0.016909, " on", false], [4424, 0.012488, " at", false], [4423, 0.012136, " as", false], [47, 0.009632, ".", false]]], "model_b": [4811, 1, 0.4000721871852875, [[4811, 0.400072, " to", false], [32227, 0.275099, " that", false], [45, 0.04289, ",", false], [21265, 0.034348, " and", false], [56500, 0.027074, " involved", false], [4596, 0.026636, " in", false], [275, 0.020389, " (", false], [61603, 0.012371, " associated", false], [4858, 0.008863, " we", false], [4706, 0.007347, " of", false]]]}, "raw_delta": 0.10286458333333337, "tuned_delta": 0.15695418074840894}, {"byte_start": 1051, "byte_end": 1062, "display": {"text": " investment", "kind": "normal"}, "is_word": true, "word_id": 182, "word_key": " investment", "bytes_hex": "20 69 6e 76 65 73 74 6d 65 6e 74", "compression": {"model_a": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12%", "model_b": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12%"}, "model_tokens": {"model_a": [[62157, " investment", "normal", 0.00032562969136051834]], "model_b": [[62157, " investment", "normal", 0.00033091893419623375]]}, "loss": {"model_a": 13.11540946262694, "model_b": 13.11540946262694}, "topk": {"model_a": [62157, 229, 0.00032562969136051834, [[22590, 0.115616, " the", false], [30322, 0.093345, " both", false], [22226, 0.069928, " one", false], [30719, 0.051907, " each", false], [38720, 0.042149, " human", false], [332, 0.029714, " a", false], [39936, 0.028816, " these", false], [45833, 0.020094, " either", false], [38279, 0.019657, " doing", false], [51161, 0.018073, " certain", false]]], "model_b": [62157, 334, 0.00033091893419623375, [[22590, 0.112738, " the", false], [4435, 0.044767, " be", false], [38720, 0.035428, " human", false], [332, 0.027608, " a", false], [38279, 0.024381, " doing", false], [30322, 0.020611, " both", false], [22187, 0.018012, " not", false], [32251, 0.015512, " time", false], [32234, 0.015455, " this", false], [31205, 0.012536, " keep", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 1062, "byte_end": 1065, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 183, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "3.87% 3.87% 3.87%", "model_b": "4.34% 4.34% 4.34%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.5252020359039307]], "model_b": [[4596, " in", "normal", 0.4849129617214203]]}, "loss": {"model_a": 3.8744251586373526, "model_b": 4.344052450593395}, "topk": {"model_a": [4596, 1, 0.5252020359039307, [[4596, 0.525202, " in", false], [32227, 0.062513, " that", false], [4706, 0.055642, " of", false], [45, 0.041935, ",", false], [21265, 0.037269, " and", false], [56832, 0.03132, " patterns", false], [62581, 0.017144, " strategies", false], [47, 0.013758, ".", false], [59451, 0.013242, " decisions", false], [4712, 0.012996, " on", false]]], "model_b": [4596, 1, 0.4849129617214203, [[4596, 0.484913, " in", false], [32227, 0.201911, " that", false], [45, 0.064838, ",", false], [4706, 0.037357, " of", false], [21265, 0.037154, " and", false], [275, 0.015381, " (", false], [31351, 0.010584, " made", false], [32251, 0.010006, " time", false], [40186, 0.009245, " which", false], [4712, 0.005257, " on", false]]]}, "raw_delta": -0.026041666666666657, "tuned_delta": 0.02804793074840893}, {"byte_start": 1065, "byte_end": 1069, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 184, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"model_a": "6.87% 6.87% 6.87% 6.87%", "model_b": "16.70% 16.70% 16.70% 16.70%"}, "model_tokens": {"model_a": [[22226, " one", "normal", 0.2196863889694214]], "model_b": [[22226, " one", "normal", 0.024661293253302574]]}, "loss": {"model_a": 6.868299144857125, "model_b": 16.69525022903732}, "topk": {"model_a": [22226, 1, 0.2196863889694214, [[22226, 0.219686, " one", false], [22590, 0.153073, " the", false], [38720, 0.078761, " human", false], [45833, 0.047795, " either", false], [332, 0.044905, " a", false], [30719, 0.03915, " each", false], [57103, 0.029351, " research", false], [30322, 0.026071, " both", false], [62293, 0.020847, " particular", false], [51161, 0.020613, " certain", false]]], "model_b": [22226, 7, 0.024661293253302574, [[38720, 0.137014, " human", false], [22590, 0.125859, " the", false], [332, 0.068044, " a", false], [57103, 0.036614, " research", false], [32251, 0.036376, " time", false], [59943, 0.028372, " knowledge", false], [22226, 0.024661, " one", false], [3609, 0.024192, " AI", false], [51832, 0.017169, " general", false], [62293, 0.016306, " particular", false]]]}, "raw_delta": -0.544921875, "tuned_delta": -0.4908322775849244}, {"byte_start": 1069, "byte_end": 1078, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 185, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "model_b": "7.73% 7.73% 7.73% 7.73% 7.73% 7.73% 7.73% 7.73% 7.73%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.002671432215720415]], "model_b": [[55532, " approach", "normal", 0.020960550755262375]]}, "loss": {"model_a": 11.834607757292277, "model_b": 7.733196074209505}, "topk": {"model_a": [55532, 27, 0.002671432215720415, [[4715, 0.464741, " or", false], [31601, 0.084309, " over", false], [47717, 0.07464, " versus", false], [32227, 0.053685, " that", false], [30173, 0.036155, " area", false], [45775, 0.035111, " domain", false], [47001, 0.033718, " rather", false], [45, 0.020318, ",", false], [4851, 0.017065, " vs", false], [21265, 0.016709, " and", false]]], "model_b": [55532, 13, 0.020960550755262375, [[4715, 0.145102, " or", false], [32227, 0.11461, " that", false], [45775, 0.086431, " domain", false], [31601, 0.070172, " over", false], [45, 0.057532, ",", false], [30173, 0.056003, " area", false], [21265, 0.02828, " and", false], [46561, 0.028149, " method", false], [4706, 0.026639, " of", false], [47717, 0.02533, " versus", false]]]}, "raw_delta": 0.22743055555555555, "tuned_delta": 0.28152015297063115}, {"byte_start": 1078, "byte_end": 1081, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 186, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "5.00% 5.00% 5.00%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.4309472441673279]], "model_b": [[4715, " or", "normal", 0.1124531552195549]]}, "loss": {"model_a": 5.001530659331855, "model_b": 13.243489633160404}, "topk": {"model_a": [4715, 1, 0.4309472441673279, [[4715, 0.430947, " or", false], [31601, 0.249141, " over", false], [47001, 0.05921, " rather", false], [32227, 0.057201, " that", false], [47717, 0.044691, " versus", false], [45, 0.0351, ",", false], [21265, 0.015548, " and", false], [4424, 0.01188, " at", false], [4811, 0.009707, " to", false], [47, 0.009567, ".", false]]], "model_b": [4715, 4, 0.1124531552195549, [[32227, 0.356004, " that", false], [31601, 0.135823, " over", false], [45, 0.13322, ",", false], [4715, 0.112453, " or", false], [21265, 0.038448, " and", false], [4811, 0.029506, " to", false], [275, 0.028057, " (", false], [47717, 0.019898, " versus", false], [4424, 0.013889, " at", false], [47, 0.01353, ".", false]]]}, "raw_delta": -0.45703125, "tuned_delta": -0.4029416525849244}, {"byte_start": 1081, "byte_end": 1085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 187, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.62% 2.62% 2.62% 2.62%", "model_b": "2.31% 2.31% 2.31% 2.31%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.5624184012413025]], "model_b": [[22590, " the", "normal", 0.6028627753257751]]}, "loss": {"model_a": 2.6240424938043887, "model_b": 2.30704407173406}, "topk": {"model_a": [22590, 1, 0.5624184012413025, [[22590, 0.562418, " the", false], [50919, 0.413225, " another", false], [39193, 0.006013, " other", false], [46561, 0.001506, " method", false], [332, 0.001272, " a", false], [4811, 0.00108, " to", false], [4596, 0.001017, " in", false], [57317, 0.00086, " strategy", false], [45775, 0.000419, " domain", false], [60624, 0.000386, " technique", false]]], "model_b": [22590, 1, 0.6028627753257751, [[22590, 0.602863, " the", false], [50919, 0.287989, " another", false], [39193, 0.030781, " other", false], [46561, 0.010589, " method", false], [62634, 0.006113, " technology", false], [60624, 0.003361, " technique", false], [57317, 0.003249, " strategy", false], [332, 0.002165, " a", false], [57103, 0.002022, " research", false], [4596, 0.00155, " in", false]]]}, "raw_delta": 0.017578125, "tuned_delta": 0.07166772241507559}, {"byte_start": 1085, "byte_end": 1091, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 188, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "0.00% 0.00% 0.00% 0.00% 0.00% 0.00%", "model_b": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.9987265467643738]], "model_b": [[39193, " other", "normal", 0.9940897226333618]]}, "loss": {"model_a": 0.003852411379326913, "model_b": 0.017794471609271934}, "topk": {"model_a": [39193, 1, 0.9987265467643738, [[39193, 0.998727, " other", false], [31515, 0.000458, " next", false], [50919, 0.000175, " another", false], [46726, 9.4e-05, " others", false], [11, 2.4e-05, "\n", false], [22590, 2.2e-05, " the", false], [22226, 1.1e-05, " one", false], [63277, 1e-05, " alternative", false], [31601, 8e-06, " over", false], [46561, 8e-06, " method", false]]], "model_b": [39193, 1, 0.9940897226333618, [[39193, 0.99409, " other", false], [31515, 0.002627, " next", false], [46726, 0.000163, " others", false], [22681, 0.000132, " use", false], [63277, 0.000113, " alternative", false], [50919, 8.8e-05, " another", false], [31458, 6.7e-05, " more", false], [47205, 6.4e-05, " second", false], [22590, 5.9e-05, " the", false], [56767, 5.3e-05, " opposite", false]]]}, "raw_delta": -0.0007731119791666668, "tuned_delta": 0.053316485435908924}, {"byte_start": 1091, "byte_end": 1092, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "24.51%", "model_b": "36.07%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.2571321725845337]], "model_b": [[47, ".", "normal", 0.1336890161037445]]}, "loss": {"model_a": 24.51454464010543, "model_b": 36.06737602222408}, "topk": {"model_a": [47, 2, 0.2571321725845337, [[45, 0.430291, ",", false], [47, 0.257132, ".", false], [32227, 0.161271, " that", false], [275, 0.019846, " (", false], [60, 0.017894, ";", false], [21265, 0.017701, " and", false], [59, 0.010773, ":", false], [40186, 0.00887, " which", false], [4423, 0.007191, " as", false], [21400, 0.006463, " but", false]]], "model_b": [47, 3, 0.1336890161037445, [[45, 0.453795, ",", false], [32227, 0.230321, " that", false], [47, 0.133689, ".", false], [275, 0.033575, " (", false], [21265, 0.020763, " and", false], [60, 0.014921, ";", false], [21400, 0.014179, " but", false], [40186, 0.011754, " which", false], [59, 0.006687, ":", false], [4423, 0.005305, " as", false]]]}, "raw_delta": -0.640625, "tuned_delta": -0.5865354025849244}, {"byte_start": 1092, "byte_end": 1096, "display": {"text": " And", "kind": "normal"}, "is_word": true, "word_id": 189, "word_key": " and", "bytes_hex": "20 41 6e 64", "compression": {"model_a": "15.15% 15.15% 15.15% 15.15%", "model_b": "17.75% 17.75% 17.75% 17.75%"}, "model_tokens": {"model_a": [[19417, " And", "normal", 0.034856654703617096]], "model_b": [[19417, " And", "normal", 0.01955912448465824]]}, "loss": {"model_a": 15.145480165582377, "model_b": 17.751911635938416}, "topk": {"model_a": [19417, 6, 0.034856654703617096, [[11, 0.171391, "\n", false], [19555, 0.079497, " But", false], [20996, 0.078147, " The", false], [37451, 0.064133, " There", false], [261, 0.045926, "\n\n", false], [19417, 0.034857, " And", false], [3918, 0.027092, " It", false], [3913, 0.02621, " In", false], [29894, 0.02114, " This", false], [19907, 0.015376, " For", false]]], "model_b": [19417, 11, 0.01955912448465824, [[11, 0.147423, "\n", false], [20996, 0.078616, " The", false], [19555, 0.07064, " But", false], [3913, 0.039537, " In", false], [37451, 0.03309, " There", false], [261, 0.032273, "\n\n", false], [19907, 0.029687, " For", false], [29894, 0.025777, " This", false], [3908, 0.025272, " If", false], [3918, 0.023066, " It", false]]]}, "raw_delta": -0.14453125, "tuned_delta": -0.09044165258492441}, {"byte_start": 1096, "byte_end": 1100, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 190, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55%", "model_b": "11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.07773029059171677]], "model_b": [[22590, " the", "normal", 0.08263010531663895]]}, "loss": {"model_a": 11.55283138211865, "model_b": 11.271055006945026}, "topk": {"model_a": [22590, 3, 0.07773029059171677, [[39934, 0.164008, " there", false], [45, 0.102711, ",", false], [22590, 0.07773, " the", false], [4788, 0.056664, " so", false], [4601, 0.033388, " it", false], [4596, 0.031255, " in", false], [22797, 0.028624, " yet", false], [4706, 0.025536, " of", false], [30788, 0.017429, " even", false], [32230, 0.016482, " then", false]]], "model_b": [22590, 3, 0.08263010531663895, [[45, 0.127735, ",", false], [39934, 0.120414, " there", false], [22590, 0.08263, " the", false], [4423, 0.040806, " as", false], [4596, 0.038446, " in", false], [4588, 0.033255, " if", false], [40187, 0.028097, " while", false], [4788, 0.027251, " so", false], [30788, 0.022515, " even", false], [32465, 0.021056, " when", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 1100, "byte_end": 1106, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 191, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "model_b": "16.16% 16.16% 16.16% 16.16% 16.16% 16.16%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.009649490937590599]], "model_b": [[38720, " human", "normal", 0.004670261405408382]]}, "loss": {"model_a": 13.994893300290073, "model_b": 16.15517884328787}, "topk": {"model_a": [38720, 12, 0.009649490937590599, [[64997, 0.014975, " psychological", false], [22638, 0.013903, " two", false], [46470, 0.013478, " longer", false], [30808, 0.013178, " fact", false], [30510, 0.012707, " cost", false], [52738, 0.011157, " results", false], [32251, 0.010943, " time", false], [62157, 0.010694, " investment", false], [31461, 0.010628, " most", false], [31458, 0.010564, " more", false]]], "model_b": [38720, 33, 0.004670261405408382, [[31458, 0.042374, " more", false], [46470, 0.042034, " longer", false], [30510, 0.022442, " cost", false], [30808, 0.022108, " fact", false], [31581, 0.018765, " only", false], [38124, 0.015388, " costs", false], [62157, 0.01331, " investment", false], [47092, 0.013289, " result", false], [31461, 0.012936, " most", false], [22638, 0.011514, " two", false]]]}, "raw_delta": -0.11979166666666674, "tuned_delta": -0.06570206925159115}, {"byte_start": 1106, "byte_end": 1107, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "68.19%", "model_b": "67.34%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.022694796323776245]], "model_b": [[46, "-", "normal", 0.02362072467803955]]}, "loss": {"model_a": 68.1898827920174, "model_b": 67.34455366649652}, "topk": {"model_a": [46, 5, 0.022694796323776245, [[59943, 0.190607, " knowledge", false], [31427, 0.065097, " mind", false], [37898, 0.055387, " brain", false], [45775, 0.029708, " domain", false], [46, 0.022695, "-", false], [57404, 0.021891, " tendency", false], [34889, 0.018041, "ities", false], [32011, 0.017197, " side", false], [31506, 0.015147, " need", false], [59324, 0.01321, " community", false]]], "model_b": [46, 4, 0.02362072467803955, [[59943, 0.152599, " knowledge", false], [31427, 0.03866, " mind", false], [45950, 0.027186, " factor", false], [46, 0.023621, "-", false], [61701, 0.021899, " commitment", false], [37636, 0.017871, " agent", false], [30510, 0.015133, " cost", false], [59305, 0.014804, " cognitive", false], [37898, 0.014428, " brain", false], [62157, 0.014077, " investment", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.10096459741507559}, {"byte_start": 1107, "byte_end": 1116, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 192, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76%", "model_b": "9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.2548525035381317]], "model_b": [[58313, "knowledge", "normal", 0.008780820295214653]]}, "loss": {"model_a": 2.7551467794754507, "model_b": 9.455162811381658}, "topk": {"model_a": [58313, 1, 0.2548525035381317, [[58313, 0.254853, "knowledge", false], [48948, 0.073047, "centric", false], [53865, 0.070934, "computer", false], [53835, 0.051882, "centered", false], [1950, 0.051786, "in", false], [34991, 0.027511, "level", false], [63039, 0.024904, "computation", false], [49389, 0.020212, "machine", false], [34011, 0.020134, "based", false], [26148, 0.017697, "like", false]]], "model_b": [58313, 20, 0.008780820295214653, [[48948, 0.192143, "centric", false], [33665, 0.072227, "agent", false], [49389, 0.056216, "machine", false], [1950, 0.045567, "in", false], [53865, 0.042396, "computer", false], [820, 0.030673, "AI", false], [63039, 0.029267, "computation", false], [53835, 0.027876, "centered", false], [41273, 0.024625, "driven", false], [34011, 0.023993, "based", false]]]}, "raw_delta": -0.37152777777777773, "tuned_delta": -0.31743818036270216}, {"byte_start": 1116, "byte_end": 1125, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 193, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04%", "model_b": "4.63% 4.63% 4.63% 4.63% 4.63% 4.63% 4.63% 4.63% 4.63%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.3655596077442169]], "model_b": [[55532, " approach", "normal", 0.10029881447553635]]}, "loss": {"model_a": 2.035051598476185, "model_b": 4.633655947299621}, "topk": {"model_a": [55532, 1, 0.3655596077442169, [[55532, 0.36556, " approach", false], [46, 0.203702, "-", false], [61590, 0.039443, " approaches", false], [38888, 0.037742, " lever", false], [52224, 0.019657, " methods", false], [56540, 0.018951, " leverage", false], [37810, 0.018358, " based", false], [62157, 0.013646, " investment", false], [46561, 0.013374, " method", false], [39552, 0.012595, " route", false]]], "model_b": [55532, 2, 0.10029881447553635, [[46, 0.166462, "-", false], [55532, 0.100299, " approach", false], [62157, 0.059549, " investment", false], [61701, 0.031349, " commitment", false], [59339, 0.020269, " component", false], [63678, 0.016692, " investments", false], [30276, 0.015899, " bias", false], [31633, 0.014491, " part", false], [63351, 0.013684, " commitments", false], [45214, 0.011995, " aspect", false]]]}, "raw_delta": -0.1440972222222222, "tuned_delta": -0.09000762480714662}, {"byte_start": 1125, "byte_end": 1131, "display": {"text": " tends", "kind": "normal"}, "is_word": true, "word_id": 194, "word_key": " tends", "bytes_hex": "20 74 65 6e 64 73", "compression": {"model_a": "9.53% 9.53% 9.53% 9.53% 9.53% 9.53%", "model_b": "8.88% 8.88% 8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[39914, " tends", "normal", 0.042093440890312195]], "model_b": [[39914, " tends", "normal", 0.05175458639860153]]}, "loss": {"model_a": 9.533434026707669, "model_b": 8.875955817969208}, "topk": {"model_a": [39914, 4, 0.042093440890312195, [[4600, 0.343703, " is", false], [21800, 0.115277, " has", false], [21413, 0.069634, " can", false], [39914, 0.042093, " tends", false], [45, 0.039557, ",", false], [4811, 0.023464, " to", false], [39620, 0.022001, " seems", false], [32475, 0.020162, " will", false], [30659, 0.019683, " does", false], [57102, 0.018662, " requires", false]]], "model_b": [39914, 3, 0.05175458639860153, [[4600, 0.320251, " is", false], [21800, 0.073541, " has", false], [39914, 0.051755, " tends", false], [21413, 0.047079, " can", false], [45, 0.045483, ",", false], [32475, 0.026921, " will", false], [22074, 0.024343, " may", false], [57102, 0.019651, " requires", false], [39171, 0.017537, " often", false], [45150, 0.013285, " always", false]]]}, "raw_delta": 0.03645833333333337, "tuned_delta": 0.09054793074840896}, {"byte_start": 1131, "byte_end": 1134, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 195, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.16% 0.16% 0.16%", "model_b": "0.15% 0.15% 0.15%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9735610485076904]], "model_b": [[4811, " to", "normal", 0.9758894443511963]]}, "loss": {"model_a": 0.15996679632252706, "model_b": 0.14675852873626336}, "topk": {"model_a": [4811, 1, 0.9735610485076904, [[4811, 0.973561, " to", false], [22187, 0.006555, " not", false], [47585, 0.004646, " toward", false], [53169, 0.002838, " towards", false], [45, 0.002173, ",", false], [31458, 0.001475, " more", false], [4435, 0.000919, " be", false], [4596, 0.000662, " in", false], [30135, 0.000516, " also", false], [60048, 0.00042, " naturally", false]]], "model_b": [4811, 1, 0.9758894443511963, [[4811, 0.975889, " to", false], [22187, 0.005909, " not", false], [47585, 0.004297, " toward", false], [53169, 0.003056, " towards", false], [45, 0.001948, ",", false], [4435, 0.000787, " be", false], [4596, 0.000559, " in", false], [275, 0.000463, " (", false], [4424, 0.000348, " at", false], [31458, 0.000335, " more", false]]]}, "raw_delta": 0.000732421875, "tuned_delta": 0.05482201929007559}, {"byte_start": 1134, "byte_end": 1142, "display": {"text": " complic", "kind": "normal"}, "is_word": true, "word_id": 196, "word_key": " complic", "bytes_hex": "20 63 6f 6d 70 6c 69 63", "compression": {"model_a": "22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 22.54%", "model_b": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82%"}, "model_tokens": {"model_a": [[51259, " complic", "normal", 4.4977648940403014e-05]], "model_b": [[51259, " complic", "normal", 4.071759758517146e-05]]}, "loss": {"model_a": 22.542110013890053, "model_b": 22.823886389063677}, "topk": {"model_a": [51259, 732, 4.4977648940403014e-05, [[4435, 0.382936, " be", false], [31059, 0.050838, " have", false], [32499, 0.037088, " work", false], [56041, 0.026311, " dominate", false], [52724, 0.025118, " require", false], [32187, 0.022907, " take", false], [21751, 0.019408, " get", false], [31358, 0.018071, " make", false], [52573, 0.01676, " produce", false], [40239, 0.015551, " yield", false]]], "model_b": [51259, 859, 4.071759758517146e-05, [[4435, 0.363719, " be", false], [31059, 0.057772, " have", false], [21751, 0.030766, " get", false], [47457, 0.024155, " suffer", false], [32499, 0.024111, " work", false], [32187, 0.016228, " take", false], [45284, 0.015914, " become", false], [22770, 0.013238, " win", false], [52724, 0.01323, " require", false], [40239, 0.012776, " yield", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 1142, "byte_end": 1145, "display": {"text": "ate", "kind": "normal"}, "is_word": true, "word_id": 197, "word_key": "ate", "bytes_hex": "61 74 65", "compression": {"model_a": "0.00% 0.00% 0.00%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[7066, "ate", "normal", 0.9994739890098572]], "model_b": [[7066, "ate", "normal", 0.9969940185546875]]}, "loss": {"model_a": 0.0031415497557606372, "model_b": 0.01816136793111259}, "topk": {"model_a": [7066, 1, 0.9994739890098572, [[7066, 0.999474, "ate", false], [24744, 0.00016, "ates", false], [7933, 0.000111, "ity", false], [33943, 7.4e-05, "ating", false], [1956, 7e-05, "it", false], [7036, 2.8e-05, "are", false], [6910, 2e-05, "acy", false], [1752, 1.9e-05, "at", false], [34881, 7e-06, "itate", false], [24566, 4e-06, "ance", false]]], "model_b": [7066, 1, 0.9969940185546875, [[7066, 0.996994, "ate", false], [24744, 0.00168, "ates", false], [33943, 0.000743, "ating", false], [7933, 0.00013, "ity", false], [1752, 0.000117, "at", false], [1956, 6.6e-05, "it", false], [7801, 6.6e-05, "ify", false], [25647, 1.8e-05, "iate", false], [7911, 1.5e-05, "ish", false], [48895, 1.2e-05, "atively", false]]]}, "raw_delta": -0.0008328755696614584, "tuned_delta": 0.05325672184541413}, {"byte_start": 1145, "byte_end": 1153, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 198, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "13.24% 13.24% 13.24% 13.24% 13.24% 13.24% 13.24% 13.24%", "model_b": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.00280464137904346]], "model_b": [[52224, " methods", "normal", 0.0006911751697771251]]}, "loss": {"model_a": 13.243489633160404, "model_b": 16.413473853863692}, "topk": {"model_a": [52224, 21, 0.00280464137904346, [[22590, 0.358809, " the", false], [47539, 0.191182, " things", false], [52201, 0.127774, " matters", false], [21265, 0.043588, " and", false], [332, 0.018348, " a", false], [3609, 0.013723, " AI", false], [57103, 0.013021, " research", false], [47001, 0.012551, " rather", false], [45, 0.008806, ",", false], [65137, 0.008605, " implementation", false]]], "model_b": [52224, 86, 0.0006911751697771251, [[22590, 0.334815, " the", false], [47539, 0.253048, " things", false], [21265, 0.052121, " and", false], [52201, 0.04381, " matters", false], [3609, 0.027861, " AI", false], [332, 0.022062, " a", false], [45, 0.020448, ",", false], [4715, 0.013265, " or", false], [32464, 0.008643, " what", false], [56939, 0.007457, " problems", false]]]}, "raw_delta": -0.17578125, "tuned_delta": -0.12169165258492441}, {"byte_start": 1153, "byte_end": 1156, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 199, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "18.41% 18.41% 18.41%", "model_b": "18.41% 18.41% 18.41%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.046689558774232864]], "model_b": [[4596, " in", "normal", 0.04660392552614212]]}, "loss": {"model_a": 18.409389844676873, "model_b": 18.409389844676873}, "topk": {"model_a": [4596, 5, 0.046689558774232864, [[45, 0.203399, ",", false], [32227, 0.192105, " that", false], [21265, 0.114402, " and", false], [47, 0.057281, ".", false], [4596, 0.04669, " in", false], [4811, 0.029125, " to", false], [21700, 0.025323, " for", false], [4788, 0.019003, " so", false], [31458, 0.018146, " more", false], [4450, 0.016926, " by", false]]], "model_b": [4596, 5, 0.04660392552614212, [[32227, 0.221495, " that", false], [45, 0.092146, ",", false], [21265, 0.07709, " and", false], [4450, 0.059162, " by", false], [4596, 0.046604, " in", false], [47, 0.042386, ".", false], [31458, 0.038037, " more", false], [21700, 0.036254, " for", false], [32487, 0.027479, " with", false], [4706, 0.021451, " of", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 1156, "byte_end": 1161, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 200, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "2.16% 2.16% 2.16% 2.16% 2.16%", "model_b": "5.89% 5.89% 5.89% 5.89% 5.89%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.55156010389328]], "model_b": [[32448, " ways", "normal", 0.19676271080970764]]}, "loss": {"model_a": 2.155589270078236, "model_b": 5.889126241128776}, "topk": {"model_a": [32448, 1, 0.55156010389328, [[32448, 0.55156, " ways", false], [332, 0.177929, " a", false], [22590, 0.036819, " the", false], [32139, 0.034377, " such", false], [4419, 0.010719, " an", false], [63667, 0.008524, " interesting", false], [22184, 0.00629, " non", false], [39189, 0.006261, " order", false], [47451, 0.005871, " subtle", false], [22659, 0.004923, " unf", false]]], "model_b": [32448, 1, 0.19676271080970764, [[32448, 0.196763, " ways", false], [332, 0.169199, " a", false], [22590, 0.139006, " the", false], [39193, 0.034462, " other", false], [38458, 0.029306, " favor", false], [4419, 0.028862, " an", false], [51832, 0.022066, " general", false], [32139, 0.021996, " such", false], [32074, 0.020077, " some", false], [62688, 0.017884, " unexpected", false]]]}, "raw_delta": -0.20703124999999994, "tuned_delta": -0.15294165258492437}, {"byte_start": 1161, "byte_end": 1166, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 201, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "0.17% 0.17% 0.17% 0.17% 0.17%", "model_b": "0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.9540926814079285]], "model_b": [[32227, " that", "normal", 0.9009321331977844]]}, "loss": {"model_a": 0.16906582510417537, "model_b": 0.38039810648439465}, "topk": {"model_a": [32227, 1, 0.9540926814079285, [[32227, 0.954093, " that", false], [40186, 0.007496, " which", false], [22590, 0.006251, " the", false], [22187, 0.003973, " not", false], [40185, 0.00326, " where", false], [4811, 0.001461, " to", false], [32232, 0.001204, " they", false], [275, 0.001064, " (", false], [4596, 0.000686, " in", false], [4858, 0.00066, " we", false]]], "model_b": [32227, 1, 0.9009321331977844, [[32227, 0.900932, " that", false], [22590, 0.011024, " the", false], [22187, 0.009708, " not", false], [40186, 0.006872, " which", false], [32232, 0.006842, " they", false], [4601, 0.00654, " it", false], [4858, 0.003936, " we", false], [40185, 0.003704, " where", false], [4811, 0.001717, " to", false], [39193, 0.001711, " other", false]]]}, "raw_delta": -0.011718750000000002, "tuned_delta": 0.04237084741507559}, {"byte_start": 1166, "byte_end": 1171, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 202, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"model_a": "4.25% 4.25% 4.25% 4.25% 4.25%", "model_b": "8.40% 8.40% 8.40% 8.40% 8.40%"}, "model_tokens": {"model_a": [[31358, " make", "normal", 0.30952146649360657]], "model_b": [[31358, " make", "normal", 0.09795092791318893]]}, "loss": {"model_a": 4.254823265121747, "model_b": 8.396935980174044}, "topk": {"model_a": [31358, 1, 0.30952146649360657, [[31358, 0.309521, " make", false], [21286, 0.094172, " are", false], [22590, 0.037461, " the", false], [47030, 0.034891, " reduce", false], [21413, 0.024152, " can", false], [56433, 0.023898, " increase", false], [32053, 0.01603, " slow", false], [32216, 0.014736, " tend", false], [38900, 0.014169, " limit", false], [31123, 0.013632, " hurt", false]]], "model_b": [31358, 3, 0.09795092791318893, [[22590, 0.132565, " the", false], [21286, 0.119562, " are", false], [31358, 0.097951, " make", false], [21413, 0.037498, " can", false], [4491, 0.032475, " do", false], [47030, 0.016852, " reduce", false], [22074, 0.016064, " may", false], [32216, 0.015622, " tend", false], [21556, 0.014558, " don", false], [4601, 0.014059, " it", false]]]}, "raw_delta": -0.2296875, "tuned_delta": -0.17559790258492441}, {"byte_start": 1171, "byte_end": 1176, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 203, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"model_a": "2.99% 2.99% 2.99% 2.99% 2.99%", "model_b": "2.72% 2.72% 2.72% 2.72% 2.72%"}, "model_tokens": {"model_a": [[32229, " them", "normal", 0.43699005246162415]], "model_b": [[32229, " them", "normal", 0.47060438990592957]]}, "loss": {"model_a": 2.9868295768404316, "model_b": 2.7191420204254877}, "topk": {"model_a": [32229, 1, 0.43699005246162415, [[32229, 0.43699, " them", false], [4601, 0.213979, " it", false], [22590, 0.053347, " the", false], [63370, 0.050107, " computation", false], [39931, 0.032802, " their", false], [38888, 0.01781, " lever", false], [332, 0.007162, " a", false], [51832, 0.005641, " general", false], [52805, 0.005592, " scaling", false], [65135, 0.00494, " generalization", false]]], "model_b": [32229, 1, 0.47060438990592957, [[32229, 0.470604, " them", false], [4601, 0.110801, " it", false], [22590, 0.102436, " the", false], [38888, 0.053952, " lever", false], [63370, 0.026163, " computation", false], [31458, 0.009561, " more", false], [39931, 0.009351, " their", false], [332, 0.009083, " a", false], [59346, 0.006652, " computing", false], [51832, 0.006036, " general", false]]]}, "raw_delta": 0.014843749999999989, "tuned_delta": 0.06893334741507558}, {"byte_start": 1176, "byte_end": 1181, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 204, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"model_a": "3.97% 3.97% 3.97% 3.97% 3.97%", "model_b": "3.86% 3.86% 3.86% 3.86% 3.86%"}, "model_tokens": {"model_a": [[31277, " less", "normal", 0.33282899856567383]], "model_b": [[31277, " less", "normal", 0.3425598442554474]]}, "loss": {"model_a": 3.9730468899481215, "model_b": 3.860336339878671}, "topk": {"model_a": [31277, 1, 0.33282899856567383, [[31277, 0.332829, " less", false], [46162, 0.252715, " harder", false], [31458, 0.083044, " more", false], [31048, 0.046206, " hard", false], [59516, 0.031681, " difficult", false], [31466, 0.01761, " much", false], [40216, 0.012972, " worse", false], [47313, 0.009219, " slower", false], [62699, 0.00891, " unsuitable", false], [64425, 0.007354, " incompatible", false]]], "model_b": [31277, 1, 0.3425598442554474, [[31277, 0.34256, " less", false], [31458, 0.182984, " more", false], [46162, 0.171653, " harder", false], [31048, 0.018654, " hard", false], [45819, 0.014035, " easier", false], [59516, 0.013857, " difficult", false], [31466, 0.01358, " much", false], [47313, 0.011471, " slower", false], [30788, 0.008952, " even", false], [40216, 0.008743, " worse", false]]]}, "raw_delta": 0.0062500000000000056, "tuned_delta": 0.060339597415075594}, {"byte_start": 1181, "byte_end": 1188, "display": {"text": " suited", "kind": "normal"}, "is_word": true, "word_id": 205, "word_key": " suited", "bytes_hex": "20 73 75 69 74 65 64", "compression": {"model_a": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%", "model_b": "16.83% 16.83% 16.83% 16.83% 16.83% 16.83% 16.83%"}, "model_tokens": {"model_a": [[47460, " suited", "normal", 0.005090330261737108]], "model_b": [[47460, " suited", "normal", 0.0014614103129133582]]}, "loss": {"model_a": 13.605773544097923, "model_b": 16.826074974653647}, "topk": {"model_a": [47460, 22, 0.005090330261737108, [[30140, 0.220185, " amen", false], [59593, 0.218613, " effective", false], [51832, 0.092297, " general", false], [59594, 0.043193, " efficient", false], [46439, 0.038388, " likely", false], [47687, 0.031806, " useful", false], [57160, 0.017752, " scalable", false], [47129, 0.01705, " robust", false], [56248, 0.015402, " flexible", false], [45820, 0.011947, " easily", false]]], "model_b": [47460, 47, 0.0014614103129133582, [[59593, 0.336037, " effective", false], [59594, 0.099007, " efficient", false], [51832, 0.09054, " general", false], [56900, 0.035607, " powerful", false], [47687, 0.031282, " useful", false], [64862, 0.02882, " computational", false], [30140, 0.024905, " amen", false], [47129, 0.023587, " robust", false], [57160, 0.023386, " scalable", false], [61586, 0.021596, " applicable", false]]]}, "raw_delta": -0.1785714285714286, "tuned_delta": -0.12448183115635301}, {"byte_start": 1188, "byte_end": 1191, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 206, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.49% 1.49% 1.49%", "model_b": "2.57% 2.57% 2.57%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.77960205078125]], "model_b": [[4811, " to", "normal", 0.6521528363227844]]}, "loss": {"model_a": 1.4910666519604356, "model_b": 2.571209423459334}, "topk": {"model_a": [4811, 1, 0.77960205078125, [[4811, 0.779602, " to", false], [21700, 0.199966, " for", false], [32226, 0.0045, " than", false], [4423, 0.003286, " as", false], [53169, 0.001679, " towards", false], [4596, 0.001553, " in", false], [45, 0.001517, ",", false], [4715, 0.00093, " or", false], [21265, 0.000782, " and", false], [275, 0.000782, " (", false]]], "model_b": [4811, 1, 0.6521528363227844, [[4811, 0.652153, " to", false], [21700, 0.29872, " for", false], [32226, 0.010534, " than", false], [47, 0.009791, ".", false], [4596, 0.005642, " in", false], [4423, 0.00477, " as", false], [45, 0.004171, ",", false], [4715, 0.002669, " or", false], [21265, 0.001201, " and", false], [275, 0.001034, " (", false]]]}, "raw_delta": -0.059895833333333336, "tuned_delta": -0.0058062359182577475}, {"byte_start": 1191, "byte_end": 1198, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 207, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"model_a": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "model_b": "21.09% 21.09% 21.09% 21.09% 21.09% 21.09% 21.09%"}, "model_tokens": {"model_a": [[47497, " taking", "normal", 0.016814475879073143]], "model_b": [[47497, " taking", "normal", 0.00027510279323905706]]}, "loss": {"model_a": 10.465979649306096, "model_b": 21.09297437013998}, "topk": {"model_a": [47497, 9, 0.016814475879073143, [[22590, 0.232486, " the", false], [38888, 0.078267, " lever", false], [52805, 0.049971, " scaling", false], [63370, 0.034423, " computation", false], [51832, 0.032748, " general", false], [37832, 0.029173, " being", false], [56540, 0.023992, " leverage", false], [31323, 0.023183, " long", false], [47497, 0.016814, " taking", false], [38864, 0.014913, " large", false]]], "model_b": [47497, 241, 0.00027510279323905706, [[22590, 0.384303, " the", false], [56540, 0.032083, " leverage", false], [38888, 0.02823, " lever", false], [51832, 0.026782, " general", false], [332, 0.022026, " a", false], [39931, 0.020339, " their", false], [63370, 0.018212, " computation", false], [3609, 0.01601, " AI", false], [52949, 0.01108, " solving", false], [51372, 0.010892, " current", false]]]}, "raw_delta": -0.5892857142857143, "tuned_delta": -0.5351961168706387}, {"byte_start": 1198, "byte_end": 1208, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 208, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"model_a": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "model_b": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"model_a": [[59093, " advantage", "normal", 0.788828432559967]], "model_b": [[59093, " advantage", "normal", 0.8801361918449402]]}, "loss": {"model_a": 0.42794786979494404, "model_b": 0.23246550951824113}, "topk": {"model_a": [59093, 1, 0.788828432559967, [[59093, 0.788828, " advantage", false], [30923, 0.179803, " full", false], [52204, 0.005016, " maximum", false], [22590, 0.003543, " the", false], [52203, 0.002685, " maximal", false], [56540, 0.002071, " leverage", false], [61544, 0.002046, " advantages", false], [30273, 0.00117, " best", false], [4712, 0.00068, " on", false], [51030, 0.000639, " benefit", false]]], "model_b": [59093, 1, 0.8801361918449402, [[59093, 0.880136, " advantage", false], [30923, 0.034038, " full", false], [22590, 0.01863, " the", false], [332, 0.005103, " a", false], [4712, 0.004507, " on", false], [38864, 0.002684, " large", false], [32229, 0.002219, " them", false], [31601, 0.002187, " over", false], [45095, 0.001921, " action", false], [64862, 0.001657, " computational", false]]]}, "raw_delta": 0.01083984375, "tuned_delta": 0.06492944116507558}, {"byte_start": 1208, "byte_end": 1211, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 209, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9979496598243713]], "model_b": [[4706, " of", "normal", 0.9959623217582703]]}, "loss": {"model_a": 0.012291026781662055, "model_b": 0.024215157241483452}, "topk": {"model_a": [4706, 1, 0.9979496598243713, [[4706, 0.99795, " of", false], [22590, 0.000468, " the", false], [45, 0.000106, ",", false], [4715, 9.5e-05, " or", false], [4596, 8.7e-05, " in", false], [275, 8.2e-05, " (", false], [4811, 8.1e-05, " to", false], [21265, 6.9e-05, " and", false], [47, 5.4e-05, ".", false], [4423, 5.1e-05, " as", false]]], "model_b": [4706, 1, 0.9959623217582703, [[4706, 0.995962, " of", false], [22590, 0.000717, " the", false], [47, 0.000361, ".", false], [4596, 0.000298, " in", false], [30917, 0.000192, " from", false], [45, 0.000183, ",", false], [64862, 0.000146, " computational", false], [4715, 9.1e-05, " or", false], [275, 8e-05, " (", false], [21265, 7.9e-05, " and", false]]]}, "raw_delta": -0.0006612141927083334, "tuned_delta": 0.05342838322236725}, {"byte_start": 1211, "byte_end": 1219, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 210, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93%", "model_b": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.01215451955795288]], "model_b": [[51832, " general", "normal", 0.01084891613572836]]}, "loss": {"model_a": 9.932617224870304, "model_b": 10.214393600043929}, "topk": {"model_a": [51832, 14, 0.01215451955795288, [[22590, 0.310744, " the", false], [63370, 0.139045, " computation", false], [30789, 0.030225, " ever", false], [37045, 0.026895, " Moore", false], [59846, 0.024509, " increased", false], [46064, 0.024085, " future", false], [22168, 0.019915, " new", false], [64862, 0.018301, " computational", false], [52195, 0.018082, " massive", false], [31458, 0.017865, " more", false]]], "model_b": [51832, 11, 0.01084891613572836, [[22590, 0.411892, " the", false], [63370, 0.088304, " computation", false], [64862, 0.037105, " computational", false], [59346, 0.033179, " computing", false], [38864, 0.017531, " large", false], [332, 0.017115, " a", false], [59206, 0.016722, " available", false], [31458, 0.014983, " more", false], [22168, 0.013022, " new", false], [52167, 0.01131, " machine", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 1219, "byte_end": 1227, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 211, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%", "model_b": "3.63% 3.63% 3.63% 3.63% 3.63% 3.63% 3.63% 3.63%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.20908476412296295]], "model_b": [[52224, " methods", "normal", 0.20070134103298187]]}, "loss": {"model_a": 3.504593666221969, "model_b": 3.62787083036043}, "topk": {"model_a": [52224, 2, 0.20908476412296295, [[63370, 0.477301, " computation", false], [52224, 0.209085, " methods", false], [46, 0.047819, "-", false], [64862, 0.031764, " computational", false], [61590, 0.021465, " approaches", false], [7933, 0.017499, "ity", false], [45, 0.013975, ",", false], [59346, 0.013237, " computing", false], [62633, 0.009677, " techniques", false], [41729, 0.009659, "izable", false]]], "model_b": [52224, 1, 0.20070134103298187, [[52224, 0.200701, " methods", false], [63370, 0.180506, " computation", false], [46, 0.120878, "-", false], [59346, 0.064932, " computing", false], [64862, 0.043198, " computational", false], [3609, 0.031633, " AI", false], [7933, 0.023324, "ity", false], [45, 0.020074, ",", false], [41729, 0.013917, "izable", false], [59943, 0.010161, " knowledge", false]]]}, "raw_delta": -0.0068359375, "tuned_delta": 0.04725365991507559}, {"byte_start": 1227, "byte_end": 1233, "display": {"text": " lever", "kind": "normal"}, "is_word": true, "word_id": 212, "word_key": " lever", "bytes_hex": "20 6c 65 76 65 72", "compression": {"model_a": "14.84% 14.84% 14.84% 14.84% 14.84% 14.84%", "model_b": "24.80% 24.80% 24.80% 24.80% 24.80% 24.80%"}, "model_tokens": {"model_a": [[38888, " lever", "normal", 0.007249490357935429]], "model_b": [[38888, " lever", "normal", 0.0002626448404043913]]}, "loss": {"model_a": 14.84022242581095, "model_b": 24.796321015279055}, "topk": {"model_a": [38888, 12, 0.007249490357935429, [[47, 0.530161, ".", false], [32227, 0.134713, " that", false], [45, 0.079152, ",", false], [4706, 0.036582, " of", false], [21265, 0.02621, " and", false], [21700, 0.026183, " for", false], [275, 0.017644, " (", false], [31296, 0.014269, " like", false], [37810, 0.011557, " based", false], [4596, 0.01063, " in", false]]], "model_b": [38888, 50, 0.0002626448404043913, [[47, 0.753823, ".", false], [45, 0.058042, ",", false], [21265, 0.033578, " and", false], [32227, 0.030786, " that", false], [4596, 0.019089, " in", false], [275, 0.011379, " (", false], [32226, 0.009054, " than", false], [21700, 0.006107, " for", false], [4423, 0.005164, " as", false], [4811, 0.004402, " to", false]]]}, "raw_delta": -0.5520833333333334, "tuned_delta": -0.4979937359182578}, {"byte_start": 1233, "byte_end": 1238, "display": {"text": "aging", "kind": "normal"}, "is_word": true, "word_id": 213, "word_key": "aging", "bytes_hex": "61 67 69 6e 67", "compression": {"model_a": "0.01% 0.01% 0.01% 0.01% 0.01%", "model_b": "0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"model_a": [[33672, "aging", "normal", 0.9961600303649902]], "model_b": [[33672, "aging", "normal", 0.9986432194709778]]}, "loss": {"model_a": 0.013868680965576887, "model_b": 0.004925583120710839}, "topk": {"model_a": [33672, 1, 0.9961600303649902, [[33672, 0.99616, "aging", false], [7856, 0.002077, "ing", false], [116, 0.000793, "s", false], [1843, 0.00035, "ed", false], [6934, 0.000128, "aga", false], [46, 8e-05, "-", false], [33943, 5.7e-05, "ating", false], [1739, 4.4e-05, "ag", false], [25504, 4.2e-05, "ging", false], [24381, 3.6e-05, "able", false]]], "model_b": [33672, 1, 0.9986432194709778, [[33672, 0.998643, "aging", false], [1843, 0.000564, "ed", false], [7856, 0.000454, "ing", false], [24451, 9.9e-05, "aged", false], [116, 1.9e-05, "s", false], [25504, 1.7e-05, "ging", false], [24738, 1.3e-05, "ated", false], [6935, 1.2e-05, "age", false], [33944, 1.1e-05, "ation", false], [33943, 1e-05, "ating", false]]]}, "raw_delta": 0.00049591064453125, "tuned_delta": 0.05458550805960684}, {"byte_start": 1238, "byte_end": 1250, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 214, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19%", "model_b": "0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.880954384803772]], "model_b": [[63370, " computation", "normal", 0.794298529624939]]}, "loss": {"model_a": 0.1907860873571423, "model_b": 0.34781771310494414}, "topk": {"model_a": [63370, 1, 0.880954384803772, [[63370, 0.880954, " computation", false], [22590, 0.013913, " the", false], [52195, 0.007068, " massive", false], [64862, 0.005728, " computational", false], [31458, 0.003763, " more", false], [30789, 0.003295, " ever", false], [51832, 0.003042, " general", false], [59846, 0.00304, " increased", false], [64298, 0.002804, " computations", false], [59988, 0.002763, " massively", false]]], "model_b": [63370, 1, 0.794298529624939, [[63370, 0.794299, " computation", false], [22590, 0.036139, " the", false], [59346, 0.025173, " computing", false], [64862, 0.017863, " computational", false], [51266, 0.010191, " compute", false], [38720, 0.008984, " human", false], [332, 0.004789, " a", false], [51832, 0.004599, " general", false], [64298, 0.004095, " computations", false], [38864, 0.003231, " large", false]]]}, "raw_delta": -0.008707682291666668, "tuned_delta": 0.04538191512340892}, {"byte_start": 1250, "byte_end": 1251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "2.61%", "model_b": "2.11%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8655523657798767]], "model_b": [[47, ".", "normal", 0.889737606048584]]}, "loss": {"model_a": 2.606431470356037, "model_b": 2.1133228138021924}, "topk": {"model_a": [47, 1, 0.8655523657798767, [[47, 0.865552, ".", false], [45, 0.063992, ",", false], [275, 0.018223, " (", false], [32227, 0.004995, " that", false], [4596, 0.004488, " in", false], [4811, 0.003288, " to", false], [21265, 0.003213, " and", false], [60, 0.002744, ";", false], [4423, 0.002031, " as", false], [59, 0.001612, ":", false]]], "model_b": [47, 1, 0.889737606048584, [[47, 0.889738, ".", false], [45, 0.035295, ",", false], [21265, 0.009378, " and", false], [275, 0.007412, " (", false], [4596, 0.006736, " in", false], [4811, 0.004848, " to", false], [4423, 0.00363, " as", false], [21700, 0.003303, " for", false], [31458, 0.002849, " more", false], [59, 0.002235, ":", false]]]}, "raw_delta": 0.02734375, "tuned_delta": 0.08143334741507559}, {"byte_start": 1251, "byte_end": 1253, "display": {"text": "  ", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 20", "compression": {"model_a": "83.41% 83.41%", "model_b": "76.08% 76.08%"}, "model_tokens": {"model_a": [[267, "  ", "normal", 9.398390830028802e-05]], "model_b": [[267, "  ", "normal", 0.00021564574853982776]]}, "loss": {"model_a": 83.40580705139318, "model_b": 76.07962129687893}, "topk": {"model_a": [267, 311, 9.398390830028802e-05, [[11, 0.409219, "\n", false], [261, 0.095854, "\n\n", false], [20996, 0.0661, " The", false], [29894, 0.03316, " This", false], [19555, 0.028544, " But", false], [3913, 0.025988, " In", false], [3918, 0.020972, " It", false], [4217, 0.016173, " So", false], [37451, 0.012744, " There", false], [19907, 0.012099, " For", false]]], "model_b": [267, 189, 0.00021564574853982776, [[11, 0.384658, "\n", false], [261, 0.073524, "\n\n", false], [20996, 0.066031, " The", false], [29894, 0.044924, " This", false], [3913, 0.029411, " In", false], [0, 0.02102, "[0]", false], [19907, 0.018948, " For", false], [19555, 0.018587, " But", false], [3918, 0.014992, " It", false], [37451, 0.012185, " There", false]]]}, "raw_delta": 0.40625, "tuned_delta": 0.4603395974150756}, {"byte_start": 1253, "byte_end": 1258, "display": {"text": "There", "kind": "normal"}, "is_word": true, "word_id": 215, "word_key": "there", "bytes_hex": "54 68 65 72 65", "compression": {"model_a": "12.51% 12.51% 12.51% 12.51% 12.51%", "model_b": "13.58% 13.58% 13.58% 13.58% 13.58%"}, "model_tokens": {"model_a": [[33504, "There", "normal", 0.03126389905810356]], "model_b": [[33504, "There", "normal", 0.022980013862252235]]}, "loss": {"model_a": 12.510871057708977, "model_b": 13.581621283368756}, "topk": {"model_a": [33504, 7, 0.03126389905810356, [[6699, 0.135256, "The", false], [1136, 0.059333, "In", false], [24242, 0.050983, "This", false], [5658, 0.036463, "But", false], [74, 0.034727, "I", false], [1141, 0.031378, "It", false], [33504, 0.031264, "There", false], [5936, 0.022767, "For", false], [66, 0.019338, "A", false], [1461, 0.019238, "So", false]]], "model_b": [33504, 5, 0.022980013862252235, [[6699, 0.156064, "The", false], [24242, 0.055964, "This", false], [1136, 0.043419, "In", false], [66, 0.027548, "A", false], [33504, 0.02298, "There", false], [5936, 0.022738, "For", false], [74, 0.015316, "I", false], [853, 0.01502, "As", false], [1141, 0.014948, "It", false], [5658, 0.014504, "But", false]]]}, "raw_delta": -0.05937500000000007, "tuned_delta": -0.0052854025849244785}, {"byte_start": 1258, "byte_end": 1263, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 216, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "18.03% 18.03% 18.03% 18.03% 18.03%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.006788540631532669]], "model_b": [[32462, " were", "normal", 0.006670194678008556]]}, "loss": {"model_a": 18.03368801111204, "model_b": 18.03368801111204}, "topk": {"model_a": [32462, 8, 0.006788540631532669, [[21286, 0.508979, " are", false], [4600, 0.303864, " is", false], [460, 0.07777, "'s", false], [31059, 0.03083, " have", false], [21800, 0.018207, " has", false], [22748, 0.009371, " was", false], [22074, 0.007386, " may", false], [32462, 0.006789, " were", false], [32475, 0.005485, " will", false], [28309, 0.003928, "’s", false]]], "model_b": [32462, 9, 0.006670194678008556, [[21286, 0.495346, " are", false], [4600, 0.346104, " is", false], [460, 0.03151, "'s", false], [31059, 0.030757, " have", false], [21800, 0.020224, " has", false], [22748, 0.009235, " was", false], [22074, 0.009093, " may", false], [32475, 0.008064, " will", false], [32462, 0.00667, " were", false], [21413, 0.00636, " can", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 1263, "byte_end": 1268, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 217, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"model_a": "9.58% 9.58% 9.58% 9.58% 9.58%", "model_b": "7.89% 7.89% 7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[31370, " many", "normal", 0.07024678587913513]], "model_b": [[31370, " many", "normal", 0.11239338666200638]]}, "loss": {"model_a": 9.580396755903271, "model_b": 7.889738504861517}, "topk": {"model_a": [31370, 4, 0.07024678587913513, [[332, 0.115769, " a", false], [22638, 0.097938, " two", false], [32074, 0.086856, " some", false], [31370, 0.070247, " many", false], [52869, 0.047081, " several", false], [39193, 0.040242, " other", false], [39962, 0.03514, " times", false], [61963, 0.025771, " exceptions", false], [45, 0.022101, ",", false], [39946, 0.021296, " three", false]]], "model_b": [31370, 1, 0.11239338666200638, [[31370, 0.112393, " many", false], [332, 0.104141, " a", false], [22638, 0.088127, " two", false], [32074, 0.0705, " some", false], [52869, 0.053998, " several", false], [39946, 0.039192, " three", false], [30135, 0.023183, " also", false], [39193, 0.023123, " other", false], [45, 0.015044, ",", false], [4424, 0.012912, " at", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 1268, "byte_end": 1277, "display": {"text": " examples", "kind": "normal"}, "is_word": true, "word_id": 218, "word_key": " examples", "bytes_hex": "20 65 78 61 6d 70 6c 65 73", "compression": {"model_a": "5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85%", "model_b": "6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73%"}, "model_tokens": {"model_a": [[56162, " examples", "normal", 0.053704049438238144]], "model_b": [[56162, " examples", "normal", 0.03508375957608223]]}, "loss": {"model_a": 5.854686906385332, "model_b": 6.731324518036613}, "topk": {"model_a": [56162, 2, 0.053704049438238144, [[39193, 0.081316, " other", false], [56162, 0.053704, " examples", false], [52654, 0.030805, " reasons", false], [39962, 0.027373, " times", false], [30992, 0.024856, " good", false], [3609, 0.023526, " AI", false], [32448, 0.021246, " ways", false], [46787, 0.020874, " people", false], [38328, 0.020161, " early", false], [32139, 0.01657, " such", false]]], "model_b": [56162, 2, 0.03508375957608223, [[52654, 0.052049, " reasons", false], [56162, 0.035084, " examples", false], [32448, 0.029548, " ways", false], [39962, 0.028588, " times", false], [39193, 0.028536, " other", false], [30992, 0.026247, " good", false], [3609, 0.023048, " AI", false], [52127, 0.022912, " lessons", false], [40237, 0.022043, " years", false], [55572, 0.017795, " attempts", false]]]}, "raw_delta": -0.048611111111111105, "tuned_delta": 0.005478486303964483}, {"byte_start": 1277, "byte_end": 1280, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 219, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "3.19% 3.19% 3.19%", "model_b": "3.57% 3.57% 3.57%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.5908578634262085]], "model_b": [[4706, " of", "normal", 0.5572123527526855]]}, "loss": {"model_a": 3.193465585301091, "model_b": 3.5691674188659244}, "topk": {"model_a": [4706, 1, 0.5908578634262085, [[4706, 0.590858, " of", false], [4596, 0.166289, " in", false], [45805, 0.027147, " during", false], [40185, 0.022259, " where", false], [62650, 0.021529, " throughout", false], [31601, 0.021349, " over", false], [32227, 0.019645, " that", false], [30917, 0.018284, " from", false], [45, 0.014583, ",", false], [37678, 0.013007, " along", false]]], "model_b": [4706, 1, 0.5572123527526855, [[4706, 0.557212, " of", false], [4596, 0.200913, " in", false], [40185, 0.035925, " where", false], [30917, 0.023157, " from", false], [31601, 0.022502, " over", false], [45805, 0.020955, " during", false], [32227, 0.014674, " that", false], [45, 0.012694, ",", false], [62650, 0.011603, " throughout", false], [4811, 0.006159, " to", false]]]}, "raw_delta": -0.020833333333333315, "tuned_delta": 0.03325626408174227}, {"byte_start": 1280, "byte_end": 1283, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 220, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "19.54% 19.54% 19.54%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.038678500801324844]], "model_b": [[3609, " AI", "normal", 0.11160546541213989]]}, "loss": {"model_a": 19.536495345371375, "model_b": 13.243489633160404}, "topk": {"model_a": [3609, 3, 0.038678500801324844, [[32234, 0.464153, " this", false], [22590, 0.072009, " the", false], [3609, 0.038679, " AI", false], [57103, 0.021769, " research", false], [63843, 0.019411, " researchers", false], [39936, 0.018715, " these", false], [52224, 0.017412, " methods", false], [38328, 0.014735, " early", false], [32139, 0.01308, " such", false], [46787, 0.012245, " people", false]]], "model_b": [3609, 2, 0.11160546541213989, [[32234, 0.307972, " this", false], [3609, 0.111605, " AI", false], [22590, 0.052077, " the", false], [57103, 0.027958, " research", false], [39936, 0.026991, " these", false], [63843, 0.020431, " researchers", false], [21835, 0.019957, " how", false], [62603, 0.016559, " successful", false], [38720, 0.011214, " human", false], [51832, 0.009484, " general", false]]]}, "raw_delta": 0.34895833333333326, "tuned_delta": 0.40304793074840883}, {"byte_start": 1283, "byte_end": 1295, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 221, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43%", "model_b": "2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.10274555534124374]], "model_b": [[63843, " researchers", "normal", 0.1758067011833191]]}, "loss": {"model_a": 3.4282792312791117, "model_b": 2.606431470356037}, "topk": {"model_a": [63843, 3, 0.10274555534124374, [[57103, 0.265672, " research", false], [53087, 0.104197, " systems", false], [63843, 0.102746, " researchers", false], [56952, 0.069278, " projects", false], [32227, 0.053649, " that", false], [52224, 0.040734, " methods", false], [61590, 0.028977, " approaches", false], [4596, 0.018487, " in", false], [45124, 0.01775, " agents", false], [60587, 0.01372, " successes", false]]], "model_b": [63843, 2, 0.1758067011833191, [[57103, 0.250349, " research", false], [63843, 0.175807, " researchers", false], [53087, 0.052367, " systems", false], [45124, 0.051031, " agents", false], [32227, 0.049704, " that", false], [52224, 0.036805, " methods", false], [61590, 0.036421, " approaches", false], [56952, 0.01953, " projects", false], [46, 0.010118, "-", false], [4596, 0.008713, " in", false]]]}, "raw_delta": 0.04557291666666665, "tuned_delta": 0.09966251408174223}, {"byte_start": 1295, "byte_end": 1296, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"model_a": "90.73%", "model_b": "96.37%"}, "model_tokens": {"model_a": [[40, "'", "normal", 0.006481685675680637]], "model_b": [[40, "'", "normal", 0.004722745157778263]]}, "loss": {"model_a": 90.73199280590745, "model_b": 96.36752030937997}, "topk": {"model_a": [40, 29, 0.006481685675680637, [[22762, 0.263142, " who", false], [4596, 0.05885, " in", false], [46500, 0.033743, " making", false], [31601, 0.021434, " over", false], [32227, 0.018717, " that", false], [45, 0.01864, ",", false], [47629, 0.018436, " trying", false], [51844, 0.01631, " getting", false], [51709, 0.016165, " falling", false], [47497, 0.013437, " taking", false]]], "model_b": [40, 32, 0.004722745157778263, [[22762, 0.183326, " who", false], [47629, 0.040301, " trying", false], [46500, 0.032175, " making", false], [4596, 0.026912, " in", false], [47497, 0.026261, " taking", false], [32227, 0.025313, " that", false], [52834, 0.020424, " seeking", false], [45, 0.017465, ",", false], [40085, 0.016818, " using", false], [56996, 0.015974, " pursuing", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.2584104025849244}, {"byte_start": 1296, "byte_end": 1300, "display": {"text": " bel", "kind": "normal"}, "is_word": true, "word_id": 222, "word_key": " bel", "bytes_hex": "20 62 65 6c", "compression": {"model_a": "40.86% 40.86% 40.86% 40.86%", "model_b": "40.86% 40.86% 40.86% 40.86%"}, "model_tokens": {"model_a": [[21344, " bel", "normal", 0.00011797981278505176]], "model_b": [[21344, " bel", "normal", 0.00011332187568768859]]}, "loss": {"model_a": 40.857574400175714, "model_b": 40.857574400175714}, "topk": {"model_a": [21344, 795, 0.00011797981278505176, [[51708, 0.053583, " failure", false], [61701, 0.036525, " commitment", false], [62157, 0.032617, " investment", false], [55572, 0.024009, " attempts", false], [59834, 0.019105, " inability", false], [31601, 0.017552, " over", false], [56652, 0.01724, " mistakes", false], [51566, 0.015452, " efforts", false], [38530, 0.01479, " focus", false], [63678, 0.014635, " investments", false]]], "model_b": [21344, 983, 0.00011332187568768859, [[55572, 0.126257, " attempts", false], [51566, 0.032488, " efforts", false], [51708, 0.01254, " failure", false], [47629, 0.011647, " trying", false], [31601, 0.01142, " over", false], [52612, 0.011207, " pursuit", false], [22681, 0.010406, " use", false], [62476, 0.008577, " reluctance", false], [39093, 0.008316, " naive", false], [45718, 0.007259, " desire", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 1300, "byte_end": 1304, "display": {"text": "ated", "kind": "normal"}, "is_word": true, "word_id": 223, "word_key": "ated", "bytes_hex": "61 74 65 64", "compression": {"model_a": "2.29% 2.29% 2.29% 2.29%", "model_b": "0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"model_a": [[24738, "ated", "normal", 0.6016695499420166]], "model_b": [[24738, "ated", "normal", 0.8028844594955444]]}, "loss": {"model_a": 2.289433048285708, "model_b": 0.9906200689697776}, "topk": {"model_a": [24738, 1, 0.6016695499420166, [[24738, 0.60167, "ated", false], [7931, 0.137252, "itt", false], [1840, 0.1047, "ea", false], [27525, 0.031826, "ying", false], [24385, 0.027527, "abor", false], [34907, 0.025719, "ittle", false], [1848, 0.018884, "ei", false], [33943, 0.006157, "ating", false], [1956, 0.004247, "it", false], [34116, 0.003747, "ching", false]]], "model_b": [24738, 1, 0.8028844594955444, [[24738, 0.802884, "ated", false], [7931, 0.076944, "itt", false], [24385, 0.04865, "abor", false], [34907, 0.018444, "ittle", false], [1840, 0.016778, "ea", false], [6896, 0.008241, "abo", false], [27525, 0.008204, "ying", false], [1848, 0.006698, "ei", false], [8862, 0.000826, "ubi", false], [34116, 0.000757, "ching", false]]]}, "raw_delta": 0.072021484375, "tuned_delta": 0.12611108179007557}, {"byte_start": 1304, "byte_end": 1313, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 224, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96%", "model_b": "9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.0042425720021128654]], "model_b": [[56537, " learning", "normal", 0.008046160452067852]]}, "loss": {"model_a": 10.957970145640996, "model_b": 9.643013728164076}, "topk": {"model_a": [56537, 19, 0.0042425720021128654, [[63821, 0.439509, " recognition", false], [63820, 0.237798, " realization", false], [59544, 0.060548, " discovery", false], [64253, 0.024141, " appreciation", false], [59209, 0.023919, " awareness", false], [65034, 0.019285, " understanding", false], [61518, 0.009576, " acceptance", false], [55572, 0.009001, " attempts", false], [63484, 0.0088, " discoveries", false], [21265, 0.008673, " and", false]]], "model_b": [56537, 10, 0.008046160452067852, [[63820, 0.47518, " realization", false], [63821, 0.162285, " recognition", false], [2030, 0.095625, "ly", false], [59209, 0.0356, " awareness", false], [55572, 0.022115, " attempts", false], [65034, 0.018976, " understanding", false], [59544, 0.010833, " discovery", false], [61518, 0.009013, " acceptance", false], [64253, 0.008928, " appreciation", false], [56537, 0.008046, " learning", false]]]}, "raw_delta": 0.07291666666666663, "tuned_delta": 0.1270062640817422}, {"byte_start": 1313, "byte_end": 1316, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 225, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "2.85% 2.85% 2.85%", "model_b": "14.37% 14.37% 14.37%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.6208587884902954]], "model_b": [[4706, " of", "normal", 0.09134647250175476]]}, "loss": {"model_a": 2.8529857986329596, "model_b": 14.370595133854907}, "topk": {"model_a": [4706, 1, 0.6208587884902954, [[4706, 0.620859, " of", false], [32227, 0.127111, " that", false], [37598, 0.059985, " about", false], [30917, 0.045809, " from", false], [32234, 0.023264, " this", false], [4811, 0.020601, " to", false], [116, 0.016251, "s", false], [22590, 0.012485, " the", false], [4596, 0.011576, " in", false], [45, 0.010873, ",", false]]], "model_b": [4706, 5, 0.09134647250175476, [[30917, 0.184069, " from", false], [37598, 0.139141, " about", false], [116, 0.097601, "s", false], [32227, 0.097062, " that", false], [4706, 0.091346, " of", false], [4596, 0.051911, " in", false], [45, 0.046871, ",", false], [4811, 0.04584, " to", false], [47, 0.041537, ".", false], [32234, 0.031213, " this", false]]]}, "raw_delta": -0.638671875, "tuned_delta": -0.5845822775849244}, {"byte_start": 1316, "byte_end": 1321, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 226, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "2.73% 2.73% 2.73% 2.73% 2.73%", "model_b": "1.73% 1.73% 1.73% 1.73% 1.73%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.47909310460090637]], "model_b": [[32234, " this", "normal", 0.6114832162857056]]}, "loss": {"model_a": 2.7332308391841686, "model_b": 1.7329247073177978}, "topk": {"model_a": [32234, 1, 0.47909310460090637, [[32234, 0.479093, " this", false], [22590, 0.293509, " the", false], [39936, 0.097901, " these", false], [51832, 0.014763, " general", false], [21835, 0.013698, " how", false], [37045, 0.012207, " Moore", false], [32227, 0.010701, " that", false], [32464, 0.009894, " what", false], [332, 0.007488, " a", false], [52127, 0.003534, " lessons", false]]], "model_b": [32234, 1, 0.6114832162857056, [[32234, 0.611483, " this", false], [22590, 0.211335, " the", false], [39936, 0.072739, " these", false], [32227, 0.020476, " that", false], [37045, 0.012146, " Moore", false], [21835, 0.008937, " how", false], [32464, 0.006899, " what", false], [332, 0.004769, " a", false], [39931, 0.004566, " their", false], [51832, 0.004029, " general", false]]]}, "raw_delta": 0.055468749999999976, "tuned_delta": 0.10955834741507556}, {"byte_start": 1321, "byte_end": 1328, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 227, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "18.11% 18.11% 18.11% 18.11% 18.11% 18.11% 18.11%", "model_b": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.000874691060744226]], "model_b": [[45315, " bitter", "normal", 0.0002502522838767618]]}, "loss": {"model_a": 18.114195546875937, "model_b": 21.415004513195548}, "topk": {"model_a": [45315, 46, 0.000874691060744226, [[46430, 0.570191, " lesson", false], [30808, 0.080296, " fact", false], [4596, 0.031999, " in", false], [45, 0.028183, ",", false], [47, 0.022626, ".", false], [45805, 0.018087, " during", false], [40029, 0.017817, " truth", false], [31601, 0.017807, " over", false], [39310, 0.016515, " point", false], [63591, 0.013891, " fundamental", false]]], "model_b": [45315, 157, 0.0002502522838767618, [[46430, 0.277033, " lesson", false], [47, 0.113436, ".", false], [45, 0.104094, ",", false], [30808, 0.072719, " fact", false], [40029, 0.038755, " truth", false], [4596, 0.037655, " in", false], [31601, 0.023546, " over", false], [60250, 0.018962, " principle", false], [21265, 0.012844, " and", false], [59, 0.012667, ":", false]]]}, "raw_delta": -0.1830357142857142, "tuned_delta": -0.12894611687063862}, {"byte_start": 1328, "byte_end": 1335, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 228, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%", "model_b": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.9681681990623474]], "model_b": [[46430, " lesson", "normal", 0.9192620515823364]]}, "loss": {"model_a": 0.08365236137967011, "model_b": 0.21636400236546258}, "topk": {"model_a": [46430, 1, 0.9681681990623474, [[46430, 0.968168, " lesson", false], [40029, 0.014764, " truth", false], [30808, 0.001671, " fact", false], [45, 0.001323, ",", false], [46454, 0.001276, " little", false], [21400, 0.000933, " but", false], [31683, 0.000757, " pill", false], [52127, 0.000645, " lessons", false], [21265, 0.000598, " and", false], [7513, 0.000549, "est", false]]], "model_b": [46430, 1, 0.9192620515823364, [[46430, 0.919262, " lesson", false], [40029, 0.05253, " truth", false], [52652, 0.00327, " reality", false], [30808, 0.002847, " fact", false], [21988, 0.00216, " law", false], [45, 0.00185, ",", false], [46, 0.001722, "-", false], [31683, 0.001321, " pill", false], [39997, 0.000653, " trade", false], [21265, 0.000433, " and", false]]]}, "raw_delta": -0.007359095982142857, "tuned_delta": 0.04673050143293273}, {"byte_start": 1335, "byte_end": 1336, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "30.01%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.19484630227088928]], "model_b": [[45, ",", "normal", 0.20595824718475342]]}, "loss": {"model_a": 30.00918395599113, "model_b": 28.600302080123}, "topk": {"model_a": [45, 2, 0.19484630227088928, [[47, 0.306842, ".", false], [45, 0.194846, ",", false], [4596, 0.158516, " in", false], [31601, 0.066778, " over", false], [45805, 0.048276, " during", false], [59, 0.021409, ":", false], [32227, 0.020235, " that", false], [37634, 0.014823, " after", false], [30917, 0.012115, " from", false], [4423, 0.011576, " as", false]]], "model_b": [45, 2, 0.20595824718475342, [[47, 0.346671, ".", false], [45, 0.205958, ",", false], [4596, 0.099794, " in", false], [31601, 0.046459, " over", false], [30917, 0.038725, " from", false], [45805, 0.035916, " during", false], [59, 0.02211, ":", false], [21265, 0.017369, " and", false], [4423, 0.016289, " as", false], [275, 0.016143, " (", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13221459741507557}, {"byte_start": 1336, "byte_end": 1340, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 229, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "8.31% 8.31% 8.31% 8.31%", "model_b": "8.63% 8.63% 8.63% 8.63%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.15665288269519806]], "model_b": [[21265, " and", "normal", 0.14588531851768494]]}, "loss": {"model_a": 8.312403067621956, "model_b": 8.629401489692285}, "topk": {"model_a": [21265, 2, 0.15665288269519806, [[21400, 0.328388, " but", false], [21265, 0.156653, " and", false], [59841, 0.04821, " including", false], [40186, 0.037553, " which", false], [4423, 0.02878, " as", false], [32139, 0.024238, " such", false], [4596, 0.020691, " in", false], [30917, 0.015871, " from", false], [57295, 0.014906, " starting", false], [37634, 0.013393, " after", false]]], "model_b": [21265, 2, 0.14588531851768494, [[21400, 0.222034, " but", false], [21265, 0.145885, " and", false], [59841, 0.068505, " including", false], [32139, 0.051139, " such", false], [4423, 0.037389, " as", false], [31461, 0.034961, " most", false], [30917, 0.029019, " from", false], [32074, 0.024645, " some", false], [40186, 0.022013, " which", false], [61953, 0.021878, " especially", false]]]}, "raw_delta": -0.017578125, "tuned_delta": 0.03651147241507559}, {"byte_start": 1340, "byte_end": 1343, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 230, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "16.16% 16.16% 16.16%", "model_b": "15.97% 15.97% 15.97%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.06742258369922638]], "model_b": [[4601, " it", "normal", 0.07039174437522888]]}, "loss": {"model_a": 16.15517884328787, "model_b": 15.967327926505453}, "topk": {"model_a": [4601, 4, 0.06742258369922638, [[22590, 0.108091, " the", false], [31370, 0.090336, " many", false], [39934, 0.069697, " there", false], [4601, 0.067423, " it", false], [308, 0.046217, " I", false], [32074, 0.035824, " some", false], [4706, 0.035493, " of", false], [32232, 0.031075, " they", false], [332, 0.026151, " a", false], [32234, 0.023182, " this", false]]], "model_b": [4601, 2, 0.07039174437522888, [[22590, 0.09253, " the", false], [4601, 0.070392, " it", false], [31370, 0.057673, " many", false], [308, 0.056016, " I", false], [4706, 0.047075, " of", false], [32232, 0.046044, " they", false], [32074, 0.03931, " some", false], [39934, 0.03817, " there", false], [32234, 0.03253, " this", false], [4596, 0.031787, " in", false]]]}, "raw_delta": 0.01041666666666674, "tuned_delta": 0.06450626408174233}, {"byte_start": 1343, "byte_end": 1346, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 231, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "8.97% 8.97% 8.97%", "model_b": "5.68% 5.68% 5.68%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.22523117065429688]], "model_b": [[4600, " is", "normal", 0.38704532384872437]]}, "loss": {"model_a": 8.969881276360416, "model_b": 5.682490232668117}, "topk": {"model_a": [4600, 1, 0.22523117065429688, [[4600, 0.225231, " is", false], [22748, 0.150831, " was", false], [460, 0.121432, "'s", false], [32272, 0.080876, " took", false], [21800, 0.054031, " has", false], [40219, 0.0229, " would", false], [39620, 0.018985, " seems", false], [59393, 0.015811, " continues", false], [39820, 0.013745, " still", false], [52701, 0.011672, " remains", false]]], "model_b": [4600, 1, 0.38704532384872437, [[4600, 0.387045, " is", false], [460, 0.098046, "'s", false], [22748, 0.097996, " was", false], [21800, 0.056861, " has", false], [39620, 0.020286, " seems", false], [21413, 0.018898, " can", false], [32272, 0.017005, " took", false], [22074, 0.012389, " may", false], [32475, 0.011137, " will", false], [47266, 0.010951, " should", false]]]}, "raw_delta": 0.18229166666666663, "tuned_delta": 0.2363812640817422}, {"byte_start": 1346, "byte_end": 1355, "display": {"text": " instruct", "kind": "normal"}, "is_word": true, "word_id": 232, "word_key": " instruct", "bytes_hex": "20 69 6e 73 74 72 75 63 74", "compression": {"model_a": "8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14%", "model_b": "9.14% 9.14% 9.14% 9.14% 9.14% 9.14% 9.14% 9.14% 9.14%"}, "model_tokens": {"model_a": [[56469, " instruct", "normal", 0.017296679317951202]], "model_b": [[56469, " instruct", "normal", 0.010477041825652122]]}, "loss": {"model_a": 8.14020639390474, "model_b": 9.142077950077633}, "topk": {"model_a": [56469, 10, 0.017296679317951202, [[22187, 0.117222, " not", false], [332, 0.0805, " a", false], [39820, 0.063108, " still", false], [22226, 0.062491, " one", false], [40218, 0.041248, " worth", false], [31581, 0.028223, " only", false], [22590, 0.020621, " the", false], [31048, 0.019876, " hard", false], [59829, 0.01731, " important", false], [56469, 0.017297, " instruct", false]]], "model_b": [56469, 22, 0.010477041825652122, [[332, 0.0788, " a", false], [22187, 0.059814, " not", false], [22226, 0.048038, " one", false], [40218, 0.046739, " worth", false], [59829, 0.031245, " important", false], [22590, 0.026903, " the", false], [46439, 0.025301, " likely", false], [4419, 0.024722, " an", false], [52448, 0.01807, " perhaps", false], [31581, 0.017865, " only", false]]]}, "raw_delta": -0.055555555555555525, "tuned_delta": -0.0014659581404799366}, {"byte_start": 1355, "byte_end": 1358, "display": {"text": "ive", "kind": "normal"}, "is_word": true, "word_id": 233, "word_key": "ive", "bytes_hex": "69 76 65", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.00% 0.00% 0.00%"}, "model_tokens": {"model_a": [[7938, "ive", "normal", 0.9983742237091064]], "model_b": [[7938, "ive", "normal", 0.9992814660072327]]}, "loss": {"model_a": 0.009860338649467695, "model_b": 0.0043568938218578185}, "topk": {"model_a": [7938, 1, 0.9983742237091064, [[7938, 0.998374, "ive", false], [7856, 0.000744, "ing", false], [34918, 0.000723, "ively", false], [4811, 3.1e-05, " to", false], [24381, 1.5e-05, "able", false], [25656, 1.2e-05, "ible", false], [1958, 6e-06, "iv", false], [2255, 6e-06, "ve", false], [49338, 5e-06, "iveness", false], [33948, 5e-06, "ative", false]]], "model_b": [7938, 1, 0.9992814660072327, [[7938, 0.999281, "ive", false], [34918, 0.000485, "ively", false], [7856, 8.8e-05, "ing", false], [26018, 2.2e-05, "ives", false], [24381, 2.2e-05, "able", false], [49338, 2e-05, "iveness", false], [4811, 1.4e-05, " to", false], [1958, 1.2e-05, "iv", false], [26015, 8e-06, "ivel", false], [25656, 7e-06, "ible", false]]]}, "raw_delta": 0.00030517578125, "tuned_delta": 0.05439477319632559}, {"byte_start": 1358, "byte_end": 1361, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 234, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.85% 0.85% 0.85%", "model_b": "0.99% 0.99% 0.99%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8673887848854065]], "model_b": [[4811, " to", "normal", 0.8502980470657349]]}, "loss": {"model_a": 0.8511994666703275, "model_b": 0.9862173131076897}, "topk": {"model_a": [4811, 1, 0.8673887848854065, [[4811, 0.867389, " to", false], [32227, 0.050323, " that", false], [21700, 0.016309, " for", false], [47, 0.015216, ".", false], [4596, 0.007946, " in", false], [21265, 0.007142, " and", false], [21835, 0.00447, " how", false], [45, 0.004036, ",", false], [4423, 0.003195, " as", false], [31077, 0.002264, " here", false]]], "model_b": [4811, 1, 0.8502980470657349, [[4811, 0.850298, " to", false], [47, 0.027792, ".", false], [32227, 0.027093, " that", false], [21700, 0.015625, " for", false], [4596, 0.013391, " in", false], [21265, 0.012833, " and", false], [31077, 0.009218, " here", false], [45, 0.007398, ",", false], [51018, 0.004006, " because", false], [4423, 0.003523, " as", false]]]}, "raw_delta": -0.007486979166666664, "tuned_delta": 0.046602618248408924}, {"byte_start": 1361, "byte_end": 1368, "display": {"text": " review", "kind": "normal"}, "is_word": true, "word_id": 235, "word_key": " review", "bytes_hex": "20 72 65 76 69 65 77", "compression": {"model_a": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "model_b": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"model_a": [[47108, " review", "normal", 0.07426609098911285]], "model_b": [[47108, " review", "normal", 0.06417879462242126]]}, "loss": {"model_a": 6.6821254684031235, "model_b": 7.084663147222587}, "topk": {"model_a": [47108, 4, 0.07426609098911285, [[31324, 0.203314, " look", false], [22449, 0.081474, " see", false], [55832, 0.076239, " consider", false], [47108, 0.074266, " review", false], [51667, 0.045202, " examine", false], [52751, 0.038728, " revisit", false], [31834, 0.024186, " read", false], [52672, 0.021541, " reflect", false], [39942, 0.019766, " think", false], [38877, 0.019247, " learn", false]]], "model_b": [47108, 4, 0.06417879462242126, [[31324, 0.204265, " look", false], [22449, 0.084451, " see", false], [55832, 0.077208, " consider", false], [47108, 0.064179, " review", false], [51667, 0.05149, " examine", false], [52672, 0.039112, " reflect", false], [31834, 0.038929, " read", false], [32187, 0.029281, " take", false], [52751, 0.021472, " revisit", false], [51250, 0.020735, " compare", false]]]}, "raw_delta": -0.022321428571428548, "tuned_delta": 0.03176816884364704}, {"byte_start": 1368, "byte_end": 1373, "display": {"text": " some", "kind": "normal"}, "is_word": true, "word_id": 236, "word_key": " some", "bytes_hex": "20 73 6f 6d 65", "compression": {"model_a": "3.97% 3.97% 3.97% 3.97% 3.97%", "model_b": "4.73% 4.73% 4.73% 4.73% 4.73%"}, "model_tokens": {"model_a": [[32074, " some", "normal", 0.3287736773490906]], "model_b": [[32074, " some", "normal", 0.2709016501903534]]}, "loss": {"model_a": 3.9730468899481215, "model_b": 4.733843102916911}, "topk": {"model_a": [32074, 1, 0.3287736773490906, [[32074, 0.328774, " some", false], [32229, 0.230669, " them", false], [332, 0.16902, " a", false], [22590, 0.085175, " the", false], [39936, 0.029564, " these", false], [39944, 0.022045, " those", false], [52869, 0.013726, " several", false], [32464, 0.011551, " what", false], [22226, 0.009252, " one", false], [31198, 0.009173, " just", false]]], "model_b": [32074, 1, 0.2709016501903534, [[32074, 0.270902, " some", false], [32229, 0.142643, " them", false], [22590, 0.131069, " the", false], [332, 0.098226, " a", false], [39936, 0.053076, " these", false], [32464, 0.035855, " what", false], [39931, 0.028361, " their", false], [21835, 0.023895, " how", false], [22226, 0.020591, " one", false], [39944, 0.016898, " those", false]]]}, "raw_delta": -0.04218750000000002, "tuned_delta": 0.011902097415075572}, {"byte_start": 1373, "byte_end": 1376, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 237, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.12% 1.12% 1.12%", "model_b": "1.26% 1.26% 1.26%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8286420106887817]], "model_b": [[4706, " of", "normal", 0.8106138110160828]]}, "loss": {"model_a": 1.1153648183956015, "model_b": 1.262123347131865}, "topk": {"model_a": [4706, 1, 0.8286420106887817, [[4706, 0.828642, " of", false], [47, 0.06279, ".", false], [56162, 0.026725, " examples", false], [32227, 0.007027, " that", false], [59, 0.004101, ":", false], [45, 0.004093, ",", false], [47014, 0.00407, " recent", false], [37970, 0.003799, " cases", false], [30917, 0.002866, " from", false], [21952, 0.002137, " key", false]]], "model_b": [4706, 1, 0.8106138110160828, [[4706, 0.810614, " of", false], [47, 0.049106, ".", false], [56162, 0.024453, " examples", false], [47014, 0.017803, " recent", false], [30917, 0.007244, " from", false], [32139, 0.005479, " such", false], [38328, 0.004706, " early", false], [4596, 0.003027, " in", false], [31636, 0.002567, " past", false], [32227, 0.00255, " that", false]]]}, "raw_delta": -0.008138020833333336, "tuned_delta": 0.04595157658174225}, {"byte_start": 1376, "byte_end": 1380, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 238, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.40% 7.40% 7.40% 7.40%", "model_b": "4.26% 4.26% 4.26% 4.26%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.19532449543476105]], "model_b": [[22590, " the", "normal", 0.3866804242134094]]}, "loss": {"model_a": 7.396629848307673, "model_b": 4.2618676745010875}, "topk": {"model_a": [22590, 2, 0.19532449543476105, [[32229, 0.596575, " them", false], [22590, 0.195324, " the", false], [39936, 0.134746, " these", false], [39944, 0.054173, " those", false], [39931, 0.01107, " their", false], [32234, 0.001394, " this", false], [32464, 0.001147, " what", false], [32227, 0.000845, " that", false], [4677, 0.000721, " my", false], [22248, 0.000481, " our", false]]], "model_b": [22590, 1, 0.3866804242134094, [[22590, 0.38668, " the", false], [32229, 0.284448, " them", false], [39936, 0.18363, " these", false], [39944, 0.064709, " those", false], [39931, 0.045848, " their", false], [32234, 0.010196, " this", false], [32464, 0.003534, " what", false], [22248, 0.003415, " our", false], [32227, 0.002303, " that", false], [4601, 0.002299, " it", false]]]}, "raw_delta": 0.173828125, "tuned_delta": 0.22791772241507557}, {"byte_start": 1380, "byte_end": 1385, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 239, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "6.42% 6.42% 6.42% 6.42% 6.42%", "model_b": "6.17% 6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.16908559203147888]], "model_b": [[31461, " most", "normal", 0.1808624118566513]]}, "loss": {"model_a": 6.424501353958664, "model_b": 6.170902616302401}, "topk": {"model_a": [31461, 1, 0.16908559203147888, [[31461, 0.169086, " most", false], [56162, 0.072147, " examples", false], [31458, 0.068466, " more", false], [37970, 0.045497, " cases", false], [32448, 0.040482, " ways", false], [21952, 0.02283, " key", false], [38328, 0.021576, " early", false], [30273, 0.020988, " best", false], [31580, 0.01857, " ones", false], [56652, 0.017062, " mistakes", false]]], "model_b": [31461, 1, 0.1808624118566513, [[31461, 0.180862, " most", false], [31458, 0.113926, " more", false], [38328, 0.054487, " early", false], [56162, 0.049368, " examples", false], [30273, 0.028548, " best", false], [32448, 0.024198, " ways", false], [52127, 0.020341, " lessons", false], [38961, 0.01979, " major", false], [21952, 0.019436, " key", false], [51551, 0.017796, " earlier", false]]]}, "raw_delta": 0.014062500000000033, "tuned_delta": 0.06815209741507562}, {"byte_start": 1385, "byte_end": 1395, "display": {"text": " prominent", "kind": "normal"}, "is_word": true, "word_id": 240, "word_key": " prominent", "bytes_hex": "20 70 72 6f 6d 69 6e 65 6e 74", "compression": {"model_a": "3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80%", "model_b": "3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94% 3.94%"}, "model_tokens": {"model_a": [[60273, " prominent", "normal", 0.12190701812505722]], "model_b": [[60273, " prominent", "normal", 0.11150821298360825]]}, "loss": {"model_a": 3.803981064843946, "model_b": 3.9448692524307587}, "topk": {"model_a": [60273, 1, 0.12190701812505722, [[60273, 0.121907, " prominent", false], [52321, 0.089666, " notable", false], [59829, 0.086941, " important", false], [45958, 0.071268, " famous", false], [57323, 0.057441, " striking", false], [52796, 0.042793, " salient", false], [56056, 0.035765, " dramatic", false], [63870, 0.03498, " significant", false], [52346, 0.0335, " obvious", false], [47014, 0.032097, " recent", false]]], "model_b": [60273, 3, 0.11150821298360825, [[52321, 0.148189, " notable", false], [59829, 0.131886, " important", false], [60273, 0.111508, " prominent", false], [45958, 0.064921, " famous", false], [63636, 0.049034, " influential", false], [63870, 0.048621, " significant", false], [47014, 0.042967, " recent", false], [63667, 0.032033, " interesting", false], [45534, 0.027185, " common", false], [57074, 0.025394, " relevant", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04627709741507559}, {"byte_start": 1395, "byte_end": 1396, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "19.58%", "model_b": "29.16%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.33353230357170105]], "model_b": [[47, ".", "normal", 0.19882600009441376]]}, "loss": {"model_a": 19.58345807456698, "model_b": 29.163854830470253}, "topk": {"model_a": [47, 1, 0.33353230357170105, [[47, 0.333532, ".", false], [56162, 0.160815, " examples", false], [31580, 0.159719, " ones", false], [4706, 0.08361, " of", false], [37970, 0.06234, " cases", false], [21265, 0.029149, " and", false], [45, 0.023184, ",", false], [59, 0.020474, ":", false], [4596, 0.012404, " in", false], [56200, 0.008557, " failures", false]]], "model_b": [47, 2, 0.19882600009441376, [[31580, 0.226119, " ones", false], [47, 0.198826, ".", false], [56162, 0.184511, " examples", false], [4706, 0.072563, " of", false], [37970, 0.052022, " cases", false], [21265, 0.02409, " and", false], [3609, 0.021392, " AI", false], [4596, 0.01388, " in", false], [57103, 0.013826, " research", false], [45, 0.012538, ",", false]]]}, "raw_delta": -0.53125, "tuned_delta": -0.4771604025849244}, {"byte_start": 1396, "byte_end": 1397, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "23.67%", "model_b": "21.98%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.0719975084066391]], "model_b": [[261, "\n\n", "control", 0.08607017993927002]]}, "loss": {"model_a": 23.669215514584554, "model_b": 21.9785572635428}, "topk": {"model_a": [261, 3, 0.0719975084066391, [[267, 0.229874, "  ", false], [11, 0.21496, "\n", false], [261, 0.071998, "\n\n", false], [20996, 0.069066, " The", false], [3913, 0.033704, " In", false], [20556, 0.017704, " One", false], [265, 0.015609, " \n", false], [308, 0.013084, " I", false], [19907, 0.011463, " For", false], [37453, 0.009139, " These", false]]], "model_b": [261, 2, 0.08607017993927002, [[11, 0.348245, "\n", false], [261, 0.08607, "\n\n", false], [267, 0.086048, "  ", false], [20996, 0.060173, " The", false], [20556, 0.041879, " One", false], [3913, 0.032476, " In", false], [300, 0.012269, " A", false], [265, 0.00966, " \n", false], [19907, 0.009561, " For", false], [308, 0.008237, " I", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 1397, "byte_end": 1398, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "23.67%", "model_b": "21.98%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.0719975084066391]], "model_b": [[261, "\n\n", "control", 0.08607017993927002]]}, "loss": {"model_a": 23.669215514584554, "model_b": 21.9785572635428}, "topk": {"model_a": [261, 3, 0.0719975084066391, [[267, 0.229874, "  ", false], [11, 0.21496, "\n", false], [261, 0.071998, "\n\n", false], [20996, 0.069066, " The", false], [3913, 0.033704, " In", false], [20556, 0.017704, " One", false], [265, 0.015609, " \n", false], [308, 0.013084, " I", false], [19907, 0.011463, " For", false], [37453, 0.009139, " These", false]]], "model_b": [261, 2, 0.08607017993927002, [[11, 0.348245, "\n", false], [261, 0.08607, "\n\n", false], [267, 0.086048, "  ", false], [20996, 0.060173, " The", false], [20556, 0.041879, " One", false], [3913, 0.032476, " In", false], [300, 0.012269, " A", false], [265, 0.00966, " \n", false], [19907, 0.009561, " For", false], [308, 0.008237, " I", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 1398, "byte_end": 1400, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 241, "word_key": "in", "bytes_hex": "49 6e", "compression": {"model_a": "30.01% 30.01%", "model_b": "34.52% 34.52%"}, "model_tokens": {"model_a": [[1136, "In", "normal", 0.036061257123947144]], "model_b": [[1136, "In", "normal", 0.021673619747161865]]}, "loss": {"model_a": 30.00918395599113, "model_b": 34.51760595876914}, "topk": {"model_a": [1136, 3, 0.036061257123947144, [[53648, 0.37618, "Question", false], [6699, 0.074905, "The", false], [1136, 0.036061, "In", false], [66, 0.026082, "A", false], [6393, 0.018312, "One", false], [33161, 0.016189, "Human", false], [820, 0.014187, "AI", false], [50, 0.010306, "1", false], [33504, 0.006586, "There", false], [24242, 0.006425, "This", false]]], "model_b": [1136, 6, 0.021673619747161865, [[53648, 0.408776, "Question", false], [6699, 0.092527, "The", false], [36, 0.039016, "#", false], [66, 0.025269, "A", false], [820, 0.022187, "AI", false], [1136, 0.021674, "In", false], [6393, 0.014354, "One", false], [33161, 0.01107, "Human", false], [402, 0.011055, "##", false], [33106, 0.007559, "First", false]]]}, "raw_delta": -0.25, "tuned_delta": -0.19591040258492443}, {"byte_start": 1400, "byte_end": 1409, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 242, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%", "model_b": "11.52% 11.52% 11.52% 11.52% 11.52% 11.52% 11.52% 11.52% 11.52%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.003919978626072407]], "model_b": [[55809, " computer", "normal", 0.0031070788390934467]]}, "loss": {"model_a": 11.020587117901803, "model_b": 11.521522895988248}, "topk": {"model_a": [55809, 21, 0.003919978626072407, [[22590, 0.392629, " the", false], [3492, 0.203776, " 19", false], [3493, 0.037114, " 20", false], [332, 0.029135, " a", false], [21823, 0.016887, " his", false], [38328, 0.01654, " early", false], [31370, 0.015106, " many", false], [32234, 0.014, " this", false], [62293, 0.012302, " particular", false], [4677, 0.009593, " my", false]]], "model_b": [55809, 20, 0.0031070788390934467, [[22590, 0.416473, " the", false], [3492, 0.171354, " 19", false], [3493, 0.080219, " 20", false], [332, 0.034665, " a", false], [21823, 0.016028, " his", false], [22226, 0.012034, " one", false], [4677, 0.011654, " my", false], [4419, 0.01091, " an", false], [3609, 0.009634, " AI", false], [51832, 0.00926, " general", false]]]}, "raw_delta": -0.02777777777777768, "tuned_delta": 0.02631181963729791}, {"byte_start": 1409, "byte_end": 1415, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 243, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "13.06% 13.06% 13.06% 13.06% 13.06% 13.06%", "model_b": "16.06% 16.06% 16.06% 16.06% 16.06% 16.06%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.012850133702158928]], "model_b": [[38013, " chess", "normal", 0.004799254238605499]]}, "loss": {"model_a": 13.055638716377988, "model_b": 16.061253384896663}, "topk": {"model_a": [38013, 5, 0.012850133702158928, [[47732, 0.682616, " vision", false], [52814, 0.189248, " science", false], [56329, 0.042617, " graphics", false], [38576, 0.019965, " games", false], [38013, 0.01285, " chess", false], [46, 0.012509, "-", false], [63795, 0.004776, " programming", false], [46075, 0.002631, " gaming", false], [57181, 0.002139, " security", false], [64254, 0.001833, " architecture", false]]], "model_b": [38013, 7, 0.004799254238605499, [[47732, 0.618927, " vision", false], [52814, 0.235768, " science", false], [56329, 0.023387, " graphics", false], [63795, 0.015396, " programming", false], [46, 0.01334, "-", false], [64254, 0.012676, " architecture", false], [38013, 0.004799, " chess", false], [38576, 0.004787, " games", false], [53087, 0.003872, " systems", false], [63528, 0.003579, " engineering", false]]]}, "raw_delta": -0.16666666666666663, "tuned_delta": -0.11257706925159104}, {"byte_start": 1415, "byte_end": 1416, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.59%", "model_b": "5.42%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8189488053321838]], "model_b": [[45, ",", "normal", 0.7381832599639893]]}, "loss": {"model_a": 3.592648783463727, "model_b": 5.424195222092293}, "topk": {"model_a": [45, 1, 0.8189488053321838, [[45, 0.818949, ",", false], [21265, 0.018424, " and", false], [22590, 0.016361, " the", false], [4596, 0.014915, " in", false], [275, 0.0128, " (", false], [39934, 0.010286, " there", false], [4858, 0.008815, " we", false], [3609, 0.004934, " AI", false], [4601, 0.004804, " it", false], [11, 0.004743, "\n", false]]], "model_b": [45, 1, 0.7381832599639893, [[45, 0.738183, ",", false], [57103, 0.053004, " research", false], [3609, 0.024496, " AI", false], [22590, 0.016857, " the", false], [275, 0.013437, " (", false], [4596, 0.012968, " in", false], [21265, 0.012216, " and", false], [39934, 0.007961, " there", false], [332, 0.004848, " a", false], [4601, 0.004611, " it", false]]]}, "raw_delta": -0.1015625, "tuned_delta": -0.04747290258492441}, {"byte_start": 1416, "byte_end": 1420, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 244, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.39% 5.39% 5.39% 5.39%", "model_b": "6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.30426910519599915]], "model_b": [[22590, " the", "normal", 0.21984124183654785]]}, "loss": {"model_a": 5.3889731751955905, "model_b": 6.833077097960421}, "topk": {"model_a": [22590, 1, 0.30426910519599915, [[22590, 0.304269, " the", false], [21700, 0.06704, " for", false], [332, 0.042806, " a", false], [4601, 0.04143, " it", false], [22226, 0.028704, " one", false], [39934, 0.024578, " there", false], [4596, 0.017291, " in", false], [63843, 0.013153, " researchers", false], [38328, 0.011117, " early", false], [31370, 0.009775, " many", false]]], "model_b": [22590, 1, 0.21984124183654785, [[22590, 0.219841, " the", false], [332, 0.058144, " a", false], [22226, 0.029624, " one", false], [21700, 0.023144, " for", false], [39934, 0.022366, " there", false], [38013, 0.020814, " chess", false], [4601, 0.020665, " it", false], [3609, 0.020265, " AI", false], [4596, 0.016139, " in", false], [31370, 0.01258, " many", false]]]}, "raw_delta": -0.080078125, "tuned_delta": -0.025988527584924412}, {"byte_start": 1420, "byte_end": 1428, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 245, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "14.23% 14.23% 14.23% 14.23% 14.23% 14.23% 14.23% 14.23%", "model_b": "15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.0018233939772471786]], "model_b": [[52224, " methods", "normal", 0.0008645016350783408]]}, "loss": {"model_a": 14.229706946268095, "model_b": 15.920365197309849}, "topk": {"model_a": [52224, 90, 0.0018233939772471786, [[38499, 0.126427, " first", false], [31461, 0.041958, " most", false], [30273, 0.027797, " best", false], [38328, 0.023165, " early", false], [31581, 0.019253, " only", false], [38720, 0.018662, " human", false], [39802, 0.015406, " state", false], [31356, 0.014352, " main", false], [3492, 0.011422, " 19", false], [52013, 0.010364, " initial", false]]], "model_b": [52224, 167, 0.0008645016350783408, [[30273, 0.054868, " best", false], [31461, 0.046248, " most", false], [38499, 0.036442, " first", false], [3609, 0.020043, " AI", false], [38720, 0.018688, " human", false], [38013, 0.014244, " chess", false], [30941, 0.01369, " game", false], [38328, 0.013671, " early", false], [51832, 0.011225, " general", false], [63933, 0.010899, " traditional", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.03966040258492441}, {"byte_start": 1428, "byte_end": 1433, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 246, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.86% 3.86% 3.86% 3.86% 3.86%", "model_b": "4.85% 4.85% 4.85% 4.85% 4.85%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.34377023577690125]], "model_b": [[32227, " that", "normal", 0.25976991653442383]]}, "loss": {"model_a": 3.860336339878671, "model_b": 4.846553652986361}, "topk": {"model_a": [32227, 1, 0.34377023577690125, [[32227, 0.34377, " that", false], [4706, 0.242646, " of", false], [32354, 0.03598, " used", false], [37810, 0.034131, " based", false], [59506, 0.033568, " developed", false], [21700, 0.032062, " for", false], [31461, 0.025372, " most", false], [32462, 0.017815, " were", false], [59206, 0.00914, " available", false], [4811, 0.007823, " to", false]]], "model_b": [32227, 1, 0.25976991653442383, [[32227, 0.25977, " that", false], [4706, 0.174083, " of", false], [32354, 0.086761, " used", false], [59506, 0.065046, " developed", false], [31461, 0.052051, " most", false], [59206, 0.024306, " available", false], [21700, 0.024127, " for", false], [21265, 0.013148, " and", false], [56104, 0.012296, " employed", false], [4596, 0.012228, " in", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 1433, "byte_end": 1442, "display": {"text": " defeated", "kind": "normal"}, "is_word": true, "word_id": 247, "word_key": " defeated", "bytes_hex": "20 64 65 66 65 61 74 65 64", "compression": {"model_a": "14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53%", "model_b": "14.59% 14.59% 14.59% 14.59% 14.59% 14.59% 14.59% 14.59% 14.59%"}, "model_tokens": {"model_a": [[55934, " defeated", "normal", 0.0007086691330187023]], "model_b": [[55934, " defeated", "normal", 0.0006837809341959655]]}, "loss": {"model_a": 14.527137564506921, "model_b": 14.589754536767728}, "topk": {"model_a": [55934, 130, 0.0007086691330187023, [[56540, 0.134546, " leverage", false], [32462, 0.100875, " were", false], [31059, 0.058523, " have", false], [47812, 0.040695, " worked", false], [22777, 0.040539, " won", false], [21286, 0.031806, " are", false], [31351, 0.030178, " made", false], [21795, 0.020883, " had", false], [32272, 0.016664, " took", false], [61959, 0.01644, " eventually", false]]], "model_b": [55934, 149, 0.0006837809341959655, [[31059, 0.177182, " have", false], [32462, 0.10143, " were", false], [21286, 0.060737, " are", false], [59572, 0.033157, " dominated", false], [47812, 0.024079, " worked", false], [31461, 0.022663, " most", false], [21795, 0.018533, " had", false], [32499, 0.01632, " work", false], [56041, 0.015301, " dominate", false], [31351, 0.01401, " made", false]]]}, "raw_delta": -0.00347222222222221, "tuned_delta": 0.05061737519285338}, {"byte_start": 1442, "byte_end": 1446, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 248, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "3.89% 3.89% 3.89% 3.89%", "model_b": "6.41% 6.41% 6.41% 6.41%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.42165428400039673]], "model_b": [[22590, " the", "normal", 0.24196265637874603]]}, "loss": {"model_a": 3.892036182085704, "model_b": 6.410412535199983}, "topk": {"model_a": [22590, 1, 0.42165428400039673, [[22590, 0.421654, " the", false], [38720, 0.083178, " human", false], [20184, 0.075613, " Kas", false], [38013, 0.072637, " chess", false], [40213, 0.053899, " world", false], [19948, 0.035155, " Gar", false], [46227, 0.028764, " humans", false], [38621, 0.028033, " grand", false], [22615, 0.012024, " top", false], [332, 0.010923, " a", false]]], "model_b": [22590, 1, 0.24196265637874603, [[22590, 0.241963, " the", false], [19948, 0.167502, " Gar", false], [38621, 0.051678, " grand", false], [40213, 0.049631, " world", false], [28951, 0.043079, " Gary", false], [332, 0.030095, " a", false], [22615, 0.029405, " top", false], [20077, 0.013971, " IBM", false], [38013, 0.013741, " chess", false], [56949, 0.01357, " programs", false]]]}, "raw_delta": -0.1396484375, "tuned_delta": -0.08555884008492441}, {"byte_start": 1446, "byte_end": 1452, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 249, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"model_a": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32%", "model_b": "3.59% 3.59% 3.59% 3.59% 3.59% 3.59%"}, "model_tokens": {"model_a": [[40213, " world", "normal", 0.4585268199443817]], "model_b": [[40213, " world", "normal", 0.3044684827327728]]}, "loss": {"model_a": 2.3246550951824116, "model_b": 3.592648783463727}, "topk": {"model_a": [40213, 1, 0.4585268199443817, [[40213, 0.458527, " world", false], [30273, 0.141294, " best", false], [38720, 0.092137, " human", false], [60571, 0.043762, " strongest", false], [22615, 0.038353, " top", false], [38621, 0.032671, " grand", false], [39471, 0.009689, " reign", false], [52196, 0.0082, " masters", false], [31461, 0.007884, " most", false], [37576, 0.006943, " World", false]]], "model_b": [40213, 1, 0.3044684827327728, [[40213, 0.304468, " world", false], [30273, 0.177897, " best", false], [22615, 0.060221, " top", false], [60571, 0.05935, " strongest", false], [39471, 0.03642, " reign", false], [38720, 0.019397, " human", false], [38621, 0.015451, " grand", false], [32230, 0.015239, " then", false], [55716, 0.013926, " champion", false], [38629, 0.012841, " great", false]]]}, "raw_delta": -0.0703125, "tuned_delta": -0.016222902584924412}, {"byte_start": 1452, "byte_end": 1461, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 250, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"model_a": "0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90%", "model_b": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[55716, " champion", "normal", 0.6399039030075073]], "model_b": [[55716, " champion", "normal", 0.8178924918174744]]}, "loss": {"model_a": 0.900118976249082, "model_b": 0.40701031969523704}, "topk": {"model_a": [55716, 1, 0.6399039030075073, [[55716, 0.639904, " champion", false], [59283, 0.18726, " champions", false], [460, 0.057858, "'s", false], [38013, 0.043835, " chess", false], [46, 0.015617, "-", false], [38621, 0.009147, " grand", false], [37996, 0.007886, " champ", false], [64275, 0.007686, " championship", false], [52196, 0.006802, " masters", false], [46526, 0.003423, " master", false]]], "model_b": [55716, 1, 0.8178924918174744, [[55716, 0.817892, " champion", false], [460, 0.062241, "'s", false], [59283, 0.057233, " champions", false], [38013, 0.01816, " chess", false], [46, 0.010976, "-", false], [37996, 0.007942, " champ", false], [28309, 0.002369, "’s", false], [47024, 0.002287, " record", false], [38621, 0.001955, " grand", false], [64275, 0.001424, " championship", false]]]}, "raw_delta": 0.027343750000000003, "tuned_delta": 0.08143334741507559}, {"byte_start": 1461, "byte_end": 1462, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "47.62%", "model_b": "31.70%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.07186435908079147]], "model_b": [[45, ",", "normal", 0.1725763976573944]]}, "loss": {"model_a": 47.620207404342736, "model_b": 31.699842207032884}, "topk": {"model_a": [45, 3, 0.07186435908079147, [[32462, 0.233318, " were", false], [4596, 0.187459, " in", false], [45, 0.071864, ",", false], [275, 0.042282, " (", false], [21286, 0.025967, " are", false], [28951, 0.020477, " Gary", false], [52628, 0.01916, " quickly", false], [36381, 0.017631, " Bobby", false], [21265, 0.017185, " and", false], [4450, 0.014326, " by", false]]], "model_b": [45, 2, 0.1725763976573944, [[4596, 0.264074, " in", false], [45, 0.172576, ",", false], [19948, 0.071276, " Gar", false], [32462, 0.030833, " were", false], [275, 0.029201, " (", false], [21700, 0.027604, " for", false], [28951, 0.0232, " Gary", false], [31601, 0.017404, " over", false], [21286, 0.014101, " are", false], [36381, 0.012277, " Bobby", false]]]}, "raw_delta": 0.8828125, "tuned_delta": 0.9369020974150756}, {"byte_start": 1462, "byte_end": 1466, "display": {"text": " Kas", "kind": "normal"}, "is_word": true, "word_id": 251, "word_key": " kas", "bytes_hex": "20 4b 61 73", "compression": {"model_a": "9.37% 9.37% 9.37% 9.37%", "model_b": "23.25% 23.25% 23.25% 23.25%"}, "model_tokens": {"model_a": [[20184, " Kas", "normal", 0.12688720226287842]], "model_b": [[20184, " Kas", "normal", 0.005837319418787956]]}, "loss": {"model_a": 9.369064474523052, "model_b": 23.246550951824116}, "topk": {"model_a": [20184, 1, 0.12688720226287842, [[20184, 0.126887, " Kas", false], [21265, 0.07066, " and", false], [28753, 0.069056, " Deep", false], [19948, 0.067941, " Gar", false], [37404, 0.058358, " Stock", false], [22590, 0.048731, " the", false], [32139, 0.037743, " such", false], [28951, 0.036827, " Gary", false], [50239, 0.020798, " Fischer", false], [31296, 0.017045, " like", false]]], "model_b": [20184, 13, 0.005837319418787956, [[19948, 0.522528, " Gar", false], [28951, 0.10435, " Gary", false], [28753, 0.028952, " Deep", false], [36381, 0.024636, " Bobby", false], [37404, 0.016631, " Stock", false], [28411, 0.016497, " Anat", false], [28397, 0.010775, " Alan", false], [3804, 0.010056, " FI", false], [36385, 0.008089, " Boris", false], [20077, 0.006561, " IBM", false]]]}, "raw_delta": -0.76953125, "tuned_delta": -0.7154416525849244}, {"byte_start": 1466, "byte_end": 1469, "display": {"text": "par", "kind": "normal"}, "is_word": true, "word_id": 252, "word_key": "par", "bytes_hex": "70 61 72", "compression": {"model_a": "0.06% 0.06% 0.06%", "model_b": "0.42% 0.42% 0.42%"}, "model_tokens": {"model_a": [[8469, "par", "normal", 0.9898763298988342]], "model_b": [[8469, "par", "normal", 0.9324463605880737]]}, "loss": {"model_a": 0.06127168574738995, "model_b": 0.41679422161098795}, "topk": {"model_a": [8469, 1, 0.9898763298988342, [[8469, 0.989876, "par", false], [113, 0.002037, "p", false], [8484, 0.001454, "per", false], [2111, 0.000612, "pa", false], [2184, 0.00045, "si", false], [2190, 0.000335, "so", false], [8496, 0.000315, "pie", false], [26645, 0.000304, "para", false], [46, 0.000293, "-", false], [2124, 0.00027, "po", false]]], "model_b": [8469, 1, 0.9324463605880737, [[8469, 0.932446, "par", false], [1737, 0.008076, "ae", false], [8641, 0.006971, "ros", false], [1741, 0.004755, "ai", false], [8590, 0.004378, "rep", false], [2170, 0.003446, "ru", false], [8529, 0.002758, "pro", false], [24541, 0.002738, "amat", false], [1949, 0.001592, "im", false], [1754, 0.001242, "av", false]]]}, "raw_delta": -0.01971435546875, "tuned_delta": 0.03437524194632559}, {"byte_start": 1469, "byte_end": 1471, "display": {"text": "ov", "kind": "normal"}, "is_word": true, "word_id": 253, "word_key": "ov", "bytes_hex": "6f 76", "compression": {"model_a": "0.01% 0.01%", "model_b": "0.04% 0.04%"}, "model_tokens": {"model_a": [[2105, "ov", "normal", 0.9990142583847046]], "model_b": [[2105, "ov", "normal", 0.9958772659301758]]}, "loss": {"model_a": 0.008805511724175801, "model_b": 0.03659790810360567}, "topk": {"model_a": [2105, 1, 0.9990142583847046, [[2105, 0.999014, "ov", false], [2106, 0.000755, "ow", false], [28017, 6.2e-05, "ов", false], [8443, 3.9e-05, "ova", false], [8311, 2.3e-05, "off", false], [112, 2e-05, "o", false], [7745, 1.3e-05, "ian", false], [8262, 1.3e-05, "nov", false], [45, 9e-06, ",", false], [8445, 8e-06, "ovi", false]]], "model_b": [2105, 1, 0.9958772659301758, [[2105, 0.995877, "ov", false], [2106, 0.000857, "ow", false], [8443, 0.000566, "ova", false], [7687, 0.000468, "hev", false], [119, 0.000197, "v", false], [20183, 0.000125, " Kar", false], [8311, 9.7e-05, "off", false], [2274, 9.5e-05, "wa", false], [29043, 8.5e-05, " Haus", false], [28017, 8.1e-05, "ов", false]]]}, "raw_delta": -0.0015411376953125, "tuned_delta": 0.05254845971976309}, {"byte_start": 1471, "byte_end": 1472, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.93%", "model_b": "1.20%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8988778591156006]], "model_b": [[45, ",", "normal", 0.9357492923736572]]}, "loss": {"model_a": 1.9284070675945004, "model_b": 1.1975495944879089}, "topk": {"model_a": [45, 1, 0.8988778591156006, [[45, 0.898878, ",", false], [4596, 0.045213, " in", false], [275, 0.036681, " (", false], [21265, 0.005375, " and", false], [460, 0.001492, "'s", false], [4424, 0.001003, " at", false], [32462, 0.000857, " were", false], [326, 0.00081, " [", false], [47, 0.000595, ".", false], [4450, 0.000436, " by", false]]], "model_b": [45, 1, 0.9357492923736572, [[45, 0.935749, ",", false], [4596, 0.018782, " in", false], [275, 0.016163, " (", false], [460, 0.005727, "'s", false], [21265, 0.004072, " and", false], [50870, 0.001464, " against", false], [4851, 0.000738, " vs", false], [22748, 0.000684, " was", false], [32487, 0.000676, " with", false], [4424, 0.000609, " at", false]]]}, "raw_delta": 0.04052734375, "tuned_delta": 0.09461694116507559}, {"byte_start": 1472, "byte_end": 1475, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 254, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "6.57% 6.57% 6.57%", "model_b": "16.06% 16.06% 16.06%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.3365491032600403]], "model_b": [[4596, " in", "normal", 0.06993464380502701]]}, "loss": {"model_a": 6.574782087384598, "model_b": 16.061253384896663}, "topk": {"model_a": [4596, 1, 0.3365491032600403, [[4596, 0.336549, " in", false], [32462, 0.324224, " were", false], [21265, 0.041704, " and", false], [21286, 0.020685, " are", false], [47054, 0.014559, " relied", false], [4450, 0.012535, " by", false], [32354, 0.011725, " used", false], [4424, 0.010701, " at", false], [56427, 0.00861, " included", false], [21795, 0.008175, " had", false]]], "model_b": [4596, 2, 0.06993464380502701, [[32462, 0.34122, " were", false], [4596, 0.069935, " in", false], [32354, 0.041868, " used", false], [47054, 0.040953, " relied", false], [21286, 0.032116, " are", false], [21795, 0.025719, " had", false], [31059, 0.018703, " have", false], [21265, 0.012952, " and", false], [21256, 0.01231, " all", false], [21532, 0.011609, " did", false]]]}, "raw_delta": -0.5260416666666667, "tuned_delta": -0.47195206925159117}, {"byte_start": 1475, "byte_end": 1478, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 255, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"model_a": "4.25% 4.25% 4.25%", "model_b": "6.34% 6.34% 6.34%"}, "model_tokens": {"model_a": [[3492, " 19", "normal", 0.4993974566459656]], "model_b": [[3492, " 19", "normal", 0.35705965757369995]]}, "loss": {"model_a": 4.250126992202187, "model_b": 6.339968441406577}, "topk": {"model_a": [3492, 1, 0.4993974566459656, [[3492, 0.499397, " 19", false], [22590, 0.25355, " the", false], [3493, 0.133876, " 20", false], [332, 0.034427, " a", false], [31198, 0.004014, " just", false], [21823, 0.004008, " his", false], [31277, 0.003156, " less", false], [20394, 0.00275, " May", false], [37598, 0.00239, " about", false], [47014, 0.002232, " recent", false]]], "model_b": [3492, 2, 0.35705965757369995, [[22590, 0.501, " the", false], [3492, 0.35706, " 19", false], [332, 0.026175, " a", false], [3493, 0.022846, " 20", false], [21823, 0.017384, " his", false], [22226, 0.003811, " one", false], [4419, 0.003474, " an", false], [39931, 0.003323, " their", false], [31370, 0.002937, " many", false], [52869, 0.002605, " several", false]]]}, "raw_delta": -0.11588541666666667, "tuned_delta": -0.06179581925159108}, {"byte_start": 1478, "byte_end": 1480, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 256, "word_key": "97", "bytes_hex": "39 37", "compression": {"model_a": "2.89% 2.89%", "model_b": "2.50% 2.50%"}, "model_tokens": {"model_a": [[717, "97", "normal", 0.7258799076080322]], "model_b": [[717, "97", "normal", 0.755956768989563]]}, "loss": {"model_a": 2.8882078455296627, "model_b": 2.5007653296659274}, "topk": {"model_a": [717, 1, 0.7258799076080322, [[717, 0.72588, "97", false], [716, 0.215199, "96", false], [719, 0.020191, "99", false], [710, 0.011702, "90", false], [718, 0.008255, "98", false], [709, 0.004508, "89", false], [713, 0.003529, "93", false], [715, 0.002784, "95", false], [705, 0.001783, "85", false], [711, 0.001693, "91", false]]], "model_b": [717, 1, 0.755956768989563, [[717, 0.755957, "97", false], [716, 0.072199, "96", false], [705, 0.058941, "85", false], [714, 0.033493, "94", false], [715, 0.012816, "95", false], [704, 0.011649, "84", false], [713, 0.008756, "93", false], [712, 0.007373, "92", false], [719, 0.006447, "99", false], [710, 0.006222, "90", false]]]}, "raw_delta": 0.021484375, "tuned_delta": 0.07557397241507559}, {"byte_start": 1480, "byte_end": 1481, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "34.94%", "model_b": "32.12%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.14454956352710724]], "model_b": [[45, ",", "normal", 0.16738271713256836]]}, "loss": {"model_a": 34.94027052152958, "model_b": 32.122506769793326}, "topk": {"model_a": [45, 3, 0.14454956352710724, [[32462, 0.371787, " were", false], [21265, 0.213639, " and", false], [45, 0.14455, ",", false], [275, 0.052413, " (", false], [32354, 0.021215, " used", false], [21286, 0.014041, " are", false], [21795, 0.012023, " had", false], [47054, 0.00872, " relied", false], [56500, 0.008076, " involved", false], [21532, 0.007348, " did", false]]], "model_b": [45, 2, 0.16738271713256836, [[32462, 0.325394, " were", false], [45, 0.167383, ",", false], [32354, 0.071639, " used", false], [21265, 0.035658, " and", false], [21286, 0.034866, " are", false], [275, 0.021177, " (", false], [47054, 0.020709, " relied", false], [21795, 0.018075, " had", false], [46, 0.015069, "-", false], [21256, 0.013645, " all", false]]]}, "raw_delta": 0.15625, "tuned_delta": 0.21033959741507557}, {"byte_start": 1481, "byte_end": 1486, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 257, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "5.95% 5.95% 5.95% 5.95% 5.95%", "model_b": "3.03% 3.03% 3.03% 3.03% 3.03%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.1922028809785843]], "model_b": [[32462, " were", "normal", 0.43692895770072937]]}, "loss": {"model_a": 5.945481516163501, "model_b": 3.029096033116476}, "topk": {"model_a": [32462, 2, 0.1922028809785843, [[3493, 0.27099, " 20", false], [32462, 0.192203, " were", false], [21265, 0.154762, " and", false], [3492, 0.098703, " 19", false], [32354, 0.012385, " used", false], [21286, 0.012159, " are", false], [22590, 0.011727, " the", false], [4596, 0.009792, " in", false], [47054, 0.007366, " relied", false], [21795, 0.00723, " had", false]]], "model_b": [32462, 1, 0.43692895770072937, [[32462, 0.436929, " were", false], [32354, 0.048537, " used", false], [21795, 0.04824, " had", false], [47054, 0.043155, " relied", false], [21286, 0.024062, " are", false], [21265, 0.014756, " and", false], [21532, 0.012035, " did", false], [56500, 0.011159, " involved", false], [56540, 0.011073, " leverage", false], [32272, 0.010751, " took", false]]]}, "raw_delta": 0.16171875000000002, "tuned_delta": 0.2158083474150756}, {"byte_start": 1486, "byte_end": 1492, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 258, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23%", "model_b": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.08956412225961685]], "model_b": [[37810, " based", "normal", 0.09550129622220993]]}, "loss": {"model_a": 7.232260296123059, "model_b": 7.044409379340641}, "topk": {"model_a": [37810, 1, 0.08956412225961685, [[37810, 0.089564, " based", false], [22187, 0.053974, " not", false], [22590, 0.049683, " the", false], [332, 0.046704, " a", false], [63541, 0.038035, " essentially", false], [52094, 0.036795, " largely", false], [52224, 0.030486, " methods", false], [39944, 0.024219, " those", false], [21256, 0.016626, " all", false], [32386, 0.016187, " very", false]]], "model_b": [37810, 1, 0.09550129622220993, [[37810, 0.095501, " based", false], [22590, 0.057008, " the", false], [22187, 0.04083, " not", false], [332, 0.032137, " a", false], [63541, 0.030383, " essentially", false], [21256, 0.029745, " all", false], [52094, 0.022757, " largely", false], [59506, 0.01999, " developed", false], [39944, 0.016565, " those", false], [56466, 0.014355, " inspired", false]]]}, "raw_delta": 0.010416666666666685, "tuned_delta": 0.06450626408174227}, {"byte_start": 1492, "byte_end": 1495, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 259, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "1.04% 1.04% 1.04%", "model_b": "1.38% 1.38% 1.38%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.8390783667564392]], "model_b": [[4712, " on", "normal", 0.7954027056694031]]}, "loss": {"model_a": 1.0449207246021952, "model_b": 1.3795301701208755}, "topk": {"model_a": [4712, 1, 0.8390783667564392, [[4712, 0.839078, " on", false], [56131, 0.016467, " entirely", false], [60247, 0.014913, " primarily", false], [4596, 0.014284, " in", false], [52094, 0.013891, " largely", false], [45145, 0.013001, " almost", false], [32350, 0.010964, " upon", false], [51919, 0.008763, " heavily", false], [22187, 0.007125, " not", false], [47330, 0.005489, " solely", false]]], "model_b": [4712, 1, 0.7954027056694031, [[4712, 0.795403, " on", false], [32350, 0.023548, " upon", false], [4596, 0.022088, " in", false], [45202, 0.020017, " around", false], [56131, 0.01834, " entirely", false], [45145, 0.017727, " almost", false], [60247, 0.017138, " primarily", false], [52094, 0.01276, " largely", false], [51919, 0.01014, " heavily", false], [56003, 0.004412, " directly", false]]]}, "raw_delta": -0.018554687499999993, "tuned_delta": 0.035534909915075595}, {"byte_start": 1495, "byte_end": 1503, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 260, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50%", "model_b": "17.68% 17.68% 17.68% 17.68% 17.68% 17.68% 17.68% 17.68%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.009590300731360912]], "model_b": [[52195, " massive", "normal", 0.000389414606615901]]}, "loss": {"model_a": 10.496169975217555, "model_b": 17.681467542145008}, "topk": {"model_a": [52195, 14, 0.009590300731360912, [[332, 0.125288, " a", false], [22590, 0.108478, " the", false], [51832, 0.057074, " general", false], [52224, 0.027377, " methods", false], [52167, 0.022165, " machine", false], [46658, 0.021982, " neural", false], [56537, 0.020004, " learning", false], [30597, 0.016778, " deep", false], [55531, 0.012636, " applying", false], [47202, 0.011492, " search", false]]], "model_b": [52195, 258, 0.000389414606615901, [[332, 0.19171, " a", false], [22590, 0.125336, " the", false], [38720, 0.042785, " human", false], [4419, 0.03776, " an", false], [51832, 0.02884, " general", false], [59792, 0.022317, " heuristic", false], [30597, 0.01858, " deep", false], [52224, 0.011983, " methods", false], [21823, 0.010531, " his", false], [59943, 0.010023, " knowledge", false]]]}, "raw_delta": -0.3984375, "tuned_delta": -0.3443479025849244}, {"byte_start": 1503, "byte_end": 1504, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "79.46%", "model_b": "77.21%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.012095452286303043]], "model_b": [[45, ",", "normal", 0.013585684821009636]]}, "loss": {"model_a": 79.46093779896243, "model_b": 77.20672679757342}, "topk": {"model_a": [45, 14, 0.012095452286303043, [[64423, 0.114045, " improvements", false], [50897, 0.110007, " amounts", false], [63370, 0.097949, " computation", false], [22681, 0.045297, " use", false], [56812, 0.028972, " parallel", false], [38720, 0.026104, " human", false], [51832, 0.02105, " general", false], [64862, 0.019825, " computational", false], [47202, 0.018326, " search", false], [63621, 0.017981, " improvement", false]]], "model_b": [45, 10, 0.013585684821009636, [[50897, 0.160219, " amounts", false], [38720, 0.095432, " human", false], [37920, 0.037311, " brute", false], [56812, 0.034707, " parallel", false], [65135, 0.021651, " generalization", false], [63370, 0.021404, " computation", false], [64862, 0.01894, " computational", false], [64298, 0.018004, " computations", false], [22681, 0.013786, " use", false], [45, 0.013586, ",", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17908959741507557}, {"byte_start": 1504, "byte_end": 1509, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 261, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"model_a": "16.79% 16.79% 16.79% 16.79% 16.79%", "model_b": "14.09% 14.09% 14.09% 14.09% 14.09%"}, "model_tokens": {"model_a": [[30597, " deep", "normal", 0.009489580988883972]], "model_b": [[30597, " deep", "normal", 0.020045988261699677]]}, "loss": {"model_a": 16.79387196034809, "model_b": 14.088818758681281}, "topk": {"model_a": [30597, 15, 0.009489580988883972, [[31044, 0.100107, " hand", false], [38720, 0.062638, " human", false], [51832, 0.055898, " general", false], [59262, 0.040896, " carefully", false], [59988, 0.033768, " massively", false], [21400, 0.020121, " but", false], [56812, 0.016347, " parallel", false], [39802, 0.015758, " state", false], [22323, 0.014956, " pre", false], [37920, 0.013377, " brute", false]]], "model_b": [30597, 6, 0.020045988261699677, [[38720, 0.043289, " human", false], [51832, 0.026297, " general", false], [37920, 0.024868, " brute", false], [62546, 0.022271, " sequential", false], [21265, 0.020969, " and", false], [30597, 0.020046, " deep", false], [21400, 0.018208, " but", false], [31082, 0.015992, " high", false], [22184, 0.01526, " non", false], [63495, 0.013108, " distributed", false]]]}, "raw_delta": 0.15000000000000002, "tuned_delta": 0.2040895974150756}, {"byte_start": 1509, "byte_end": 1516, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 262, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22%", "model_b": "8.61% 8.61% 8.61% 8.61% 8.61% 8.61% 8.61%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.027812570333480835]], "model_b": [[47202, " search", "normal", 0.0355411022901535]]}, "loss": {"model_a": 9.218112844965754, "model_b": 8.614306326736557}, "topk": {"model_a": [47202, 5, 0.027812570333480835, [[56537, 0.250962, " learning", false], [45, 0.165588, ",", false], [46658, 0.154947, " neural", false], [46, 0.033813, "-", false], [47202, 0.027813, " search", false], [32298, 0.014586, " tree", false], [56705, 0.012814, " networks", false], [63384, 0.012554, " connections", false], [51832, 0.011478, " general", false], [21265, 0.010674, " and", false]]], "model_b": [47202, 5, 0.0355411022901535, [[56537, 0.172261, " learning", false], [46, 0.137712, "-", false], [45, 0.135397, ",", false], [46658, 0.062461, " neural", false], [47202, 0.035541, " search", false], [65003, 0.035335, " reinforcement", false], [59943, 0.034229, " knowledge", false], [57174, 0.018041, " searches", false], [63562, 0.015663, " exploration", false], [38720, 0.011622, " human", false]]]}, "raw_delta": 0.03348214285714285, "tuned_delta": 0.08757174027221844}, {"byte_start": 1516, "byte_end": 1517, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "33.25%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.15849344432353973]], "model_b": [[47, ".", "normal", 0.20554819703102112]]}, "loss": {"model_a": 33.24961227048782, "model_b": 28.600302080123}, "topk": {"model_a": [47, 1, 0.15849344432353973, [[47, 0.158493, ".", false], [45, 0.150797, ",", false], [21265, 0.079702, " and", false], [40085, 0.069838, " using", false], [4706, 0.066579, " of", false], [55780, 0.050283, " combined", false], [32487, 0.045227, " with", false], [4596, 0.042338, " in", false], [31601, 0.035346, " over", false], [275, 0.033037, " (", false]]], "model_b": [47, 1, 0.20554819703102112, [[47, 0.205548, ".", false], [45, 0.134562, ",", false], [4706, 0.066646, " of", false], [21265, 0.055897, " and", false], [40085, 0.046612, " using", false], [61559, 0.037406, " algorithms", false], [275, 0.036744, " (", false], [4596, 0.035687, " in", false], [32227, 0.030694, " that", false], [32487, 0.026447, " with", false]]]}, "raw_delta": 0.2578125, "tuned_delta": 0.3119020974150756}, {"byte_start": 1517, "byte_end": 1520, "display": {"text": " At", "kind": "normal"}, "is_word": true, "word_id": 263, "word_key": " at", "bytes_hex": "20 41 74", "compression": {"model_a": "28.74% 28.74% 28.74%", "model_b": "28.55% 28.55% 28.55%"}, "model_tokens": {"model_a": [[3642, " At", "normal", 0.008294779807329178]], "model_b": [[3642, " At", "normal", 0.008816681802272797]]}, "loss": {"model_a": 28.741190267709815, "model_b": 28.553339350927395}, "topk": {"model_a": [3642, 17, 0.008294779807329178, [[20996, 0.16726, " The", false], [3913, 0.099724, " In", false], [29894, 0.074496, " This", false], [19555, 0.034937, " But", false], [29893, 0.030826, " They", false], [28753, 0.030702, " Deep", false], [3918, 0.025467, " It", false], [20184, 0.025448, " Kas", false], [37453, 0.024568, " These", false], [267, 0.024184, "  ", false]]], "model_b": [3642, 19, 0.008816681802272797, [[20996, 0.125859, " The", false], [3913, 0.071229, " In", false], [29893, 0.066383, " They", false], [29894, 0.053881, " This", false], [37453, 0.044123, " These", false], [267, 0.044014, "  ", false], [28753, 0.043217, " Deep", false], [19555, 0.028208, " But", false], [20184, 0.028172, " Kas", false], [3918, 0.017223, " It", false]]]}, "raw_delta": 0.01041666666666674, "tuned_delta": 0.06450626408174233}, {"byte_start": 1520, "byte_end": 1524, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 264, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.03% 2.03% 2.03% 2.03%", "model_b": "2.25% 2.25% 2.25% 2.25%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.6423044800758362]], "model_b": [[22590, " the", "normal", 0.6123349666595459]]}, "loss": {"model_a": 2.025267696560434, "model_b": 2.2454054896648294}, "topk": {"model_a": [22590, 1, 0.6423044800758362, [[22590, 0.642304, " the", false], [32227, 0.203458, " that", false], [38499, 0.018085, " first", false], [332, 0.017556, " a", false], [38879, 0.015072, " least", false], [37598, 0.012445, " about", false], [32234, 0.011288, " this", false], [22226, 0.00807, " one", false], [32074, 0.00772, " some", false], [21902, 0.004991, " its", false]]], "model_b": [22590, 1, 0.6123349666595459, [[22590, 0.612335, " the", false], [32227, 0.206117, " that", false], [21902, 0.023121, " its", false], [22226, 0.01889, " one", false], [38499, 0.017997, " first", false], [39931, 0.01437, " their", false], [32234, 0.012962, " this", false], [332, 0.012659, " a", false], [32074, 0.011834, " some", false], [38879, 0.007559, " least", false]]]}, "raw_delta": -0.01220703125, "tuned_delta": 0.04188256616507559}, {"byte_start": 1524, "byte_end": 1529, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 265, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "0.61% 0.61% 0.61% 0.61% 0.61%", "model_b": "0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.8444154262542725]], "model_b": [[32251, " time", "normal", 0.8882914781570435]]}, "loss": {"model_a": 0.6128636160026357, "model_b": 0.42266456276043846}, "topk": {"model_a": [32251, 1, 0.8444154262542725, [[32251, 0.844415, " time", false], [31937, 0.053033, " same", false], [21616, 0.030037, " end", false], [59220, 0.008447, " beginning", false], [38887, 0.007236, " level", false], [39801, 0.007233, " start", false], [38676, 0.002994, " heart", false], [22615, 0.002662, " top", false], [3492, 0.00228, " 19", false], [32321, 0.002239, " turn", false]]], "model_b": [32251, 1, 0.8882914781570435, [[32251, 0.888291, " time", false], [31937, 0.019808, " same", false], [21616, 0.013035, " end", false], [59220, 0.009571, " beginning", false], [39801, 0.009118, " start", false], [32321, 0.007707, " turn", false], [31640, 0.003487, " peak", false], [46734, 0.003197, " outset", false], [32386, 0.003116, " very", false], [38676, 0.002897, " heart", false]]]}, "raw_delta": 0.010546874999999997, "tuned_delta": 0.06463647241507559}, {"byte_start": 1529, "byte_end": 1530, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "5.74%", "model_b": "6.59%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.7221240401268005]], "model_b": [[45, ",", "normal", 0.6933923363685608]]}, "loss": {"model_a": 5.741193644162623, "model_b": 6.5865227696835}, "topk": {"model_a": [45, 1, 0.7221240401268005, [[45, 0.722124, ",", false], [4706, 0.075869, " of", false], [32234, 0.037753, " this", false], [22590, 0.032489, " the", false], [4601, 0.026915, " it", false], [32232, 0.017926, " they", false], [32227, 0.015678, " that", false], [39934, 0.009674, " there", false], [20184, 0.008429, " Kas", false], [275, 0.006458, " (", false]]], "model_b": [45, 1, 0.6933923363685608, [[45, 0.693392, ",", false], [4706, 0.062876, " of", false], [4601, 0.036057, " it", false], [22590, 0.033171, " the", false], [32232, 0.02734, " they", false], [32234, 0.018614, " this", false], [39934, 0.014924, " there", false], [20184, 0.011597, " Kas", false], [39936, 0.007837, " these", false], [275, 0.007205, " (", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 1530, "byte_end": 1535, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 266, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "7.33% 7.33% 7.33% 7.33% 7.33%", "model_b": "9.07% 9.07% 9.07% 9.07% 9.07%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.13208968937397003]], "model_b": [[32234, " this", "normal", 0.08076493442058563]]}, "loss": {"model_a": 7.326185754514267, "model_b": 9.073199280590746}, "topk": {"model_a": [32234, 2, 0.13208968937397003, [[22590, 0.208129, " the", false], [32234, 0.13209, " this", false], [4601, 0.096917, " it", false], [32232, 0.045646, " they", false], [39936, 0.038543, " these", false], [39934, 0.036859, " there", false], [4692, 0.019692, " no", false], [32227, 0.018609, " that", false], [332, 0.018595, " a", false], [47202, 0.015894, " search", false]]], "model_b": [32234, 4, 0.08076493442058563, [[22590, 0.168605, " the", false], [30597, 0.089205, " deep", false], [4601, 0.086545, " it", false], [32234, 0.080765, " this", false], [39934, 0.04882, " there", false], [38013, 0.029614, " chess", false], [332, 0.025478, " a", false], [32232, 0.023934, " they", false], [39936, 0.022107, " these", false], [20184, 0.019071, " Kas", false]]]}, "raw_delta": -0.09687500000000004, "tuned_delta": -0.042785402584924456}, {"byte_start": 1535, "byte_end": 1539, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 267, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "2.25% 2.25% 2.25% 2.25%", "model_b": "2.45% 2.45% 2.45% 2.45%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.6059576272964478]], "model_b": [[22748, " was", "normal", 0.5848690867424011]]}, "loss": {"model_a": 2.2454054896648294, "model_b": 2.4479322593208726}, "topk": {"model_a": [22748, 1, 0.6059576272964478, [[22748, 0.605958, " was", false], [47211, 0.052989, " seemed", false], [55532, 0.040104, " approach", false], [46561, 0.028907, " method", false], [63841, 0.017092, " represented", false], [57101, 0.014504, " required", false], [31351, 0.011846, " made", false], [47202, 0.011302, " search", false], [38990, 0.011119, " meant", false], [21795, 0.011076, " had", false]]], "model_b": [22748, 1, 0.5848690867424011, [[22748, 0.584869, " was", false], [47211, 0.074655, " seemed", false], [55532, 0.069503, " approach", false], [46561, 0.040694, " method", false], [38990, 0.025845, " meant", false], [57101, 0.011126, " required", false], [55526, 0.008592, " appeared", false], [56500, 0.008464, " involved", false], [21795, 0.007449, " had", false], [57317, 0.007054, " strategy", false]]]}, "raw_delta": -0.01123046875, "tuned_delta": 0.04285912866507559}, {"byte_start": 1539, "byte_end": 1546, "display": {"text": " looked", "kind": "normal"}, "is_word": true, "word_id": 268, "word_key": " looked", "bytes_hex": "20 6c 6f 6f 6b 65 64", "compression": {"model_a": "22.86% 22.86% 22.86% 22.86% 22.86% 22.86% 22.86%", "model_b": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"model_a": [[46471, " looked", "normal", 0.00014063648995943367]], "model_b": [[46471, " looked", "normal", 0.000245631264988333]]}, "loss": {"model_a": 22.864140156945616, "model_b": 21.415004513195548}, "topk": {"model_a": [46471, 291, 0.00014063648995943367, [[22590, 0.209277, " the", false], [332, 0.169261, " a", false], [61755, 0.094635, " considered", false], [31968, 0.039652, " seen", false], [4419, 0.03881, " an", false], [53137, 0.033443, " thought", false], [22187, 0.029644, " not", false], [57059, 0.019155, " regarded", false], [47724, 0.012689, " viewed", false], [22168, 0.011154, " new", false]]], "model_b": [46471, 212, 0.000245631264988333, [[22590, 0.322581, " the", false], [61755, 0.118709, " considered", false], [332, 0.114969, " a", false], [22187, 0.043919, " not", false], [4419, 0.032908, " an", false], [31968, 0.027952, " seen", false], [53137, 0.018634, " thought", false], [39820, 0.017794, " still", false], [22226, 0.014862, " one", false], [57059, 0.012958, " regarded", false]]]}, "raw_delta": 0.0803571428571428, "tuned_delta": 0.13444674027221837}, {"byte_start": 1546, "byte_end": 1551, "display": {"text": " upon", "kind": "normal"}, "is_word": true, "word_id": 269, "word_key": " upon", "bytes_hex": "20 75 70 6f 6e", "compression": {"model_a": "3.24% 3.24% 3.24% 3.24% 3.24%", "model_b": "3.48% 3.48% 3.48% 3.48% 3.48%"}, "model_tokens": {"model_a": [[32350, " upon", "normal", 0.4067184627056122]], "model_b": [[32350, " upon", "normal", 0.3809601664543152]]}, "loss": {"model_a": 3.240428314496695, "model_b": 3.4799382333942765}, "topk": {"model_a": [32350, 1, 0.4067184627056122, [[32350, 0.406718, " upon", false], [4424, 0.29206, " at", false], [4712, 0.264328, " on", false], [30678, 0.013842, " down", false], [4811, 0.006693, " to", false], [4423, 0.004043, " as", false], [4833, 0.001548, " up", false], [4450, 0.001287, " by", false], [30218, 0.001161, " back", false], [21295, 0.001024, " ask", false]]], "model_b": [32350, 1, 0.3809601664543152, [[32350, 0.38096, " upon", false], [4424, 0.283228, " at", false], [4712, 0.194202, " on", false], [30678, 0.119559, " down", false], [4811, 0.007383, " to", false], [4423, 0.006153, " as", false], [4833, 0.001904, " up", false], [51791, 0.000624, " forward", false], [31296, 0.000575, " like", false], [30218, 0.000413, " back", false]]]}, "raw_delta": -0.013281249999999994, "tuned_delta": 0.040808347415075594}, {"byte_start": 1551, "byte_end": 1556, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 270, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "7.13% 7.13% 7.13% 7.13% 7.13%", "model_b": "12.74% 12.74% 12.74% 12.74% 12.74%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.13835200667381287]], "model_b": [[32487, " with", "normal", 0.029233908280730247]]}, "loss": {"model_a": 7.128942291892729, "model_b": 12.73629215784788}, "topk": {"model_a": [32487, 2, 0.13835200667381287, [[4423, 0.711724, " as", false], [32487, 0.138352, " with", false], [4450, 0.068183, " by", false], [60512, 0.034853, " skeptical", false], [4596, 0.005076, " in", false], [38458, 0.003401, " favor", false], [57263, 0.002588, " somewhat", false], [45, 0.002395, ",", false], [62624, 0.002145, " suspicious", false], [21295, 0.001884, " ask", false]]], "model_b": [32487, 2, 0.029233908280730247, [[4423, 0.928999, " as", false], [32487, 0.029234, " with", false], [4450, 0.016074, " by", false], [4596, 0.003217, " in", false], [45, 0.001906, ",", false], [45145, 0.001605, " almost", false], [60512, 0.001346, " skeptical", false], [31296, 0.001105, " like", false], [31458, 0.001053, " more", false], [38458, 0.000934, " favor", false]]]}, "raw_delta": -0.31093750000000003, "tuned_delta": -0.25684790258492446}, {"byte_start": 1556, "byte_end": 1563, "display": {"text": " dismay", "kind": "normal"}, "is_word": true, "word_id": 271, "word_key": " dismay", "bytes_hex": "20 64 69 73 6d 61 79", "compression": {"model_a": "13.44% 13.44% 13.44% 13.44% 13.44% 13.44% 13.44%", "model_b": "13.69% 13.69% 13.69% 13.69% 13.69% 13.69% 13.69%"}, "model_tokens": {"model_a": [[45756, " dismay", "normal", 0.005509744398295879]], "model_b": [[45756, " dismay", "normal", 0.004998579155653715]]}, "loss": {"model_a": 13.444758472570138, "model_b": 13.686281079861814}, "topk": {"model_a": [45756, 19, 0.005509744398295879, [[62561, 0.263272, " skepticism", false], [60609, 0.212474, " suspicion", false], [32074, 0.077677, " some", false], [21542, 0.051934, " dis", false], [332, 0.044298, " a", false], [46271, 0.026665, " incred", false], [38629, 0.024728, " great", false], [39608, 0.02181, " scorn", false], [39599, 0.017621, " scept", false], [21523, 0.016758, " der", false]]], "model_b": [45756, 32, 0.004998579155653715, [[62561, 0.163547, " skepticism", false], [32074, 0.113671, " some", false], [60609, 0.107019, " suspicion", false], [38629, 0.092827, " great", false], [21542, 0.038367, " dis", false], [332, 0.037108, " a", false], [64313, 0.025357, " considerable", false], [46218, 0.014064, " horror", false], [21316, 0.011455, " awe", false], [55845, 0.010842, " contempt", false]]]}, "raw_delta": -0.013392857142857095, "tuned_delta": 0.04069674027221849}, {"byte_start": 1563, "byte_end": 1566, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 272, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "5.57% 5.57% 5.57%", "model_b": "8.27% 8.27% 8.27%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.3952583074569702]], "model_b": [[4450, " by", "normal", 0.2501745820045471]]}, "loss": {"model_a": 5.565083409679106, "model_b": 8.265440338426352}, "topk": {"model_a": [4450, 1, 0.3952583074569702, [[4450, 0.395258, " by", false], [45, 0.190716, ",", false], [4423, 0.147753, " as", false], [47, 0.083341, ".", false], [51018, 0.051481, " because", false], [21265, 0.030159, " and", false], [4596, 0.017165, " in", false], [59, 0.016393, ":", false], [60, 0.01203, ";", false], [30917, 0.008852, " from", false]]], "model_b": [4450, 2, 0.2501745820045471, [[45, 0.256069, ",", false], [4450, 0.250175, " by", false], [47, 0.182905, ".", false], [4423, 0.096965, " as", false], [21265, 0.054841, " and", false], [51018, 0.045416, " because", false], [60, 0.024543, ";", false], [59, 0.019208, ":", false], [39690, 0.008086, " since", false], [4596, 0.008085, " in", false]]]}, "raw_delta": -0.14973958333333331, "tuned_delta": -0.09564998591825773}, {"byte_start": 1566, "byte_end": 1570, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 273, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.68% 7.68% 7.68% 7.68%", "model_b": "6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.18160317838191986]], "model_b": [[22590, " the", "normal", 0.22167043387889862]]}, "loss": {"model_a": 7.678406223481298, "model_b": 6.833077097960421}, "topk": {"model_a": [22590, 2, 0.18160317838191986, [[31370, 0.205778, " many", false], [22590, 0.181603, " the", false], [39944, 0.082015, " those", false], [32074, 0.077888, " some", false], [38013, 0.076814, " chess", false], [38720, 0.068789, " human", false], [31461, 0.026712, " most", false], [20184, 0.021205, " Kas", false], [332, 0.015787, " a", false], [55809, 0.013672, " computer", false]]], "model_b": [22590, 2, 0.22167043387889862, [[31370, 0.238927, " many", false], [22590, 0.22167, " the", false], [31461, 0.050329, " most", false], [63843, 0.049521, " researchers", false], [55809, 0.041588, " computer", false], [39944, 0.03926, " those", false], [3609, 0.037528, " AI", false], [38013, 0.033535, " chess", false], [32074, 0.030523, " some", false], [39193, 0.021712, " other", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.10096459741507559}, {"byte_start": 1570, "byte_end": 1579, "display": {"text": " majority", "kind": "normal"}, "is_word": true, "word_id": 274, "word_key": " majority", "bytes_hex": "20 6d 61 6a 6f 72 69 74 79", "compression": {"model_a": "10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39%", "model_b": "8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95%"}, "model_tokens": {"model_a": [[56573, " majority", "normal", 0.005612103268504143]], "model_b": [[56573, " majority", "normal", 0.01159416139125824]]}, "loss": {"model_a": 10.394417395293745, "model_b": 8.954227033295215}, "topk": {"model_a": [56573, 21, 0.005612103268504143, [[38720, 0.170913, " human", false], [38013, 0.169576, " chess", false], [38621, 0.076005, " grand", false], [55809, 0.05481, " computer", false], [40213, 0.036494, " world", false], [51685, 0.02337, " experts", false], [3609, 0.019848, " AI", false], [22615, 0.019308, " top", false], [45929, 0.018355, " expert", false], [59324, 0.017437, " community", false]]], "model_b": [56573, 12, 0.01159416139125824, [[38013, 0.179964, " chess", false], [3609, 0.111599, " AI", false], [51832, 0.069374, " general", false], [59324, 0.051628, " community", false], [57103, 0.028455, " research", false], [55809, 0.028226, " computer", false], [40213, 0.024895, " world", false], [38478, 0.024589, " field", false], [51093, 0.016281, " broader", false], [40192, 0.0127, " wider", false]]]}, "raw_delta": 0.07986111111111105, "tuned_delta": 0.13395070852618662}, {"byte_start": 1579, "byte_end": 1582, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 275, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.12% 0.12% 0.12%", "model_b": "0.11% 0.11% 0.11%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9806281328201294]], "model_b": [[4706, " of", "normal", 0.9813337922096252]]}, "loss": {"model_a": 0.11740682298901069, "model_b": 0.11373785977060409}, "topk": {"model_a": [4706, 1, 0.9806281328201294, [[4706, 0.980628, " of", false], [45, 0.004248, ",", false], [47, 0.002026, ".", false], [4596, 0.001685, " in", false], [22762, 0.001408, " who", false], [59324, 0.001187, " community", false], [38013, 0.001015, " chess", false], [3609, 0.000869, " AI", false], [52367, 0.000761, " opinion", false], [275, 0.000644, " (", false]]], "model_b": [4706, 1, 0.9813337922096252, [[4706, 0.981334, " of", false], [4596, 0.005802, " in", false], [45, 0.002662, ",", false], [47, 0.001357, ".", false], [47806, 0.000969, " within", false], [275, 0.000954, " (", false], [22762, 0.000922, " who", false], [3609, 0.00063, " AI", false], [55809, 0.000551, " computer", false], [38013, 0.000403, " chess", false]]]}, "raw_delta": 0.0002034505208333339, "tuned_delta": 0.054293047935908924}, {"byte_start": 1582, "byte_end": 1591, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 276, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%", "model_b": "4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.09370432049036026]], "model_b": [[55809, " computer", "normal", 0.1303100883960724]]}, "loss": {"model_a": 4.727581405690829, "model_b": 4.07010319695237}, "topk": {"model_a": [55809, 4, 0.09370432049036026, [[3609, 0.243718, " AI", false], [38013, 0.221257, " chess", false], [22590, 0.216489, " the", false], [55809, 0.093704, " computer", false], [63843, 0.072572, " researchers", false], [46787, 0.022371, " people", false], [51685, 0.015295, " experts", false], [38720, 0.01309, " human", false], [52489, 0.010965, " players", false], [39944, 0.008059, " those", false]]], "model_b": [55809, 4, 0.1303100883960724, [[22590, 0.201404, " the", false], [63843, 0.157741, " researchers", false], [3609, 0.143625, " AI", false], [55809, 0.13031, " computer", false], [38013, 0.120347, " chess", false], [52489, 0.035217, " players", false], [46787, 0.019959, " people", false], [64985, 0.009807, " practitioners", false], [51685, 0.009569, " experts", false], [30941, 0.008987, " game", false]]]}, "raw_delta": 0.03645833333333334, "tuned_delta": 0.09054793074840893}, {"byte_start": 1591, "byte_end": 1592, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "55.79%", "model_b": "81.15%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.04488632455468178]], "model_b": [[46, "-", "normal", 0.011165601201355457]]}, "loss": {"model_a": 55.791722284377876, "model_b": 81.15159605000419}, "topk": {"model_a": [46, 3, 0.04488632455468178, [[38013, 0.620857, " chess", false], [62532, 0.155146, " scientists", false], [46, 0.044886, "-", false], [51685, 0.036822, " experts", false], [52489, 0.027644, " players", false], [63794, 0.026189, " programmers", false], [52814, 0.023006, " science", false], [63843, 0.012672, " researchers", false], [3609, 0.006459, " AI", false], [30941, 0.003699, " game", false]]], "model_b": [46, 7, 0.011165601201355457, [[62532, 0.389449, " scientists", false], [38013, 0.360814, " chess", false], [63843, 0.079742, " researchers", false], [52489, 0.040172, " players", false], [52814, 0.031204, " science", false], [63794, 0.011788, " programmers", false], [46, 0.011166, "-", false], [51685, 0.009555, " experts", false], [60455, 0.007517, " scientist", false], [30941, 0.00607, " game", false]]]}, "raw_delta": -1.40625, "tuned_delta": -1.3521604025849243}, {"byte_start": 1592, "byte_end": 1596, "display": {"text": "ches", "kind": "normal"}, "is_word": true, "word_id": 277, "word_key": "ches", "bytes_hex": "63 68 65 73", "compression": {"model_a": "8.28% 8.28% 8.28% 8.28%", "model_b": "15.00% 15.00% 15.00% 15.00%"}, "model_tokens": {"model_a": [[24991, "ches", "normal", 0.15904244780540466]], "model_b": [[24991, "ches", "normal", 0.03575974702835083]]}, "loss": {"model_a": 8.277181020725253, "model_b": 15.004591977995565}, "topk": {"model_a": [24991, 2, 0.15904244780540466, [[49551, 0.35995, "playing", false], [24991, 0.159042, "ches", false], [6954, 0.122666, "aid", false], [33914, 0.034658, "assis", false], [41394, 0.029402, "expert", false], [49589, 0.02906, "program", false], [34580, 0.025387, "human", false], [49685, 0.024675, "science", false], [25478, 0.024462, "game", false], [820, 0.016222, "AI", false]]], "model_b": [24991, 6, 0.03575974702835083, [[49685, 0.390986, "science", false], [49551, 0.181108, "playing", false], [42227, 0.074327, "scient", false], [25478, 0.040748, "game", false], [26697, 0.035996, "play", false], [24991, 0.03576, "ches", false], [54309, 0.025151, "research", false], [34011, 0.019083, "based", false], [34580, 0.013956, "human", false], [26679, 0.012147, "phil", false]]]}, "raw_delta": -0.373046875, "tuned_delta": -0.3189572775849244}, {"byte_start": 1596, "byte_end": 1597, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 278, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.03%", "model_b": "0.01%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9983900785446167]], "model_b": [[116, "s", "normal", 0.9993035793304443]]}, "loss": {"model_a": 0.029305843707022588, "model_b": 0.012520336982812467}, "topk": {"model_a": [116, 1, 0.9983900785446167, [[116, 0.99839, "s", false], [8739, 0.000568, "spl", false], [2194, 0.000297, "ss", false], [2177, 0.000233, "sb", false], [2188, 8.6e-05, "sm", false], [27027, 7.5e-05, "sing", false], [8741, 6.9e-05, "spr", false], [2182, 3.9e-05, "sg", false], [8705, 3.8e-05, "ses", false], [2178, 1.8e-05, "sc", false]]], "model_b": [116, 1, 0.9993035793304443, [[116, 0.999304, "s", false], [2188, 0.000229, "sm", false], [2177, 0.000126, "sb", false], [2182, 6.4e-05, "sg", false], [8741, 4e-05, "spr", false], [2194, 3.1e-05, "ss", false], [2187, 2.3e-05, "sl", false], [2180, 2.3e-05, "se", false], [8701, 1.6e-05, "sen", false], [8705, 1.4e-05, "ses", false]]]}, "raw_delta": 0.0009307861328125, "tuned_delta": 0.05502038354788809}, {"byte_start": 1597, "byte_end": 1609, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 279, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37%", "model_b": "0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.7792559862136841]], "model_b": [[63843, " researchers", "normal", 0.5922250151634216]]}, "loss": {"model_a": 0.37129907770274634, "model_b": 0.7924960551758221}, "topk": {"model_a": [63843, 1, 0.7792559862136841, [[63843, 0.779256, " researchers", false], [51685, 0.079981, " experts", false], [52489, 0.038938, " players", false], [63533, 0.015383, " enthusiasts", false], [64985, 0.010136, " practitioners", false], [57103, 0.008909, " research", false], [46, 0.007441, "-", false], [46787, 0.007054, " people", false], [63874, 0.005711, " specialists", false], [30819, 0.003354, " fans", false]]], "model_b": [63843, 1, 0.5922250151634216, [[63843, 0.592225, " researchers", false], [52489, 0.169155, " players", false], [51685, 0.052896, " experts", false], [57103, 0.03933, " research", false], [64985, 0.021939, " practitioners", false], [63533, 0.016064, " enthusiasts", false], [63874, 0.008368, " specialists", false], [57166, 0.006502, " scholars", false], [62532, 0.006161, " scientists", false], [39933, 0.006021, " theor", false]]]}, "raw_delta": -0.023356119791666668, "tuned_delta": 0.03073347762340892}, {"byte_start": 1609, "byte_end": 1613, "display": {"text": " who", "kind": "normal"}, "is_word": true, "word_id": 280, "word_key": " who", "bytes_hex": "20 77 68 6f", "compression": {"model_a": "12.89% 12.89% 12.89% 12.89%", "model_b": "13.88% 13.88% 13.88% 13.88%"}, "model_tokens": {"model_a": [[22762, " who", "normal", 0.05782460421323776]], "model_b": [[22762, " who", "normal", 0.04473256319761276]]}, "loss": {"model_a": 12.891269164193373, "model_b": 13.877486477301062}, "topk": {"model_a": [22762, 3, 0.05782460421323776, [[45, 0.493104, ",", false], [47, 0.262916, ".", false], [22762, 0.057825, " who", false], [4423, 0.048434, " as", false], [51018, 0.044163, " because", false], [275, 0.017412, " (", false], [59, 0.014396, ":", false], [60, 0.013908, ";", false], [21265, 0.011592, " and", false], [4596, 0.007335, " in", false]]], "model_b": [22762, 4, 0.04473256319761276, [[45, 0.411418, ",", false], [47, 0.336056, ".", false], [51018, 0.052242, " because", false], [22762, 0.044733, " who", false], [21265, 0.035172, " and", false], [275, 0.024918, " (", false], [60, 0.014226, ";", false], [4423, 0.014027, " as", false], [59, 0.012054, ":", false], [4596, 0.00984, " in", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 1613, "byte_end": 1617, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 281, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"model_a": "8.81% 8.81% 8.81% 8.81%", "model_b": "9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[21795, " had", "normal", 0.14216969907283783]], "model_b": [[21795, " had", "normal", 0.1189601868391037]]}, "loss": {"model_a": 8.805511724175801, "model_b": 9.580396755903271}, "topk": {"model_a": [21795, 1, 0.14216969907283783, [[21795, 0.14217, " had", false], [55616, 0.139973, " believed", false], [32462, 0.124577, " were", false], [53137, 0.103935, " thought", false], [30840, 0.040844, " felt", false], [22439, 0.028225, " saw", false], [60227, 0.02457, " preferred", false], [45, 0.021214, ",", false], [56175, 0.017539, " expected", false], [39820, 0.015485, " still", false]]], "model_b": [21795, 3, 0.1189601868391037, [[32462, 0.16967, " were", false], [55616, 0.128779, " believed", false], [21795, 0.11896, " had", false], [22439, 0.054735, " saw", false], [30840, 0.053712, " felt", false], [53137, 0.034973, " thought", false], [45196, 0.02776, " argued", false], [45, 0.026086, ",", false], [50970, 0.013834, " assumed", false], [31220, 0.012617, " knew", false]]]}, "raw_delta": -0.04296875, "tuned_delta": 0.011120847415075588}, {"byte_start": 1617, "byte_end": 1625, "display": {"text": " pursued", "kind": "normal"}, "is_word": true, "word_id": 282, "word_key": " pursued", "bytes_hex": "20 70 75 72 73 75 65 64", "compression": {"model_a": "13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10%", "model_b": "13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31%"}, "model_tokens": {"model_a": [[52611, " pursued", "normal", 0.002957211807370186]], "model_b": [[52611, " pursued", "normal", 0.0026982815470546484]]}, "loss": {"model_a": 13.102601445573592, "model_b": 13.313933726953811}, "topk": {"model_a": [52611, 46, 0.002957211807370186, [[30259, 0.249961, " been", false], [39762, 0.085795, " spent", false], [62367, 0.072542, " previously", false], [30482, 0.02922, " come", false], [55616, 0.024881, " believed", false], [47812, 0.024567, " worked", false], [56495, 0.023266, " invested", false], [53137, 0.020698, " thought", false], [22187, 0.017016, " not", false], [38709, 0.015475, " hoped", false]]], "model_b": [52611, 51, 0.0026982815470546484, [[30259, 0.213605, " been", false], [39762, 0.058563, " spent", false], [22187, 0.043365, " not", false], [62367, 0.028677, " previously", false], [30482, 0.021782, " come", false], [56495, 0.018974, " invested", false], [47812, 0.018181, " worked", false], [4692, 0.018102, " no", false], [59506, 0.018033, " developed", false], [31323, 0.016603, " long", false]]]}, "raw_delta": -0.01171875, "tuned_delta": 0.04237084741507559}, {"byte_start": 1625, "byte_end": 1633, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 283, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "model_b": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.07155764102935791]], "model_b": [[52224, " methods", "normal", 0.050028473138809204]]}, "loss": {"model_a": 5.952525925542842, "model_b": 6.762633004167015}, "topk": {"model_a": [52224, 4, 0.07155764102935791, [[22590, 0.188231, " the", false], [332, 0.132115, " a", false], [39193, 0.079462, " other", false], [52224, 0.071558, " methods", false], [31458, 0.042285, " more", false], [63277, 0.028887, " alternative", false], [4419, 0.024123, " an", false], [38720, 0.017514, " human", false], [47202, 0.014367, " search", false], [53265, 0.012634, " various", false]]], "model_b": [52224, 6, 0.050028473138809204, [[22590, 0.125305, " the", false], [332, 0.076052, " a", false], [31458, 0.066069, " more", false], [51832, 0.065335, " general", false], [32234, 0.05527, " this", false], [52224, 0.050028, " methods", false], [30597, 0.034191, " deep", false], [39931, 0.030091, " their", false], [39193, 0.026121, " other", false], [52906, 0.015227, " similar", false]]]}, "raw_delta": -0.044921875, "tuned_delta": 0.009167722415075588}, {"byte_start": 1633, "byte_end": 1638, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 284, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "4.93% 4.93% 4.93% 4.93% 4.93%", "model_b": "3.86% 3.86% 3.86% 3.86% 3.86%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.25757429003715515]], "model_b": [[32227, " that", "normal", 0.34694546461105347]]}, "loss": {"model_a": 4.931086565538449, "model_b": 3.860336339878671}, "topk": {"model_a": [32227, 2, 0.25757429003715515, [[37810, 0.371391, " based", false], [32227, 0.257574, " that", false], [4706, 0.072435, " of", false], [59927, 0.030102, " involving", false], [21700, 0.021525, " for", false], [52700, 0.018955, " relying", false], [31296, 0.01863, " like", false], [38888, 0.018359, " lever", false], [4596, 0.017246, " in", false], [32139, 0.016944, " such", false]]], "model_b": [32227, 1, 0.34694546461105347, [[32227, 0.346945, " that", false], [37810, 0.271595, " based", false], [4706, 0.056618, " of", false], [32487, 0.029409, " with", false], [4596, 0.019025, " in", false], [31458, 0.0179, " more", false], [21700, 0.01674, " for", false], [31296, 0.016564, " like", false], [40085, 0.012471, " using", false], [38888, 0.011837, " lever", false]]]}, "raw_delta": 0.05937500000000001, "tuned_delta": 0.1134645974150756}, {"byte_start": 1638, "byte_end": 1647, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 285, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"model_a": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "model_b": "1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94%"}, "model_tokens": {"model_a": [[56540, " leverage", "normal", 0.12110395729541779]], "model_b": [[56540, " leverage", "normal", 0.3794272840023041]]}, "loss": {"model_a": 4.226645627604385, "model_b": 1.9411261400849762}, "topk": {"model_a": [56540, 2, 0.12110395729541779, [[32462, 0.139173, " were", false], [56540, 0.121104, " leverage", false], [47054, 0.084049, " relied", false], [32354, 0.059584, " used", false], [56500, 0.033754, " involved", false], [59685, 0.027754, " exploited", false], [21532, 0.027139, " did", false], [31351, 0.024597, " made", false], [40219, 0.021734, " would", false], [47340, 0.020651, " sought", false]]], "model_b": [56540, 1, 0.3794272840023041, [[56540, 0.379427, " leverage", false], [32462, 0.113895, " were", false], [47054, 0.10193, " relied", false], [32354, 0.043574, " used", false], [21532, 0.02552, " did", false], [32272, 0.018492, " took", false], [51770, 0.01579, " focused", false], [31351, 0.013913, " made", false], [21795, 0.009582, " had", false], [40219, 0.008678, " would", false]]]}, "raw_delta": 0.12673611111111113, "tuned_delta": 0.18082570852618673}, {"byte_start": 1647, "byte_end": 1648, "display": {"text": "d", "kind": "normal"}, "is_word": true, "word_id": 286, "word_key": "d", "bytes_hex": "64", "compression": {"model_a": "0.26%", "model_b": "0.46%"}, "model_tokens": {"model_a": [[101, "d", "normal", 0.9858278036117554]], "model_b": [[101, "d", "normal", 0.9749835133552551]]}, "loss": {"model_a": 0.25866190689766416, "model_b": 0.4556852317260977}, "topk": {"model_a": [101, 1, 0.9858278036117554, [[101, 0.985828, "d", false], [38720, 0.006589, " human", false], [22590, 0.001635, " the", false], [59943, 0.000991, " knowledge", false], [63370, 0.000662, " computation", false], [64862, 0.000325, " computational", false], [39931, 0.000181, " their", false], [55809, 0.000165, " computer", false], [51832, 0.000119, " general", false], [59683, 0.00011, " expertise", false]]], "model_b": [101, 1, 0.9749835133552551, [[101, 0.974984, "d", false], [51832, 0.004531, " general", false], [63370, 0.002212, " computation", false], [22590, 0.001893, " the", false], [30597, 0.001431, " deep", false], [64862, 0.001376, " computational", false], [52167, 0.000691, " machine", false], [38720, 0.000458, " human", false], [63637, 0.000299, " information", false], [332, 0.00029, " a", false]]]}, "raw_delta": -0.01092529296875, "tuned_delta": 0.04316430444632559}, {"byte_start": 1648, "byte_end": 1654, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 287, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "1.54% 1.54% 1.54% 1.54% 1.54% 1.54%", "model_b": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.5997323393821716]], "model_b": [[38720, " human", "normal", 0.05400249734520912]]}, "loss": {"model_a": 1.53802938115604, "model_b": 8.735067630382394}, "topk": {"model_a": [38720, 1, 0.5997323393821716, [[38720, 0.599732, " human", false], [59943, 0.064163, " knowledge", false], [22590, 0.057836, " the", false], [39931, 0.05362, " their", false], [45775, 0.020474, " domain", false], [51832, 0.015236, " general", false], [332, 0.013627, " a", false], [38013, 0.009546, " chess", false], [55809, 0.009065, " computer", false], [59792, 0.007936, " heuristic", false]]], "model_b": [38720, 4, 0.05400249734520912, [[51832, 0.401834, " general", false], [22590, 0.057332, " the", false], [63370, 0.054984, " computation", false], [38720, 0.054002, " human", false], [52167, 0.027703, " machine", false], [65135, 0.019297, " generalization", false], [64862, 0.011803, " computational", false], [59943, 0.01075, " knowledge", false], [332, 0.010695, " a", false], [3609, 0.009757, " AI", false]]]}, "raw_delta": -0.3990885416666667, "tuned_delta": -0.3449989442515911}, {"byte_start": 1654, "byte_end": 1668, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 288, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"model_a": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "model_b": "8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41%"}, "model_tokens": {"model_a": [[65034, " understanding", "normal", 0.0055396584793925285]], "model_b": [[65034, " understanding", "normal", 0.0014373342273756862]]}, "loss": {"model_a": 6.6821254684031235, "model_b": 8.41303748732682}, "topk": {"model_a": [65034, 5, 0.0055396584793925285, [[59943, 0.883994, " knowledge", false], [59683, 0.025255, " expertise", false], [46, 0.022538, "-", false], [38013, 0.013486, " chess", false], [65034, 0.00554, " understanding", false], [59917, 0.003281, " intuition", false], [62418, 0.003033, " psychology", false], [52022, 0.002299, " insight", false], [45929, 0.00215, " expert", false], [45775, 0.00209, " domain", false]]], "model_b": [65034, 14, 0.0014373342273756862, [[59943, 0.816923, " knowledge", false], [46, 0.067215, "-", false], [59683, 0.014032, " expertise", false], [64452, 0.009651, " intelligence", false], [59917, 0.007247, " intuition", false], [63637, 0.004447, " information", false], [61979, 0.003726, " experience", false], [52022, 0.002728, " insight", false], [59304, 0.002613, " cognition", false], [56537, 0.002583, " learning", false]]]}, "raw_delta": -0.09598214285714282, "tuned_delta": -0.04189254544206723}, {"byte_start": 1668, "byte_end": 1671, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 289, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "3.71% 3.71% 3.71%", "model_b": "7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.5453326106071472]], "model_b": [[4706, " of", "normal", 0.26915931701660156]]}, "loss": {"model_a": 3.7100556064527375, "model_b": 7.889738504861517}, "topk": {"model_a": [4706, 1, 0.5453326106071472, [[4706, 0.545333, " of", false], [47, 0.215073, ".", false], [45, 0.072792, ",", false], [21265, 0.057871, " and", false], [275, 0.021519, " (", false], [4596, 0.017123, " in", false], [4811, 0.01344, " to", false], [4715, 0.00484, " or", false], [59, 0.004384, ":", false], [47001, 0.003393, " rather", false]]], "model_b": [4706, 2, 0.26915931701660156, [[47, 0.328782, ".", false], [4706, 0.269159, " of", false], [21265, 0.083946, " and", false], [45, 0.082692, ",", false], [275, 0.027502, " (", false], [4596, 0.025475, " in", false], [4811, 0.019659, " to", false], [4715, 0.018249, " or", false], [21700, 0.01557, " for", false], [4423, 0.01339, " as", false]]]}, "raw_delta": -0.23177083333333334, "tuned_delta": -0.17768123591825774}, {"byte_start": 1671, "byte_end": 1675, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 290, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.02% 2.02% 2.02% 2.02%", "model_b": "1.18% 1.18% 1.18% 1.18%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.6395004987716675]], "model_b": [[22590, " the", "normal", 0.7714414000511169]]}, "loss": {"model_a": 2.0164621848362585, "model_b": 1.1799385710395573}, "topk": {"model_a": [22590, 1, 0.6395004987716675, [[22590, 0.6395, " the", false], [38013, 0.250885, " chess", false], [30941, 0.013298, " game", false], [38576, 0.009768, " games", false], [21835, 0.008793, " how", false], [57317, 0.005117, " strategy", false], [31702, 0.00386, " play", false], [32464, 0.003629, " what", false], [39072, 0.003538, " moves", false], [60563, 0.003109, " strategic", false]]], "model_b": [22590, 1, 0.7714414000511169, [[22590, 0.771441, " the", false], [38013, 0.046475, " chess", false], [30941, 0.020286, " game", false], [56893, 0.018627, " position", false], [57317, 0.012533, " strategy", false], [31702, 0.009473, " play", false], [38576, 0.009262, " games", false], [332, 0.006674, " a", false], [37876, 0.005909, " board", false], [39558, 0.005212, " rules", false]]]}, "raw_delta": 0.04638671875, "tuned_delta": 0.10047631616507559}, {"byte_start": 1675, "byte_end": 1683, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 291, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "22.96% 22.96% 22.96% 22.96% 22.96% 22.96% 22.96% 22.96%", "model_b": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 3.7776739191031083e-05]], "model_b": [[52964, " special", "normal", 2.5096107492572628e-05]]}, "loss": {"model_a": 22.96477457665049, "model_b": 23.810103702171368}, "topk": {"model_a": [52964, 207, 3.7776739191031083e-05, [[30941, 0.776871, " game", false], [45775, 0.113485, " domain", false], [38013, 0.020491, " chess", false], [39558, 0.008626, " rules", false], [56893, 0.007699, " position", false], [37876, 0.006084, " board", false], [52569, 0.005186, " problem", false], [60572, 0.003166, " structure", false], [46642, 0.003003, " nature", false], [60563, 0.002563, " strategic", false]]], "model_b": [52964, 436, 2.5096107492572628e-05, [[30941, 0.715762, " game", false], [37876, 0.066386, " board", false], [39558, 0.035551, " rules", false], [38013, 0.02766, " chess", false], [45775, 0.014098, " domain", false], [52569, 0.011543, " problem", false], [56893, 0.007312, " position", false], [40213, 0.005, " world", false], [46817, 0.003451, " pieces", false], [38576, 0.003092, " games", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 1683, "byte_end": 1693, "display": {"text": " structure", "kind": "normal"}, "is_word": true, "word_id": 292, "word_key": " structure", "bytes_hex": "20 73 74 72 75 63 74 75 72 65", "compression": {"model_a": "3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16%", "model_b": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"model_a": [[60572, " structure", "normal", 0.17478929460048676]], "model_b": [[60572, " structure", "normal", 0.060184232890605927]]}, "loss": {"model_a": 3.1558954019446075, "model_b": 5.0437971156079}, "topk": {"model_a": [60572, 2, 0.17478929460048676, [[56215, 0.198867, " features", false], [60572, 0.174789, " structure", false], [62404, 0.108107, " properties", false], [65258, 0.088162, " characteristics", false], [46642, 0.078605, " nature", false], [30405, 0.046773, " case", false], [50964, 0.030504, " aspects", false], [39558, 0.022449, " rules", false], [64847, 0.014595, " circumstances", false], [59943, 0.014528, " knowledge", false]]], "model_b": [60572, 4, 0.060184232890605927, [[62404, 0.11079, " properties", false], [34889, 0.077093, "ities", false], [46642, 0.062547, " nature", false], [60572, 0.060184, " structure", false], [39558, 0.059902, " rules", false], [56215, 0.047721, " features", false], [38013, 0.027587, " chess", false], [27161, 0.024018, "ties", false], [45775, 0.015063, " domain", false], [60310, 0.014582, " qualities", false]]]}, "raw_delta": -0.10468750000000002, "tuned_delta": -0.05059790258492443}, {"byte_start": 1693, "byte_end": 1696, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 293, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.54% 0.54% 0.54%", "model_b": "0.48% 0.48% 0.48%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9133241176605225]], "model_b": [[4706, " of", "normal", 0.923256516456604]]}, "loss": {"model_a": 0.5430065563241744, "model_b": 0.47843280368021857}, "topk": {"model_a": [4706, 1, 0.9133241176605225, [[4706, 0.913324, " of", false], [21265, 0.05389, " and", false], [32227, 0.007661, " that", false], [4596, 0.007532, " in", false], [45, 0.002641, ",", false], [275, 0.001931, " (", false], [52544, 0.001214, " present", false], [4715, 0.000954, " or", false], [56454, 0.000948, " inherent", false], [56500, 0.00066, " involved", false]]], "model_b": [4706, 1, 0.923256516456604, [[4706, 0.923257, " of", false], [21265, 0.036511, " and", false], [32227, 0.010164, " that", false], [4596, 0.002904, " in", false], [56454, 0.002826, " inherent", false], [45, 0.002201, ",", false], [275, 0.001743, " (", false], [22590, 0.001614, " the", false], [38013, 0.00106, " chess", false], [4715, 0.001009, " or", false]]]}, "raw_delta": 0.0035807291666666644, "tuned_delta": 0.05767032658174225}, {"byte_start": 1696, "byte_end": 1702, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 294, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "model_b": "4.09% 4.09% 4.09% 4.09% 4.09% 4.09%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.4181702733039856]], "model_b": [[38013, " chess", "normal", 0.25466564297676086]]}, "loss": {"model_a": 2.618172152654938, "model_b": 4.085757440017572}, "topk": {"model_a": [38013, 2, 0.4181702733039856, [[22590, 0.476079, " the", false], [38013, 0.41817, " chess", false], [332, 0.012555, " a", false], [37876, 0.011526, " board", false], [32234, 0.01071, " this", false], [38576, 0.009492, " games", false], [32227, 0.005553, " that", false], [55809, 0.003802, " computer", false], [60202, 0.002747, " positions", false], [30941, 0.002439, " game", false]]], "model_b": [38013, 2, 0.25466564297676086, [[22590, 0.56385, " the", false], [38013, 0.254666, " chess", false], [38576, 0.035104, " games", false], [332, 0.01491, " a", false], [37876, 0.011707, " board", false], [55809, 0.011664, " computer", false], [38720, 0.00731, " human", false], [30941, 0.006544, " game", false], [3609, 0.004476, " AI", false], [31702, 0.003471, " play", false]]]}, "raw_delta": -0.08138020833333336, "tuned_delta": -0.02729061091825777}, {"byte_start": 1702, "byte_end": 1703, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "15.92%", "model_b": "17.26%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.4152854382991791]], "model_b": [[47, ".", "normal", 0.38291752338409424]]}, "loss": {"model_a": 15.920365197309849, "model_b": 17.25880297938457}, "topk": {"model_a": [47, 1, 0.4152854382991791, [[47, 0.415285, ".", false], [45, 0.138868, ",", false], [275, 0.060483, " (", false], [60202, 0.059551, " positions", false], [21265, 0.052644, " and", false], [4423, 0.038024, " as", false], [38576, 0.034104, " games", false], [56939, 0.02069, " problems", false], [4811, 0.015186, " to", false], [52616, 0.013291, " puzzles", false]]], "model_b": [47, 1, 0.38291752338409424, [[47, 0.382918, ".", false], [45, 0.076759, ",", false], [38576, 0.063028, " games", false], [56939, 0.043073, " problems", false], [21265, 0.033888, " and", false], [41111, 0.032912, "boards", false], [46817, 0.031298, " pieces", false], [45323, 0.027287, " boards", false], [60202, 0.026045, " positions", false], [275, 0.024962, " (", false]]]}, "raw_delta": -0.07421875, "tuned_delta": -0.020129152584924412}, {"byte_start": 1703, "byte_end": 1708, "display": {"text": " When", "kind": "normal"}, "is_word": true, "word_id": 295, "word_key": " when", "bytes_hex": "20 57 68 65 6e", "compression": {"model_a": "17.92% 17.92% 17.92% 17.92% 17.92%", "model_b": "17.02% 17.02% 17.02% 17.02% 17.02%"}, "model_tokens": {"model_a": [[30032, " When", "normal", 0.007001301273703575]], "model_b": [[30032, " When", "normal", 0.009000157937407494]]}, "loss": {"model_a": 17.92097746104259, "model_b": 17.019293060486987}, "topk": {"model_a": [30032, 27, 0.007001301273703575, [[20996, 0.146973, " The", false], [19555, 0.095088, " But", false], [3913, 0.06269, " In", false], [29894, 0.038998, " This", false], [3918, 0.035124, " It", false], [267, 0.033548, "  ", false], [37453, 0.028921, " These", false], [29893, 0.026198, " They", false], [275, 0.022298, " (", false], [50318, 0.022143, " However", false]]], "model_b": [30032, 25, 0.009000157937407494, [[20996, 0.113969, " The", false], [3913, 0.065387, " In", false], [19555, 0.043658, " But", false], [267, 0.042033, "  ", false], [3918, 0.041936, " It", false], [37453, 0.034238, " These", false], [29894, 0.03365, " This", false], [50318, 0.031169, " However", false], [20184, 0.025309, " Kas", false], [28753, 0.024741, " Deep", false]]]}, "raw_delta": 0.050000000000000044, "tuned_delta": 0.10408959741507563}, {"byte_start": 1708, "byte_end": 1710, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 296, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "30.57% 30.57%", "model_b": "34.52% 34.52%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.033543530851602554]], "model_b": [[332, " a", "normal", 0.02141929417848587]]}, "loss": {"model_a": 30.572736706338382, "model_b": 34.51760595876914}, "topk": {"model_a": [332, 5, 0.033543530851602554, [[22590, 0.200279, " the", false], [20184, 0.119217, " Kas", false], [28753, 0.053023, " Deep", false], [4601, 0.051405, " it", false], [332, 0.033544, " a", false], [39936, 0.026697, " these", false], [36274, 0.025618, " Alpha", false], [39944, 0.02499, " those", false], [32234, 0.021867, " this", false], [32227, 0.018636, " that", false]]], "model_b": [332, 8, 0.02141929417848587, [[20184, 0.277196, " Kas", false], [22590, 0.151481, " the", false], [30597, 0.041223, " deep", false], [4601, 0.037948, " it", false], [28753, 0.03538, " Deep", false], [45, 0.034691, ",", false], [32232, 0.029424, " they", false], [332, 0.021419, " a", false], [308, 0.014752, " I", false], [39936, 0.014356, " these", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 1710, "byte_end": 1718, "display": {"text": " simpler", "kind": "normal"}, "is_word": true, "word_id": 297, "word_key": " simpler", "bytes_hex": "20 73 69 6d 70 6c 65 72", "compression": {"model_a": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "model_b": "19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"model_a": [[52907, " simpler", "normal", 0.0012639120686799288]], "model_b": [[52907, " simpler", "normal", 0.00019978224008809775]]}, "loss": {"model_a": 15.075036071788972, "model_b": 19.160793511806542}, "topk": {"model_a": [52907, 83, 0.0012639120686799288, [[55809, 0.076037, " computer", false], [46561, 0.075533, " method", false], [52167, 0.063921, " machine", false], [38013, 0.061223, " chess", false], [38720, 0.060972, " human", false], [30597, 0.060776, " deep", false], [52580, 0.052468, " program", false], [51832, 0.038626, " general", false], [22168, 0.034404, " new", false], [47202, 0.027246, " search", false]]], "model_b": [52907, 396, 0.00019978224008809775, [[22168, 0.103321, " new", false], [55809, 0.099264, " computer", false], [30597, 0.056972, " deep", false], [46561, 0.045211, " method", false], [52167, 0.035499, " machine", false], [38013, 0.029512, " chess", false], [38720, 0.027306, " human", false], [31458, 0.019629, " more", false], [38961, 0.018938, " major", false], [51832, 0.017536, " general", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17247290258492443}, {"byte_start": 1718, "byte_end": 1719, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "33.25%", "model_b": "23.81%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.15707261860370636]], "model_b": [[45, ",", "normal", 0.26743805408477783]]}, "loss": {"model_a": 33.24961227048782, "model_b": 23.810103702171368}, "topk": {"model_a": [45, 2, 0.15707261860370636, [[46561, 0.473748, " method", false], [45, 0.157073, ",", false], [55532, 0.071119, " approach", false], [47202, 0.038367, " search", false], [21265, 0.029981, " and", false], [51832, 0.021128, " general", false], [21400, 0.014595, " but", false], [53275, 0.01257, " version", false], [47487, 0.011231, " system", false], [30597, 0.009506, " deep", false]]], "model_b": [45, 2, 0.26743805408477783, [[46561, 0.294779, " method", false], [45, 0.267438, ",", false], [55532, 0.112626, " approach", false], [21265, 0.048414, " and", false], [51832, 0.031431, " general", false], [21400, 0.021933, " but", false], [59113, 0.021109, " algorithm", false], [47202, 0.015975, " search", false], [275, 0.013305, " (", false], [57260, 0.011113, " solution", false]]]}, "raw_delta": 0.5234375, "tuned_delta": 0.5775270974150756}, {"byte_start": 1719, "byte_end": 1726, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 298, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "model_b": "19.89% 19.89% 19.89% 19.89% 19.89% 19.89% 19.89%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.009499076753854752]], "model_b": [[47202, " search", "normal", 0.00044600284309126437]]}, "loss": {"model_a": 11.99562282882006, "model_b": 19.88536133368158}, "topk": {"model_a": [47202, 16, 0.009499076753854752, [[31458, 0.185807, " more", false], [38720, 0.093854, " human", false], [51832, 0.084545, " general", false], [31277, 0.073223, " less", false], [21400, 0.064149, " but", false], [45961, 0.045475, " faster", false], [52873, 0.028926, " shallow", false], [45301, 0.019571, " better", false], [45683, 0.018277, " deeper", false], [37920, 0.01491, " brute", false]]], "model_b": [47202, 156, 0.00044600284309126437, [[31458, 0.317712, " more", false], [51832, 0.106312, " general", false], [31277, 0.059871, " less", false], [21400, 0.055849, " but", false], [45961, 0.04364, " faster", false], [21265, 0.026223, " and", false], [22797, 0.015498, " yet", false], [38720, 0.01088, " human", false], [59792, 0.008391, " heuristic", false], [45301, 0.008278, " better", false]]]}, "raw_delta": -0.4375, "tuned_delta": -0.3834104025849244}, {"byte_start": 1726, "byte_end": 1727, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "0.74%", "model_b": "1.57%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.9595441222190857]], "model_b": [[46, "-", "normal", 0.9168814420700073]]}, "loss": {"model_a": 0.7440657406928552, "model_b": 1.5673810869032927}, "topk": {"model_a": [46, 1, 0.9595441222190857, [[46, 0.959544, "-", false], [37810, 0.006754, " based", false], [46561, 0.006426, " method", false], [26127, 0.005095, "less", false], [35003, 0.002918, "light", false], [45862, 0.001671, " engine", false], [34011, 0.001429, "based", false], [31277, 0.00105, " less", false], [32298, 0.001029, " tree", false], [55532, 0.001023, " approach", false]]], "model_b": [46, 1, 0.9168814420700073, [[46, 0.916881, "-", false], [46561, 0.011624, " method", false], [37810, 0.011594, " based", false], [59113, 0.005844, " algorithm", false], [52224, 0.00497, " methods", false], [32227, 0.004775, " that", false], [55532, 0.00411, " approach", false], [24381, 0.002834, "able", false], [45862, 0.002399, " engine", false], [57317, 0.002092, " strategy", false]]]}, "raw_delta": -0.045654296875, "tuned_delta": 0.008435300540075588}, {"byte_start": 1727, "byte_end": 1732, "display": {"text": "based", "kind": "normal"}, "is_word": true, "word_id": 299, "word_key": "based", "bytes_hex": "62 61 73 65 64", "compression": {"model_a": "0.96% 0.96% 0.96% 0.96% 0.96%", "model_b": "1.62% 1.62% 1.62% 1.62% 1.62%"}, "model_tokens": {"model_a": [[34011, "based", "normal", 0.7661516070365906]], "model_b": [[34011, "based", "normal", 0.6380438804626465]]}, "loss": {"model_a": 0.9580396755903271, "model_b": 1.6202141572483475}, "topk": {"model_a": [34011, 1, 0.7661516070365906, [[34011, 0.766152, "based", false], [25457, 0.064083, "free", false], [26127, 0.021186, "less", false], [35003, 0.016261, "light", false], [63067, 0.011975, "independent", false], [54208, 0.01078, "oriented", false], [34547, 0.010126, "heavy", false], [26476, 0.008524, "only", false], [41273, 0.008247, "driven", false], [26148, 0.004807, "like", false]]], "model_b": [34011, 1, 0.6380438804626465, [[34011, 0.638044, "based", false], [54208, 0.063643, "oriented", false], [25457, 0.041241, "free", false], [26476, 0.026925, "only", false], [26148, 0.020739, "like", false], [63067, 0.013724, "independent", false], [41273, 0.012811, "driven", false], [26127, 0.009199, "less", false], [25885, 0.00899, "inte", false], [7005, 0.006184, "and", false]]]}, "raw_delta": -0.03671875, "tuned_delta": 0.017370847415075587}, {"byte_start": 1732, "byte_end": 1741, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 300, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%", "model_b": "1.93% 1.93% 1.93% 1.93% 1.93% 1.93% 1.93% 1.93% 1.93%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.21413181722164154]], "model_b": [[55532, " approach", "normal", 0.3847121596336365]]}, "loss": {"model_a": 3.0838858838446805, "model_b": 1.9254718970197753}, "topk": {"model_a": [55532, 2, 0.21413181722164154, [[46561, 0.566179, " method", false], [55532, 0.214132, " approach", false], [47487, 0.037443, " system", false], [52580, 0.021893, " program", false], [45, 0.020486, ",", false], [57260, 0.017414, " solution", false], [3609, 0.01615, " AI", false], [38013, 0.01427, " chess", false], [55809, 0.011896, " computer", false], [59113, 0.00571, " algorithm", false]]], "model_b": [55532, 2, 0.3847121596336365, [[46561, 0.393174, " method", false], [55532, 0.384712, " approach", false], [57260, 0.038307, " solution", false], [59113, 0.036864, " algorithm", false], [45, 0.030598, ",", false], [57317, 0.016332, " strategy", false], [60624, 0.009455, " technique", false], [3609, 0.007399, " AI", false], [47487, 0.006233, " system", false], [37636, 0.003592, " agent", false]]]}, "raw_delta": 0.06423611111111112, "tuned_delta": 0.11832570852618671}, {"byte_start": 1741, "byte_end": 1746, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 301, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "20.06% 20.06% 20.06% 20.06% 20.06%", "model_b": "17.36% 17.36% 17.36% 17.36% 17.36%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.0038757920265197754]], "model_b": [[32487, " with", "normal", 0.00800991989672184]]}, "loss": {"model_a": 20.062477912362148, "model_b": 17.35742471069534}, "topk": {"model_a": [32487, 34, 0.0038757920265197754, [[22748, 0.135995, " was", false], [22777, 0.104854, " won", false], [30256, 0.064874, " beat", false], [55934, 0.064274, " defeated", false], [51744, 0.052972, " finally", false], [61959, 0.042262, " eventually", false], [4811, 0.036133, " to", false], [45, 0.032198, ",", false], [32227, 0.026997, " that", false], [30383, 0.019303, " came", false]]], "model_b": [32487, 16, 0.00800991989672184, [[22748, 0.262088, " was", false], [4811, 0.112621, " to", false], [51585, 0.054368, " emerged", false], [45, 0.046672, ",", false], [45283, 0.044148, " became", false], [32227, 0.041936, " that", false], [22777, 0.036684, " won", false], [275, 0.026816, " (", false], [55526, 0.022837, " appeared", false], [30383, 0.022727, " came", false]]]}, "raw_delta": 0.15000000000000002, "tuned_delta": 0.2040895974150756}, {"byte_start": 1746, "byte_end": 1754, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 302, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "17.33% 17.33% 17.33% 17.33% 17.33% 17.33% 17.33% 17.33%", "model_b": "17.82% 17.82% 17.82% 17.82% 17.82% 17.82% 17.82% 17.82%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 0.0004496047622524202]], "model_b": [[52964, " special", "normal", 0.00037118809996172786]]}, "loss": {"model_a": 17.329247073177978, "model_b": 17.82235572973182}, "topk": {"model_a": [52964, 194, 0.0004496047622524202, [[332, 0.191682, " a", false], [22590, 0.048645, " the", false], [38720, 0.038933, " human", false], [31277, 0.036428, " less", false], [30597, 0.034435, " deep", false], [31466, 0.025209, " much", false], [52906, 0.023126, " similar", false], [4692, 0.018722, " no", false], [52195, 0.017973, " massive", false], [4419, 0.017767, " an", false]]], "model_b": [52964, 184, 0.00037118809996172786, [[332, 0.159359, " a", false], [38475, 0.086012, " fewer", false], [31277, 0.052147, " less", false], [4692, 0.051379, " no", false], [22590, 0.050115, " the", false], [45301, 0.035831, " better", false], [31466, 0.031467, " much", false], [52906, 0.02818, " similar", false], [31458, 0.020756, " more", false], [38940, 0.01794, " lower", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.026745847415075588}, {"byte_start": 1754, "byte_end": 1763, "display": {"text": " hardware", "kind": "normal"}, "is_word": true, "word_id": 303, "word_key": " hardware", "bytes_hex": "20 68 61 72 64 77 61 72 65", "compression": {"model_a": "7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86%", "model_b": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90%"}, "model_tokens": {"model_a": [[56353, " hardware", "normal", 0.01969507336616516]], "model_b": [[56353, " hardware", "normal", 0.0043007913045585155]]}, "loss": {"model_a": 7.858430018731115, "model_b": 10.89535317338019}, "topk": {"model_a": [56353, 10, 0.01969507336616516, [[46, 0.136974, "-", false], [52224, 0.067794, " methods", false], [59943, 0.043138, " knowledge", false], [60572, 0.043045, " structure", false], [62586, 0.037339, " structures", false], [39558, 0.033567, " rules", false], [59792, 0.0335, " heuristic", false], [56215, 0.025575, " features", false], [62633, 0.024171, " techniques", false], [56353, 0.019695, " hardware", false]]], "model_b": [56353, 31, 0.0043007913045585155, [[60572, 0.171321, " structure", false], [62586, 0.087438, " structures", false], [52224, 0.057636, " methods", false], [46, 0.050602, "-", false], [38530, 0.023692, " focus", false], [59943, 0.021365, " knowledge", false], [47202, 0.018668, " search", false], [59193, 0.018073, " attention", false], [62633, 0.016228, " techniques", false], [38013, 0.014433, " chess", false]]]}, "raw_delta": -0.1684027777777777, "tuned_delta": -0.11431318036270212}, {"byte_start": 1763, "byte_end": 1767, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 304, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "15.50% 15.50% 15.50% 15.50%", "model_b": "15.29% 15.29% 15.29% 15.29%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.0321439653635025]], "model_b": [[21265, " and", "normal", 0.03388107940554619]]}, "loss": {"model_a": 15.49770063454941, "model_b": 15.286368353169191}, "topk": {"model_a": [21265, 7, 0.0321439653635025, [[22777, 0.162071, " won", false], [22748, 0.136268, " was", false], [55934, 0.077032, " defeated", false], [275, 0.048254, " (", false], [45, 0.045464, ",", false], [51744, 0.042829, " finally", false], [21265, 0.032144, " and", false], [61959, 0.026994, " eventually", false], [30256, 0.026825, " beat", false], [38128, 0.019286, " could", false]]], "model_b": [21265, 5, 0.03388107940554619, [[22748, 0.28274, " was", false], [275, 0.044154, " (", false], [4811, 0.040128, " to", false], [45283, 0.035154, " became", false], [21265, 0.033881, " and", false], [46, 0.033335, "-", false], [53061, 0.031648, " support", false], [45, 0.025696, ",", false], [21700, 0.019143, " for", false], [46936, 0.014153, " proved", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06580834741507559}, {"byte_start": 1767, "byte_end": 1776, "display": {"text": " software", "kind": "normal"}, "is_word": true, "word_id": 305, "word_key": " software", "bytes_hex": "20 73 6f 66 74 77 61 72 65", "compression": {"model_a": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "model_b": "4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07%"}, "model_tokens": {"model_a": [[57257, " software", "normal", 0.12066756188869476]], "model_b": [[57257, " software", "normal", 0.13186407089233398]]}, "loss": {"model_a": 4.226645627604385, "model_b": 4.07010319695237}, "topk": {"model_a": [57257, 1, 0.12066756188869476, [[57257, 0.120668, " software", false], [332, 0.091038, " a", false], [52195, 0.040955, " massive", false], [38720, 0.033452, " human", false], [59988, 0.025548, " massively", false], [52964, 0.019492, " special", false], [31044, 0.019435, " hand", false], [4419, 0.017655, " an", false], [45301, 0.015361, " better", false], [31458, 0.013354, " more", false]]], "model_b": [57257, 1, 0.13186407089233398, [[57257, 0.131864, " software", false], [332, 0.066141, " a", false], [61559, 0.030557, " algorithms", false], [57453, 0.028081, " training", false], [59792, 0.020743, " heuristic", false], [52964, 0.02005, " special", false], [48, 0.019917, "/", false], [46543, 0.016586, " memory", false], [4419, 0.016197, " an", false], [31277, 0.016106, " less", false]]]}, "raw_delta": 0.008680555555555552, "tuned_delta": 0.06277015297063114}, {"byte_start": 1776, "byte_end": 1783, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 306, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"model_a": "12.08% 12.08% 12.08% 12.08% 12.08% 12.08% 12.08%", "model_b": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"model_a": [[46936, " proved", "normal", 0.009227147325873375]], "model_b": [[46936, " proved", "normal", 0.012738101184368134]]}, "loss": {"model_a": 12.076130364583953, "model_b": 11.271055006945026}, "topk": {"model_a": [46936, 17, 0.009227147325873375, [[22748, 0.155735, " was", false], [22777, 0.145421, " won", false], [55934, 0.076917, " defeated", false], [45, 0.048027, ",", false], [275, 0.037139, " (", false], [30256, 0.03504, " beat", false], [51744, 0.032274, " finally", false], [32227, 0.028484, " that", false], [61959, 0.026472, " eventually", false], [38128, 0.021097, " could", false]]], "model_b": [46936, 11, 0.012738101184368134, [[22748, 0.354254, " was", false], [45283, 0.046469, " became", false], [4811, 0.032448, " to", false], [275, 0.028201, " (", false], [39979, 0.026726, " tools", false], [45, 0.02208, ",", false], [32227, 0.017431, " that", false], [55526, 0.017131, " appeared", false], [51585, 0.015257, " emerged", false], [53061, 0.014258, " support", false]]]}, "raw_delta": 0.044642857142857095, "tuned_delta": 0.09873245455793268}, {"byte_start": 1783, "byte_end": 1790, "display": {"text": " vastly", "kind": "normal"}, "is_word": true, "word_id": 307, "word_key": " vastly", "bytes_hex": "20 76 61 73 74 6c 79", "compression": {"model_a": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%", "model_b": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%"}, "model_tokens": {"model_a": [[47708, " vastly", "normal", 0.012812004424631596]], "model_b": [[47708, " vastly", "normal", 0.004485932644456625]]}, "loss": {"model_a": 11.271055006945026, "model_b": 13.927803687153498}, "topk": {"model_a": [47708, 17, 0.012812004424631596, [[4811, 0.272015, " to", false], [57350, 0.142239, " superior", false], [31458, 0.050594, " more", false], [62603, 0.03392, " successful", false], [51127, 0.033284, " capable", false], [32227, 0.031712, " that", false], [32393, 0.025362, " vict", false], [59593, 0.02474, " effective", false], [22590, 0.022994, " the", false], [46342, 0.018988, " itself", false]]], "model_b": [47708, 30, 0.004485932644456625, [[4811, 0.282824, " to", false], [57350, 0.133951, " superior", false], [31458, 0.054105, " more", false], [62603, 0.043361, " successful", false], [59593, 0.038328, " effective", false], [63362, 0.032364, " competitive", false], [46342, 0.03008, " itself", false], [45301, 0.018392, " better", false], [31466, 0.013856, " much", false], [21660, 0.011682, " far", false]]]}, "raw_delta": -0.1473214285714286, "tuned_delta": -0.09323183115635301}, {"byte_start": 1790, "byte_end": 1795, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 308, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "3.72% 3.72% 3.72% 3.72% 3.72%", "model_b": "4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.3574398159980774]], "model_b": [[31458, " more", "normal", 0.25460779666900635]]}, "loss": {"model_a": 3.719448152291858, "model_b": 4.959264203055811}, "topk": {"model_a": [31458, 2, 0.3574398159980774, [[57350, 0.515153, " superior", false], [31458, 0.35744, " more", false], [45301, 0.07177, " better", false], [45961, 0.014264, " faster", false], [57326, 0.013514, " stronger", false], [59593, 0.003661, " effective", false], [22249, 0.002475, " out", false], [62603, 0.001708, " successful", false], [39855, 0.001371, " super", false], [56445, 0.001241, " inferior", false]]], "model_b": [31458, 2, 0.25460779666900635, [[57350, 0.627075, " superior", false], [31458, 0.254608, " more", false], [45301, 0.041448, " better", false], [45961, 0.022155, " faster", false], [56445, 0.018065, " inferior", false], [31277, 0.006526, " less", false], [45819, 0.004167, " easier", false], [22249, 0.003186, " out", false], [62603, 0.003038, " successful", false], [59593, 0.001678, " effective", false]]]}, "raw_delta": -0.06875000000000003, "tuned_delta": -0.014660402584924445}, {"byte_start": 1795, "byte_end": 1805, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 309, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"model_a": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18%", "model_b": "1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03% 1.03%"}, "model_tokens": {"model_a": [[59593, " effective", "normal", 0.5193632245063782]], "model_b": [[59593, " effective", "normal", 0.5633891224861145]]}, "loss": {"model_a": 1.183460775729228, "model_b": 1.0284837693837334}, "topk": {"model_a": [59593, 1, 0.5193632245063782, [[59593, 0.519363, " effective", false], [56900, 0.248142, " powerful", false], [62603, 0.087465, " successful", false], [51127, 0.040674, " capable", false], [59594, 0.032189, " efficient", false], [63362, 0.009723, " competitive", false], [47129, 0.005053, " robust", false], [55435, 0.004777, " accurate", false], [46876, 0.004775, " potent", false], [59330, 0.003539, " competent", false]]], "model_b": [59593, 1, 0.5633891224861145, [[59593, 0.563389, " effective", false], [56900, 0.168002, " powerful", false], [59594, 0.105435, " efficient", false], [62603, 0.047855, " successful", false], [51127, 0.016481, " capable", false], [60274, 0.012893, " promising", false], [63362, 0.010467, " competitive", false], [47687, 0.003955, " useful", false], [60212, 0.003923, " practical", false], [64862, 0.003827, " computational", false]]]}, "raw_delta": 0.008593750000000006, "tuned_delta": 0.0626833474150756}, {"byte_start": 1805, "byte_end": 1806, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "11.83%", "model_b": "6.66%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.517075777053833]], "model_b": [[45, ",", "normal", 0.6937479972839355]]}, "loss": {"model_a": 11.834607757292277, "model_b": 6.656966863476906}, "topk": {"model_a": [45, 1, 0.517075777053833, [[45, 0.517076, ",", false], [32226, 0.318234, " than", false], [4596, 0.058019, " in", false], [4424, 0.033092, " at", false], [275, 0.013151, " (", false], [50870, 0.010288, " against", false], [21265, 0.006574, " and", false], [21700, 0.005527, " for", false], [4712, 0.005304, " on", false], [32227, 0.003332, " that", false]]], "model_b": [45, 1, 0.6937479972839355, [[45, 0.693748, ",", false], [4596, 0.098073, " in", false], [32226, 0.04286, " than", false], [4424, 0.028521, " at", false], [275, 0.02546, " (", false], [50870, 0.019577, " against", false], [21265, 0.019316, " and", false], [21700, 0.00614, " for", false], [332, 0.00529, " a", false], [4712, 0.004795, " on", false]]]}, "raw_delta": 0.287109375, "tuned_delta": 0.3411989724150756}, {"byte_start": 1806, "byte_end": 1812, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 310, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "10.24% 10.24% 10.24% 10.24% 10.24% 10.24%", "model_b": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.03285355120897293]], "model_b": [[39936, " these", "normal", 0.03961408883333206]]}, "loss": {"model_a": 10.237874964641732, "model_b": 9.721284943490085}, "topk": {"model_a": [39936, 7, 0.03285355120897293, [[22590, 0.291234, " the", false], [4601, 0.146537, " it", false], [31370, 0.061791, " many", false], [39934, 0.045832, " there", false], [32234, 0.039601, " this", false], [32232, 0.037792, " they", false], [39936, 0.032854, " these", false], [39944, 0.03154, " those", false], [332, 0.024274, " a", false], [32074, 0.02115, " some", false]]], "model_b": [39936, 4, 0.03961408883333206, [[22590, 0.25007, " the", false], [4601, 0.133875, " it", false], [31370, 0.072151, " many", false], [39936, 0.039614, " these", false], [39934, 0.037539, " there", false], [32234, 0.034635, " this", false], [31461, 0.033444, " most", false], [20184, 0.028804, " Kas", false], [32232, 0.02692, " they", false], [32074, 0.024456, " some", false]]]}, "raw_delta": 0.02864583333333337, "tuned_delta": 0.08273543074840896}, {"byte_start": 1812, "byte_end": 1818, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 311, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "model_b": "17.85% 17.85% 17.85% 17.85% 17.85% 17.85%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.03081255406141281]], "model_b": [[38720, " human", "normal", 0.002575174206867814]]}, "loss": {"model_a": 10.472688610619752, "model_b": 17.845837094329625}, "topk": {"model_a": [38720, 3, 0.03081255406141281, [[63843, 0.426013, " researchers", false], [52224, 0.145729, " methods", false], [38720, 0.030813, " human", false], [61590, 0.030591, " approaches", false], [31937, 0.027987, " same", false], [46787, 0.018104, " people", false], [55809, 0.012532, " computer", false], [32462, 0.011953, " were", false], [39193, 0.011745, " other", false], [31458, 0.010867, " more", false]]], "model_b": [38720, 30, 0.002575174206867814, [[52224, 0.294994, " methods", false], [63843, 0.230355, " researchers", false], [30597, 0.043903, " deep", false], [61590, 0.040176, " approaches", false], [46787, 0.027628, " people", false], [55809, 0.015556, " computer", false], [38013, 0.011606, " chess", false], [38328, 0.011196, " early", false], [32462, 0.009702, " were", false], [3609, 0.009312, " AI", false]]]}, "raw_delta": -0.4088541666666668, "tuned_delta": -0.3547645692515912}, {"byte_start": 1818, "byte_end": 1819, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "2.48%", "model_b": "8.45%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.871780276298523]], "model_b": [[46, "-", "normal", 0.6294569373130798]]}, "loss": {"model_a": 2.483154306217576, "model_b": 8.45329125520877}, "topk": {"model_a": [46, 1, 0.871780276298523, [[46, 0.87178, "-", false], [25971, 0.030047, "ists", false], [38013, 0.012634, " chess", false], [51685, 0.011814, " experts", false], [52224, 0.010909, " methods", false], [7919, 0.010518, "ist", false], [61590, 0.007997, " approaches", false], [47202, 0.00402, " search", false], [59943, 0.00399, " knowledge", false], [63843, 0.003556, " researchers", false]]], "model_b": [46, 1, 0.6294569373130798, [[46, 0.629457, "-", false], [25971, 0.142219, "ists", false], [38013, 0.032485, " chess", false], [59943, 0.021338, " knowledge", false], [63843, 0.01812, " researchers", false], [7919, 0.016074, "ist", false], [61590, 0.010422, " approaches", false], [52224, 0.009925, " methods", false], [65034, 0.008619, " understanding", false], [51685, 0.008555, " experts", false]]]}, "raw_delta": -0.3310546875, "tuned_delta": -0.2769650900849244}, {"byte_start": 1819, "byte_end": 1828, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 312, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%", "model_b": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.6595557928085327]], "model_b": [[58313, "knowledge", "normal", 0.7668314576148987]]}, "loss": {"model_a": 0.8375020039882761, "model_b": 0.5322442642168485}, "topk": {"model_a": [58313, 1, 0.6595557928085327, [[58313, 0.659556, "knowledge", false], [34011, 0.048856, "based", false], [42430, 0.044636, "unders", false], [24991, 0.039186, "ches", false], [54208, 0.029457, "oriented", false], [48948, 0.016421, "centric", false], [49161, 0.014498, "focused", false], [42233, 0.012124, "search", false], [41394, 0.010531, "expert", false], [26085, 0.00788, "know", false]]], "model_b": [58313, 1, 0.7668314576148987, [[58313, 0.766831, "knowledge", false], [34011, 0.041142, "based", false], [26085, 0.023295, "know", false], [48948, 0.01716, "centric", false], [42430, 0.009332, "unders", false], [54208, 0.00607, "oriented", false], [26249, 0.005736, "mind", false], [25116, 0.004976, "deep", false], [42233, 0.004694, "search", false], [49161, 0.004595, "focused", false]]]}, "raw_delta": 0.01692708333333334, "tuned_delta": 0.07101668074840893}, {"byte_start": 1828, "byte_end": 1829, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "30.57%", "model_b": "35.22%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.18554151058197021]], "model_b": [[46, "-", "normal", 0.1419229507446289]]}, "loss": {"model_a": 30.572736706338382, "model_b": 35.222046896703205}, "topk": {"model_a": [46, 3, 0.18554151058197021, [[52224, 0.265552, " methods", false], [61590, 0.238326, " approaches", false], [46, 0.185542, "-", false], [63843, 0.142978, " researchers", false], [37810, 0.066875, " based", false], [56777, 0.00802, " oriented", false], [51685, 0.006366, " experts", false], [38013, 0.00614, " chess", false], [55532, 0.003715, " approach", false], [59099, 0.003218, " advocates", false]]], "model_b": [46, 3, 0.1419229507446289, [[61590, 0.257604, " approaches", false], [52224, 0.167675, " methods", false], [46, 0.141923, "-", false], [37810, 0.111287, " based", false], [63843, 0.079599, " researchers", false], [38677, 0.015488, " heavy", false], [30597, 0.013888, " deep", false], [55532, 0.011655, " approach", false], [56777, 0.010638, " oriented", false], [52489, 0.007347, " players", false]]]}, "raw_delta": -0.2578125, "tuned_delta": -0.20372290258492443}, {"byte_start": 1829, "byte_end": 1834, "display": {"text": "based", "kind": "normal"}, "is_word": true, "word_id": 313, "word_key": "based", "bytes_hex": "62 61 73 65 64", "compression": {"model_a": "1.56% 1.56% 1.56% 1.56% 1.56%", "model_b": "1.32% 1.32% 1.32% 1.32% 1.32%"}, "model_tokens": {"model_a": [[34011, "based", "normal", 0.6482729315757751]], "model_b": [[34011, "based", "normal", 0.6929730772972107]]}, "loss": {"model_a": 1.5638588822136221, "model_b": 1.3173045539366999}, "topk": {"model_a": [34011, 1, 0.6482729315757751, [[34011, 0.648273, "based", false], [54208, 0.073196, "oriented", false], [8080, 0.052624, "lev", false], [49161, 0.029072, "focused", false], [58213, 0.022318, "dependent", false], [41273, 0.01721, "driven", false], [33841, 0.015847, "appro", false], [8067, 0.007389, "led", false], [26996, 0.006059, "seek", false], [26476, 0.006058, "only", false]]], "model_b": [34011, 1, 0.6929730772972107, [[34011, 0.692973, "based", false], [54208, 0.074928, "oriented", false], [41273, 0.03485, "driven", false], [34547, 0.030014, "heavy", false], [49161, 0.019685, "focused", false], [48948, 0.009336, "centric", false], [34048, 0.005276, "bound", false], [25885, 0.004887, "inte", false], [54087, 0.004764, "inspired", false], [8287, 0.003383, "obs", false]]]}, "raw_delta": 0.013671875, "tuned_delta": 0.06776147241507559}, {"byte_start": 1834, "byte_end": 1840, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 314, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04%", "model_b": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.025300495326519012]], "model_b": [[38013, " chess", "normal", 0.02617591992020607]]}, "loss": {"model_a": 11.036241360967004, "model_b": 10.9892786317714}, "topk": {"model_a": [38013, 4, 0.025300495326519012, [[52224, 0.373073, " methods", false], [63843, 0.289508, " researchers", false], [61590, 0.210366, " approaches", false], [38013, 0.0253, " chess", false], [47202, 0.007561, " search", false], [3609, 0.006943, " AI", false], [57103, 0.006204, " research", false], [55809, 0.006163, " computer", false], [51685, 0.005402, " experts", false], [45, 0.004026, ",", false]]], "model_b": [38013, 4, 0.02617591992020607, [[52224, 0.485095, " methods", false], [61590, 0.257207, " approaches", false], [63843, 0.067374, " researchers", false], [38013, 0.026176, " chess", false], [52489, 0.016462, " players", false], [62633, 0.010713, " techniques", false], [30597, 0.009821, " deep", false], [3609, 0.008671, " AI", false], [53087, 0.008155, " systems", false], [57103, 0.007313, " research", false]]]}, "raw_delta": 0.0026041666666666297, "tuned_delta": 0.05669376408174222}, {"byte_start": 1840, "byte_end": 1852, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 315, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%", "model_b": "2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.6872232556343079]], "model_b": [[63843, " researchers", "normal", 0.23710738122463226]]}, "loss": {"model_a": 0.5606175797725259, "model_b": 2.172026225296697}, "topk": {"model_a": [63843, 1, 0.6872232556343079, [[63843, 0.687223, " researchers", false], [52224, 0.09212, " methods", false], [51685, 0.042066, " experts", false], [46, 0.034204, "-", false], [61590, 0.023681, " approaches", false], [3609, 0.022106, " AI", false], [52489, 0.013138, " players", false], [56949, 0.012948, " programs", false], [57103, 0.009412, " research", false], [63874, 0.004496, " specialists", false]]], "model_b": [63843, 1, 0.23710738122463226, [[63843, 0.237107, " researchers", false], [52489, 0.171122, " players", false], [52224, 0.131196, " methods", false], [46, 0.050691, "-", false], [51685, 0.046105, " experts", false], [51616, 0.038815, " engines", false], [57103, 0.024134, " research", false], [56949, 0.023432, " programs", false], [59283, 0.01467, " champions", false], [61559, 0.013536, " algorithms", false]]]}, "raw_delta": -0.08935546875, "tuned_delta": -0.03526587133492441}, {"byte_start": 1852, "byte_end": 1857, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 316, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "4.90% 4.90% 4.90% 4.90% 4.90%", "model_b": "4.62% 4.62% 4.62% 4.62% 4.62%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.25559622049331665]], "model_b": [[32462, " were", "normal", 0.27910637855529785]]}, "loss": {"model_a": 4.902908928021086, "model_b": 4.62113255284746}, "topk": {"model_a": [32462, 1, 0.25559622049331665, [[32462, 0.255596, " were", false], [21795, 0.046323, " had", false], [21532, 0.023956, " did", false], [45, 0.022912, ",", false], [38547, 0.016735, " found", false], [30840, 0.016341, " felt", false], [31334, 0.012921, " lost", false], [60419, 0.012504, " retreated", false], [38435, 0.012385, " faced", false], [52628, 0.011966, " quickly", false]]], "model_b": [32462, 1, 0.27910637855529785, [[32462, 0.279106, " were", false], [45283, 0.037378, " became", false], [45, 0.026684, ",", false], [30840, 0.023213, " felt", false], [37828, 0.02265, " began", false], [21795, 0.021619, " had", false], [38547, 0.020005, " found", false], [47638, 0.016447, " turned", false], [52628, 0.016357, " quickly", false], [22439, 0.010692, " saw", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 1857, "byte_end": 1861, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 317, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "13.95% 13.95% 13.95% 13.95%", "model_b": "18.60% 18.60% 18.60% 18.60%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.04509412869811058]], "model_b": [[22187, " not", "normal", 0.016034794971346855]]}, "loss": {"model_a": 13.947930571094469, "model_b": 18.597240761459293}, "topk": {"model_a": [22187, 4, 0.04509412869811058, [[32053, 0.1306, " slow", false], [46021, 0.06047, " forced", false], [31269, 0.045305, " left", false], [22187, 0.045094, " not", false], [62683, 0.027402, " understand", false], [39418, 0.026169, " quick", false], [47650, 0.017289, " unable", false], [60601, 0.01446, " surprised", false], [39820, 0.013581, " still", false], [45, 0.013549, ",", false]]], "model_b": [22187, 8, 0.016034794971346855, [[31269, 0.065372, " left", false], [45756, 0.063213, " dismay", false], [52885, 0.043112, " shocked", false], [64362, 0.028211, " disappointed", false], [53039, 0.025339, " stunned", false], [60601, 0.023566, " surprised", false], [52390, 0.016073, " outrage", false], [22187, 0.016035, " not", false], [61855, 0.015629, " devastated", false], [39171, 0.015253, " often", false]]]}, "raw_delta": -0.2578125, "tuned_delta": -0.20372290258492443}, {"byte_start": 1861, "byte_end": 1866, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 318, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"model_a": "30.43% 30.43% 30.43% 30.43% 30.43%", "model_b": "33.14% 33.14% 33.14% 33.14% 33.14%"}, "model_tokens": {"model_a": [[30992, " good", "normal", 0.00022168979921843857]], "model_b": [[30992, " good", "normal", 0.0001058305351762101]]}, "loss": {"model_a": 30.43184851875157, "model_b": 33.13690172041837}, "topk": {"model_a": [30992, 284, 0.00022168979921843857, [[39418, 0.095821, " quick", false], [30093, 0.073438, " able", false], [31581, 0.065513, " only", false], [53350, 0.047835, " willing", false], [56914, 0.043708, " prepared", false], [39449, 0.035332, " ready", false], [32053, 0.035318, " slow", false], [60601, 0.030924, " surprised", false], [4424, 0.021641, " at", false], [56426, 0.020471, " inclined", false]]], "model_b": [30992, 425, 0.0001058305351762101, [[31581, 0.098295, " only", false], [38664, 0.095491, " happy", false], [60601, 0.075429, " surprised", false], [56914, 0.04055, " prepared", false], [4788, 0.033065, " so", false], [52494, 0.032881, " pleased", false], [63613, 0.023801, " immediately", false], [59831, 0.020393, " impressed", false], [45159, 0.020384, " amused", false], [52047, 0.020302, " invited", false]]]}, "raw_delta": -0.1499999999999999, "tuned_delta": -0.09591040258492432}, {"byte_start": 1866, "byte_end": 1872, "display": {"text": " loser", "kind": "normal"}, "is_word": true, "word_id": 319, "word_key": " loser", "bytes_hex": "20 6c 6f 73 65 72", "compression": {"model_a": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[38935, " loser", "normal", 0.0007969274884089828]], "model_b": [[38935, " loser", "normal", 0.0029632030054926872]]}, "loss": {"model_a": 21.415004513195548, "model_b": 17.47013526076479}, "topk": {"model_a": [38935, 25, 0.0007969274884089828, [[4424, 0.626598, " at", false], [45865, 0.227566, " enough", false], [37598, 0.04074, " about", false], [46, 0.010277, "-", false], [32487, 0.009293, " with", false], [4811, 0.00882, " to", false], [61653, 0.007227, " candidates", false], [57330, 0.003439, " students", false], [46356, 0.003353, " judges", false], [4712, 0.002797, " on", false]]], "model_b": [38935, 22, 0.0029632030054926872, [[45865, 0.510216, " enough", false], [4424, 0.122771, " at", false], [21700, 0.036248, " for", false], [46787, 0.026197, " people", false], [4811, 0.020372, " to", false], [61653, 0.020359, " candidates", false], [38010, 0.019988, " cheer", false], [32487, 0.016404, " with", false], [51803, 0.015743, " friends", false], [51249, 0.010041, " company", false]]]}, "raw_delta": 0.21875, "tuned_delta": 0.2728395974150756}, {"byte_start": 1872, "byte_end": 1873, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 320, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.01%", "model_b": "0.03%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9997172951698303]], "model_b": [[116, "s", "normal", 0.9984013438224792]]}, "loss": {"model_a": 0.0050562899353665735, "model_b": 0.0287554992242616}, "topk": {"model_a": [116, 1, 0.9997172951698303, [[116, 0.999717, "s", false], [47, 5e-05, ".", false], [45, 3.7e-05, ",", false], [460, 2.7e-05, "'s", false], [46, 2.7e-05, "-", false], [1858, 1.9e-05, "es", false], [21265, 8e-06, " and", false], [26983, 5e-06, "sand", false], [60, 4e-06, ";", false], [52489, 4e-06, " players", false]]], "model_b": [116, 1, 0.9984013438224792, [[116, 0.998401, "s", false], [47, 0.000427, ".", false], [45, 0.000154, ",", false], [4596, 7.1e-05, " in", false], [21265, 6.1e-05, " and", false], [460, 3.4e-05, "'s", false], [46, 2.9e-05, "-", false], [45865, 2.6e-05, " enough", false], [60, 2.5e-05, ";", false], [4811, 2.2e-05, " to", false]]]}, "raw_delta": -0.0013141632080078125, "tuned_delta": 0.052775434207067776}, {"byte_start": 1873, "byte_end": 1874, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "6.23%", "model_b": "10.71%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7060011625289917]], "model_b": [[47, ".", "normal", 0.5480251908302307]]}, "loss": {"model_a": 6.234302300716467, "model_b": 10.707502256597774}, "topk": {"model_a": [47, 1, 0.7060011625289917, [[47, 0.706001, ".", false], [45, 0.148981, ",", false], [21265, 0.032215, " and", false], [60, 0.025791, ";", false], [59, 0.016035, ":", false], [275, 0.009601, " (", false], [21400, 0.007759, " but", false], [4596, 0.007044, " in", false], [4424, 0.006522, " at", false], [280, 0.002929, " -", false]]], "model_b": [47, 1, 0.5480251908302307, [[47, 0.548025, ".", false], [45, 0.151271, ",", false], [21265, 0.060734, " and", false], [4596, 0.0556, " in", false], [4424, 0.018045, " at", false], [60, 0.016765, ";", false], [21400, 0.016395, " but", false], [4811, 0.014776, " to", false], [275, 0.010684, " (", false], [59, 0.01032, ":", false]]]}, "raw_delta": -0.248046875, "tuned_delta": -0.19395727758492443}, {"byte_start": 1874, "byte_end": 1879, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 321, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"model_a": "6.73% 6.73% 6.73% 6.73% 6.73%", "model_b": "8.51% 8.51% 8.51% 8.51% 8.51%"}, "model_tokens": {"model_a": [[29893, " They", "normal", 0.15564467012882233]], "model_b": [[29893, " They", "normal", 0.09539249539375305]]}, "loss": {"model_a": 6.7344553666496525, "model_b": 8.509646530243494}, "topk": {"model_a": [29893, 2, 0.15564467012882233, [[261, 0.194605, "\n\n", false], [29893, 0.155645, " They", false], [20996, 0.067001, " The", false], [267, 0.047631, "  ", false], [19555, 0.046406, " But", false], [3913, 0.039858, " In", false], [37449, 0.03316, " Their", false], [3918, 0.024008, " It", false], [300, 0.014307, " A", false], [37451, 0.012311, " There", false]]], "model_b": [29893, 2, 0.09539249539375305, [[261, 0.121605, "\n\n", false], [29893, 0.095392, " They", false], [20996, 0.079071, " The", false], [267, 0.063849, "  ", false], [3913, 0.059656, " In", false], [29894, 0.038987, " This", false], [11, 0.031004, "\n", false], [3918, 0.027647, " It", false], [19555, 0.023157, " But", false], [37449, 0.0206, " Their", false]]]}, "raw_delta": -0.09843750000000001, "tuned_delta": -0.04434790258492442}, {"byte_start": 1879, "byte_end": 1884, "display": {"text": " said", "kind": "normal"}, "is_word": true, "word_id": 322, "word_key": " said", "bytes_hex": "20 73 61 69 64", "compression": {"model_a": "23.11% 23.11% 23.11% 23.11% 23.11%", "model_b": "23.67% 23.67% 23.67% 23.67% 23.67%"}, "model_tokens": {"model_a": [[31929, " said", "normal", 0.001669788733124733]], "model_b": [[31929, " said", "normal", 0.0014281454496085644]]}, "loss": {"model_a": 23.1056627642373, "model_b": 23.669215514584554}, "topk": {"model_a": [31929, 94, 0.001669788733124733, [[32462, 0.119811, " were", false], [21795, 0.087098, " had", false], [21532, 0.05324, " did", false], [59392, 0.03691, " continued", false], [39762, 0.01865, " spent", false], [40013, 0.018119, " tried", false], [39820, 0.017358, " still", false], [38128, 0.015004, " could", false], [45196, 0.014658, " argued", false], [60158, 0.01246, " persisted", false]]], "model_b": [31929, 94, 0.0014281454496085644, [[32462, 0.177929, " were", false], [21795, 0.12276, " had", false], [21532, 0.028037, " did", false], [31059, 0.020356, " have", false], [59392, 0.018789, " continued", false], [31334, 0.017631, " lost", false], [38128, 0.014874, " could", false], [39820, 0.014375, " still", false], [21286, 0.013806, " are", false], [47285, 0.012494, " simply", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 1884, "byte_end": 1889, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 323, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.51% 3.51% 3.51% 3.51% 3.51%", "model_b": "6.45% 6.45% 6.45% 6.45% 6.45%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.3803556561470032]], "model_b": [[32227, " that", "normal", 0.16712068021297455]]}, "loss": {"model_a": 3.508115870911639, "model_b": 6.452678991476026}, "topk": {"model_a": [32227, 1, 0.3803556561470032, [[32227, 0.380356, " that", false], [45, 0.099526, ",", false], [22590, 0.097763, " the", false], [32232, 0.08083, " they", false], [47539, 0.048248, " things", false], [4601, 0.042272, " it", false], [39931, 0.026849, " their", false], [269, 0.023397, " \"", false], [38013, 0.019255, " chess", false], [31370, 0.011386, " many", false]]], "model_b": [32227, 2, 0.16712068021297455, [[45, 0.268442, ",", false], [32227, 0.167121, " that", false], [4811, 0.073732, " to", false], [32232, 0.056641, " they", false], [59, 0.05018, ":", false], [269, 0.047021, " \"", false], [4601, 0.038424, " it", false], [22590, 0.030969, " the", false], [47539, 0.024706, " things", false], [32234, 0.020005, " this", false]]]}, "raw_delta": -0.16328125, "tuned_delta": -0.1091916525849244}, {"byte_start": 1889, "byte_end": 1892, "display": {"text": " ``", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 60 60", "compression": {"model_a": "63.12% 63.12% 63.12%", "model_b": "58.61% 58.61% 58.61%"}, "model_tokens": {"model_a": [[4404, " ``", "normal", 2.7912303266930394e-05]], "model_b": [[4404, " ``", "normal", 5.867650543223135e-05]]}, "loss": {"model_a": 63.11790803889214, "model_b": 58.609486036114134}, "topk": {"model_a": [4404, 575, 2.7912303266930394e-05, [[22590, 0.30634, " the", false], [39931, 0.110249, " their", false], [32232, 0.084758, " they", false], [47202, 0.083649, " search", false], [4601, 0.032346, " it", false], [32234, 0.032225, " this", false], [332, 0.025036, " a", false], [30597, 0.02062, " deep", false], [45, 0.017945, ",", false], [39934, 0.016947, " there", false]]], "model_b": [4404, 380, 5.867650543223135e-05, [[32232, 0.212075, " they", false], [22590, 0.192067, " the", false], [39931, 0.1185, " their", false], [32234, 0.051301, " this", false], [4601, 0.046165, " it", false], [4588, 0.023838, " if", false], [45, 0.023506, ",", false], [269, 0.018449, " \"", false], [39934, 0.017319, " there", false], [30597, 0.013244, " deep", false]]]}, "raw_delta": 0.25, "tuned_delta": 0.3040895974150756}, {"byte_start": 1892, "byte_end": 1895, "display": {"text": "bru", "kind": "normal"}, "is_word": true, "word_id": 324, "word_key": "bru", "bytes_hex": "62 72 75", "compression": {"model_a": "45.46% 45.46% 45.46%", "model_b": "53.73% 53.73% 53.73%"}, "model_tokens": {"model_a": [[7184, "bru", "normal", 0.0005290898261591792]], "model_b": [[7184, "bru", "normal", 0.00013019150355830789]]}, "loss": {"model_a": 45.45992186134494, "model_b": 53.72536219977128}, "topk": {"model_a": [7184, 173, 0.0005290898261591792, [[8801, 0.129063, "the", false], [25116, 0.067519, "deep", false], [42233, 0.054828, "search", false], [34580, 0.042701, "human", false], [53865, 0.026487, "computer", false], [2278, 0.0246, "we", false], [2073, 0.021748, "no", false], [35755, 0.020988, "there", false], [24991, 0.020163, "ches", false], [1956, 0.018559, "it", false]]], "model_b": [7184, 548, 0.00013019150355830789, [[8801, 0.139817, "the", false], [2278, 0.05224, "we", false], [1942, 0.031592, "if", false], [1956, 0.030958, "it", false], [25116, 0.030151, "deep", false], [34580, 0.030021, "human", false], [35755, 0.026264, "there", false], [1589, 0.020793, "We", false], [53865, 0.018463, "computer", false], [74, 0.017074, "I", false]]]}, "raw_delta": -0.45833333333333304, "tuned_delta": -0.40424373591825746}, {"byte_start": 1895, "byte_end": 1897, "display": {"text": "te", "kind": "normal"}, "is_word": true, "word_id": 325, "word_key": "te", "bytes_hex": "74 65", "compression": {"model_a": "0.02% 0.02%", "model_b": "1.08% 1.08%"}, "model_tokens": {"model_a": [[2206, "te", "normal", 0.9979749321937561]], "model_b": [[2206, "te", "normal", 0.886979341506958]]}, "loss": {"model_a": 0.018298954051802836, "model_b": 1.0830779420736236}, "topk": {"model_a": [2206, 1, 0.9979749321937561, [[2206, 0.997975, "te", false], [8817, 0.001025, "tis", false], [8776, 0.000632, "tal", false], [8796, 0.000205, "tes", false], [42351, 3.9e-05, "teness", false], [117, 1e-05, "t", false], [1788, 1e-05, "ce", false], [8792, 8e-06, "tel", false], [2210, 5e-06, "ti", false], [2077, 5e-06, "nt", false]]], "model_b": [2206, 1, 0.886979341506958, [[2206, 0.886979, "te", false], [8776, 0.095044, "tal", false], [8796, 0.00683, "tes", false], [8817, 0.001657, "tis", false], [105, 0.001057, "h", false], [34841, 0.001008, "ising", false], [2077, 0.000829, "nt", false], [2061, 0.000619, "nc", false], [8744, 0.000571, "squ", false], [117, 0.000443, "t", false]]]}, "raw_delta": -0.05904388427734375, "tuned_delta": -0.004954286862268162}, {"byte_start": 1897, "byte_end": 1903, "display": {"text": " force", "kind": "normal"}, "is_word": true, "word_id": 326, "word_key": " force", "bytes_hex": "20 66 6f 72 63 65", "compression": {"model_a": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18%", "model_b": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"model_a": [[38536, " force", "normal", 0.673162579536438]], "model_b": [[38536, " force", "normal", 0.6831681132316589]]}, "loss": {"model_a": 1.1799385710395573, "model_b": 1.144716524142854}, "topk": {"model_a": [38536, 1, 0.673162579536438, [[38536, 0.673163, " force", false], [46, 0.282958, "-", false], [57319, 0.006794, " strength", false], [439, 0.005511, "''", false], [39339, 0.003964, " power", false], [59346, 0.002994, " computing", false], [47202, 0.002701, " search", false], [63370, 0.002166, " computation", false], [46022, 0.0018, " forces", false], [51779, 0.00164, " forcing", false]]], "model_b": [38536, 1, 0.6831681132316589, [[38536, 0.683168, " force", false], [46, 0.263826, "-", false], [39339, 0.005934, " power", false], [46022, 0.004559, " forces", false], [439, 0.003753, "''", false], [37920, 0.003037, " brute", false], [59346, 0.002948, " computing", false], [34470, 0.002894, "force", false], [45829, 0.002452, " effort", false], [51779, 0.002339, " forcing", false]]]}, "raw_delta": 0.001953125, "tuned_delta": 0.05604272241507559}, {"byte_start": 1903, "byte_end": 1904, "display": {"text": "\"", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "22", "compression": {"model_a": "59.74%", "model_b": "48.75%"}, "model_tokens": {"model_a": [[35, "\"", "normal", 0.036194030195474625]], "model_b": [[35, "\"", "normal", 0.06597781926393509]]}, "loss": {"model_a": 59.73659153680863, "model_b": 48.747312905037234}, "topk": {"model_a": [35, 3, 0.036194030195474625, [[439, 0.636685, "''", false], [4600, 0.06822, " is", false], [35, 0.036194, "\"", false], [40, 0.020316, "'", false], [47202, 0.018037, " search", false], [22748, 0.016308, " was", false], [32475, 0.015448, " will", false], [37825, 0.010313, " beats", false], [32481, 0.010184, " wins", false], [5341, 0.00864, ",''", false]]], "model_b": [35, 3, 0.06597781926393509, [[439, 0.386313, "''", false], [4600, 0.080882, " is", false], [35, 0.065978, "\"", false], [47202, 0.049762, " search", false], [22748, 0.038648, " was", false], [45, 0.02683, ",", false], [5341, 0.018986, ",''", false], [1732, 0.018624, "``", false], [52224, 0.016414, " methods", false], [21265, 0.013334, " and", false]]]}, "raw_delta": 0.609375, "tuned_delta": 0.6634645974150756}, {"byte_start": 1904, "byte_end": 1911, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 327, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "model_b": "6.64% 6.64% 6.64% 6.64% 6.64% 6.64% 6.64%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.06495513767004013]], "model_b": [[47202, " search", "normal", 0.0762103945016861]]}, "loss": {"model_a": 7.044409379340641, "model_b": 6.641871700521177}, "topk": {"model_a": [47202, 4, 0.06495513767004013, [[22748, 0.248066, " was", false], [52224, 0.163488, " methods", false], [40219, 0.089023, " would", false], [47202, 0.064955, " search", false], [21795, 0.053909, " had", false], [4600, 0.040446, " is", false], [38128, 0.027898, " could", false], [61590, 0.024319, " approaches", false], [275, 0.014012, " (", false], [21265, 0.011585, " and", false]]], "model_b": [47202, 3, 0.0762103945016861, [[22748, 0.21166, " was", false], [52224, 0.100026, " methods", false], [47202, 0.07621, " search", false], [275, 0.065044, " (", false], [4600, 0.054754, " is", false], [40219, 0.043398, " would", false], [61590, 0.03276, " approaches", false], [21795, 0.030473, " had", false], [4715, 0.026859, " or", false], [21265, 0.022788, " and", false]]]}, "raw_delta": 0.022321428571428548, "tuned_delta": 0.07641102598650414}, {"byte_start": 1911, "byte_end": 1915, "display": {"text": " may", "kind": "normal"}, "is_word": true, "word_id": 328, "word_key": " may", "bytes_hex": "20 6d 61 79", "compression": {"model_a": "37.19% 37.19% 37.19% 37.19%", "model_b": "28.18% 28.18% 28.18% 28.18%"}, "model_tokens": {"model_a": [[22074, " may", "normal", 0.0002585754555184394]], "model_b": [[22074, " may", "normal", 0.001948247547261417]]}, "loss": {"model_a": 37.194481522918586, "model_b": 28.177637517362562}, "topk": {"model_a": [22074, 128, 0.0002585754555184394, [[22748, 0.403255, " was", false], [40219, 0.084631, " would", false], [52224, 0.075907, " methods", false], [21795, 0.067733, " had", false], [4600, 0.053641, " is", false], [38128, 0.045601, " could", false], [21532, 0.016726, " did", false], [45, 0.016359, ",", false], [47285, 0.009384, " simply", false], [32445, 0.008629, " wasn", false]]], "model_b": [22074, 40, 0.001948247547261417, [[22748, 0.359617, " was", false], [45, 0.083062, ",", false], [4600, 0.061796, " is", false], [21795, 0.053923, " had", false], [40219, 0.041583, " would", false], [52224, 0.035108, " methods", false], [275, 0.027478, " (", false], [21265, 0.022928, " and", false], [4596, 0.021153, " in", false], [32487, 0.020187, " with", false]]]}, "raw_delta": 0.5, "tuned_delta": 0.5540895974150756}, {"byte_start": 1915, "byte_end": 1920, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 329, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "4.45% 4.45% 4.45% 4.45% 4.45%", "model_b": "5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.2906019389629364]], "model_b": [[31059, " have", "normal", 0.2358183115720749]]}, "loss": {"model_a": 4.4520667277432855, "model_b": 5.297395853264162}, "topk": {"model_a": [31059, 2, 0.2906019389629364, [[4435, 0.36095, " be", false], [31059, 0.290602, " have", false], [32499, 0.107708, " work", false], [22770, 0.028328, " win", false], [22187, 0.026155, " not", false], [32458, 0.023707, " well", false], [61959, 0.020059, " eventually", false], [30256, 0.015342, " beat", false], [46272, 0.006488, " indeed", false], [31358, 0.005452, " make", false]]], "model_b": [31059, 2, 0.2358183115720749, [[4435, 0.356053, " be", false], [31059, 0.235818, " have", false], [22187, 0.081663, " not", false], [31967, 0.032731, " seem", false], [32499, 0.031346, " work", false], [39115, 0.027954, " never", false], [32458, 0.020105, " well", false], [39820, 0.013041, " still", false], [46272, 0.007733, " indeed", false], [22770, 0.006825, " win", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 1920, "byte_end": 1924, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 330, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"model_a": "7.64% 7.64% 7.64% 7.64%", "model_b": "13.88% 13.88% 13.88% 13.88%"}, "model_tokens": {"model_a": [[22777, " won", "normal", 0.18192946910858154]], "model_b": [[22777, " won", "normal", 0.04570045694708824]]}, "loss": {"model_a": 7.643184176584596, "model_b": 13.877486477301062}, "topk": {"model_a": [22777, 2, 0.18192946910858154, [[30259, 0.284607, " been", false], [22777, 0.181929, " won", false], [47812, 0.179618, " worked", false], [55934, 0.056501, " defeated", false], [45281, 0.029122, " beaten", false], [61959, 0.022459, " eventually", false], [47333, 0.014326, " solved", false], [30256, 0.010943, " beat", false], [60586, 0.010462, " succeeded", false], [31351, 0.010056, " made", false]]], "model_b": [22777, 3, 0.04570045694708824, [[30259, 0.466232, " been", false], [47812, 0.052019, " worked", false], [22777, 0.0457, " won", false], [21795, 0.025709, " had", false], [332, 0.020011, " a", false], [31351, 0.019928, " made", false], [47211, 0.012853, " seemed", false], [60586, 0.011009, " succeeded", false], [45284, 0.010004, " become", false], [47333, 0.00865, " solved", false]]]}, "raw_delta": -0.345703125, "tuned_delta": -0.2916135275849244}, {"byte_start": 1924, "byte_end": 1929, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 331, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "16.68% 16.68% 16.68% 16.68% 16.68%", "model_b": "18.26% 18.26% 18.26% 18.26% 18.26%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.009804054163396358]], "model_b": [[32234, " this", "normal", 0.006272817496210337]]}, "loss": {"model_a": 16.681161410278637, "model_b": 18.25910911125094}, "topk": {"model_a": [32234, 11, 0.009804054163396358, [[22590, 0.574802, " the", false], [45, 0.125965, ",", false], [50870, 0.054928, " against", false], [4596, 0.039392, " in", false], [4712, 0.038121, " on", false], [32229, 0.022023, " them", false], [21400, 0.013831, " but", false], [332, 0.012925, " a", false], [4424, 0.012721, " at", false], [21700, 0.01186, " for", false]]], "model_b": [32234, 19, 0.006272817496210337, [[22590, 0.284089, " the", false], [45, 0.143603, ",", false], [4596, 0.075107, " in", false], [332, 0.056761, " a", false], [32074, 0.046639, " some", false], [32229, 0.033281, " them", false], [38013, 0.031659, " chess", false], [50870, 0.0279, " against", false], [21700, 0.022783, " for", false], [4424, 0.022645, " at", false]]]}, "raw_delta": -0.08749999999999991, "tuned_delta": -0.03341040258492432}, {"byte_start": 1929, "byte_end": 1934, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 332, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "4.79% 4.79% 4.79% 4.79% 4.79%", "model_b": "6.79% 6.79% 6.79% 6.79% 6.79%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.26396211981773376]], "model_b": [[32251, " time", "normal", 0.15286463499069214]]}, "loss": {"model_a": 4.7901983779516355, "model_b": 6.790810641684378}, "topk": {"model_a": [32251, 1, 0.26396211981773376, [[32251, 0.263962, " time", false], [62293, 0.2201, " particular", false], [30941, 0.093729, " game", false], [39551, 0.077617, " round", false], [38981, 0.06603, " match", false], [45278, 0.042764, " battle", false], [22226, 0.040377, " one", false], [38013, 0.032679, " chess", false], [57271, 0.026488, " specific", false], [62653, 0.01863, " tournament", false]]], "model_b": [32251, 2, 0.15286463499069214, [[30941, 0.303059, " game", false], [32251, 0.152865, " time", false], [38013, 0.075128, " chess", false], [62293, 0.053138, " particular", false], [45278, 0.043279, " battle", false], [38981, 0.032759, " match", false], [22226, 0.027868, " one", false], [62653, 0.021793, " tournament", false], [31813, 0.015498, " race", false], [63361, 0.015308, " competition", false]]]}, "raw_delta": -0.11093750000000002, "tuned_delta": -0.056847902584924434}, {"byte_start": 1934, "byte_end": 1935, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.25%", "model_b": "4.79%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8824990391731262]], "model_b": [[45, ",", "normal", 0.7683281898498535]]}, "loss": {"model_a": 2.2454054896648294, "model_b": 4.7901983779516355}, "topk": {"model_a": [45, 1, 0.8824990391731262, [[45, 0.882499, ",", false], [21400, 0.054787, " but", false], [275, 0.015165, " (", false], [45202, 0.013356, " around", false], [51018, 0.005571, " because", false], [50870, 0.0037, " against", false], [21265, 0.00283, " and", false], [47, 0.002494, ".", false], [4450, 0.001975, " by", false], [4596, 0.001817, " in", false]]], "model_b": [45, 1, 0.7683281898498535, [[45, 0.768328, ",", false], [21400, 0.082393, " but", false], [47, 0.026133, ".", false], [51018, 0.017856, " because", false], [45202, 0.012856, " around", false], [275, 0.012106, " (", false], [50870, 0.009971, " against", false], [21265, 0.007982, " and", false], [4450, 0.007785, " by", false], [4596, 0.006426, " in", false]]]}, "raw_delta": -0.14111328125, "tuned_delta": -0.08702368383492441}, {"byte_start": 1935, "byte_end": 1939, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 333, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12%", "model_b": "0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.9737100005149841]], "model_b": [[21400, " but", "normal", 0.9340184330940247]]}, "loss": {"model_a": 0.11997509724189528, "model_b": 0.30819291034615304}, "topk": {"model_a": [21400, 1, 0.9737100005149841, [[21400, 0.97371, " but", false], [21265, 0.011471, " and", false], [51018, 0.002272, " because", false], [4596, 0.000807, " in", false], [32227, 0.000668, " that", false], [4423, 0.000658, " as", false], [4715, 0.000573, " or", false], [4601, 0.000563, " it", false], [21700, 0.00055, " for", false], [39690, 0.000361, " since", false]]], "model_b": [21400, 1, 0.9340184330940247, [[21400, 0.934018, " but", false], [21265, 0.024587, " and", false], [32227, 0.002178, " that", false], [51018, 0.002152, " because", false], [4423, 0.001799, " as", false], [4715, 0.001647, " or", false], [4596, 0.00157, " in", false], [4601, 0.001422, " it", false], [32232, 0.001369, " they", false], [4424, 0.00117, " at", false]]]}, "raw_delta": -0.01043701171875, "tuned_delta": 0.04365258569632559}, {"byte_start": 1939, "byte_end": 1942, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 334, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "5.00% 5.00% 5.00%", "model_b": "10.24% 10.24% 10.24%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.4341208338737488]], "model_b": [[4601, " it", "normal", 0.18370026350021362]]}, "loss": {"model_a": 5.001530659331855, "model_b": 10.237874964641732}, "topk": {"model_a": [4601, 1, 0.4341208338737488, [[4601, 0.434121, " it", false], [32227, 0.09888, " that", false], [32232, 0.051912, " they", false], [22590, 0.049127, " the", false], [4596, 0.040486, " in", false], [40219, 0.039958, " would", false], [39934, 0.019556, " there", false], [37920, 0.016224, " brute", false], [32234, 0.01315, " this", false], [32475, 0.012144, " will", false]]], "model_b": [4601, 1, 0.18370026350021362, [[4601, 0.1837, " it", false], [22590, 0.103578, " the", false], [32232, 0.089445, " they", false], [32227, 0.08636, " that", false], [4404, 0.063047, " ``", false], [22187, 0.062354, " not", false], [4596, 0.047763, " in", false], [31581, 0.019614, " only", false], [32234, 0.018727, " this", false], [30597, 0.016505, " deep", false]]]}, "raw_delta": -0.29036458333333337, "tuned_delta": -0.2362749859182578}, {"byte_start": 1942, "byte_end": 1946, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 335, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "8.84% 8.84% 8.84% 8.84%", "model_b": "5.07% 5.07% 5.07% 5.07%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.14146897196769714]], "model_b": [[22748, " was", "normal", 0.32803913950920105]]}, "loss": {"model_a": 8.840733771072504, "model_b": 5.071974753125262}, "topk": {"model_a": [22748, 3, 0.14146897196769714, [[40219, 0.328436, " would", false], [32475, 0.152008, " will", false], [22748, 0.141469, " was", false], [4600, 0.070187, " is", false], [22777, 0.057875, " won", false], [38128, 0.044718, " could", false], [47816, 0.038036, " wouldn", false], [45599, 0.017827, " couldn", false], [21795, 0.014394, " had", false], [45409, 0.013113, " cannot", false]]], "model_b": [22748, 1, 0.32803913950920105, [[22748, 0.328039, " was", false], [40219, 0.090167, " would", false], [21795, 0.082457, " had", false], [4600, 0.045245, " is", false], [32445, 0.040379, " wasn", false], [21532, 0.031238, " did", false], [22074, 0.029579, " may", false], [32272, 0.028042, " took", false], [30633, 0.022282, " didn", false], [38128, 0.021146, " could", false]]]}, "raw_delta": 0.208984375, "tuned_delta": 0.2630739724150756}, {"byte_start": 1946, "byte_end": 1950, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 336, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "6.41% 6.41% 6.41% 6.41%", "model_b": "7.57% 7.57% 7.57% 7.57%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.24128875136375427]], "model_b": [[22187, " not", "normal", 0.18477612733840942]]}, "loss": {"model_a": 6.410412535199983, "model_b": 7.572740082791189}, "topk": {"model_a": [22187, 1, 0.24128875136375427, [[22187, 0.241289, " not", false], [332, 0.159051, " a", false], [31581, 0.063467, " only", false], [22590, 0.045234, " the", false], [4692, 0.037471, " no", false], [4419, 0.034066, " an", false], [57492, 0.02133, " unlikely", false], [31198, 0.02111, " just", false], [45781, 0.017322, " doomed", false], [39115, 0.012332, " never", false]]], "model_b": [22187, 1, 0.18477612733840942, [[22187, 0.184776, " not", false], [332, 0.109358, " a", false], [22590, 0.044319, " the", false], [39115, 0.034657, " never", false], [4404, 0.032019, " ``", false], [39820, 0.030124, " still", false], [22614, 0.029906, " too", false], [31581, 0.028014, " only", false], [4692, 0.024736, " no", false], [31198, 0.018871, " just", false]]]}, "raw_delta": -0.064453125, "tuned_delta": -0.010363527584924412}, {"byte_start": 1950, "byte_end": 1952, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 337, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "9.79% 9.79%", "model_b": "18.32% 18.32%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.33454951643943787]], "model_b": [[332, " a", "normal", 0.1309400051832199]]}, "loss": {"model_a": 9.79172903728349, "model_b": 18.315464386285665}, "topk": {"model_a": [332, 1, 0.33454951643943787, [[332, 0.33455, " a", false], [22590, 0.164044, " the", false], [38606, 0.109563, " going", false], [4419, 0.046664, " an", false], [46439, 0.032817, " likely", false], [51832, 0.021246, " general", false], [30992, 0.014992, " good", false], [47008, 0.014346, " really", false], [4596, 0.011074, " in", false], [32464, 0.00847, " what", false]]], "model_b": [332, 2, 0.1309400051832199, [[22590, 0.274482, " the", false], [332, 0.13094, " a", false], [30992, 0.03294, " good", false], [51018, 0.031183, " because", false], [4404, 0.022644, " ``", false], [38606, 0.020037, " going", false], [4423, 0.018593, " as", false], [4419, 0.018186, " an", false], [32464, 0.012755, " what", false], [40218, 0.012726, " worth", false]]]}, "raw_delta": -0.47265625, "tuned_delta": -0.4185666525849244}, {"byte_start": 1952, "byte_end": 1960, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 338, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12%", "model_b": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.16105210781097412]], "model_b": [[51832, " general", "normal", 0.04023819416761398]]}, "loss": {"model_a": 4.120979486914275, "model_b": 7.25574166072086}, "topk": {"model_a": [51832, 1, 0.16105210781097412, [[51832, 0.161052, " general", false], [30992, 0.098127, " good", false], [46561, 0.056488, " method", false], [30811, 0.04894, " fair", false], [53283, 0.034534, " victory", false], [31835, 0.031968, " real", false], [53354, 0.027957, " winning", false], [40091, 0.022314, " valid", false], [32313, 0.022279, " true", false], [63910, 0.020254, " sustainable", false]]], "model_b": [51832, 2, 0.04023819416761398, [[30992, 0.137531, " good", false], [51832, 0.040238, " general", false], [53354, 0.040082, " winning", false], [45301, 0.028232, " better", false], [32313, 0.023684, " true", false], [4404, 0.023037, " ``", false], [46430, 0.021228, " lesson", false], [22770, 0.01627, " win", false], [46561, 0.015864, " method", false], [30811, 0.014917, " fair", false]]]}, "raw_delta": -0.173828125, "tuned_delta": -0.11973852758492441}, {"byte_start": 1960, "byte_end": 1969, "display": {"text": " strategy", "kind": "normal"}, "is_word": true, "word_id": 339, "word_key": " strategy", "bytes_hex": "20 73 74 72 61 74 65 67 79", "compression": {"model_a": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%", "model_b": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39%"}, "model_tokens": {"model_a": [[57317, " strategy", "normal", 0.04533086344599724]], "model_b": [[57317, " strategy", "normal", 0.02484375797212124]]}, "loss": {"model_a": 6.199080253819764, "model_b": 7.388802726775073}, "topk": {"model_a": [57317, 4, 0.04533086344599724, [[46561, 0.493444, " method", false], [55532, 0.154119, " approach", false], [57260, 0.106063, " solution", false], [57317, 0.045331, " strategy", false], [41729, 0.043446, "izable", false], [60250, 0.032022, " principle", false], [22752, 0.022479, " way", false], [46, 0.01435, "-", false], [45, 0.006075, ",", false], [53354, 0.005696, " winning", false]]], "model_b": [57317, 7, 0.02484375797212124, [[46561, 0.373543, " method", false], [46, 0.196512, "-", false], [55532, 0.092046, " approach", false], [47202, 0.041826, " search", false], [41729, 0.032965, "izable", false], [60250, 0.029431, " principle", false], [57317, 0.024844, " strategy", false], [57260, 0.020576, " solution", false], [45, 0.009354, ",", false], [59113, 0.006931, " algorithm", false]]]}, "raw_delta": -0.06597222222222221, "tuned_delta": -0.011882624807146622}, {"byte_start": 1969, "byte_end": 1970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "35.08%", "model_b": "40.86%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.14232106506824493]], "model_b": [[45, ",", "normal", 0.10325170308351517]]}, "loss": {"model_a": 35.081158709116394, "model_b": 40.857574400175714}, "topk": {"model_a": [45, 3, 0.14232106506824493, [[47, 0.377648, ".", false], [21700, 0.194098, " for", false], [45, 0.142321, ",", false], [32227, 0.125138, " that", false], [21265, 0.057005, " and", false], [60, 0.019251, ";", false], [4811, 0.01429, " to", false], [275, 0.008036, " (", false], [59, 0.005971, ":", false], [61586, 0.004592, " applicable", false]]], "model_b": [45, 4, 0.10325170308351517, [[47, 0.329965, ".", false], [32227, 0.183408, " that", false], [21700, 0.111932, " for", false], [45, 0.103252, ",", false], [21265, 0.050731, " and", false], [4811, 0.048047, " to", false], [4596, 0.032129, " in", false], [60, 0.012202, ";", false], [4715, 0.01194, " or", false], [4706, 0.010654, " of", false]]]}, "raw_delta": -0.3203125, "tuned_delta": -0.2662229025849244}, {"byte_start": 1970, "byte_end": 1974, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 340, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "0.99% 0.99% 0.99% 0.99%", "model_b": "1.59% 1.59% 1.59% 1.59%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.8024763464927673]], "model_b": [[21265, " and", "normal", 0.6996076107025146]]}, "loss": {"model_a": 0.9862173131076897, "model_b": 1.59379762207582}, "topk": {"model_a": [21265, 1, 0.8024763464927673, [[21265, 0.802476, " and", false], [4601, 0.031419, " it", false], [4788, 0.024592, " so", false], [22185, 0.016011, " nor", false], [32227, 0.008448, " that", false], [22187, 0.008329, " not", false], [51018, 0.008077, " because", false], [40186, 0.007414, " which", false], [4423, 0.006721, " as", false], [4715, 0.006302, " or", false]]], "model_b": [21265, 1, 0.6996076107025146, [[21265, 0.699608, " and", false], [4601, 0.039372, " it", false], [22185, 0.023399, " nor", false], [21400, 0.020069, " but", false], [40186, 0.017451, " which", false], [4423, 0.016733, " as", false], [4715, 0.014257, " or", false], [4788, 0.012262, " so", false], [32227, 0.011997, " that", false], [22187, 0.010444, " not", false]]]}, "raw_delta": -0.03369140625, "tuned_delta": 0.020398191165075588}, {"byte_start": 1974, "byte_end": 1981, "display": {"text": " anyway", "kind": "normal"}, "is_word": true, "word_id": 341, "word_key": " anyway", "bytes_hex": "20 61 6e 79 77 61 79", "compression": {"model_a": "18.84% 18.84% 18.84% 18.84% 18.84% 18.84% 18.84%", "model_b": "25.28% 25.28% 25.28% 25.28% 25.28% 25.28% 25.28%"}, "model_tokens": {"model_a": [[45179, " anyway", "normal", 0.000668044900521636]], "model_b": [[45179, " anyway", "normal", 5.476904334500432e-05]]}, "loss": {"model_a": 18.838763368750975, "model_b": 25.279366229862408}, "topk": {"model_a": [45179, 105, 0.000668044900521636, [[4601, 0.168485, " it", false], [32232, 0.097553, " they", false], [40219, 0.080985, " would", false], [22590, 0.077007, " the", false], [32227, 0.075758, " that", false], [4596, 0.028886, " in", false], [39934, 0.022722, " there", false], [60645, 0.019418, " therefore", false], [32465, 0.018131, " when", false], [4788, 0.017, " so", false]]], "model_b": [45179, 587, 5.476904334500432e-05, [[4601, 0.160745, " it", false], [22590, 0.124201, " the", false], [32232, 0.09059, " they", false], [32227, 0.053054, " that", false], [39934, 0.026065, " there", false], [4596, 0.024392, " in", false], [22748, 0.01929, " was", false], [4788, 0.016118, " so", false], [332, 0.015308, " a", false], [32234, 0.014614, " this", false]]]}, "raw_delta": -0.35714285714285704, "tuned_delta": -0.30305325972778147}, {"byte_start": 1981, "byte_end": 1984, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 342, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "11.04% 11.04% 11.04%", "model_b": "12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.16004523634910583]], "model_b": [[4601, " it", "normal", 0.11806605756282806]]}, "loss": {"model_a": 11.036241360967004, "model_b": 12.96171325798678}, "topk": {"model_a": [4601, 2, 0.16004523634910583, [[45, 0.272488, ",", false], [4601, 0.160045, " it", false], [32232, 0.113072, " they", false], [22590, 0.098783, " the", false], [37920, 0.02628, " brute", false], [39934, 0.022621, " there", false], [20184, 0.017527, " Kas", false], [38013, 0.015741, " chess", false], [4858, 0.014868, " we", false], [39931, 0.014708, " their", false]]], "model_b": [4601, 2, 0.11806605756282806, [[45, 0.430459, ",", false], [4601, 0.118066, " it", false], [22590, 0.096193, " the", false], [32232, 0.068282, " they", false], [39934, 0.027871, " there", false], [116, 0.01295, "s", false], [32234, 0.012657, " this", false], [4404, 0.009835, " ``", false], [37920, 0.009743, " brute", false], [39931, 0.00822, " their", false]]]}, "raw_delta": -0.10677083333333337, "tuned_delta": -0.05268123591825778}, {"byte_start": 1984, "byte_end": 1988, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 343, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "4.00% 4.00% 4.00% 4.00%", "model_b": "3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.41470974683761597]], "model_b": [[22748, " was", "normal", 0.4991486370563507]]}, "loss": {"model_a": 3.997702322775814, "model_b": 3.1171511503582336}, "topk": {"model_a": [22748, 1, 0.41470974683761597, [[22748, 0.41471, " was", false], [40219, 0.093539, " would", false], [21795, 0.083712, " had", false], [21532, 0.038062, " did", false], [57101, 0.032465, " required", false], [4600, 0.030558, " is", false], [38128, 0.027898, " could", false], [32272, 0.021889, " took", false], [30633, 0.017073, " didn", false], [32445, 0.015023, " wasn", false]]], "model_b": [22748, 1, 0.4991486370563507, [[22748, 0.499149, " was", false], [21795, 0.07986, " had", false], [40219, 0.045283, " would", false], [32272, 0.043589, " took", false], [21532, 0.03967, " did", false], [57101, 0.021615, " required", false], [4600, 0.020339, " is", false], [38128, 0.019212, " could", false], [31581, 0.012458, " only", false], [32445, 0.010334, " wasn", false]]]}, "raw_delta": 0.048828125, "tuned_delta": 0.10291772241507559}, {"byte_start": 1988, "byte_end": 1992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 344, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "6.76% 6.76% 6.76% 6.76%", "model_b": "9.09% 9.09% 9.09% 9.09%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.22291997075080872]], "model_b": [[22187, " not", "normal", 0.1334061175584793]]}, "loss": {"model_a": 6.762633004167015, "model_b": 9.087288099349427}, "topk": {"model_a": [22187, 1, 0.22291997075080872, [[22187, 0.22292, " not", false], [22614, 0.064934, " too", false], [332, 0.059773, " a", false], [31581, 0.034407, " only", false], [31198, 0.024346, " just", false], [55725, 0.020326, " cheating", false], [4692, 0.016252, " no", false], [4788, 0.015378, " so", false], [4419, 0.013394, " an", false], [4404, 0.013135, " ``", false]]], "model_b": [22187, 1, 0.1334061175584793, [[22187, 0.133406, " not", false], [22614, 0.080381, " too", false], [332, 0.076979, " a", false], [31198, 0.029655, " just", false], [31581, 0.021596, " only", false], [4788, 0.018288, " so", false], [4419, 0.017084, " an", false], [22590, 0.01643, " the", false], [4404, 0.013578, " ``", false], [39820, 0.013323, " still", false]]]}, "raw_delta": -0.12890625, "tuned_delta": -0.07481665258492441}, {"byte_start": 1992, "byte_end": 1996, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 345, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"model_a": "19.58% 19.58% 19.58% 19.58%", "model_b": "28.04% 28.04% 28.04% 28.04%"}, "model_tokens": {"model_a": [[21835, " how", "normal", 0.013002678751945496]], "model_b": [[21835, " how", "normal", 0.002005617367103696]]}, "loss": {"model_a": 19.58345807456698, "model_b": 28.036749329775752}, "topk": {"model_a": [21835, 14, 0.013002678751945496, [[332, 0.11312, " a", false], [22590, 0.05675, " the", false], [32386, 0.05119, " very", false], [47008, 0.043505, " really", false], [30992, 0.0394, " good", false], [30788, 0.035621, " even", false], [32464, 0.029665, " what", false], [4423, 0.027903, " as", false], [4404, 0.022892, " ``", false], [38606, 0.022005, " going", false]]], "model_b": [21835, 76, 0.002005617367103696, [[332, 0.118247, " a", false], [22590, 0.103395, " the", false], [56895, 0.032115, " possible", false], [4423, 0.02839, " as", false], [30788, 0.02287, " even", false], [4419, 0.020538, " an", false], [38606, 0.016804, " going", false], [4404, 0.015741, " ``", false], [39931, 0.015521, " their", false], [37810, 0.014085, " based", false]]]}, "raw_delta": -0.46875, "tuned_delta": -0.4146604025849244}, {"byte_start": 1996, "byte_end": 2003, "display": {"text": " people", "kind": "normal"}, "is_word": true, "word_id": 346, "word_key": " people", "bytes_hex": "20 70 65 6f 70 6c 65", "compression": {"model_a": "8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33%", "model_b": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"model_a": [[46787, " people", "normal", 0.03884807601571083]], "model_b": [[46787, " people", "normal", 0.01079116016626358]]}, "loss": {"model_a": 8.33252995156293, "model_b": 11.673592685764493}, "topk": {"model_a": [46787, 6, 0.03884807601571083, [[32232, 0.287569, " they", false], [46227, 0.184412, " humans", false], [38013, 0.072462, " chess", false], [38720, 0.060286, " human", false], [22590, 0.055845, " the", false], [46787, 0.038848, " people", false], [4858, 0.036273, " we", false], [59345, 0.035608, " computers", false], [332, 0.032924, " a", false], [22226, 0.026625, " one", false]]], "model_b": [46787, 16, 0.01079116016626358, [[32232, 0.289992, " they", false], [22590, 0.179383, " the", false], [38013, 0.062245, " chess", false], [4858, 0.04422, " we", false], [46227, 0.039858, " humans", false], [59345, 0.035711, " computers", false], [20184, 0.03064, " Kas", false], [4811, 0.021322, " to", false], [332, 0.020576, " a", false], [31461, 0.017949, " most", false]]]}, "raw_delta": -0.18526785714285718, "tuned_delta": -0.13117825972778158}, {"byte_start": 2003, "byte_end": 2010, "display": {"text": " played", "kind": "normal"}, "is_word": true, "word_id": 347, "word_key": " played", "bytes_hex": "20 70 6c 61 79 65 64", "compression": {"model_a": "2.74% 2.74% 2.74% 2.74% 2.74% 2.74% 2.74%", "model_b": "4.55% 4.55% 4.55% 4.55% 4.55% 4.55% 4.55%"}, "model_tokens": {"model_a": [[46840, " played", "normal", 0.3473087251186371]], "model_b": [[46840, " played", "normal", 0.17108111083507538]]}, "loss": {"model_a": 2.737256215972363, "model_b": 4.5486757706599565}, "topk": {"model_a": [46840, 1, 0.3473087251186371, [[46840, 0.347309, " played", false], [31702, 0.25139, " play", false], [55448, 0.045466, " actually", false], [39942, 0.044385, " think", false], [56714, 0.043096, " normally", false], [53137, 0.038729, " thought", false], [40219, 0.025537, " would", false], [47008, 0.016811, " really", false], [47333, 0.015898, " solved", false], [53248, 0.014591, " usually", false]]], "model_b": [46840, 2, 0.17108111083507538, [[31702, 0.199884, " play", false], [46840, 0.171081, " played", false], [32462, 0.060422, " were", false], [40219, 0.055806, " would", false], [21795, 0.052672, " had", false], [55448, 0.036247, " actually", false], [53137, 0.030561, " thought", false], [53248, 0.019501, " usually", false], [4596, 0.015636, " in", false], [60687, 0.015509, " typically", false]]]}, "raw_delta": -0.10044642857142859, "tuned_delta": -0.046356831156353}, {"byte_start": 2010, "byte_end": 2016, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 348, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "1.20% 1.20% 1.20% 1.20% 1.20% 1.20%", "model_b": "1.55% 1.55% 1.55% 1.55% 1.55% 1.55%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.6706175804138184]], "model_b": [[38013, " chess", "normal", 0.5911086797714233]]}, "loss": {"model_a": 1.2034199356373594, "model_b": 1.549770063454941}, "topk": {"model_a": [38013, 1, 0.6706175804138184, [[38013, 0.670618, " chess", false], [47, 0.164079, ".", false], [22590, 0.09552, " the", false], [45, 0.022467, ",", false], [275, 0.007571, " (", false], [4715, 0.005695, " or", false], [21265, 0.005432, " and", false], [4596, 0.002739, " in", false], [38576, 0.002639, " games", false], [60, 0.002549, ";", false]]], "model_b": [38013, 1, 0.5911086797714233, [[38013, 0.591109, " chess", false], [47, 0.158089, ".", false], [22590, 0.105069, " the", false], [4601, 0.02168, " it", false], [45, 0.018217, ",", false], [4596, 0.013606, " in", false], [39931, 0.008092, " their", false], [4424, 0.005561, " at", false], [55809, 0.004729, " computer", false], [38576, 0.004521, " games", false]]]}, "raw_delta": -0.01920572916666667, "tuned_delta": 0.03488386824840892}, {"byte_start": 2016, "byte_end": 2017, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "4.93%", "model_b": "8.56%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7578884959220886]], "model_b": [[47, ".", "normal", 0.6236730813980103]]}, "loss": {"model_a": 4.931086565538449, "model_b": 8.55895739589888}, "topk": {"model_a": [47, 1, 0.7578884959220886, [[47, 0.757888, ".", false], [45, 0.108649, ",", false], [275, 0.028499, " (", false], [45179, 0.014494, " anyway", false], [34, 0.013592, "!", false], [4596, 0.010393, " in", false], [21265, 0.010356, " and", false], [60, 0.007991, ";", false], [4715, 0.005646, " or", false], [4788, 0.003098, " so", false]]], "model_b": [47, 1, 0.6236730813980103, [[47, 0.623673, ".", false], [45, 0.080792, ",", false], [4596, 0.051386, " in", false], [50931, 0.023277, " anymore", false], [45179, 0.019447, " anyway", false], [34, 0.017498, "!", false], [4424, 0.014355, " at", false], [275, 0.012267, " (", false], [21700, 0.011709, " for", false], [60, 0.009394, ";", false]]]}, "raw_delta": -0.201171875, "tuned_delta": -0.14708227758492443}, {"byte_start": 2017, "byte_end": 2023, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 349, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"model_a": "13.43% 13.43% 13.43% 13.43% 13.43% 13.43%", "model_b": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"model_a": [[37453, " These", "normal", 0.011329433880746365]], "model_b": [[37453, " These", "normal", 0.015510297380387783]]}, "loss": {"model_a": 13.43134054994282, "model_b": 12.492085966030738}, "topk": {"model_a": [37453, 15, 0.011329433880746365, [[261, 0.154872, "\n\n", false], [29893, 0.095155, " They", false], [267, 0.074251, "  ", false], [20996, 0.072246, " The", false], [19555, 0.042003, " But", false], [29894, 0.039349, " This", false], [3913, 0.037968, " In", false], [3918, 0.028282, " It", false], [275, 0.022757, " (", false], [19417, 0.017849, " And", false]]], "model_b": [37453, 11, 0.015510297380387783, [[261, 0.106931, "\n\n", false], [20996, 0.087469, " The", false], [29893, 0.086363, " They", false], [267, 0.078928, "  ", false], [3913, 0.04852, " In", false], [3918, 0.038553, " It", false], [11, 0.035409, "\n", false], [29894, 0.035352, " This", false], [19417, 0.027121, " And", false], [19555, 0.015753, " But", false]]]}, "raw_delta": 0.05208333333333326, "tuned_delta": 0.10617293074840885}, {"byte_start": 2023, "byte_end": 2035, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 350, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90%", "model_b": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.14677117764949799]], "model_b": [[63843, " researchers", "normal", 0.14784522354602814]]}, "loss": {"model_a": 2.899948527828564, "model_b": 2.8764671632307612}, "topk": {"model_a": [63843, 1, 0.14677117764949799, [[63843, 0.146771, " researchers", false], [46787, 0.141002, " people", false], [32462, 0.086447, " were", false], [38720, 0.06432, " human", false], [38013, 0.025646, " chess", false], [31937, 0.024281, " same", false], [21286, 0.023734, " are", false], [59165, 0.023505, " arguments", false], [40119, 0.016835, " views", false], [61803, 0.015363, " criticisms", false]]], "model_b": [63843, 1, 0.14784522354602814, [[63843, 0.147845, " researchers", false], [38720, 0.094914, " human", false], [46787, 0.087448, " people", false], [38013, 0.06465, " chess", false], [32462, 0.043961, " were", false], [52224, 0.043885, " methods", false], [21286, 0.033083, " are", false], [22638, 0.019777, " two", false], [55809, 0.019599, " computer", false], [52489, 0.017868, " players", false]]]}, "raw_delta": 0.0013020833333333148, "tuned_delta": 0.0553916807484089}, {"byte_start": 2035, "byte_end": 2042, "display": {"text": " wanted", "kind": "normal"}, "is_word": true, "word_id": 351, "word_key": " wanted", "bytes_hex": "20 77 61 6e 74 65 64", "compression": {"model_a": "14.97% 14.97% 14.97% 14.97% 14.97% 14.97% 14.97%", "model_b": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65%"}, "model_tokens": {"model_a": [[47763, " wanted", "normal", 0.002969448920339346]], "model_b": [[47763, " wanted", "normal", 0.003409898141399026]]}, "loss": {"model_a": 14.974401652084108, "model_b": 14.652371509028534}, "topk": {"model_a": [47763, 48, 0.002969448920339346, [[32462, 0.22819, " were", false], [21795, 0.087504, " had", false], [40, 0.058233, "'", false], [21532, 0.042336, " did", false], [45, 0.034351, ",", false], [31059, 0.020011, " have", false], [21286, 0.019543, " are", false], [40219, 0.017185, " would", false], [30135, 0.015096, " also", false], [38128, 0.012906, " could", false]]], "model_b": [47763, 48, 0.003409898141399026, [[32462, 0.197857, " were", false], [21795, 0.06933, " had", false], [45, 0.048457, ",", false], [21532, 0.030827, " did", false], [30135, 0.023736, " also", false], [21286, 0.01953, " are", false], [31059, 0.016885, " have", false], [55616, 0.016637, " believed", false], [31220, 0.01416, " knew", false], [22439, 0.013713, " saw", false]]]}, "raw_delta": 0.017857142857142905, "tuned_delta": 0.07194674027221849}, {"byte_start": 2042, "byte_end": 2050, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 352, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72%", "model_b": "13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.013591461814939976]], "model_b": [[52224, " methods", "normal", 0.002716091461479664]]}, "loss": {"model_a": 9.721284943490085, "model_b": 13.313933726953811}, "topk": {"model_a": [52224, 6, 0.013591461814939976, [[4811, 0.664396, " to", false], [332, 0.068835, " a", false], [39931, 0.060808, " their", false], [22590, 0.029243, " the", false], [38013, 0.016546, " chess", false], [52224, 0.013591, " methods", false], [4419, 0.013344, " an", false], [31458, 0.009715, " more", false], [45, 0.007355, ",", false], [38720, 0.007183, " human", false]]], "model_b": [52224, 19, 0.002716091461479664, [[4811, 0.633568, " to", false], [332, 0.082228, " a", false], [22590, 0.052206, " the", false], [39931, 0.033106, " their", false], [4404, 0.013824, " ``", false], [4419, 0.012182, " an", false], [31458, 0.010221, " more", false], [60522, 0.010023, " something", false], [38013, 0.007925, " chess", false], [38720, 0.007883, " human", false]]]}, "raw_delta": -0.19921875, "tuned_delta": -0.14512915258492443}, {"byte_start": 2050, "byte_end": 2056, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 353, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "9.06% 9.06% 9.06% 9.06% 9.06% 9.06%", "model_b": "9.25% 9.25% 9.25% 9.25% 9.25% 9.25%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.0484761968255043]], "model_b": [[37810, " based", "normal", 0.046119190752506256]]}, "loss": {"model_a": 9.063806734751624, "model_b": 9.251657651534043}, "topk": {"model_a": [37810, 3, 0.0484761968255043, [[32227, 0.763646, " that", false], [4811, 0.075396, " to", false], [37810, 0.048476, " based", false], [21700, 0.030739, " for", false], [4706, 0.011632, " of", false], [32232, 0.009019, " they", false], [32487, 0.005753, " with", false], [4596, 0.004702, " in", false], [45, 0.003848, ",", false], [31458, 0.003551, " more", false]]], "model_b": [37810, 3, 0.046119190752506256, [[32227, 0.771056, " that", false], [4811, 0.061495, " to", false], [37810, 0.046119, " based", false], [32487, 0.01205, " with", false], [21700, 0.011619, " for", false], [4596, 0.009592, " in", false], [4706, 0.006764, " of", false], [31296, 0.0047, " like", false], [40186, 0.00389, " which", false], [45, 0.003656, ",", false]]]}, "raw_delta": -0.01041666666666674, "tuned_delta": 0.04367293074840885}, {"byte_start": 2056, "byte_end": 2059, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 354, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.19% 0.19% 0.19%", "model_b": "0.45% 0.45% 0.45%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9695175290107727]], "model_b": [[4712, " on", "normal", 0.9278945922851562]]}, "loss": {"model_a": 0.18564953885137314, "model_b": 0.44908109793296586}, "topk": {"model_a": [4712, 1, 0.9695175290107727, [[4712, 0.969518, " on", false], [32350, 0.006262, " upon", false], [31458, 0.005079, " more", false], [4596, 0.003877, " in", false], [22187, 0.003003, " not", false], [31581, 0.001197, " only", false], [56003, 0.001081, " directly", false], [46957, 0.000884, " purely", false], [52028, 0.00077, " instead", false], [4423, 0.000643, " as", false]]], "model_b": [4712, 1, 0.9278945922851562, [[4712, 0.927895, " on", false], [32350, 0.017534, " upon", false], [47330, 0.011441, " solely", false], [4596, 0.0083, " in", false], [45202, 0.005005, " around", false], [46957, 0.003843, " purely", false], [31581, 0.003676, " only", false], [31458, 0.003253, " more", false], [22187, 0.001871, " not", false], [56003, 0.001682, " directly", false]]]}, "raw_delta": -0.014607747395833334, "tuned_delta": 0.03948185001924225}, {"byte_start": 2059, "byte_end": 2065, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 355, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15%", "model_b": "8.27% 8.27% 8.27% 8.27% 8.27% 8.27%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.35164931416511536]], "model_b": [[38720, " human", "normal", 0.0626552477478981]]}, "loss": {"model_a": 3.146502856105486, "model_b": 8.265440338426352}, "topk": {"model_a": [38720, 1, 0.35164931416511536, [[38720, 0.351649, " human", false], [39931, 0.106248, " their", false], [22590, 0.074814, " the", false], [65034, 0.047961, " understanding", false], [51832, 0.034556, " general", false], [30597, 0.030661, " deep", false], [332, 0.028802, " a", false], [38013, 0.024469, " chess", false], [59943, 0.020981, " knowledge", false], [32464, 0.013386, " what", false]]], "model_b": [38720, 3, 0.0626552477478981, [[51832, 0.178868, " general", false], [30597, 0.165952, " deep", false], [38720, 0.062655, " human", false], [22590, 0.054619, " the", false], [52195, 0.029506, " massive", false], [37920, 0.026978, " brute", false], [332, 0.025243, " a", false], [38888, 0.018927, " lever", false], [4404, 0.017547, " ``", false], [47202, 0.014349, " search", false]]]}, "raw_delta": -0.2838541666666666, "tuned_delta": -0.229764569251591}, {"byte_start": 2065, "byte_end": 2071, "display": {"text": " input", "kind": "normal"}, "is_word": true, "word_id": 356, "word_key": " input", "bytes_hex": "20 69 6e 70 75 74", "compression": {"model_a": "25.55% 25.55% 25.55% 25.55% 25.55% 25.55%", "model_b": "22.35% 22.35% 22.35% 22.35% 22.35% 22.35%"}, "model_tokens": {"model_a": [[38786, " input", "normal", 0.0002019024977926165]], "model_b": [[38786, " input", "normal", 0.0005947783356532454]]}, "loss": {"model_a": 25.547724682408727, "model_b": 22.354259097107633}, "topk": {"model_a": [38786, 72, 0.0002019024977926165, [[59943, 0.43564, " knowledge", false], [65034, 0.339619, " understanding", false], [59683, 0.040743, " expertise", false], [46, 0.034344, "-", false], [38013, 0.02655, " chess", false], [31702, 0.014614, " play", false], [59917, 0.010166, " intuition", false], [62418, 0.007823, " psychology", false], [60323, 0.00728, " reasoning", false], [52022, 0.00606, " insight", false]]], "model_b": [38786, 44, 0.0005947783356532454, [[59943, 0.538765, " knowledge", false], [65034, 0.214749, " understanding", false], [46, 0.097981, "-", false], [59917, 0.013525, " intuition", false], [64452, 0.00829, " intelligence", false], [52022, 0.007257, " insight", false], [56537, 0.00677, " learning", false], [59683, 0.006533, " expertise", false], [59304, 0.005362, " cognition", false], [47802, 0.004984, " wisdom", false]]]}, "raw_delta": 0.17708333333333348, "tuned_delta": 0.23117293074840906}, {"byte_start": 2071, "byte_end": 2074, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 357, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "16.06% 16.06% 16.06%", "model_b": "9.53% 9.53% 9.53%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.0680377185344696]], "model_b": [[4811, " to", "normal", 0.20497405529022217]]}, "loss": {"model_a": 16.061253384896663, "model_b": 9.533434026707669}, "topk": {"model_a": [4811, 5, 0.0680377185344696, [[45, 0.329605, ",", false], [21265, 0.164667, " and", false], [47, 0.136455, ".", false], [32227, 0.082538, " that", false], [4811, 0.068038, " to", false], [4706, 0.038071, " of", false], [31162, 0.033628, " into", false], [60, 0.01405, ";", false], [47001, 0.012615, " rather", false], [275, 0.01243, " (", false]]], "model_b": [4811, 2, 0.20497405529022217, [[45, 0.209931, ",", false], [4811, 0.204974, " to", false], [32227, 0.109403, " that", false], [47, 0.109395, ".", false], [21265, 0.103822, " and", false], [31162, 0.02818, " into", false], [4596, 0.016012, " in", false], [47001, 0.014765, " rather", false], [275, 0.013453, " (", false], [4706, 0.012859, " of", false]]]}, "raw_delta": 0.3619791666666667, "tuned_delta": 0.41606876408174226}, {"byte_start": 2074, "byte_end": 2078, "display": {"text": " win", "kind": "normal"}, "is_word": true, "word_id": 358, "word_key": " win", "bytes_hex": "20 77 69 6e", "compression": {"model_a": "12.05% 12.05% 12.05% 12.05%", "model_b": "14.72% 14.72% 14.72% 14.72%"}, "model_tokens": {"model_a": [[22770, " win", "normal", 0.06979643553495407]], "model_b": [[22770, " win", "normal", 0.03799634799361229]]}, "loss": {"model_a": 12.045940038672496, "model_b": 14.722815602821939}, "topk": {"model_a": [22770, 3, 0.06979643553495407, [[4435, 0.203171, " be", false], [22590, 0.109735, " the", false], [22770, 0.069796, " win", false], [30256, 0.033785, " beat", false], [38013, 0.027678, " chess", false], [47059, 0.026664, " remain", false], [31702, 0.020708, " play", false], [51982, 0.020194, " improve", false], [55851, 0.018556, " continue", false], [32499, 0.015507, " work", false]]], "model_b": [22770, 2, 0.03799634799361229, [[4435, 0.277594, " be", false], [22770, 0.037996, " win", false], [22590, 0.031214, " the", false], [56540, 0.031115, " leverage", false], [31059, 0.028381, " have", false], [31358, 0.02589, " make", false], [31702, 0.024583, " play", false], [47059, 0.02383, " remain", false], [51982, 0.02245, " improve", false], [32499, 0.018856, " work", false]]]}, "raw_delta": -0.1484375, "tuned_delta": -0.09434790258492441}, {"byte_start": 2078, "byte_end": 2082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 359, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "26.21% 26.21% 26.21% 26.21%", "model_b": "19.87% 19.87% 19.87% 19.87%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.0029539780225604773]], "model_b": [[21265, " and", "normal", 0.012039311230182648]]}, "loss": {"model_a": 26.205202891147184, "model_b": 19.86523444974061}, "topk": {"model_a": [21265, 23, 0.0029539780225604773, [[22590, 0.176022, " the", false], [45, 0.160544, ",", false], [37635, 0.139895, " again", false], [4596, 0.122245, " in", false], [38013, 0.09006, " chess", false], [47, 0.071366, ".", false], [50870, 0.026514, " against", false], [46064, 0.024483, " future", false], [4424, 0.015812, " at", false], [4712, 0.01217, " on", false]]], "model_b": [21265, 14, 0.012039311230182648, [[45, 0.182991, ",", false], [47, 0.176139, ".", false], [22590, 0.10716, " the", false], [38013, 0.059687, " chess", false], [4596, 0.056955, " in", false], [50870, 0.055918, " against", false], [38576, 0.019201, " games", false], [31458, 0.017787, " more", false], [31601, 0.016975, " over", false], [332, 0.015638, " a", false]]]}, "raw_delta": 0.3515625, "tuned_delta": 0.4056520974150756}, {"byte_start": 2082, "byte_end": 2087, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 360, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "10.03% 10.03% 10.03% 10.03% 10.03%", "model_b": "10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.06204770505428314]], "model_b": [[32462, " were", "normal", 0.059402503073215485]]}, "loss": {"model_a": 10.031238956181074, "model_b": 10.200304781285249}, "topk": {"model_a": [32462, 3, 0.06204770505428314, [[32232, 0.132566, " they", false], [45, 0.070691, ",", false], [32462, 0.062048, " were", false], [4811, 0.049485, " to", false], [22187, 0.030569, " not", false], [4788, 0.027509, " so", false], [21795, 0.026674, " had", false], [21532, 0.021734, " did", false], [22777, 0.021721, " won", false], [22590, 0.020569, " the", false]]], "model_b": [32462, 2, 0.059402503073215485, [[32232, 0.094017, " they", false], [32462, 0.059403, " were", false], [22187, 0.055454, " not", false], [4811, 0.049565, " to", false], [45, 0.031681, ",", false], [21532, 0.018652, " did", false], [21795, 0.017254, " had", false], [22590, 0.016905, " the", false], [47763, 0.014397, " wanted", false], [40219, 0.01386, " would", false]]]}, "raw_delta": -0.009375000000000022, "tuned_delta": 0.044714597415075566}, {"byte_start": 2087, "byte_end": 2100, "display": {"text": " disappointed", "kind": "normal"}, "is_word": true, "word_id": 361, "word_key": " disappointed", "bytes_hex": "20 64 69 73 61 70 70 6f 69 6e 74 65 64", "compression": {"model_a": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%", "model_b": "3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51% 3.51%"}, "model_tokens": {"model_a": [[64362, " disappointed", "normal", 0.03446732833981514]], "model_b": [[64362, " disappointed", "normal", 0.07878207415342331]]}, "loss": {"model_a": 4.660147743256117, "model_b": 3.511367136779027}, "topk": {"model_a": [64362, 3, 0.03446732833981514, [[22187, 0.217453, " not", false], [60713, 0.048667, " unwilling", false], [64362, 0.034467, " disappointed", false], [32239, 0.029944, " thus", false], [53350, 0.022808, " willing", false], [62028, 0.019999, " frustrated", false], [45756, 0.014221, " dismay", false], [60374, 0.013732, " reluctant", false], [61853, 0.013632, " determined", false], [60645, 0.013492, " therefore", false]]], "model_b": [64362, 2, 0.07878207415342331, [[22187, 0.147246, " not", false], [64362, 0.078782, " disappointed", false], [53350, 0.043523, " willing", false], [60713, 0.0307, " unwilling", false], [62028, 0.022422, " frustrated", false], [45756, 0.020629, " dismay", false], [60601, 0.016312, " surprised", false], [40229, 0.015052, " wrong", false], [60645, 0.014324, " therefore", false], [38664, 0.013193, " happy", false]]]}, "raw_delta": 0.06370192307692311, "tuned_delta": 0.1177915204919987}, {"byte_start": 2100, "byte_end": 2105, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 362, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"model_a": "3.72% 3.72% 3.72% 3.72% 3.72%", "model_b": "3.78% 3.78% 3.78% 3.78% 3.78%"}, "model_tokens": {"model_a": [[32465, " when", "normal", 0.35685861110687256]], "model_b": [[32465, " when", "normal", 0.35188373923301697]]}, "loss": {"model_a": 3.719448152291858, "model_b": 3.7758034273265837}, "topk": {"model_a": [32465, 1, 0.35685861110687256, [[32465, 0.356859, " when", false], [32227, 0.257545, " that", false], [47, 0.097154, ".", false], [4811, 0.083437, " to", false], [4450, 0.061366, " by", false], [4596, 0.028412, " in", false], [45, 0.019553, ",", false], [4424, 0.019265, " at", false], [32487, 0.014428, " with", false], [21265, 0.012572, " and", false]]], "model_b": [32465, 1, 0.35188373923301697, [[32465, 0.351884, " when", false], [32227, 0.181129, " that", false], [4811, 0.129919, " to", false], [4450, 0.11098, " by", false], [47, 0.096264, ".", false], [32487, 0.042757, " with", false], [4596, 0.021586, " in", false], [45, 0.011407, ",", false], [4424, 0.010594, " at", false], [21265, 0.007729, " and", false]]]}, "raw_delta": -0.0031250000000000167, "tuned_delta": 0.05096459741507557}, {"byte_start": 2105, "byte_end": 2110, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 363, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"model_a": "4.14% 4.14% 4.14% 4.14% 4.14%", "model_b": "4.09% 4.09% 4.09% 4.09% 4.09%"}, "model_tokens": {"model_a": [[32232, " they", "normal", 0.31571972370147705]], "model_b": [[32232, " they", "normal", 0.32408860325813293]]}, "loss": {"model_a": 4.1421127150522965, "model_b": 4.085757440017572}, "topk": {"model_a": [32232, 1, 0.31571972370147705, [[32232, 0.31572, " they", false], [22590, 0.131504, " the", false], [37920, 0.105664, " brute", false], [4601, 0.061405, " it", false], [39931, 0.056841, " their", false], [332, 0.049243, " a", false], [47202, 0.029884, " search", false], [52224, 0.027449, " methods", false], [32234, 0.026024, " this", false], [32227, 0.021355, " that", false]]], "model_b": [32232, 1, 0.32408860325813293, [[32232, 0.324089, " they", false], [22590, 0.122936, " the", false], [32234, 0.062629, " this", false], [32227, 0.048083, " that", false], [39931, 0.042469, " their", false], [4601, 0.042464, " it", false], [39936, 0.03038, " these", false], [39944, 0.026643, " those", false], [332, 0.023241, " a", false], [38720, 0.023109, " human", false]]]}, "raw_delta": 0.003124999999999989, "tuned_delta": 0.05721459741507558}, {"byte_start": 2110, "byte_end": 2114, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 364, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"model_a": "5.04% 5.04% 5.04% 5.04%", "model_b": "8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"model_a": [[21532, " did", "normal", 0.3273182213306427]], "model_b": [[21532, " did", "normal", 0.15639647841453552]]}, "loss": {"model_a": 5.036752706228558, "model_b": 8.418069208312065}, "topk": {"model_a": [21532, 1, 0.3273182213306427, [[21532, 0.327318, " did", false], [30633, 0.185, " didn", false], [31334, 0.114422, " lost", false], [45953, 0.111483, " failed", false], [32462, 0.064871, " were", false], [38128, 0.018362, " could", false], [38547, 0.016022, " found", false], [46936, 0.009529, " proved", false], [30383, 0.009396, " came", false], [45599, 0.008578, " couldn", false]]], "model_b": [21532, 2, 0.15639647841453552, [[32462, 0.158099, " were", false], [21532, 0.156396, " did", false], [38128, 0.087932, " could", false], [38547, 0.084503, " found", false], [45953, 0.071662, " failed", false], [31334, 0.062573, " lost", false], [22439, 0.061866, " saw", false], [21795, 0.043287, " had", false], [30633, 0.036449, " didn", false], [45599, 0.033806, " couldn", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13341040258492443}, {"byte_start": 2114, "byte_end": 2118, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 365, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "0.07% 0.07% 0.07% 0.07%", "model_b": "0.86% 0.86% 0.86% 0.86%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.9849550724029541]], "model_b": [[22187, " not", "normal", 0.8271129727363586]]}, "loss": {"model_a": 0.06824271586236245, "model_b": 0.8585373931071406}, "topk": {"model_a": [22187, 1, 0.9849550724029541, [[22187, 0.984955, " not", false], [47, 0.008415, ".", false], [4788, 0.001999, " so", false], [45, 0.00102, ",", false], [22770, 0.000965, " win", false], [45301, 0.000136, " better", false], [31332, 0.000135, " lose", false], [22590, 0.000112, " the", false], [4692, 0.000108, " no", false], [275, 0.000108, " (", false]]], "model_b": [22187, 1, 0.8271129727363586, [[22187, 0.827113, " not", false], [47, 0.114031, ".", false], [4788, 0.019375, " so", false], [45, 0.009983, ",", false], [22770, 0.00574, " win", false], [31332, 0.001779, " lose", false], [46866, 0.001636, " poorly", false], [21265, 0.001167, " and", false], [21751, 0.001119, " get", false], [30858, 0.001007, " find", false]]]}, "raw_delta": -0.0438232421875, "tuned_delta": 0.010266355227575588}, {"byte_start": 2118, "byte_end": 2119, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "2.84%", "model_b": "16.20%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8558160662651062]], "model_b": [[47, ".", "normal", 0.409647136926651]]}, "loss": {"model_a": 2.835374775184608, "model_b": 16.202141572483473}, "topk": {"model_a": [47, 1, 0.8558160662651062, [[47, 0.855816, ".", false], [45, 0.039462, ",", false], [22770, 0.031375, " win", false], [32499, 0.019109, " work", false], [4491, 0.004912, " do", false], [275, 0.0049, " (", false], [53051, 0.004546, " succeed", false], [60, 0.004252, ";", false], [4596, 0.002915, " in", false], [30482, 0.001322, " come", false]]], "model_b": [47, 1, 0.409647136926651, [[47, 0.409647, ".", false], [21751, 0.190958, " get", false], [22770, 0.094346, " win", false], [50848, 0.043843, " achieve", false], [53051, 0.030814, " succeed", false], [31059, 0.029234, " have", false], [4491, 0.024147, " do", false], [22449, 0.016898, " see", false], [30858, 0.016705, " find", false], [45, 0.016302, ",", false]]]}, "raw_delta": -0.7412109375, "tuned_delta": -0.6871213400849244}, {"byte_start": 2119, "byte_end": 2120, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "8.45%", "model_b": "12.61%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.3931463956832886]], "model_b": [[261, "\n\n", "control", 0.24868327379226685]]}, "loss": {"model_a": 8.45329125520877, "model_b": 12.609492789019747}, "topk": {"model_a": [261, 1, 0.3931463956832886, [[261, 0.393146, "\n\n", false], [267, 0.07657, "  ", false], [29893, 0.060086, " They", false], [20996, 0.041803, " The", false], [19555, 0.035121, " But", false], [29894, 0.034772, " This", false], [3913, 0.030426, " In", false], [3918, 0.019266, " It", false], [3336, 0.014494, " \n\n", false], [37449, 0.012445, " Their", false]]], "model_b": [261, 1, 0.24868327379226685, [[261, 0.248683, "\n\n", false], [267, 0.075584, "  ", false], [29893, 0.072627, " They", false], [20996, 0.057864, " The", false], [29894, 0.05394, " This", false], [11, 0.053058, "\n", false], [3913, 0.042999, " In", false], [3918, 0.023796, " It", false], [37449, 0.014655, " Their", false], [3336, 0.013712, " \n\n", false]]]}, "raw_delta": -0.23046875, "tuned_delta": -0.17637915258492443}, {"byte_start": 2120, "byte_end": 2121, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "8.45%", "model_b": "12.61%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.3931463956832886]], "model_b": [[261, "\n\n", "control", 0.24868327379226685]]}, "loss": {"model_a": 8.45329125520877, "model_b": 12.609492789019747}, "topk": {"model_a": [261, 1, 0.3931463956832886, [[261, 0.393146, "\n\n", false], [267, 0.07657, "  ", false], [29893, 0.060086, " They", false], [20996, 0.041803, " The", false], [19555, 0.035121, " But", false], [29894, 0.034772, " This", false], [3913, 0.030426, " In", false], [3918, 0.019266, " It", false], [3336, 0.014494, " \n\n", false], [37449, 0.012445, " Their", false]]], "model_b": [261, 1, 0.24868327379226685, [[261, 0.248683, "\n\n", false], [267, 0.075584, "  ", false], [29893, 0.072627, " They", false], [20996, 0.057864, " The", false], [29894, 0.05394, " This", false], [11, 0.053058, "\n", false], [3913, 0.042999, " In", false], [3918, 0.023796, " It", false], [37449, 0.014655, " Their", false], [3336, 0.013712, " \n\n", false]]]}, "raw_delta": -0.23046875, "tuned_delta": -0.17637915258492443}, {"byte_start": 2121, "byte_end": 2122, "display": {"text": "A", "kind": "normal"}, "is_word": true, "word_id": 366, "word_key": "a", "bytes_hex": "41", "compression": {"model_a": "51.57%", "model_b": "62.55%"}, "model_tokens": {"model_a": [[66, "A", "normal", 0.0568917877972126]], "model_b": [[66, "A", "normal", 0.03149300813674927]]}, "loss": {"model_a": 51.56507665677349, "model_b": 62.55435528854489}, "topk": {"model_a": [66, 3, 0.0568917877972126, [[1136, 0.297876, "In", false], [6699, 0.154795, "The", false], [66, 0.056892, "A", false], [58094, 0.043348, "Similarly", false], [24242, 0.03946, "This", false], [33504, 0.021774, "There", false], [1141, 0.01801, "It", false], [24327, 0.016703, "When", false], [6393, 0.011491, "One", false], [5658, 0.010754, "But", false]]], "model_b": [66, 4, 0.03149300813674927, [[1136, 0.264268, "In", false], [6699, 0.134055, "The", false], [24242, 0.053097, "This", false], [66, 0.031493, "A", false], [24327, 0.016594, "When", false], [33504, 0.015093, "There", false], [6393, 0.014883, "One", false], [1141, 0.012094, "It", false], [58094, 0.011883, "Similarly", false], [853, 0.01, "As", false]]]}, "raw_delta": -0.609375, "tuned_delta": -0.5552854025849244}, {"byte_start": 2122, "byte_end": 2130, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 367, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"model_a": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "model_b": "3.79% 3.79% 3.79% 3.79% 3.79% 3.79% 3.79% 3.79%"}, "model_tokens": {"model_a": [[52906, " similar", "normal", 0.5198955535888672]], "model_b": [[52906, " similar", "normal", 0.18641811609268188]]}, "loss": {"model_a": 1.4705204579373587, "model_b": 3.7863700413955943}, "topk": {"model_a": [52906, 1, 0.5198955535888672, [[52906, 0.519896, " similar", false], [31458, 0.041951, " more", false], [21674, 0.032268, " few", false], [52693, 0.030508, " related", false], [47205, 0.024086, " second", false], [32386, 0.017301, " very", false], [30992, 0.016075, " good", false], [59513, 0.01496, " different", false], [56812, 0.010946, " parallel", false], [21365, 0.010519, " bit", false]]], "model_b": [52906, 1, 0.18641811609268188, [[52906, 0.186418, " similar", false], [21674, 0.063715, " few", false], [31458, 0.062477, " more", false], [59513, 0.033032, " different", false], [47205, 0.032641, " second", false], [45674, 0.027455, " decade", false], [52693, 0.027333, " related", false], [38961, 0.017504, " major", false], [32386, 0.012634, " very", false], [45301, 0.012354, " better", false]]]}, "raw_delta": -0.12841796875, "tuned_delta": -0.07432837133492441}, {"byte_start": 2130, "byte_end": 2138, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 368, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"model_a": "7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15%", "model_b": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%"}, "model_tokens": {"model_a": [[52427, " pattern", "normal", 0.04210507869720459]], "model_b": [[52427, " pattern", "normal", 0.07108903676271439]]}, "loss": {"model_a": 7.15007552003075, "model_b": 5.952525925542842}, "topk": {"model_a": [52427, 5, 0.04210507869720459, [[39831, 0.281547, " story", false], [45315, 0.088449, " bitter", false], [60511, 0.079096, " situation", false], [65126, 0.055528, " disappointment", false], [52427, 0.042105, " pattern", false], [46430, 0.027427, " lesson", false], [30405, 0.021213, " case", false], [51668, 0.017758, " example", false], [45, 0.015309, ",", false], [57020, 0.01485, " reaction", false]]], "model_b": [52427, 5, 0.07108903676271439, [[46430, 0.130792, " lesson", false], [39831, 0.122112, " story", false], [60511, 0.097622, " situation", false], [51668, 0.072365, " example", false], [52427, 0.071089, " pattern", false], [62315, 0.031761, " phenomenon", false], [61979, 0.02422, " experience", false], [55574, 0.020656, " attitude", false], [30405, 0.017524, " case", false], [65126, 0.01501, " disappointment", false]]]}, "raw_delta": 0.06640625, "tuned_delta": 0.12049584741507559}, {"byte_start": 2138, "byte_end": 2141, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 369, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "17.09% 17.09% 17.09%", "model_b": "16.72% 16.72% 16.72%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.05823513865470886]], "model_b": [[4706, " of", "normal", 0.061589132994413376]]}, "loss": {"model_a": 17.094433427199956, "model_b": 16.718731593635123}, "topk": {"model_a": [4706, 7, 0.05823513865470886, [[56745, 0.179856, " occurred", false], [22748, 0.134576, " was", false], [4600, 0.088215, " is", false], [21413, 0.073263, " can", false], [46840, 0.064228, " played", false], [51585, 0.058998, " emerged", false], [4706, 0.058235, " of", false], [21800, 0.032277, " has", false], [50935, 0.02939, " appears", false], [46697, 0.027455, " occurs", false]]], "model_b": [4706, 4, 0.061589132994413376, [[21413, 0.167653, " can", false], [4600, 0.147674, " is", false], [22748, 0.082444, " was", false], [4706, 0.061589, " of", false], [45921, 0.052079, " exists", false], [56745, 0.048586, " occurred", false], [46697, 0.047575, " occurs", false], [21800, 0.047157, " has", false], [51585, 0.045753, " emerged", false], [46840, 0.043084, " played", false]]]}, "raw_delta": 0.02083333333333326, "tuned_delta": 0.07492293074840885}, {"byte_start": 2141, "byte_end": 2150, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 370, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71%", "model_b": "6.98% 6.98% 6.98% 6.98% 6.98% 6.98% 6.98% 6.98% 6.98%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.002921848325058818]], "model_b": [[57103, " research", "normal", 0.030826685950160027]]}, "loss": {"model_a": 11.709373812770664, "model_b": 6.981792407079834}, "topk": {"model_a": [57103, 25, 0.002921848325058818, [[45315, 0.352916, " bitter", false], [65126, 0.183364, " disappointment", false], [61640, 0.055511, " bitterness", false], [51708, 0.024754, " failure", false], [62500, 0.015933, " resistance", false], [38720, 0.01585, " human", false], [45685, 0.015144, " defeat", false], [45294, 0.010314, " belief", false], [55615, 0.010227, " behavior", false], [57419, 0.007118, " thinking", false]]], "model_b": [57103, 4, 0.030826685950160027, [[55615, 0.082904, " behavior", false], [65126, 0.064598, " disappointment", false], [51708, 0.034261, " failure", false], [57103, 0.030827, " research", false], [45315, 0.025562, " bitter", false], [3609, 0.023152, " AI", false], [56537, 0.022165, " learning", false], [62500, 0.019321, " resistance", false], [60363, 0.019092, " rejection", false], [38720, 0.015971, " human", false]]]}, "raw_delta": 0.26215277777777773, "tuned_delta": 0.3162423751928533}, {"byte_start": 2150, "byte_end": 2159, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 371, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"model_a": "12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27%", "model_b": "16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66%"}, "model_tokens": {"model_a": [[56950, " progress", "normal", 0.0022138170897960663]], "model_b": [[56950, " progress", "normal", 0.0002521340502426028]]}, "loss": {"model_a": 12.272926563117915, "model_b": 16.65611462137431}, "topk": {"model_a": [56950, 50, 0.0022138170897960663, [[51708, 0.153821, " failure", false], [65126, 0.131114, " disappointment", false], [22748, 0.063285, " was", false], [4600, 0.040835, " is", false], [21413, 0.035036, " can", false], [21265, 0.031881, " and", false], [46, 0.030735, "-", false], [4596, 0.024249, " in", false], [56745, 0.020649, " occurred", false], [21800, 0.020107, " has", false]]], "model_b": [56950, 263, 0.0002521340502426028, [[4600, 0.103452, " is", false], [22748, 0.086536, " was", false], [21413, 0.072379, " can", false], [21800, 0.059078, " has", false], [4596, 0.036967, " in", false], [45921, 0.035202, " exists", false], [56745, 0.02645, " occurred", false], [21265, 0.025689, " and", false], [51585, 0.023867, " emerged", false], [4712, 0.023555, " on", false]]]}, "raw_delta": -0.24305555555555555, "tuned_delta": -0.18896595814047995}, {"byte_start": 2159, "byte_end": 2163, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 372, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "8.31% 8.31% 8.31% 8.31%", "model_b": "9.86% 9.86% 9.86% 9.86%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.15902355313301086]], "model_b": [[22748, " was", "normal", 0.11206827312707901]]}, "loss": {"model_a": 8.312403067621956, "model_b": 9.862173131076897}, "topk": {"model_a": [22748, 1, 0.15902355313301086, [[22748, 0.159024, " was", false], [4596, 0.121666, " in", false], [21413, 0.115618, " can", false], [4600, 0.104086, " is", false], [56745, 0.097474, " occurred", false], [21800, 0.047412, " has", false], [21265, 0.047105, " and", false], [45, 0.020773, ",", false], [46840, 0.016361, " played", false], [51585, 0.015945, " emerged", false]]], "model_b": [22748, 2, 0.11206827312707901, [[4600, 0.130396, " is", false], [22748, 0.112068, " was", false], [21413, 0.106051, " can", false], [56745, 0.067367, " occurred", false], [21800, 0.065746, " has", false], [21265, 0.049793, " and", false], [4596, 0.042238, " in", false], [45, 0.03027, ",", false], [56255, 0.028702, " followed", false], [45921, 0.021559, " exists", false]]]}, "raw_delta": -0.0859375, "tuned_delta": -0.03184790258492441}, {"byte_start": 2163, "byte_end": 2168, "display": {"text": " seen", "kind": "normal"}, "is_word": true, "word_id": 373, "word_key": " seen", "bytes_hex": "20 73 65 65 6e", "compression": {"model_a": "3.30% 3.30% 3.30% 3.30% 3.30%", "model_b": "5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"model_a": [[31968, " seen", "normal", 0.4029674828052521]], "model_b": [[31968, " seen", "normal", 0.24821822345256805]]}, "loss": {"model_a": 3.2967835895314197, "model_b": 5.043797115607899}, "topk": {"model_a": [31968, 1, 0.4029674828052521, [[31968, 0.402967, " seen", false], [51661, 0.141165, " evident", false], [56734, 0.110823, " observed", false], [57093, 0.04144, " repeated", false], [56255, 0.039543, " followed", false], [38547, 0.027996, " found", false], [55524, 0.02218, " apparent", false], [53296, 0.021982, " visible", false], [59676, 0.010409, " exhibited", false], [22590, 0.00836, " the", false]]], "model_b": [31968, 2, 0.24821822345256805, [[56734, 0.270738, " observed", false], [31968, 0.248218, " seen", false], [51661, 0.091382, " evident", false], [38547, 0.036643, " found", false], [55524, 0.021574, " apparent", false], [30135, 0.017256, " also", false], [39140, 0.016477, " noted", false], [56255, 0.015938, " followed", false], [53296, 0.01318, " visible", false], [22590, 0.011978, " the", false]]]}, "raw_delta": -0.09687499999999999, "tuned_delta": -0.0427854025849244}, {"byte_start": 2168, "byte_end": 2171, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 374, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "0.73% 0.73% 0.73%", "model_b": "1.36% 1.36% 1.36%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.8845621347427368]], "model_b": [[4596, " in", "normal", 0.7961896061897278]]}, "loss": {"model_a": 0.7337926436813167, "model_b": 1.3560488055230733}, "topk": {"model_a": [4596, 1, 0.8845621347427368, [[4596, 0.884562, " in", false], [32487, 0.042789, " with", false], [32465, 0.010809, " when", false], [21700, 0.008234, " for", false], [4424, 0.004667, " at", false], [45, 0.004451, ",", false], [45805, 0.004283, " during", false], [45202, 0.002929, " around", false], [31601, 0.002847, " over", false], [4712, 0.002664, " on", false]]], "model_b": [4596, 1, 0.7961896061897278, [[4596, 0.79619, " in", false], [32487, 0.087676, " with", false], [32465, 0.018634, " when", false], [21700, 0.009946, " for", false], [4424, 0.006633, " at", false], [37634, 0.00648, " after", false], [37694, 0.005969, " among", false], [45805, 0.00564, " during", false], [45093, 0.005557, " across", false], [31601, 0.004665, " over", false]]]}, "raw_delta": -0.034505208333333336, "tuned_delta": 0.019584389081742253}, {"byte_start": 2171, "byte_end": 2180, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 375, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.14471325278282166]], "model_b": [[55809, " computer", "normal", 0.04509180411696434]]}, "loss": {"model_a": 3.8665980371047524, "model_b": 6.199080253819764}, "topk": {"model_a": [55809, 2, 0.14471325278282166, [[22590, 0.245204, " the", false], [55809, 0.144713, " computer", false], [52167, 0.044997, " machine", false], [3609, 0.037594, " AI", false], [38328, 0.035455, " early", false], [52299, 0.032372, " natural", false], [3851, 0.028316, " Go", false], [45929, 0.023532, " expert", false], [30941, 0.020615, " game", false], [61594, 0.018992, " artificial", false]]], "model_b": [55809, 4, 0.04509180411696434, [[22590, 0.200719, " the", false], [65003, 0.108099, " reinforcement", false], [39193, 0.05891, " other", false], [55809, 0.045092, " computer", false], [3609, 0.039075, " AI", false], [52167, 0.038428, " machine", false], [52299, 0.032573, " natural", false], [38744, 0.02676, " image", false], [31370, 0.016008, " many", false], [61594, 0.015422, " artificial", false]]]}, "raw_delta": -0.1293402777777778, "tuned_delta": -0.0752506803627022}, {"byte_start": 2180, "byte_end": 2183, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 376, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"model_a": "4.27% 4.27% 4.27%", "model_b": "32.50% 32.50% 32.50%"}, "model_tokens": {"model_a": [[3851, " Go", "normal", 0.4911113381385803]], "model_b": [[3851, " Go", "normal", 0.004526057746261358]]}, "loss": {"model_a": 4.273608356799989, "model_b": 32.49820860335816}, "topk": {"model_a": [3851, 1, 0.4911113381385803, [[3851, 0.491111, " Go", false], [46, 0.096961, "-", false], [52814, 0.053694, " science", false], [39311, 0.042617, " poker", false], [4559, 0.026011, " go", false], [38576, 0.0252, " games", false], [47732, 0.022105, " vision", false], [47350, 0.017712, " speech", false], [52491, 0.01751, " playing", false], [31044, 0.01627, " hand", false]]], "model_b": [3851, 27, 0.004526057746261358, [[47350, 0.124153, " speech", false], [46, 0.103143, "-", false], [47732, 0.082612, " vision", false], [56529, 0.050559, " language", false], [38576, 0.049769, " games", false], [52814, 0.034479, " science", false], [52491, 0.031029, " playing", false], [47202, 0.030155, " search", false], [39082, 0.029577, " music", false], [30941, 0.028603, " game", false]]]}, "raw_delta": -1.5651041666666667, "tuned_delta": -1.511014569251591}, {"byte_start": 2183, "byte_end": 2184, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "22.54%", "model_b": "24.94%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.28818774223327637]], "model_b": [[45, ",", "normal", 0.2501910924911499]]}, "loss": {"model_a": 22.542110013890053, "model_b": 24.93720920286587}, "topk": {"model_a": [45, 2, 0.28818774223327637, [[47, 0.545737, ".", false], [45, 0.288188, ",", false], [4596, 0.049747, " in", false], [21265, 0.020126, " and", false], [275, 0.01743, " (", false], [59, 0.016158, ":", false], [31601, 0.006594, " over", false], [332, 0.003671, " a", false], [30917, 0.003334, " from", false], [60, 0.002923, ";", false]]], "model_b": [45, 2, 0.2501910924911499, [[47, 0.620214, ".", false], [45, 0.250191, ",", false], [4596, 0.022606, " in", false], [21265, 0.017995, " and", false], [275, 0.015996, " (", false], [59, 0.009818, ":", false], [4423, 0.004668, " as", false], [32465, 0.004363, " when", false], [4424, 0.00425, " at", false], [40185, 0.003801, " where", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07872290258492441}, {"byte_start": 2184, "byte_end": 2189, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 377, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "26.83% 26.83% 26.83% 26.83% 26.83%", "model_b": "28.85% 28.85% 28.85% 28.85% 28.85%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.0005948423640802503]], "model_b": [[31581, " only", "normal", 0.0003290027379989624]]}, "loss": {"model_a": 26.825110916529162, "model_b": 28.853900817779266}, "topk": {"model_a": [31581, 58, 0.0005948423640802503, [[40185, 0.426502, " where", false], [40186, 0.09853, " which", false], [21265, 0.05285, " and", false], [4596, 0.051349, " in", false], [22590, 0.048452, " the", false], [32487, 0.037382, " with", false], [332, 0.028634, " a", false], [50919, 0.015959, " another", false], [32465, 0.015691, " when", false], [57295, 0.015006, " starting", false]]], "model_b": [31581, 114, 0.0003290027379989624, [[40185, 0.353599, " where", false], [40186, 0.105564, " which", false], [21265, 0.06975, " and", false], [332, 0.039648, " a", false], [32487, 0.039273, " with", false], [4596, 0.037782, " in", false], [22590, 0.035803, " the", false], [21400, 0.023658, " but", false], [4423, 0.014449, " as", false], [32465, 0.012168, " when", false]]]}, "raw_delta": -0.11250000000000004, "tuned_delta": -0.058410402584924456}, {"byte_start": 2189, "byte_end": 2197, "display": {"text": " delayed", "kind": "normal"}, "is_word": true, "word_id": 378, "word_key": " delayed", "bytes_hex": "20 64 65 6c 61 79 65 64", "compression": {"model_a": "13.74% 13.74% 13.74% 13.74% 13.74% 13.74% 13.74% 13.74%", "model_b": "17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54%"}, "model_tokens": {"model_a": [[51419, " delayed", "normal", 0.0022904397919774055]], "model_b": [[51419, " delayed", "normal", 0.0004149079031776637]]}, "loss": {"model_a": 13.73659828971425, "model_b": 17.540579354558197}, "topk": {"model_a": [51419, 44, 0.0022904397919774055, [[332, 0.104567, " a", false], [31458, 0.082089, " more", false], [32487, 0.068922, " with", false], [31466, 0.060723, " much", false], [38869, 0.051716, " later", false], [32234, 0.051586, " this", false], [57245, 0.038719, " slightly", false], [4596, 0.038426, " in", false], [22590, 0.037312, " the", false], [37598, 0.03605, " about", false]]], "model_b": [51419, 104, 0.0004149079031776637, [[32487, 0.146821, " with", false], [32234, 0.117647, " this", false], [4596, 0.074352, " in", false], [31277, 0.052209, " less", false], [31466, 0.049385, " much", false], [332, 0.043766, " a", false], [22590, 0.042992, " the", false], [22190, 0.036107, " now", false], [31458, 0.033763, " more", false], [32227, 0.03188, " that", false]]]}, "raw_delta": -0.2109375, "tuned_delta": -0.15684790258492443}, {"byte_start": 2197, "byte_end": 2200, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 379, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "3.19% 3.19% 3.19%", "model_b": "6.29% 6.29% 6.29%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.5878183245658875]], "model_b": [[4450, " by", "normal", 0.3499545454978943]]}, "loss": {"model_a": 3.193465585301091, "model_b": 6.293005712210972}, "topk": {"model_a": [4450, 1, 0.5878183245658875, [[4450, 0.587818, " by", false], [332, 0.081254, " a", false], [57263, 0.06127, " somewhat", false], [21700, 0.041814, " for", false], [51018, 0.03781, " because", false], [57245, 0.031974, " slightly", false], [47, 0.0227, ".", false], [40076, 0.022327, " until", false], [4596, 0.012012, " in", false], [21265, 0.011976, " and", false]]], "model_b": [4450, 1, 0.3499545454978943, [[4450, 0.349955, " by", false], [332, 0.08109, " a", false], [21700, 0.079952, " for", false], [40076, 0.073053, " until", false], [47, 0.051827, ".", false], [4811, 0.032457, " to", false], [21265, 0.031238, " and", false], [4596, 0.029526, " in", false], [57263, 0.0249, " somewhat", false], [45, 0.016473, ",", false]]]}, "raw_delta": -0.17187499999999997, "tuned_delta": -0.11778540258492438}, {"byte_start": 2200, "byte_end": 2202, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 380, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "11.06% 11.06%", "model_b": "17.47% 17.47%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.29469388723373413]], "model_b": [[332, " a", "normal", 0.1437380462884903]]}, "loss": {"model_a": 11.059722725564805, "model_b": 17.47013526076479}, "topk": {"model_a": [332, 1, 0.29469388723373413, [[332, 0.294694, " a", false], [37598, 0.13754, " about", false], [22590, 0.122066, " the", false], [52869, 0.073772, " several", false], [22638, 0.033299, " two", false], [3483, 0.028246, " 10", false], [31370, 0.022508, " many", false], [31458, 0.018281, " more", false], [32074, 0.016117, " some", false], [30869, 0.015442, " five", false]]], "model_b": [332, 2, 0.1437380462884903, [[22590, 0.297971, " the", false], [332, 0.143738, " a", false], [51396, 0.058055, " decades", false], [37598, 0.031181, " about", false], [31458, 0.028781, " more", false], [52869, 0.022096, " several", false], [40237, 0.019516, " years", false], [31370, 0.019008, " many", false], [22638, 0.01868, " two", false], [31601, 0.015907, " over", false]]]}, "raw_delta": -0.35546875, "tuned_delta": -0.3013791525849244}, {"byte_start": 2202, "byte_end": 2210, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 381, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"model_a": "14.51% 14.51% 14.51% 14.51% 14.51% 14.51% 14.51% 14.51%", "model_b": "10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"model_a": [[51816, " further", "normal", 0.0015914300456643105]], "model_b": [[51816, " further", "normal", 0.007771448232233524]]}, "loss": {"model_a": 14.51148332144172, "model_b": 10.918834537977993}, "topk": {"model_a": [51816, 14, 0.0015914300456643105, [[21674, 0.405744, " few", false], [45674, 0.309951, " decade", false], [45602, 0.109651, " couple", false], [32512, 0.038509, " year", false], [45950, 0.029282, " factor", false], [62035, 0.026727, " generation", false], [21365, 0.008774, " bit", false], [46454, 0.006501, " little", false], [46685, 0.005826, " number", false], [46530, 0.003238, " matter", false]]], "model_b": [51816, 13, 0.007771448232233524, [[45674, 0.384253, " decade", false], [21674, 0.192576, " few", false], [62035, 0.090725, " generation", false], [45602, 0.054211, " couple", false], [51158, 0.03168, " century", false], [21365, 0.014244, " bit", false], [32512, 0.013721, " year", false], [31323, 0.011277, " long", false], [46685, 0.010254, " number", false], [46454, 0.009832, " little", false]]]}, "raw_delta": 0.19921875, "tuned_delta": 0.2533083474150756}, {"byte_start": 2210, "byte_end": 2213, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 382, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"model_a": "21.32% 21.32% 21.32%", "model_b": "15.78% 15.78% 15.78%"}, "model_tokens": {"model_a": [[3493, " 20", "normal", 0.028869060799479485]], "model_b": [[3493, " 20", "normal", 0.07343742251396179]]}, "loss": {"model_a": 21.32107905480434, "model_b": 15.779477009723035}, "topk": {"model_a": [3493, 11, 0.028869060799479485, [[45674, 0.256186, " decade", false], [3483, 0.092028, " 10", false], [30869, 0.068324, " five", false], [22638, 0.057827, " two", false], [22583, 0.050065, " ten", false], [3488, 0.045831, " 15", false], [39946, 0.033846, " three", false], [30905, 0.032757, " four", false], [21674, 0.032355, " few", false], [39644, 0.032022, " seven", false]]], "model_b": [3493, 2, 0.07343742251396179, [[45674, 0.332488, " decade", false], [3493, 0.073437, " 20", false], [3503, 0.06305, " 30", false], [3483, 0.051979, " 10", false], [3543, 0.039776, " 70", false], [3513, 0.036991, " 40", false], [3523, 0.035895, " 50", false], [22583, 0.024358, " ten", false], [3488, 0.023878, " 15", false], [22638, 0.023789, " two", false]]]}, "raw_delta": 0.30729166666666674, "tuned_delta": 0.3613812640817423}, {"byte_start": 2213, "byte_end": 2219, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 383, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"model_a": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "model_b": "0.51% 0.51% 0.51% 0.51% 0.51% 0.51%"}, "model_tokens": {"model_a": [[40237, " years", "normal", 0.9501520395278931]], "model_b": [[40237, " years", "normal", 0.8429040312767029]]}, "loss": {"model_a": 0.1533626625293952, "model_b": 0.5107196800021965}, "topk": {"model_a": [40237, 1, 0.9501520395278931, [[40237, 0.950152, " years", false], [4715, 0.01547, " or", false], [46, 0.013147, "-", false], [44, 0.005844, "+", false], [49, 0.002858, "0", false], [620, 0.001895, "00", false], [4811, 0.001188, " to", false], [32512, 0.001152, " year", false], [46596, 0.000922, " months", false], [38, 0.000819, "%", false]]], "model_b": [40237, 1, 0.8429040312767029, [[40237, 0.842904, " years", false], [46, 0.048949, "-", false], [4715, 0.039465, " or", false], [4811, 0.026624, " to", false], [44, 0.02154, "+", false], [49, 0.004687, "0", false], [9815, 0.002466, "–", false], [32512, 0.002176, " year", false], [31709, 0.00204, " plus", false], [45, 0.001178, ",", false]]]}, "raw_delta": -0.01981608072916666, "tuned_delta": 0.03427351668590893}, {"byte_start": 2219, "byte_end": 2220, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.88%", "model_b": "9.37%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.719201385974884]], "model_b": [[47, ".", "normal", 0.5940296649932861]]}, "loss": {"model_a": 5.882081831749435, "model_b": 9.369064474523052}, "topk": {"model_a": [47, 1, 0.719201385974884, [[47, 0.719201, ".", false], [45, 0.076919, ",", false], [4715, 0.043867, " or", false], [51018, 0.027513, " because", false], [21572, 0.021136, " due", false], [21265, 0.018064, " and", false], [275, 0.017362, " (", false], [59, 0.013806, ":", false], [4706, 0.007526, " of", false], [37634, 0.006439, " after", false]]], "model_b": [47, 1, 0.5940296649932861, [[47, 0.59403, ".", false], [45, 0.090487, ",", false], [4715, 0.053563, " or", false], [40076, 0.034775, " until", false], [21265, 0.031182, " and", false], [21572, 0.02804, " due", false], [275, 0.022606, " (", false], [51018, 0.019256, " because", false], [32465, 0.013423, " when", false], [37634, 0.009314, " after", false]]]}, "raw_delta": -0.193359375, "tuned_delta": -0.13926977758492443}, {"byte_start": 2220, "byte_end": 2223, "display": {"text": " En", "kind": "normal"}, "is_word": true, "word_id": 384, "word_key": " en", "bytes_hex": "20 45 6e", "compression": {"model_a": "64.25% 64.25% 64.25%", "model_b": "60.86% 60.86% 60.86%"}, "model_tokens": {"model_a": [[3785, " En", "normal", 2.30054010899039e-05]], "model_b": [[3785, " En", "normal", 4.110014924663119e-05]]}, "loss": {"model_a": 64.24501353958665, "model_b": 60.86369703750314}, "topk": {"model_a": [3785, 910, 2.30054010899039e-05, [[20996, 0.178418, " The", false], [3913, 0.156782, " In", false], [37451, 0.027566, " There", false], [3851, 0.027197, " Go", false], [36251, 0.025745, " Again", false], [267, 0.025683, "  ", false], [300, 0.024986, " A", false], [30032, 0.023466, " When", false], [28753, 0.023235, " Deep", false], [29894, 0.022236, " This", false]]], "model_b": [3785, 716, 4.110014924663119e-05, [[3913, 0.168972, " In", false], [20996, 0.12202, " The", false], [3851, 0.107151, " Go", false], [267, 0.02962, "  ", false], [29894, 0.022398, " This", false], [3918, 0.021629, " It", false], [30032, 0.02022, " When", false], [37451, 0.019091, " There", false], [300, 0.018932, " A", false], [3642, 0.017813, " At", false]]]}, "raw_delta": 0.1875, "tuned_delta": 0.24158959741507557}, {"byte_start": 2223, "byte_end": 2226, "display": {"text": "orm", "kind": "normal"}, "is_word": true, "word_id": 385, "word_key": "orm", "bytes_hex": "6f 72 6d", "compression": {"model_a": "10.71% 10.71% 10.71%", "model_b": "21.79% 21.79% 21.79%"}, "model_tokens": {"model_a": [[8404, "orm", "normal", 0.16802969574928284]], "model_b": [[8404, "orm", "normal", 0.02686510607600212]]}, "loss": {"model_a": 10.707502256597774, "model_b": 21.79070634676038}, "topk": {"model_a": [8404, 2, 0.16802969574928284, [[26596, 0.450405, "ough", false], [8404, 0.16803, "orm", false], [35003, 0.112099, "light", false], [39552, 0.056283, " route", false], [34698, 0.039843, "igmat", false], [40885, 0.015508, "abling", false], [35590, 0.014525, "route", false], [54327, 0.013166, "rollment", false], [27567, 0.01029, "zyme", false], [2356, 0.010017, "zo", false]]], "model_b": [8404, 6, 0.02686510607600212, [[26883, 0.3439, "rico", false], [2356, 0.104485, "zo", false], [34698, 0.075443, "igmat", false], [46, 0.058524, "-", false], [7460, 0.028802, "emy", false], [8404, 0.026865, "orm", false], [112, 0.024956, "o", false], [35003, 0.021814, "light", false], [25758, 0.021072, "igma", false], [26596, 0.01688, "ough", false]]]}, "raw_delta": -0.6145833333333333, "tuned_delta": -0.5604937359182577}, {"byte_start": 2226, "byte_end": 2229, "display": {"text": "ous", "kind": "normal"}, "is_word": true, "word_id": 386, "word_key": "ous", "bytes_hex": "6f 75 73", "compression": {"model_a": "0.46% 0.46% 0.46%", "model_b": "0.64% 0.64% 0.64%"}, "model_tokens": {"model_a": [[8439, "ous", "normal", 0.9265947937965393]], "model_b": [[8439, "ous", "normal", 0.8984516859054565]]}, "loss": {"model_a": 0.46082178023186693, "model_b": 0.6369320147153829}, "topk": {"model_a": [8439, 1, 0.9265947937965393, [[8439, 0.926595, "ous", false], [35323, 0.072697, "ously", false], [2243, 0.000173, "us", false], [27340, 8.8e-05, "uous", false], [8435, 5.2e-05, "oul", false], [7933, 4.9e-05, "ity", false], [25902, 3.5e-05, "ious", false], [8440, 2.5e-05, "out", false], [2030, 2.2e-05, "ly", false], [7450, 2.2e-05, "ely", false]]], "model_b": [8439, 1, 0.8984516859054565, [[8439, 0.898452, "ous", false], [35323, 0.097101, "ously", false], [34889, 0.0021, "ities", false], [26610, 0.000287, "oust", false], [7933, 0.000223, "ity", false], [116, 0.000218, "s", false], [2104, 0.000206, "ou", false], [8415, 0.000149, "ose", false], [2243, 9.7e-05, "us", false], [2102, 7.8e-05, "os", false]]]}, "raw_delta": -0.009765624999999997, "tuned_delta": 0.04432397241507559}, {"byte_start": 2229, "byte_end": 2237, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 387, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"model_a": "15.29% 15.29% 15.29% 15.29% 15.29% 15.29% 15.29% 15.29%", "model_b": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91% 16.91% 16.91%"}, "model_tokens": {"model_a": [[52013, " initial", "normal", 0.0011326418025419116]], "model_b": [[52013, " initial", "normal", 0.0005470130708999932]]}, "loss": {"model_a": 15.286368353169191, "model_b": 16.90658251041754}, "topk": {"model_a": [52013, 64, 0.0011326418025419116, [[56950, 0.28901, " progress", false], [64423, 0.146597, " improvements", false], [51566, 0.040142, " efforts", false], [55465, 0.037863, " advances", false], [50897, 0.032676, " amounts", false], [63621, 0.031678, " improvement", false], [45829, 0.030438, " effort", false], [57103, 0.021281, " research", false], [45, 0.018387, ",", false], [38720, 0.015586, " human", false]]], "model_b": [52013, 103, 0.0005470130708999932, [[50897, 0.167788, " amounts", false], [55465, 0.109535, " advances", false], [45829, 0.063238, " effort", false], [56950, 0.061321, " progress", false], [51566, 0.060479, " efforts", false], [57103, 0.038806, " research", false], [64862, 0.037797, " computational", false], [64423, 0.032261, " improvements", false], [60406, 0.021763, " resources", false], [55809, 0.017081, " computer", false]]]}, "raw_delta": -0.08984375, "tuned_delta": -0.03575415258492441}, {"byte_start": 2237, "byte_end": 2245, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 388, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"model_a": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "model_b": "5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"model_a": [[51566, " efforts", "normal", 0.05230437591671944]], "model_b": [[51566, " efforts", "normal", 0.07790109515190125]]}, "loss": {"model_a": 6.656966863476906, "model_b": 5.741193644162623}, "topk": {"model_a": [51566, 5, 0.05230437591671944, [[56950, 0.35329, " progress", false], [62157, 0.129804, " investment", false], [63678, 0.083329, " investments", false], [53052, 0.064681, " success", false], [51566, 0.052304, " efforts", false], [57103, 0.04055, " research", false], [45829, 0.038126, " effort", false], [60587, 0.028781, " successes", false], [55465, 0.023761, " advances", false], [38575, 0.020554, " gains", false]]], "model_b": [51566, 4, 0.07790109515190125, [[55465, 0.102642, " advances", false], [56950, 0.100263, " progress", false], [45829, 0.097663, " effort", false], [51566, 0.077901, " efforts", false], [57103, 0.06897, " research", false], [62157, 0.063888, " investment", false], [38575, 0.048853, " gains", false], [61947, 0.045165, " enthusiasm", false], [63678, 0.037747, " investments", false], [64862, 0.019756, " computational", false]]]}, "raw_delta": 0.05078125, "tuned_delta": 0.10487084741507559}, {"byte_start": 2245, "byte_end": 2250, "display": {"text": " went", "kind": "normal"}, "is_word": true, "word_id": 389, "word_key": " went", "bytes_hex": "20 77 65 6e 74", "compression": {"model_a": "12.96% 12.96% 12.96% 12.96% 12.96%", "model_b": "19.27% 19.27% 19.27% 19.27% 19.27%"}, "model_tokens": {"model_a": [[32460, " went", "normal", 0.027259374037384987]], "model_b": [[32460, " went", "normal", 0.004818818066269159]]}, "loss": {"model_a": 12.96171325798678, "model_b": 19.273504061875997}, "topk": {"model_a": [32460, 7, 0.027259374037384987, [[32462, 0.22322, " were", false], [4811, 0.216341, " to", false], [4596, 0.091994, " in", false], [4424, 0.056441, " at", false], [4450, 0.055174, " by", false], [51770, 0.046341, " focused", false], [32460, 0.027259, " went", false], [37810, 0.023881, " based", false], [45, 0.021706, ",", false], [4712, 0.016341, " on", false]]], "model_b": [32460, 18, 0.004818818066269159, [[32462, 0.291657, " were", false], [4811, 0.273431, " to", false], [4596, 0.091051, " in", false], [4450, 0.059213, " by", false], [45, 0.02661, ",", false], [4424, 0.023108, " at", false], [21795, 0.019218, " had", false], [51770, 0.017275, " focused", false], [4712, 0.016932, " on", false], [32227, 0.009843, " that", false]]]}, "raw_delta": -0.3500000000000001, "tuned_delta": -0.2959104025849245}, {"byte_start": 2250, "byte_end": 2255, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 390, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"model_a": "0.73% 0.73% 0.73% 0.73% 0.73%", "model_b": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"model_a": [[31162, " into", "normal", 0.8183413147926331]], "model_b": [[31162, " into", "normal", 0.824995756149292]]}, "loss": {"model_a": 0.725574166072086, "model_b": 0.6973965285547234}, "topk": {"model_a": [31162, 1, 0.8183413147926331, [[31162, 0.818341, " into", false], [4811, 0.090753, " to", false], [47585, 0.044775, " toward", false], [53169, 0.01744, " towards", false], [4596, 0.015096, " in", false], [4712, 0.002648, " on", false], [56003, 0.00101, " directly", false], [52028, 0.000552, " instead", false], [45, 0.000477, ",", false], [38543, 0.000413, " forth", false]]], "model_b": [31162, 1, 0.824995756149292, [[31162, 0.824996, " into", false], [4811, 0.080152, " to", false], [47585, 0.04737, " toward", false], [53169, 0.02292, " towards", false], [37634, 0.004733, " after", false], [4596, 0.004642, " in", false], [4712, 0.002392, " on", false], [45302, 0.000819, " beyond", false], [56003, 0.000788, " directly", false], [4450, 0.000686, " by", false]]]}, "raw_delta": 0.0015625000000000014, "tuned_delta": 0.05565209741507559}, {"byte_start": 2255, "byte_end": 2264, "display": {"text": " avoiding", "kind": "normal"}, "is_word": true, "word_id": 391, "word_key": " avoiding", "bytes_hex": "20 61 76 6f 69 64 69 6e 67", "compression": {"model_a": "19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04%", "model_b": "18.66% 18.66% 18.66% 18.66% 18.66% 18.66% 18.66% 18.66% 18.66%"}, "model_tokens": {"model_a": [[55586, " avoiding", "normal", 7.312235538847744e-05]], "model_b": [[55586, " avoiding", "normal", 8.848893776303157e-05]]}, "loss": {"model_a": 19.03555956728493, "model_b": 18.6598577337201}, "topk": {"model_a": [55586, 585, 7.312235538847744e-05, [[52224, 0.124664, " methods", false], [61857, 0.076176, " developing", false], [38720, 0.066835, " human", false], [22590, 0.064859, " the", false], [47202, 0.035851, " search", false], [55882, 0.024303, " creating", false], [47629, 0.02362, " trying", false], [55666, 0.020139, " building", false], [59832, 0.019298, " improving", false], [55809, 0.017883, " computer", false]]], "model_b": [55586, 707, 8.848893776303157e-05, [[61857, 0.070464, " developing", false], [22590, 0.053191, " the", false], [30597, 0.04802, " deep", false], [52224, 0.034547, " methods", false], [47202, 0.03135, " search", false], [332, 0.030546, " a", false], [55666, 0.03052, " building", false], [60463, 0.026458, " searching", false], [59832, 0.024467, " improving", false], [51746, 0.024054, " finding", false]]]}, "raw_delta": 0.02083333333333326, "tuned_delta": 0.07492293074840885}, {"byte_start": 2264, "byte_end": 2271, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 392, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%", "model_b": "11.43% 11.43% 11.43% 11.43% 11.43% 11.43% 11.43%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.06380629539489746]], "model_b": [[47202, " search", "normal", 0.011659345589578152]]}, "loss": {"model_a": 7.084663147222587, "model_b": 11.432070078472808}, "topk": {"model_a": [47202, 3, 0.06380629539489746, [[22590, 0.329888, " the", false], [37920, 0.219049, " brute", false], [47202, 0.063806, " search", false], [38720, 0.031973, " human", false], [30597, 0.031087, " deep", false], [332, 0.017288, " a", false], [4404, 0.015733, " ``", false], [63370, 0.008384, " computation", false], [52195, 0.00834, " massive", false], [32234, 0.00729, " this", false]]], "model_b": [47202, 9, 0.011659345589578152, [[22590, 0.329557, " the", false], [37920, 0.043191, " brute", false], [38720, 0.041353, " human", false], [30597, 0.040075, " deep", false], [332, 0.038384, " a", false], [51832, 0.0316, " general", false], [4404, 0.020033, " ``", false], [65135, 0.01581, " generalization", false], [47202, 0.011659, " search", false], [32234, 0.010131, " this", false]]]}, "raw_delta": -0.24107142857142858, "tuned_delta": -0.18698183115635297}, {"byte_start": 2271, "byte_end": 2274, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 393, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "13.81% 13.81% 13.81%", "model_b": "16.81% 16.81% 16.81%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.09918215870857239]], "model_b": [[4450, " by", "normal", 0.061145003885030746]]}, "loss": {"model_a": 13.807042383507657, "model_b": 16.812657052026328}, "topk": {"model_a": [4450, 3, 0.09918215870857239, [[45, 0.234043, ",", false], [21265, 0.109957, " and", false], [4450, 0.099182, " by", false], [61566, 0.078327, " altogether", false], [47, 0.059861, ".", false], [46, 0.058658, "-", false], [52224, 0.04194, " methods", false], [56131, 0.040686, " entirely", false], [4424, 0.032649, " at", false], [4596, 0.029406, " in", false]]], "model_b": [4450, 4, 0.061145003885030746, [[46, 0.337535, "-", false], [45, 0.106264, ",", false], [21265, 0.068668, " and", false], [4450, 0.061145, " by", false], [52224, 0.05129, " methods", false], [4596, 0.05024, " in", false], [37810, 0.020702, " based", false], [61559, 0.018526, " algorithms", false], [47, 0.01845, ".", false], [62581, 0.017435, " strategies", false]]]}, "raw_delta": -0.16666666666666663, "tuned_delta": -0.11257706925159104}, {"byte_start": 2274, "byte_end": 2281, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 394, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"model_a": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "model_b": "14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25%"}, "model_tokens": {"model_a": [[47497, " taking", "normal", 0.002687763888388872]], "model_b": [[47497, " taking", "normal", 0.003944364842027426]]}, "loss": {"model_a": 15.215924259375784, "model_b": 14.249833830209065}, "topk": {"model_a": [47497, 58, 0.002687763888388872, [[40085, 0.080334, " using", false], [38720, 0.078829, " human", false], [31044, 0.077578, " hand", false], [38888, 0.037363, " lever", false], [47629, 0.025732, " trying", false], [46227, 0.022546, " humans", false], [61857, 0.021797, " developing", false], [38989, 0.021698, " means", false], [61984, 0.020016, " exploiting", false], [21273, 0.01784, " any", false]]], "model_b": [47497, 38, 0.003944364842027426, [[37920, 0.156618, " brute", false], [30597, 0.065576, " deep", false], [38720, 0.051642, " human", false], [332, 0.030006, " a", false], [46227, 0.027536, " humans", false], [22590, 0.024722, " the", false], [31044, 0.019228, " hand", false], [38888, 0.018142, " lever", false], [40085, 0.017994, " using", false], [52167, 0.011705, " machine", false]]]}, "raw_delta": 0.0535714285714286, "tuned_delta": 0.10766102598650419}, {"byte_start": 2281, "byte_end": 2291, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 395, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"model_a": "0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47%", "model_b": "1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15% 1.15%"}, "model_tokens": {"model_a": [[59093, " advantage", "normal", 0.7686576247215271]], "model_b": [[59093, " advantage", "normal", 0.5287151336669922]]}, "loss": {"model_a": 0.471975428415823, "model_b": 1.1482387288325249}, "topk": {"model_a": [59093, 1, 0.7686576247215271, [[59093, 0.768658, " advantage", false], [38720, 0.048083, " human", false], [332, 0.026224, " a", false], [22590, 0.017803, " the", false], [31044, 0.008921, " hand", false], [30923, 0.005653, " full", false], [4419, 0.004693, " an", false], [45929, 0.004575, " expert", false], [52964, 0.003557, " special", false], [39216, 0.003248, " pains", false]]], "model_b": [59093, 1, 0.5287151336669922, [[59093, 0.528715, " advantage", false], [332, 0.091275, " a", false], [22590, 0.059881, " the", false], [31162, 0.033416, " into", false], [4419, 0.018123, " an", false], [38720, 0.016447, " human", false], [63649, 0.014946, " inspiration", false], [30923, 0.014078, " full", false], [4596, 0.007176, " in", false], [31601, 0.006583, " over", false]]]}, "raw_delta": -0.0375, "tuned_delta": 0.01658959741507559}, {"byte_start": 2291, "byte_end": 2294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 396, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.03% 0.03% 0.03%", "model_b": "0.03% 0.03% 0.03%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9949083924293518]], "model_b": [[4706, " of", "normal", 0.9951691031455994]]}, "loss": {"model_a": 0.030819291034615302, "model_b": 0.02898480942541201}, "topk": {"model_a": [4706, 1, 0.9949083924293518, [[4706, 0.994908, " of", false], [38720, 0.00164, " human", false], [45, 0.000835, ",", false], [52028, 0.000366, " instead", false], [22590, 0.000319, " the", false], [275, 0.000218, " (", false], [31581, 0.000146, " only", false], [4596, 0.000112, " in", false], [4423, 8.7e-05, " as", false], [21265, 8.1e-05, " and", false]]], "model_b": [4706, 1, 0.9951691031455994, [[4706, 0.995169, " of", false], [45, 0.000652, ",", false], [22590, 0.000373, " the", false], [22187, 0.000361, " not", false], [11, 0.000255, "\n", false], [31581, 0.000214, " only", false], [275, 0.000199, " (", false], [52028, 0.000126, " instead", false], [332, 0.000118, " a", false], [4596, 0.000112, " in", false]]]}, "raw_delta": 0.00010172526041666674, "tuned_delta": 0.05419132267549225}, {"byte_start": 2294, "byte_end": 2300, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 397, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75%", "model_b": "5.64% 5.64% 5.64% 5.64% 5.64% 5.64%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.40167295932769775]], "model_b": [[38720, " human", "normal", 0.15226154029369354]]}, "loss": {"model_a": 2.74731965794285, "model_b": 5.635527503472513}, "topk": {"model_a": [38720, 1, 0.40167295932769775, [[38720, 0.401673, " human", false], [22590, 0.185124, " the", false], [52964, 0.042692, " special", false], [59943, 0.035366, " knowledge", false], [45775, 0.018048, " domain", false], [332, 0.015266, " a", false], [59792, 0.014431, " heuristic", false], [31044, 0.014003, " hand", false], [51832, 0.011934, " general", false], [46227, 0.009153, " humans", false]]], "model_b": [38720, 2, 0.15226154029369354, [[22590, 0.330378, " the", false], [38720, 0.152262, " human", false], [30597, 0.040464, " deep", false], [332, 0.033449, " a", false], [51832, 0.024299, " general", false], [59943, 0.017375, " knowledge", false], [38864, 0.008585, " large", false], [52195, 0.008372, " massive", false], [4404, 0.007833, " ``", false], [52964, 0.007329, " special", false]]]}, "raw_delta": -0.16015625, "tuned_delta": -0.10606665258492441}, {"byte_start": 2300, "byte_end": 2310, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 398, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20%", "model_b": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.5131533145904541]], "model_b": [[59943, " knowledge", "normal", 0.54017174243927]]}, "loss": {"model_a": 1.1975495944879089, "model_b": 1.120061091315162}, "topk": {"model_a": [59943, 1, 0.5131533145904541, [[59943, 0.513153, " knowledge", false], [65034, 0.161099, " understanding", false], [46, 0.046622, "-", false], [59683, 0.035035, " expertise", false], [38786, 0.029546, " input", false], [59917, 0.028831, " intuition", false], [52022, 0.014413, " insight", false], [38013, 0.007878, " chess", false], [31702, 0.007873, " play", false], [62418, 0.005917, " psychology", false]]], "model_b": [59943, 1, 0.54017174243927, [[59943, 0.540172, " knowledge", false], [65034, 0.107301, " understanding", false], [59917, 0.057916, " intuition", false], [46, 0.03869, "-", false], [59683, 0.021656, " expertise", false], [38786, 0.02138, " input", false], [59304, 0.008801, " cognition", false], [52022, 0.007899, " insight", false], [56537, 0.007199, " learning", false], [46543, 0.006641, " memory", false]]]}, "raw_delta": 0.004296874999999999, "tuned_delta": 0.05838647241507559}, {"byte_start": 2310, "byte_end": 2311, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "37.76%", "model_b": "31.98%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.12568451464176178]], "model_b": [[45, ",", "normal", 0.17178332805633545]]}, "loss": {"model_a": 37.758034273265835, "model_b": 31.98161858220651}, "topk": {"model_a": [45, 3, 0.12568451464176178, [[4706, 0.490393, " of", false], [47, 0.148935, ".", false], [45, 0.125685, ",", false], [37598, 0.08465, " about", false], [21265, 0.051184, " and", false], [4596, 0.02177, " in", false], [275, 0.019625, " (", false], [4811, 0.010303, " to", false], [60, 0.006758, ";", false], [32227, 0.003812, " that", false]]], "model_b": [45, 2, 0.17178332805633545, [[4706, 0.416088, " of", false], [45, 0.171783, ",", false], [47, 0.139266, ".", false], [37598, 0.060687, " about", false], [21265, 0.038148, " and", false], [4596, 0.035517, " in", false], [32227, 0.022164, " that", false], [275, 0.02161, " (", false], [4811, 0.015766, " to", false], [4715, 0.00583, " or", false]]]}, "raw_delta": 0.3203125, "tuned_delta": 0.3744020974150756}, {"byte_start": 2311, "byte_end": 2314, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 399, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "30.62% 30.62% 30.62%", "model_b": "30.81% 30.81% 30.81%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.006159464828670025]], "model_b": [[4715, " or", "normal", 0.005786491557955742]]}, "loss": {"model_a": 30.619699435533988, "model_b": 30.8075503523164}, "topk": {"model_a": [4715, 19, 0.006159464828670025, [[21400, 0.394387, " but", false], [21265, 0.173016, " and", false], [32139, 0.038936, " such", false], [59841, 0.023127, " including", false], [40186, 0.018653, " which", false], [32487, 0.018028, " with", false], [4596, 0.017413, " in", false], [4423, 0.016758, " as", false], [21700, 0.011152, " for", false], [32230, 0.010708, " then", false]]], "model_b": [4715, 17, 0.005786491557955742, [[21400, 0.368968, " but", false], [21265, 0.233122, " and", false], [32139, 0.028534, " such", false], [40186, 0.021187, " which", false], [32487, 0.019557, " with", false], [31581, 0.017497, " only", false], [4423, 0.016224, " as", false], [4596, 0.012355, " in", false], [59841, 0.011591, " including", false], [32230, 0.008683, " then", false]]]}, "raw_delta": -0.010416666666666519, "tuned_delta": 0.04367293074840907}, {"byte_start": 2314, "byte_end": 2317, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 400, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "15.87% 15.87% 15.87%", "model_b": "27.99% 27.99% 27.99%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.07145383208990097]], "model_b": [[4706, " of", "normal", 0.009619863703846931]]}, "loss": {"model_a": 15.873402468114245, "model_b": 27.989786600580146}, "topk": {"model_a": [4706, 2, 0.07145383208990097, [[4450, 0.244458, " by", false], [4706, 0.071454, " of", false], [4424, 0.06519, " at", false], [30788, 0.037718, " even", false], [4404, 0.032433, " ``", false], [4596, 0.024966, " in", false], [40085, 0.023776, " using", false], [4788, 0.019072, " so", false], [45, 0.018771, ",", false], [47629, 0.018548, " trying", false]]], "model_b": [4706, 19, 0.009619863703846931, [[4424, 0.123093, " at", false], [4404, 0.100145, " ``", false], [4450, 0.047387, " by", false], [4596, 0.036918, " in", false], [40085, 0.026705, " using", false], [4811, 0.026208, " to", false], [22590, 0.026179, " the", false], [45, 0.025227, ",", false], [30788, 0.023474, " even", false], [47001, 0.020251, " rather", false]]]}, "raw_delta": -0.6718749999999999, "tuned_delta": -0.6177854025849243}, {"byte_start": 2317, "byte_end": 2321, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 401, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.57% 10.57% 10.57% 10.57%", "model_b": "11.20% 11.20% 11.20% 11.20%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09579303115606308]], "model_b": [[22590, " the", "normal", 0.08394689857959747]]}, "loss": {"model_a": 10.566614069010962, "model_b": 11.20061091315162}, "topk": {"model_a": [22590, 1, 0.09579303115606308, [[22590, 0.095793, " the", false], [38720, 0.064957, " human", false], [59792, 0.046383, " heuristic", false], [31044, 0.043984, " hand", false], [59943, 0.032278, " knowledge", false], [39193, 0.030453, " other", false], [332, 0.02655, " a", false], [4404, 0.023907, " ``", false], [32074, 0.018977, " some", false], [47202, 0.016324, " search", false]]], "model_b": [22590, 1, 0.08394689857959747, [[22590, 0.083947, " the", false], [38720, 0.059603, " human", false], [38888, 0.033236, " lever", false], [32074, 0.031592, " some", false], [332, 0.029139, " a", false], [40085, 0.02844, " using", false], [51832, 0.027074, " general", false], [39193, 0.026366, " other", false], [4404, 0.026155, " ``", false], [59792, 0.019354, " heuristic", false]]]}, "raw_delta": -0.03515625, "tuned_delta": 0.018933347415075588}, {"byte_start": 2321, "byte_end": 2329, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 402, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49%", "model_b": "8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 0.08785334974527359]], "model_b": [[52964, " special", "normal", 0.018890444189310074]]}, "loss": {"model_a": 5.4946393158857, "model_b": 8.946399911762613}, "topk": {"model_a": [52964, 2, 0.08785334974527359, [[60572, 0.132312, " structure", false], [52964, 0.087853, " special", false], [38720, 0.048425, " human", false], [30808, 0.037641, " fact", false], [62293, 0.025744, " particular", false], [30941, 0.017763, " game", false], [47484, 0.017089, " symmet", false], [57271, 0.015589, " specific", false], [4404, 0.014219, " ``", false], [39558, 0.013507, " rules", false]]], "model_b": [52964, 6, 0.018890444189310074, [[38720, 0.074861, " human", false], [30808, 0.061963, " fact", false], [59943, 0.038544, " knowledge", false], [4404, 0.032579, " ``", false], [50836, 0.023995, " ability", false], [52964, 0.01889, " special", false], [60572, 0.018285, " structure", false], [51832, 0.014813, " general", false], [52140, 0.013101, " limited", false], [45775, 0.012998, " domain", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13731665258492443}, {"byte_start": 2329, "byte_end": 2338, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 403, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"model_a": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83%", "model_b": "10.02% 10.02% 10.02% 10.02% 10.02% 10.02% 10.02% 10.02% 10.02%"}, "model_tokens": {"model_a": [[56215, " features", "normal", 0.0121115418151021]], "model_b": [[56215, " features", "normal", 0.006747689563781023]]}, "loss": {"model_a": 8.828993088773602, "model_b": 10.01871556172891}, "topk": {"model_a": [56215, 6, 0.0121115418151021, [[60572, 0.63675, " structure", false], [62404, 0.034095, " properties", false], [46642, 0.021637, " nature", false], [62586, 0.02135, " structures", false], [47484, 0.012824, " symmet", false], [56215, 0.012112, " features", false], [56310, 0.012014, " geometry", false], [65258, 0.011735, " characteristics", false], [39558, 0.008685, " rules", false], [39654, 0.008449, " shape", false]]], "model_b": [56215, 11, 0.006747689563781023, [[60572, 0.509633, " structure", false], [62586, 0.041015, " structures", false], [62404, 0.028188, " properties", false], [56353, 0.026383, " hardware", false], [46642, 0.01031, " nature", false], [45, 0.010182, ",", false], [38720, 0.00882, " human", false], [64254, 0.008013, " architecture", false], [64862, 0.007527, " computational", false], [39558, 0.007154, " rules", false]]]}, "raw_delta": -0.06597222222222227, "tuned_delta": -0.011882624807146677}, {"byte_start": 2338, "byte_end": 2341, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 404, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.20% 0.20% 0.20%", "model_b": "0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9666310548782349]], "model_b": [[4706, " of", "normal", 0.933143138885498]]}, "loss": {"model_a": 0.20399435494340606, "model_b": 0.41385905103626264}, "topk": {"model_a": [4706, 1, 0.9666310548782349, [[4706, 0.966631, " of", false], [32227, 0.010082, " that", false], [21265, 0.00398, " and", false], [4596, 0.003571, " in", false], [275, 0.002553, " (", false], [45, 0.000726, ",", false], [47660, 0.000688, " unique", false], [57271, 0.000538, " specific", false], [56976, 0.000459, " provided", false], [32139, 0.000443, " such", false]]], "model_b": [4706, 1, 0.933143138885498, [[4706, 0.933143, " of", false], [32227, 0.032942, " that", false], [21265, 0.004068, " and", false], [56454, 0.002734, " inherent", false], [4596, 0.001954, " in", false], [275, 0.001933, " (", false], [45, 0.001351, ",", false], [38547, 0.001173, " found", false], [56976, 0.001054, " provided", false], [61603, 0.000927, " associated", false]]]}, "raw_delta": -0.011637369791666666, "tuned_delta": 0.042452227623408924}, {"byte_start": 2341, "byte_end": 2345, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 405, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "3.84% 3.84% 3.84% 3.84%", "model_b": "6.23% 6.23% 6.23% 6.23%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.4348495900630951]], "model_b": [[22590, " the", "normal", 0.2557132840156555]]}, "loss": {"model_a": 3.839203111740649, "model_b": 6.234302300716467}, "topk": {"model_a": [22590, 1, 0.4348495900630951, [[22590, 0.43485, " the", false], [3851, 0.269551, " Go", false], [37876, 0.047224, " board", false], [332, 0.023571, " a", false], [62293, 0.017269, " particular", false], [30941, 0.013335, " game", false], [52491, 0.0104, " playing", false], [38576, 0.009769, " games", false], [32234, 0.007583, " this", false], [51161, 0.006293, " certain", false]]], "model_b": [22590, 2, 0.2557132840156555, [[3851, 0.422084, " Go", false], [22590, 0.255713, " the", false], [38720, 0.044242, " human", false], [332, 0.020954, " a", false], [55809, 0.015471, " computer", false], [38013, 0.013238, " chess", false], [30941, 0.00934, " game", false], [3609, 0.009025, " AI", false], [38576, 0.008324, " games", false], [52491, 0.006604, " playing", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07872290258492441}, {"byte_start": 2345, "byte_end": 2350, "display": {"text": " game", "kind": "normal"}, "is_word": true, "word_id": 406, "word_key": " game", "bytes_hex": "20 67 61 6d 65", "compression": {"model_a": "3.56% 3.56% 3.56% 3.56% 3.56%", "model_b": "6.51% 6.51% 6.51% 6.51% 6.51%"}, "model_tokens": {"model_a": [[30941, " game", "normal", 0.3745507597923279]], "model_b": [[30941, " game", "normal", 0.1638253927230835]]}, "loss": {"model_a": 3.5644711459463645, "model_b": 6.509034266510753}, "topk": {"model_a": [30941, 1, 0.3745507597923279, [[30941, 0.374551, " game", false], [37876, 0.254442, " board", false], [3851, 0.117418, " Go", false], [62293, 0.020858, " particular", false], [45775, 0.019811, " domain", false], [52569, 0.011625, " problem", false], [22638, 0.008441, " two", false], [38720, 0.008009, " human", false], [39558, 0.007313, " rules", false], [31012, 0.007254, " grid", false]]], "model_b": [30941, 2, 0.1638253927230835, [[3851, 0.368264, " Go", false], [30941, 0.163825, " game", false], [38720, 0.075582, " human", false], [37876, 0.026966, " board", false], [45775, 0.026289, " domain", false], [55809, 0.014095, " computer", false], [39558, 0.013146, " rules", false], [52569, 0.012838, " problem", false], [3609, 0.012653, " AI", false], [60572, 0.007137, " structure", false]]]}, "raw_delta": -0.16328125000000002, "tuned_delta": -0.10919165258492443}, {"byte_start": 2350, "byte_end": 2351, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "30.01%", "model_b": "34.24%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1922062188386917]], "model_b": [[45, ",", "normal", 0.14918695390224457]]}, "loss": {"model_a": 30.00918395599113, "model_b": 34.23582958359552}, "topk": {"model_a": [45, 2, 0.1922062188386917, [[47, 0.363612, ".", false], [45, 0.192206, ",", false], [275, 0.071949, " (", false], [4706, 0.067428, " of", false], [32139, 0.044257, " such", false], [32227, 0.040145, " that", false], [460, 0.03844, "'s", false], [60572, 0.021663, " structure", false], [46342, 0.021244, " itself", false], [31296, 0.012087, " like", false]]], "model_b": [45, 3, 0.14918695390224457, [[47, 0.29402, ".", false], [32227, 0.194866, " that", false], [45, 0.149187, ",", false], [275, 0.050714, " (", false], [46342, 0.038213, " itself", false], [32139, 0.034616, " such", false], [4596, 0.026667, " in", false], [4706, 0.019196, " of", false], [460, 0.01334, "'s", false], [21265, 0.013309, " and", false]]]}, "raw_delta": -0.234375, "tuned_delta": -0.18028540258492443}, {"byte_start": 2351, "byte_end": 2355, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 407, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "5.57% 5.57% 5.57% 5.57%", "model_b": "8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.28987160325050354]], "model_b": [[21400, " but", "normal", 0.15923331677913666]]}, "loss": {"model_a": 5.565083409679106, "model_b": 8.24195897382855}, "topk": {"model_a": [21400, 1, 0.28987160325050354, [[21400, 0.289872, " but", false], [32139, 0.233732, " such", false], [21265, 0.106829, " and", false], [4715, 0.104154, " or", false], [31296, 0.030195, " like", false], [4596, 0.02698, " in", false], [4811, 0.017742, " to", false], [59841, 0.012625, " including", false], [40186, 0.011637, " which", false], [4423, 0.010956, " as", false]]], "model_b": [21400, 2, 0.15923331677913666, [[32139, 0.24349, " such", false], [21400, 0.159233, " but", false], [4715, 0.140316, " or", false], [21265, 0.104814, " and", false], [31296, 0.032689, " like", false], [4596, 0.030812, " in", false], [4811, 0.025501, " to", false], [21700, 0.019704, " for", false], [59841, 0.018894, " including", false], [40186, 0.017688, " which", false]]]}, "raw_delta": -0.1484375, "tuned_delta": -0.09434790258492441}, {"byte_start": 2355, "byte_end": 2359, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 408, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"model_a": "19.44% 19.44% 19.44% 19.44%", "model_b": "21.98% 21.98% 21.98% 21.98%"}, "model_tokens": {"model_a": [[21256, " all", "normal", 0.013479495421051979]], "model_b": [[21256, " all", "normal", 0.007687249220907688]]}, "loss": {"model_a": 19.44256988698017, "model_b": 21.9785572635428}, "topk": {"model_a": [21256, 15, 0.013479495421051979, [[39936, 0.150641, " these", false], [22590, 0.095963, " the", false], [32465, 0.091621, " when", false], [32234, 0.069119, " this", false], [4596, 0.065346, " in", false], [4601, 0.041442, " it", false], [4423, 0.035239, " as", false], [32232, 0.022459, " they", false], [32230, 0.02222, " then", false], [31578, 0.021448, " once", false]]], "model_b": [21256, 27, 0.007687249220907688, [[39936, 0.158511, " these", false], [22590, 0.138224, " the", false], [4596, 0.061076, " in", false], [32232, 0.05306, " they", false], [32234, 0.051613, " this", false], [4601, 0.035748, " it", false], [32465, 0.021199, " when", false], [61959, 0.01928, " eventually", false], [4450, 0.017778, " by", false], [45, 0.016728, ",", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08653540258492441}, {"byte_start": 2359, "byte_end": 2365, "display": {"text": " those", "kind": "normal"}, "is_word": true, "word_id": 409, "word_key": " those", "bytes_hex": "20 74 68 6f 73 65", "compression": {"model_a": "10.38% 10.38% 10.38% 10.38% 10.38% 10.38%", "model_b": "11.18% 11.18% 11.18% 11.18% 11.18% 11.18%"}, "model_tokens": {"model_a": [[39944, " those", "normal", 0.03198657184839249]], "model_b": [[39944, " those", "normal", 0.024385707452893257]]}, "loss": {"model_a": 10.378763152228546, "model_b": 11.177129548553816}, "topk": {"model_a": [39944, 9, 0.03198657184839249, [[4706, 0.251499, " of", false], [39936, 0.157181, " these", false], [32139, 0.076099, " such", false], [32234, 0.065139, " this", false], [45953, 0.056934, " failed", false], [32462, 0.052521, " were", false], [32227, 0.049182, " that", false], [22590, 0.040221, " the", false], [39944, 0.031987, " those", false], [46936, 0.026999, " proved", false]]], "model_b": [39944, 8, 0.024385707452893257, [[4706, 0.391057, " of", false], [39936, 0.121978, " these", false], [32462, 0.043188, " were", false], [22590, 0.039964, " the", false], [45953, 0.03895, " failed", false], [32227, 0.036748, " that", false], [32234, 0.032114, " this", false], [39944, 0.024386, " those", false], [4596, 0.021288, " in", false], [51566, 0.016201, " efforts", false]]]}, "raw_delta": -0.04427083333333326, "tuned_delta": 0.009818764081742329}, {"byte_start": 2365, "byte_end": 2373, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 410, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"model_a": "1.67% 1.67% 1.67% 1.67% 1.67% 1.67% 1.67% 1.67%", "model_b": "1.98% 1.98% 1.98% 1.98% 1.98% 1.98% 1.98% 1.98%"}, "model_tokens": {"model_a": [[51566, " efforts", "normal", 0.4796241521835327]], "model_b": [[51566, " efforts", "normal", 0.417220801115036]]}, "loss": {"model_a": 1.6730472275934023, "model_b": 1.9812401379395552}, "topk": {"model_a": [51566, 1, 0.4796241521835327, [[51566, 0.479624, " efforts", false], [52224, 0.114917, " methods", false], [61590, 0.086399, " approaches", false], [38720, 0.024548, " human", false], [32462, 0.023234, " were", false], [55572, 0.019823, " attempts", false], [22762, 0.01328, " who", false], [45953, 0.010727, " failed", false], [32227, 0.009949, " that", false], [38328, 0.009683, " early", false]]], "model_b": [51566, 1, 0.417220801115036, [[51566, 0.417221, " efforts", false], [52224, 0.148015, " methods", false], [61590, 0.129351, " approaches", false], [55572, 0.01946, " attempts", false], [32227, 0.011117, " that", false], [32462, 0.01084, " were", false], [62581, 0.010276, " strategies", false], [38720, 0.009271, " human", false], [38328, 0.007715, " early", false], [62633, 0.006557, " techniques", false]]]}, "raw_delta": -0.01708984375, "tuned_delta": 0.03699975366507559}, {"byte_start": 2373, "byte_end": 2380, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 411, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"model_a": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "model_b": "8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57%"}, "model_tokens": {"model_a": [[46936, " proved", "normal", 0.07473129779100418]], "model_b": [[46936, " proved", "normal", 0.03583824262022972]]}, "loss": {"model_a": 6.6821254684031235, "model_b": 8.574052558854607}, "topk": {"model_a": [46936, 3, 0.07473129779100418, [[32462, 0.364346, " were", false], [45953, 0.129943, " failed", false], [46936, 0.074731, " proved", false], [62676, 0.041216, " ultimately", false], [61959, 0.028101, " eventually", false], [30383, 0.025273, " came", false], [21532, 0.020969, " did", false], [38367, 0.020479, " ended", false], [47638, 0.01424, " turned", false], [32460, 0.01336, " went", false]]], "model_b": [46936, 5, 0.03583824262022972, [[32462, 0.312913, " were", false], [45953, 0.10896, " failed", false], [38367, 0.049087, " ended", false], [21532, 0.039142, " did", false], [46936, 0.035838, " proved", false], [62676, 0.035355, " ultimately", false], [61959, 0.031672, " eventually", false], [21795, 0.028001, " had", false], [30383, 0.025305, " came", false], [47638, 0.022014, " turned", false]]]}, "raw_delta": -0.10491071428571422, "tuned_delta": -0.05082111687063863}, {"byte_start": 2380, "byte_end": 2391, "display": {"text": " irrelevant", "kind": "normal"}, "is_word": true, "word_id": 412, "word_key": " irrelevant", "bytes_hex": "20 69 72 72 65 6c 65 76 61 6e 74", "compression": {"model_a": "8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91%", "model_b": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%"}, "model_tokens": {"model_a": [[62161, " irrelevant", "normal", 0.004359398037195206]], "model_b": [[62161, " irrelevant", "normal", 0.0018604384968057275]]}, "loss": {"model_a": 8.914379869129245, "model_b": 10.297645710890684}, "topk": {"model_a": [62161, 30, 0.004359398037195206, [[4811, 0.169799, " to", false], [62676, 0.108742, " ultimately", false], [62088, 0.062653, " inadequate", false], [63631, 0.060356, " ineffective", false], [21719, 0.059164, " fut", false], [31277, 0.044976, " less", false], [64450, 0.034119, " insufficient", false], [64616, 0.029121, " unsuccessful", false], [56445, 0.021643, " inferior", false], [38562, 0.019466, " fruit", false]]], "model_b": [62161, 50, 0.0018604384968057275, [[21719, 0.217937, " fut", false], [4811, 0.208306, " to", false], [63631, 0.085355, " ineffective", false], [52094, 0.035362, " largely", false], [38562, 0.032151, " fruit", false], [64616, 0.030708, " unsuccessful", false], [53247, 0.021536, " useless", false], [4596, 0.019549, " in", false], [62676, 0.016705, " ultimately", false], [51336, 0.0167, " counter", false]]]}, "raw_delta": -0.07670454545454546, "tuned_delta": -0.022614948039469868}, {"byte_start": 2391, "byte_end": 2392, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "61.71%", "model_b": "52.69%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.03248727694153786]], "model_b": [[45, ",", "normal", 0.054435063153505325]]}, "loss": {"model_a": 61.709026163024014, "model_b": 52.692182157468}, "topk": {"model_a": [45, 7, 0.03248727694153786, [[32465, 0.290877, " when", false], [4596, 0.165691, " in", false], [4811, 0.141382, " to", false], [47, 0.122309, ".", false], [4423, 0.084247, " as", false], [31578, 0.0398, " once", false], [45, 0.032487, ",", false], [21265, 0.013905, " and", false], [55794, 0.013724, " compared", false], [37634, 0.012328, " after", false]]], "model_b": [45, 6, 0.054435063153505325, [[47, 0.291627, ".", false], [4596, 0.170779, " in", false], [4811, 0.096937, " to", false], [32465, 0.089005, " when", false], [4423, 0.063866, " as", false], [45, 0.054435, ",", false], [51018, 0.030622, " because", false], [4450, 0.023351, " by", false], [31601, 0.021036, " over", false], [31578, 0.020003, " once", false]]]}, "raw_delta": 0.5, "tuned_delta": 0.5540895974150756}, {"byte_start": 2392, "byte_end": 2395, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 413, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "20.19% 20.19% 20.19%", "model_b": "22.54% 22.54% 22.54%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.0346657894551754]], "model_b": [[4715, " or", "normal", 0.02376241609454155]]}, "loss": {"model_a": 20.19397355410984, "model_b": 22.542110013890053}, "topk": {"model_a": [4715, 6, 0.0346657894551754, [[21265, 0.334903, " and", false], [4423, 0.1551, " as", false], [51018, 0.062139, " because", false], [4596, 0.052483, " in", false], [32465, 0.042149, " when", false], [4715, 0.034666, " or", false], [40187, 0.033495, " while", false], [31578, 0.02105, " once", false], [39690, 0.019456, " since", false], [32487, 0.015308, " with", false]]], "model_b": [4715, 5, 0.02376241609454155, [[21265, 0.344623, " and", false], [4423, 0.164551, " as", false], [51018, 0.08261, " because", false], [39690, 0.041976, " since", false], [4715, 0.023762, " or", false], [4596, 0.02143, " in", false], [4424, 0.020421, " at", false], [45913, 0.017453, " except", false], [32487, 0.017307, " with", false], [30788, 0.015625, " even", false]]]}, "raw_delta": -0.13020833333333326, "tuned_delta": -0.07611873591825767}, {"byte_start": 2395, "byte_end": 2401, "display": {"text": " worse", "kind": "normal"}, "is_word": true, "word_id": 414, "word_key": " worse", "bytes_hex": "20 77 6f 72 73 65", "compression": {"model_a": "7.51% 7.51% 7.51% 7.51% 7.51% 7.51%", "model_b": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"model_a": [[40216, " worse", "normal", 0.08160778880119324]], "model_b": [[40216, " worse", "normal", 0.03381677716970444]]}, "loss": {"model_a": 7.514036671296684, "model_b": 10.190912235446126}, "topk": {"model_a": [40216, 2, 0.08160778880119324, [[4424, 0.398658, " at", false], [40216, 0.081608, " worse", false], [30788, 0.054097, " even", false], [31581, 0.026726, " only", false], [31277, 0.015032, " less", false], [22187, 0.01217, " not", false], [62161, 0.011741, " irrelevant", false], [22614, 0.011484, " too", false], [51336, 0.010688, " counter", false], [63631, 0.010246, " ineffective", false]]], "model_b": [40216, 4, 0.03381677716970444, [[4424, 0.274657, " at", false], [32462, 0.064129, " were", false], [30788, 0.056245, " even", false], [40216, 0.033817, " worse", false], [63631, 0.025439, " ineffective", false], [47001, 0.022559, " rather", false], [22614, 0.019177, " too", false], [51336, 0.0174, " counter", false], [47285, 0.016938, " simply", false], [31581, 0.015761, " only", false]]]}, "raw_delta": -0.14843749999999997, "tuned_delta": -0.09434790258492438}, {"byte_start": 2401, "byte_end": 2402, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.75%", "model_b": "6.94%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8126047253608704]], "model_b": [[45, ",", "normal", 0.6771745681762695]]}, "loss": {"model_a": 3.7511479944988912, "model_b": 6.938743238650531}, "topk": {"model_a": [45, 1, 0.8126047253608704, [[45, 0.812605, ",", false], [47, 0.144453, ".", false], [59, 0.005925, ":", false], [32226, 0.005779, " than", false], [275, 0.00417, " (", false], [39820, 0.00309, " still", false], [22797, 0.002026, " yet", false], [4596, 0.001995, " in", false], [60, 0.001529, ";", false], [32465, 0.001258, " when", false]]], "model_b": [45, 1, 0.6771745681762695, [[45, 0.677175, ",", false], [47, 0.238099, ".", false], [32226, 0.011396, " than", false], [4596, 0.008628, " in", false], [59, 0.007243, ":", false], [51018, 0.003273, " because", false], [22797, 0.002788, " yet", false], [32462, 0.002525, " were", false], [275, 0.002242, " (", false], [4811, 0.002116, " to", false]]]}, "raw_delta": -0.1767578125, "tuned_delta": -0.12266821508492441}, {"byte_start": 2402, "byte_end": 2407, "display": {"text": " once", "kind": "normal"}, "is_word": true, "word_id": 415, "word_key": " once", "bytes_hex": "20 6f 6e 63 65", "compression": {"model_a": "10.76% 10.76% 10.76% 10.76% 10.76%", "model_b": "30.88% 30.88% 30.88% 30.88% 30.88%"}, "model_tokens": {"model_a": [[31578, " once", "normal", 0.05073611065745354]], "model_b": [[31578, " once", "normal", 0.00018784687563311309]]}, "loss": {"model_a": 10.7638575316325, "model_b": 30.88269071902937}, "topk": {"model_a": [31578, 5, 0.05073611065745354, [[32465, 0.465948, " when", false], [4423, 0.139763, " as", false], [4596, 0.122279, " in", false], [4811, 0.071231, " to", false], [31578, 0.050736, " once", false], [51018, 0.014975, " because", false], [37634, 0.013941, " after", false], [22590, 0.009001, " the", false], [21265, 0.0075, " and", false], [55794, 0.005529, " compared", false]]], "model_b": [31578, 384, 0.00018784687563311309, [[51336, 0.130673, " counter", false], [4596, 0.068859, " in", false], [32462, 0.053354, " were", false], [4811, 0.047091, " to", false], [4423, 0.027701, " as", false], [32465, 0.025287, " when", false], [45953, 0.025079, " failed", false], [32232, 0.024462, " they", false], [51018, 0.023732, " because", false], [47768, 0.019458, " wasted", false]]]}, "raw_delta": -1.1156249999999999, "tuned_delta": -1.0615354025849242}, {"byte_start": 2407, "byte_end": 2414, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 416, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00% 7.00%", "model_b": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.0654434785246849]], "model_b": [[47202, " search", "normal", 0.014682039618492126]]}, "loss": {"model_a": 7.004155611458694, "model_b": 10.868517328125558}, "topk": {"model_a": [47202, 4, 0.0654434785246849, [[22590, 0.252623, " the", false], [332, 0.098207, " a", false], [51832, 0.071414, " general", false], [47202, 0.065443, " search", false], [30597, 0.046835, " deep", false], [52224, 0.027957, " methods", false], [4601, 0.025044, " it", false], [52195, 0.02204, " massive", false], [59345, 0.016717, " computers", false], [63370, 0.013647, " computation", false]]], "model_b": [47202, 11, 0.014682039618492126, [[22590, 0.356844, " the", false], [332, 0.075028, " a", false], [51832, 0.047769, " general", false], [32232, 0.040599, " they", false], [3851, 0.034147, " Go", false], [52224, 0.024601, " methods", false], [38720, 0.020885, " human", false], [4601, 0.020826, " it", false], [37635, 0.017766, " again", false], [31458, 0.015574, " more", false]]]}, "raw_delta": -0.21428571428571422, "tuned_delta": -0.16019611687063862}, {"byte_start": 2414, "byte_end": 2418, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 417, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "9.02% 9.02% 9.02% 9.02%", "model_b": "9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.13477815687656403]], "model_b": [[22748, " was", "normal", 0.12929710745811462]]}, "loss": {"model_a": 9.01684400555602, "model_b": 9.157732193142833}, "topk": {"model_a": [22748, 3, 0.13477815687656403, [[45283, 0.237867, " became", false], [46, 0.168972, "-", false], [22748, 0.134778, " was", false], [52224, 0.08936, " methods", false], [21795, 0.026584, " had", false], [32487, 0.017196, " with", false], [37810, 0.014106, " based", false], [21265, 0.012929, " and", false], [61559, 0.012752, " algorithms", false], [4450, 0.011651, " by", false]]], "model_b": [22748, 4, 0.12929710745811462, [[52224, 0.228456, " methods", false], [46, 0.168477, "-", false], [45283, 0.139786, " became", false], [22748, 0.129297, " was", false], [4450, 0.035286, " by", false], [62633, 0.022648, " techniques", false], [21795, 0.018626, " had", false], [61559, 0.013917, " algorithms", false], [37828, 0.013818, " began", false], [21265, 0.012167, " and", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04627709741507559}, {"byte_start": 2418, "byte_end": 2426, "display": {"text": " applied", "kind": "normal"}, "is_word": true, "word_id": 418, "word_key": " applied", "bytes_hex": "20 61 70 70 6c 69 65 64", "compression": {"model_a": "6.59% 6.59% 6.59% 6.59% 6.59% 6.59% 6.59% 6.59%", "model_b": "10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07%"}, "model_tokens": {"model_a": [[50937, " applied", "normal", 0.053955789655447006]], "model_b": [[50937, " applied", "normal", 0.01146637462079525]]}, "loss": {"model_a": 6.5865227696835, "model_b": 10.073505412457116}, "topk": {"model_a": [50937, 3, 0.053955789655447006, [[31351, 0.090637, " made", false], [59206, 0.089687, " available", false], [50937, 0.053956, " applied", false], [51744, 0.034488, " finally", false], [59506, 0.034336, " developed", false], [22590, 0.029703, " the", false], [51097, 0.027678, " brought", false], [64583, 0.025097, " sufficiently", false], [32354, 0.025039, " used", false], [63616, 0.020898, " implemented", false]]], "model_b": [50937, 20, 0.01146637462079525, [[59206, 0.080118, " available", false], [63616, 0.057095, " implemented", false], [31351, 0.056977, " made", false], [38547, 0.038804, " found", false], [59506, 0.036311, " developed", false], [61885, 0.030819, " discovered", false], [63594, 0.028288, " generalized", false], [62151, 0.021501, " introduced", false], [39887, 0.020598, " taken", false], [4692, 0.016344, " no", false]]]}, "raw_delta": -0.193359375, "tuned_delta": -0.13926977758492443}, {"byte_start": 2426, "byte_end": 2438, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 419, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"model_a": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "model_b": "7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37% 7.37%"}, "model_tokens": {"model_a": [[63507, " effectively", "normal", 0.004854880273342133]], "model_b": [[63507, " effectively", "normal", 0.0071459985338151455]]}, "loss": {"model_a": 7.983663963252726, "model_b": 7.373148483709871}, "topk": {"model_a": [63507, 22, 0.004854880273342133, [[47, 0.41929, ".", false], [4811, 0.169509, " to", false], [4596, 0.088032, " in", false], [21265, 0.044924, " and", false], [45, 0.027145, ",", false], [32487, 0.022463, " with", false], [4712, 0.020371, " on", false], [4424, 0.018365, " at", false], [4517, 0.01801, " en", false], [4423, 0.015975, " as", false]]], "model_b": [63507, 16, 0.0071459985338151455, [[47, 0.390005, ".", false], [4811, 0.177595, " to", false], [4596, 0.08703, " in", false], [45, 0.043771, ",", false], [31458, 0.024753, " more", false], [32487, 0.020716, " with", false], [4450, 0.019521, " by", false], [4423, 0.017603, " as", false], [21265, 0.017332, " and", false], [4712, 0.016528, " on", false]]]}, "raw_delta": 0.03385416666666663, "tuned_delta": 0.08794376408174222}, {"byte_start": 2438, "byte_end": 2441, "display": {"text": " at", "kind": "normal"}, "is_word": true, "word_id": 420, "word_key": " at", "bytes_hex": "20 61 74", "compression": {"model_a": "31.37% 31.37% 31.37%", "model_b": "29.49% 29.49% 29.49%"}, "model_tokens": {"model_a": [[4424, " at", "normal", 0.005401988048106432]], "model_b": [[4424, " at", "normal", 0.00744384853169322]]}, "loss": {"model_a": 31.371103102663653, "model_b": 29.492593934839483}, "topk": {"model_a": [4424, 11, 0.005401988048106432, [[47, 0.573171, ".", false], [4811, 0.225641, " to", false], [21265, 0.052157, " and", false], [45, 0.032724, ",", false], [4596, 0.024689, " in", false], [275, 0.011357, " (", false], [32487, 0.011309, " with", false], [4450, 0.010695, " by", false], [4712, 0.008205, " on", false], [40085, 0.00728, " using", false]]], "model_b": [4424, 13, 0.00744384853169322, [[47, 0.49816, ".", false], [4811, 0.124317, " to", false], [4450, 0.094539, " by", false], [45, 0.050663, ",", false], [4596, 0.043042, " in", false], [21265, 0.026952, " and", false], [45865, 0.024021, " enough", false], [4712, 0.01952, " on", false], [32487, 0.018999, " with", false], [4423, 0.010442, " as", false]]]}, "raw_delta": 0.10416666666666652, "tuned_delta": 0.1582562640817421}, {"byte_start": 2441, "byte_end": 2447, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 421, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"model_a": "5.40% 5.40% 5.40% 5.40% 5.40% 5.40%", "model_b": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"model_a": [[39590, " scale", "normal", 0.16841745376586914]], "model_b": [[39590, " scale", "normal", 0.09567037969827652]]}, "loss": {"model_a": 5.400713857494492, "model_b": 7.0913721085362456}, "topk": {"model_a": [39590, 3, 0.16841745376586914, [[332, 0.204759, " a", false], [22590, 0.170021, " the", false], [39590, 0.168417, " scale", false], [38864, 0.078099, " large", false], [52195, 0.053434, " massive", false], [4419, 0.029039, " an", false], [21256, 0.022619, " all", false], [31082, 0.016488, " high", false], [62606, 0.013832, " sufficient", false], [39855, 0.012291, " super", false]]], "model_b": [39590, 3, 0.09567037969827652, [[22590, 0.279557, " the", false], [332, 0.180007, " a", false], [39590, 0.09567, " scale", false], [21256, 0.092636, " all", false], [32074, 0.028531, " some", false], [38864, 0.028169, " large", false], [21273, 0.021292, " any", false], [4419, 0.017475, " an", false], [64583, 0.013406, " sufficiently", false], [62431, 0.009643, " reasonable", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.03966040258492441}, {"byte_start": 2447, "byte_end": 2448, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "2.99%", "model_b": "4.02%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8458263278007507]], "model_b": [[47, ".", "normal", 0.7990453243255615]]}, "loss": {"model_a": 2.9938739862197723, "model_b": 4.015313346224166}, "topk": {"model_a": [47, 1, 0.8458263278007507, [[47, 0.845826, ".", false], [45, 0.033495, ",", false], [4811, 0.03331, " to", false], [21265, 0.0227, " and", false], [275, 0.013027, " (", false], [4450, 0.007837, " by", false], [4596, 0.007629, " in", false], [40085, 0.006791, " using", false], [32487, 0.006761, " with", false], [4712, 0.002454, " on", false]]], "model_b": [47, 1, 0.7990453243255615, [[47, 0.799045, ".", false], [45, 0.05539, ",", false], [21265, 0.028102, " and", false], [4811, 0.019751, " to", false], [4596, 0.016284, " in", false], [4450, 0.013485, " by", false], [275, 0.011514, " (", false], [32487, 0.007818, " with", false], [4712, 0.005536, " on", false], [40085, 0.004766, " using", false]]]}, "raw_delta": -0.056640625, "tuned_delta": -0.002551027584924412}, {"byte_start": 2448, "byte_end": 2453, "display": {"text": " Also", "kind": "normal"}, "is_word": true, "word_id": 422, "word_key": " also", "bytes_hex": "20 41 6c 73 6f", "compression": {"model_a": "27.73% 27.73% 27.73% 27.73% 27.73%", "model_b": "26.60% 26.60% 26.60% 26.60% 26.60%"}, "model_tokens": {"model_a": [[28402, " Also", "normal", 0.000463341100839898]], "model_b": [[28402, " Also", "normal", 0.0006224684184417129]]}, "loss": {"model_a": 27.726795317084765, "model_b": 26.599689816390264}, "topk": {"model_a": [28402, 125, 0.000463341100839898, [[261, 0.245212, "\n\n", false], [20996, 0.120486, " The", false], [3913, 0.042041, " In", false], [36251, 0.036602, " Again", false], [267, 0.035076, "  ", false], [29894, 0.032905, " This", false], [3918, 0.029586, " It", false], [300, 0.020538, " A", false], [37451, 0.017805, " There", false], [29511, 0.015977, " Once", false]]], "model_b": [28402, 125, 0.0006224684184417129, [[261, 0.132906, "\n\n", false], [20996, 0.132787, " The", false], [267, 0.052558, "  ", false], [3913, 0.051128, " In", false], [29894, 0.034048, " This", false], [3851, 0.026804, " Go", false], [3918, 0.024628, " It", false], [300, 0.019543, " A", false], [37453, 0.017719, " These", false], [19417, 0.016657, " And", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11658959741507559}, {"byte_start": 2453, "byte_end": 2463, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 423, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"model_a": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "model_b": "8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68% 8.68%"}, "model_tokens": {"model_a": [[59829, " important", "normal", 0.0002152388624381274]], "model_b": [[59829, " important", "normal", 0.008188338950276375]]}, "loss": {"model_a": 15.215924259375784, "model_b": 8.67871235534767}, "topk": {"model_a": [59829, 111, 0.0002152388624381274, [[45, 0.390312, ",", false], [4596, 0.230308, " in", false], [31296, 0.080176, " like", false], [4423, 0.057574, " as", false], [4424, 0.031256, " at", false], [51419, 0.014735, " delayed", false], [32487, 0.011839, " with", false], [332, 0.010051, " a", false], [52906, 0.008664, " similar", false], [4712, 0.007033, " on", false]]], "model_b": [59829, 13, 0.008188338950276375, [[45, 0.494786, ",", false], [4596, 0.052715, " in", false], [31296, 0.041518, " like", false], [62161, 0.021246, " irrelevant", false], [4706, 0.014763, " of", false], [31578, 0.014092, " once", false], [31968, 0.010728, " seen", false], [38869, 0.010579, " later", false], [332, 0.010316, " a", false], [51960, 0.009938, " ignored", false]]]}, "raw_delta": 0.36249999999999993, "tuned_delta": 0.4165895974150755}, {"byte_start": 2463, "byte_end": 2467, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 424, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "7.22% 7.22% 7.22% 7.22%", "model_b": "5.46% 5.46% 5.46% 5.46%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.2006615549325943]], "model_b": [[22748, " was", "normal", 0.2994954288005829]]}, "loss": {"model_a": 7.220519613824157, "model_b": 5.459417268988997}, "topk": {"model_a": [22748, 2, 0.2006615549325943, [[4596, 0.252713, " in", false], [22748, 0.200662, " was", false], [31077, 0.118265, " here", false], [45, 0.115576, ",", false], [32462, 0.089572, " were", false], [4811, 0.077186, " to", false], [4600, 0.05561, " is", false], [21700, 0.025312, " for", false], [21286, 0.014834, " are", false], [21400, 0.005999, " but", false]]], "model_b": [22748, 1, 0.2994954288005829, [[22748, 0.299495, " was", false], [4811, 0.127262, " to", false], [4600, 0.119593, " is", false], [4596, 0.116492, " in", false], [45, 0.099248, ",", false], [32462, 0.059979, " were", false], [21700, 0.054562, " for", false], [31077, 0.030303, " here", false], [21286, 0.019811, " are", false], [4424, 0.012389, " at", false]]]}, "raw_delta": 0.09765625, "tuned_delta": 0.15174584741507557}, {"byte_start": 2467, "byte_end": 2471, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 425, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.36% 1.36% 1.36% 1.36%", "model_b": "1.85% 1.85% 1.85% 1.85%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.7405827045440674]], "model_b": [[22590, " the", "normal", 0.6630631685256958]]}, "loss": {"model_a": 1.3648543172472491, "model_b": 1.8491574620769182}, "topk": {"model_a": [22590, 1, 0.7405827045440674, [[22590, 0.740583, " the", false], [32227, 0.072345, " that", false], [332, 0.06375, " a", false], [4419, 0.013205, " an", false], [32499, 0.005354, " work", false], [56950, 0.004961, " progress", false], [57103, 0.004122, " research", false], [21835, 0.004078, " how", false], [38720, 0.003317, " human", false], [50919, 0.002861, " another", false]]], "model_b": [22590, 1, 0.6630631685256958, [[22590, 0.663063, " the", false], [32227, 0.125759, " that", false], [332, 0.055063, " a", false], [4419, 0.01212, " an", false], [4811, 0.009522, " to", false], [22187, 0.005803, " not", false], [21835, 0.004968, " how", false], [32234, 0.004037, " this", false], [63822, 0.003851, " recognizing", false], [51746, 0.003391, " finding", false]]]}, "raw_delta": -0.02685546875, "tuned_delta": 0.027234128665075588}, {"byte_start": 2471, "byte_end": 2475, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 426, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "18.32% 18.32% 18.32% 18.32%", "model_b": "22.68% 22.68% 22.68% 22.68%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.017374522984027863]], "model_b": [[22681, " use", "normal", 0.006453223060816526]]}, "loss": {"model_a": 18.315464386285665, "model_b": 22.682998201476863}, "topk": {"model_a": [22681, 5, 0.017374522984027863, [[30808, 0.096526, " fact", false], [63469, 0.037724, " development", false], [59544, 0.033335, " discovery", false], [63820, 0.027142, " realization", false], [22681, 0.017375, " use", false], [63729, 0.01587, " observation", false], [31894, 0.014609, " role", false], [59612, 0.013572, " emergence", false], [63821, 0.01307, " recognition", false], [52013, 0.011464, " initial", false]]], "model_b": [22681, 13, 0.006453223060816526, [[30808, 0.113714, " fact", false], [63820, 0.05192, " realization", false], [45294, 0.035361, " belief", false], [59544, 0.024251, " discovery", false], [63729, 0.01735, " observation", false], [63821, 0.01715, " recognition", false], [63469, 0.015737, " development", false], [51708, 0.015735, " failure", false], [57404, 0.012184, " tendency", false], [31135, 0.011158, " idea", false]]]}, "raw_delta": -0.2421875, "tuned_delta": -0.18809790258492443}, {"byte_start": 2475, "byte_end": 2478, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 427, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.21% 0.21% 0.21%", "model_b": "0.16% 0.16% 0.16%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9654042720794678]], "model_b": [[4706, " of", "normal", 0.9739702343940735]]}, "loss": {"model_a": 0.21133228138021923, "model_b": 0.15849921103516443}, "topk": {"model_a": [4706, 1, 0.9654042720794678, [[4706, 0.965404, " of", false], [45, 0.012247, ",", false], [4450, 0.008096, " by", false], [4596, 0.005176, " in", false], [275, 0.001271, " (", false], [4424, 0.000813, " at", false], [21265, 0.000751, " and", false], [31601, 0.000534, " over", false], [21700, 0.000303, " for", false], [32227, 0.000271, " that", false]]], "model_b": [4706, 1, 0.9739702343940735, [[4706, 0.97397, " of", false], [4450, 0.011903, " by", false], [45, 0.003109, ",", false], [4596, 0.00234, " in", false], [32227, 0.001168, " that", false], [31351, 0.001086, " made", false], [21265, 0.000781, " and", false], [4811, 0.000622, " to", false], [275, 0.000448, " (", false], [21700, 0.000281, " for", false]]]}, "raw_delta": 0.0029296875, "tuned_delta": 0.05701928491507559}, {"byte_start": 2478, "byte_end": 2487, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 428, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34%", "model_b": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.002125680912286043]], "model_b": [[56537, " learning", "normal", 0.003542921971529722]]}, "loss": {"model_a": 12.335543535378722, "model_b": 11.333671979205832}, "topk": {"model_a": [56537, 62, 0.002125680912286043, [[38720, 0.059488, " human", false], [332, 0.054038, " a", false], [22590, 0.043098, " the", false], [46658, 0.037007, " neural", false], [52195, 0.032594, " massive", false], [30597, 0.028056, " deep", false], [59988, 0.024844, " massively", false], [56812, 0.020321, " parallel", false], [52167, 0.018009, " machine", false], [63875, 0.017711, " specialized", false]]], "model_b": [56537, 38, 0.003542921971529722, [[38720, 0.140135, " human", false], [30597, 0.068231, " deep", false], [59792, 0.042151, " heuristic", false], [22590, 0.036876, " the", false], [332, 0.031428, " a", false], [51832, 0.028815, " general", false], [4404, 0.019399, " ``", false], [47202, 0.018442, " search", false], [3609, 0.017911, " AI", false], [52167, 0.017716, " machine", false]]]}, "raw_delta": 0.05555555555555558, "tuned_delta": 0.10964515297063117}, {"byte_start": 2487, "byte_end": 2490, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 429, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "21.13% 21.13% 21.13%", "model_b": "22.07% 22.07% 22.07%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.02975294552743435]], "model_b": [[4450, " by", "normal", 0.02558513544499874]]}, "loss": {"model_a": 21.133228138021924, "model_b": 22.07248272193401}, "topk": {"model_a": [4450, 8, 0.02975294552743435, [[52224, 0.167015, " methods", false], [4811, 0.161166, " to", false], [61559, 0.123459, " algorithms", false], [45, 0.107821, ",", false], [30917, 0.101079, " from", false], [46, 0.034105, "-", false], [62633, 0.033417, " techniques", false], [4450, 0.029753, " by", false], [21265, 0.021394, " and", false], [275, 0.019614, " (", false]]], "model_b": [4450, 9, 0.02558513544499874, [[4811, 0.146963, " to", false], [61559, 0.112884, " algorithms", false], [46, 0.075809, "-", false], [52224, 0.068692, " methods", false], [45, 0.053224, ",", false], [4596, 0.051027, " in", false], [30917, 0.04963, " from", false], [62633, 0.044571, " techniques", false], [4450, 0.025585, " by", false], [4423, 0.025268, " as", false]]]}, "raw_delta": -0.05208333333333326, "tuned_delta": 0.002006264081742329}, {"byte_start": 2490, "byte_end": 2495, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 430, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"model_a": "16.57% 16.57% 16.57% 16.57% 16.57%", "model_b": "18.03% 18.03% 18.03% 18.03% 18.03%"}, "model_tokens": {"model_a": [[31978, " self", "normal", 0.010073735378682613]], "model_b": [[31978, " self", "normal", 0.006662741769105196]]}, "loss": {"model_a": 16.568450860209186, "model_b": 18.03368801111204}, "topk": {"model_a": [31978, 17, 0.010073735378682613, [[65003, 0.1349, " reinforcement", false], [59815, 0.102238, " imitation", false], [51668, 0.063129, " example", false], [30597, 0.061445, " deep", false], [46658, 0.042966, " neural", false], [38720, 0.032869, " human", false], [30218, 0.027649, " back", false], [22590, 0.02644, " the", false], [52491, 0.024558, " playing", false], [62557, 0.022996, " simulation", false]]], "model_b": [31978, 22, 0.006662741769105196, [[59815, 0.076912, " imitation", false], [46227, 0.062047, " humans", false], [40010, 0.061835, " trial", false], [52491, 0.048665, " playing", false], [38720, 0.04459, " human", false], [61979, 0.042451, " experience", false], [51668, 0.037955, " example", false], [65003, 0.034655, " reinforcement", false], [63729, 0.032149, " observation", false], [22590, 0.031917, " the", false]]]}, "raw_delta": -0.08125000000000004, "tuned_delta": -0.027160402584924456}, {"byte_start": 2495, "byte_end": 2500, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 431, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"model_a": "12.17% 12.17% 12.17% 12.17% 12.17%", "model_b": "16.23% 16.23% 16.23% 16.23% 16.23%"}, "model_tokens": {"model_a": [[31702, " play", "normal", 0.03406842425465584]], "model_b": [[31702, " play", "normal", 0.011169259436428547]]}, "loss": {"model_a": 12.172739407500629, "model_b": 16.230319210000836}, "topk": {"model_a": [31702, 2, 0.03406842425465584, [[46, 0.945554, "-", false], [31702, 0.034068, " play", false], [26697, 0.008956, "play", false], [57453, 0.001425, " training", false], [63621, 0.000766, " improvement", false], [52491, 0.000756, " playing", false], [45, 0.000704, ",", false], [21265, 0.000694, " and", false], [4715, 0.000517, " or", false], [275, 0.000372, " (", false]]], "model_b": [31702, 3, 0.011169259436428547, [[46, 0.916271, "-", false], [26697, 0.020017, "play", false], [31702, 0.011169, " play", false], [63621, 0.007883, " improvement", false], [45, 0.004966, ",", false], [57453, 0.003257, " training", false], [47, 0.002916, ".", false], [52491, 0.002421, " playing", false], [61958, 0.001414, " evaluation", false], [56537, 0.001245, " learning", false]]]}, "raw_delta": -0.225, "tuned_delta": -0.1709104025849244}, {"byte_start": 2500, "byte_end": 2503, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 432, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "12.02% 12.02% 12.02%", "model_b": "14.56% 14.56% 14.56%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.13792358338832855]], "model_b": [[4811, " to", "normal", 0.08752110600471497]]}, "loss": {"model_a": 12.022458674074693, "model_b": 14.558446050637324}, "topk": {"model_a": [4811, 2, 0.13792358338832855, [[45, 0.417633, ",", false], [4811, 0.137924, " to", false], [47, 0.114948, ".", false], [275, 0.042461, " (", false], [21265, 0.027035, " and", false], [4596, 0.026374, " in", false], [59, 0.02125, ":", false], [4706, 0.019343, " of", false], [32487, 0.01735, " with", false], [4712, 0.015412, " on", false]]], "model_b": [4811, 3, 0.08752110600471497, [[45, 0.352886, ",", false], [47, 0.152839, ".", false], [4811, 0.087521, " to", false], [4596, 0.061318, " in", false], [275, 0.043671, " (", false], [4706, 0.039374, " of", false], [21265, 0.035892, " and", false], [59, 0.021125, ":", false], [4712, 0.020903, " on", false], [50870, 0.020209, " against", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08653540258492441}, {"byte_start": 2503, "byte_end": 2509, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 433, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"model_a": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04%", "model_b": "10.85% 10.85% 10.85% 10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[38877, " learn", "normal", 0.025368090718984604]], "model_b": [[38877, " learn", "normal", 0.02700219675898552]]}, "loss": {"model_a": 11.036241360967004, "model_b": 10.848390444184586}, "topk": {"model_a": [38877, 4, 0.025368090718984604, [[51982, 0.162285, " improve", false], [30858, 0.030204, " find", false], [56010, 0.026963, " discover", false], [38877, 0.025368, " learn", false], [51456, 0.024142, " develop", false], [40000, 0.02404, " train", false], [37786, 0.019827, " avoid", false], [52640, 0.017333, " rapidly", false], [61516, 0.01656, " accelerate", false], [59771, 0.016493, " gradually", false]]], "model_b": [38877, 5, 0.02700219675898552, [[51982, 0.115712, " improve", false], [56791, 0.032878, " overcome", false], [31358, 0.030674, " make", false], [40000, 0.029158, " train", false], [38877, 0.027002, " learn", false], [37923, 0.024875, " build", false], [37786, 0.02256, " avoid", false], [51456, 0.02108, " develop", false], [47030, 0.018577, " reduce", false], [30938, 0.017609, " gain", false]]]}, "raw_delta": 0.01041666666666663, "tuned_delta": 0.06450626408174222}, {"byte_start": 2509, "byte_end": 2511, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 434, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "22.26% 22.26%", "model_b": "29.73% 29.73%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.08501612395048141]], "model_b": [[332, " a", "normal", 0.03741900250315666]]}, "loss": {"model_a": 22.260333638716425, "model_b": 29.727407580817506}, "topk": {"model_a": [332, 4, 0.08501612395048141, [[22590, 0.130279, " the", false], [30917, 0.099003, " from", false], [4811, 0.095094, " to", false], [332, 0.085016, " a", false], [21835, 0.05709, " how", false], [37598, 0.026214, " about", false], [32464, 0.024185, " what", false], [47202, 0.023609, " search", false], [22168, 0.019606, " new", false], [4419, 0.016802, " an", false]]], "model_b": [332, 6, 0.03741900250315666, [[22590, 0.153423, " the", false], [21835, 0.119948, " how", false], [30917, 0.081108, " from", false], [37598, 0.055786, " about", false], [4811, 0.051841, " to", false], [332, 0.037419, " a", false], [32464, 0.034885, " what", false], [62581, 0.021658, " strategies", false], [31458, 0.020069, " more", false], [38720, 0.019461, " human", false]]]}, "raw_delta": -0.4140625, "tuned_delta": -0.3599729025849244}, {"byte_start": 2511, "byte_end": 2517, "display": {"text": " value", "kind": "normal"}, "is_word": true, "word_id": 435, "word_key": " value", "bytes_hex": "20 76 61 6c 75 65", "compression": {"model_a": "17.09% 17.09% 17.09% 17.09% 17.09% 17.09%", "model_b": "21.70% 21.70% 21.70% 21.70% 21.70% 21.70%"}, "model_tokens": {"model_a": [[40093, " value", "normal", 0.003398081986233592]], "model_b": [[40093, " value", "normal", 0.0007248707115650177]]}, "loss": {"model_a": 17.094433427199956, "model_b": 21.696780888369172}, "topk": {"model_a": [40093, 40, 0.003398081986233592, [[51832, 0.077462, " general", false], [47202, 0.067976, " search", false], [30992, 0.062359, " good", false], [46857, 0.049598, " policy", false], [57317, 0.045921, " strategy", false], [39043, 0.037693, " model", false], [65161, 0.032359, " representation", false], [32386, 0.028991, " very", false], [45301, 0.028377, " better", false], [3851, 0.028315, " Go", false]]], "model_b": [40093, 165, 0.0007248707115650177, [[57317, 0.067435, " strategy", false], [51832, 0.044872, " general", false], [38720, 0.043453, " human", false], [22168, 0.038043, " new", false], [62483, 0.037019, " repertoire", false], [45301, 0.035218, " better", false], [30941, 0.034348, " game", false], [4404, 0.025406, " ``", false], [30992, 0.020266, " good", false], [31466, 0.017827, " much", false]]]}, "raw_delta": -0.2552083333333334, "tuned_delta": -0.20111873591825785}, {"byte_start": 2517, "byte_end": 2526, "display": {"text": " function", "kind": "normal"}, "is_word": true, "word_id": 436, "word_key": " function", "bytes_hex": "20 66 75 6e 63 74 69 6f 6e", "compression": {"model_a": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "model_b": "1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06%"}, "model_tokens": {"model_a": [[56292, " function", "normal", 0.6556443572044373]], "model_b": [[56292, " function", "normal", 0.5843533873558044]]}, "loss": {"model_a": 0.8453291255208769, "model_b": 1.064488528433697}, "topk": {"model_a": [56292, 1, 0.6556443572044373, [[56292, 0.655644, " function", false], [21700, 0.087647, " for", false], [56149, 0.061979, " estimate", false], [46, 0.036318, "-", false], [4706, 0.024888, " of", false], [39043, 0.01316, " model", false], [65161, 0.009733, " representation", false], [61955, 0.007907, " estimation", false], [59792, 0.00619, " heuristic", false], [47487, 0.00616, " system", false]]], "model_b": [56292, 1, 0.5843533873558044, [[56292, 0.584353, " function", false], [21700, 0.051106, " for", false], [64371, 0.041056, " distribution", false], [46, 0.038471, "-", false], [65161, 0.02862, " representation", false], [59793, 0.018943, " hierarchy", false], [47487, 0.018777, " system", false], [39043, 0.018136, " model", false], [60572, 0.017273, " structure", false], [4706, 0.013046, " of", false]]]}, "raw_delta": -0.012152777777777776, "tuned_delta": 0.04193681963729781}, {"byte_start": 2526, "byte_end": 2528, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "34.94% 34.94%", "model_b": "30.57% 30.57%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.02069687843322754]], "model_b": [[275, " (", "normal", 0.03355369716882706]]}, "loss": {"model_a": 34.94027052152958, "model_b": 30.572736706338382}, "topk": {"model_a": [275, 9, 0.02069687843322754, [[21700, 0.195586, " for", false], [32227, 0.177936, " that", false], [45, 0.157856, ",", false], [47, 0.07278, ".", false], [30917, 0.052868, " from", false], [4811, 0.046829, " to", false], [21265, 0.045101, " and", false], [4706, 0.042649, " of", false], [275, 0.020697, " (", false], [55536, 0.020321, " approxim", false]]], "model_b": [275, 8, 0.03355369716882706, [[32227, 0.242619, " that", false], [21700, 0.147878, " for", false], [45, 0.145897, ",", false], [47, 0.075668, ".", false], [4811, 0.050193, " to", false], [30917, 0.039797, " from", false], [21265, 0.039545, " and", false], [275, 0.033554, " (", false], [4596, 0.029122, " in", false], [4706, 0.018811, " of", false]]]}, "raw_delta": 0.2421875, "tuned_delta": 0.2962770974150756}, {"byte_start": 2528, "byte_end": 2530, "display": {"text": "as", "kind": "normal"}, "is_word": true, "word_id": 437, "word_key": "as", "bytes_hex": "61 73", "compression": {"model_a": "31.28% 31.28%", "model_b": "36.63% 36.63%"}, "model_tokens": {"model_a": [[1751, "as", "normal", 0.03128112480044365]], "model_b": [[1751, "as", "normal", 0.017456352710723877]]}, "loss": {"model_a": 31.277177644272445, "model_b": 36.63092877257133}, "topk": {"model_a": [1751, 7, 0.03128112480044365, [[2101, 0.080326, "or", false], [36003, 0.080096, "which", false], [98, 0.069288, "a", false], [8801, 0.05731, "the", false], [7005, 0.040737, "and", false], [7579, 0.03159, "for", false], [1751, 0.031281, "as", false], [2215, 0.023428, "to", false], [1746, 0.022925, "an", false], [1950, 0.021773, "in", false]]], "model_b": [1751, 11, 0.017456352710723877, [[8801, 0.09797, "the", false], [98, 0.070307, "a", false], [2101, 0.068019, "or", false], [36003, 0.054511, "which", false], [106, 0.030739, "i", false], [7005, 0.030498, "and", false], [87, 0.025531, "V", false], [8695, 0.024865, "see", false], [1950, 0.024629, "in", false], [27142, 0.023172, "that", false]]]}, "raw_delta": -0.296875, "tuned_delta": -0.24278540258492443}, {"byte_start": 2530, "byte_end": 2533, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 438, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "29.87% 29.87% 29.87%", "model_b": "27.99% 27.99% 27.99%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.006845293566584587]], "model_b": [[4601, " it", "normal", 0.009495694190263748]]}, "loss": {"model_a": 29.868295768404316, "model_b": 27.989786600580146}, "topk": {"model_a": [4601, 18, 0.006845293566584587, [[4596, 0.248739, " in", false], [52369, 0.244738, " opposed", false], [332, 0.049698, " a", false], [32458, 0.047174, " well", false], [22748, 0.033749, " was", false], [4419, 0.01949, " an", false], [32487, 0.019064, " with", false], [22590, 0.016928, " the", false], [4600, 0.016442, " is", false], [32354, 0.012238, " used", false]]], "model_b": [4601, 11, 0.009495694190263748, [[52369, 0.432471, " opposed", false], [4596, 0.200633, " in", false], [32487, 0.029501, " with", false], [32458, 0.018328, " well", false], [59546, 0.017136, " discussed", false], [332, 0.015749, " a", false], [32354, 0.015209, " used", false], [59488, 0.013216, " described", false], [22590, 0.010719, " the", false], [22748, 0.009662, " was", false]]]}, "raw_delta": 0.10416666666666674, "tuned_delta": 0.15825626408174231}, {"byte_start": 2533, "byte_end": 2537, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 439, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "7.33% 7.33% 7.33% 7.33%", "model_b": "7.33% 7.33% 7.33% 7.33%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.198941171169281]], "model_b": [[22748, " was", "normal", 0.19946284592151642]]}, "loss": {"model_a": 7.326185754514267, "model_b": 7.326185754514267}, "topk": {"model_a": [22748, 2, 0.198941171169281, [[47638, 0.242441, " turned", false], [22748, 0.198941, " was", false], [4600, 0.161035, " is", false], [32462, 0.105217, " were", false], [40040, 0.091945, " turns", false], [51896, 0.026667, " happens", false], [56348, 0.020272, " happened", false], [40219, 0.01411, " would", false], [21795, 0.011829, " had", false], [21800, 0.011143, " has", false]]], "model_b": [22748, 2, 0.19946284592151642, [[4600, 0.258128, " is", false], [22748, 0.199463, " was", false], [47638, 0.066204, " turned", false], [40219, 0.058771, " would", false], [40040, 0.053514, " turns", false], [32462, 0.043266, " were", false], [45283, 0.032811, " became", false], [21795, 0.029514, " had", false], [47266, 0.025758, " should", false], [21800, 0.02009, " has", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 2537, "byte_end": 2540, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 440, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "27.05% 27.05% 27.05%", "model_b": "17.28% 17.28% 17.28%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.01114705577492714]], "model_b": [[4596, " in", "normal", 0.05652039125561714]]}, "loss": {"model_a": 27.05053201666806, "model_b": 17.282284343982372}, "topk": {"model_a": [4596, 13, 0.01114705577492714, [[45395, 0.333862, " called", false], [32230, 0.079106, " then", false], [38848, 0.051663, " known", false], [62275, 0.029972, " originally", false], [38869, 0.022371, " later", false], [59868, 0.019801, " initially", false], [22187, 0.018243, " not", false], [38499, 0.016669, " first", false], [62684, 0.01598, " understood", false], [45, 0.012787, ",", false]]], "model_b": [4596, 4, 0.05652039125561714, [[45395, 0.366293, " called", false], [38848, 0.066298, " known", false], [32230, 0.058089, " then", false], [4596, 0.05652, " in", false], [47525, 0.048181, " termed", false], [30666, 0.035766, " done", false], [38869, 0.027089, " later", false], [21700, 0.020644, " for", false], [57053, 0.020468, " referred", false], [4811, 0.01997, " to", false]]]}, "raw_delta": 0.5416666666666666, "tuned_delta": 0.5957562640817422}, {"byte_start": 2540, "byte_end": 2545, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 441, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"model_a": "16.12% 16.12% 16.12% 16.12% 16.12%", "model_b": "17.70% 17.70% 17.70% 17.70% 17.70%"}, "model_tokens": {"model_a": [[31370, " many", "normal", 0.011500372551381588]], "model_b": [[31370, " many", "normal", 0.0073697203770279884]]}, "loss": {"model_a": 16.11760865993139, "model_b": 17.69555636090369}, "topk": {"model_a": [31370, 13, 0.011500372551381588, [[38013, 0.26649, " chess", false], [22590, 0.139523, " the", false], [3851, 0.113686, " Go", false], [30322, 0.042923, " both", false], [55809, 0.033523, " computer", false], [36274, 0.031875, " Alpha", false], [3492, 0.02359, " 19", false], [47202, 0.021193, " search", false], [38720, 0.01729, " human", false], [36466, 0.015516, " Chess", false]]], "model_b": [31370, 11, 0.0073697203770279884, [[3851, 0.326416, " Go", false], [22590, 0.107525, " the", false], [38013, 0.092976, " chess", false], [28753, 0.044442, " Deep", false], [38720, 0.042925, " human", false], [55809, 0.038097, " computer", false], [39193, 0.016904, " other", false], [3609, 0.014466, " AI", false], [30597, 0.008513, " deep", false], [47202, 0.008185, " search", false]]]}, "raw_delta": -0.08749999999999991, "tuned_delta": -0.03341040258492432}, {"byte_start": 2545, "byte_end": 2551, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 442, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "2.91% 2.91% 2.91% 2.91% 2.91% 2.91%", "model_b": "3.57% 3.57% 3.57% 3.57% 3.57% 3.57%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.3769276738166809]], "model_b": [[39193, " other", "normal", 0.30442193150520325]]}, "loss": {"model_a": 2.911689210127465, "model_b": 3.5691674188659244}, "topk": {"model_a": [39193, 1, 0.3769276738166809, [[39193, 0.376928, " other", false], [51551, 0.09823, " earlier", false], [4706, 0.06621, " of", false], [51515, 0.040781, " domains", false], [38576, 0.033758, " games", false], [38328, 0.032301, " early", false], [56926, 0.025966, " previous", false], [3609, 0.024194, " AI", false], [55809, 0.022975, " computer", false], [37970, 0.020843, " cases", false]]], "model_b": [39193, 1, 0.30442193150520325, [[39193, 0.304422, " other", false], [38576, 0.066986, " games", false], [3609, 0.04457, " AI", false], [4706, 0.038266, " of", false], [37970, 0.030744, " cases", false], [55809, 0.023647, " computer", false], [38720, 0.02271, " human", false], [47202, 0.021548, " search", false], [37738, 0.021134, " areas", false], [38328, 0.019662, " early", false]]]}, "raw_delta": -0.036458333333333315, "tuned_delta": 0.017631264081742273}, {"byte_start": 2551, "byte_end": 2557, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 443, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"model_a": "6.53% 6.53% 6.53% 6.53% 6.53% 6.53%", "model_b": "6.39% 6.39% 6.39% 6.39% 6.39% 6.39%"}, "model_tokens": {"model_a": [[38576, " games", "normal", 0.1139829158782959]], "model_b": [[38576, " games", "normal", 0.11949160695075989]]}, "loss": {"model_a": 6.527819358188994, "model_b": 6.386931170602182}, "topk": {"model_a": [38576, 2, 0.1139829158782959, [[51515, 0.433342, " domains", false], [38576, 0.113983, " games", false], [3609, 0.095083, " AI", false], [37738, 0.075944, " areas", false], [37970, 0.035832, " cases", false], [45976, 0.031162, " fields", false], [56939, 0.018183, " problems", false], [64251, 0.015185, " applications", false], [55809, 0.012712, " computer", false], [30941, 0.012314, " game", false]]], "model_b": [38576, 3, 0.11949160695075989, [[51515, 0.183152, " domains", false], [37738, 0.166471, " areas", false], [38576, 0.119492, " games", false], [45976, 0.087668, " fields", false], [3609, 0.080897, " AI", false], [55809, 0.021371, " computer", false], [30941, 0.018257, " game", false], [63481, 0.01668, " disciplines", false], [37970, 0.015147, " cases", false], [56939, 0.014307, " problems", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06190209741507559}, {"byte_start": 2557, "byte_end": 2561, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 444, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "20.57% 20.57% 20.57% 20.57%", "model_b": "20.01% 20.01% 20.01% 20.01%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.01029981765896082]], "model_b": [[21265, " and", "normal", 0.012044657953083515]]}, "loss": {"model_a": 20.56967538767467, "model_b": 20.00612263732742}, "topk": {"model_a": [21265, 7, 0.01029981765896082, [[42, 0.300396, ")", false], [497, 0.201442, "),", false], [499, 0.168273, ").", false], [45, 0.125889, ",", false], [4423, 0.046018, " as", false], [4424, 0.019084, " at", false], [21265, 0.0103, " and", false], [45285, 0.009439, " before", false], [22614, 0.008871, " too", false], [32139, 0.008363, " such", false]]], "model_b": [21265, 6, 0.012044657953083515, [[42, 0.38861, ")", false], [497, 0.219285, "),", false], [499, 0.179689, ").", false], [45, 0.077856, ",", false], [32139, 0.022522, " such", false], [21265, 0.012045, " and", false], [31296, 0.010345, " like", false], [40185, 0.008957, " where", false], [4706, 0.008468, " of", false], [4424, 0.008024, " at", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08533959741507559}, {"byte_start": 2561, "byte_end": 2566, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 445, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "18.71% 18.71% 18.71% 18.71% 18.71%", "model_b": "13.69% 13.69% 13.69% 13.69% 13.69%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.005658430512994528]], "model_b": [[30788, " even", "normal", 0.022639598697423935]]}, "loss": {"model_a": 18.709951311528744, "model_b": 13.694331833438206}, "topk": {"model_a": [30788, 23, 0.005658430512994528, [[51515, 0.383366, " domains", false], [4596, 0.12598, " in", false], [3609, 0.032943, " AI", false], [64251, 0.031425, " applications", false], [4423, 0.027926, " as", false], [39193, 0.026296, " other", false], [4811, 0.020793, " to", false], [56939, 0.017074, " problems", false], [31370, 0.012536, " many", false], [39898, 0.010971, " tasks", false]]], "model_b": [30788, 7, 0.022639598697423935, [[51515, 0.152644, " domains", false], [4596, 0.074931, " in", false], [3609, 0.043213, " AI", false], [31370, 0.042888, " many", false], [56939, 0.03156, " problems", false], [39898, 0.029813, " tasks", false], [30788, 0.02264, " even", false], [64251, 0.022457, " applications", false], [45, 0.020139, ",", false], [22187, 0.0182, " not", false]]]}, "raw_delta": 0.27812500000000007, "tuned_delta": 0.33221459741507564}, {"byte_start": 2566, "byte_end": 2569, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 446, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "4.27% 4.27% 4.27%", "model_b": "7.28% 7.28% 7.28%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.48613446950912476]], "model_b": [[4596, " in", "normal", 0.2976779341697693]]}, "loss": {"model_a": 4.273608356799989, "model_b": 7.279223025318662}, "topk": {"model_a": [4596, 1, 0.48613446950912476, [[4596, 0.486134, " in", false], [38013, 0.111113, " chess", false], [32074, 0.030967, " some", false], [31458, 0.024572, " more", false], [22184, 0.021033, " non", false], [4423, 0.013628, " as", false], [4811, 0.013192, " to", false], [31370, 0.013172, " many", false], [3851, 0.011135, " Go", false], [55809, 0.010021, " computer", false]]], "model_b": [4596, 1, 0.2976779341697693, [[4596, 0.297678, " in", false], [32074, 0.082362, " some", false], [38013, 0.037263, " chess", false], [22590, 0.026765, " the", false], [31458, 0.026542, " more", false], [39193, 0.022111, " other", false], [21700, 0.018435, " for", false], [332, 0.017301, " a", false], [31370, 0.015684, " many", false], [4811, 0.014685, " to", false]]]}, "raw_delta": -0.16666666666666666, "tuned_delta": -0.11257706925159107}, {"byte_start": 2569, "byte_end": 2575, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 447, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "3.78% 3.78% 3.78% 3.78% 3.78% 3.78%", "model_b": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.2851180136203766]], "model_b": [[38013, " chess", "normal", 0.062201086431741714]]}, "loss": {"model_a": 3.780499700246144, "model_b": 8.359365796817562}, "topk": {"model_a": [38013, 1, 0.2851180136203766, [[38013, 0.285118, " chess", false], [22590, 0.076218, " the", false], [3851, 0.068435, " Go", false], [55809, 0.050382, " computer", false], [32074, 0.037516, " some", false], [31370, 0.030969, " many", false], [39311, 0.024418, " poker", false], [36274, 0.016639, " Alpha", false], [47202, 0.015812, " search", false], [38720, 0.015549, " human", false]]], "model_b": [38013, 3, 0.062201086431741714, [[32074, 0.106671, " some", false], [22590, 0.077265, " the", false], [38013, 0.062201, " chess", false], [38720, 0.059492, " human", false], [46227, 0.041409, " humans", false], [31370, 0.032722, " many", false], [39193, 0.029234, " other", false], [65003, 0.026938, " reinforcement", false], [332, 0.021406, " a", false], [52299, 0.017447, " natural", false]]]}, "raw_delta": -0.25390625, "tuned_delta": -0.19981665258492443}, {"byte_start": 2575, "byte_end": 2576, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "43.11%", "model_b": "57.20%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.0931757241487503]], "model_b": [[45, ",", "normal", 0.041017524898052216]]}, "loss": {"model_a": 43.111785401564724, "model_b": 57.200604160246}, "topk": {"model_a": [45, 4, 0.0931757241487503, [[499, 0.282001, ").", false], [42, 0.259751, ")", false], [497, 0.189755, "),", false], [45, 0.093176, ",", false], [45285, 0.052042, " before", false], [4596, 0.012291, " in", false], [4424, 0.011912, " at", false], [39356, 0.009601, " prior", false], [502, 0.005652, ");", false], [37634, 0.004393, " after", false]]], "model_b": [45, 4, 0.041017524898052216, [[42, 0.379129, ")", false], [497, 0.218409, "),", false], [499, 0.19993, ").", false], [45, 0.041018, ",", false], [46342, 0.030988, " itself", false], [21265, 0.021911, " and", false], [4596, 0.012276, " in", false], [502, 0.011403, ");", false], [4424, 0.009112, " at", false], [21700, 0.004806, " for", false]]]}, "raw_delta": -0.78125, "tuned_delta": -0.7271604025849244}, {"byte_start": 2576, "byte_end": 2585, "display": {"text": " although", "kind": "normal"}, "is_word": true, "word_id": 448, "word_key": " although", "bytes_hex": "20 61 6c 74 68 6f 75 67 68", "compression": {"model_a": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "model_b": "7.45% 7.45% 7.45% 7.45% 7.45% 7.45% 7.45% 7.45% 7.45%"}, "model_tokens": {"model_a": [[55495, " although", "normal", 0.029813870787620544]], "model_b": [[55495, " although", "normal", 0.02429584227502346]]}, "loss": {"model_a": 7.044409379340641, "model_b": 7.451419699035879}, "topk": {"model_a": [55495, 6, 0.029813870787620544, [[21400, 0.200355, " but", false], [40185, 0.103638, " where", false], [47544, 0.065321, " though", false], [45285, 0.055038, " before", false], [4423, 0.036981, " as", false], [55495, 0.029814, " although", false], [21265, 0.029054, " and", false], [22590, 0.025076, " the", false], [21700, 0.024961, " for", false], [40186, 0.022637, " which", false]]], "model_b": [55495, 11, 0.02429584227502346, [[21400, 0.134146, " but", false], [40185, 0.070194, " where", false], [4596, 0.054786, " in", false], [21265, 0.049136, " and", false], [47544, 0.048312, " though", false], [40186, 0.032657, " which", false], [3851, 0.031219, " Go", false], [22590, 0.030867, " the", false], [4423, 0.029914, " as", false], [21700, 0.028243, " for", false]]]}, "raw_delta": -0.02256944444444442, "tuned_delta": 0.03152015297063117}, {"byte_start": 2585, "byte_end": 2594, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 449, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46%", "model_b": "8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.005482254084199667]], "model_b": [[56537, " learning", "normal", 0.015728676691651344]]}, "loss": {"model_a": 10.457034367554552, "model_b": 8.328057310687155}, "topk": {"model_a": [56537, 20, 0.005482254084199667, [[22590, 0.14525, " the", false], [4596, 0.112733, " in", false], [32227, 0.111733, " that", false], [4601, 0.072475, " it", false], [39934, 0.07201, " there", false], [22187, 0.052881, " not", false], [32234, 0.049834, " this", false], [38013, 0.041112, " chess", false], [47202, 0.016682, " search", false], [31277, 0.015004, " less", false]]], "model_b": [56537, 14, 0.015728676691651344, [[22590, 0.13996, " the", false], [22187, 0.085657, " not", false], [4601, 0.076407, " it", false], [4596, 0.060201, " in", false], [32234, 0.059724, " this", false], [32227, 0.041737, " that", false], [3851, 0.020304, " Go", false], [39934, 0.020177, " there", false], [31466, 0.019466, " much", false], [31277, 0.017826, " less", false]]]}, "raw_delta": 0.11805555555555558, "tuned_delta": 0.17214515297063115}, {"byte_start": 2594, "byte_end": 2598, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 450, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"model_a": "27.05% 27.05% 27.05% 27.05%", "model_b": "26.35% 26.35% 26.35% 26.35%"}, "model_tokens": {"model_a": [[21532, " did", "normal", 0.0025070246774703264]], "model_b": [[21532, " did", "normal", 0.002922740997746587]]}, "loss": {"model_a": 27.05053201666806, "model_b": 26.346091078734}, "topk": {"model_a": [21532, 27, 0.0025070246774703264, [[4450, 0.402714, " by", false], [332, 0.136427, " a", false], [22590, 0.078279, " the", false], [22748, 0.053338, " was", false], [4706, 0.051219, " of", false], [4596, 0.03753, " in", false], [4811, 0.029705, " to", false], [30917, 0.019043, " from", false], [32227, 0.016914, " that", false], [4600, 0.013652, " is", false]]], "model_b": [21532, 29, 0.002922740997746587, [[4450, 0.268345, " by", false], [22748, 0.166412, " was", false], [332, 0.055394, " a", false], [4596, 0.043072, " in", false], [4811, 0.039645, " to", false], [40093, 0.027725, " value", false], [4600, 0.027138, " is", false], [4706, 0.027095, " of", false], [22590, 0.025771, " the", false], [30917, 0.025059, " from", false]]]}, "raw_delta": 0.0390625, "tuned_delta": 0.09315209741507559}, {"byte_start": 2598, "byte_end": 2602, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 451, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "0.26% 0.26% 0.26% 0.26%", "model_b": "0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.9441571831703186]], "model_b": [[22187, " not", "normal", 0.9001966714859009]]}, "loss": {"model_a": 0.25866190689766416, "model_b": 0.4776990110365372}, "topk": {"model_a": [22187, 1, 0.9441571831703186, [[22187, 0.944157, " not", false], [32187, 0.006166, " take", false], [39166, 0.004852, " occur", false], [31702, 0.004682, " play", false], [46159, 0.00249, " happen", false], [30482, 0.002195, " come", false], [61959, 0.001925, " eventually", false], [31967, 0.001481, " seem", false], [31466, 0.001419, " much", false], [37829, 0.001197, " begin", false]]], "model_b": [22187, 1, 0.9001966714859009, [[22187, 0.900197, " not", false], [32187, 0.013522, " take", false], [39166, 0.00991, " occur", false], [46159, 0.007772, " happen", false], [31466, 0.003301, " much", false], [61959, 0.002765, " eventually", false], [45284, 0.002324, " become", false], [52724, 0.002243, " require", false], [30482, 0.002193, " come", false], [31059, 0.002018, " have", false]]]}, "raw_delta": -0.01214599609375, "tuned_delta": 0.04194360132132559}, {"byte_start": 2602, "byte_end": 2607, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 452, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"model_a": "9.19% 9.19% 9.19% 9.19% 9.19%", "model_b": "14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"model_a": [[31702, " play", "normal", 0.07770711183547974]], "model_b": [[31702, " play", "normal", 0.01688573881983757]]}, "loss": {"model_a": 9.185909830660195, "model_b": 14.765082059097983}, "topk": {"model_a": [31702, 1, 0.07770711183547974, [[31702, 0.077707, " play", false], [31967, 0.062265, " seem", false], [39801, 0.058786, " start", false], [39166, 0.04257, " occur", false], [56041, 0.036512, " dominate", false], [32499, 0.031206, " work", false], [46159, 0.030387, " happen", false], [45185, 0.027338, " appear", false], [22770, 0.02692, " win", false], [37829, 0.02434, " begin", false]]], "model_b": [31702, 16, 0.01688573881983757, [[45284, 0.080067, " become", false], [39166, 0.078557, " occur", false], [30482, 0.071509, " come", false], [32187, 0.047155, " take", false], [37829, 0.040502, " begin", false], [46159, 0.034844, " happen", false], [45185, 0.026456, " appear", false], [45150, 0.024874, " always", false], [45846, 0.020636, " emerge", false], [22797, 0.020068, " yet", false]]]}, "raw_delta": -0.30937499999999996, "tuned_delta": -0.2552854025849244}, {"byte_start": 2607, "byte_end": 2609, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 453, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "7.89% 7.89%", "model_b": "6.52% 6.52%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.4145268499851227]], "model_b": [[332, " a", "normal", 0.48289451003074646]]}, "loss": {"model_a": 7.889738504861517, "model_b": 6.516078675890093}, "topk": {"model_a": [332, 1, 0.4145268499851227, [[332, 0.414527, " a", false], [4423, 0.218792, " as", false], [32139, 0.092081, " such", false], [22590, 0.089039, " the", false], [4419, 0.038356, " an", false], [31466, 0.034285, " much", false], [32227, 0.033541, " that", false], [21273, 0.027088, " any", false], [4788, 0.011159, " so", false], [32234, 0.006514, " this", false]]], "model_b": [332, 1, 0.48289451003074646, [[332, 0.482895, " a", false], [22249, 0.144994, " out", false], [4423, 0.143065, " as", false], [22590, 0.043459, " the", false], [4419, 0.034712, " an", false], [31466, 0.02782, " much", false], [46342, 0.018442, " itself", false], [32139, 0.015331, " such", false], [21273, 0.011806, " any", false], [46647, 0.010337, " nearly", false]]]}, "raw_delta": 0.076171875, "tuned_delta": 0.13026147241507557}, {"byte_start": 2609, "byte_end": 2613, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 454, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"model_a": "17.47% 17.47% 17.47% 17.47%", "model_b": "15.36% 15.36% 15.36% 15.36%"}, "model_tokens": {"model_a": [[21357, " big", "normal", 0.020496277138590813]], "model_b": [[21357, " big", "normal", 0.03324894234538078]]}, "loss": {"model_a": 17.47013526076479, "model_b": 15.356812446962596}, "topk": {"model_a": [21357, 10, 0.020496277138590813, [[31894, 0.35724, " role", false], [38961, 0.087679, " major", false], [51156, 0.079813, " central", false], [60273, 0.062897, " prominent", false], [38864, 0.053773, " large", false], [63870, 0.047491, " significant", false], [31633, 0.031742, " part", false], [56040, 0.031581, " dominant", false], [45752, 0.027115, " direct", false], [21357, 0.020496, " big", false]]], "model_b": [21357, 9, 0.03324894234538078, [[38864, 0.203478, " large", false], [38961, 0.14804, " major", false], [51156, 0.106336, " central", false], [31894, 0.086186, " role", false], [63870, 0.06335, " significant", false], [56040, 0.041903, " dominant", false], [60273, 0.039293, " prominent", false], [21952, 0.034871, " key", false], [21357, 0.033249, " big", false], [32386, 0.018315, " very", false]]]}, "raw_delta": 0.1171875, "tuned_delta": 0.17127709741507557}, {"byte_start": 2613, "byte_end": 2618, "display": {"text": " role", "kind": "normal"}, "is_word": true, "word_id": 455, "word_key": " role", "bytes_hex": "20 72 6f 6c 65", "compression": {"model_a": "0.50% 0.50% 0.50% 0.50% 0.50%", "model_b": "0.43% 0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"model_a": [[31894, " role", "normal", 0.8702993392944336]], "model_b": [[31894, " role", "normal", 0.8881008625030518]]}, "loss": {"model_a": 0.5036752706228559, "model_b": 0.42618676745010875}, "topk": {"model_a": [31894, 1, 0.8702993392944336, [[31894, 0.870299, " role", false], [31633, 0.099551, " part", false], [45865, 0.013572, " enough", false], [52013, 0.006282, " initial", false], [45752, 0.001327, " direct", false], [45, 0.001155, ",", false], [31895, 0.000607, " roll", false], [39568, 0.0006, " rôle", false], [4715, 0.000542, " or", false], [38328, 0.000513, " early", false]]], "model_b": [31894, 1, 0.8881008625030518, [[31894, 0.888101, " role", false], [31633, 0.095788, " part", false], [45950, 0.002614, " factor", false], [45865, 0.002349, " enough", false], [31895, 0.001227, " roll", false], [45, 0.000749, ",", false], [4715, 0.000663, " or", false], [31044, 0.000431, " hand", false], [4588, 0.00027, " if", false], [11, 0.000252, "\n", false]]]}, "raw_delta": 0.004296875000000002, "tuned_delta": 0.058386472415075594}, {"byte_start": 2618, "byte_end": 2621, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 456, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "3.10% 3.10% 3.10%", "model_b": "2.38% 2.38% 2.38%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.5950484275817871]], "model_b": [[4596, " in", "normal", 0.6751785278320312]]}, "loss": {"model_a": 3.099540126909882, "model_b": 2.383358506676917}, "topk": {"model_a": [4596, 1, 0.5950484275817871, [[4596, 0.595048, " in", false], [39934, 0.150896, " there", false], [499, 0.059296, ").", false], [40076, 0.034228, " until", false], [4424, 0.034011, " at", false], [59868, 0.017486, " initially", false], [42, 0.012552, ")", false], [32230, 0.011976, " then", false], [21700, 0.009663, " for", false], [31077, 0.009021, " here", false]]], "model_b": [4596, 1, 0.6751785278320312, [[4596, 0.675179, " in", false], [40076, 0.077049, " until", false], [499, 0.064471, ").", false], [42, 0.02277, ")", false], [4424, 0.019983, " at", false], [39934, 0.019775, " there", false], [21700, 0.019674, " for", false], [497, 0.016649, "),", false], [59868, 0.006841, " initially", false], [32230, 0.006452, " then", false]]]}, "raw_delta": 0.03971354166666666, "tuned_delta": 0.09380313908174225}, {"byte_start": 2621, "byte_end": 2625, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 457, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.99% 5.99% 5.99% 5.99%", "model_b": "6.02% 6.02% 6.02% 6.02%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.26575765013694763]], "model_b": [[22590, " the", "normal", 0.2657221257686615]]}, "loss": {"model_a": 5.987747972439545, "model_b": 6.022970019336248}, "topk": {"model_a": [22590, 2, 0.26575765013694763, [[38013, 0.269528, " chess", false], [22590, 0.265758, " the", false], [3851, 0.081561, " Go", false], [55809, 0.052864, " computer", false], [32227, 0.046727, " that", false], [39944, 0.027278, " those", false], [38328, 0.023411, " early", false], [53354, 0.013249, " winning", false], [47202, 0.010337, " search", false], [38720, 0.009971, " human", false]]], "model_b": [22590, 1, 0.2657221257686615, [[22590, 0.265722, " the", false], [3851, 0.263964, " Go", false], [32234, 0.040059, " this", false], [38013, 0.033684, " chess", false], [32227, 0.031838, " that", false], [38328, 0.028107, " early", false], [55809, 0.018289, " computer", false], [31461, 0.016475, " most", false], [38720, 0.009684, " human", false], [39944, 0.008747, " those", false]]]}, "raw_delta": -0.001953125, "tuned_delta": 0.05213647241507559}, {"byte_start": 2625, "byte_end": 2628, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 458, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"model_a": "23.48% 23.48% 23.48%", "model_b": "25.36% 25.36% 25.36%"}, "model_tokens": {"model_a": [[3492, " 19", "normal", 0.02015720121562481]], "model_b": [[3492, " 19", "normal", 0.014982953667640686]]}, "loss": {"model_a": 23.481364597802134, "model_b": 25.359873765626308}, "topk": {"model_a": [3492, 10, 0.02015720121562481, [[38328, 0.119445, " early", false], [38013, 0.104095, " chess", false], [47202, 0.086436, " search", false], [52013, 0.076176, " initial", false], [3851, 0.048838, " Go", false], [51551, 0.043884, " earlier", false], [38720, 0.036309, " human", false], [38499, 0.035452, " first", false], [38491, 0.026591, " final", false], [3492, 0.020157, " 19", false]]], "model_b": [3492, 11, 0.014982953667640686, [[38328, 0.160086, " early", false], [3851, 0.078211, " Go", false], [59657, 0.040416, " evolution", false], [53052, 0.03133, " success", false], [63469, 0.03119, " development", false], [30941, 0.031093, " game", false], [30405, 0.025967, " case", false], [52013, 0.022289, " initial", false], [38491, 0.021848, " final", false], [38720, 0.020925, " human", false]]]}, "raw_delta": -0.10416666666666674, "tuned_delta": -0.05007706925159115}, {"byte_start": 2628, "byte_end": 2630, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 459, "word_key": "97", "bytes_hex": "39 37", "compression": {"model_a": "2.85% 2.85%", "model_b": "10.36% 10.36%"}, "model_tokens": {"model_a": [[717, "97", "normal", 0.7284044027328491]], "model_b": [[717, "97", "normal", 0.3165627717971802]]}, "loss": {"model_a": 2.8529857986329596, "model_b": 10.355281787630743}, "topk": {"model_a": [717, 1, 0.7284044027328491, [[717, 0.728404, "97", false], [710, 0.179865, "90", false], [716, 0.035469, "96", false], [700, 0.011845, "80", false], [690, 0.00909, "70", false], [709, 0.004971, "89", false], [719, 0.004885, "99", false], [670, 0.004309, "50", false], [715, 0.003452, "95", false], [711, 0.002343, "91", false]]], "model_b": [717, 1, 0.3165627717971802, [[717, 0.316563, "97", false], [710, 0.218616, "90", false], [700, 0.21409, "80", false], [690, 0.099309, "70", false], [680, 0.041751, "60", false], [716, 0.018912, "96", false], [719, 0.011322, "99", false], [718, 0.009491, "98", false], [670, 0.007609, "50", false], [715, 0.00743, "95", false]]]}, "raw_delta": -0.416015625, "tuned_delta": -0.3619260275849244}, {"byte_start": 2630, "byte_end": 2638, "display": {"text": " program", "kind": "normal"}, "is_word": true, "word_id": 460, "word_key": " program", "bytes_hex": "20 70 72 6f 67 72 61 6d", "compression": {"model_a": "11.48% 11.48% 11.48% 11.48% 11.48% 11.48% 11.48% 11.48%", "model_b": "16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62%"}, "model_tokens": {"model_a": [[52580, " program", "normal", 0.006228081416338682]], "model_b": [[52580, " program", "normal", 0.0006317073712125421]]}, "loss": {"model_a": 11.482387288325246, "model_b": 16.62480613524391}, "topk": {"model_a": [52580, 24, 0.006228081416338682, [[53283, 0.108538, " victory", false], [38013, 0.089222, " chess", false], [38981, 0.065294, " match", false], [46, 0.065221, "-", false], [30941, 0.063723, " game", false], [45685, 0.059596, " defeat", false], [20184, 0.044272, " Kas", false], [40213, 0.037546, " world", false], [21265, 0.035805, " and", false], [47202, 0.030445, " search", false]]], "model_b": [52580, 122, 0.0006317073712125421, [[3851, 0.079371, " Go", false], [38013, 0.054612, " chess", false], [53283, 0.052956, " victory", false], [20184, 0.052099, " Kas", false], [45685, 0.049574, " defeat", false], [30405, 0.046693, " case", false], [30941, 0.033691, " game", false], [46, 0.030283, "-", false], [40213, 0.025896, " world", false], [52738, 0.024997, " results", false]]]}, "raw_delta": -0.28515625, "tuned_delta": -0.23106665258492443}, {"byte_start": 2638, "byte_end": 2643, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 461, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "14.37% 14.37% 14.37% 14.37% 14.37%", "model_b": "15.89% 15.89% 15.89% 15.89% 15.89%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.01888643205165863]], "model_b": [[32227, " that", "normal", 0.012416651472449303]]}, "loss": {"model_a": 14.370595133854907, "model_b": 15.892187559792486}, "topk": {"model_a": [32227, 6, 0.01888643205165863, [[499, 0.68857, ").", false], [42, 0.068422, ")", false], [497, 0.06727, "),", false], [45, 0.03764, ",", false], [21700, 0.021178, " for", false], [32227, 0.018886, " that", false], [580, 0.016441, ".)", false], [21265, 0.010519, " and", false], [4706, 0.007717, " of", false], [47, 0.004464, ".", false]]], "model_b": [32227, 13, 0.012416651472449303, [[499, 0.461952, ").", false], [42, 0.098318, ")", false], [497, 0.070002, "),", false], [21700, 0.054104, " for", false], [4706, 0.035631, " of", false], [50870, 0.023114, " against", false], [4596, 0.019853, " in", false], [580, 0.019402, ".)", false], [45, 0.015885, ",", false], [4424, 0.013815, " at", false]]]}, "raw_delta": -0.08437499999999998, "tuned_delta": -0.03028540258492439}, {"byte_start": 2643, "byte_end": 2649, "display": {"text": " first", "kind": "normal"}, "is_word": true, "word_id": 462, "word_key": " first", "bytes_hex": "20 66 69 72 73 74", "compression": {"model_a": "15.59% 15.59% 15.59% 15.59% 15.59% 15.59%", "model_b": "20.85% 20.85% 20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[38499, " first", "normal", 0.005630576517432928]], "model_b": [[38499, " first", "normal", 0.0009758607484400272]]}, "loss": {"model_a": 15.591626092940619, "model_b": 20.851451762848296}, "topk": {"model_a": [38499, 9, 0.005630576517432928, [[22777, 0.464782, " won", false], [55934, 0.223228, " defeated", false], [30256, 0.083291, " beat", false], [22748, 0.020675, " was", false], [51744, 0.017805, " finally", false], [61959, 0.009888, " eventually", false], [21532, 0.007498, " did", false], [62676, 0.007335, " ultimately", false], [38499, 0.005631, " first", false], [21994, 0.005627, " led", false]]], "model_b": [38499, 81, 0.0009758607484400272, [[22777, 0.255547, " won", false], [55934, 0.156276, " defeated", false], [46936, 0.053159, " proved", false], [22748, 0.030445, " was", false], [30256, 0.02645, " beat", false], [45283, 0.025217, " became", false], [21994, 0.022691, " led", false], [32272, 0.021496, " took", false], [56942, 0.016025, " produced", false], [31351, 0.014846, " made", false]]]}, "raw_delta": -0.2916666666666666, "tuned_delta": -0.237577069251591}, {"byte_start": 2649, "byte_end": 2654, "display": {"text": " beat", "kind": "normal"}, "is_word": true, "word_id": 463, "word_key": " beat", "bytes_hex": "20 62 65 61 74", "compression": {"model_a": "5.55% 5.55% 5.55% 5.55% 5.55%", "model_b": "11.10% 11.10% 11.10% 11.10% 11.10%"}, "model_tokens": {"model_a": [[30256, " beat", "normal", 0.21177823841571808]], "model_b": [[30256, " beat", "normal", 0.045871980488300323]]}, "loss": {"model_a": 5.550994590920425, "model_b": 11.10198918184085}, "topk": {"model_a": [30256, 3, 0.21177823841571808, [[22777, 0.286485, " won", false], [55934, 0.253486, " defeated", false], [30256, 0.211778, " beat", false], [31351, 0.012831, " made", false], [55437, 0.011345, " achieved", false], [32354, 0.006439, " used", false], [46936, 0.005962, " proved", false], [32272, 0.005958, " took", false], [47333, 0.005357, " solved", false], [51097, 0.004873, " brought", false]]], "model_b": [30256, 7, 0.045871980488300323, [[22777, 0.089459, " won", false], [32354, 0.0731, " used", false], [47270, 0.066907, " showed", false], [50937, 0.059883, " applied", false], [46936, 0.055908, " proved", false], [64347, 0.049327, " demonstrated", false], [30256, 0.045872, " beat", false], [55437, 0.039771, " achieved", false], [52112, 0.036492, " learned", false], [55934, 0.024097, " defeated", false]]]}, "raw_delta": -0.3078125, "tuned_delta": -0.2537229025849244}, {"byte_start": 2654, "byte_end": 2656, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 464, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "40.01% 40.01%", "model_b": "30.71% 30.71%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.011944356374442577]], "model_b": [[332, " a", "normal", 0.032871197909116745]]}, "loss": {"model_a": 40.01224527465484, "model_b": 30.713624893925193}, "topk": {"model_a": [332, 4, 0.011944356374442577, [[20184, 0.806659, " Kas", false], [22590, 0.126618, " the", false], [40213, 0.014172, " world", false], [332, 0.011944, " a", false], [38720, 0.010875, " human", false], [19948, 0.003774, " Gar", false], [38013, 0.003355, " chess", false], [46227, 0.001549, " humans", false], [38621, 0.001381, " grand", false], [22615, 0.001217, " top", false]]], "model_b": [332, 3, 0.032871197909116745, [[20184, 0.763552, " Kas", false], [22590, 0.045832, " the", false], [332, 0.032871, " a", false], [40213, 0.020043, " world", false], [19948, 0.019551, " Gar", false], [3851, 0.017685, " Go", false], [28753, 0.0115, " Deep", false], [37576, 0.00926, " World", false], [38621, 0.003567, " grand", false], [20273, 0.003498, " Lee", false]]]}, "raw_delta": 0.515625, "tuned_delta": 0.5697145974150756}, {"byte_start": 2656, "byte_end": 2662, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 465, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"model_a": "2.61% 2.61% 2.61% 2.61% 2.61% 2.61%", "model_b": "3.31% 3.31% 3.31% 3.31% 3.31% 3.31%"}, "model_tokens": {"model_a": [[40213, " world", "normal", 0.4182984530925751]], "model_b": [[40213, " world", "normal", 0.33036497235298157]]}, "loss": {"model_a": 2.606431470356037, "model_b": 3.310872408290101}, "topk": {"model_a": [40213, 1, 0.4182984530925751, [[40213, 0.418298, " world", false], [38720, 0.249122, " human", false], [38621, 0.153568, " grand", false], [22615, 0.061515, " top", false], [38013, 0.046831, " chess", false], [64532, 0.010259, " professional", false], [55716, 0.010002, " champion", false], [39471, 0.006408, " reign", false], [20184, 0.005079, " Kas", false], [47436, 0.003959, " strong", false]]], "model_b": [40213, 1, 0.33036497235298157, [[40213, 0.330365, " world", false], [38720, 0.184093, " human", false], [38621, 0.042989, " grand", false], [3851, 0.0366, " Go", false], [64532, 0.035317, " professional", false], [22615, 0.032237, " top", false], [55809, 0.023568, " computer", false], [46526, 0.023096, " master", false], [55716, 0.02182, " champion", false], [39855, 0.018392, " super", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.015027097415075588}, {"byte_start": 2662, "byte_end": 2671, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 466, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"model_a": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "model_b": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"model_a": [[55716, " champion", "normal", 0.7612940073013306]], "model_b": [[55716, " champion", "normal", 0.8632250428199768]]}, "loss": {"model_a": 0.5439849465157495, "model_b": 0.2935170574725267}, "topk": {"model_a": [55716, 1, 0.7612940073013306, [[55716, 0.761294, " champion", false], [38013, 0.123764, " chess", false], [46, 0.072842, "-", false], [38621, 0.011521, " grand", false], [37996, 0.007376, " champ", false], [64275, 0.007362, " championship", false], [38046, 0.002726, " class", false], [46526, 0.00215, " master", false], [38720, 0.001669, " human", false], [46841, 0.000877, " player", false]]], "model_b": [55716, 1, 0.8632250428199768, [[55716, 0.863225, " champion", false], [46, 0.079431, "-", false], [38013, 0.017023, " chess", false], [38621, 0.005226, " grand", false], [47024, 0.003024, " record", false], [46841, 0.00279, " player", false], [46685, 0.002401, " number", false], [64275, 0.002243, " championship", false], [37996, 0.001825, " champ", false], [64532, 0.001539, " professional", false]]]}, "raw_delta": 0.013888888888888892, "tuned_delta": 0.06797848630396448}, {"byte_start": 2671, "byte_end": 2673, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"model_a": "3.08% 3.08%", "model_b": "4.93% 4.93%"}, "model_tokens": {"model_a": [[499, ").", "normal", 0.7121771574020386]], "model_b": [[499, ").", "normal", 0.5840897560119629]]}, "loss": {"model_a": 3.0819291034615306, "model_b": 4.931086565538449}, "topk": {"model_a": [499, 1, 0.7121771574020386, [[499, 0.712177, ").", false], [42, 0.054444, ")", false], [497, 0.049724, "),", false], [45, 0.049385, ",", false], [580, 0.032032, ".)", false], [47, 0.022036, ".", false], [4596, 0.019002, " in", false], [4424, 0.011766, " at", false], [21265, 0.006325, " and", false], [60, 0.004699, ";", false]]], "model_b": [499, 1, 0.5840897560119629, [[499, 0.58409, ").", false], [4596, 0.109329, " in", false], [42, 0.070828, ")", false], [45, 0.051846, ",", false], [497, 0.051119, "),", false], [47, 0.027023, ".", false], [4424, 0.019368, " at", false], [580, 0.011062, ".)", false], [4450, 0.008653, " by", false], [502, 0.00527, ");", false]]]}, "raw_delta": -0.1025390625, "tuned_delta": -0.04844946508492441}, {"byte_start": 2673, "byte_end": 2682, "display": {"text": " Learning", "kind": "normal"}, "is_word": true, "word_id": 467, "word_key": " learning", "bytes_hex": "20 4c 65 61 72 6e 69 6e 67", "compression": {"model_a": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%", "model_b": "8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70%"}, "model_tokens": {"model_a": [[55122, " Learning", "normal", 0.014099424704909325]], "model_b": [[55122, " Learning", "normal", 0.012911861762404442]]}, "loss": {"model_a": 8.515908227469575, "model_b": 8.703759144251991}, "topk": {"model_a": [55122, 12, 0.014099424704909325, [[261, 0.277084, "\n\n", false], [20996, 0.098456, " The", false], [267, 0.055791, "  ", false], [29894, 0.053921, " This", false], [3913, 0.043547, " In", false], [19555, 0.033826, " But", false], [36251, 0.023086, " Again", false], [3918, 0.021389, " It", false], [37453, 0.017088, " These", false], [29511, 0.016195, " Once", false]]], "model_b": [55122, 16, 0.012911861762404442, [[261, 0.149566, "\n\n", false], [20996, 0.104216, " The", false], [29894, 0.05696, " This", false], [267, 0.048657, "  ", false], [3913, 0.047837, " In", false], [37453, 0.043949, " These", false], [19555, 0.027562, " But", false], [3918, 0.018408, " It", false], [11, 0.017395, "\n", false], [300, 0.01571, " A", false]]]}, "raw_delta": -0.010416666666666685, "tuned_delta": 0.0436729307484089}, {"byte_start": 2682, "byte_end": 2685, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 468, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "7.51% 7.51% 7.51%", "model_b": "6.39% 6.39% 6.39%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.2856481075286865]], "model_b": [[4450, " by", "normal", 0.3497852087020874]]}, "loss": {"model_a": 7.514036671296684, "model_b": 6.386931170602182}, "topk": {"model_a": [4450, 1, 0.2856481075286865, [[4450, 0.285648, " by", false], [4600, 0.074767, " is", false], [22748, 0.067164, " was", false], [332, 0.056962, " a", false], [30917, 0.042613, " from", false], [4811, 0.037718, " to", false], [22590, 0.033044, " the", false], [4706, 0.032283, " of", false], [45, 0.022286, ",", false], [21800, 0.021196, " has", false]]], "model_b": [4450, 1, 0.3497852087020874, [[4450, 0.349785, " by", false], [22748, 0.097998, " was", false], [4600, 0.051442, " is", false], [4811, 0.040763, " to", false], [30917, 0.027216, " from", false], [332, 0.026345, " a", false], [4596, 0.023712, " in", false], [45, 0.021884, ",", false], [4706, 0.017131, " of", false], [22590, 0.015121, " the", false]]]}, "raw_delta": 0.0625, "tuned_delta": 0.11658959741507559}, {"byte_start": 2685, "byte_end": 2690, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 469, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"model_a": "0.74% 0.74% 0.74% 0.74% 0.74%", "model_b": "2.71% 2.71% 2.71% 2.71% 2.71%"}, "model_tokens": {"model_a": [[31978, " self", "normal", 0.8137813806533813]], "model_b": [[31978, " self", "normal", 0.46954578161239624]]}, "loss": {"model_a": 0.7431851895204377, "model_b": 2.705053201666806}, "topk": {"model_a": [31978, 1, 0.8137813806533813, [[31978, 0.813781, " self", false], [47202, 0.029136, " search", false], [38720, 0.01375, " human", false], [46342, 0.012835, " itself", false], [52491, 0.008772, " playing", false], [65003, 0.007723, " reinforcement", false], [40093, 0.007475, " value", false], [59815, 0.005903, " imitation", false], [31702, 0.004359, " play", false], [62557, 0.004344, " simulation", false]]], "model_b": [31978, 1, 0.46954578161239624, [[31978, 0.469546, " self", false], [31702, 0.134425, " play", false], [52491, 0.071326, " playing", false], [40010, 0.015928, " trial", false], [61979, 0.012584, " experience", false], [46342, 0.011715, " itself", false], [47497, 0.008927, " taking", false], [22590, 0.008023, " the", false], [47202, 0.008001, " search", false], [40093, 0.007978, " value", false]]]}, "raw_delta": -0.1087890625, "tuned_delta": -0.05469946508492442}, {"byte_start": 2690, "byte_end": 2695, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 470, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"model_a": "1.13% 1.13% 1.13% 1.13% 1.13%", "model_b": "0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"model_a": [[31702, " play", "normal", 0.7305943965911865]], "model_b": [[31702, " play", "normal", 0.9550389051437378]]}, "loss": {"model_a": 1.1271055006945025, "model_b": 0.16554362041450507}, "topk": {"model_a": [31702, 1, 0.7305943965911865, [[31702, 0.730594, " play", false], [46, 0.264675, "-", false], [26697, 0.001694, "play", false], [39301, 0.000377, " plays", false], [52491, 0.000345, " playing", false], [4715, 0.000135, " or", false], [11, 7.4e-05, "\n", false], [45, 7.4e-05, ",", false], [32189, 6.3e-05, " talk", false], [47077, 6.2e-05, " replay", false]]], "model_b": [31702, 1, 0.9550389051437378, [[31702, 0.955039, " play", false], [46, 0.033199, "-", false], [26697, 0.003746, "play", false], [52491, 0.00344, " playing", false], [56537, 0.000268, " learning", false], [46840, 0.00023, " played", false], [39301, 0.000218, " plays", false], [38877, 0.000118, " learn", false], [61958, 0.000104, " evaluation", false], [29593, 9.8e-05, " Play", false]]]}, "raw_delta": 0.0533203125, "tuned_delta": 0.1074099099150756}, {"byte_start": 2695, "byte_end": 2696, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "50.72%", "model_b": "50.16%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.06047001853585243]], "model_b": [[45, ",", "normal", 0.061828434467315674]]}, "loss": {"model_a": 50.719747531252615, "model_b": 50.156194780905366}, "topk": {"model_a": [45, 3, 0.06047001853585243, [[4600, 0.265067, " is", false], [22748, 0.154439, " was", false], [45, 0.06047, ",", false], [21800, 0.048743, " has", false], [46936, 0.023373, " proved", false], [30135, 0.018009, " also", false], [21795, 0.017133, " had", false], [21413, 0.016848, " can", false], [4596, 0.016831, " in", false], [21532, 0.012162, " did", false]]], "model_b": [45, 3, 0.061828434467315674, [[22748, 0.220829, " was", false], [4600, 0.198458, " is", false], [45, 0.061828, ",", false], [21413, 0.023614, " can", false], [45283, 0.021424, " became", false], [21800, 0.02046, " has", false], [46936, 0.017836, " proved", false], [4596, 0.014947, " in", false], [21795, 0.013247, " had", false], [50887, 0.012743, " allowed", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08533959741507559}, {"byte_start": 2696, "byte_end": 2700, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 471, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "11.98% 11.98% 11.98% 11.98%", "model_b": "12.89% 12.89% 12.89% 12.89%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.0699387714266777]], "model_b": [[21265, " and", "normal", 0.05706906318664551]]}, "loss": {"model_a": 11.97549594487909, "model_b": 12.891269164193373}, "topk": {"model_a": [21265, 4, 0.0699387714266777, [[4715, 0.106634, " or", false], [51948, 0.080174, " however", false], [4596, 0.073112, " in", false], [21265, 0.069939, " and", false], [40186, 0.05474, " which", false], [4423, 0.042955, " as", false], [4450, 0.028859, " by", false], [32487, 0.024602, " with", false], [47001, 0.019805, " rather", false], [32465, 0.019563, " when", false]]], "model_b": [21265, 4, 0.05706906318664551, [[4596, 0.084682, " in", false], [40186, 0.068736, " which", false], [4715, 0.061147, " or", false], [21265, 0.057069, " and", false], [4423, 0.047575, " as", false], [51948, 0.036482, " however", false], [22590, 0.02892, " the", false], [55780, 0.028642, " combined", false], [40187, 0.02329, " while", false], [32465, 0.023017, " when", false]]]}, "raw_delta": -0.05078125, "tuned_delta": 0.003308347415075588}, {"byte_start": 2700, "byte_end": 2709, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 472, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "model_b": "6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.051337603479623795]], "model_b": [[56537, " learning", "normal", 0.03347543627023697]]}, "loss": {"model_a": 5.948612364776541, "model_b": 6.825249976427822}, "topk": {"model_a": [56537, 3, 0.051337603479623795, [[22590, 0.14072, " the", false], [4450, 0.077418, " by", false], [56537, 0.051338, " learning", false], [47202, 0.05026, " search", false], [4596, 0.047363, " in", false], [32230, 0.039624, " then", false], [21902, 0.038404, " its", false], [39193, 0.02872, " other", false], [61953, 0.028545, " especially", false], [40085, 0.023326, " using", false]]], "model_b": [56537, 6, 0.03347543627023697, [[22590, 0.253182, " the", false], [4450, 0.065913, " by", false], [61953, 0.051862, " especially", false], [4596, 0.050266, " in", false], [21902, 0.037618, " its", false], [56537, 0.033475, " learning", false], [31458, 0.027456, " more", false], [39193, 0.021644, " other", false], [22187, 0.019804, " not", false], [64507, 0.017652, " particularly", false]]]}, "raw_delta": -0.048611111111111105, "tuned_delta": 0.005478486303964483}, {"byte_start": 2709, "byte_end": 2712, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 473, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "20.85% 20.85% 20.85%", "model_b": "18.13% 18.13% 18.13%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.031202295795083046]], "model_b": [[4596, " in", "normal", 0.0487254336476326]]}, "loss": {"model_a": 20.851451762848296, "model_b": 18.12761346950325}, "topk": {"model_a": [4596, 6, 0.031202295795083046, [[4450, 0.419549, " by", false], [30917, 0.107853, " from", false], [4811, 0.069568, " to", false], [332, 0.049121, " a", false], [22590, 0.037323, " the", false], [4596, 0.031202, " in", false], [4706, 0.030607, " of", false], [32487, 0.030387, " with", false], [22705, 0.013148, " via", false], [40093, 0.012071, " value", false]]], "model_b": [4596, 4, 0.0487254336476326, [[4450, 0.309295, " by", false], [30917, 0.151789, " from", false], [4811, 0.088109, " to", false], [4596, 0.048725, " in", false], [32487, 0.041134, " with", false], [53140, 0.032376, " through", false], [4706, 0.029938, " of", false], [22705, 0.023759, " via", false], [40085, 0.018342, " using", false], [22590, 0.015113, " the", false]]]}, "raw_delta": 0.15104166666666674, "tuned_delta": 0.20513126408174231}, {"byte_start": 2712, "byte_end": 2720, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 474, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "model_b": "2.54% 2.54% 2.54% 2.54% 2.54% 2.54% 2.54% 2.54%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.5234772562980652]], "model_b": [[51832, " general", "normal", 0.32668763399124146]]}, "loss": {"model_a": 1.4705204579373587, "model_b": 2.535987376562631}, "topk": {"model_a": [51832, 1, 0.5234772562980652, [[51832, 0.523477, " general", false], [22590, 0.101166, " the", false], [332, 0.060567, " a", false], [39193, 0.024559, " other", false], [62293, 0.021128, " particular", false], [32234, 0.016136, " this", false], [47202, 0.013361, " search", false], [4419, 0.012075, " an", false], [56812, 0.01165, " parallel", false], [38576, 0.010957, " games", false]]], "model_b": [51832, 1, 0.32668763399124146, [[51832, 0.326688, " general", false], [332, 0.167972, " a", false], [22590, 0.11121, " the", false], [39193, 0.030677, " other", false], [4419, 0.021096, " an", false], [38576, 0.019307, " games", false], [32234, 0.014439, " this", false], [32448, 0.011794, " ways", false], [31978, 0.009668, " self", false], [38720, 0.009232, " human", false]]]}, "raw_delta": -0.05908203125, "tuned_delta": -0.004992433834924412}, {"byte_start": 2720, "byte_end": 2721, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.28%", "model_b": "3.45%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9317038059234619]], "model_b": [[45, ",", "normal", 0.8270139694213867]]}, "loss": {"model_a": 1.276799200005491, "model_b": 3.451760595876914}, "topk": {"model_a": [45, 1, 0.9317038059234619, [[45, 0.931704, ",", false], [275, 0.008793, " (", false], [4450, 0.007177, " by", false], [30917, 0.005872, " from", false], [21286, 0.004578, " are", false], [4596, 0.004207, " in", false], [4600, 0.003044, " is", false], [4423, 0.002999, " as", false], [21700, 0.002112, " for", false], [32462, 0.00185, " were", false]]], "model_b": [45, 1, 0.8270139694213867, [[45, 0.827014, ",", false], [4450, 0.043312, " by", false], [30917, 0.03124, " from", false], [275, 0.012716, " (", false], [22748, 0.005982, " was", false], [40085, 0.005319, " using", false], [22705, 0.00455, " via", false], [4600, 0.004261, " is", false], [4596, 0.00393, " in", false], [32487, 0.003908, " with", false]]]}, "raw_delta": -0.12060546875, "tuned_delta": -0.06651587133492441}, {"byte_start": 2721, "byte_end": 2724, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 475, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "8.55% 8.55% 8.55%", "model_b": "9.02% 9.02% 9.02%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.239624485373497]], "model_b": [[4600, " is", "normal", 0.22019228339195251]]}, "loss": {"model_a": 8.547216713599978, "model_b": 9.01684400555602}, "topk": {"model_a": [4600, 1, 0.239624485373497, [[4600, 0.239624, " is", false], [22748, 0.130871, " was", false], [21800, 0.096172, " has", false], [21286, 0.086335, " are", false], [32462, 0.04343, " were", false], [46936, 0.030249, " proved", false], [31059, 0.026591, " have", false], [21795, 0.025319, " had", false], [47638, 0.019544, " turned", false], [21413, 0.015931, " can", false]]], "model_b": [4600, 1, 0.22019228339195251, [[4600, 0.220192, " is", false], [22748, 0.210715, " was", false], [32462, 0.04842, " were", false], [21286, 0.042572, " are", false], [21800, 0.040901, " has", false], [45283, 0.027661, " became", false], [46936, 0.024967, " proved", false], [21413, 0.020365, " can", false], [21795, 0.016835, " had", false], [21532, 0.009108, " did", false]]]}, "raw_delta": -0.026041666666666685, "tuned_delta": 0.028047930748408903}, {"byte_start": 2724, "byte_end": 2729, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 476, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"model_a": "27.84% 27.84% 27.84% 27.84% 27.84%", "model_b": "25.70% 25.70% 25.70% 25.70% 25.70%"}, "model_tokens": {"model_a": [[31296, " like", "normal", 0.0004481030919123441]], "model_b": [[31296, " like", "normal", 0.0008152991649694741]]}, "loss": {"model_a": 27.839505867154212, "model_b": 25.698005415834658}, "topk": {"model_a": [31296, 151, 0.0004481030919123441, [[332, 0.285115, " a", false], [22187, 0.072617, " not", false], [22590, 0.060805, " the", false], [4419, 0.059896, " an", false], [22226, 0.031702, " one", false], [31466, 0.027757, " much", false], [39171, 0.025885, " often", false], [50919, 0.022929, " another", false], [31458, 0.01857, " more", false], [32386, 0.01539, " very", false]]], "model_b": [31296, 108, 0.0008152991649694741, [[332, 0.202642, " a", false], [22590, 0.182725, " the", false], [4419, 0.051941, " an", false], [22226, 0.043922, " one", false], [22187, 0.041384, " not", false], [32464, 0.026519, " what", false], [22190, 0.02646, " now", false], [31466, 0.017944, " much", false], [39820, 0.011795, " still", false], [32386, 0.011191, " very", false]]]}, "raw_delta": 0.11874999999999991, "tuned_delta": 0.17283959741507549}, {"byte_start": 2729, "byte_end": 2736, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 477, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.85% 7.85% 7.85% 7.85% 7.85% 7.85% 7.85%", "model_b": "15.46% 15.46% 15.46% 15.46% 15.46% 15.46% 15.46%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.04752352833747864]], "model_b": [[47202, " search", "normal", 0.002499517984688282]]}, "loss": {"model_a": 7.849484736979571, "model_b": 15.45744686666746}, "topk": {"model_a": [47202, 4, 0.04752352833747864, [[332, 0.146975, " a", false], [22590, 0.119602, " the", false], [38720, 0.067053, " human", false], [47202, 0.047524, " search", false], [37920, 0.03768, " brute", false], [38013, 0.021692, " chess", false], [60463, 0.021109, " searching", false], [21273, 0.021, " any", false], [56537, 0.020379, " learning", false], [30597, 0.019064, " deep", false]]], "model_b": [47202, 34, 0.002499517984688282, [[56537, 0.239753, " learning", false], [22590, 0.137477, " the", false], [332, 0.070553, " a", false], [47497, 0.026018, " taking", false], [40085, 0.019209, " using", false], [38720, 0.018395, " human", false], [30597, 0.016535, " deep", false], [4419, 0.013216, " an", false], [31978, 0.01141, " self", false], [57453, 0.01081, " training", false]]]}, "raw_delta": -0.42187499999999994, "tuned_delta": -0.36778540258492437}, {"byte_start": 2736, "byte_end": 2739, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 478, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "5.64% 5.64% 5.64%", "model_b": "6.72% 6.72% 6.72%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.3910079598426819]], "model_b": [[4596, " in", "normal", 0.32310786843299866]]}, "loss": {"model_a": 5.635527503472513, "model_b": 6.71567027497141}, "topk": {"model_a": [4596, 1, 0.3910079598426819, [[4596, 0.391008, " in", false], [45, 0.202242, ",", false], [59, 0.099982, ":", false], [4450, 0.084479, " by", false], [47, 0.040716, ".", false], [21400, 0.03315, " but", false], [60, 0.02015, ";", false], [21265, 0.018215, " and", false], [32487, 0.008743, " with", false], [21700, 0.007815, " for", false]]], "model_b": [4596, 1, 0.32310786843299866, [[4596, 0.323108, " in", false], [45, 0.107558, ",", false], [4450, 0.089082, " by", false], [59, 0.065315, ":", false], [47, 0.044845, ".", false], [21265, 0.043302, " and", false], [32227, 0.037173, " that", false], [21400, 0.032726, " but", false], [21700, 0.018794, " for", false], [60, 0.017197, ";", false]]]}, "raw_delta": -0.059895833333333315, "tuned_delta": -0.005806235918257727}, {"byte_start": 2739, "byte_end": 2744, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 479, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.62% 1.62% 1.62% 1.62% 1.62%", "model_b": "2.61% 2.61% 2.61% 2.61% 2.61%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.6378023028373718]], "model_b": [[32227, " that", "normal", 0.48553159832954407]]}, "loss": {"model_a": 1.6202141572483475, "model_b": 2.606431470356037}, "topk": {"model_a": [32227, 1, 0.6378023028373718, [[32227, 0.637802, " that", false], [22590, 0.088056, " the", false], [31370, 0.040742, " many", false], [21902, 0.030745, " its", false], [37832, 0.025968, " being", false], [32234, 0.023841, " this", false], [38013, 0.019362, " chess", false], [332, 0.018678, " a", false], [32074, 0.006937, " some", false], [39920, 0.006094, " terms", false]]], "model_b": [32227, 1, 0.48553159832954407, [[32227, 0.485532, " that", false], [38013, 0.126855, " chess", false], [22590, 0.095399, " the", false], [31370, 0.031732, " many", false], [51832, 0.026939, " general", false], [332, 0.026108, " a", false], [55809, 0.024397, " computer", false], [21902, 0.015671, " its", false], [39193, 0.01525, " other", false], [3851, 0.00902, " Go", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 2744, "byte_end": 2747, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 480, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "2.21% 2.21% 2.21%", "model_b": "2.43% 2.43% 2.43%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.694502592086792]], "model_b": [[4601, " it", "normal", 0.6688187718391418]]}, "loss": {"model_a": 2.2072482721934006, "model_b": 2.4303212358725212}, "topk": {"model_a": [4601, 1, 0.694502592086792, [[4601, 0.694503, " it", false], [22590, 0.090856, " the", false], [21902, 0.019429, " its", false], [45, 0.018944, ",", false], [332, 0.010958, " a", false], [39934, 0.010073, " there", false], [30322, 0.009476, " both", false], [56537, 0.007013, " learning", false], [22226, 0.006704, " one", false], [22799, 0.005822, " you", false]]], "model_b": [4601, 1, 0.6688187718391418, [[4601, 0.668819, " it", false], [22590, 0.074987, " the", false], [30322, 0.033225, " both", false], [39934, 0.020741, " there", false], [332, 0.015512, " a", false], [21902, 0.012752, " its", false], [45, 0.010439, ",", false], [22799, 0.008181, " you", false], [4588, 0.006975, " if", false], [22226, 0.006793, " one", false]]]}, "raw_delta": -0.012369791666666671, "tuned_delta": 0.04171980574840892}, {"byte_start": 2747, "byte_end": 2755, "display": {"text": " enables", "kind": "normal"}, "is_word": true, "word_id": 481, "word_key": " enables", "bytes_hex": "20 65 6e 61 62 6c 65 73", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "model_b": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"model_a": [[51597, " enables", "normal", 0.005270105786621571]], "model_b": [[51597, " enables", "normal", 0.0028392684180289507]]}, "loss": {"model_a": 11.834607757292277, "model_b": 13.173045539367}, "topk": {"model_a": [51597, 25, 0.005270105786621571, [[4600, 0.253682, " is", false], [21413, 0.087753, " can", false], [56540, 0.045638, " leverage", false], [47181, 0.045148, " scales", false], [30659, 0.044006, " does", false], [57102, 0.034876, " requires", false], [56501, 0.025579, " involves", false], [21800, 0.023224, " has", false], [39914, 0.01778, " tends", false], [32356, 0.016487, " uses", false]]], "model_b": [51597, 39, 0.0028392684180289507, [[4600, 0.324105, " is", false], [21413, 0.070451, " can", false], [57102, 0.054109, " requires", false], [56540, 0.048869, " leverage", false], [30659, 0.028533, " does", false], [32356, 0.02823, " uses", false], [39888, 0.027711, " takes", false], [56501, 0.021844, " involves", false], [38964, 0.021737, " makes", false], [47056, 0.020859, " relies", false]]]}, "raw_delta": -0.07421875, "tuned_delta": -0.020129152584924412}, {"byte_start": 2755, "byte_end": 2763, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 482, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "model_b": "10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.0401168130338192]], "model_b": [[52195, " massive", "normal", 0.008654110133647919]]}, "loss": {"model_a": 7.25574166072086, "model_b": 10.707502256597774}, "topk": {"model_a": [52195, 3, 0.0401168130338192, [[22590, 0.173718, " the", false], [332, 0.10964, " a", false], [52195, 0.040117, " massive", false], [22226, 0.034335, " one", false], [4419, 0.0304, " an", false], [59988, 0.029927, " massively", false], [38888, 0.027781, " lever", false], [52224, 0.027375, " methods", false], [51832, 0.023804, " general", false], [63370, 0.023168, " computation", false]]], "model_b": [52195, 18, 0.008654110133647919, [[22590, 0.199932, " the", false], [332, 0.11528, " a", false], [51832, 0.04592, " general", false], [4419, 0.043823, " an", false], [63370, 0.038843, " computation", false], [45124, 0.026297, " agents", false], [65135, 0.020153, " generalization", false], [22226, 0.019975, " one", false], [31458, 0.019527, " more", false], [22799, 0.017633, " you", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13731665258492443}, {"byte_start": 2763, "byte_end": 2775, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 483, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52%", "model_b": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.09728000313043594]], "model_b": [[63370, " computation", "normal", 0.2271721065044403]]}, "loss": {"model_a": 3.5222046896703203, "model_b": 2.2307296367912035}, "topk": {"model_a": [63370, 4, 0.09728000313043594, [[45, 0.126396, ",", false], [56812, 0.121244, " parallel", false], [63621, 0.119267, " improvement", false], [63370, 0.09728, " computation", false], [64423, 0.075713, " improvements", false], [56950, 0.063865, " progress", false], [63562, 0.031557, " exploration", false], [56540, 0.023432, " leverage", false], [38888, 0.022804, " lever", false], [52805, 0.01612, " scaling", false]]], "model_b": [63370, 1, 0.2271721065044403, [[63370, 0.227172, " computation", false], [45, 0.081097, ",", false], [65135, 0.063275, " generalization", false], [56812, 0.043252, " parallel", false], [39590, 0.038168, " scale", false], [51832, 0.026817, " general", false], [64862, 0.025793, " computational", false], [63562, 0.022641, " exploration", false], [30597, 0.022017, " deep", false], [59346, 0.021445, " computing", false]]]}, "raw_delta": 0.07161458333333334, "tuned_delta": 0.12570418074840894}, {"byte_start": 2775, "byte_end": 2778, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 484, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "4.27% 4.27% 4.27%", "model_b": "11.22% 11.22% 11.22%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.4887532591819763]], "model_b": [[4811, " to", "normal", 0.1538623869419098]]}, "loss": {"model_a": 4.273608356799989, "model_b": 11.224092277749422}, "topk": {"model_a": [4811, 1, 0.4887532591819763, [[4811, 0.488753, " to", false], [45, 0.089803, ",", false], [47, 0.079899, ".", false], [21265, 0.036857, " and", false], [53356, 0.031182, " without", false], [4706, 0.028676, " of", false], [4424, 0.027044, " at", false], [4596, 0.026625, " in", false], [32487, 0.026466, " with", false], [4712, 0.020952, " on", false]]], "model_b": [4811, 3, 0.1538623869419098, [[45, 0.270061, ",", false], [47, 0.194681, ".", false], [4811, 0.153862, " to", false], [21265, 0.08956, " and", false], [32227, 0.027312, " that", false], [4450, 0.023491, " by", false], [4424, 0.023485, " at", false], [275, 0.021791, " (", false], [4596, 0.019403, " in", false], [4706, 0.017161, " of", false]]]}, "raw_delta": -0.38541666666666674, "tuned_delta": -0.33132706925159117}, {"byte_start": 2778, "byte_end": 2781, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 485, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "1.55% 1.55% 1.55%", "model_b": "3.12% 3.12% 3.12%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.7740868926048279]], "model_b": [[4435, " be", "normal", 0.5915042161941528]]}, "loss": {"model_a": 1.549770063454941, "model_b": 3.1230214915076844}, "topk": {"model_a": [4435, 1, 0.7740868926048279, [[4435, 0.774087, " be", false], [56540, 0.038693, " leverage", false], [32187, 0.00792, " take", false], [31358, 0.006221, " make", false], [45284, 0.006172, " become", false], [30858, 0.005718, " find", false], [31702, 0.005342, " play", false], [4491, 0.00497, " do", false], [51982, 0.004533, " improve", false], [52570, 0.004326, " proceed", false]]], "model_b": [4435, 1, 0.5915042161941528, [[4435, 0.591504, " be", false], [45284, 0.029481, " become", false], [56540, 0.028765, " leverage", false], [32187, 0.027471, " take", false], [39590, 0.019896, " scale", false], [22770, 0.013262, " win", false], [53051, 0.011517, " succeed", false], [51982, 0.011107, " improve", false], [4491, 0.009931, " do", false], [50848, 0.009858, " achieve", false]]]}, "raw_delta": -0.08723958333333333, "tuned_delta": -0.03314998591825774}, {"byte_start": 2781, "byte_end": 2789, "display": {"text": " brought", "kind": "normal"}, "is_word": true, "word_id": 486, "word_key": " brought", "bytes_hex": "20 62 72 6f 75 67 68 74", "compression": {"model_a": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%", "model_b": "14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30%"}, "model_tokens": {"model_a": [[51097, " brought", "normal", 0.010964682325720787]], "model_b": [[51097, " brought", "normal", 0.0017313762800768018]]}, "loss": {"model_a": 10.214393600043929, "model_b": 14.3001510400615}, "topk": {"model_a": [51097, 8, 0.010964682325720787, [[50937, 0.351463, " applied", false], [56540, 0.165552, " leverage", false], [32354, 0.085808, " used", false], [30666, 0.057943, " done", false], [60152, 0.05008, " performed", false], [51139, 0.012738, " carried", false], [55957, 0.011391, " deployed", false], [51097, 0.010965, " brought", false], [31351, 0.010142, " made", false], [59355, 0.009901, " conducted", false]]], "model_b": [51097, 34, 0.0017313762800768018, [[50937, 0.36869, " applied", false], [56540, 0.154402, " leverage", false], [32354, 0.143389, " used", false], [30666, 0.044967, " done", false], [60152, 0.04239, " performed", false], [31351, 0.019344, " made", false], [55957, 0.013644, " deployed", false], [51903, 0.013332, " harness", false], [51139, 0.01159, " carried", false], [59355, 0.008892, " conducted", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17247290258492443}, {"byte_start": 2789, "byte_end": 2792, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 487, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.26% 0.26% 0.26%", "model_b": "2.35% 2.35% 2.35%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9572607278823853]], "model_b": [[4811, " to", "normal", 0.6771755814552307]]}, "loss": {"model_a": 0.2612301811505488, "model_b": 2.3481364597802137}, "topk": {"model_a": [4811, 1, 0.9572607278823853, [[4811, 0.957261, " to", false], [31162, 0.01716, " into", false], [40062, 0.004825, " under", false], [4596, 0.002499, " in", false], [56003, 0.001631, " directly", false], [30678, 0.001246, " down", false], [63507, 0.001037, " effectively", false], [52628, 0.000781, " quickly", false], [51791, 0.000753, " forward", false], [57435, 0.000639, " together", false]]], "model_b": [4811, 1, 0.6771755814552307, [[4811, 0.677176, " to", false], [31162, 0.123182, " into", false], [57435, 0.032646, " together", false], [30678, 0.02151, " down", false], [40062, 0.019549, " under", false], [22249, 0.019358, " out", false], [4596, 0.013701, " in", false], [46705, 0.011146, " online", false], [4712, 0.006451, " on", false], [4424, 0.006423, " at", false]]]}, "raw_delta": -0.11572265625000001, "tuned_delta": -0.061633058834924426}, {"byte_start": 2792, "byte_end": 2797, "display": {"text": " bear", "kind": "normal"}, "is_word": true, "word_id": 488, "word_key": " bear", "bytes_hex": "20 62 65 61 72", "compression": {"model_a": "0.04% 0.04% 0.04% 0.04% 0.04%", "model_b": "0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"model_a": [[30255, " bear", "normal", 0.989607036113739]], "model_b": [[30255, " bear", "normal", 0.9745910167694092]]}, "loss": {"model_a": 0.037863700413955946, "model_b": 0.09333842427626349}, "topk": {"model_a": [30255, 1, 0.989607036113739, [[30255, 0.989607, " bear", false], [22590, 0.002974, " the", false], [332, 0.001924, " a", false], [4419, 0.000646, " an", false], [39590, 0.000471, " scale", false], [31702, 0.000347, " play", false], [30235, 0.000283, " bare", false], [32202, 0.000196, " task", false], [22681, 0.000153, " use", false], [39898, 0.000123, " tasks", false]]], "model_b": [30255, 1, 0.9745910167694092, [[30255, 0.974591, " bear", false], [22590, 0.007851, " the", false], [39590, 0.003177, " scale", false], [332, 0.00309, " a", false], [31702, 0.002168, " play", false], [37823, 0.000805, " bears", false], [4419, 0.000707, " an", false], [31044, 0.000358, " hand", false], [22681, 0.000309, " use", false], [31427, 0.000233, " mind", false]]]}, "raw_delta": -0.003076171875, "tuned_delta": 0.05101342554007559}, {"byte_start": 2797, "byte_end": 2798, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "44.52%", "model_b": "41.98%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.0853908360004425]], "model_b": [[47, ".", "normal", 0.09691029042005539]]}, "loss": {"model_a": 44.52066727743285, "model_b": 41.98467990087022}, "topk": {"model_a": [47, 2, 0.0853908360004425, [[4712, 0.611888, " on", false], [47, 0.085391, ".", false], [45, 0.06785, ",", false], [4596, 0.062799, " in", false], [4811, 0.025209, " to", false], [53356, 0.02008, " without", false], [4424, 0.010781, " at", false], [21265, 0.010185, " and", false], [31601, 0.006874, " over", false], [50870, 0.00669, " against", false]]], "model_b": [47, 2, 0.09691029042005539, [[4712, 0.597248, " on", false], [47, 0.09691, ".", false], [45, 0.087653, ",", false], [4596, 0.037468, " in", false], [31601, 0.019711, " over", false], [4424, 0.013746, " at", false], [21265, 0.012947, " and", false], [53356, 0.010087, " without", false], [4811, 0.009569, " to", false], [4450, 0.008291, " by", false]]]}, "raw_delta": 0.140625, "tuned_delta": 0.19471459741507557}, {"byte_start": 2798, "byte_end": 2805, "display": {"text": " Search", "kind": "normal"}, "is_word": true, "word_id": 489, "word_key": " search", "bytes_hex": "20 53 65 61 72 63 68", "compression": {"model_a": "9.78% 9.78% 9.78% 9.78% 9.78% 9.78% 9.78%", "model_b": "9.98% 9.98% 9.98% 9.98% 9.98% 9.98% 9.98%"}, "model_tokens": {"model_a": [[44844, " Search", "normal", 0.022513993084430695]], "model_b": [[44844, " Search", "normal", 0.020962383598089218]]}, "loss": {"model_a": 9.781665595313005, "model_b": 9.98293443472274}, "topk": {"model_a": [44844, 9, 0.022513993084430695, [[261, 0.16093, "\n\n", false], [19555, 0.10747, " But", false], [20996, 0.091038, " The", false], [3918, 0.079995, " It", false], [3913, 0.053094, " In", false], [19417, 0.030495, " And", false], [55122, 0.029356, " Learning", false], [267, 0.025966, "  ", false], [44844, 0.022514, " Search", false], [29894, 0.022505, " This", false]]], "model_b": [44844, 10, 0.020962383598089218, [[19555, 0.151032, " But", false], [20996, 0.117798, " The", false], [261, 0.089238, "\n\n", false], [3918, 0.07081, " It", false], [3913, 0.044894, " In", false], [19417, 0.031652, " And", false], [267, 0.028234, "  ", false], [50318, 0.025973, " However", false], [29894, 0.024625, " This", false], [44844, 0.020962, " Search", false]]]}, "raw_delta": -0.011160714285714302, "tuned_delta": 0.04292888312936129}, {"byte_start": 2805, "byte_end": 2809, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 490, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "9.65% 9.65% 9.65% 9.65%", "model_b": "12.82% 12.82% 12.82% 12.82%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.11752758175134659]], "model_b": [[21265, " and", "normal", 0.05832850933074951]]}, "loss": {"model_a": 9.650840849696678, "model_b": 12.820825070399966}, "topk": {"model_a": [21265, 2, 0.11752758175134659, [[4600, 0.182704, " is", false], [21265, 0.117528, " and", false], [45, 0.065288, ",", false], [22748, 0.055948, " was", false], [4596, 0.050092, " in", false], [46, 0.037843, "-", false], [21800, 0.03667, " has", false], [21413, 0.036002, " can", false], [4450, 0.018851, " by", false], [30659, 0.018669, " does", false]]], "model_b": [21265, 3, 0.05832850933074951, [[4600, 0.176464, " is", false], [45, 0.142571, ",", false], [21265, 0.058329, " and", false], [22748, 0.054433, " was", false], [46, 0.054116, "-", false], [4596, 0.037135, " in", false], [21413, 0.024015, " can", false], [57102, 0.023338, " requires", false], [7856, 0.022807, "ing", false], [52224, 0.017415, " methods", false]]]}, "raw_delta": -0.17578125, "tuned_delta": -0.12169165258492441}, {"byte_start": 2809, "byte_end": 2818, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 491, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "model_b": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.7790603041648865]], "model_b": [[56537, " learning", "normal", 0.4923510253429413]]}, "loss": {"model_a": 0.5009357780864456, "model_b": 1.4245361189333299}, "topk": {"model_a": [56537, 1, 0.7790603041648865, [[56537, 0.77906, " learning", false], [31978, 0.19959, " self", false], [30597, 0.00259, " deep", false], [65003, 0.001368, " reinforcement", false], [22590, 0.001093, " the", false], [39193, 0.001069, " other", false], [51832, 0.000805, " general", false], [21902, 0.000578, " its", false], [40093, 0.000557, " value", false], [38720, 0.000556, " human", false]]], "model_b": [56537, 1, 0.4923510253429413, [[56537, 0.492351, " learning", false], [31978, 0.326697, " self", false], [51832, 0.018249, " general", false], [65135, 0.014755, " generalization", false], [40093, 0.014454, " value", false], [30597, 0.012096, " deep", false], [22590, 0.011704, " the", false], [39193, 0.008927, " other", false], [21902, 0.008533, " its", false], [65003, 0.004221, " reinforcement", false]]]}, "raw_delta": -0.05121527777777778, "tuned_delta": 0.002874319637297805}, {"byte_start": 2818, "byte_end": 2822, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 492, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "4.44% 4.44% 4.44% 4.44%", "model_b": "5.85% 5.85% 5.85% 5.85%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.37734663486480713]], "model_b": [[21286, " are", "normal", 0.26956799626350403]]}, "loss": {"model_a": 4.437977908984604, "model_b": 5.846859784852732}, "topk": {"model_a": [21286, 1, 0.37734663486480713, [[21286, 0.377347, " are", false], [21413, 0.066319, " can", false], [4450, 0.063431, " by", false], [31059, 0.055624, " have", false], [30322, 0.043189, " both", false], [32462, 0.035023, " were", false], [45, 0.032518, ",", false], [4596, 0.029261, " in", false], [4491, 0.013718, " do", false], [22074, 0.009527, " may", false]]], "model_b": [21286, 2, 0.26956799626350403, [[4450, 0.276487, " by", false], [21286, 0.269568, " are", false], [4596, 0.082736, " in", false], [45, 0.039668, ",", false], [30322, 0.031065, " both", false], [21413, 0.026899, " can", false], [31059, 0.026129, " have", false], [32462, 0.026106, " were", false], [4491, 0.015092, " do", false], [57435, 0.009386, " together", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.024035402584924412}, {"byte_start": 2822, "byte_end": 2826, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 493, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "13.24% 13.24% 13.24% 13.24%", "model_b": "15.15% 15.15% 15.15% 15.15%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.05241644009947777]], "model_b": [[22590, " the", "normal", 0.034474536776542664]]}, "loss": {"model_a": 13.243489633160404, "model_b": 15.145480165582377}, "topk": {"model_a": [22590, 4, 0.05241644009947777, [[64857, 0.157054, " complementary", false], [30322, 0.117149, " both", false], [22187, 0.083916, " not", false], [22590, 0.052416, " the", false], [22638, 0.049132, " two", false], [32239, 0.021946, " thus", false], [59513, 0.018533, " different", false], [30135, 0.0165, " also", false], [39171, 0.01559, " often", false], [45, 0.015421, ",", false]]], "model_b": [22590, 6, 0.034474536776542664, [[30322, 0.124204, " both", false], [22638, 0.08266, " two", false], [64857, 0.076008, " complementary", false], [22187, 0.070218, " not", false], [59513, 0.039605, " different", false], [22590, 0.034475, " the", false], [30135, 0.0238, " also", false], [31296, 0.021176, " like", false], [32239, 0.018252, " thus", false], [32386, 0.017224, " very", false]]]}, "raw_delta": -0.10546875, "tuned_delta": -0.05137915258492441}, {"byte_start": 2826, "byte_end": 2830, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 494, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"model_a": "4.72% 4.72% 4.72% 4.72%", "model_b": "4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"model_a": [[22638, " two", "normal", 0.3510001003742218]], "model_b": [[22638, " two", "normal", 0.38090911507606506]]}, "loss": {"model_a": 4.719754284158229, "model_b": 4.3323117682944945}, "topk": {"model_a": [22638, 1, 0.3510001003742218, [[22638, 0.351, " two", false], [31937, 0.12424, " same", false], [31581, 0.063199, " only", false], [31461, 0.054213, " most", false], [51832, 0.021634, " general", false], [52224, 0.020149, " methods", false], [31356, 0.01754, " main", false], [57481, 0.011627, " ultimate", false], [21952, 0.009799, " key", false], [37812, 0.008782, " basic", false]]], "model_b": [22638, 1, 0.38090911507606506, [[22638, 0.380909, " two", false], [31937, 0.075925, " same", false], [31581, 0.048256, " only", false], [56767, 0.047044, " opposite", false], [31461, 0.036202, " most", false], [30273, 0.012305, " best", false], [37717, 0.01082, " antit", false], [32448, 0.008602, " ways", false], [31356, 0.00809, " main", false], [52224, 0.007275, " methods", false]]]}, "raw_delta": 0.021484375, "tuned_delta": 0.07557397241507559}, {"byte_start": 2830, "byte_end": 2835, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 495, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "5.78% 5.78% 5.78% 5.78% 5.78%", "model_b": "7.50% 7.50% 7.50% 7.50% 7.50%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.19866539537906647]], "model_b": [[31461, " most", "normal", 0.12435755878686905]]}, "loss": {"model_a": 5.776415691059325, "model_b": 7.495251579618443}, "topk": {"model_a": [31461, 1, 0.19866539537906647, [[31461, 0.198665, " most", false], [31356, 0.111706, " main", false], [51832, 0.066345, " general", false], [52224, 0.04932, " methods", false], [39682, 0.02909, " sides", false], [61590, 0.028021, " approaches", false], [21357, 0.027703, " big", false], [37812, 0.025698, " basic", false], [63591, 0.025067, " fundamental", false], [38961, 0.0248, " major", false]]], "model_b": [31461, 1, 0.12435755878686905, [[31461, 0.124358, " most", false], [31356, 0.084169, " main", false], [38961, 0.074434, " major", false], [61590, 0.039028, " approaches", false], [32448, 0.037811, " ways", false], [39682, 0.037017, " sides", false], [52224, 0.02719, " methods", false], [56194, 0.025416, " extremes", false], [63591, 0.023061, " fundamental", false], [30757, 0.021619, " ends", false]]]}, "raw_delta": -0.09531250000000002, "tuned_delta": -0.041222902584924434}, {"byte_start": 2835, "byte_end": 2845, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 496, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"model_a": "2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92%", "model_b": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32%"}, "model_tokens": {"model_a": [[59829, " important", "normal", 0.1988791674375534]], "model_b": [[59829, " important", "normal", 0.27621975541114807]]}, "loss": {"model_a": 2.9163854830470246, "model_b": 2.3246550951824116}, "topk": {"model_a": [59829, 2, 0.1988791674375534, [[51832, 0.234228, " general", false], [59829, 0.198879, " important", false], [59593, 0.173565, " effective", false], [56900, 0.095803, " powerful", false], [63591, 0.039601, " fundamental", false], [45534, 0.032414, " common", false], [37812, 0.022478, " basic", false], [60274, 0.018906, " promising", false], [59594, 0.01451, " efficient", false], [62603, 0.011655, " successful", false]]], "model_b": [59829, 1, 0.27621975541114807, [[59829, 0.27622, " important", false], [59593, 0.110372, " effective", false], [45534, 0.090401, " common", false], [60273, 0.04922, " prominent", false], [63591, 0.043518, " fundamental", false], [37812, 0.034813, " basic", false], [56900, 0.033529, " powerful", false], [51832, 0.026151, " general", false], [62603, 0.019196, " successful", false], [52346, 0.017339, " obvious", false]]]}, "raw_delta": 0.0328125, "tuned_delta": 0.0869020974150756}, {"byte_start": 2845, "byte_end": 2853, "display": {"text": " classes", "kind": "normal"}, "is_word": true, "word_id": 497, "word_key": " classes", "bytes_hex": "20 63 6c 61 73 73 65 73", "compression": {"model_a": "10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50%", "model_b": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12%"}, "model_tokens": {"model_a": [[51200, " classes", "normal", 0.009409043937921524]], "model_b": [[51200, " classes", "normal", 0.0046080173924565315]]}, "loss": {"model_a": 10.496169975217555, "model_b": 12.116384132465903}, "topk": {"model_a": [51200, 19, 0.009409043937921524, [[51832, 0.171532, " general", false], [52224, 0.157667, " methods", false], [32448, 0.04766, " ways", false], [61590, 0.033871, " approaches", false], [62633, 0.032932, " techniques", false], [21265, 0.027545, " and", false], [39979, 0.024062, " tools", false], [45, 0.021598, ",", false], [38888, 0.019368, " lever", false], [64862, 0.017444, " computational", false]]], "model_b": [51200, 37, 0.0046080173924565315, [[32448, 0.091462, " ways", false], [52224, 0.090706, " methods", false], [61590, 0.080232, " approaches", false], [51832, 0.048424, " general", false], [50964, 0.029971, " aspects", false], [47539, 0.027488, " things", false], [39979, 0.026628, " tools", false], [62581, 0.02414, " strategies", false], [61723, 0.022933, " components", false], [51703, 0.02228, " factors", false]]]}, "raw_delta": -0.08984375, "tuned_delta": -0.03575415258492441}, {"byte_start": 2853, "byte_end": 2856, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 498, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.06% 0.06% 0.06%", "model_b": "0.11% 0.11% 0.11%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9908678531646729]], "model_b": [[4706, " of", "normal", 0.981881320476532]]}, "loss": {"model_a": 0.055034448276098755, "model_b": 0.1093351039085162}, "topk": {"model_a": [4706, 1, 0.9908678531646729, [[4706, 0.990868, " of", false], [4596, 0.003537, " in", false], [45, 0.00085, ",", false], [21700, 0.000842, " for", false], [32227, 0.00058, " that", false], [275, 0.000406, " (", false], [47, 0.00033, ".", false], [4715, 0.000312, " or", false], [4811, 0.000249, " to", false], [21265, 0.000169, " and", false]]], "model_b": [4706, 1, 0.981881320476532, [[4706, 0.981881, " of", false], [4596, 0.004096, " in", false], [32227, 0.003253, " that", false], [45, 0.002229, ",", false], [21700, 0.001073, " for", false], [47, 0.001014, ".", false], [4811, 0.000938, " to", false], [275, 0.000625, " (", false], [11, 0.000344, "\n", false], [21265, 0.000343, " and", false]]]}, "raw_delta": -0.0030110677083333335, "tuned_delta": 0.05107852970674225}, {"byte_start": 2856, "byte_end": 2867, "display": {"text": " techniques", "kind": "normal"}, "is_word": true, "word_id": 499, "word_key": " techniques", "bytes_hex": "20 74 65 63 68 6e 69 71 75 65 73", "compression": {"model_a": "5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43%", "model_b": "5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61% 5.61%"}, "model_tokens": {"model_a": [[62633, " techniques", "normal", 0.036410946398973465]], "model_b": [[62633, " techniques", "normal", 0.03257099539041519]]}, "loss": {"model_a": 5.430599230618968, "model_b": 5.609911469365819}, "topk": {"model_a": [62633, 5, 0.036410946398973465, [[52224, 0.401138, " methods", false], [51832, 0.213233, " general", false], [61559, 0.05683, " algorithms", false], [3609, 0.051195, " AI", false], [62633, 0.036411, " techniques", false], [61590, 0.033764, " approaches", false], [63370, 0.022006, " computation", false], [59113, 0.015465, " algorithm", false], [46561, 0.01065, " method", false], [64862, 0.010585, " computational", false]]], "model_b": [62633, 6, 0.03257099539041519, [[52224, 0.279092, " methods", false], [3609, 0.140981, " AI", false], [57103, 0.074101, " research", false], [61559, 0.052818, " algorithms", false], [51832, 0.041032, " general", false], [62633, 0.032571, " techniques", false], [61590, 0.025621, " approaches", false], [63370, 0.016929, " computation", false], [55809, 0.016821, " computer", false], [52167, 0.016384, " machine", false]]]}, "raw_delta": -0.009943181818181823, "tuned_delta": 0.044146415596893765}, {"byte_start": 2867, "byte_end": 2871, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 500, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "5.25% 5.25% 5.25% 5.25%", "model_b": "8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.31299299001693726]], "model_b": [[21700, " for", "normal", 0.14102023839950562]]}, "loss": {"model_a": 5.248084987608777, "model_b": 8.875955817969208}, "topk": {"model_a": [21700, 1, 0.31299299001693726, [[21700, 0.312993, " for", false], [32227, 0.235007, " that", false], [4596, 0.190611, " in", false], [45, 0.059024, ",", false], [47, 0.030487, ".", false], [4811, 0.029508, " to", false], [32354, 0.019552, " used", false], [59206, 0.012683, " available", false], [4450, 0.007349, " by", false], [21265, 0.005422, " and", false]]], "model_b": [21700, 3, 0.14102023839950562, [[4596, 0.251669, " in", false], [32227, 0.231146, " that", false], [21700, 0.14102, " for", false], [32354, 0.085129, " used", false], [45, 0.059931, ",", false], [4811, 0.033155, " to", false], [47, 0.026141, ".", false], [59206, 0.020614, " available", false], [50937, 0.011569, " applied", false], [21265, 0.007872, " and", false]]]}, "raw_delta": -0.201171875, "tuned_delta": -0.14708227758492443}, {"byte_start": 2871, "byte_end": 2881, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 501, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"model_a": "12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74%", "model_b": "14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37%"}, "model_tokens": {"model_a": [[60720, " utilizing", "normal", 0.0008674556156620383]], "model_b": [[60720, " utilizing", "normal", 0.0003449231735430658]]}, "loss": {"model_a": 12.736292157847878, "model_b": 14.370595133854907}, "topk": {"model_a": [60720, 129, 0.0008674556156620383, [[51832, 0.092093, " general", false], [3609, 0.085782, " AI", false], [38888, 0.048469, " lever", false], [59832, 0.041083, " improving", false], [52949, 0.039655, " solving", false], [46500, 0.032191, " making", false], [55531, 0.020808, " applying", false], [47497, 0.019485, " taking", false], [22590, 0.019327, " the", false], [51392, 0.01912, " dealing", false]]], "model_b": [60720, 233, 0.0003449231735430658, [[3609, 0.108058, " AI", false], [59832, 0.07206, " improving", false], [38888, 0.068069, " lever", false], [51832, 0.039686, " general", false], [46500, 0.037731, " making", false], [22590, 0.03619, " the", false], [55809, 0.024186, " computer", false], [59346, 0.023158, " computing", false], [52949, 0.021486, " solving", false], [59069, 0.017535, " achieving", false]]]}, "raw_delta": -0.09062499999999996, "tuned_delta": -0.03653540258492437}, {"byte_start": 2881, "byte_end": 2889, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 502, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "4.42% 4.42% 4.42% 4.42% 4.42% 4.42% 4.42% 4.42%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.14183133840560913]], "model_b": [[52195, " massive", "normal", 0.06326282024383545]]}, "loss": {"model_a": 4.420366885536252, "model_b": 6.199080253819764}, "topk": {"model_a": [52195, 2, 0.14183133840560913, [[63370, 0.505701, " computation", false], [52195, 0.141831, " massive", false], [51832, 0.088197, " general", false], [22590, 0.046436, " the", false], [59988, 0.040588, " massively", false], [38864, 0.022429, " large", false], [64862, 0.018896, " computational", false], [59346, 0.00621, " computing", false], [332, 0.005905, " a", false], [38720, 0.005461, " human", false]]], "model_b": [52195, 5, 0.06326282024383545, [[63370, 0.197329, " computation", false], [51832, 0.179968, " general", false], [22590, 0.118283, " the", false], [32234, 0.069243, " this", false], [52195, 0.063263, " massive", false], [59346, 0.034952, " computing", false], [38720, 0.032667, " human", false], [64862, 0.021438, " computational", false], [38864, 0.021003, " large", false], [3609, 0.016536, " AI", false]]]}, "raw_delta": -0.0986328125, "tuned_delta": -0.04454321508492441}, {"byte_start": 2889, "byte_end": 2897, "display": {"text": " amounts", "kind": "normal"}, "is_word": true, "word_id": 503, "word_key": " amounts", "bytes_hex": "20 61 6d 6f 75 6e 74 73", "compression": {"model_a": "9.65% 9.65% 9.65% 9.65% 9.65% 9.65% 9.65% 9.65%", "model_b": "9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79%"}, "model_tokens": {"model_a": [[50897, " amounts", "normal", 0.013889632187783718]], "model_b": [[50897, " amounts", "normal", 0.01309353206306696]]}, "loss": {"model_a": 9.650840849696678, "model_b": 9.79172903728349}, "topk": {"model_a": [50897, 4, 0.013889632187783718, [[63370, 0.872918, " computation", false], [64862, 0.028989, " computational", false], [45, 0.01809, ",", false], [50897, 0.01389, " amounts", false], [59346, 0.007893, " computing", false], [56812, 0.007679, " parallel", false], [64298, 0.006149, " computations", false], [51832, 0.004509, " general", false], [51266, 0.004495, " compute", false], [59206, 0.002221, " available", false]]], "model_b": [50897, 5, 0.01309353206306696, [[63370, 0.74864, " computation", false], [59346, 0.04381, " computing", false], [64862, 0.040834, " computational", false], [45, 0.036494, ",", false], [50897, 0.013094, " amounts", false], [64298, 0.012582, " computations", false], [51266, 0.010348, " compute", false], [51832, 0.007997, " general", false], [56812, 0.004259, " parallel", false], [3609, 0.003329, " AI", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04627709741507559}, {"byte_start": 2897, "byte_end": 2900, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 504, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9988504648208618]], "model_b": [[4706, " of", "normal", 0.9964355230331421]]}, "loss": {"model_a": 0.006925168074742427, "model_b": 0.02155515890813868}, "topk": {"model_a": [4706, 1, 0.9988504648208618, [[4706, 0.99885, " of", false], [63370, 0.000213, " computation", false], [21265, 0.00016, " and", false], [275, 0.000135, " (", false], [4715, 9.2e-05, " or", false], [45, 5.4e-05, ",", false], [11, 4.6e-05, "\n", false], [4588, 3.2e-05, " if", false], [261, 2.8e-05, "\n\n", false], [267, 2.8e-05, "  ", false]]], "model_b": [4706, 1, 0.9964355230331421, [[4706, 0.996436, " of", false], [11, 0.000699, "\n", false], [21265, 0.000531, " and", false], [275, 0.000338, " (", false], [64862, 0.000246, " computational", false], [45, 0.000208, ",", false], [4715, 0.00016, " or", false], [261, 0.000143, "\n\n", false], [47, 0.00012, ".", false], [63370, 0.000107, " computation", false]]]}, "raw_delta": -0.0008112589518229165, "tuned_delta": 0.053278338463252674}, {"byte_start": 2900, "byte_end": 2912, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 505, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%", "model_b": "0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.8953267335891724]], "model_b": [[63370, " computation", "normal", 0.6752276420593262]]}, "loss": {"model_a": 0.16730472275934022, "model_b": 0.5870341149450533}, "topk": {"model_a": [63370, 1, 0.8953267335891724, [[63370, 0.895327, " computation", false], [64862, 0.028066, " computational", false], [59346, 0.015039, " computing", false], [51266, 0.011506, " compute", false], [59206, 0.004368, " available", false], [55809, 0.004326, " computer", false], [51832, 0.003667, " general", false], [56812, 0.003351, " parallel", false], [56353, 0.00212, " hardware", false], [52167, 0.001729, " machine", false]]], "model_b": [63370, 1, 0.6752276420593262, [[63370, 0.675228, " computation", false], [59346, 0.089949, " computing", false], [64862, 0.051349, " computational", false], [30579, 0.036206, " data", false], [63637, 0.022502, " information", false], [51266, 0.01898, " compute", false], [59206, 0.010678, " available", false], [51832, 0.008178, " general", false], [38720, 0.005993, " human", false], [55809, 0.005738, " computer", false]]]}, "raw_delta": -0.02327473958333334, "tuned_delta": 0.03081485783174225}, {"byte_start": 2912, "byte_end": 2915, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 506, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "14.46% 14.46% 14.46%", "model_b": "13.43% 13.43% 13.43%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.08931517601013184]], "model_b": [[4596, " in", "normal", 0.10819895565509796]]}, "loss": {"model_a": 14.464520592246117, "model_b": 13.43134054994282}, "topk": {"model_a": [4596, 4, 0.08931517601013184, [[47, 0.455824, ".", false], [45, 0.17863, ",", false], [4811, 0.108767, " to", false], [4596, 0.089315, " in", false], [21700, 0.025316, " for", false], [21265, 0.016218, " and", false], [60, 0.015935, ";", false], [32227, 0.015852, " that", false], [63507, 0.012333, " effectively", false], [4712, 0.008639, " on", false]]], "model_b": [4596, 4, 0.10819895565509796, [[47, 0.410667, ".", false], [45, 0.181913, ",", false], [4811, 0.111947, " to", false], [4596, 0.108199, " in", false], [21700, 0.045159, " for", false], [21265, 0.026626, " and", false], [32227, 0.01633, " that", false], [275, 0.013989, " (", false], [60, 0.008931, ";", false], [63507, 0.006752, " effectively", false]]]}, "raw_delta": 0.05729166666666674, "tuned_delta": 0.11138126408174233}, {"byte_start": 2915, "byte_end": 2918, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 507, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "4.70% 4.70% 4.70%", "model_b": "9.39% 9.39% 9.39%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.4577257037162781]], "model_b": [[3609, " AI", "normal", 0.2099425494670868]]}, "loss": {"model_a": 4.696272919560427, "model_b": 9.392545839120855}, "topk": {"model_a": [3609, 1, 0.4577257037162781, [[3609, 0.457726, " AI", false], [332, 0.093265, " a", false], [22590, 0.063462, " the", false], [51832, 0.051233, " general", false], [4419, 0.029316, " an", false], [52949, 0.020207, " solving", false], [61594, 0.016048, " artificial", false], [32448, 0.015452, " ways", false], [52167, 0.014971, " machine", false], [46588, 0.013959, " modern", false]]], "model_b": [3609, 1, 0.2099425494670868, [[3609, 0.209943, " AI", false], [51832, 0.154168, " general", false], [22590, 0.104284, " the", false], [332, 0.085464, " a", false], [55809, 0.057282, " computer", false], [39189, 0.029685, " order", false], [38576, 0.020918, " games", false], [4419, 0.020744, " an", false], [61594, 0.016147, " artificial", false], [56901, 0.015847, " practice", false]]]}, "raw_delta": -0.2604166666666667, "tuned_delta": -0.2063270692515911}, {"byte_start": 2918, "byte_end": 2927, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 508, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"model_a": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "model_b": "3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"model_a": [[57103, " research", "normal", 0.23793143033981323]], "model_b": [[57103, " research", "normal", 0.16715504229068756]]}, "loss": {"model_a": 2.880380723997062, "model_b": 3.5848216619311257}, "topk": {"model_a": [57103, 2, 0.23793143033981323, [[47, 0.473299, ".", false], [57103, 0.237931, " research", false], [45, 0.134669, ",", false], [53087, 0.028497, " systems", false], [52224, 0.019277, " methods", false], [56949, 0.013444, " programs", false], [21265, 0.011196, " and", false], [60, 0.010851, ";", false], [275, 0.007695, " (", false], [45124, 0.005847, " agents", false]]], "model_b": [57103, 3, 0.16715504229068756, [[47, 0.538305, ".", false], [45, 0.198639, ",", false], [57103, 0.167155, " research", false], [21265, 0.012224, " and", false], [275, 0.011909, " (", false], [60, 0.007334, ";", false], [64251, 0.005999, " applications", false], [53087, 0.005634, " systems", false], [4811, 0.003167, " to", false], [21700, 0.003166, " for", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.015027097415075588}, {"byte_start": 2927, "byte_end": 2928, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.53%", "model_b": "7.01%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7364534735679626]], "model_b": [[47, ".", "normal", 0.6791210174560547]]}, "loss": {"model_a": 5.529861362782403, "model_b": 7.009187332443938}, "topk": {"model_a": [47, 1, 0.7364534735679626, [[47, 0.736453, ".", false], [45, 0.175021, ",", false], [21265, 0.017487, " and", false], [60, 0.014362, ";", false], [275, 0.012494, " (", false], [39971, 0.006398, " today", false], [51018, 0.003501, " because", false], [56949, 0.003443, " programs", false], [59, 0.00287, ":", false], [4596, 0.002828, " in", false]]], "model_b": [47, 1, 0.6791210174560547, [[47, 0.679121, ".", false], [45, 0.212637, ",", false], [39971, 0.023156, " today", false], [21265, 0.022497, " and", false], [275, 0.011919, " (", false], [60, 0.009125, ";", false], [4596, 0.003758, " in", false], [59, 0.002809, ":", false], [4811, 0.002681, " to", false], [4424, 0.002122, " at", false]]]}, "raw_delta": -0.08203125, "tuned_delta": -0.027941652584924412}, {"byte_start": 2928, "byte_end": 2931, "display": {"text": " In", "kind": "normal"}, "is_word": true, "word_id": 509, "word_key": " in", "bytes_hex": "20 49 6e", "compression": {"model_a": "20.57% 20.57% 20.57%", "model_b": "21.79% 21.79% 21.79%"}, "model_tokens": {"model_a": [[3913, " In", "normal", 0.03227507695555687]], "model_b": [[3913, " In", "normal", 0.026831308379769325]]}, "loss": {"model_a": 20.56967538767467, "model_b": 21.79070634676038}, "topk": {"model_a": [3913, 5, 0.03227507695555687, [[261, 0.423476, "\n\n", false], [20996, 0.063265, " The", false], [29893, 0.040221, " They", false], [267, 0.033824, "  ", false], [3913, 0.032275, " In", false], [44844, 0.022807, " Search", false], [3918, 0.021278, " It", false], [19555, 0.018017, " But", false], [28530, 0.016632, " Both", false], [19417, 0.016513, " And", false]]], "model_b": [3913, 6, 0.026831308379769325, [[261, 0.366019, "\n\n", false], [267, 0.069452, "  ", false], [20996, 0.06741, " The", false], [11, 0.05521, "\n", false], [44844, 0.028729, " Search", false], [3913, 0.026831, " In", false], [19555, 0.021388, " But", false], [29893, 0.018988, " They", false], [19417, 0.015505, " And", false], [3918, 0.014677, " It", false]]]}, "raw_delta": -0.06770833333333326, "tuned_delta": -0.013618735918257671}, {"byte_start": 2931, "byte_end": 2940, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 510, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07%", "model_b": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.04809846356511116]], "model_b": [[55809, " computer", "normal", 0.052452635020017624]]}, "loss": {"model_a": 6.073846309298153, "model_b": 5.885995392515736}, "topk": {"model_a": [55809, 5, 0.04809846356511116, [[22590, 0.158746, " the", false], [38013, 0.094629, " chess", false], [30322, 0.078071, " both", false], [30808, 0.062159, " fact", false], [55809, 0.048098, " computer", false], [56901, 0.046506, " practice", false], [31370, 0.039199, " many", false], [32234, 0.031957, " this", false], [51832, 0.028731, " general", false], [332, 0.022042, " a", false]]], "model_b": [55809, 3, 0.052452635020017624, [[22590, 0.205148, " the", false], [30322, 0.074029, " both", false], [55809, 0.052453, " computer", false], [30808, 0.039739, " fact", false], [30719, 0.037312, " each", false], [3492, 0.03476, " 19", false], [55856, 0.034045, " contrast", false], [3609, 0.029903, " AI", false], [51832, 0.028891, " general", false], [32234, 0.027082, " this", false]]]}, "raw_delta": 0.010416666666666685, "tuned_delta": 0.06450626408174227}, {"byte_start": 2940, "byte_end": 2943, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 511, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"model_a": "3.97% 3.97% 3.97%", "model_b": "21.70% 21.70% 21.70%"}, "model_tokens": {"model_a": [[3851, " Go", "normal", 0.5136668682098389]], "model_b": [[3851, " Go", "normal", 0.02688601426780224]]}, "loss": {"model_a": 3.968350617028561, "model_b": 21.696780888369172}, "topk": {"model_a": [3851, 1, 0.5136668682098389, [[3851, 0.513667, " Go", false], [38013, 0.325252, " chess", false], [38576, 0.04543, " games", false], [52814, 0.02737, " science", false], [46, 0.026703, "-", false], [36466, 0.012349, " Chess", false], [47732, 0.005854, " vision", false], [47202, 0.004233, " search", false], [39311, 0.003728, " poker", false], [52491, 0.002707, " playing", false]]], "model_b": [3851, 5, 0.02688601426780224, [[38013, 0.452022, " chess", false], [38576, 0.093073, " games", false], [47202, 0.055517, " search", false], [47732, 0.051587, " vision", false], [3851, 0.026886, " Go", false], [39311, 0.023756, " poker", false], [46, 0.021757, "-", false], [30941, 0.021399, " game", false], [52814, 0.020908, " science", false], [52491, 0.017677, " playing", false]]]}, "raw_delta": -0.9830729166666666, "tuned_delta": -0.928983319251591}, {"byte_start": 2943, "byte_end": 2944, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "3.65%", "model_b": "4.54%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8168437480926514]], "model_b": [[45, ",", "normal", 0.7758035659790039]]}, "loss": {"model_a": 3.6454818538087816, "model_b": 4.543644049674714}, "topk": {"model_a": [45, 1, 0.8168437480926514, [[45, 0.816844, ",", false], [21265, 0.051853, " and", false], [22590, 0.029782, " the", false], [4423, 0.013966, " as", false], [39934, 0.011708, " there", false], [4601, 0.011033, " it", false], [32232, 0.007683, " they", false], [275, 0.005776, " (", false], [4596, 0.004322, " in", false], [4424, 0.003153, " at", false]]], "model_b": [45, 1, 0.7758035659790039, [[45, 0.775804, ",", false], [21265, 0.103331, " and", false], [22590, 0.026011, " the", false], [4601, 0.009815, " it", false], [57103, 0.007865, " research", false], [32234, 0.006529, " this", false], [39934, 0.006377, " there", false], [275, 0.0047, " (", false], [56537, 0.003863, " learning", false], [31978, 0.003684, " self", false]]]}, "raw_delta": -0.0498046875, "tuned_delta": 0.004284909915075588}, {"byte_start": 2944, "byte_end": 2947, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 512, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "15.50% 15.50% 15.50%", "model_b": "27.05% 27.05% 27.05%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.07514823973178864]], "model_b": [[4423, " as", "normal", 0.011040277779102325]]}, "loss": {"model_a": 15.49770063454941, "model_b": 27.05053201666806}, "topk": {"model_a": [4423, 4, 0.07514823973178864, [[22590, 0.228135, " the", false], [47202, 0.087917, " search", false], [56537, 0.087015, " learning", false], [4423, 0.075148, " as", false], [4601, 0.05964, " it", false], [39936, 0.038903, " these", false], [32232, 0.031231, " they", false], [30322, 0.023966, " both", false], [51948, 0.023287, " however", false], [21265, 0.022746, " and", false]]], "model_b": [4423, 14, 0.011040277779102325, [[22590, 0.296201, " the", false], [56537, 0.059345, " learning", false], [332, 0.034056, " a", false], [51948, 0.031118, " however", false], [4601, 0.02876, " it", false], [32234, 0.025045, " this", false], [39934, 0.024686, " there", false], [39936, 0.022569, " these", false], [31978, 0.020721, " self", false], [47202, 0.016094, " search", false]]]}, "raw_delta": -0.640625, "tuned_delta": -0.5865354025849244}, {"byte_start": 2947, "byte_end": 2950, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 513, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "0.83% 0.83% 0.83%", "model_b": "1.51% 1.51% 1.51%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.871487557888031]], "model_b": [[4596, " in", "normal", 0.7765874862670898]]}, "loss": {"model_a": 0.8335884432219759, "model_b": 1.514548016558238}, "topk": {"model_a": [4596, 1, 0.871487557888031, [[4596, 0.871488, " in", false], [32487, 0.03339, " with", false], [32458, 0.024945, " well", false], [4601, 0.012148, " it", false], [59608, 0.00553, " elsewhere", false], [22748, 0.003998, " was", false], [332, 0.003713, " a", false], [22590, 0.003417, " the", false], [4600, 0.002758, " is", false], [4858, 0.002301, " we", false]]], "model_b": [4596, 1, 0.7765874862670898, [[4596, 0.776587, " in", false], [32487, 0.081577, " with", false], [32458, 0.033869, " well", false], [59608, 0.016844, " elsewhere", false], [4601, 0.00938, " it", false], [21700, 0.007309, " for", false], [4858, 0.005505, " we", false], [332, 0.005185, " a", false], [4600, 0.004603, " is", false], [22748, 0.004438, " was", false]]]}, "raw_delta": -0.037760416666666664, "tuned_delta": 0.016329180748408924}, {"byte_start": 2950, "byte_end": 2959, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 514, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57%", "model_b": "4.01% 4.01% 4.01% 4.01% 4.01% 4.01% 4.01% 4.01% 4.01%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.27854442596435547]], "model_b": [[55809, " computer", "normal", 0.13552680611610413]]}, "loss": {"model_a": 2.567295862693034, "model_b": 4.007486224691565}, "topk": {"model_a": [55809, 2, 0.27854442596435547, [[38013, 0.450208, " chess", false], [55809, 0.278544, " computer", false], [31370, 0.081316, " many", false], [39193, 0.037325, " other", false], [22590, 0.032114, " the", false], [31461, 0.01344, " most", false], [21256, 0.010313, " all", false], [3609, 0.010308, " AI", false], [3851, 0.004859, " Go", false], [4788, 0.004682, " so", false]]], "model_b": [55809, 2, 0.13552680611610413, [[38013, 0.602602, " chess", false], [55809, 0.135527, " computer", false], [31370, 0.050499, " many", false], [3609, 0.045423, " AI", false], [39193, 0.037313, " other", false], [22590, 0.02377, " the", false], [21256, 0.01919, " all", false], [31461, 0.015205, " most", false], [36466, 0.008241, " Chess", false], [47202, 0.006585, " search", false]]]}, "raw_delta": -0.0798611111111111, "tuned_delta": -0.025771513696035517}, {"byte_start": 2959, "byte_end": 2965, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 515, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"model_a": "0.07% 0.07% 0.07% 0.07% 0.07% 0.07%", "model_b": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"model_a": [[38013, " chess", "normal", 0.9758548140525818]], "model_b": [[38013, " chess", "normal", 0.9818809032440186]]}, "loss": {"model_a": 0.073012368046291, "model_b": 0.0546675519542581}, "topk": {"model_a": [38013, 1, 0.9758548140525818, [[38013, 0.975855, " chess", false], [36466, 0.018626, " Chess", false], [3851, 0.000883, " Go", false], [47202, 0.000854, " search", false], [46, 0.00065, "-", false], [39311, 0.000558, " poker", false], [38576, 0.000248, " games", false], [51180, 0.000204, " checker", false], [20660, 0.000123, " Pok", false], [52814, 8.4e-05, " science", false]]], "model_b": [38013, 1, 0.9818809032440186, [[38013, 0.981881, " chess", false], [36466, 0.011586, " Chess", false], [47202, 0.002762, " search", false], [38576, 0.001077, " games", false], [3609, 0.000326, " AI", false], [46, 0.000316, "-", false], [31702, 0.000206, " play", false], [39311, 0.000196, " poker", false], [52491, 0.00016, " playing", false], [30941, 6.6e-05, " game", false]]]}, "raw_delta": 0.0010172526041666663, "tuned_delta": 0.05510685001924225}, {"byte_start": 2965, "byte_end": 2966, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "0.81%", "model_b": "1.23%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9563775062561035]], "model_b": [[45, ",", "normal", 0.9337862133979797]]}, "loss": {"model_a": 0.8057043227620858, "model_b": 1.2327716413846121}, "topk": {"model_a": [45, 1, 0.9563775062561035, [[45, 0.956378, ",", false], [21265, 0.0132, " and", false], [45285, 0.007554, " before", false], [275, 0.00596, " (", false], [4596, 0.003062, " in", false], [22590, 0.0012, " the", false], [332, 0.001195, " a", false], [4601, 0.00068, " it", false], [51551, 0.000651, " earlier", false], [4424, 0.000578, " at", false]]], "model_b": [45, 1, 0.9337862133979797, [[45, 0.933786, ",", false], [21265, 0.044352, " and", false], [275, 0.004339, " (", false], [4715, 0.0023, " or", false], [4596, 0.00212, " in", false], [22590, 0.002073, " the", false], [57103, 0.000972, " research", false], [4424, 0.000758, " at", false], [332, 0.000619, " a", false], [39934, 0.000538, " there", false]]]}, "raw_delta": -0.023681640625, "tuned_delta": 0.030407956790075588}, {"byte_start": 2966, "byte_end": 2978, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 516, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57%", "model_b": "7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14% 7.14%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.012594263069331646]], "model_b": [[63843, " researchers", "normal", 0.008551239967346191]]}, "loss": {"model_a": 6.574782087384598, "model_b": 7.138334837731849}, "topk": {"model_a": [63843, 10, 0.012594263069331646, [[22590, 0.348165, " the", false], [47202, 0.093982, " search", false], [56537, 0.06539, " learning", false], [4601, 0.061346, " it", false], [39936, 0.052645, " these", false], [38720, 0.036401, " human", false], [39934, 0.031691, " there", false], [32232, 0.018513, " they", false], [332, 0.015389, " a", false], [63843, 0.012594, " researchers", false]]], "model_b": [63843, 16, 0.008551239967346191, [[22590, 0.353923, " the", false], [39934, 0.046462, " there", false], [4601, 0.04446, " it", false], [39936, 0.039567, " these", false], [56537, 0.031211, " learning", false], [32234, 0.026218, " this", false], [332, 0.024753, " a", false], [52195, 0.015033, " massive", false], [38720, 0.014246, " human", false], [21265, 0.01307, " and", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 2978, "byte_end": 2979, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"model_a": "63.96%", "model_b": "78.33%"}, "model_tokens": {"model_a": [[40, "'", "normal", 0.029054807499051094]], "model_b": [[40, "'", "normal", 0.012874784879386425]]}, "loss": {"model_a": 63.96323716441302, "model_b": 78.33383229826792}, "topk": {"model_a": [40, 4, 0.029054807499051094, [[22762, 0.261008, " who", false], [32462, 0.079869, " were", false], [21795, 0.046791, " had", false], [40, 0.029055, "'", false], [21532, 0.024395, " did", false], [32487, 0.023957, " with", false], [59868, 0.021031, " initially", false], [31059, 0.018028, " have", false], [52112, 0.01637, " learned", false], [32227, 0.014176, " that", false]]], "model_b": [40, 9, 0.012874784879386425, [[32462, 0.125557, " were", false], [22762, 0.116367, " who", false], [21795, 0.037602, " had", false], [55616, 0.022837, " believed", false], [21532, 0.022587, " did", false], [47340, 0.022474, " sought", false], [51770, 0.017576, " focused", false], [47763, 0.014876, " wanted", false], [40, 0.012875, "'", false], [59868, 0.012661, " initially", false]]]}, "raw_delta": -0.796875, "tuned_delta": -0.7427854025849244}, {"byte_start": 2979, "byte_end": 2987, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 517, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"model_a": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[52013, " initial", "normal", 0.09287940710783005]], "model_b": [[52013, " initial", "normal", 0.06403638422489166]]}, "loss": {"model_a": 5.353751128298887, "model_b": 6.199080253819764}, "topk": {"model_a": [52013, 1, 0.09287940710783005, [[52013, 0.092879, " initial", false], [62157, 0.073147, " investment", false], [38720, 0.063106, " human", false], [51566, 0.044173, " efforts", false], [61701, 0.028034, " commitment", false], [63678, 0.024073, " investments", false], [45294, 0.022275, " belief", false], [51024, 0.020855, " beliefs", false], [64997, 0.018628, " psychological", false], [65034, 0.017758, " understanding", false]]], "model_b": [52013, 2, 0.06403638422489166, [[51566, 0.067713, " efforts", false], [52013, 0.064036, " initial", false], [45294, 0.040004, " belief", false], [55572, 0.02435, " attempts", false], [65126, 0.020237, " disappointment", false], [63588, 0.020189, " frustration", false], [38499, 0.019099, " first", false], [38530, 0.017722, " focus", false], [59943, 0.014812, " knowledge", false], [51024, 0.012833, " beliefs", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 2987, "byte_end": 2994, "display": {"text": " effort", "kind": "normal"}, "is_word": true, "word_id": 518, "word_key": " effort", "bytes_hex": "20 65 66 66 6f 72 74", "compression": {"model_a": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%", "model_b": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"model_a": [[45829, " effort", "normal", 0.004506670869886875]], "model_b": [[45829, " effort", "normal", 0.025776837021112442]]}, "loss": {"model_a": 13.927803687153498, "model_b": 9.419381684375487}, "topk": {"model_a": [45829, 37, 0.004506670869886875, [[51566, 0.151177, " efforts", false], [62157, 0.10848, " investment", false], [63678, 0.05266, " investments", false], [38530, 0.046918, " focus", false], [62500, 0.034469, " resistance", false], [61701, 0.028744, " commitment", false], [55572, 0.021242, " attempts", false], [62561, 0.018954, " skepticism", false], [62476, 0.01889, " reluctance", false], [45294, 0.017965, " belief", false]]], "model_b": [45829, 5, 0.025776837021112442, [[51566, 0.185123, " efforts", false], [45294, 0.062163, " belief", false], [38530, 0.061922, " focus", false], [61947, 0.058583, " enthusiasm", false], [45829, 0.025777, " effort", false], [55532, 0.021129, " approach", false], [55572, 0.020453, " attempts", false], [63588, 0.018992, " frustration", false], [53052, 0.016068, " success", false], [60587, 0.014851, " successes", false]]]}, "raw_delta": 0.25, "tuned_delta": 0.3040895974150756}, {"byte_start": 2994, "byte_end": 2998, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 519, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "4.97% 4.97% 4.97% 4.97%", "model_b": "4.24% 4.24% 4.24% 4.24%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.3331619203090668]], "model_b": [[22748, " was", "normal", 0.3829701542854309]]}, "loss": {"model_a": 4.966308612435152, "model_b": 4.244256651052736}, "topk": {"model_a": [22748, 1, 0.3331619203090668, [[22748, 0.333162, " was", false], [4811, 0.141249, " to", false], [4424, 0.090194, " at", false], [32460, 0.06933, " went", false], [4596, 0.042545, " in", false], [51770, 0.034064, " focused", false], [31162, 0.019866, " into", false], [21795, 0.019657, " had", false], [4712, 0.016957, " on", false], [47518, 0.016818, " tended", false]]], "model_b": [22748, 1, 0.3829701542854309, [[22748, 0.38297, " was", false], [4811, 0.254727, " to", false], [51770, 0.03573, " focused", false], [4596, 0.033717, " in", false], [32460, 0.018231, " went", false], [21795, 0.014544, " had", false], [4424, 0.013753, " at", false], [4712, 0.011013, " on", false], [45, 0.010142, ",", false], [21265, 0.008898, " and", false]]]}, "raw_delta": 0.0400390625, "tuned_delta": 0.09412865991507559}, {"byte_start": 2998, "byte_end": 3007, "display": {"text": " directed", "kind": "normal"}, "is_word": true, "word_id": 520, "word_key": " directed", "bytes_hex": "20 64 69 72 65 63 74 65 64", "compression": {"model_a": "6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61%", "model_b": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57%"}, "model_tokens": {"model_a": [[56002, " directed", "normal", 0.037287674844264984]], "model_b": [[56002, " directed", "normal", 0.06195797398686409]]}, "loss": {"model_a": 6.606090573515001, "model_b": 5.572910531211706}, "topk": {"model_a": [56002, 9, 0.037287674844264984, [[4811, 0.192953, " to", false], [39762, 0.072596, " spent", false], [4596, 0.063694, " in", false], [51770, 0.062405, " focused", false], [22187, 0.060269, " not", false], [37810, 0.05508, " based", false], [51459, 0.045389, " devoted", false], [4712, 0.044941, " on", false], [56002, 0.037288, " directed", false], [56495, 0.023658, " invested", false]]], "model_b": [56002, 2, 0.06195797398686409, [[4811, 0.4423, " to", false], [56002, 0.061958, " directed", false], [37810, 0.060962, " based", false], [51770, 0.037305, " focused", false], [22187, 0.034576, " not", false], [47768, 0.022633, " wasted", false], [60031, 0.018832, " motivated", false], [4712, 0.018682, " on", false], [4596, 0.018653, " in", false], [51459, 0.011715, " devoted", false]]]}, "raw_delta": 0.05729166666666663, "tuned_delta": 0.11138126408174222}, {"byte_start": 3007, "byte_end": 3015, "display": {"text": " towards", "kind": "normal"}, "is_word": true, "word_id": 521, "word_key": " towards", "bytes_hex": "20 74 6f 77 61 72 64 73", "compression": {"model_a": "4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44%", "model_b": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%"}, "model_tokens": {"model_a": [[53169, " towards", "normal", 0.1395360380411148]], "model_b": [[53169, " towards", "normal", 0.11246705055236816]]}, "loss": {"model_a": 4.437977908984604, "model_b": 4.931086565538449}, "topk": {"model_a": [53169, 3, 0.1395360380411148, [[4424, 0.363651, " at", false], [47585, 0.238883, " toward", false], [53169, 0.139536, " towards", false], [4811, 0.111944, " to", false], [30211, 0.040751, " away", false], [50870, 0.020957, " against", false], [60247, 0.009616, " primarily", false], [4596, 0.00879, " in", false], [4450, 0.006458, " by", false], [31162, 0.005836, " into", false]]], "model_b": [53169, 4, 0.11246705055236816, [[4424, 0.413996, " at", false], [47585, 0.201444, " toward", false], [4811, 0.138369, " to", false], [53169, 0.112467, " towards", false], [30211, 0.024814, " away", false], [4450, 0.019434, " by", false], [50870, 0.013145, " against", false], [22187, 0.013034, " not", false], [4596, 0.004708, " in", false], [60247, 0.004479, " primarily", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.026745847415075588}, {"byte_start": 3015, "byte_end": 3025, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 522, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"model_a": "10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93%", "model_b": "10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93%"}, "model_tokens": {"model_a": [[60720, " utilizing", "normal", 0.0023603595327585936]], "model_b": [[60720, " utilizing", "normal", 0.002348734764382243]]}, "loss": {"model_a": 10.932923356736676, "model_b": 10.932923356736676}, "topk": {"model_a": [60720, 38, 0.0023603595327585936, [[52224, 0.203569, " methods", false], [38720, 0.117299, " human", false], [47202, 0.101278, " search", false], [22590, 0.097177, " the", false], [55586, 0.048863, " avoiding", false], [38888, 0.04015, " lever", false], [332, 0.027977, " a", false], [61590, 0.021083, " approaches", false], [40085, 0.015468, " using", false], [60463, 0.012611, " searching", false]]], "model_b": [60720, 54, 0.002348734764382243, [[38888, 0.180919, " lever", false], [22590, 0.054888, " the", false], [55586, 0.052009, " avoiding", false], [56537, 0.03925, " learning", false], [47202, 0.033978, " search", false], [61984, 0.028041, " exploiting", false], [59832, 0.02752, " improving", false], [52224, 0.026551, " methods", false], [38720, 0.025158, " human", false], [40085, 0.024963, " using", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 3025, "byte_end": 3031, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 523, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "0.96% 0.96% 0.96% 0.96% 0.96% 0.96%", "model_b": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.7257537841796875]], "model_b": [[38720, " human", "normal", 0.3250206410884857]]}, "loss": {"model_a": 0.9568656073604371, "model_b": 3.3813165020835076}, "topk": {"model_a": [38720, 1, 0.7257537841796875, [[38720, 0.725754, " human", false], [39931, 0.10154, " their", false], [22590, 0.041212, " the", false], [59943, 0.022745, " knowledge", false], [47202, 0.014268, " search", false], [52195, 0.005148, " massive", false], [52964, 0.003961, " special", false], [332, 0.003898, " a", false], [39936, 0.003832, " these", false], [46227, 0.003764, " humans", false]]], "model_b": [38720, 1, 0.3250206410884857, [[38720, 0.325021, " human", false], [22590, 0.128005, " the", false], [47202, 0.093767, " search", false], [52195, 0.071496, " massive", false], [56537, 0.028395, " learning", false], [39936, 0.025532, " these", false], [32234, 0.02447, " this", false], [39931, 0.022274, " their", false], [59943, 0.018554, " knowledge", false], [30597, 0.017431, " deep", false]]]}, "raw_delta": -0.13444010416666666, "tuned_delta": -0.08035050675159107}, {"byte_start": 3031, "byte_end": 3045, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 524, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"model_a": "4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39%", "model_b": "4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41%"}, "model_tokens": {"model_a": [[65034, " understanding", "normal", 0.03325283154845238]], "model_b": [[65034, " understanding", "normal", 0.03294064849615097]]}, "loss": {"model_a": 4.387660699132171, "model_b": 4.4077875830731434}, "topk": {"model_a": [65034, 2, 0.03325283154845238, [[59943, 0.889831, " knowledge", false], [65034, 0.033253, " understanding", false], [59683, 0.018382, " expertise", false], [38786, 0.016128, " input", false], [46, 0.010098, "-", false], [52022, 0.002473, " insight", false], [38013, 0.002287, " chess", false], [59917, 0.002057, " intuition", false], [31702, 0.001625, " play", false], [45775, 0.001433, " domain", false]]], "model_b": [65034, 4, 0.03294064849615097, [[59943, 0.719563, " knowledge", false], [38786, 0.088319, " input", false], [46, 0.049806, "-", false], [65034, 0.032941, " understanding", false], [59683, 0.009567, " expertise", false], [56537, 0.007388, " learning", false], [47802, 0.006322, " wisdom", false], [52022, 0.005914, " insight", false], [63637, 0.005808, " information", false], [64452, 0.004066, " intelligence", false]]]}, "raw_delta": -0.0011160714285714246, "tuned_delta": 0.052973525986504164}, {"byte_start": 3045, "byte_end": 3047, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "39.45% 39.45%", "model_b": "37.76% 37.76%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.01249697059392929]], "model_b": [[275, " (", "normal", 0.015344199724495411]]}, "loss": {"model_a": 39.44869252430759, "model_b": 37.758034273265835}, "topk": {"model_a": [275, 8, 0.01249697059392929, [[4706, 0.405488, " of", false], [45, 0.228967, ",", false], [47, 0.082108, ".", false], [21265, 0.073364, " and", false], [47001, 0.044919, " rather", false], [4596, 0.041555, " in", false], [4811, 0.036254, " to", false], [275, 0.012497, " (", false], [4423, 0.011074, " as", false], [52028, 0.009213, " instead", false]]], "model_b": [275, 9, 0.015344199724495411, [[4706, 0.500958, " of", false], [45, 0.12409, ",", false], [4811, 0.087217, " to", false], [47, 0.0592, ".", false], [21265, 0.043449, " and", false], [4596, 0.040769, " in", false], [4423, 0.028657, " as", false], [47001, 0.026536, " rather", false], [275, 0.015344, " (", false], [21700, 0.011701, " for", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 3047, "byte_end": 3049, "display": {"text": "so", "kind": "normal"}, "is_word": true, "word_id": 525, "word_key": "so", "bytes_hex": "73 6f", "compression": {"model_a": "49.59% 49.59%", "model_b": "52.69% 52.69%"}, "model_tokens": {"model_a": [[2190, "so", "normal", 0.0040810187347233295]], "model_b": [[2190, "so", "normal", 0.0028974430169910192]]}, "loss": {"model_a": 49.59264203055811, "model_b": 52.692182157468}, "topk": {"model_a": [2190, 38, 0.0040810187347233295, [[2101, 0.094433, "or", false], [7005, 0.087191, "and", false], [1950, 0.082559, "in", false], [2090, 0.057561, "of", false], [36003, 0.050845, "which", false], [1751, 0.040668, "as", false], [8801, 0.030303, "the", false], [98, 0.024738, "a", false], [42135, 0.019727, "rather", false], [1782, 0.018952, "by", false]]], "model_b": [2190, 40, 0.0028974430169910192, [[2101, 0.132615, "or", false], [7005, 0.124689, "and", false], [1950, 0.066841, "in", false], [36003, 0.057641, "which", false], [1751, 0.049002, "as", false], [8801, 0.039061, "the", false], [2090, 0.028748, "of", false], [58313, 0.028488, "knowledge", false], [42233, 0.016595, "search", false], [42135, 0.01549, "rather", false]]]}, "raw_delta": -0.171875, "tuned_delta": -0.11778540258492441}, {"byte_start": 3049, "byte_end": 3054, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 526, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "6.09% 6.09% 6.09% 6.09% 6.09%", "model_b": "3.97% 3.97% 3.97% 3.97% 3.97%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.1862810105085373]], "model_b": [[32227, " that", "normal", 0.33469370007514954]]}, "loss": {"model_a": 6.086369703750314, "model_b": 3.9730468899481215}, "topk": {"model_a": [32227, 2, 0.1862810105085373, [[46, 0.230581, "-", false], [32227, 0.186281, " that", false], [4423, 0.125813, " as", false], [32232, 0.062569, " they", false], [45395, 0.049735, " called", false], [22590, 0.025463, " the", false], [31466, 0.022861, " much", false], [45, 0.022699, ",", false], [4811, 0.02096, " to", false], [4601, 0.019518, " it", false]]], "model_b": [32227, 1, 0.33469370007514954, [[32227, 0.334694, " that", false], [46, 0.153347, "-", false], [32232, 0.073834, " they", false], [4811, 0.059866, " to", false], [4423, 0.057139, " as", false], [22590, 0.029961, " the", false], [45395, 0.028907, " called", false], [31466, 0.026366, " much", false], [21660, 0.01791, " far", false], [4601, 0.017564, " it", false]]]}, "raw_delta": 0.11718750000000003, "tuned_delta": 0.17127709741507563}, {"byte_start": 3054, "byte_end": 3059, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 527, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"model_a": "26.83% 26.83% 26.83% 26.83% 26.83%", "model_b": "23.89% 23.89% 23.89% 23.89% 23.89%"}, "model_tokens": {"model_a": [[31277, " less", "normal", 0.0005903737619519234]], "model_b": [[31277, " less", "normal", 0.001320666866376996]]}, "loss": {"model_a": 26.825110916529162, "model_b": 23.894636614723453}, "topk": {"model_a": [31277, 99, 0.0005903737619519234, [[22590, 0.192673, " the", false], [32232, 0.118792, " they", false], [47202, 0.102596, " search", false], [4601, 0.072384, " it", false], [332, 0.039451, " a", false], [56537, 0.031491, " learning", false], [38720, 0.028914, " human", false], [39931, 0.025104, " their", false], [45, 0.022468, ",", false], [46227, 0.015888, " humans", false]]], "model_b": [31277, 61, 0.001320666866376996, [[32232, 0.250544, " they", false], [22590, 0.170599, " the", false], [47202, 0.051605, " search", false], [39931, 0.044297, " their", false], [4601, 0.036776, " it", false], [332, 0.029244, " a", false], [38720, 0.025757, " human", false], [45, 0.016534, ",", false], [56537, 0.015655, " learning", false], [46227, 0.014126, " humans", false]]]}, "raw_delta": 0.1625000000000001, "tuned_delta": 0.21658959741507566}, {"byte_start": 3059, "byte_end": 3066, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 528, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "7.49% 7.49% 7.49% 7.49% 7.49% 7.49% 7.49%", "model_b": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.05517926067113876]], "model_b": [[47202, " search", "normal", 0.03395988047122955]]}, "loss": {"model_a": 7.487200826042054, "model_b": 8.735067630382394}, "topk": {"model_a": [47202, 4, 0.05517926067113876, [[63370, 0.279616, " computation", false], [52195, 0.09342, " massive", false], [45829, 0.076264, " effort", false], [47202, 0.055179, " search", false], [32251, 0.043486, " time", false], [56537, 0.030917, " learning", false], [4706, 0.030595, " of", false], [38720, 0.026767, " human", false], [22748, 0.026319, " was", false], [59346, 0.023582, " computing", false]]], "model_b": [47202, 7, 0.03395988047122955, [[63370, 0.226618, " computation", false], [45829, 0.090605, " effort", false], [38720, 0.061999, " human", false], [64862, 0.047647, " computational", false], [52195, 0.04743, " massive", false], [59346, 0.04411, " computing", false], [47202, 0.03396, " search", false], [32251, 0.033431, " time", false], [4706, 0.018111, " of", false], [46, 0.017983, "-", false]]]}, "raw_delta": -0.06919642857142855, "tuned_delta": -0.01510683115635296}, {"byte_start": 3066, "byte_end": 3070, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 529, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "3.66% 3.66% 3.66% 3.66%", "model_b": "3.79% 3.79% 3.79% 3.79%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.44635388255119324]], "model_b": [[22748, " was", "normal", 0.42982035875320435]]}, "loss": {"model_a": 3.6630928772571334, "model_b": 3.7863700413955943}, "topk": {"model_a": [22748, 1, 0.44635388255119324, [[22748, 0.446354, " was", false], [40219, 0.259778, " would", false], [21265, 0.060199, " and", false], [4715, 0.05388, " or", false], [38128, 0.037509, " could", false], [21795, 0.028175, " had", false], [4600, 0.017478, " is", false], [32251, 0.01452, " time", false], [45829, 0.013382, " effort", false], [46650, 0.010046, " needed", false]]], "model_b": [22748, 1, 0.42982035875320435, [[22748, 0.42982, " was", false], [40219, 0.174897, " would", false], [38128, 0.115432, " could", false], [21265, 0.051271, " and", false], [4600, 0.045448, " is", false], [39021, 0.034326, " might", false], [45, 0.021801, ",", false], [45829, 0.014574, " effort", false], [46, 0.014464, "-", false], [22074, 0.008019, " may", false]]]}, "raw_delta": -0.0068359375, "tuned_delta": 0.04725365991507559}, {"byte_start": 3070, "byte_end": 3077, "display": {"text": " needed", "kind": "normal"}, "is_word": true, "word_id": 530, "word_key": " needed", "bytes_hex": "20 6e 65 65 64 65 64", "compression": {"model_a": "1.85% 1.85% 1.85% 1.85% 1.85% 1.85% 1.85%", "model_b": "1.79% 1.79% 1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"model_a": [[46650, " needed", "normal", 0.48742541670799255]], "model_b": [[46650, " needed", "normal", 0.4988114535808563]]}, "loss": {"model_a": 1.8516733225695396, "model_b": 1.7912926707466197}, "topk": {"model_a": [46650, 1, 0.48742541670799255, [[46650, 0.487425, " needed", false], [57101, 0.339497, " required", false], [60050, 0.132029, " necessary", false], [30666, 0.006985, " done", false], [56500, 0.006829, " involved", false], [60152, 0.003734, " performed", false], [55448, 0.003093, " actually", false], [32354, 0.001828, " used", false], [56895, 0.001333, " possible", false], [4811, 0.000938, " to", false]]], "model_b": [46650, 1, 0.4988114535808563, [[46650, 0.498811, " needed", false], [57101, 0.215886, " required", false], [60050, 0.093838, " necessary", false], [30666, 0.042643, " done", false], [60152, 0.027101, " performed", false], [32354, 0.023332, " used", false], [56895, 0.013414, " possible", false], [59206, 0.006696, " available", false], [50937, 0.005228, " applied", false], [37832, 0.004849, " being", false]]]}, "raw_delta": 0.0033482142857142877, "tuned_delta": 0.057437811700789876}, {"byte_start": 3077, "byte_end": 3078, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "18.17%", "model_b": "20.15%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.3699245750904083]], "model_b": [[42, ")", "normal", 0.33101072907447815]]}, "loss": {"model_a": 18.174576198698855, "model_b": 20.147010824914233}, "topk": {"model_a": [42, 1, 0.3699245750904083, [[42, 0.369925, ")", false], [497, 0.332328, "),", false], [499, 0.121045, ").", false], [45, 0.050915, ",", false], [4811, 0.044693, " to", false], [21265, 0.018407, " and", false], [4715, 0.00916, " or", false], [21700, 0.00907, " for", false], [4596, 0.008958, " in", false], [502, 0.008178, ");", false]]], "model_b": [42, 1, 0.33101072907447815, [[42, 0.331011, ")", false], [497, 0.274755, "),", false], [499, 0.140964, ").", false], [4811, 0.060251, " to", false], [45, 0.059308, ",", false], [21265, 0.040597, " and", false], [4596, 0.020406, " in", false], [21700, 0.012211, " for", false], [502, 0.008167, ");", false], [32226, 0.007011, " than", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05528540258492441}, {"byte_start": 3078, "byte_end": 3082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 531, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.75% 4.75% 4.75% 4.75%", "model_b": "5.35% 5.35% 5.35% 5.35%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.34676387906074524]], "model_b": [[21265, " and", "normal", 0.30312976241111755]]}, "loss": {"model_a": 4.754976331054933, "model_b": 5.353751128298887}, "topk": {"model_a": [21265, 1, 0.34676387906074524, [[21265, 0.346764, " and", false], [47001, 0.239757, " rather", false], [21400, 0.19219, " but", false], [4715, 0.063797, " or", false], [40187, 0.028047, " while", false], [52028, 0.015544, " instead", false], [4596, 0.015222, " in", false], [4423, 0.011613, " as", false], [45285, 0.010545, " before", false], [4811, 0.007172, " to", false]]], "model_b": [21265, 1, 0.30312976241111755, [[21265, 0.30313, " and", false], [21400, 0.241492, " but", false], [47001, 0.148247, " rather", false], [4715, 0.07433, " or", false], [4811, 0.041842, " to", false], [4596, 0.035144, " in", false], [4423, 0.022246, " as", false], [52028, 0.017011, " instead", false], [53356, 0.010272, " without", false], [4450, 0.009241, " by", false]]]}, "raw_delta": -0.033203125, "tuned_delta": 0.020886472415075588}, {"byte_start": 3082, "byte_end": 3087, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 532, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "10.93% 10.93% 10.93% 10.93% 10.93%", "model_b": "19.84% 19.84% 19.84% 19.84% 19.84%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.04779050499200821]], "model_b": [[31581, " only", "normal", 0.004124380182474852]]}, "loss": {"model_a": 10.932923356736675, "model_b": 19.837056812223246}, "topk": {"model_a": [31581, 6, 0.04779050499200821, [[32230, 0.106557, " then", false], [32234, 0.071504, " this", false], [22590, 0.064578, " the", false], [56537, 0.060568, " learning", false], [45, 0.05272, ",", false], [31581, 0.047791, " only", false], [32232, 0.041411, " they", false], [32227, 0.031797, " that", false], [4601, 0.028144, " it", false], [22187, 0.02412, " not", false]]], "model_b": [31581, 34, 0.004124380182474852, [[32230, 0.120086, " then", false], [56537, 0.053762, " learning", false], [22590, 0.048672, " the", false], [45, 0.031856, ",", false], [4811, 0.028595, " to", false], [53169, 0.024912, " towards", false], [38869, 0.02452, " later", false], [4596, 0.024161, " in", false], [32227, 0.022255, " that", false], [38720, 0.021751, " human", false]]]}, "raw_delta": -0.4937500000000002, "tuned_delta": -0.4396604025849246}, {"byte_start": 3087, "byte_end": 3092, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 533, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "11.72% 11.72% 11.72% 11.72% 11.72%", "model_b": "18.48% 18.48% 18.48% 18.48% 18.48%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.03886871039867401]], "model_b": [[31466, " much", "normal", 0.00587884709239006]]}, "loss": {"model_a": 11.721897207222828, "model_b": 18.48453021138984}, "topk": {"model_a": [31466, 5, 0.03886871039867401, [[38869, 0.458746, " later", false], [37634, 0.128596, " after", false], [32465, 0.045201, " when", false], [61552, 0.044255, " afterwards", false], [31466, 0.038869, " much", false], [32230, 0.029004, " then", false], [47205, 0.027375, " second", false], [4596, 0.018488, " in", false], [4424, 0.014949, " at", false], [59771, 0.011795, " gradually", false]]], "model_b": [31466, 21, 0.00587884709239006, [[38869, 0.429606, " later", false], [32230, 0.061926, " then", false], [37634, 0.051809, " after", false], [32465, 0.026133, " when", false], [4596, 0.019722, " in", false], [4811, 0.016104, " to", false], [47205, 0.014005, " second", false], [22590, 0.012353, " the", false], [59771, 0.012288, " gradually", false], [45283, 0.012276, " became", false]]]}, "raw_delta": -0.3749999999999999, "tuned_delta": -0.3209104025849243}, {"byte_start": 3092, "byte_end": 3098, "display": {"text": " later", "kind": "normal"}, "is_word": true, "word_id": 534, "word_key": " later", "bytes_hex": "20 6c 61 74 65 72", "compression": {"model_a": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06%", "model_b": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"model_a": [[38869, " later", "normal", 0.97950279712677]], "model_b": [[38869, " later", "normal", 0.9137549996376038]]}, "loss": {"model_a": 0.062372374712911925, "model_b": 0.27003569287472456}, "topk": {"model_a": [38869, 1, 0.97950279712677, [[38869, 0.979503, " later", false], [31458, 0.009658, " more", false], [45, 0.002336, ",", false], [31466, 0.00095, " much", false], [46405, 0.000949, " latter", false], [61552, 0.00082, " afterwards", false], [37634, 0.000819, " after", false], [31255, 0.000636, " late", false], [51816, 0.000634, " further", false], [31277, 0.000567, " less", false]]], "model_b": [38869, 1, 0.9137549996376038, [[38869, 0.913755, " later", false], [31458, 0.041458, " more", false], [31277, 0.014214, " less", false], [45, 0.008385, ",", false], [45683, 0.002452, " deeper", false], [31466, 0.002423, " much", false], [51816, 0.001994, " further", false], [37634, 0.001938, " after", false], [4706, 0.001879, " of", false], [46470, 0.001099, " longer", false]]]}, "raw_delta": -0.01151529947916667, "tuned_delta": 0.04257429793590892}, {"byte_start": 3098, "byte_end": 3102, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 535, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "9.72% 9.72% 9.72% 9.72%", "model_b": "15.29% 15.29% 15.29% 15.29%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.11592810600996017]], "model_b": [[22748, " was", "normal", 0.0338088795542717]]}, "loss": {"model_a": 9.721284943490085, "model_b": 15.286368353169191}, "topk": {"model_a": [22748, 2, 0.11592810600996017, [[21532, 0.541503, " did", false], [22748, 0.115928, " was", false], [32462, 0.10857, " were", false], [45, 0.073, ",", false], [53169, 0.025974, " towards", false], [47585, 0.012947, " toward", false], [275, 0.00969, " (", false], [30383, 0.009638, " came", false], [4712, 0.006647, " on", false], [4596, 0.005592, " in", false]]], "model_b": [22748, 5, 0.0338088795542717, [[21532, 0.263094, " did", false], [45, 0.147636, ",", false], [32462, 0.063005, " were", false], [32232, 0.037539, " they", false], [22748, 0.033809, " was", false], [37828, 0.029368, " began", false], [4596, 0.028505, " in", false], [4811, 0.022908, " to", false], [52112, 0.020956, " learned", false], [56537, 0.018457, " learning", false]]]}, "raw_delta": -0.30859375, "tuned_delta": -0.2545041525849244}, {"byte_start": 3102, "byte_end": 3107, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 536, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "21.64% 21.64% 21.64% 21.64% 21.64%", "model_b": "18.15% 18.15% 18.15% 18.15% 18.15%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.002497876062989235]], "model_b": [[31466, " much", "normal", 0.006635008379817009]]}, "loss": {"model_a": 21.640425613334447, "model_b": 18.146398561181492}, "topk": {"model_a": [31466, 23, 0.002497876062989235, [[22590, 0.226275, " the", false], [4601, 0.195146, " it", false], [56537, 0.135421, " learning", false], [47202, 0.092641, " search", false], [39934, 0.043747, " there", false], [32234, 0.043389, " this", false], [32227, 0.032814, " that", false], [39931, 0.027075, " their", false], [52195, 0.018011, " massive", false], [332, 0.016077, " a", false]]], "model_b": [31466, 17, 0.006635008379817009, [[22590, 0.254605, " the", false], [4601, 0.185147, " it", false], [56537, 0.078256, " learning", false], [59193, 0.053329, " attention", false], [332, 0.04189, " a", false], [39931, 0.038741, " their", false], [32234, 0.030966, " this", false], [32232, 0.029968, " they", false], [39934, 0.027982, " there", false], [32227, 0.019616, " that", false]]]}, "raw_delta": 0.19374999999999987, "tuned_delta": 0.24783959741507544}, {"byte_start": 3107, "byte_end": 3115, "display": {"text": " greater", "kind": "normal"}, "is_word": true, "word_id": 537, "word_key": " greater", "bytes_hex": "20 67 72 65 61 74 65 72", "compression": {"model_a": "7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40%", "model_b": "11.13% 11.13% 11.13% 11.13% 11.13% 11.13% 11.13% 11.13%"}, "model_tokens": {"model_a": [[51867, " greater", "normal", 0.037600304931402206]], "model_b": [[51867, " greater", "normal", 0.007241510320454836]]}, "loss": {"model_a": 7.396629848307673, "model_b": 11.130166819358212}, "topk": {"model_a": [51867, 5, 0.037600304931402206, [[31458, 0.344054, " more", false], [4706, 0.204652, " of", false], [45829, 0.075449, " effort", false], [47202, 0.044362, " search", false], [51867, 0.0376, " greater", false], [31277, 0.034233, " less", false], [59193, 0.021018, " attention", false], [56537, 0.018753, " learning", false], [45683, 0.016974, " deeper", false], [45301, 0.015936, " better", false]]], "model_b": [51867, 12, 0.007241510320454836, [[4706, 0.384006, " of", false], [31458, 0.135944, " more", false], [45829, 0.113871, " effort", false], [59193, 0.08905, " attention", false], [57103, 0.019762, " research", false], [56537, 0.016612, " learning", false], [45683, 0.015143, " deeper", false], [56103, 0.009252, " emphasis", false], [56950, 0.008578, " progress", false], [31277, 0.008147, " less", false]]]}, "raw_delta": -0.20703125, "tuned_delta": -0.15294165258492443}, {"byte_start": 3115, "byte_end": 3123, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 538, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"model_a": "5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42%", "model_b": "12.33% 12.33% 12.33% 12.33% 12.33% 12.33% 12.33% 12.33%"}, "model_tokens": {"model_a": [[53052, " success", "normal", 0.0909983441233635]], "model_b": [[53052, " success", "normal", 0.004178218077868223]]}, "loss": {"model_a": 5.424195222092293, "model_b": 12.327716413846122}, "topk": {"model_a": [53052, 2, 0.0909983441233635, [[45829, 0.182586, " effort", false], [53052, 0.090998, " success", false], [47202, 0.084582, " search", false], [56950, 0.071137, " progress", false], [63370, 0.052609, " computation", false], [64862, 0.042148, " computational", false], [22681, 0.040962, " use", false], [64902, 0.038508, " effectiveness", false], [56103, 0.032701, " emphasis", false], [57077, 0.024547, " reliance", false]]], "model_b": [53052, 20, 0.004178218077868223, [[45829, 0.337204, " effort", false], [59193, 0.154845, " attention", false], [56103, 0.088014, " emphasis", false], [63370, 0.035732, " computation", false], [64862, 0.03507, " computational", false], [59346, 0.033101, " computing", false], [57077, 0.028513, " reliance", false], [38530, 0.026895, " focus", false], [22681, 0.018707, " use", false], [56950, 0.014957, " progress", false]]]}, "raw_delta": -0.3828125, "tuned_delta": -0.3287229025849244}, {"byte_start": 3123, "byte_end": 3127, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 539, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"model_a": "16.55% 16.55% 16.55% 16.55%", "model_b": "30.71% 30.71% 30.71% 30.71%"}, "model_tokens": {"model_a": [[21795, " had", "normal", 0.0256732739508152]], "model_b": [[21795, " had", "normal", 0.001098484150134027]]}, "loss": {"model_a": 16.554362041450506, "model_b": 30.713624893925193}, "topk": {"model_a": [21795, 6, 0.0256732739508152, [[55437, 0.408485, " achieved", false], [38547, 0.115582, " found", false], [56741, 0.076742, " obtained", false], [31968, 0.065383, " seen", false], [57027, 0.059663, " realized", false], [21795, 0.025673, " had", false], [55571, 0.024821, " attained", false], [4596, 0.022397, " in", false], [51097, 0.01655, " brought", false], [21572, 0.013365, " due", false]]], "model_b": [21795, 64, 0.001098484150134027, [[55437, 0.349075, " achieved", false], [57027, 0.17274, " realized", false], [56741, 0.036873, " obtained", false], [31968, 0.028171, " seen", false], [55571, 0.027184, " attained", false], [4596, 0.023454, " in", false], [38547, 0.022523, " found", false], [52643, 0.017719, " reached", false], [61618, 0.016802, " attributed", false], [21572, 0.016055, " due", false]]]}, "raw_delta": -0.78515625, "tuned_delta": -0.7310666525849244}, {"byte_start": 3127, "byte_end": 3130, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 540, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "8.88% 8.88% 8.88%", "model_b": "18.60% 18.60% 18.60%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.22978253662586212]], "model_b": [[4450, " by", "normal", 0.044994913041591644]]}, "loss": {"model_a": 8.875955817969208, "model_b": 18.597240761459293}, "topk": {"model_a": [4450, 2, 0.22978253662586212, [[32487, 0.305985, " with", false], [4450, 0.229783, " by", false], [4596, 0.116747, " in", false], [30259, 0.083631, " been", false], [32465, 0.0293, " when", false], [30917, 0.028723, " from", false], [4712, 0.024422, " on", false], [40085, 0.020209, " using", false], [4811, 0.017967, " to", false], [30482, 0.013175, " come", false]]], "model_b": [4450, 6, 0.044994913041591644, [[30259, 0.24952, " been", false], [4811, 0.16244, " to", false], [47, 0.10919, ".", false], [32487, 0.060841, " with", false], [4596, 0.056299, " in", false], [4450, 0.044995, " by", false], [22590, 0.028662, " the", false], [332, 0.0284, " a", false], [55437, 0.021987, " achieved", false], [32465, 0.01813, " when", false]]]}, "raw_delta": -0.5390625, "tuned_delta": -0.4849729025849244}, {"byte_start": 3130, "byte_end": 3140, "display": {"text": " embracing", "kind": "normal"}, "is_word": true, "word_id": 541, "word_key": " embracing", "bytes_hex": "20 65 6d 62 72 61 63 69 6e 67", "compression": {"model_a": "7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78%", "model_b": "12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06% 12.06%"}, "model_tokens": {"model_a": [[59611, " embracing", "normal", 0.013404577039182186]], "model_b": [[59611, " embracing", "normal", 0.0012345211580395699]]}, "loss": {"model_a": 7.777027954792068, "model_b": 12.06002885743118}, "topk": {"model_a": [59611, 14, 0.013404577039182186, [[40085, 0.093338, " using", false], [38888, 0.083852, " lever", false], [56537, 0.070385, " learning", false], [60720, 0.061764, " utilizing", false], [22590, 0.043762, " the", false], [47497, 0.036913, " taking", false], [55531, 0.034593, " applying", false], [332, 0.022074, " a", false], [47285, 0.020393, " simply", false], [52700, 0.019382, " relying", false]]], "model_b": [59611, 43, 0.0012345211580395699, [[38888, 0.567971, " lever", false], [40085, 0.047167, " using", false], [55531, 0.036529, " applying", false], [47497, 0.032738, " taking", false], [60720, 0.025477, " utilizing", false], [22590, 0.017222, " the", false], [56537, 0.013585, " learning", false], [52700, 0.01167, " relying", false], [47285, 0.010732, " simply", false], [46500, 0.008393, " making", false]]]}, "raw_delta": -0.23749999999999988, "tuned_delta": -0.1834104025849243}, {"byte_start": 3140, "byte_end": 3147, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 542, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04%", "model_b": "5.31% 5.31% 5.31% 5.31% 5.31% 5.31% 5.31%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.44809770584106445]], "model_b": [[47202, " search", "normal", 0.12691177427768707]]}, "loss": {"model_a": 2.042878720008786, "model_b": 5.313497360416941}, "topk": {"model_a": [47202, 1, 0.44809770584106445, [[47202, 0.448098, " search", false], [22590, 0.209414, " the", false], [52195, 0.063619, " massive", false], [56537, 0.055673, " learning", false], [21265, 0.038601, " and", false], [332, 0.023735, " a", false], [51832, 0.020836, " general", false], [63370, 0.01426, " computation", false], [37920, 0.008584, " brute", false], [31458, 0.006744, " more", false]]], "model_b": [47202, 3, 0.12691177427768707, [[51832, 0.206579, " general", false], [22590, 0.134588, " the", false], [47202, 0.126912, " search", false], [56537, 0.072195, " learning", false], [332, 0.060285, " a", false], [52195, 0.045068, " massive", false], [52224, 0.02428, " methods", false], [31978, 0.020413, " self", false], [63370, 0.019964, " computation", false], [31458, 0.019322, " more", false]]]}, "raw_delta": -0.18136160714285718, "tuned_delta": -0.12727200972778158}, {"byte_start": 3147, "byte_end": 3151, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 543, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "8.17% 8.17% 8.17% 8.17%", "model_b": "7.01% 7.01% 7.01% 7.01%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.16404545307159424]], "model_b": [[21265, " and", "normal", 0.2153063714504242]]}, "loss": {"model_a": 8.171514880035144, "model_b": 7.009187332443938}, "topk": {"model_a": [21265, 2, 0.16404545307159424, [[47, 0.382502, ".", false], [21265, 0.164045, " and", false], [4423, 0.118605, " as", false], [45, 0.054232, ",", false], [275, 0.048288, " (", false], [46, 0.01957, "-", false], [4596, 0.01727, " in", false], [32487, 0.01584, " with", false], [46342, 0.014273, " itself", false], [31458, 0.012311, " more", false]]], "model_b": [21265, 2, 0.2153063714504242, [[47, 0.32488, ".", false], [21265, 0.215306, " and", false], [275, 0.057303, " (", false], [4423, 0.054973, " as", false], [46, 0.053612, "-", false], [45, 0.043802, ",", false], [4596, 0.029199, " in", false], [52224, 0.022313, " methods", false], [37810, 0.016249, " based", false], [21700, 0.015659, " for", false]]]}, "raw_delta": 0.064453125, "tuned_delta": 0.11854272241507559}, {"byte_start": 3151, "byte_end": 3160, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 544, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71%", "model_b": "1.68% 1.68% 1.68% 1.68% 1.68% 1.68% 1.68% 1.68% 1.68%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.7037807703018188]], "model_b": [[56537, " learning", "normal", 0.42830225825309753]]}, "loss": {"model_a": 0.7083544987003645, "model_b": 1.6828311295091531}, "topk": {"model_a": [56537, 1, 0.7037807703018188, [[56537, 0.703781, " learning", false], [31978, 0.047677, " self", false], [38888, 0.033895, " lever", false], [22590, 0.021175, " the", false], [21902, 0.020025, " its", false], [45, 0.008132, ",", false], [55586, 0.007394, " avoiding", false], [4450, 0.006453, " by", false], [40085, 0.005997, " using", false], [52129, 0.005276, " letting", false]]], "model_b": [56537, 1, 0.42830225825309753, [[56537, 0.428302, " learning", false], [38888, 0.165778, " lever", false], [51832, 0.041314, " general", false], [31978, 0.024467, " self", false], [22590, 0.021826, " the", false], [40085, 0.020884, " using", false], [63370, 0.018313, " computation", false], [39193, 0.010507, " other", false], [59346, 0.009369, " computing", false], [30597, 0.009046, " deep", false]]]}, "raw_delta": -0.05403645833333333, "tuned_delta": 5.313908174225945e-05}, {"byte_start": 3160, "byte_end": 3161, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "8.14%", "model_b": "8.24%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6419187188148499]], "model_b": [[47, ".", "normal", 0.631603479385376]]}, "loss": {"model_a": 8.136292833138441, "model_b": 8.24195897382855}, "topk": {"model_a": [47, 1, 0.6419187188148499, [[47, 0.641919, ".", false], [4423, 0.078597, " as", false], [45, 0.048777, ",", false], [4450, 0.033713, " by", false], [275, 0.024425, " (", false], [4596, 0.020929, " in", false], [21265, 0.012378, " and", false], [4811, 0.010892, " to", false], [31458, 0.009224, " more", false], [52028, 0.009113, " instead", false]]], "model_b": [47, 1, 0.631603479385376, [[47, 0.631603, ".", false], [275, 0.051979, " (", false], [4450, 0.039089, " by", false], [45, 0.037884, ",", false], [4423, 0.034968, " as", false], [4596, 0.026681, " in", false], [52224, 0.017134, " methods", false], [4811, 0.013264, " to", false], [21700, 0.01307, " for", false], [21265, 0.01139, " and", false]]]}, "raw_delta": -0.005859375, "tuned_delta": 0.04823022241507559}, {"byte_start": 3161, "byte_end": 3162, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "4.09%", "model_b": "6.52%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.6377475261688232]], "model_b": [[261, "\n\n", "control", 0.4876733124256134]]}, "loss": {"model_a": 4.085757440017572, "model_b": 6.516078675890093}, "topk": {"model_a": [261, 1, 0.6377475261688232, [[261, 0.637748, "\n\n", false], [20996, 0.040391, " The", false], [267, 0.033178, "  ", false], [3913, 0.021198, " In", false], [29894, 0.020926, " This", false], [3918, 0.015197, " It", false], [3336, 0.014963, " \n\n", false], [19417, 0.01011, " And", false], [19555, 0.009394, " But", false], [3328, 0.008935, "\n\n\n", false]]], "model_b": [261, 1, 0.4876733124256134, [[261, 0.487673, "\n\n", false], [267, 0.070869, "  ", false], [20996, 0.046998, " The", false], [3913, 0.044231, " In", false], [11, 0.043138, "\n", false], [29894, 0.030869, " This", false], [3336, 0.019602, " \n\n", false], [3918, 0.012731, " It", false], [19417, 0.010886, " And", false], [37453, 0.007772, " These", false]]]}, "raw_delta": -0.134765625, "tuned_delta": -0.08067602758492441}, {"byte_start": 3162, "byte_end": 3163, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "4.09%", "model_b": "6.52%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.6377475261688232]], "model_b": [[261, "\n\n", "control", 0.4876733124256134]]}, "loss": {"model_a": 4.085757440017572, "model_b": 6.516078675890093}, "topk": {"model_a": [261, 1, 0.6377475261688232, [[261, 0.637748, "\n\n", false], [20996, 0.040391, " The", false], [267, 0.033178, "  ", false], [3913, 0.021198, " In", false], [29894, 0.020926, " This", false], [3918, 0.015197, " It", false], [3336, 0.014963, " \n\n", false], [19417, 0.01011, " And", false], [19555, 0.009394, " But", false], [3328, 0.008935, "\n\n\n", false]]], "model_b": [261, 1, 0.4876733124256134, [[261, 0.487673, "\n\n", false], [267, 0.070869, "  ", false], [20996, 0.046998, " The", false], [3913, 0.044231, " In", false], [11, 0.043138, "\n", false], [29894, 0.030869, " This", false], [3336, 0.019602, " \n\n", false], [3918, 0.012731, " It", false], [19417, 0.010886, " And", false], [37453, 0.007772, " These", false]]]}, "raw_delta": -0.134765625, "tuned_delta": -0.08067602758492441}, {"byte_start": 3163, "byte_end": 3165, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 545, "word_key": "in", "bytes_hex": "49 6e", "compression": {"model_a": "16.27% 16.27%", "model_b": "15.08% 15.08%"}, "model_tokens": {"model_a": [[1136, "In", "normal", 0.16476811468601227]], "model_b": [[1136, "In", "normal", 0.187474325299263]]}, "loss": {"model_a": 16.272585666276882, "model_b": 15.075036071788972}, "topk": {"model_a": [1136, 1, 0.16476811468601227, [[1136, 0.164768, "In", false], [6699, 0.148463, "The", false], [66, 0.083091, "A", false], [48358, 0.057915, "Another", false], [33504, 0.039198, "There", false], [1141, 0.025535, "It", false], [24242, 0.018545, "This", false], [58094, 0.016799, "Similarly", false], [6393, 0.015119, "One", false], [33505, 0.015112, "These", false]]], "model_b": [1136, 1, 0.187474325299263, [[1136, 0.187474, "In", false], [6699, 0.165424, "The", false], [66, 0.057961, "A", false], [24242, 0.02953, "This", false], [33504, 0.028861, "There", false], [48358, 0.024581, "Another", false], [53454, 0.022711, "Computer", false], [6393, 0.014744, "One", false], [1141, 0.014385, "It", false], [820, 0.013886, "AI", false]]]}, "raw_delta": 0.06640625, "tuned_delta": 0.12049584741507559}, {"byte_start": 3165, "byte_end": 3172, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 546, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"model_a": "13.69% 13.69% 13.69% 13.69% 13.69% 13.69% 13.69%", "model_b": "16.75% 16.75% 16.75% 16.75% 16.75% 16.75% 16.75%"}, "model_tokens": {"model_a": [[47350, " speech", "normal", 0.0049649751745164394]], "model_b": [[47350, " speech", "normal", 0.0015016007237136364]]}, "loss": {"model_a": 13.686281079861814, "model_b": 16.745567438889754}, "topk": {"model_a": [47350, 24, 0.0049649751745164394, [[55809, 0.327519, " computer", false], [22590, 0.123117, " the", false], [3492, 0.039047, " 19", false], [52299, 0.034119, " natural", false], [52766, 0.03024, " robotic", false], [52167, 0.029188, " machine", false], [3609, 0.027223, " AI", false], [51832, 0.021017, " general", false], [3493, 0.020056, " 20", false], [31370, 0.016802, " many", false]]], "model_b": [47350, 52, 0.0015016007237136364, [[55809, 0.375784, " computer", false], [22590, 0.111634, " the", false], [52167, 0.044856, " machine", false], [3609, 0.035944, " AI", false], [65003, 0.029932, " reinforcement", false], [39193, 0.017296, " other", false], [30322, 0.016643, " both", false], [332, 0.012923, " a", false], [50919, 0.01056, " another", false], [31370, 0.010372, " many", false]]]}, "raw_delta": -0.1696428571428572, "tuned_delta": -0.11555325972778162}, {"byte_start": 3172, "byte_end": 3184, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 547, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"model_a": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%", "model_b": "0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76%"}, "model_tokens": {"model_a": [[63821, " recognition", "normal", 0.910800576210022]], "model_b": [[63821, " recognition", "normal", 0.6027653217315674]]}, "loss": {"model_a": 0.13942060229945022, "model_b": 0.757274008279119}, "topk": {"model_a": [63821, 1, 0.910800576210022, [[63821, 0.910801, " recognition", false], [21265, 0.017009, " and", false], [46, 0.015004, "-", false], [45, 0.012315, ",", false], [62378, 0.011844, " processing", false], [60615, 0.010048, " synthesis", false], [65034, 0.007881, " understanding", false], [63944, 0.002946, " translation", false], [62035, 0.002079, " generation", false], [62634, 0.000906, " technology", false]]], "model_b": [63821, 1, 0.6027653217315674, [[63821, 0.602765, " recognition", false], [46, 0.101487, "-", false], [21265, 0.070219, " and", false], [60615, 0.069978, " synthesis", false], [62378, 0.034364, " processing", false], [45, 0.030477, ",", false], [65034, 0.019338, " understanding", false], [60335, 0.011133, " recognize", false], [56529, 0.00574, " language", false], [62634, 0.00325, " technology", false]]]}, "raw_delta": -0.03426106770833333, "tuned_delta": 0.01982852970674226}, {"byte_start": 3184, "byte_end": 3185, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.75%", "model_b": "3.15%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8587448000907898]], "model_b": [[45, ",", "normal", 0.8389545679092407]]}, "loss": {"model_a": 2.74731965794285, "model_b": 3.1523731972549367}, "topk": {"model_a": [45, 1, 0.8587448000907898, [[45, 0.858745, ",", false], [21265, 0.067216, " and", false], [275, 0.009614, " (", false], [22590, 0.009349, " the", false], [57103, 0.008136, " research", false], [39934, 0.007132, " there", false], [53087, 0.004491, " systems", false], [4601, 0.004453, " it", false], [4596, 0.00248, " in", false], [332, 0.002215, " a", false]]], "model_b": [45, 1, 0.8389545679092407, [[45, 0.838955, ",", false], [21265, 0.064064, " and", false], [275, 0.022599, " (", false], [57103, 0.014011, " research", false], [22590, 0.011862, " the", false], [39934, 0.004196, " there", false], [4596, 0.003383, " in", false], [4601, 0.003337, " it", false], [32234, 0.001942, " this", false], [53087, 0.001706, " systems", false]]]}, "raw_delta": -0.0224609375, "tuned_delta": 0.03162865991507559}, {"byte_start": 3185, "byte_end": 3191, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 548, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"model_a": "9.58% 9.58% 9.58% 9.58% 9.58% 9.58%", "model_b": "9.63% 9.63% 9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"model_a": [[39934, " there", "normal", 0.041605982929468155]], "model_b": [[39934, " there", "normal", 0.04031412675976753]]}, "loss": {"model_a": 9.580396755903271, "model_b": 9.627359485098875}, "topk": {"model_a": [39934, 4, 0.041605982929468155, [[22590, 0.365746, " the", false], [63843, 0.086614, " researchers", false], [332, 0.049329, " a", false], [39934, 0.041606, " there", false], [4601, 0.024879, " it", false], [40186, 0.014319, " which", false], [50919, 0.013814, " another", false], [38328, 0.012859, " early", false], [22226, 0.012047, " one", false], [4423, 0.011603, " as", false]]], "model_b": [39934, 3, 0.04031412675976753, [[22590, 0.363664, " the", false], [332, 0.048145, " a", false], [39934, 0.040314, " there", false], [63843, 0.028919, " researchers", false], [31466, 0.018842, " much", false], [32234, 0.018108, " this", false], [4601, 0.015344, " it", false], [22226, 0.014396, " one", false], [57103, 0.012773, " research", false], [38328, 0.012746, " early", false]]]}, "raw_delta": -0.0026041666666666297, "tuned_delta": 0.05148543074840896}, {"byte_start": 3191, "byte_end": 3195, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 549, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "3.75% 3.75% 3.75% 3.75%", "model_b": "4.39% 4.39% 4.39% 4.39%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.4342584013938904]], "model_b": [[22748, " was", "normal", 0.37649038434028625]]}, "loss": {"model_a": 3.7511479944988912, "model_b": 4.385144838639549}, "topk": {"model_a": [22748, 1, 0.4342584013938904, [[22748, 0.434258, " was", false], [32462, 0.205648, " were", false], [21800, 0.11211, " has", false], [4600, 0.093833, " is", false], [31059, 0.062746, " have", false], [21286, 0.047831, " are", false], [21795, 0.016404, " had", false], [30135, 0.00243, " also", false], [39620, 0.002053, " seems", false], [22614, 0.001832, " too", false]]], "model_b": [22748, 1, 0.37649038434028625, [[22748, 0.37649, " was", false], [32462, 0.214913, " were", false], [4600, 0.138603, " is", false], [21286, 0.116427, " are", false], [21800, 0.06276, " has", false], [31059, 0.04416, " have", false], [21795, 0.00996, " had", false], [30135, 0.00551, " also", false], [22614, 0.003811, " too", false], [22074, 0.001915, " may", false]]]}, "raw_delta": -0.03515625, "tuned_delta": 0.018933347415075588}, {"byte_start": 3195, "byte_end": 3198, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 550, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"model_a": "13.43% 13.43% 13.43%", "model_b": "15.31% 15.31% 15.31%"}, "model_tokens": {"model_a": [[4419, " an", "normal", 0.10843311995267868]], "model_b": [[4419, " an", "normal", 0.07878382503986359]]}, "loss": {"model_a": 13.43134054994282, "model_b": 15.309849717766994}, "topk": {"model_a": [4419, 2, 0.10843311995267868, [[332, 0.505881, " a", false], [4419, 0.108433, " an", false], [30135, 0.051776, " also", false], [22590, 0.031101, " the", false], [59868, 0.02628, " initially", false], [50919, 0.02625, " another", false], [30788, 0.021297, " even", false], [52906, 0.020631, " similar", false], [31466, 0.017201, " much", false], [4692, 0.015729, " no", false]]], "model_b": [4419, 2, 0.07878382503986359, [[332, 0.343079, " a", false], [4419, 0.078784, " an", false], [31466, 0.07254, " much", false], [22590, 0.048772, " the", false], [30135, 0.047286, " also", false], [4692, 0.034066, " no", false], [59868, 0.027968, " initially", false], [52013, 0.022776, " initial", false], [46454, 0.020384, " little", false], [50919, 0.019823, " another", false]]]}, "raw_delta": -0.10416666666666674, "tuned_delta": -0.05007706925159115}, {"byte_start": 3198, "byte_end": 3204, "display": {"text": " early", "kind": "normal"}, "is_word": true, "word_id": 551, "word_key": " early", "bytes_hex": "20 65 61 72 6c 79", "compression": {"model_a": "4.98% 4.98% 4.98% 4.98% 4.98% 4.98%", "model_b": "4.09% 4.09% 4.09% 4.09% 4.09% 4.09%"}, "model_tokens": {"model_a": [[38328, " early", "normal", 0.19043795764446259]], "model_b": [[38328, " early", "normal", 0.25682786107063293]]}, "loss": {"model_a": 4.9780492947340536, "model_b": 4.085757440017572}, "topk": {"model_a": [38328, 2, 0.19043795764446259, [[52013, 0.233134, " initial", false], [38328, 0.190438, " early", false], [30788, 0.15006, " even", false], [51639, 0.042763, " equally", false], [59134, 0.035616, " analogous", false], [51551, 0.022189, " earlier", false], [59829, 0.018427, " important", false], [45829, 0.016659, " effort", false], [56125, 0.012986, " enormous", false], [52035, 0.010989, " intense", false]]], "model_b": [38328, 1, 0.25682786107063293, [[38328, 0.256828, " early", false], [52013, 0.24645, " initial", false], [51551, 0.046832, " earlier", false], [45829, 0.036899, " effort", false], [56125, 0.017762, " enormous", false], [50976, 0.017453, " attempt", false], [63667, 0.017318, " interesting", false], [51639, 0.016447, " equally", false], [60080, 0.015647, " obsession", false], [30788, 0.015264, " even", false]]]}, "raw_delta": 0.049479166666666685, "tuned_delta": 0.10356876408174227}, {"byte_start": 3204, "byte_end": 3216, "display": {"text": " competition", "kind": "normal"}, "is_word": true, "word_id": 552, "word_key": " competition", "bytes_hex": "20 63 6f 6d 70 65 74 69 74 69 6f 6e", "compression": {"model_a": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "model_b": "13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[63361, " competition", "normal", 0.0025059119798243046]], "model_b": [[63361, " competition", "normal", 0.0001074282408808358]]}, "loss": {"model_a": 9.01684400555602, "model_b": 13.713116925116447}, "topk": {"model_a": [63361, 58, 0.0025059119798243046, [[45829, 0.128628, " effort", false], [45, 0.047331, ",", false], [46790, 0.047023, " period", false], [21265, 0.046186, " and", false], [50976, 0.043196, " attempt", false], [55532, 0.037538, " approach", false], [56103, 0.031512, " emphasis", false], [31813, 0.020199, " race", false], [32447, 0.016303, " wave", false], [45294, 0.015906, " belief", false]]], "model_b": [63361, 643, 0.0001074282408808358, [[45829, 0.161554, " effort", false], [53052, 0.042111, " success", false], [38530, 0.039414, " focus", false], [50976, 0.037759, " attempt", false], [45, 0.034578, ",", false], [61947, 0.033868, " enthusiasm", false], [45294, 0.030329, " belief", false], [60080, 0.029428, " obsession", false], [56477, 0.013246, " interest", false], [21265, 0.012947, " and", false]]]}, "raw_delta": -0.2604166666666666, "tuned_delta": -0.206327069251591}, {"byte_start": 3216, "byte_end": 3217, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "72.13%", "model_b": "76.08%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.018264463171362877]], "model_b": [[45, ",", "normal", 0.014770129695534706]]}, "loss": {"model_a": 72.13475204444816, "model_b": 76.07962129687893}, "topk": {"model_a": [45, 5, 0.018264463171362877, [[51035, 0.769351, " between", false], [4811, 0.039499, " to", false], [37694, 0.033841, " among", false], [4596, 0.030007, " in", false], [45, 0.018264, ",", false], [32487, 0.016816, " with", false], [21700, 0.016061, " for", false], [4706, 0.012016, " of", false], [32227, 0.010963, " that", false], [275, 0.005901, " (", false]]], "model_b": [45, 7, 0.014770129695534706, [[51035, 0.667575, " between", false], [32487, 0.088503, " with", false], [21700, 0.047118, " for", false], [4596, 0.028337, " in", false], [4811, 0.026315, " to", false], [37694, 0.021453, " among", false], [45, 0.01477, ",", false], [32227, 0.012305, " that", false], [4450, 0.010144, " by", false], [50870, 0.009589, " against", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 3217, "byte_end": 3227, "display": {"text": " sponsored", "kind": "normal"}, "is_word": true, "word_id": 553, "word_key": " sponsored", "bytes_hex": "20 73 70 6f 6e 73 6f 72 65 64", "compression": {"model_a": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%", "model_b": "12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79% 12.79%"}, "model_tokens": {"model_a": [[60543, " sponsored", "normal", 0.0018463052110746503]], "model_b": [[60543, " sponsored", "normal", 0.0008212585235014558]]}, "loss": {"model_a": 11.32741028197975, "model_b": 12.792647432882601}, "topk": {"model_a": [60543, 68, 0.0018463052110746503, [[4596, 0.18676, " in", false], [51035, 0.080088, " between", false], [22590, 0.040197, " the", false], [32487, 0.037731, " with", false], [30917, 0.034535, " from", false], [40186, 0.030379, " which", false], [57295, 0.024309, " starting", false], [21265, 0.020234, " and", false], [3492, 0.019021, " 19", false], [45202, 0.01845, " around", false]]], "model_b": [60543, 118, 0.0008212585235014558, [[4596, 0.102722, " in", false], [32487, 0.094154, " with", false], [21400, 0.067422, " but", false], [21265, 0.066919, " and", false], [51035, 0.040398, " between", false], [4423, 0.035332, " as", false], [22590, 0.031106, " the", false], [40185, 0.015717, " where", false], [21700, 0.015417, " for", false], [22614, 0.015044, " too", false]]]}, "raw_delta": -0.08124999999999993, "tuned_delta": -0.027160402584924345}, {"byte_start": 3227, "byte_end": 3230, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 554, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "0.40% 0.40% 0.40%", "model_b": "1.06% 1.06% 1.06%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.9355474710464478]], "model_b": [[4450, " by", "normal", 0.8395534157752991]]}, "loss": {"model_a": 0.40211836873736156, "model_b": 1.0566614069010962}, "topk": {"model_a": [4450, 1, 0.9355474710464478, [[4450, 0.935547, " by", false], [4596, 0.0308, " in", false], [52063, 0.006403, " jointly", false], [21265, 0.003917, " and", false], [4424, 0.002611, " at", false], [21700, 0.002492, " for", false], [4423, 0.002065, " as", false], [59868, 0.001265, " initially", false], [46768, 0.001179, " partly", false], [45, 0.001036, ",", false]]], "model_b": [4450, 1, 0.8395534157752991, [[4450, 0.839553, " by", false], [4596, 0.08013, " in", false], [52063, 0.011147, " jointly", false], [21265, 0.010384, " and", false], [4424, 0.00617, " at", false], [46768, 0.004914, " partly", false], [52094, 0.004766, " largely", false], [45, 0.004023, ",", false], [59868, 0.003683, " initially", false], [4423, 0.002232, " as", false]]]}, "raw_delta": -0.03629557291666667, "tuned_delta": 0.017794024498408917}, {"byte_start": 3230, "byte_end": 3234, "display": {"text": " DAR", "kind": "normal"}, "is_word": true, "word_id": 555, "word_key": " dar", "bytes_hex": "20 44 41 52", "compression": {"model_a": "6.06% 6.06% 6.06% 6.06%", "model_b": "11.91% 11.91% 11.91% 11.91%"}, "model_tokens": {"model_a": [[19678, " DAR", "normal", 0.26150837540626526]], "model_b": [[19678, " DAR", "normal", 0.07156697660684586]]}, "loss": {"model_a": 6.058192066232952, "model_b": 11.905051851085684}, "topk": {"model_a": [19678, 1, 0.26150837540626526, [[19678, 0.261508, " DAR", false], [22590, 0.203837, " the", false], [20077, 0.179209, " IBM", false], [28484, 0.093815, " Bell", false], [3620, 0.074024, " AT", false], [54894, 0.023838, " Carnegie", false], [323, 0.017206, " X", false], [332, 0.015336, " a", false], [36292, 0.007002, " Apple", false], [62041, 0.006133, " government", false]]], "model_b": [19678, 3, 0.07156697660684586, [[22590, 0.268638, " the", false], [20077, 0.140832, " IBM", false], [19678, 0.071567, " DAR", false], [20354, 0.049451, " MIT", false], [332, 0.037842, " a", false], [58902, 0.037511, " Microsoft", false], [28484, 0.030679, " Bell", false], [47350, 0.028826, " speech", false], [44348, 0.024033, " Google", false], [54894, 0.022664, " Carnegie", false]]]}, "raw_delta": -0.32421875, "tuned_delta": -0.2701291525849244}, {"byte_start": 3234, "byte_end": 3236, "display": {"text": "PA", "kind": "normal"}, "is_word": true, "word_id": 556, "word_key": "pa", "bytes_hex": "50 41", "compression": {"model_a": "0.00% 0.00%", "model_b": "0.01% 0.01%"}, "model_tokens": {"model_a": [[1342, "PA", "normal", 0.9996206760406494]], "model_b": [[1342, "PA", "normal", 0.999221920967102]]}, "loss": {"model_a": 0.0034052564870836106, "model_b": 0.0069824956250300295}, "topk": {"model_a": [1342, 1, 0.9996206760406494, [[1342, 0.999621, "PA", false], [6405, 8.3e-05, "PAN", false], [81, 7.4e-05, "P", false], [66, 3.9e-05, "A", false], [85, 2.3e-05, "T", false], [1356, 1.5e-05, "PP", false], [2111, 1.2e-05, "pa", false], [1470, 1.2e-05, "TA", false], [827, 9e-06, "AP", false], [6407, 9e-06, "PAS", false]]], "model_b": [1342, 1, 0.999221920967102, [[1342, 0.999222, "PA", false], [66, 0.000166, "A", false], [70, 4.9e-05, "E", false], [2111, 4.4e-05, "pa", false], [1360, 3.4e-05, "PU", false], [812, 3.1e-05, "AA", false], [76, 2.7e-05, "K", false], [4104, 2.1e-05, " PA", false], [1178, 1.7e-05, "KN", false], [1104, 1.6e-05, "IA", false]]]}, "raw_delta": -0.0001983642578125, "tuned_delta": 0.05389123315726309}, {"byte_start": 3236, "byte_end": 3237, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "4.31%", "model_b": "4.12%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.7888008952140808]], "model_b": [[45, ",", "normal", 0.7947840094566345]]}, "loss": {"model_a": 4.314700744846142, "model_b": 4.120979486914275}, "topk": {"model_a": [45, 1, 0.7888008952140808, [[45, 0.788801, ",", false], [4596, 0.100737, " in", false], [21265, 0.054736, " and", false], [275, 0.023392, " (", false], [51035, 0.003307, " between", false], [21700, 0.0031, " for", false], [4811, 0.002906, " to", false], [4423, 0.002458, " as", false], [460, 0.001865, "'s", false], [45805, 0.001627, " during", false]]], "model_b": [45, 1, 0.7947840094566345, [[45, 0.794784, ",", false], [21265, 0.074647, " and", false], [4596, 0.048029, " in", false], [275, 0.030108, " (", false], [460, 0.010256, "'s", false], [47, 0.007557, ".", false], [4423, 0.003226, " as", false], [21700, 0.002375, " for", false], [4811, 0.001869, " to", false], [32487, 0.00175, " with", false]]]}, "raw_delta": 0.0107421875, "tuned_delta": 0.06483178491507559}, {"byte_start": 3237, "byte_end": 3240, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 557, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "15.22% 15.22% 15.22%", "model_b": "20.38% 20.38% 20.38%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.08052660524845123]], "model_b": [[4596, " in", "normal", 0.033477943390607834]]}, "loss": {"model_a": 15.215924259375784, "model_b": 20.38182447089225}, "topk": {"model_a": [4596, 3, 0.08052660524845123, [[51035, 0.588954, " between", false], [4811, 0.137252, " to", false], [4596, 0.080527, " in", false], [32227, 0.055003, " that", false], [21700, 0.031132, " for", false], [32487, 0.014863, " with", false], [40186, 0.014385, " which", false], [37694, 0.009269, " among", false], [40185, 0.007082, " where", false], [4706, 0.00515, " of", false]]], "model_b": [4596, 6, 0.033477943390607834, [[51035, 0.578665, " between", false], [4811, 0.078488, " to", false], [32227, 0.058016, " that", false], [32487, 0.049809, " with", false], [21700, 0.047798, " for", false], [4596, 0.033478, " in", false], [40185, 0.028148, " where", false], [50870, 0.016389, " against", false], [40186, 0.016218, " which", false], [21265, 0.011498, " and", false]]]}, "raw_delta": -0.28645833333333326, "tuned_delta": -0.23236873591825769}, {"byte_start": 3240, "byte_end": 3244, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 558, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.98% 11.98% 11.98% 11.98%", "model_b": "10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.06948770582675934]], "model_b": [[22590, " the", "normal", 0.09931225329637527]]}, "loss": {"model_a": 11.97549594487909, "model_b": 10.425725881424148}, "topk": {"model_a": [22590, 3, 0.06948770582675934, [[40186, 0.696188, " which", false], [3492, 0.089394, " 19", false], [22590, 0.069488, " the", false], [53342, 0.007611, " whether", false], [52224, 0.005943, " methods", false], [40085, 0.005289, " using", false], [22638, 0.005097, " two", false], [332, 0.004836, " a", false], [61857, 0.004387, " developing", false], [47350, 0.003569, " speech", false]]], "model_b": [22590, 2, 0.09931225329637527, [[40186, 0.644626, " which", false], [22590, 0.099312, " the", false], [3492, 0.047643, " 19", false], [332, 0.009461, " a", false], [21835, 0.009151, " how", false], [47350, 0.008201, " speech", false], [52167, 0.007823, " machine", false], [40085, 0.006189, " using", false], [51035, 0.004641, " between", false], [53342, 0.004631, " whether", false]]]}, "raw_delta": 0.0859375, "tuned_delta": 0.14002709741507557}, {"byte_start": 3244, "byte_end": 3247, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 559, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"model_a": "6.01% 6.01% 6.01%", "model_b": "7.47% 7.47% 7.47%"}, "model_tokens": {"model_a": [[3492, " 19", "normal", 0.3674902021884918]], "model_b": [[3492, " 19", "normal", 0.28519123792648315]]}, "loss": {"model_a": 6.011229337037347, "model_b": 7.467073942101079}, "topk": {"model_a": [3492, 1, 0.3674902021884918, [[3492, 0.36749, " 19", false], [31255, 0.149987, " late", false], [38328, 0.090776, " early", false], [22089, 0.055917, " mid", false], [22681, 0.03991, " use", false], [63469, 0.016627, " development", false], [30899, 0.011415, " form", false], [38478, 0.007578, " field", false], [4273, 0.007523, " US", false], [45010, 0.00728, " United", false]]], "model_b": [3492, 1, 0.28519123792648315, [[3492, 0.285191, " 19", false], [38328, 0.103618, " early", false], [31255, 0.065783, " late", false], [22681, 0.057978, " use", false], [22089, 0.035934, " mid", false], [63469, 0.032568, " development", false], [40237, 0.016381, " years", false], [30173, 0.013296, " area", false], [45294, 0.010782, " belief", false], [50836, 0.009139, " ability", false]]]}, "raw_delta": -0.08072916666666669, "tuned_delta": -0.026639569251591097}, {"byte_start": 3247, "byte_end": 3249, "display": {"text": "70", "kind": "normal"}, "is_word": true, "word_id": 560, "word_key": "70", "bytes_hex": "37 30", "compression": {"model_a": "8.00% 8.00%", "model_b": "11.91% 11.91%"}, "model_tokens": {"model_a": [[690, "70", "normal", 0.41248324513435364]], "model_b": [[690, "70", "normal", 0.2674158215522766]]}, "loss": {"model_a": 7.995404645551628, "model_b": 11.905051851085684}, "topk": {"model_a": [690, 1, 0.41248324513435364, [[690, 0.412483, "70", false], [680, 0.283178, "60", false], [700, 0.129796, "80", false], [710, 0.115721, "90", false], [670, 0.025593, "50", false], [686, 0.003766, "66", false], [689, 0.00332, "69", false], [711, 0.002239, "91", false], [691, 0.002143, "71", false], [687, 0.001669, "67", false]]], "model_b": [690, 2, 0.2674158215522766, [[700, 0.41359, "80", false], [690, 0.267416, "70", false], [710, 0.196498, "90", false], [680, 0.101693, "60", false], [670, 0.010493, "50", false], [705, 0.000764, "85", false], [660, 0.000585, "40", false], [706, 0.000579, "86", false], [715, 0.000524, "95", false], [709, 0.000433, "89", false]]]}, "raw_delta": -0.216796875, "tuned_delta": -0.16270727758492443}, {"byte_start": 3249, "byte_end": 3250, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 561, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "2.20%", "model_b": "0.88%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.885227620601654]], "model_b": [[116, "s", "normal", 0.9520741105079651]]}, "loss": {"model_a": 2.2013779310439503, "model_b": 0.884953928279668}, "topk": {"model_a": [116, 1, 0.885227620601654, [[116, 0.885228, "s", false], [460, 0.111462, "'s", false], [21265, 0.000614, " and", false], [46, 0.000477, "-", false], [28309, 0.000448, "’s", false], [97, 0.000223, "`", false], [350, 0.000156, " s", false], [40, 0.000148, "'", false], [9835, 0.000127, "′", false], [45, 8.5e-05, ",", false]]], "model_b": [116, 1, 0.9520741105079651, [[116, 0.952074, "s", false], [460, 0.045196, "'s", false], [46, 0.000632, "-", false], [28309, 0.000322, "’s", false], [21265, 0.000176, " and", false], [7789, 0.000131, "ies", false], [40, 0.000128, "'", false], [4811, 8.9e-05, " to", false], [48, 6.8e-05, "/", false], [84, 6.5e-05, "S", false]]]}, "raw_delta": 0.072998046875, "tuned_delta": 0.12708764429007557}, {"byte_start": 3250, "byte_end": 3251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "69.04%", "model_b": "56.36%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.021778911352157593]], "model_b": [[47, ".", "normal", 0.043890297412872314]]}, "loss": {"model_a": 69.03521191753828, "model_b": 56.355275034725125}, "topk": {"model_a": [47, 6, 0.021778911352157593, [[51035, 0.381235, " between", false], [45, 0.207386, ",", false], [21265, 0.173183, " and", false], [4811, 0.095693, " to", false], [32227, 0.040025, " that", false], [47, 0.021779, ".", false], [21700, 0.014593, " for", false], [4596, 0.009535, " in", false], [32487, 0.005555, " with", false], [37694, 0.005413, " among", false]]], "model_b": [47, 5, 0.043890297412872314, [[51035, 0.3112, " between", false], [21265, 0.20798, " and", false], [45, 0.158605, ",", false], [4811, 0.067616, " to", false], [47, 0.04389, ".", false], [32487, 0.03636, " with", false], [32227, 0.035217, " that", false], [21700, 0.023253, " for", false], [46, 0.013059, "-", false], [4450, 0.01029, " by", false]]]}, "raw_delta": 0.703125, "tuned_delta": 0.7572145974150756}, {"byte_start": 3251, "byte_end": 3255, "display": {"text": " Ent", "kind": "normal"}, "is_word": true, "word_id": 562, "word_key": " ent", "bytes_hex": "20 45 6e 74", "compression": {"model_a": "34.80% 34.80% 34.80% 34.80%", "model_b": "32.55% 32.55% 32.55% 32.55%"}, "model_tokens": {"model_a": [[19830, " Ent", "normal", 0.0004425676597747952]], "model_b": [[19830, " Ent", "normal", 0.0007399555179290473]]}, "loss": {"model_a": 34.799382333942766, "model_b": 32.545171332553764}, "topk": {"model_a": [19830, 108, 0.0004425676597747952, [[20996, 0.315605, " The", false], [20556, 0.145259, " One", false], [3918, 0.059293, " It", false], [3913, 0.043634, " In", false], [29894, 0.043511, " This", false], [37451, 0.028093, " There", false], [63222, 0.024791, " Researchers", false], [300, 0.022096, " A", false], [19678, 0.015182, " DAR", false], [29804, 0.015114, " Some", false]]], "model_b": [19830, 118, 0.0007399555179290473, [[20996, 0.210616, " The", false], [29894, 0.059091, " This", false], [3913, 0.058434, " In", false], [300, 0.035779, " A", false], [63222, 0.028162, " Researchers", false], [3918, 0.027416, " It", false], [20556, 0.025185, " One", false], [37451, 0.022364, " There", false], [44900, 0.018136, " Speech", false], [19555, 0.017609, " But", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17908959741507557}, {"byte_start": 3255, "byte_end": 3259, "display": {"text": "rant", "kind": "normal"}, "is_word": true, "word_id": 563, "word_key": "rant", "bytes_hex": "72 61 6e 74", "compression": {"model_a": "3.59% 3.59% 3.59% 3.59%", "model_b": "28.60% 28.60% 28.60% 28.60%"}, "model_tokens": {"model_a": [[26809, "rant", "normal", 0.4516456723213196]], "model_b": [[26809, "rant", "normal", 0.0017240220913663507]]}, "loss": {"model_a": 3.592648783463727, "model_b": 28.600302080123}, "topk": {"model_a": [26809, 2, 0.4516456723213196, [[26892, 0.487275, "ries", false], [26809, 0.451646, "rant", false], [7730, 0.023319, "hus", false], [34889, 0.012949, "ities", false], [7896, 0.010949, "ire", false], [35492, 0.006285, "rance", false], [34895, 0.002035, "itled", false], [25664, 0.000995, "iced", false], [7759, 0.000395, "ice", false], [34612, 0.000364, "icing", false]]], "model_b": [26809, 13, 0.0017240220913663507, [[7730, 0.501604, "hus", false], [7896, 0.39309, "ire", false], [26892, 0.02176, "ries", false], [34889, 0.019603, "ities", false], [8359, 0.01182, "omo", false], [34895, 0.007814, "itled", false], [26942, 0.006833, "ropy", false], [7715, 0.004742, "hou", false], [35492, 0.004399, "rance", false], [26965, 0.004127, "rust", false]]]}, "raw_delta": -1.38671875, "tuned_delta": -1.3326291525849243}, {"byte_start": 3259, "byte_end": 3260, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 564, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.22%", "model_b": "0.57%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9878607392311096]], "model_b": [[116, "s", "normal", 0.9683756232261658]]}, "loss": {"model_a": 0.22013779310439502, "model_b": 0.572358262071427}, "topk": {"model_a": [116, 1, 0.9878607392311096, [[116, 0.987861, "s", false], [300, 0.003177, " A", false], [284, 0.002124, " 1", false], [39904, 0.00073, " teams", false], [4596, 0.000224, " in", false], [37634, 0.000211, " after", false], [270, 0.000208, " #", false], [4811, 0.000182, " to", false], [22748, 0.000169, " was", false], [46685, 0.000155, " number", false]]], "model_b": [116, 1, 0.9683756232261658, [[116, 0.968376, "s", false], [59326, 0.004991, " companies", false], [63843, 0.002195, " researchers", false], [57103, 0.001625, " research", false], [39904, 0.001134, " teams", false], [51566, 0.001047, " efforts", false], [47350, 0.000915, " speech", false], [56949, 0.000821, " programs", false], [64973, 0.000536, " organizations", false], [4596, 0.000516, " in", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03455834741507559}, {"byte_start": 3260, "byte_end": 3269, "display": {"text": " included", "kind": "normal"}, "is_word": true, "word_id": 565, "word_key": " included", "bytes_hex": "20 69 6e 63 6c 75 64 65 64", "compression": {"model_a": "5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60%", "model_b": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%"}, "model_tokens": {"model_a": [[56427, " included", "normal", 0.06150316074490547]], "model_b": [[56427, " included", "normal", 0.02706131897866726]]}, "loss": {"model_a": 5.60421901734211, "model_b": 7.232260296123058}, "topk": {"model_a": [56427, 2, 0.06150316074490547, [[32462, 0.414593, " were", false], [56427, 0.061503, " included", false], [32354, 0.053603, " used", false], [21795, 0.042334, " had", false], [4811, 0.04173, " to", false], [55796, 0.022861, " competed", false], [38128, 0.022067, " could", false], [4596, 0.02121, " in", false], [22762, 0.01614, " who", false], [59506, 0.01222, " developed", false]]], "model_b": [56427, 6, 0.02706131897866726, [[32462, 0.148345, " were", false], [4811, 0.076712, " to", false], [4596, 0.072178, " in", false], [32354, 0.065867, " used", false], [21795, 0.037852, " had", false], [56427, 0.027061, " included", false], [40013, 0.021092, " tried", false], [51196, 0.018047, " claimed", false], [31351, 0.017858, " made", false], [59506, 0.017798, " developed", false]]]}, "raw_delta": -0.09027777777777779, "tuned_delta": -0.0361881803627022}, {"byte_start": 3269, "byte_end": 3271, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 566, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "22.82% 22.82%", "model_b": "22.40% 22.40%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.07904893159866333]], "model_b": [[332, " a", "normal", 0.0847340002655983]]}, "loss": {"model_a": 22.823886389063677, "model_b": 22.40122182630324}, "topk": {"model_a": [332, 3, 0.07904893159866333, [[63843, 0.108868, " researchers", false], [22590, 0.097801, " the", false], [332, 0.079049, " a", false], [30322, 0.052179, " both", false], [22638, 0.027818, " two", false], [32074, 0.023717, " some", false], [31370, 0.023121, " many", false], [46787, 0.0176, " people", false], [46131, 0.015359, " groups", false], [52869, 0.015197, " several", false]]], "model_b": [332, 2, 0.0847340002655983, [[22590, 0.100226, " the", false], [332, 0.084734, " a", false], [63843, 0.038499, " researchers", false], [30322, 0.028365, " both", false], [47350, 0.02767, " speech", false], [20077, 0.024947, " IBM", false], [31370, 0.021039, " many", false], [20354, 0.018723, " MIT", false], [46787, 0.018539, " people", false], [32074, 0.015023, " some", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07752709741507559}, {"byte_start": 3271, "byte_end": 3276, "display": {"text": " host", "kind": "normal"}, "is_word": true, "word_id": 567, "word_key": " host", "bytes_hex": "20 68 6f 73 74", "compression": {"model_a": "27.28% 27.28% 27.28% 27.28% 27.28%", "model_b": "26.60% 26.60% 26.60% 26.60% 26.60%"}, "model_tokens": {"model_a": [[31112, " host", "normal", 0.0005192694952711463]], "model_b": [[31112, " host", "normal", 0.0006211800500750542]]}, "loss": {"model_a": 27.27595311680696, "model_b": 26.599689816390264}, "topk": {"model_a": [31112, 126, 0.0005192694952711463, [[32207, 0.218117, " team", false], [38640, 0.105203, " group", false], [46685, 0.078566, " number", false], [38720, 0.036927, " human", false], [53264, 0.032496, " variety", false], [21674, 0.029699, " few", false], [47350, 0.029298, " speech", false], [47202, 0.024372, " search", false], [38864, 0.022772, " large", false], [57103, 0.020937, " research", false]]], "model_b": [31112, 184, 0.0006211800500750542, [[46685, 0.113236, " number", false], [53264, 0.064902, " variety", false], [38720, 0.047991, " human", false], [47350, 0.037229, " speech", false], [47487, 0.024865, " system", false], [46561, 0.021297, " method", false], [52167, 0.019323, " machine", false], [38640, 0.01851, " group", false], [38864, 0.01722, " large", false], [52580, 0.016365, " program", false]]]}, "raw_delta": 0.03749999999999987, "tuned_delta": 0.09158959741507545}, {"byte_start": 3276, "byte_end": 3279, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 568, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.04% 0.04% 0.04%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9926510453224182]], "model_b": [[4706, " of", "normal", 0.9967646598815918]]}, "loss": {"model_a": 0.044394454942719666, "model_b": 0.019445505057554897}, "topk": {"model_a": [4706, 1, 0.9926510453224182, [[4706, 0.992651, " of", false], [22762, 0.00065, " who", false], [45, 0.000576, ",", false], [37747, 0.000511, " array", false], [32227, 0.000392, " that", false], [1851, 0.000307, "el", false], [46, 0.000304, "-", false], [275, 0.000231, " (", false], [32207, 0.000214, " team", false], [21265, 0.0002, " and", false]]], "model_b": [4706, 1, 0.9967646598815918, [[4706, 0.996765, " of", false], [46, 0.000298, "-", false], [332, 0.000268, " a", false], [45, 0.000142, ",", false], [46685, 0.000138, " number", false], [11, 0.000116, "\n", false], [7512, 0.000115, "ess", false], [275, 0.000113, " (", false], [32227, 0.000107, " that", false], [55809, 9.9e-05, " computer", false]]]}, "raw_delta": 0.0013834635416666667, "tuned_delta": 0.05547306095674225}, {"byte_start": 3279, "byte_end": 3287, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 569, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"model_a": "14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30%", "model_b": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93% 14.93% 14.93%"}, "model_tokens": {"model_a": [[52964, " special", "normal", 0.0017601862782612443]], "model_b": [[52964, " special", "normal", 0.0013258279068395495]]}, "loss": {"model_a": 14.3001510400615, "model_b": 14.934147884202158}, "topk": {"model_a": [52964, 73, 0.0017601862782612443, [[63843, 0.188318, " researchers", false], [38720, 0.075254, " human", false], [57103, 0.050293, " research", false], [46787, 0.025338, " people", false], [52224, 0.022181, " methods", false], [3609, 0.020609, " AI", false], [39904, 0.020084, " teams", false], [59513, 0.019582, " different", false], [55809, 0.018218, " computer", false], [46131, 0.017402, " groups", false]]], "model_b": [52964, 105, 0.0013258279068395495, [[63843, 0.098232, " researchers", false], [38720, 0.063244, " human", false], [59513, 0.040278, " different", false], [32458, 0.02582, " well", false], [3609, 0.025278, " AI", false], [57103, 0.02428, " research", false], [46787, 0.02329, " people", false], [61590, 0.019391, " approaches", false], [52224, 0.0188, " methods", false], [60274, 0.018737, " promising", false]]]}, "raw_delta": -0.03515625, "tuned_delta": 0.018933347415075588}, {"byte_start": 3287, "byte_end": 3295, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 570, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80%", "model_b": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.04879653826355934]], "model_b": [[52224, " methods", "normal", 0.055639758706092834]]}, "loss": {"model_a": 6.797855051063719, "model_b": 6.516078675890093}, "topk": {"model_a": [52224, 3, 0.04879653826355934, [[46, 0.652387, "-", false], [52610, 0.07975, " purpose", false], [52224, 0.048797, " methods", false], [62633, 0.021554, " techniques", false], [61590, 0.016459, " approaches", false], [53087, 0.008744, " systems", false], [25971, 0.007197, "ists", false], [38720, 0.006938, " human", false], [27161, 0.006379, "ties", false], [25940, 0.006283, "ised", false]]], "model_b": [52224, 2, 0.055639758706092834, [[46, 0.443921, "-", false], [52224, 0.05564, " methods", false], [57103, 0.048099, " research", false], [62633, 0.038511, " techniques", false], [57257, 0.019616, " software", false], [38720, 0.018514, " human", false], [63843, 0.016163, " researchers", false], [61590, 0.014965, " approaches", false], [52610, 0.014134, " purpose", false], [51565, 0.014117, " effects", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 3295, "byte_end": 3300, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 571, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "7.13% 7.13% 7.13% 7.13% 7.13%", "model_b": "5.18% 5.18% 5.18% 5.18% 5.18%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.13948602974414825]], "model_b": [[32227, " that", "normal", 0.2355164736509323]]}, "loss": {"model_a": 7.128942291892729, "model_b": 5.184685303194711}, "topk": {"model_a": [32227, 2, 0.13948602974414825, [[45, 0.234957, ",", false], [32227, 0.139486, " that", false], [37810, 0.132836, " based", false], [21700, 0.111832, " for", false], [55966, 0.03012, " designed", false], [21265, 0.029156, " and", false], [38888, 0.025359, " lever", false], [47, 0.02045, ".", false], [4811, 0.017289, " to", false], [32139, 0.017098, " such", false]]], "model_b": [32227, 1, 0.2355164736509323, [[32227, 0.235516, " that", false], [45, 0.224244, ",", false], [21700, 0.114787, " for", false], [37810, 0.065998, " based", false], [275, 0.053573, " (", false], [21265, 0.039624, " and", false], [32139, 0.020234, " such", false], [47, 0.014373, ".", false], [59841, 0.013078, " including", false], [55966, 0.01233, " designed", false]]]}, "raw_delta": 0.10781250000000005, "tuned_delta": 0.16190209741507564}, {"byte_start": 3300, "byte_end": 3305, "display": {"text": " took", "kind": "normal"}, "is_word": true, "word_id": 572, "word_key": " took", "bytes_hex": "20 74 6f 6f 6b", "compression": {"model_a": "8.12% 8.12% 8.12% 8.12% 8.12%", "model_b": "12.00% 12.00% 12.00% 12.00% 12.00%"}, "model_tokens": {"model_a": [[32272, " took", "normal", 0.1053810864686966]], "model_b": [[32272, " took", "normal", 0.035712677985429764]]}, "loss": {"model_a": 8.115159605000418, "model_b": 12.003673582396452}, "topk": {"model_a": [32272, 3, 0.1053810864686966, [[32462, 0.119223, " were", false], [56540, 0.116081, " leverage", false], [32272, 0.105381, " took", false], [59685, 0.070902, " exploited", false], [31351, 0.050261, " made", false], [32354, 0.046111, " used", false], [40013, 0.040103, " tried", false], [57510, 0.031828, " utilized", false], [21795, 0.026877, " had", false], [47054, 0.021588, " relied", false]]], "model_b": [32272, 6, 0.035712677985429764, [[32462, 0.168255, " were", false], [56540, 0.138939, " leverage", false], [32354, 0.068645, " used", false], [47054, 0.038766, " relied", false], [31351, 0.036145, " made", false], [32272, 0.035713, " took", false], [59685, 0.034678, " exploited", false], [21795, 0.026963, " had", false], [57510, 0.025662, " utilized", false], [21532, 0.024549, " did", false]]]}, "raw_delta": -0.215625, "tuned_delta": -0.16153540258492444}, {"byte_start": 3305, "byte_end": 3315, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 573, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"model_a": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "model_b": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"model_a": [[59093, " advantage", "normal", 0.9194269776344299]], "model_b": [[59093, " advantage", "normal", 0.7971101403236389]]}, "loss": {"model_a": 0.15145480165582373, "model_b": 0.41562015338109776}, "topk": {"model_a": [59093, 1, 0.9194269776344299, [[59093, 0.919427, " advantage", false], [38720, 0.022346, " human", false], [30923, 0.00885, " full", false], [31162, 0.005785, " into", false], [61544, 0.004482, " advantages", false], [332, 0.002767, " a", false], [22590, 0.002495, " the", false], [38629, 0.002271, " great", false], [56540, 0.001736, " leverage", false], [50845, 0.001522, " account", false]]], "model_b": [59093, 1, 0.7971101403236389, [[59093, 0.79711, " advantage", false], [30923, 0.024409, " full", false], [332, 0.015111, " a", false], [52195, 0.011364, " massive", false], [22590, 0.00994, " the", false], [63649, 0.007378, " inspiration", false], [38720, 0.006661, " human", false], [31162, 0.006457, " into", false], [4712, 0.003476, " on", false], [4423, 0.003407, " as", false]]]}, "raw_delta": -0.014648437500000003, "tuned_delta": 0.03944115991507559}, {"byte_start": 3315, "byte_end": 3318, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 574, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.03% 0.03% 0.03%", "model_b": "0.05% 0.05% 0.05%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.995306670665741]], "model_b": [[4706, " of", "normal", 0.9922602772712708]]}, "loss": {"model_a": 0.028434464942651023, "model_b": 0.046595832873763614}, "topk": {"model_a": [4706, 1, 0.995306670665741, [[4706, 0.995307, " of", false], [45, 0.000963, ",", false], [4596, 0.000722, " in", false], [38720, 0.000713, " human", false], [45833, 0.000277, " either", false], [275, 0.000191, " (", false], [22590, 0.00014, " the", false], [22187, 0.000134, " not", false], [4715, 0.000111, " or", false], [53265, 9.7e-05, " various", false]]], "model_b": [4706, 1, 0.9922602772712708, [[4706, 0.99226, " of", false], [45, 0.001005, ",", false], [22187, 0.000651, " not", false], [22590, 0.000441, " the", false], [30322, 0.000418, " both", false], [45833, 0.000383, " either", false], [275, 0.000309, " (", false], [56003, 0.00029, " directly", false], [11, 0.000204, "\n", false], [332, 0.000198, " a", false]]]}, "raw_delta": -0.0010070800781250002, "tuned_delta": 0.05308251733695059}, {"byte_start": 3318, "byte_end": 3324, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 575, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "3.83% 3.83% 3.83% 3.83% 3.83% 3.83%", "model_b": "4.44% 4.44% 4.44% 4.44% 4.44% 4.44%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.2783218324184418]], "model_b": [[38720, " human", "normal", 0.23036672174930573]]}, "loss": {"model_a": 3.8274624294417485, "model_b": 4.437977908984604}, "topk": {"model_a": [38720, 1, 0.2783218324184418, [[38720, 0.278322, " human", false], [22590, 0.270218, " the", false], [59943, 0.056224, " knowledge", false], [62182, 0.035436, " linguistic", false], [45775, 0.015658, " domain", false], [332, 0.014945, " a", false], [52964, 0.013684, " special", false], [56215, 0.013602, " features", false], [62293, 0.010376, " particular", false], [53265, 0.009834, " various", false]]], "model_b": [38720, 1, 0.23036672174930573, [[38720, 0.230367, " human", false], [22590, 0.182838, " the", false], [52195, 0.024145, " massive", false], [47350, 0.022492, " speech", false], [52964, 0.02017, " special", false], [332, 0.02003, " a", false], [30597, 0.018796, " deep", false], [52167, 0.015644, " machine", false], [38864, 0.013886, " large", false], [62182, 0.009304, " linguistic", false]]]}, "raw_delta": -0.03385416666666666, "tuned_delta": 0.02023543074840893}, {"byte_start": 3324, "byte_end": 3334, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 576, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82%", "model_b": "1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.6355510950088501]], "model_b": [[59943, " knowledge", "normal", 0.4036145508289337]]}, "loss": {"model_a": 0.824195897382855, "model_b": 1.627258566627688}, "topk": {"model_a": [59943, 1, 0.6355510950088501, [[59943, 0.635551, " knowledge", false], [65034, 0.179749, " understanding", false], [62182, 0.046399, " linguistic", false], [46, 0.022666, "-", false], [38786, 0.016538, " input", false], [59683, 0.016386, " expertise", false], [56529, 0.011517, " language", false], [47350, 0.01107, " speech", false], [59917, 0.003494, " intuition", false], [63637, 0.002681, " information", false]]], "model_b": [59943, 1, 0.4036145508289337, [[59943, 0.403615, " knowledge", false], [65034, 0.092764, " understanding", false], [47350, 0.088315, " speech", false], [46, 0.082239, "-", false], [38786, 0.055486, " input", false], [56529, 0.035012, " language", false], [62182, 0.018001, " linguistic", false], [56537, 0.011822, " learning", false], [59683, 0.011316, " expertise", false], [46543, 0.00566, " memory", false]]]}, "raw_delta": -0.044531250000000015, "tuned_delta": 0.009558347415075573}, {"byte_start": 3334, "byte_end": 3337, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"model_a": "48.84% 48.84% 48.84%", "model_b": "50.72% 50.72% 50.72%"}, "model_tokens": {"model_a": [[5346, "---", "normal", 0.00029503233963623643]], "model_b": [[5346, "---", "normal", 0.00021370417380239815]]}, "loss": {"model_a": 48.841238363428445, "model_b": 50.719747531252615}, "topk": {"model_a": [5346, 42, 0.00029503233963623643, [[4706, 0.257508, " of", false], [45, 0.25072, ",", false], [47, 0.111356, ".", false], [37598, 0.100703, " about", false], [21265, 0.08588, " and", false], [275, 0.05165, " (", false], [4596, 0.037083, " in", false], [59, 0.019559, ":", false], [4811, 0.014264, " to", false], [32139, 0.008908, " such", false]]], "model_b": [5346, 58, 0.00021370417380239815, [[4706, 0.240509, " of", false], [45, 0.231625, ",", false], [47, 0.110663, ".", false], [37598, 0.082443, " about", false], [275, 0.068471, " (", false], [21265, 0.059972, " and", false], [4596, 0.044222, " in", false], [4811, 0.034828, " to", false], [4715, 0.017336, " or", false], [59, 0.011824, ":", false]]]}, "raw_delta": -0.10416666666666652, "tuned_delta": -0.05007706925159093}, {"byte_start": 3337, "byte_end": 3346, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 577, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%", "model_b": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.0337136946618557]], "model_b": [[58313, "knowledge", "normal", 0.0027521008159965277]]}, "loss": {"model_a": 6.793941490297418, "model_b": 11.834607757292277}, "topk": {"model_a": [58313, 5, 0.0337136946618557, [[35381, 0.06631, "phone", false], [7579, 0.05077, "for", false], [27095, 0.046591, "such", false], [58282, 0.035448, "including", false], [58313, 0.033714, "knowledge", false], [8801, 0.026144, "the", false], [1950, 0.025295, "in", false], [2090, 0.021315, "of", false], [6907, 0.015876, "aco", false], [98, 0.015545, "a", false]]], "model_b": [58313, 64, 0.0027521008159965277, [[8801, 0.058501, "the", false], [7579, 0.046537, "for", false], [1950, 0.034562, "in", false], [98, 0.027765, "a", false], [7005, 0.026606, "and", false], [27095, 0.020699, "such", false], [58282, 0.01898, "including", false], [27142, 0.017465, "that", false], [8260, 0.017157, "not", false], [7195, 0.01586, "but", false]]]}, "raw_delta": -0.2795138888888889, "tuned_delta": -0.22542429147381332}, {"byte_start": 3346, "byte_end": 3349, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 578, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.50% 1.50% 1.50%", "model_b": "7.70% 7.70% 7.70%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.7771164774894714]], "model_b": [[4706, " of", "normal", 0.27606573700904846]]}, "loss": {"model_a": 1.5028073342593367, "model_b": 7.7018875880791}, "topk": {"model_a": [4706, 1, 0.7771164774894714, [[4706, 0.777116, " of", false], [37598, 0.087997, " about", false], [32227, 0.053327, " that", false], [46, 0.007534, "-", false], [32139, 0.005432, " such", false], [37810, 0.005192, " based", false], [4596, 0.003923, " in", false], [22187, 0.003118, " not", false], [55442, 0.002865, " acquired", false], [30917, 0.002861, " from", false]]], "model_b": [4706, 1, 0.27606573700904846, [[4706, 0.276066, " of", false], [37598, 0.27008, " about", false], [32227, 0.186733, " that", false], [4596, 0.030895, " in", false], [4712, 0.019445, " on", false], [45, 0.009376, ",", false], [37810, 0.008859, " based", false], [30917, 0.008826, " from", false], [46, 0.008006, "-", false], [32139, 0.007894, " such", false]]]}, "raw_delta": -0.34375, "tuned_delta": -0.2896604025849244}, {"byte_start": 3349, "byte_end": 3355, "display": {"text": " words", "kind": "normal"}, "is_word": true, "word_id": 579, "word_key": " words", "bytes_hex": "20 77 6f 72 64 73", "compression": {"model_a": "11.74% 11.74% 11.74% 11.74% 11.74% 11.74%", "model_b": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99%"}, "model_tokens": {"model_a": [[40210, " words", "normal", 0.020194733515381813]], "model_b": [[40210, " words", "normal", 0.025606537237763405]]}, "loss": {"model_a": 11.740682298901067, "model_b": 10.9892786317714}, "topk": {"model_a": [40210, 10, 0.020194733515381813, [[22590, 0.253503, " the", false], [39273, 0.138416, " phone", false], [56529, 0.059451, " language", false], [47350, 0.056894, " speech", false], [55440, 0.043914, " acoustic", false], [21835, 0.037936, " how", false], [62182, 0.035757, " linguistic", false], [51860, 0.034834, " grammar", false], [59946, 0.026252, " languages", false], [40210, 0.020195, " words", false]]], "model_b": [40210, 6, 0.025606537237763405, [[22590, 0.261001, " the", false], [21835, 0.139231, " how", false], [39273, 0.066871, " phone", false], [47350, 0.047419, " speech", false], [32464, 0.027075, " what", false], [40210, 0.025607, " words", false], [56529, 0.024848, " language", false], [32497, 0.019637, " word", false], [50199, 0.018396, " English", false], [38720, 0.016389, " human", false]]]}, "raw_delta": 0.04166666666666663, "tuned_delta": 0.09575626408174222}, {"byte_start": 3355, "byte_end": 3356, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "6.06%", "model_b": "9.79%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.715740442276001]], "model_b": [[45, ",", "normal", 0.5828771591186523]]}, "loss": {"model_a": 6.058192066232952, "model_b": 9.79172903728349}, "topk": {"model_a": [45, 1, 0.715740442276001, [[45, 0.71574, ",", false], [21265, 0.188574, " and", false], [4596, 0.02537, " in", false], [275, 0.016159, " (", false], [32227, 0.009013, " that", false], [4715, 0.008957, " or", false], [5346, 0.004707, "---", false], [4423, 0.003686, " as", false], [40, 0.002234, "'", false], [30917, 0.001721, " from", false]]], "model_b": [45, 1, 0.5828771591186523, [[45, 0.582877, ",", false], [21265, 0.225873, " and", false], [4596, 0.033945, " in", false], [4715, 0.027299, " or", false], [275, 0.016747, " (", false], [32227, 0.014686, " that", false], [4423, 0.011387, " as", false], [30917, 0.00528, " from", false], [47, 0.004621, ".", false], [4811, 0.003507, " to", false]]]}, "raw_delta": -0.20703125, "tuned_delta": -0.15294165258492443}, {"byte_start": 3356, "byte_end": 3359, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 580, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "10.38% 10.38% 10.38%", "model_b": "17.94% 17.94% 17.94%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.17572148144245148]], "model_b": [[4706, " of", "normal", 0.050897203385829926]]}, "loss": {"model_a": 10.378763152228546, "model_b": 17.939762552720833}, "topk": {"model_a": [4706, 2, 0.17572148144245148, [[59943, 0.400852, " knowledge", false], [4706, 0.175721, " of", false], [51860, 0.054776, " grammar", false], [39273, 0.037322, " phone", false], [21265, 0.017596, " and", false], [64996, 0.014313, " pronunciation", false], [56529, 0.013782, " language", false], [47486, 0.013023, " syntax", false], [32497, 0.012532, " word", false], [47341, 0.012097, " sounds", false]]], "model_b": [4706, 5, 0.050897203385829926, [[51860, 0.091062, " grammar", false], [39273, 0.072042, " phone", false], [52464, 0.068061, " phrases", false], [64996, 0.053209, " pronunciation", false], [4706, 0.050897, " of", false], [47486, 0.040359, " syntax", false], [40210, 0.029404, " words", false], [59943, 0.027735, " knowledge", false], [47350, 0.025564, " speech", false], [39931, 0.021979, " their", false]]]}, "raw_delta": -0.41927083333333326, "tuned_delta": -0.3651812359182577}, {"byte_start": 3359, "byte_end": 3365, "display": {"text": " phone", "kind": "normal"}, "is_word": true, "word_id": 581, "word_key": " phone", "bytes_hex": "20 70 68 6f 6e 65", "compression": {"model_a": "7.28% 7.28% 7.28% 7.28% 7.28% 7.28%", "model_b": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"model_a": [[39273, " phone", "normal", 0.08897095918655396]], "model_b": [[39273, " phone", "normal", 0.09497666358947754]]}, "loss": {"model_a": 7.279223025318662, "model_b": 7.0913721085362456}, "topk": {"model_a": [39273, 2, 0.08897095918655396, [[51860, 0.168416, " grammar", false], [39273, 0.088971, " phone", false], [22590, 0.080181, " the", false], [56529, 0.053506, " language", false], [47350, 0.039147, " speech", false], [47486, 0.032729, " syntax", false], [64996, 0.025667, " pronunciation", false], [55440, 0.025221, " acoustic", false], [60476, 0.02402, " sentences", false], [51310, 0.023265, " context", false]]], "model_b": [39273, 1, 0.09497666358947754, [[39273, 0.094977, " phone", false], [22590, 0.079305, " the", false], [51860, 0.06286, " grammar", false], [21835, 0.051815, " how", false], [47350, 0.049031, " speech", false], [64996, 0.046487, " pronunciation", false], [39931, 0.025336, " their", false], [47486, 0.025328, " syntax", false], [56529, 0.018075, " language", false], [31670, 0.017822, " phon", false]]]}, "raw_delta": 0.01041666666666663, "tuned_delta": 0.06450626408174222}, {"byte_start": 3365, "byte_end": 3368, "display": {"text": "mes", "kind": "normal"}, "is_word": true, "word_id": 582, "word_key": "mes", "bytes_hex": "6d 65 73", "compression": {"model_a": "2.64% 2.64% 2.64%", "model_b": "3.55% 3.55% 3.55%"}, "model_tokens": {"model_a": [[8164, "mes", "normal", 0.6444879770278931]], "model_b": [[8164, "mes", "normal", 0.5542075634002686]]}, "loss": {"model_a": 2.6416535172527404, "model_b": 3.5456860542681228}, "topk": {"model_a": [8164, 1, 0.6444879770278931, [[8164, 0.644488, "mes", false], [8807, 0.159458, "tic", false], [27159, 0.157394, "tics", false], [2038, 0.027418, "me", false], [8169, 0.006148, "mic", false], [35770, 0.001472, "tical", false], [31989, 0.000246, " sets", false], [46, 0.000217, "-", false], [60483, 0.000117, " sequences", false], [53083, 0.00011, " symbols", false]]], "model_b": [8164, 1, 0.5542075634002686, [[8164, 0.554208, "mes", false], [27159, 0.1936, "tics", false], [8807, 0.118074, "tic", false], [2038, 0.107848, "me", false], [8169, 0.011126, "mic", false], [52333, 0.002313, " numbers", false], [35770, 0.002224, "tical", false], [46, 0.000864, "-", false], [56832, 0.00057, " patterns", false], [40050, 0.000541, " types", false]]]}, "raw_delta": -0.05013020833333334, "tuned_delta": 0.003959389081742246}, {"byte_start": 3368, "byte_end": 3369, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.48%", "model_b": "3.54%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8706715703010559]], "model_b": [[45, ",", "normal", 0.8224924802780151]]}, "loss": {"model_a": 2.483154306217576, "model_b": 3.539815713118672}, "topk": {"model_a": [45, 1, 0.8706715703010559, [[45, 0.870672, ",", false], [21265, 0.052177, " and", false], [275, 0.033585, " (", false], [4596, 0.012094, " in", false], [4715, 0.007122, " or", false], [5346, 0.005051, "---", false], [47, 0.003442, ".", false], [4706, 0.00294, " of", false], [4423, 0.001587, " as", false], [47806, 0.001463, " within", false]]], "model_b": [45, 1, 0.8224924802780151, [[45, 0.822492, ",", false], [21265, 0.080392, " and", false], [275, 0.032952, " (", false], [4715, 0.014513, " or", false], [4596, 0.011592, " in", false], [5346, 0.009886, "---", false], [47, 0.004767, ".", false], [4706, 0.003239, " of", false], [21643, 0.00182, " etc", false], [48, 0.001745, "/", false]]]}, "raw_delta": -0.05859375, "tuned_delta": -0.004504152584924412}, {"byte_start": 3369, "byte_end": 3372, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 583, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.53% 1.53% 1.53%", "model_b": "2.40% 2.40% 2.40%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.7766412496566772]], "model_b": [[4706, " of", "normal", 0.6710361838340759]]}, "loss": {"model_a": 1.526288698857139, "model_b": 2.3950991889758177}, "topk": {"model_a": [4706, 1, 0.7766412496566772, [[4706, 0.776641, " of", false], [21265, 0.138856, " and", false], [21643, 0.022741, " etc", false], [4715, 0.010595, " or", false], [59943, 0.005057, " knowledge", false], [30788, 0.00494, " even", false], [22590, 0.002472, " the", false], [39273, 0.002387, " phone", false], [55440, 0.001789, " acoustic", false], [51860, 0.001327, " grammar", false]]], "model_b": [4706, 1, 0.6710361838340759, [[4706, 0.671036, " of", false], [21265, 0.143216, " and", false], [21643, 0.059485, " etc", false], [4715, 0.037658, " or", false], [31768, 0.004698, " pros", false], [31162, 0.004665, " into", false], [39273, 0.003883, " phone", false], [22590, 0.003579, " the", false], [30788, 0.003231, " even", false], [32497, 0.002872, " word", false]]]}, "raw_delta": -0.048177083333333336, "tuned_delta": 0.0059125140817422525}, {"byte_start": 3372, "byte_end": 3376, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 584, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.64% 10.64% 10.64% 10.64%", "model_b": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09426004439592361]], "model_b": [[22590, " the", "normal", 0.07578276842832565]]}, "loss": {"model_a": 10.637058162804367, "model_b": 11.623275475912058}, "topk": {"model_a": [22590, 2, 0.09426004439592361, [[51860, 0.129075, " grammar", false], [22590, 0.09426, " the", false], [55440, 0.064723, " acoustic", false], [56529, 0.041231, " language", false], [51310, 0.039466, " context", false], [62182, 0.038495, " linguistic", false], [39273, 0.035438, " phone", false], [47350, 0.027224, " speech", false], [64996, 0.026239, " pronunciation", false], [47486, 0.020857, " syntax", false]]], "model_b": [22590, 1, 0.07578276842832565, [[22590, 0.075783, " the", false], [31768, 0.051418, " pros", false], [39273, 0.046542, " phone", false], [51860, 0.045761, " grammar", false], [47350, 0.04559, " speech", false], [32497, 0.040197, " word", false], [64996, 0.034782, " pronunciation", false], [47486, 0.030995, " syntax", false], [56529, 0.027846, " language", false], [21835, 0.024345, " how", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 3376, "byte_end": 3382, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 585, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.005730811506509781]], "model_b": [[38720, " human", "normal", 0.01362643949687481]]}, "loss": {"model_a": 15.49770063454941, "model_b": 12.96171325798678}, "topk": {"model_a": [38720, 31, 0.005730811506509781, [[60572, 0.113852, " structure", false], [55440, 0.079798, " acoustic", false], [51860, 0.059951, " grammar", false], [39273, 0.027495, " phone", false], [22752, 0.026084, " way", false], [39747, 0.023744, " sound", false], [56529, 0.022356, " language", false], [47341, 0.021375, " sounds", false], [51310, 0.020774, " context", false], [47350, 0.01737, " speech", false]]], "model_b": [38720, 17, 0.01362643949687481, [[31768, 0.094887, " pros", false], [60572, 0.078331, " structure", false], [39273, 0.035889, " phone", false], [51860, 0.028476, " grammar", false], [31670, 0.02377, " phon", false], [51310, 0.023641, " context", false], [55440, 0.022095, " acoustic", false], [39558, 0.020655, " rules", false], [47341, 0.019361, " sounds", false], [64996, 0.018247, " pronunciation", false]]]}, "raw_delta": 0.140625, "tuned_delta": 0.19471459741507557}, {"byte_start": 3382, "byte_end": 3388, "display": {"text": " vocal", "kind": "normal"}, "is_word": true, "word_id": 586, "word_key": " vocal", "bytes_hex": "20 76 6f 63 61 6c", "compression": {"model_a": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "model_b": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"model_a": [[40136, " vocal", "normal", 0.07571001350879669]], "model_b": [[40136, " vocal", "normal", 0.01580442301928997]]}, "loss": {"model_a": 7.748850317274705, "model_b": 12.492085966030738}, "topk": {"model_a": [40136, 2, 0.07571001350879669, [[40139, 0.438532, " voice", false], [40136, 0.07571, " vocal", false], [47350, 0.064505, " speech", false], [56529, 0.045972, " language", false], [21590, 0.035777, " ear", false], [52963, 0.032602, " speaker", false], [55579, 0.029032, " auditory", false], [50905, 0.023315, " anatomy", false], [39070, 0.019673, " mouth", false], [37898, 0.016469, " brain", false]]], "model_b": [40136, 11, 0.01580442301928997, [[40139, 0.313743, " voice", false], [52963, 0.073862, " speaker", false], [21590, 0.067246, " ear", false], [56529, 0.066009, " language", false], [31427, 0.032605, " mind", false], [30305, 0.027915, " body", false], [37898, 0.025389, " brain", false], [47577, 0.023401, " tongue", false], [46, 0.022691, "-", false], [47350, 0.020376, " speech", false]]]}, "raw_delta": -0.2630208333333334, "tuned_delta": -0.20893123591825785}, {"byte_start": 3388, "byte_end": 3394, "display": {"text": " tract", "kind": "normal"}, "is_word": true, "word_id": 587, "word_key": " tract", "bytes_hex": "20 74 72 61 63 74", "compression": {"model_a": "0.93% 0.93% 0.93% 0.93% 0.93% 0.93%", "model_b": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"model_a": [[39996, " tract", "normal", 0.7332308888435364]], "model_b": [[39996, " tract", "normal", 0.633985698223114]]}, "loss": {"model_a": 0.9275139016131844, "model_b": 1.3677894878219745}, "topk": {"model_a": [39996, 1, 0.7332308888435364, [[39996, 0.733231, " tract", false], [59153, 0.116333, " apparatus", false], [47487, 0.052536, " system", false], [50905, 0.030457, " anatomy", false], [38115, 0.009745, " cords", false], [38024, 0.00734, " chord", false], [59994, 0.005682, " mechanism", false], [46719, 0.005405, " organs", false], [46, 0.003949, "-", false], [62382, 0.003221, " production", false]]], "model_b": [39996, 1, 0.633985698223114, [[39996, 0.633986, " tract", false], [50905, 0.075687, " anatomy", false], [47487, 0.057809, " system", false], [59153, 0.040349, " apparatus", false], [59994, 0.025103, " mechanism", false], [39438, 0.021739, " range", false], [49344, 0.008682, "ization", false], [46, 0.005294, "-", false], [51706, 0.003789, " faculty", false], [54114, 0.003641, "izations", false]]]}, "raw_delta": -0.024414062500000003, "tuned_delta": 0.029675534915075585}, {"byte_start": 3394, "byte_end": 3395, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "10.00%", "model_b": "10.78%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5722053050994873]], "model_b": [[45, ",", "normal", 0.5521984696388245]]}, "loss": {"model_a": 10.00306131866371, "model_b": 10.777946350391181}, "topk": {"model_a": [45, 1, 0.5722053050994873, [[45, 0.572205, ",", false], [47, 0.161537, ".", false], [5346, 0.128898, "---", false], [21265, 0.084454, " and", false], [275, 0.007558, " (", false], [568, 0.005787, "--", false], [60, 0.003431, ";", false], [21643, 0.002768, " etc", false], [50905, 0.002691, " anatomy", false], [116, 0.002302, "s", false]]], "model_b": [45, 1, 0.5521984696388245, [[45, 0.552198, ",", false], [47, 0.176571, ".", false], [5346, 0.126866, "---", false], [21265, 0.048886, " and", false], [275, 0.019035, " (", false], [460, 0.007379, "'s", false], [60572, 0.006079, " structure", false], [4423, 0.005736, " as", false], [21643, 0.004983, " etc", false], [568, 0.004207, "--", false]]]}, "raw_delta": -0.04296875, "tuned_delta": 0.011120847415075588}, {"byte_start": 3395, "byte_end": 3399, "display": {"text": " etc", "kind": "normal"}, "is_word": true, "word_id": 588, "word_key": " etc", "bytes_hex": "20 65 74 63", "compression": {"model_a": "10.36% 10.36% 10.36% 10.36%", "model_b": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"model_a": [[21643, " etc", "normal", 0.1010892316699028]], "model_b": [[21643, " etc", "normal", 0.15003611147403717]]}, "loss": {"model_a": 10.355281787630743, "model_b": 8.594179442795582}, "topk": {"model_a": [21643, 3, 0.1010892316699028, [[4706, 0.496547, " of", false], [21265, 0.323512, " and", false], [21643, 0.101089, " etc", false], [59943, 0.014964, " knowledge", false], [4715, 0.008195, " or", false], [22590, 0.006899, " the", false], [30788, 0.005034, " even", false], [55440, 0.002536, " acoustic", false], [4522, 0.001973, " et", false], [21256, 0.001644, " all", false]]], "model_b": [21643, 3, 0.15003611147403717, [[4706, 0.483461, " of", false], [21265, 0.216552, " and", false], [21643, 0.150036, " etc", false], [4715, 0.0259, " or", false], [22590, 0.01541, " the", false], [30788, 0.009006, " even", false], [21700, 0.007779, " for", false], [21400, 0.005596, " but", false], [59943, 0.003964, " knowledge", false], [4522, 0.003899, " et", false]]]}, "raw_delta": 0.09765625, "tuned_delta": 0.15174584741507557}, {"byte_start": 3399, "byte_end": 3400, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "4.47%", "model_b": "2.84%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7803417444229126]], "model_b": [[47, ".", "normal", 0.8546682596206665]]}, "loss": {"model_a": 4.473199955881307, "model_b": 2.835374775184608}, "topk": {"model_a": [47, 1, 0.7803417444229126, [[47, 0.780342, ".", false], [5361, 0.09236, ".--", false], [583, 0.048006, ".,", false], [5346, 0.047938, "---", false], [45, 0.005661, ",", false], [584, 0.005269, ".-", false], [568, 0.00297, "--", false], [23326, 0.002968, ".—", false], [25358, 0.002714, "eter", false], [585, 0.002696, "..", false]]], "model_b": [47, 1, 0.8546682596206665, [[47, 0.854668, ".", false], [5361, 0.058676, ".--", false], [583, 0.031134, ".,", false], [5346, 0.018914, "---", false], [45, 0.008065, ",", false], [568, 0.005049, "--", false], [585, 0.002693, "..", false], [584, 0.002321, ".-", false], [19310, 0.002009, " ---", false], [23323, 0.001692, "....", false]]]}, "raw_delta": 0.0908203125, "tuned_delta": 0.14490990991507557}, {"byte_start": 3400, "byte_end": 3403, "display": {"text": " On", "kind": "normal"}, "is_word": true, "word_id": 589, "word_key": " on", "bytes_hex": "20 4f 6e", "compression": {"model_a": "40.58% 40.58% 40.58%", "model_b": "39.07% 39.07% 39.07%"}, "model_tokens": {"model_a": [[4095, " On", "normal", 0.00117211090400815]], "model_b": [[4095, " On", "normal", 0.001505706924945116]]}, "loss": {"model_a": 40.57579802500209, "model_b": 39.07299069074275}, "topk": {"model_a": [4095, 80, 0.00117211090400815, [[20996, 0.155459, " The", false], [37453, 0.116238, " These", false], [19555, 0.06252, " But", false], [3913, 0.039468, " In", false], [29894, 0.031814, " This", false], [29804, 0.030002, " Some", false], [19407, 0.029717, " All", false], [37451, 0.026174, " There", false], [20556, 0.024466, " One", false], [29344, 0.021451, " Many", false]]], "model_b": [4095, 74, 0.001505706924945116, [[20996, 0.126201, " The", false], [19555, 0.100272, " But", false], [37453, 0.087399, " These", false], [3913, 0.04871, " In", false], [29894, 0.041004, " This", false], [37451, 0.022973, " There", false], [19407, 0.020885, " All", false], [20556, 0.017046, " One", false], [3918, 0.016936, " It", false], [275, 0.016777, " (", false]]]}, "raw_delta": 0.08333333333333348, "tuned_delta": 0.13742293074840906}, {"byte_start": 3403, "byte_end": 3407, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 590, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.87% 2.87% 2.87% 2.87%", "model_b": "2.17% 2.17% 2.17% 2.17%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.5254470109939575]], "model_b": [[22590, " the", "normal", 0.6135150790214539]]}, "loss": {"model_a": 2.8705968220813114, "model_b": 2.174961395871423}, "topk": {"model_a": [22590, 1, 0.5254470109939575, [[22590, 0.525447, " the", false], [332, 0.072098, " a", false], [32234, 0.050453, " this", false], [50987, 0.044821, " average", false], [22615, 0.042635, " top", false], [22226, 0.03378, " one", false], [30719, 0.014834, " each", false], [39931, 0.012789, " their", false], [32227, 0.012635, " that", false], [34514, 0.012627, "going", false]]], "model_b": [22590, 1, 0.6135150790214539, [[22590, 0.613515, " the", false], [332, 0.064957, " a", false], [39227, 0.035367, " paper", false], [22226, 0.019418, " one", false], [22615, 0.01902, " top", false], [21902, 0.018876, " its", false], [32234, 0.015073, " this", false], [50987, 0.013909, " average", false], [32074, 0.013251, " some", false], [39931, 0.010348, " their", false]]]}, "raw_delta": 0.03857421875, "tuned_delta": 0.09266381616507559}, {"byte_start": 3407, "byte_end": 3413, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 591, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"model_a": "2.29% 2.29% 2.29% 2.29% 2.29% 2.29%", "model_b": "2.08% 2.08% 2.08% 2.08% 2.08% 2.08%"}, "model_tokens": {"model_a": [[39193, " other", "normal", 0.470399409532547]], "model_b": [[39193, " other", "normal", 0.5004579424858093]]}, "loss": {"model_a": 2.289433048285708, "model_b": 2.078100766905489}, "topk": {"model_a": [39193, 1, 0.470399409532547, [[39193, 0.470399, " other", false], [40190, 0.138401, " whole", false], [37815, 0.064786, " basis", false], [22226, 0.032974, " one", false], [30807, 0.018048, " face", false], [53064, 0.016245, " surface", false], [38499, 0.011105, " first", false], [19678, 0.007489, " DAR", false], [21509, 0.005219, " day", false], [30218, 0.005181, " back", false]]], "model_b": [39193, 1, 0.5004579424858093, [[39193, 0.500458, " other", false], [37815, 0.081935, " basis", false], [53064, 0.071662, " surface", false], [22226, 0.038991, " one", false], [40190, 0.030635, " whole", false], [30807, 0.016466, " face", false], [55855, 0.011328, " contrary", false], [38499, 0.006439, " first", false], [38720, 0.005718, " human", false], [31515, 0.005127, " next", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06580834741507559}, {"byte_start": 3413, "byte_end": 3418, "display": {"text": " side", "kind": "normal"}, "is_word": true, "word_id": 592, "word_key": " side", "bytes_hex": "20 73 69 64 65", "compression": {"model_a": "2.78% 2.78% 2.78% 2.78% 2.78%", "model_b": "7.61% 7.61% 7.61% 7.61% 7.61%"}, "model_tokens": {"model_a": [[32011, " side", "normal", 0.4629760682582855]], "model_b": [[32011, " side", "normal", 0.12040365487337112]]}, "loss": {"model_a": 2.7754972954602124, "model_b": 7.607962129687892}, "topk": {"model_a": [32011, 2, 0.4629760682582855, [[31044, 0.514676, " hand", false], [32011, 0.462976, " side", false], [21616, 0.014103, " end", false], [45, 0.001928, ",", false], [32207, 0.000888, " team", false], [51699, 0.000887, " extreme", false], [32462, 0.000323, " were", false], [38559, 0.000305, " front", false], [22748, 0.000162, " was", false], [25548, 0.000155, "hand", false]]], "model_b": [32011, 2, 0.12040365487337112, [[31044, 0.825368, " hand", false], [32011, 0.120404, " side", false], [21616, 0.042194, " end", false], [51699, 0.003427, " extreme", false], [38660, 0.001377, " hands", false], [45, 0.000913, ",", false], [57274, 0.000333, " spectrum", false], [21795, 0.000312, " had", false], [30729, 0.000271, " edge", false], [55532, 0.000262, " approach", false]]]}, "raw_delta": -0.26796875, "tuned_delta": -0.2138791525849244}, {"byte_start": 3418, "byte_end": 3423, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 593, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "4.03% 4.03% 4.03% 4.03% 4.03%", "model_b": "5.78% 5.78% 5.78% 5.78% 5.78%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.31780949234962463]], "model_b": [[32462, " were", "normal", 0.20073066651821136]]}, "loss": {"model_a": 4.029402164982847, "model_b": 5.776415691059325}, "topk": {"model_a": [32462, 1, 0.31780949234962463, [[32462, 0.317809, " were", false], [45, 0.316057, ",", false], [22748, 0.181299, " was", false], [4706, 0.149667, " of", false], [39934, 0.017661, " there", false], [39826, 0.005139, " stood", false], [22590, 0.001342, " the", false], [275, 0.001303, " (", false], [4858, 0.001141, " we", false], [5346, 0.000915, "---", false]]], "model_b": [32462, 2, 0.20073066651821136, [[4706, 0.535615, " of", false], [32462, 0.200731, " were", false], [45, 0.141315, ",", false], [22748, 0.094355, " was", false], [39934, 0.008075, " there", false], [39826, 0.004372, " stood", false], [22590, 0.001672, " the", false], [4858, 0.001172, " we", false], [55526, 0.000754, " appeared", false], [275, 0.000715, " (", false]]]}, "raw_delta": -0.09687499999999999, "tuned_delta": -0.0427854025849244}, {"byte_start": 3423, "byte_end": 3429, "display": {"text": " newer", "kind": "normal"}, "is_word": true, "word_id": 594, "word_key": " newer", "bytes_hex": "20 6e 65 77 65 72", "compression": {"model_a": "26.30% 26.30% 26.30% 26.30% 26.30% 26.30%", "model_b": "25.74% 25.74% 25.74% 25.74% 25.74% 25.74%"}, "model_tokens": {"model_a": [[39116, " newer", "normal", 0.00016174896154552698]], "model_b": [[39116, " newer", "normal", 0.00019147903367411345]]}, "loss": {"model_a": 26.299128349538393, "model_b": 25.73557559919114}, "topk": {"model_a": [39116, 270, 0.00016174896154552698, [[52224, 0.239662, " methods", false], [22590, 0.121987, " the", false], [63843, 0.11326, " researchers", false], [332, 0.042692, " a", false], [61590, 0.022408, " approaches", false], [39944, 0.019127, " those", false], [39904, 0.018869, " teams", false], [51566, 0.01637, " efforts", false], [62633, 0.016064, " techniques", false], [53087, 0.014074, " systems", false]]], "model_b": [39116, 352, 0.00019147903367411345, [[52224, 0.156762, " methods", false], [22590, 0.067576, " the", false], [332, 0.056346, " a", false], [51832, 0.054622, " general", false], [31370, 0.029493, " many", false], [61590, 0.028995, " approaches", false], [63843, 0.016833, " researchers", false], [47202, 0.016601, " search", false], [22638, 0.016214, " two", false], [31458, 0.012718, " more", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08533959741507559}, {"byte_start": 3429, "byte_end": 3437, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 595, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "model_b": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.5125495791435242]], "model_b": [[52224, " methods", "normal", 0.5422415733337402]]}, "loss": {"model_a": 1.514548016558238, "model_b": 1.373659828971425}, "topk": {"model_a": [52224, 1, 0.5125495791435242, [[52224, 0.51255, " methods", false], [45, 0.124348, ",", false], [61590, 0.109964, " approaches", false], [62633, 0.056274, " techniques", false], [38378, 0.041541, " entra", false], [21265, 0.024336, " and", false], [63843, 0.012209, " researchers", false], [57103, 0.009618, " research", false], [4404, 0.00684, " ``", false], [51566, 0.005897, " efforts", false]]], "model_b": [52224, 1, 0.5422415733337402, [[52224, 0.542242, " methods", false], [61590, 0.125874, " approaches", false], [45, 0.084401, ",", false], [21265, 0.039065, " and", false], [51832, 0.037902, " general", false], [62633, 0.033068, " techniques", false], [61559, 0.007324, " algorithms", false], [57103, 0.006276, " research", false], [53087, 0.005361, " systems", false], [38378, 0.004843, " entra", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06190209741507559}, {"byte_start": 3437, "byte_end": 3442, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 596, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "2.93% 2.93% 2.93% 2.93% 2.93%", "model_b": "1.45% 1.45% 1.45% 1.45% 1.45%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.4417383074760437]], "model_b": [[32227, " that", "normal", 0.6665999889373779]]}, "loss": {"model_a": 2.930474301805707, "model_b": 1.451148332144172}, "topk": {"model_a": [32227, 1, 0.4417383074760437, [[32227, 0.441738, " that", false], [37810, 0.227342, " based", false], [45, 0.107697, ",", false], [4706, 0.039301, " of", false], [5346, 0.019834, "---", false], [40085, 0.017174, " using", false], [32139, 0.011853, " such", false], [21700, 0.011562, " for", false], [275, 0.009923, " (", false], [31296, 0.006963, " like", false]]], "model_b": [32227, 1, 0.6665999889373779, [[32227, 0.6666, " that", false], [37810, 0.103047, " based", false], [45, 0.069208, ",", false], [5346, 0.01243, "---", false], [40186, 0.011847, " which", false], [4706, 0.011824, " of", false], [40085, 0.009252, " using", false], [275, 0.009182, " (", false], [38888, 0.008914, " lever", false], [32487, 0.006785, " with", false]]]}, "raw_delta": 0.08203125, "tuned_delta": 0.13612084741507557}, {"byte_start": 3442, "byte_end": 3447, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 597, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"model_a": "8.28% 8.28% 8.28% 8.28% 8.28%", "model_b": "9.41% 9.41% 9.41% 9.41% 9.41%"}, "model_tokens": {"model_a": [[32462, " were", "normal", 0.10054638981819153]], "model_b": [[32462, " were", "normal", 0.07283622026443481]]}, "loss": {"model_a": 8.284225430104593, "model_b": 9.411330930799096}, "topk": {"model_a": [32462, 3, 0.10054638981819153, [[32354, 0.152801, " used", false], [32272, 0.116563, " took", false], [32462, 0.100546, " were", false], [21532, 0.055004, " did", false], [56540, 0.046257, " leverage", false], [31351, 0.038582, " made", false], [57510, 0.036171, " utilized", false], [47054, 0.034577, " relied", false], [21795, 0.019937, " had", false], [50937, 0.01773, " applied", false]]], "model_b": [32462, 4, 0.07283622026443481, [[56540, 0.242768, " leverage", false], [32272, 0.185704, " took", false], [32354, 0.089097, " used", false], [32462, 0.072836, " were", false], [57510, 0.035139, " utilized", false], [47054, 0.03357, " relied", false], [59685, 0.031037, " exploited", false], [21532, 0.020129, " did", false], [31351, 0.016628, " made", false], [38128, 0.01276, " could", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.008410402584924412}, {"byte_start": 3447, "byte_end": 3452, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 598, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "10.43% 10.43% 10.43% 10.43% 10.43%", "model_b": "10.93% 10.93% 10.93% 10.93% 10.93%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.05520031973719597]], "model_b": [[31458, " more", "normal", 0.048501159995794296]]}, "loss": {"model_a": 10.425725881424148, "model_b": 10.932923356736675}, "topk": {"model_a": [31458, 2, 0.05520031973719597, [[37810, 0.26754, " based", false], [31458, 0.0552, " more", false], [22187, 0.055078, " not", false], [31466, 0.020558, " much", false], [63541, 0.020256, " essentially", false], [46957, 0.017689, " purely", false], [47202, 0.013153, " search", false], [31277, 0.011647, " less", false], [47285, 0.010488, " simply", false], [31198, 0.009328, " just", false]]], "model_b": [31458, 2, 0.048501159995794296, [[37810, 0.323314, " based", false], [31458, 0.048501, " more", false], [22187, 0.032772, " not", false], [31277, 0.019341, " less", false], [31466, 0.01617, " much", false], [51832, 0.015168, " general", false], [46083, 0.014954, " geared", false], [63541, 0.014361, " essentially", false], [52094, 0.01217, " largely", false], [53180, 0.011121, " trained", false]]]}, "raw_delta": -0.028124999999999956, "tuned_delta": 0.025964597415075633}, {"byte_start": 3452, "byte_end": 3464, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 599, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"model_a": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "model_b": "10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94% 10.94%"}, "model_tokens": {"model_a": [[63885, " statistical", "normal", 0.004327341448515654]], "model_b": [[63885, " statistical", "normal", 0.0006863577291369438]]}, "loss": {"model_a": 8.171514880035144, "model_b": 10.942315902575794}, "topk": {"model_a": [63885, 34, 0.004327341448515654, [[51832, 0.309702, " general", false], [31296, 0.098105, " like", false], [30579, 0.026066, " data", false], [59758, 0.025707, " generally", false], [59593, 0.024248, " effective", false], [4715, 0.020687, " or", false], [64862, 0.018046, " computational", false], [4596, 0.015982, " in", false], [52906, 0.014617, " similar", false], [37810, 0.014523, " based", false]]], "model_b": [63885, 112, 0.0006863577291369438, [[51832, 0.345844, " general", false], [59593, 0.086187, " effective", false], [31296, 0.041248, " like", false], [64862, 0.03242, " computational", false], [56900, 0.0232, " powerful", false], [59594, 0.015708, " efficient", false], [30579, 0.015003, " data", false], [65014, 0.014716, " sophisticated", false], [63594, 0.01466, " generalized", false], [4404, 0.010506, " ``", false]]]}, "raw_delta": -0.1536458333333334, "tuned_delta": -0.09955623591825781}, {"byte_start": 3464, "byte_end": 3467, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 600, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "7.51% 7.51% 7.51%", "model_b": "10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.28507310152053833]], "model_b": [[4596, " in", "normal", 0.1634882092475891]]}, "loss": {"model_a": 7.514036671296684, "model_b": 10.848390444184586}, "topk": {"model_a": [4596, 2, 0.28507310152053833, [[45, 0.334784, ",", false], [4596, 0.285073, " in", false], [21265, 0.188728, " and", false], [47, 0.067821, ".", false], [5346, 0.03041, "---", false], [275, 0.024674, " (", false], [4715, 0.013308, " or", false], [32226, 0.008372, " than", false], [21400, 0.006468, " but", false], [59, 0.00586, ":", false]]], "model_b": [4596, 3, 0.1634882092475891, [[45, 0.330661, ",", false], [21265, 0.198319, " and", false], [4596, 0.163488, " in", false], [5346, 0.067936, "---", false], [47, 0.067906, ".", false], [275, 0.040216, " (", false], [59, 0.016909, ":", false], [4715, 0.016058, " or", false], [46, 0.014868, "-", false], [32226, 0.014474, " than", false]]]}, "raw_delta": -0.18489583333333334, "tuned_delta": -0.13080623591825774}, {"byte_start": 3467, "byte_end": 3474, "display": {"text": " nature", "kind": "normal"}, "is_word": true, "word_id": 601, "word_key": " nature", "bytes_hex": "20 6e 61 74 75 72 65", "compression": {"model_a": "0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78%", "model_b": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"model_a": [[46642, " nature", "normal", 0.7380651235580444]], "model_b": [[46642, " nature", "normal", 0.6401297450065613]]}, "loss": {"model_a": 0.7799167527127138, "model_b": 1.1422006636502329}, "topk": {"model_a": [46642, 1, 0.7380651235580444, [[46642, 0.738065, " nature", false], [55532, 0.066161, " approach", false], [59284, 0.065103, " character", false], [39931, 0.040284, " their", false], [46004, 0.027238, " flavor", false], [47362, 0.013647, " spirit", false], [22590, 0.012682, " the", false], [63735, 0.005605, " orientation", false], [32227, 0.0027, " that", false], [30899, 0.002066, " form", false]]], "model_b": [46642, 1, 0.6401297450065613, [[46642, 0.64013, " nature", false], [39931, 0.124695, " their", false], [59284, 0.056782, " character", false], [55532, 0.045545, " approach", false], [47362, 0.019634, " spirit", false], [22590, 0.015036, " the", false], [63735, 0.009623, " orientation", false], [32227, 0.009476, " that", false], [45717, 0.00762, " design", false], [46723, 0.004841, " origin", false]]]}, "raw_delta": -0.020089285714285723, "tuned_delta": 0.03400031170078986}, {"byte_start": 3474, "byte_end": 3478, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 602, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "6.97% 6.97% 6.97% 6.97%", "model_b": "8.49% 8.49% 8.49% 8.49%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.21052032709121704]], "model_b": [[21265, " and", "normal", 0.1532915085554123]]}, "loss": {"model_a": 6.9739652855472345, "model_b": 8.488513302105472}, "topk": {"model_a": [21265, 2, 0.21052032709121704, [[45, 0.456307, ",", false], [21265, 0.21052, " and", false], [47, 0.20057, ".", false], [5346, 0.048755, "---", false], [275, 0.039368, " (", false], [21400, 0.013839, " but", false], [59, 0.010156, ":", false], [60, 0.006548, ";", false], [4715, 0.001868, " or", false], [32227, 0.001345, " that", false]]], "model_b": [21265, 3, 0.1532915085554123, [[45, 0.43571, ",", false], [47, 0.172826, ".", false], [21265, 0.153292, " and", false], [5346, 0.123379, "---", false], [275, 0.041105, " (", false], [21400, 0.02491, " but", false], [59, 0.014398, ":", false], [60, 0.006037, ";", false], [568, 0.003095, "--", false], [19310, 0.00301, " ---", false]]]}, "raw_delta": -0.083984375, "tuned_delta": -0.029894777584924412}, {"byte_start": 3478, "byte_end": 3482, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 603, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"model_a": "11.91% 11.91% 11.91% 11.91%", "model_b": "16.34% 16.34% 16.34% 16.34%"}, "model_tokens": {"model_a": [[21532, " did", "normal", 0.07148892432451248]], "model_b": [[21532, " did", "normal", 0.026745272800326347]]}, "loss": {"model_a": 11.905051851085684, "model_b": 16.343029760070287}, "topk": {"model_a": [21532, 2, 0.07148892432451248, [[32227, 0.161816, " that", false], [21532, 0.071489, " did", false], [32354, 0.067243, " used", false], [37810, 0.054365, " based", false], [32462, 0.050358, " were", false], [31458, 0.047804, " more", false], [31277, 0.02681, " less", false], [21795, 0.024628, " had", false], [31351, 0.023634, " made", false], [47054, 0.022225, " relied", false]]], "model_b": [21532, 11, 0.026745272800326347, [[32462, 0.088614, " were", false], [32227, 0.077926, " that", false], [32354, 0.058563, " used", false], [47054, 0.051332, " relied", false], [31458, 0.044029, " more", false], [56540, 0.03619, " leverage", false], [32272, 0.035076, " took", false], [37810, 0.032181, " based", false], [45, 0.028844, ",", false], [40186, 0.028734, " which", false]]]}, "raw_delta": -0.24609375, "tuned_delta": -0.19200415258492443}, {"byte_start": 3482, "byte_end": 3487, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 604, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "22.32% 22.32% 22.32% 22.32% 22.32%", "model_b": "15.22% 15.22% 15.22% 15.22% 15.22%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.002074274467304349]], "model_b": [[31466, " much", "normal", 0.014698252081871033]]}, "loss": {"model_a": 22.31668891375115, "model_b": 15.215924259375784}, "topk": {"model_a": [31466, 4, 0.002074274467304349, [[22187, 0.971966, " not", false], [30211, 0.004615, " away", false], [4692, 0.00315, " no", false], [31466, 0.002074, " much", false], [31277, 0.001834, " less", false], [46454, 0.001438, " little", false], [31458, 0.0013, " more", false], [332, 0.001027, " a", false], [45301, 0.000947, " better", false], [31856, 0.000638, " rely", false]]], "model_b": [31466, 3, 0.014698252081871033, [[22187, 0.855129, " not", false], [45301, 0.02019, " better", false], [31466, 0.014698, " much", false], [332, 0.010246, " a", false], [30211, 0.008508, " away", false], [22590, 0.006436, " the", false], [32458, 0.006197, " well", false], [31277, 0.006173, " less", false], [46454, 0.005336, " little", false], [21660, 0.004987, " far", false]]]}, "raw_delta": 0.39375000000000004, "tuned_delta": 0.4478395974150756}, {"byte_start": 3487, "byte_end": 3492, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 605, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "9.19% 9.19% 9.19% 9.19% 9.19%", "model_b": "10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.07819143682718277]], "model_b": [[31458, " more", "normal", 0.05937027186155319]]}, "loss": {"model_a": 9.185909830660195, "model_b": 10.200304781285249}, "topk": {"model_a": [31458, 3, 0.07819143682718277, [[45301, 0.566712, " better", false], [31277, 0.246108, " less", false], [31458, 0.078191, " more", false], [4706, 0.027247, " of", false], [32487, 0.017617, " with", false], [22590, 0.015422, " the", false], [4811, 0.010659, " to", false], [45, 0.004582, ",", false], [4715, 0.003168, " or", false], [38475, 0.002385, " fewer", false]]], "model_b": [31458, 4, 0.05937027186155319, [[45301, 0.645097, " better", false], [31277, 0.190808, " less", false], [4706, 0.084448, " of", false], [31458, 0.05937, " more", false], [22590, 0.003261, " the", false], [45, 0.002562, ",", false], [40216, 0.002015, " worse", false], [4811, 0.001901, " to", false], [38475, 0.000964, " fewer", false], [51867, 0.000813, " greater", false]]]}, "raw_delta": -0.05625000000000002, "tuned_delta": -0.002160402584924434}, {"byte_start": 3492, "byte_end": 3504, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 606, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%", "model_b": "4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.0981467068195343]], "model_b": [[63370, " computation", "normal", 0.03985937312245369]]}, "loss": {"model_a": 3.4987233250725183, "model_b": 4.83716110714724}, "topk": {"model_a": [63370, 2, 0.0981467068195343, [[32487, 0.277294, " with", false], [63370, 0.098147, " computation", false], [4811, 0.049486, " to", false], [51832, 0.041776, " general", false], [4706, 0.032036, " of", false], [32499, 0.024771, " work", false], [56537, 0.024551, " learning", false], [52195, 0.01695, " massive", false], [47202, 0.015255, " search", false], [63507, 0.01412, " effectively", false]]], "model_b": [63370, 8, 0.03985937312245369, [[32487, 0.124183, " with", false], [4706, 0.122927, " of", false], [4811, 0.106583, " to", false], [32499, 0.0656, " work", false], [32226, 0.062819, " than", false], [59346, 0.052495, " computing", false], [4450, 0.041925, " by", false], [63370, 0.039859, " computation", false], [51832, 0.022192, " general", false], [47, 0.019537, ".", false]]]}, "raw_delta": -0.07421875000000001, "tuned_delta": -0.020129152584924426}, {"byte_start": 3504, "byte_end": 3505, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "32.97%", "model_b": "36.35%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1606893539428711]], "model_b": [[45, ",", "normal", 0.13408640027046204]]}, "loss": {"model_a": 32.9678358953142, "model_b": 36.34915239739771}, "topk": {"model_a": [45, 2, 0.1606893539428711, [[47, 0.49463, ".", false], [45, 0.160689, ",", false], [5346, 0.049153, "---", false], [275, 0.044913, " (", false], [4596, 0.033058, " in", false], [4811, 0.028661, " to", false], [4712, 0.021897, " on", false], [22278, 0.020443, " per", false], [21265, 0.017576, " and", false], [32226, 0.017341, " than", false]]], "model_b": [45, 2, 0.13408640027046204, [[47, 0.408728, ".", false], [45, 0.134086, ",", false], [32226, 0.076712, " than", false], [5346, 0.069406, "---", false], [4596, 0.052163, " in", false], [4811, 0.030961, " to", false], [275, 0.028969, " (", false], [32487, 0.018865, " with", false], [4712, 0.016911, " on", false], [22278, 0.016186, " per", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13341040258492443}, {"byte_start": 3505, "byte_end": 3511, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 607, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "model_b": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.013464839197695255]], "model_b": [[37810, " based", "normal", 0.006241780240088701]]}, "loss": {"model_a": 12.96171325798678, "model_b": 15.309849717766994}, "topk": {"model_a": [37810, 13, 0.013464839197695255, [[21400, 0.256003, " but", false], [21265, 0.090732, " and", false], [59841, 0.056641, " including", false], [40085, 0.034153, " using", false], [4596, 0.02781, " in", false], [40186, 0.022788, " which", false], [32487, 0.018737, " with", false], [61953, 0.01661, " especially", false], [30322, 0.016132, " both", false], [55495, 0.01419, " although", false]]], "model_b": [37810, 21, 0.006241780240088701, [[21400, 0.301673, " but", false], [21265, 0.152444, " and", false], [59841, 0.066172, " including", false], [40085, 0.032044, " using", false], [40186, 0.023483, " which", false], [32139, 0.022302, " such", false], [4596, 0.021315, " in", false], [32487, 0.014481, " with", false], [30788, 0.013376, " even", false], [4788, 0.013014, " so", false]]]}, "raw_delta": -0.13020833333333337, "tuned_delta": -0.07611873591825778}, {"byte_start": 3511, "byte_end": 3514, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 608, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.57% 0.57% 0.57%", "model_b": "1.06% 1.06% 1.06%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9089198112487793]], "model_b": [[4712, " on", "normal", 0.8374754190444946]]}, "loss": {"model_a": 0.572358262071427, "model_b": 1.0625317480505467}, "topk": {"model_a": [4712, 1, 0.9089198112487793, [[4712, 0.90892, " on", false], [4596, 0.01225, " in", false], [32350, 0.011141, " upon", false], [52094, 0.008452, " largely", false], [46495, 0.007784, " mainly", false], [60247, 0.005817, " primarily", false], [45, 0.005664, ",", false], [46602, 0.005173, " mostly", false], [31581, 0.003709, " only", false], [31458, 0.003253, " more", false]]], "model_b": [4712, 1, 0.8374754190444946, [[4712, 0.837475, " on", false], [4596, 0.044892, " in", false], [52094, 0.019958, " largely", false], [32350, 0.019937, " upon", false], [60247, 0.008077, " primarily", false], [46602, 0.007643, " mostly", false], [46495, 0.006668, " mainly", false], [45, 0.004113, ",", false], [56131, 0.00403, " entirely", false], [31458, 0.002984, " more", false]]]}, "raw_delta": -0.027180989583333332, "tuned_delta": 0.026908607831742256}, {"byte_start": 3514, "byte_end": 3521, "display": {"text": " hidden", "kind": "normal"}, "is_word": true, "word_id": 609, "word_key": " hidden", "bytes_hex": "20 68 69 64 64 65 6e", "compression": {"model_a": "9.62% 9.62% 9.62% 9.62% 9.62% 9.62% 9.62%", "model_b": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"model_a": [[46196, " hidden", "normal", 0.023908214643597603]], "model_b": [[46196, " hidden", "normal", 0.002613342134281993]]}, "loss": {"model_a": 9.62065052378522, "model_b": 15.296431795139677}, "topk": {"model_a": [46196, 6, 0.023908214643597603, [[22590, 0.178736, " the", false], [56537, 0.070708, " learning", false], [332, 0.058205, " a", false], [52195, 0.051162, " massive", false], [38864, 0.043341, " large", false], [46196, 0.023908, " hidden", false], [63885, 0.023092, " statistical", false], [62633, 0.017139, " techniques", false], [52224, 0.01643, " methods", false], [57453, 0.013904, " training", false]]], "model_b": [46196, 55, 0.002613342134281993, [[22590, 0.1355, " the", false], [56537, 0.05133, " learning", false], [30597, 0.050769, " deep", false], [332, 0.048987, " a", false], [51832, 0.037935, " general", false], [52167, 0.035141, " machine", false], [52195, 0.017824, " massive", false], [62633, 0.017685, " techniques", false], [61559, 0.014066, " algorithms", false], [52112, 0.013604, " learned", false]]]}, "raw_delta": -0.3147321428571428, "tuned_delta": -0.2606425454420672}, {"byte_start": 3521, "byte_end": 3528, "display": {"text": " Markov", "kind": "normal"}, "is_word": true, "word_id": 610, "word_key": " markov", "bytes_hex": "20 4d 61 72 6b 6f 76", "compression": {"model_a": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "model_b": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%"}, "model_tokens": {"model_a": [[44557, " Markov", "normal", 0.959473192691803]], "model_b": [[44557, " Markov", "normal", 0.9234638214111328]]}, "loss": {"model_a": 0.10692407093642042, "model_b": 0.20630056039497588}, "topk": {"model_a": [44557, 1, 0.959473192691803, [[44557, 0.959473, " Markov", false], [46, 0.018457, "-", false], [31376, 0.008027, " mark", false], [60725, 0.002314, " variables", false], [40069, 0.001311, " units", false], [47398, 0.000993, " states", false], [57518, 0.000764, " variable", false], [39802, 0.000665, " state", false], [46587, 0.000534, " models", false], [275, 0.000464, " (", false]]], "model_b": [44557, 1, 0.9234638214111328, [[44557, 0.923464, " Markov", false], [46, 0.051448, "-", false], [31376, 0.003706, " mark", false], [30899, 0.002326, " form", false], [40069, 0.002143, " units", false], [57518, 0.001314, " variable", false], [38541, 0.000935, " forms", false], [60725, 0.00086, " variables", false], [47398, 0.000758, " states", false], [39802, 0.000732, " state", false]]]}, "raw_delta": -0.005510602678571429, "tuned_delta": 0.04857899473650416}, {"byte_start": 3528, "byte_end": 3535, "display": {"text": " models", "kind": "normal"}, "is_word": true, "word_id": 611, "word_key": " models", "bytes_hex": "20 6d 6f 64 65 6c 73", "compression": {"model_a": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "model_b": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"model_a": [[46587, " models", "normal", 0.9444479942321777]], "model_b": [[46587, " models", "normal", 0.9676041007041931]]}, "loss": {"model_a": 0.147177838818367, "model_b": 0.08491029162598092}, "topk": {"model_a": [46587, 1, 0.9444479942321777, [[46587, 0.944448, " models", false], [39043, 0.015857, " model", false], [56658, 0.00883, " modeling", false], [46, 0.007083, "-", false], [45447, 0.003356, " chains", false], [21265, 0.003224, " and", false], [4715, 0.002533, " or", false], [44592, 0.00183, " Models", false], [60261, 0.001642, " processes", false], [275, 0.00117, " (", false]]], "model_b": [46587, 1, 0.9676041007041931, [[46587, 0.967604, " models", false], [56658, 0.007357, " modeling", false], [39043, 0.004017, " model", false], [60261, 0.00364, " processes", false], [45447, 0.002253, " chains", false], [21265, 0.001887, " and", false], [56567, 0.001058, " machines", false], [4715, 0.000854, " or", false], [44592, 0.000806, " Models", false], [56705, 0.000755, " networks", false]]]}, "raw_delta": 0.003452845982142857, "tuned_delta": 0.057542443397218444}, {"byte_start": 3535, "byte_end": 3537, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"model_a": "17.19% 17.19%", "model_b": "22.82% 22.82%"}, "model_tokens": {"model_a": [[275, " (", "normal", 0.1487080305814743]], "model_b": [[275, " (", "normal", 0.08120135217905045]]}, "loss": {"model_a": 17.188358885591164, "model_b": 22.823886389063677}, "topk": {"model_a": [275, 4, 0.1487080305814743, [[47, 0.283415, ".", false], [21265, 0.247813, " and", false], [45, 0.190994, ",", false], [275, 0.148708, " (", false], [4715, 0.039965, " or", false], [4706, 0.01696, " of", false], [32227, 0.013779, " that", false], [5346, 0.012509, "---", false], [32487, 0.007722, " with", false], [21700, 0.006554, " for", false]]], "model_b": [275, 4, 0.08120135217905045, [[45, 0.331823, ",", false], [21265, 0.276453, " and", false], [47, 0.181593, ".", false], [275, 0.081201, " (", false], [4715, 0.063514, " or", false], [5346, 0.016749, "---", false], [4706, 0.010074, " of", false], [21700, 0.007105, " for", false], [32227, 0.005222, " that", false], [4423, 0.002757, " as", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.2584104025849244}, {"byte_start": 3537, "byte_end": 3539, "display": {"text": "HM", "kind": "normal"}, "is_word": true, "word_id": 612, "word_key": "hm", "bytes_hex": "48 4d", "compression": {"model_a": "2.69% 2.69%", "model_b": "6.52% 6.52%"}, "model_tokens": {"model_a": [[1082, "HM", "normal", 0.743228554725647]], "model_b": [[1082, "HM", "normal", 0.48420006036758423]]}, "loss": {"model_a": 2.6944865875977952, "model_b": 6.516078675890093}, "topk": {"model_a": [1082, 1, 0.743228554725647, [[1082, 0.743229, "HM", false], [36003, 0.023631, "which", false], [98, 0.02212, "a", false], [7005, 0.018637, "and", false], [1926, 0.014106, "hm", false], [2101, 0.01403, "or", false], [8695, 0.011904, "see", false], [8801, 0.009683, "the", false], [27142, 0.006171, "that", false], [58443, 0.005013, "statistic", false]]], "model_b": [1082, 1, 0.48420006036758423, [[1082, 0.4842, "HM", false], [36003, 0.065857, "which", false], [2101, 0.031039, "or", false], [7005, 0.023722, "and", false], [7579, 0.021346, "for", false], [8801, 0.019847, "the", false], [1751, 0.014549, "as", false], [1950, 0.014258, "in", false], [8695, 0.013607, "see", false], [98, 0.013534, "a", false]]]}, "raw_delta": -0.2119140625, "tuned_delta": -0.15782446508492443}, {"byte_start": 3539, "byte_end": 3541, "display": {"text": "Ms", "kind": "normal"}, "is_word": true, "word_id": 613, "word_key": "ms", "bytes_hex": "4d 73", "compression": {"model_a": "0.94% 0.94%", "model_b": "2.10% 2.10%"}, "model_tokens": {"model_a": [[1261, "Ms", "normal", 0.9010351896286011]], "model_b": [[1261, "Ms", "normal", 0.7922157049179077]]}, "loss": {"model_a": 0.9421897544868107, "model_b": 2.0957117903538407}, "topk": {"model_a": [1261, 1, 0.9010351896286011, [[1261, 0.901035, "Ms", false], [78, 0.097309, "M", false], [1243, 0.000807, "MS", false], [1140, 0.000182, "Is", false], [116, 0.000118, "s", false], [77, 3.3e-05, "L", false], [1236, 2.4e-05, "ML", false], [1237, 2.4e-05, "MM", false], [84, 2.2e-05, "S", false], [1242, 1.8e-05, "MR", false]]], "model_b": [1261, 1, 0.7922157049179077, [[1261, 0.792216, "Ms", false], [78, 0.206315, "M", false], [116, 0.000437, "s", false], [42, 0.000137, ")", false], [497, 0.000111, "),", false], [1243, 0.000105, "MS", false], [499, 7.2e-05, ").", false], [1236, 5.9e-05, "ML", false], [46587, 5e-05, " models", false], [68, 4.5e-05, "C", false]]]}, "raw_delta": -0.06396484375, "tuned_delta": -0.009875246334924412}, {"byte_start": 3541, "byte_end": 3543, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"model_a": "7.22% 7.22%", "model_b": "11.13% 11.13%"}, "model_tokens": {"model_a": [[499, ").", "normal", 0.44534578919410706]], "model_b": [[499, ").", "normal", 0.2916545569896698]]}, "loss": {"model_a": 7.220519613824157, "model_b": 11.130166819358212}, "topk": {"model_a": [499, 1, 0.44534578919410706, [[499, 0.445346, ").", false], [42, 0.328558, ")", false], [497, 0.201617, "),", false], [5308, 0.008746, ")--", false], [45, 0.005604, ",", false], [502, 0.002893, ");", false], [60, 0.001664, ";", false], [5346, 0.0007, "---", false], [21700, 0.000687, " for", false], [501, 0.000635, "):", false]]], "model_b": [499, 2, 0.2916545569896698, [[42, 0.415553, ")", false], [499, 0.291655, ").", false], [497, 0.252517, "),", false], [45, 0.014629, ",", false], [5308, 0.010481, ")--", false], [502, 0.003148, ");", false], [60, 0.001874, ";", false], [5346, 0.001574, "---", false], [21700, 0.001374, " for", false], [4715, 0.001194, " or", false]]]}, "raw_delta": -0.216796875, "tuned_delta": -0.16270727758492443}, {"byte_start": 3543, "byte_end": 3549, "display": {"text": " Again", "kind": "normal"}, "is_word": true, "word_id": 614, "word_key": " again", "bytes_hex": "20 41 67 61 69 6e", "compression": {"model_a": "16.81% 16.81% 16.81% 16.81% 16.81% 16.81%", "model_b": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22%"}, "model_tokens": {"model_a": [[36251, " Again", "normal", 0.003723106812685728]], "model_b": [[36251, " Again", "normal", 0.006411013193428516]]}, "loss": {"model_a": 16.812657052026328, "model_b": 15.215924259375784}, "topk": {"model_a": [36251, 32, 0.003723106812685728, [[20996, 0.324433, " The", false], [37453, 0.087602, " These", false], [3866, 0.072985, " HM", false], [3913, 0.057136, " In", false], [3918, 0.026648, " It", false], [29894, 0.022694, " This", false], [3642, 0.019202, " At", false], [267, 0.018116, "  ", false], [37451, 0.016326, " There", false], [54829, 0.014108, " Although", false]]], "model_b": [36251, 29, 0.006411013193428516, [[20996, 0.192547, " The", false], [3913, 0.072499, " In", false], [37453, 0.066245, " These", false], [29894, 0.033839, " This", false], [3866, 0.027877, " HM", false], [3918, 0.023781, " It", false], [37451, 0.022702, " There", false], [300, 0.019996, " A", false], [3641, 0.018049, " As", false], [3642, 0.017538, " At", false]]]}, "raw_delta": 0.08854166666666663, "tuned_delta": 0.1426312640817422}, {"byte_start": 3549, "byte_end": 3550, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.61%", "model_b": "2.47%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.865909218788147]], "model_b": [[45, ",", "normal", 0.8733248114585876]]}, "loss": {"model_a": 2.606431470356037, "model_b": 2.4655432827692243}, "topk": {"model_a": [45, 1, 0.865909218788147, [[45, 0.865909, ",", false], [22590, 0.047503, " the", false], [39934, 0.014524, " there", false], [21265, 0.009154, " and", false], [3866, 0.008656, " HM", false], [4601, 0.007596, " it", false], [4596, 0.005665, " in", false], [39936, 0.005091, " these", false], [32234, 0.003568, " this", false], [47202, 0.002804, " search", false]]], "model_b": [45, 1, 0.8733248114585876, [[45, 0.873325, ",", false], [22590, 0.028937, " the", false], [39934, 0.02277, " there", false], [4601, 0.008837, " it", false], [4596, 0.008205, " in", false], [32234, 0.007554, " this", false], [39936, 0.00574, " these", false], [21265, 0.002884, " and", false], [332, 0.002453, " a", false], [38720, 0.002198, " human", false]]]}, "raw_delta": 0.0078125, "tuned_delta": 0.06190209741507559}, {"byte_start": 3550, "byte_end": 3554, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 615, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "3.24% 3.24% 3.24% 3.24%", "model_b": "6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.49406540393829346]], "model_b": [[22590, " the", "normal", 0.23466208577156067]]}, "loss": {"model_a": 3.240428314496695, "model_b": 6.551300722786796}, "topk": {"model_a": [22590, 1, 0.49406540393829346, [[22590, 0.494065, " the", false], [3866, 0.06066, " HM", false], [39934, 0.046454, " there", false], [39936, 0.038909, " these", false], [38720, 0.034166, " human", false], [4601, 0.031346, " it", false], [4596, 0.021296, " in", false], [32234, 0.020433, " this", false], [63843, 0.015117, " researchers", false], [332, 0.012578, " a", false]]], "model_b": [22590, 1, 0.23466208577156067, [[22590, 0.234662, " the", false], [39936, 0.078542, " these", false], [4601, 0.063296, " it", false], [39934, 0.058144, " there", false], [32234, 0.050373, " this", false], [4596, 0.038929, " in", false], [38720, 0.038171, " human", false], [32465, 0.02213, " when", false], [4423, 0.020266, " as", false], [332, 0.018861, " a", false]]]}, "raw_delta": -0.18359375, "tuned_delta": -0.12950415258492443}, {"byte_start": 3554, "byte_end": 3566, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 616, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"model_a": "4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98%", "model_b": "5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73%"}, "model_tokens": {"model_a": [[63885, " statistical", "normal", 0.03652314469218254]], "model_b": [[63885, " statistical", "normal", 0.022040219977498055]]}, "loss": {"model_a": 4.978049294734053, "model_b": 5.729452961863722}, "topk": {"model_a": [63885, 4, 0.03652314469218254, [[3866, 0.201409, " HM", false], [38720, 0.184401, " human", false], [38328, 0.046366, " early", false], [63885, 0.036523, " statistical", false], [52224, 0.034727, " methods", false], [47202, 0.030684, " search", false], [52013, 0.026483, " initial", false], [47798, 0.02279, " winner", false], [52964, 0.017055, " special", false], [63843, 0.01606, " researchers", false]]], "model_b": [63885, 4, 0.022040219977498055, [[38720, 0.183121, " human", false], [38328, 0.053107, " early", false], [52013, 0.028994, " initial", false], [63885, 0.02204, " statistical", false], [47798, 0.019003, " winner", false], [63361, 0.015865, " competition", false], [22638, 0.015508, " two", false], [53052, 0.012315, " success", false], [52738, 0.011711, " results", false], [38499, 0.011698, " first", false]]]}, "raw_delta": -0.04166666666666663, "tuned_delta": 0.012422930748408959}, {"byte_start": 3566, "byte_end": 3574, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 617, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63%", "model_b": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.7541329860687256]], "model_b": [[52224, " methods", "normal", 0.5149917006492615]]}, "loss": {"model_a": 0.6295940882785698, "model_b": 1.4881314813857105}, "topk": {"model_a": [52224, 1, 0.7541329860687256, [[52224, 0.754133, " methods", false], [55532, 0.056963, " approach", false], [61590, 0.045995, " approaches", false], [46561, 0.032751, " method", false], [45, 0.015164, ",", false], [46587, 0.014644, " models", false], [46, 0.01364, "-", false], [3866, 0.01118, " HM", false], [62633, 0.008179, " techniques", false], [32011, 0.005531, " side", false]]], "model_b": [52224, 1, 0.5149917006492615, [[52224, 0.514992, " methods", false], [55532, 0.131289, " approach", false], [46561, 0.069665, " method", false], [3866, 0.063606, " HM", false], [61590, 0.046253, " approaches", false], [46587, 0.029851, " models", false], [46, 0.013172, "-", false], [62633, 0.012229, " techniques", false], [39043, 0.010296, " model", false], [61559, 0.006905, " algorithms", false]]]}, "raw_delta": -0.047607421875, "tuned_delta": 0.006482175540075588}, {"byte_start": 3574, "byte_end": 3578, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 618, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"model_a": "3.84% 3.84% 3.84% 3.84%", "model_b": "6.13% 6.13% 6.13% 6.13%"}, "model_tokens": {"model_a": [[22777, " won", "normal", 0.424134761095047]], "model_b": [[22777, " won", "normal", 0.25623154640197754]]}, "loss": {"model_a": 3.839203111740649, "model_b": 6.128636160026358}, "topk": {"model_a": [22777, 1, 0.424134761095047, [[22777, 0.424135, " won", false], [32462, 0.173788, " were", false], [46936, 0.039287, " proved", false], [45, 0.037533, ",", false], [61959, 0.026863, " eventually", false], [21795, 0.023217, " had", false], [60244, 0.01898, " prevailed", false], [21532, 0.01613, " did", false], [30256, 0.012252, " beat", false], [47211, 0.011561, " seemed", false]]], "model_b": [22777, 2, 0.25623154640197754, [[32462, 0.282613, " were", false], [22777, 0.256232, " won", false], [46936, 0.058806, " proved", false], [21795, 0.031382, " had", false], [21532, 0.026641, " did", false], [32272, 0.020761, " took", false], [32227, 0.019508, " that", false], [45, 0.017522, ",", false], [47518, 0.015328, " tended", false], [45283, 0.010065, " became", false]]]}, "raw_delta": -0.126953125, "tuned_delta": -0.07286352758492441}, {"byte_start": 3578, "byte_end": 3582, "display": {"text": " out", "kind": "normal"}, "is_word": true, "word_id": 619, "word_key": " out", "bytes_hex": "20 6f 75 74", "compression": {"model_a": "10.43% 10.43% 10.43% 10.43%", "model_b": "9.37% 9.37% 9.37% 9.37%"}, "model_tokens": {"model_a": [[22249, " out", "normal", 0.0996764749288559]], "model_b": [[22249, " out", "normal", 0.12429650127887726]]}, "loss": {"model_a": 10.425725881424148, "model_b": 9.369064474523052}, "topk": {"model_a": [22249, 4, 0.0996764749288559, [[45, 0.271348, ",", false], [47, 0.190689, ".", false], [22590, 0.123692, " the", false], [22249, 0.099676, " out", false], [4450, 0.059841, " by", false], [4596, 0.040531, " in", false], [21265, 0.028968, " and", false], [5346, 0.026318, "---", false], [32234, 0.011701, " this", false], [21357, 0.010701, " big", false]]], "model_b": [22249, 4, 0.12429650127887726, [[47, 0.225055, ".", false], [45, 0.179494, ",", false], [22590, 0.170505, " the", false], [22249, 0.124297, " out", false], [4596, 0.063355, " in", false], [21265, 0.037327, " and", false], [4450, 0.022129, " by", false], [51018, 0.020988, " because", false], [32465, 0.01155, " when", false], [4712, 0.009282, " on", false]]]}, "raw_delta": 0.05859375, "tuned_delta": 0.11268334741507559}, {"byte_start": 3582, "byte_end": 3587, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 620, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "12.57% 12.57% 12.57% 12.57% 12.57%", "model_b": "14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.030751002952456474]], "model_b": [[31601, " over", "normal", 0.0163179412484169]]}, "loss": {"model_a": 12.567226332743704, "model_b": 14.765082059097983}, "topk": {"model_a": [31601, 6, 0.030751002952456474, [[45, 0.315893, ",", false], [47, 0.222139, ".", false], [4596, 0.14563, " in", false], [21265, 0.053644, " and", false], [4450, 0.03463, " by", false], [31601, 0.030751, " over", false], [61959, 0.029524, " eventually", false], [5346, 0.017705, "---", false], [51018, 0.011196, " because", false], [55925, 0.008306, " decisive", false]]], "model_b": [31601, 8, 0.0163179412484169, [[47, 0.353942, ".", false], [45, 0.205151, ",", false], [4596, 0.126606, " in", false], [21265, 0.066316, " and", false], [51018, 0.041629, " because", false], [4712, 0.02931, " on", false], [32465, 0.017102, " when", false], [31601, 0.016318, " over", false], [21700, 0.010462, " for", false], [4423, 0.010318, " as", false]]]}, "raw_delta": -0.12187499999999996, "tuned_delta": -0.06778540258492437}, {"byte_start": 3587, "byte_end": 3591, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 621, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.57% 2.57% 2.57% 2.57%", "model_b": "0.34% 0.34% 0.34% 0.34%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.569801390171051]], "model_b": [[22590, " the", "normal", 0.9279612302780151]]}, "loss": {"model_a": 2.571209423459334, "model_b": 0.3390122013807683}, "topk": {"model_a": [22590, 1, 0.569801390171051, [[22590, 0.569801, " the", false], [32251, 0.230766, " time", false], [332, 0.040427, " a", false], [38720, 0.02062, " human", false], [52224, 0.018804, " methods", false], [39944, 0.015984, " those", false], [31370, 0.013614, " many", false], [31323, 0.008454, " long", false], [52869, 0.004427, " several", false], [3866, 0.004113, " HM", false]]], "model_b": [22590, 1, 0.9279612302780151, [[22590, 0.927961, " the", false], [39931, 0.009194, " their", false], [39944, 0.008598, " those", false], [3866, 0.005468, " HM", false], [21256, 0.005044, " all", false], [332, 0.003224, " a", false], [38720, 0.003055, " human", false], [39936, 0.00252, " these", false], [31370, 0.002467, " many", false], [52224, 0.002463, " methods", false]]]}, "raw_delta": 0.123779296875, "tuned_delta": 0.17786889429007557}, {"byte_start": 3591, "byte_end": 3597, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 622, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "2.79% 2.79% 2.79% 2.79% 2.79% 2.79%", "model_b": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.39809736609458923]], "model_b": [[38720, " human", "normal", 0.30793383717536926]]}, "loss": {"model_a": 2.794282387138454, "model_b": 3.5456860542681228}, "topk": {"model_a": [38720, 1, 0.39809736609458923, [[38720, 0.398097, " human", false], [52224, 0.093048, " methods", false], [31458, 0.066597, " more", false], [52964, 0.041854, " special", false], [63875, 0.028607, " specialized", false], [31580, 0.019392, " ones", false], [39174, 0.019105, " older", false], [47202, 0.017081, " search", false], [59943, 0.015856, " knowledge", false], [3866, 0.014252, " HM", false]]], "model_b": [38720, 1, 0.30793383717536926, [[38720, 0.307934, " human", false], [3866, 0.305936, " HM", false], [31458, 0.063103, " more", false], [63885, 0.050406, " statistical", false], [52964, 0.043021, " special", false], [47202, 0.015751, " search", false], [46196, 0.011734, " hidden", false], [59792, 0.008528, " heuristic", false], [52224, 0.007885, " methods", false], [51551, 0.007486, " earlier", false]]]}, "raw_delta": -0.041666666666666685, "tuned_delta": 0.012422930748408903}, {"byte_start": 3597, "byte_end": 3598, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "4.68%", "model_b": "3.21%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.7723766565322876]], "model_b": [[46, "-", "normal", 0.8371728658676147]]}, "loss": {"model_a": 4.684532237261526, "model_b": 3.2052062675999915}, "topk": {"model_a": [46, 1, 0.7723766565322876, [[46, 0.772377, "-", false], [59943, 0.128563, " knowledge", false], [52224, 0.05253, " methods", false], [61590, 0.00985, " approaches", false], [34864, 0.006816, "istic", false], [7919, 0.004152, "ist", false], [65034, 0.001804, " understanding", false], [46561, 0.001197, " method", false], [46587, 0.001169, " models", false], [55532, 0.001133, " approach", false]]], "model_b": [46, 1, 0.8371728658676147, [[46, 0.837173, "-", false], [59943, 0.104336, " knowledge", false], [52224, 0.0137, " methods", false], [38786, 0.009265, " input", false], [61590, 0.003682, " approaches", false], [55532, 0.001612, " approach", false], [46561, 0.001261, " method", false], [31580, 0.001183, " ones", false], [102, 0.00098, "e", false], [46297, 0.000804, " inputs", false]]]}, "raw_delta": 0.08203125, "tuned_delta": 0.13612084741507557}, {"byte_start": 3598, "byte_end": 3607, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 623, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "model_b": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"model_a": [[58313, "knowledge", "normal", 0.9389006495475769]], "model_b": [[58313, "knowledge", "normal", 0.8924340605735779]]}, "loss": {"model_a": 0.12719072490476158, "model_b": 0.22894330482857084}, "topk": {"model_a": [58313, 1, 0.9389006495475769, [[58313, 0.938901, "knowledge", false], [34011, 0.01433, "based", false], [42430, 0.005919, "unders", false], [54208, 0.004574, "oriented", false], [26085, 0.003279, "know", false], [54122, 0.00213, "language", false], [48948, 0.001965, "centric", false], [49161, 0.001939, "focused", false], [34795, 0.001224, "input", false], [35074, 0.00119, "model", false]]], "model_b": [58313, 1, 0.8924340605735779, [[58313, 0.892434, "knowledge", false], [34011, 0.032684, "based", false], [34795, 0.018537, "input", false], [26085, 0.005028, "know", false], [33992, 0.003237, "aware", false], [48948, 0.003027, "centric", false], [41273, 0.001812, "driven", false], [41269, 0.001698, "domain", false], [54359, 0.001547, "specific", false], [53835, 0.001432, "centered", false]]]}, "raw_delta": -0.005642361111111111, "tuned_delta": 0.048447236303964476}, {"byte_start": 3607, "byte_end": 3608, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "30.71%", "model_b": "25.78%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.1845637559890747]], "model_b": [[46, "-", "normal", 0.23880502581596375]]}, "loss": {"model_a": 30.713624893925193, "model_b": 25.782538328386746}, "topk": {"model_a": [46, 2, 0.1845637559890747, [[52224, 0.670292, " methods", false], [46, 0.184564, "-", false], [61590, 0.080086, " approaches", false], [37810, 0.017626, " based", false], [55532, 0.009256, " approach", false], [31580, 0.008055, " ones", false], [46561, 0.002841, " method", false], [45, 0.002271, ",", false], [51566, 0.001977, " efforts", false], [46587, 0.001846, " models", false]]], "model_b": [46, 2, 0.23880502581596375, [[52224, 0.445691, " methods", false], [46, 0.238805, "-", false], [61590, 0.124797, " approaches", false], [37810, 0.085946, " based", false], [55532, 0.017921, " approach", false], [31580, 0.009642, " ones", false], [34011, 0.005145, "based", false], [62633, 0.004359, " techniques", false], [46561, 0.004173, " method", false], [45796, 0.003158, " driven", false]]]}, "raw_delta": 0.2734375, "tuned_delta": 0.3275270974150756}, {"byte_start": 3608, "byte_end": 3613, "display": {"text": "based", "kind": "normal"}, "is_word": true, "word_id": 624, "word_key": "based", "bytes_hex": "62 61 73 65 64", "compression": {"model_a": "0.46% 0.46% 0.46% 0.46% 0.46%", "model_b": "0.32% 0.32% 0.32% 0.32% 0.32%"}, "model_tokens": {"model_a": [[34011, "based", "normal", 0.880551278591156]], "model_b": [[34011, "based", "normal", 0.9153889417648315]]}, "loss": {"model_a": 0.4578866096571417, "model_b": 0.31875952441516403}, "topk": {"model_a": [34011, 1, 0.880551278591156, [[34011, 0.880551, "based", false], [54208, 0.023119, "oriented", false], [58213, 0.015658, "dependent", false], [41273, 0.011439, "driven", false], [49161, 0.008183, "focused", false], [34547, 0.003367, "heavy", false], [26476, 0.003224, "only", false], [25885, 0.003094, "inte", false], [49411, 0.002836, "methods", false], [48948, 0.002481, "centric", false]]], "model_b": [34011, 1, 0.9153889417648315, [[34011, 0.915389, "based", false], [54208, 0.02013, "oriented", false], [41273, 0.010937, "driven", false], [34547, 0.005086, "heavy", false], [49161, 0.003757, "focused", false], [48948, 0.003415, "centric", false], [53835, 0.002418, "centered", false], [26996, 0.002071, "seek", false], [54087, 0.001954, "inspired", false], [34453, 0.001816, "first", false]]]}, "raw_delta": 0.007714843749999999, "tuned_delta": 0.06180444116507559}, {"byte_start": 3613, "byte_end": 3621, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 625, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "0.66% 0.66% 0.66% 0.66% 0.66% 0.66% 0.66% 0.66%", "model_b": "0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.7432807087898254]], "model_b": [[52224, " methods", "normal", 0.6950480937957764]]}, "loss": {"model_a": 0.6648161351752729, "model_b": 0.8145098344862616}, "topk": {"model_a": [52224, 1, 0.7432807087898254, [[52224, 0.743281, " methods", false], [61590, 0.109698, " approaches", false], [31580, 0.089866, " ones", false], [55532, 0.009513, " approach", false], [51566, 0.00478, " efforts", false], [45, 0.004181, ",", false], [46561, 0.002382, " method", false], [47, 0.002334, ".", false], [63363, 0.002329, " competitors", false], [62633, 0.002109, " techniques", false]]], "model_b": [52224, 1, 0.6950480937957764, [[52224, 0.695048, " methods", false], [31580, 0.109996, " ones", false], [61590, 0.107327, " approaches", false], [55532, 0.009361, " approach", false], [62633, 0.006984, " techniques", false], [47202, 0.006127, " search", false], [46561, 0.005333, " method", false], [63363, 0.004424, " competitors", false], [51566, 0.002259, " efforts", false], [45, 0.002198, ",", false]]]}, "raw_delta": -0.00830078125, "tuned_delta": 0.04578881616507559}, {"byte_start": 3621, "byte_end": 3622, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "14.37%", "model_b": "11.76%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.45558494329452515]], "model_b": [[47, ".", "normal", 0.5168300271034241]]}, "loss": {"model_a": 14.370595133854907, "model_b": 11.76416366349887}, "topk": {"model_a": [47, 1, 0.45558494329452515, [[47, 0.455585, ".", false], [45, 0.309949, ",", false], [4596, 0.058838, " in", false], [21265, 0.033201, " and", false], [4450, 0.031756, " by", false], [5346, 0.012278, "---", false], [275, 0.011693, " (", false], [51018, 0.010177, " because", false], [32227, 0.006678, " that", false], [37634, 0.004424, " after", false]]], "model_b": [47, 1, 0.5168300271034241, [[47, 0.51683, ".", false], [45, 0.193888, ",", false], [4596, 0.096865, " in", false], [51018, 0.02393, " because", false], [32227, 0.023231, " that", false], [21265, 0.017448, " and", false], [4712, 0.011376, " on", false], [21700, 0.010269, " for", false], [4424, 0.009992, " at", false], [275, 0.008742, " (", false]]]}, "raw_delta": 0.14453125, "tuned_delta": 0.19862084741507557}, {"byte_start": 3622, "byte_end": 3627, "display": {"text": " This", "kind": "normal"}, "is_word": true, "word_id": 626, "word_key": " this", "bytes_hex": "20 54 68 69 73", "compression": {"model_a": "10.03% 10.03% 10.03% 10.03% 10.03%", "model_b": "9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"model_a": [[29894, " This", "normal", 0.06170455738902092]], "model_b": [[29894, " This", "normal", 0.07581163197755814]]}, "loss": {"model_a": 10.031238956181074, "model_b": 9.24226510569492}, "topk": {"model_a": [29894, 4, 0.06170455738902092, [[261, 0.184556, "\n\n", false], [20996, 0.13913, " The", false], [3913, 0.075887, " In", false], [29894, 0.061705, " This", false], [19555, 0.033519, " But", false], [3918, 0.02886, " It", false], [267, 0.021632, "  ", false], [19417, 0.019461, " And", false], [300, 0.018988, " A", false], [37451, 0.018419, " There", false]]], "model_b": [29894, 3, 0.07581163197755814, [[261, 0.202353, "\n\n", false], [20996, 0.100709, " The", false], [29894, 0.075812, " This", false], [3913, 0.058624, " In", false], [19555, 0.027314, " But", false], [3918, 0.026075, " It", false], [267, 0.02415, "  ", false], [37451, 0.022327, " There", false], [19417, 0.021247, " And", false], [36251, 0.021238, " Again", false]]]}, "raw_delta": 0.04375000000000007, "tuned_delta": 0.09783959741507565}, {"byte_start": 3627, "byte_end": 3631, "display": {"text": " led", "kind": "normal"}, "is_word": true, "word_id": 627, "word_key": " led", "bytes_hex": "20 6c 65 64", "compression": {"model_a": "21.84% 21.84% 21.84% 21.84%", "model_b": "21.84% 21.84% 21.84% 21.84%"}, "model_tokens": {"model_a": [[21994, " led", "normal", 0.0078525235876441]], "model_b": [[21994, " led", "normal", 0.00803307443857193]]}, "loss": {"model_a": 21.837669075955986, "model_b": 21.837669075955986}, "topk": {"model_a": [21994, 11, 0.0078525235876441, [[22748, 0.335846, " was", false], [32251, 0.127685, " time", false], [4600, 0.092788, " is", false], [63361, 0.060595, " competition", false], [52427, 0.04616, " pattern", false], [56348, 0.010858, " happened", false], [38328, 0.010419, " early", false], [53283, 0.010181, " victory", false], [22074, 0.009366, " may", false], [47092, 0.009033, " result", false]]], "model_b": [21994, 11, 0.00803307443857193, [[22748, 0.291007, " was", false], [4600, 0.137069, " is", false], [52427, 0.072515, " pattern", false], [63361, 0.029567, " competition", false], [32251, 0.014963, " time", false], [45315, 0.011001, " bitter", false], [39831, 0.010877, " story", false], [59392, 0.009553, " continued", false], [53052, 0.008282, " success", false], [40009, 0.00806, " trend", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 3631, "byte_end": 3634, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 628, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.91% 1.91% 1.91%", "model_b": "1.86% 1.86% 1.86%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7254297137260437]], "model_b": [[4811, " to", "normal", 0.7335218191146851]]}, "loss": {"model_a": 1.9137312147208743, "model_b": 1.8550278032263687}, "topk": {"model_a": [4811, 1, 0.7254297137260437, [[4811, 0.72543, " to", false], [32074, 0.053977, " some", false], [31370, 0.044685, " many", false], [22590, 0.035891, " the", false], [332, 0.018427, " a", false], [63843, 0.017706, " researchers", false], [46787, 0.011179, " people", false], [22226, 0.009128, " one", false], [45, 0.007413, ",", false], [19678, 0.004704, " DAR", false]]], "model_b": [4811, 1, 0.7335218191146851, [[4811, 0.733522, " to", false], [63843, 0.04741, " researchers", false], [31370, 0.036438, " many", false], [32074, 0.025773, " some", false], [22590, 0.025216, " the", false], [332, 0.013138, " a", false], [45, 0.012573, ",", false], [46787, 0.00997, " people", false], [22226, 0.006151, " one", false], [4596, 0.005239, " in", false]]]}, "raw_delta": 0.0032552083333333426, "tuned_delta": 0.05734480574840893}, {"byte_start": 3634, "byte_end": 3636, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 629, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "10.07% 10.07%", "model_b": "12.54% 12.54%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.32784348726272583]], "model_b": [[332, " a", "normal", 0.24982376396656036]]}, "loss": {"model_a": 10.073505412457116, "model_b": 12.539048695226342}, "topk": {"model_a": [332, 1, 0.32784348726272583, [[332, 0.327843, " a", false], [22590, 0.231271, " the", false], [4419, 0.048289, " an", false], [31466, 0.028891, " much", false], [32074, 0.024626, " some", false], [31370, 0.020084, " many", false], [51816, 0.014236, " further", false], [50919, 0.012117, " another", false], [65126, 0.011758, " disappointment", false], [31458, 0.008876, " more", false]]], "model_b": [332, 2, 0.24982376396656036, [[22590, 0.28816, " the", false], [332, 0.249824, " a", false], [4419, 0.049783, " an", false], [32074, 0.028157, " some", false], [31370, 0.023346, " many", false], [31466, 0.018703, " much", false], [57103, 0.012921, " research", false], [51816, 0.012234, " further", false], [22638, 0.008203, " two", false], [50919, 0.006816, " another", false]]]}, "raw_delta": -0.13671875, "tuned_delta": -0.08262915258492441}, {"byte_start": 3636, "byte_end": 3642, "display": {"text": " major", "kind": "normal"}, "is_word": true, "word_id": 630, "word_key": " major", "bytes_hex": "20 6d 61 6a 6f 72", "compression": {"model_a": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "model_b": "13.90% 13.90% 13.90% 13.90% 13.90% 13.90%"}, "model_tokens": {"model_a": [[38961, " major", "normal", 0.018703404814004898]], "model_b": [[38961, " major", "normal", 0.009727684780955315]]}, "loss": {"model_a": 11.97549594487909, "model_b": 13.900967841898865}, "topk": {"model_a": [38961, 8, 0.018703404814004898, [[31323, 0.072443, " long", false], [46790, 0.056268, " period", false], [45315, 0.030924, " bitter", false], [55591, 0.023598, " backlash", false], [38629, 0.022737, " great", false], [22031, 0.022407, " lot", false], [51816, 0.022389, " further", false], [38961, 0.018703, " major", false], [45674, 0.018517, " decade", false], [39664, 0.018253, " shift", false]]], "model_b": [38961, 15, 0.009727684780955315, [[46790, 0.035802, " period", false], [31323, 0.030831, " long", false], [52427, 0.024596, " pattern", false], [45315, 0.024483, " bitter", false], [51832, 0.019027, " general", false], [22031, 0.01713, " lot", false], [47234, 0.015323, " series", false], [45669, 0.015294, " debate", false], [55591, 0.014976, " backlash", false], [22168, 0.014845, " new", false]]]}, "raw_delta": -0.10677083333333337, "tuned_delta": -0.05268123591825778}, {"byte_start": 3642, "byte_end": 3649, "display": {"text": " change", "kind": "normal"}, "is_word": true, "word_id": 631, "word_key": " change", "bytes_hex": "20 63 68 61 6e 67 65", "compression": {"model_a": "4.81% 4.81% 4.81% 4.81% 4.81% 4.81% 4.81%", "model_b": "7.12% 7.12% 7.12% 7.12% 7.12% 7.12% 7.12%"}, "model_tokens": {"model_a": [[45450, " change", "normal", 0.15361158549785614]], "model_b": [[45450, " change", "normal", 0.06280500441789627]]}, "loss": {"model_a": 4.81032526189261, "model_b": 7.124916915104532}, "topk": {"model_a": [45450, 2, 0.15361158549785614, [[39664, 0.203584, " shift", false], [45450, 0.153612, " change", false], [56810, 0.036295, " paradigm", false], [57103, 0.030638, " research", false], [45829, 0.030009, " effort", false], [4757, 0.029589, " re", false], [22378, 0.019607, " ret", false], [63415, 0.015852, " controversy", false], [55591, 0.015402, " backlash", false], [57138, 0.014776, " revision", false]]], "model_b": [45450, 2, 0.06280500441789627, [[39664, 0.103545, " shift", false], [45450, 0.062805, " change", false], [45669, 0.045428, " debate", false], [4757, 0.032174, " re", false], [45829, 0.027957, " effort", false], [57103, 0.02589, " research", false], [65126, 0.022654, " disappointment", false], [56810, 0.022432, " paradigm", false], [63415, 0.018882, " controversy", false], [22459, 0.018761, " set", false]]]}, "raw_delta": -0.12834821428571422, "tuned_delta": -0.07425861687063863}, {"byte_start": 3649, "byte_end": 3652, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 632, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "0.55% 0.55% 0.55%", "model_b": "0.78% 0.78% 0.78%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.9128422141075134]], "model_b": [[4596, " in", "normal", 0.8774064183235168]]}, "loss": {"model_a": 0.5459417268988996, "model_b": 0.7807553728769211}, "topk": {"model_a": [4596, 1, 0.9128422141075134, [[4596, 0.912842, " in", false], [4706, 0.03714, " of", false], [45, 0.015217, ",", false], [59, 0.006536, ":", false], [47, 0.003765, ".", false], [4811, 0.001911, " to", false], [32227, 0.001871, " that", false], [4424, 0.001563, " at", false], [31601, 0.001483, " over", false], [30917, 0.001482, " from", false]]], "model_b": [4596, 1, 0.8774064183235168, [[4596, 0.877406, " in", false], [4706, 0.063857, " of", false], [45, 0.015019, ",", false], [59, 0.006338, ":", false], [31601, 0.004102, " over", false], [47, 0.004073, ".", false], [32227, 0.002914, " that", false], [30917, 0.002316, " from", false], [21700, 0.001893, " for", false], [4811, 0.001781, " to", false]]]}, "raw_delta": -0.013020833333333336, "tuned_delta": 0.04106876408174225}, {"byte_start": 3652, "byte_end": 3656, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 633, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"model_a": "35.08% 35.08% 35.08% 35.08%", "model_b": "35.36% 35.36% 35.36% 35.36%"}, "model_tokens": {"model_a": [[21256, " all", "normal", 0.00040676642674952745]], "model_b": [[21256, " all", "normal", 0.0003896649868693203]]}, "loss": {"model_a": 35.081158709116394, "model_b": 35.362935084290015}, "topk": {"model_a": [21256, 86, 0.00040676642674952745, [[22590, 0.462505, " the", false], [47350, 0.114987, " speech", false], [3609, 0.079406, " AI", false], [57103, 0.057021, " research", false], [59526, 0.039207, " direction", false], [56103, 0.028247, " emphasis", false], [38530, 0.017078, " focus", false], [21835, 0.01464, " how", false], [57419, 0.010613, " thinking", false], [55574, 0.009997, " attitude", false]]], "model_b": [21256, 89, 0.0003896649868693203, [[22590, 0.552629, " the", false], [57103, 0.088625, " research", false], [21835, 0.057083, " how", false], [3609, 0.038585, " AI", false], [47350, 0.02966, " speech", false], [32464, 0.01777, " what", false], [55532, 0.014121, " approach", false], [30322, 0.010081, " both", false], [57419, 0.009933, " thinking", false], [59526, 0.009134, " direction", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 3656, "byte_end": 3659, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 634, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "13.24% 13.24% 13.24%", "model_b": "11.74% 11.74% 11.74%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.109671451151371]], "model_b": [[4706, " of", "normal", 0.14011384546756744]]}, "loss": {"model_a": 13.243489633160404, "model_b": 11.740682298901067}, "topk": {"model_a": [4706, 2, 0.109671451151371, [[47350, 0.439427, " speech", false], [4706, 0.109671, " of", false], [3609, 0.067718, " AI", false], [22590, 0.067576, " the", false], [62597, 0.067054, " subsequent", false], [57103, 0.042091, " research", false], [46064, 0.020986, " future", false], [37738, 0.018781, " areas", false], [50964, 0.01707, " aspects", false], [38720, 0.009232, " human", false]]], "model_b": [4706, 2, 0.14011384546756744, [[47350, 0.276447, " speech", false], [4706, 0.140114, " of", false], [22590, 0.136753, " the", false], [3609, 0.050255, " AI", false], [57103, 0.035138, " research", false], [37738, 0.028793, " areas", false], [62597, 0.028432, " subsequent", false], [61590, 0.026778, " approaches", false], [52224, 0.019192, " methods", false], [50964, 0.010702, " aspects", false]]]}, "raw_delta": 0.08333333333333337, "tuned_delta": 0.13742293074840894}, {"byte_start": 3659, "byte_end": 3667, "display": {"text": " natural", "kind": "normal"}, "is_word": true, "word_id": 635, "word_key": " natural", "bytes_hex": "20 6e 61 74 75 72 61 6c", "compression": {"model_a": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "model_b": "15.99% 15.99% 15.99% 15.99% 15.99% 15.99% 15.99% 15.99%"}, "model_tokens": {"model_a": [[52299, " natural", "normal", 0.002481764182448387]], "model_b": [[52299, " natural", "normal", 0.0008189572254195809]]}, "loss": {"model_a": 13.52526600833403, "model_b": 15.990809291103256}, "topk": {"model_a": [52299, 9, 0.002481764182448387, [[47350, 0.755028, " speech", false], [3609, 0.07456, " AI", false], [22590, 0.06515, " the", false], [55809, 0.029765, " computer", false], [57103, 0.009415, " research", false], [19678, 0.007169, " DAR", false], [64862, 0.006673, " computational", false], [52167, 0.003082, " machine", false], [52299, 0.002482, " natural", false], [38720, 0.002255, " human", false]]], "model_b": [52299, 23, 0.0008189572254195809, [[47350, 0.527685, " speech", false], [22590, 0.334968, " the", false], [3609, 0.032689, " AI", false], [55809, 0.016052, " computer", false], [39936, 0.01497, " these", false], [32234, 0.007785, " this", false], [52167, 0.007196, " machine", false], [39944, 0.006125, " those", false], [38720, 0.00566, " human", false], [57103, 0.004682, " research", false]]]}, "raw_delta": -0.13671875, "tuned_delta": -0.08262915258492441}, {"byte_start": 3667, "byte_end": 3676, "display": {"text": " language", "kind": "normal"}, "is_word": true, "word_id": 636, "word_key": " language", "bytes_hex": "20 6c 61 6e 67 75 61 67 65", "compression": {"model_a": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "model_b": "2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33%"}, "model_tokens": {"model_a": [[56529, " language", "normal", 0.8071631789207458]], "model_b": [[56529, " language", "normal", 0.3133000135421753]]}, "loss": {"model_a": 0.43049168429303913, "model_b": 2.3324822167150123}, "topk": {"model_a": [56529, 1, 0.8071631789207458, [[56529, 0.807163, " language", false], [46, 0.18598, "-", false], [59946, 0.002354, " languages", false], [47350, 0.002111, " speech", false], [21265, 0.000347, " and", false], [275, 0.000189, " (", false], [34864, 0.000178, "istic", false], [62378, 0.00015, " processing", false], [48, 0.000104, "/", false], [52814, 9e-05, " science", false]]], "model_b": [56529, 2, 0.3133000135421753, [[46, 0.654903, "-", false], [56529, 0.3133, " language", false], [47350, 0.008974, " speech", false], [21265, 0.005914, " and", false], [59946, 0.002621, " languages", false], [4715, 0.000878, " or", false], [38720, 0.00083, " human", false], [65117, 0.000721, " communications", false], [11, 0.000713, "\n", false], [52814, 0.000681, " science", false]]]}, "raw_delta": -0.10546875000000001, "tuned_delta": -0.051379152584924426}, {"byte_start": 3676, "byte_end": 3687, "display": {"text": " processing", "kind": "normal"}, "is_word": true, "word_id": 637, "word_key": " processing", "bytes_hex": "20 70 72 6f 63 65 73 73 69 6e 67", "compression": {"model_a": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "model_b": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"model_a": [[62378, " processing", "normal", 0.9100680947303772]], "model_b": [[62378, " processing", "normal", 0.8427163362503052]]}, "loss": {"model_a": 0.15449670570599364, "model_b": 0.2801753730419573}, "topk": {"model_a": [62378, 1, 0.9100680947303772, [[62378, 0.910068, " processing", false], [57103, 0.046873, " research", false], [65034, 0.020287, " understanding", false], [45, 0.003555, ",", false], [21265, 0.00215, " and", false], [275, 0.00147, " (", false], [63821, 0.001433, " recognition", false], [62634, 0.001212, " technology", false], [47, 0.00121, ".", false], [46, 0.000894, "-", false]]], "model_b": [62378, 1, 0.8427163362503052, [[62378, 0.842716, " processing", false], [65034, 0.018445, " understanding", false], [63821, 0.015608, " recognition", false], [47350, 0.014659, " speech", false], [57103, 0.014577, " research", false], [46, 0.010718, "-", false], [21265, 0.007423, " and", false], [53087, 0.004813, " systems", false], [62634, 0.004431, " technology", false], [3609, 0.004258, " AI", false]]]}, "raw_delta": -0.006969105113636362, "tuned_delta": 0.04712049230143923}, {"byte_start": 3687, "byte_end": 3688, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "21.70%", "model_b": "24.23%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.3021651804447174]], "model_b": [[45, ",", "normal", 0.2616400718688965]]}, "loss": {"model_a": 21.696780888369172, "model_b": 24.232768264931806}, "topk": {"model_a": [45, 1, 0.3021651804447174, [[45, 0.302165, ",", false], [275, 0.219077, " (", false], [47, 0.153554, ".", false], [57103, 0.093974, " research", false], [59, 0.052152, ":", false], [5346, 0.0422, "---", false], [21265, 0.035003, " and", false], [4596, 0.01944, " in", false], [32227, 0.012163, " that", false], [31601, 0.00587, " over", false]]], "model_b": [45, 1, 0.2616400718688965, [[45, 0.26164, ",", false], [47, 0.184068, ".", false], [275, 0.171719, " (", false], [57103, 0.096232, " research", false], [21265, 0.061595, " and", false], [4596, 0.032835, " in", false], [59, 0.031883, ":", false], [5346, 0.017164, "---", false], [52224, 0.011842, " methods", false], [4423, 0.011005, " as", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08653540258492441}, {"byte_start": 3688, "byte_end": 3698, "display": {"text": " gradually", "kind": "normal"}, "is_word": true, "word_id": 638, "word_key": " gradually", "bytes_hex": "20 67 72 61 64 75 61 6c 6c 79", "compression": {"model_a": "14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88%", "model_b": "17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58% 17.58%"}, "model_tokens": {"model_a": [[59771, " gradually", "normal", 0.00026331678964197636]], "model_b": [[59771, " gradually", "normal", 5.65048903808929e-05]]}, "loss": {"model_a": 14.877792609167432, "model_b": 17.582845810834236}, "topk": {"model_a": [59771, 128, 0.00026331678964197636, [[40186, 0.18027, " which", false], [21265, 0.113458, " and", false], [30917, 0.091548, " from", false], [40185, 0.073692, " where", false], [32487, 0.071375, " with", false], [4423, 0.052657, " as", false], [4811, 0.044154, " to", false], [4596, 0.040929, " in", false], [30211, 0.023158, " away", false], [59841, 0.020795, " including", false]]], "model_b": [59771, 399, 5.65048903808929e-05, [[21265, 0.19816, " and", false], [40185, 0.094668, " where", false], [4423, 0.086444, " as", false], [32487, 0.085939, " with", false], [30917, 0.067136, " from", false], [40186, 0.056208, " which", false], [4596, 0.036451, " in", false], [21400, 0.026367, " but", false], [4811, 0.022995, " to", false], [22590, 0.021236, " the", false]]]}, "raw_delta": -0.15, "tuned_delta": -0.0959104025849244}, {"byte_start": 3698, "byte_end": 3703, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 639, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "16.68% 16.68% 16.68% 16.68% 16.68%", "model_b": "20.85% 20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.009676050394773483]], "model_b": [[31601, " over", "normal", 0.003135876962915063]]}, "loss": {"model_a": 16.681161410278637, "model_b": 20.851451762848296}, "topk": {"model_a": [31601, 19, 0.009676050394773483, [[46612, 0.15327, " moving", false], [60385, 0.134453, " replacing", false], [57209, 0.126251, " shifting", false], [52107, 0.029412, " leading", false], [45, 0.022168, ",", false], [39856, 0.02079, " suppl", false], [46500, 0.020352, " making", false], [30917, 0.020219, " from", false], [50834, 0.019002, " abandon", false], [55660, 0.018108, " bringing", false]]], "model_b": [31601, 45, 0.003135876962915063, [[46612, 0.23252, " moving", false], [57209, 0.064182, " shifting", false], [60385, 0.039964, " replacing", false], [52107, 0.038568, " leading", false], [46500, 0.037304, " making", false], [57050, 0.024541, " reducing", false], [47497, 0.023725, " taking", false], [57088, 0.017915, " removing", false], [55611, 0.015082, " becoming", false], [52613, 0.012252, " pushing", false]]]}, "raw_delta": -0.23124999999999996, "tuned_delta": -0.17716040258492438}, {"byte_start": 3703, "byte_end": 3711, "display": {"text": " decades", "kind": "normal"}, "is_word": true, "word_id": 640, "word_key": " decades", "bytes_hex": "20 64 65 63 61 64 65 73", "compression": {"model_a": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%", "model_b": "9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[51396, " decades", "normal", 0.022979633882641792]], "model_b": [[51396, " decades", "normal", 0.017409812659025192]]}, "loss": {"model_a": 8.523735349002175, "model_b": 9.157732193142833}, "topk": {"model_a": [51396, 6, 0.022979633882641792, [[22590, 0.511333, " the", false], [332, 0.151255, " a", false], [32251, 0.107072, " time", false], [31370, 0.062735, " many", false], [52869, 0.042528, " several", false], [51396, 0.02298, " decades", false], [37598, 0.017119, " about", false], [3493, 0.014353, " 20", false], [22638, 0.008469, " two", false], [31458, 0.005752, " more", false]]], "model_b": [51396, 6, 0.017409812659025192, [[22590, 0.412625, " the", false], [332, 0.155853, " a", false], [31370, 0.122328, " many", false], [52869, 0.086023, " several", false], [32251, 0.0356, " time", false], [51396, 0.01741, " decades", false], [31458, 0.016361, " more", false], [22638, 0.014311, " two", false], [3503, 0.009747, " 30", false], [39946, 0.006722, " three", false]]]}, "raw_delta": -0.03515625, "tuned_delta": 0.018933347415075588}, {"byte_start": 3711, "byte_end": 3712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "12.26%", "model_b": "18.88%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5042016506195068]], "model_b": [[45, ",", "normal", 0.35004180669784546]]}, "loss": {"model_a": 12.257272320052715, "model_b": 18.879017136632918}, "topk": {"model_a": [45, 1, 0.5042016506195068, [[45, 0.504202, ",", false], [47, 0.347258, ".", false], [21265, 0.017231, " and", false], [4706, 0.016622, " of", false], [59, 0.015157, ":", false], [4423, 0.011844, " as", false], [30917, 0.008682, " from", false], [4811, 0.008501, " to", false], [275, 0.007981, " (", false], [21400, 0.007161, " but", false]]], "model_b": [45, 2, 0.35004180669784546, [[47, 0.427391, ".", false], [45, 0.350042, ",", false], [4706, 0.070159, " of", false], [4423, 0.019566, " as", false], [59, 0.019532, ":", false], [21265, 0.017397, " and", false], [275, 0.014068, " (", false], [40076, 0.00949, " until", false], [4596, 0.007453, " in", false], [4811, 0.006439, " to", false]]]}, "raw_delta": -0.3671875, "tuned_delta": -0.3130979025849244}, {"byte_start": 3712, "byte_end": 3718, "display": {"text": " where", "kind": "normal"}, "is_word": true, "word_id": 641, "word_key": " where", "bytes_hex": "20 77 68 65 72 65", "compression": {"model_a": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90%", "model_b": "10.85% 10.85% 10.85% 10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[40185, " where", "normal", 0.02696811780333519]], "model_b": [[40185, " where", "normal", 0.026948951184749603]]}, "loss": {"model_a": 10.89535317338019, "model_b": 10.848390444184586}, "topk": {"model_a": [40185, 12, 0.02696811780333519, [[30917, 0.187083, " from", false], [4423, 0.116297, " as", false], [32487, 0.089598, " with", false], [4811, 0.087584, " to", false], [30211, 0.065642, " away", false], [21265, 0.062838, " and", false], [53169, 0.047793, " towards", false], [4596, 0.045397, " in", false], [21400, 0.030748, " but", false], [40186, 0.029044, " which", false]]], "model_b": [40185, 9, 0.026948951184749603, [[30917, 0.169148, " from", false], [21265, 0.149518, " and", false], [4423, 0.109597, " as", false], [4811, 0.087169, " to", false], [32487, 0.064022, " with", false], [40076, 0.038414, " until", false], [4596, 0.037105, " in", false], [21400, 0.032382, " but", false], [40185, 0.026949, " where", false], [30211, 0.019193, " away", false]]]}, "raw_delta": 0.0026041666666666297, "tuned_delta": 0.05669376408174222}, {"byte_start": 3718, "byte_end": 3729, "display": {"text": " statistics", "kind": "normal"}, "is_word": true, "word_id": 642, "word_key": " statistics", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 73", "compression": {"model_a": "10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20%", "model_b": "9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32%"}, "model_tokens": {"model_a": [[62577, " statistics", "normal", 0.0020087799057364464]], "model_b": [[62577, " statistics", "normal", 0.0033852974884212017]]}, "loss": {"model_a": 10.19518157446391, "model_b": 9.324236414836342}, "topk": {"model_a": [62577, 42, 0.0020087799057364464, [[22590, 0.218629, " the", false], [63885, 0.190964, " statistical", false], [3866, 0.06995, " HM", false], [52224, 0.048869, " methods", false], [38720, 0.043119, " human", false], [4601, 0.021841, " it", false], [31458, 0.021768, " more", false], [21256, 0.015081, " all", false], [31461, 0.013634, " most", false], [332, 0.013095, " a", false]]], "model_b": [62577, 38, 0.0033852974884212017, [[22590, 0.247697, " the", false], [63885, 0.083859, " statistical", false], [38720, 0.07203, " human", false], [31466, 0.024044, " much", false], [3866, 0.022472, " HM", false], [21256, 0.0208, " all", false], [332, 0.019735, " a", false], [31458, 0.019609, " more", false], [4601, 0.018925, " it", false], [46227, 0.017124, " humans", false]]]}, "raw_delta": 0.048295454545454475, "tuned_delta": 0.10238505196053006}, {"byte_start": 3729, "byte_end": 3733, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 643, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "11.06% 11.06% 11.06% 11.06%", "model_b": "11.91% 11.91% 11.91% 11.91%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.08643412590026855]], "model_b": [[21265, " and", "normal", 0.07094316929578781]]}, "loss": {"model_a": 11.059722725564805, "model_b": 11.905051851085684}, "topk": {"model_a": [21265, 2, 0.08643412590026855, [[45283, 0.091928, " became", false], [21265, 0.086434, " and", false], [30383, 0.067295, " came", false], [32272, 0.060775, " took", false], [57094, 0.059678, " replaced", false], [46, 0.059529, "-", false], [31059, 0.050042, " have", false], [22777, 0.035994, " won", false], [32462, 0.035378, " were", false], [37828, 0.034083, " began", false]]], "model_b": [21265, 3, 0.07094316929578781, [[45283, 0.212538, " became", false], [32462, 0.083343, " were", false], [21265, 0.070943, " and", false], [59572, 0.062085, " dominated", false], [22748, 0.045062, " was", false], [32272, 0.038095, " took", false], [31059, 0.031256, " have", false], [45, 0.026981, ",", false], [46, 0.026354, "-", false], [275, 0.025705, " (", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 3733, "byte_end": 3745, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 644, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%", "model_b": "5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.13499867916107178]], "model_b": [[63370, " computation", "normal", 0.027223113924264908]]}, "loss": {"model_a": 3.0056146685186733, "model_b": 5.424195222092293}, "topk": {"model_a": [63370, 3, 0.13499867916107178, [[3866, 0.163178, " HM", false], [56537, 0.151697, " learning", false], [63370, 0.134999, " computation", false], [47202, 0.090606, " search", false], [52167, 0.062742, " machine", false], [63885, 0.059155, " statistical", false], [52195, 0.033744, " massive", false], [56935, 0.019006, " probabil", false], [31458, 0.013914, " more", false], [63787, 0.013857, " probability", false]]], "model_b": [63370, 6, 0.027223113924264908, [[3866, 0.296679, " HM", false], [52167, 0.100715, " machine", false], [38720, 0.07561, " human", false], [56537, 0.047433, " learning", false], [63885, 0.032035, " statistical", false], [63370, 0.027223, " computation", false], [30597, 0.020769, " deep", false], [22590, 0.016648, " the", false], [47202, 0.014868, " search", false], [46196, 0.013644, " hidden", false]]]}, "raw_delta": -0.13411458333333331, "tuned_delta": -0.08002498591825773}, {"byte_start": 3745, "byte_end": 3750, "display": {"text": " came", "kind": "normal"}, "is_word": true, "word_id": 645, "word_key": " came", "bytes_hex": "20 63 61 6d 65", "compression": {"model_a": "8.06% 8.06% 8.06% 8.06% 8.06%", "model_b": "14.31% 14.31% 14.31% 14.31% 14.31%"}, "model_tokens": {"model_a": [[30383, " came", "normal", 0.10698934644460678]], "model_b": [[30383, " came", "normal", 0.018926488235592842]]}, "loss": {"model_a": 8.058804329965694, "model_b": 14.314239858820182}, "topk": {"model_a": [30383, 2, 0.10698934644460678, [[31059, 0.108267, " have", false], [30383, 0.106989, " came", false], [45283, 0.103023, " became", false], [32272, 0.089009, " took", false], [57094, 0.058479, " replaced", false], [32462, 0.052215, " were", false], [22777, 0.040453, " won", false], [22190, 0.028635, " now", false], [61959, 0.028579, " eventually", false], [59771, 0.028253, " gradually", false]]], "model_b": [30383, 8, 0.018926488235592842, [[45283, 0.244488, " became", false], [32462, 0.183793, " were", false], [31059, 0.06573, " have", false], [21286, 0.045222, " are", false], [59572, 0.043921, " dominated", false], [55858, 0.032032, " converge", false], [32272, 0.023484, " took", false], [30383, 0.018926, " came", false], [64430, 0.017734, " increasingly", false], [45284, 0.016936, " become", false]]]}, "raw_delta": -0.34687499999999993, "tuned_delta": -0.29278540258492436}, {"byte_start": 3750, "byte_end": 3753, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 646, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.25% 0.25% 0.25%", "model_b": "0.62% 0.62% 0.62%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9597342610359192]], "model_b": [[4811, " to", "normal", 0.9016938805580139]]}, "loss": {"model_a": 0.24655432827692242, "model_b": 0.6222561618417567}, "topk": {"model_a": [4811, 1, 0.9597342610359192, [[4811, 0.959734, " to", false], [38499, 0.011867, " first", false], [31162, 0.006523, " into", false], [4596, 0.005717, " in", false], [22249, 0.00207, " out", false], [64430, 0.001754, " increasingly", false], [57435, 0.001214, " together", false], [45285, 0.000735, " before", false], [30218, 0.00061, " back", false], [4712, 0.000538, " on", false]]], "model_b": [4811, 1, 0.9016938805580139, [[4811, 0.901694, " to", false], [57435, 0.031587, " together", false], [64430, 0.021568, " increasingly", false], [31162, 0.017167, " into", false], [38499, 0.003778, " first", false], [22249, 0.002935, " out", false], [31458, 0.002383, " more", false], [4596, 0.001676, " in", false], [4423, 0.001541, " as", false], [40062, 0.001282, " under", false]]]}, "raw_delta": -0.020833333333333332, "tuned_delta": 0.03325626408174226}, {"byte_start": 3753, "byte_end": 3762, "display": {"text": " dominate", "kind": "normal"}, "is_word": true, "word_id": 647, "word_key": " dominate", "bytes_hex": "20 64 6f 6d 69 6e 61 74 65", "compression": {"model_a": "1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89%", "model_b": "1.74% 1.74% 1.74% 1.74% 1.74% 1.74% 1.74% 1.74% 1.74%"}, "model_tokens": {"model_a": [[56041, " dominate", "normal", 0.3885592222213745]], "model_b": [[56041, " dominate", "normal", 0.4188868999481201]]}, "loss": {"model_a": 1.8863362893567714, "model_b": 1.737620980237358}, "topk": {"model_a": [56041, 1, 0.3885592222213745, [[56041, 0.388559, " dominate", false], [4435, 0.274421, " be", false], [31702, 0.051946, " play", false], [52716, 0.045106, " replace", false], [31907, 0.043391, " rule", false], [32187, 0.029668, " take", false], [56906, 0.026743, " predomin", false], [22590, 0.020774, " the", false], [52550, 0.008612, " prevail", false], [31059, 0.005651, " have", false]]], "model_b": [56041, 1, 0.4188868999481201, [[56041, 0.418887, " dominate", false], [4435, 0.28993, " be", false], [32187, 0.026905, " take", false], [22590, 0.023162, " the", false], [22770, 0.019245, " win", false], [31702, 0.018936, " play", false], [31907, 0.01676, " rule", false], [52716, 0.014633, " replace", false], [56906, 0.014613, " predomin", false], [31059, 0.012288, " have", false]]]}, "raw_delta": 0.008246527777777776, "tuned_delta": 0.062336125192853364}, {"byte_start": 3762, "byte_end": 3766, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 648, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "12.33% 12.33% 12.33% 12.33%", "model_b": "7.89% 7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.06447254866361618]], "model_b": [[22590, " the", "normal", 0.1703592836856842]]}, "loss": {"model_a": 12.327716413846122, "model_b": 7.889738504861517}, "topk": {"model_a": [22590, 3, 0.06447254866361618, [[47, 0.53756, ".", false], [45, 0.14881, ",", false], [22590, 0.064473, " the", false], [31601, 0.054655, " over", false], [21265, 0.054523, " and", false], [275, 0.013618, " (", false], [57103, 0.010165, " research", false], [4596, 0.009688, " in", false], [52224, 0.007401, " methods", false], [40187, 0.007125, " while", false]]], "model_b": [22590, 2, 0.1703592836856842, [[47, 0.448357, ".", false], [22590, 0.170359, " the", false], [45, 0.061848, ",", false], [21265, 0.036587, " and", false], [47350, 0.025236, " speech", false], [4596, 0.020175, " in", false], [21256, 0.01621, " all", false], [52299, 0.014395, " natural", false], [57103, 0.013474, " research", false], [31601, 0.011657, " over", false]]]}, "raw_delta": 0.24609375, "tuned_delta": 0.3001833474150756}, {"byte_start": 3766, "byte_end": 3772, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 649, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"model_a": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55%", "model_b": "3.64% 3.64% 3.64% 3.64% 3.64% 3.64%"}, "model_tokens": {"model_a": [[38478, " field", "normal", 0.3058306574821472]], "model_b": [[38478, " field", "normal", 0.2982555031776428]]}, "loss": {"model_a": 3.5456860542681228, "model_b": 3.639611512659331}, "topk": {"model_a": [38478, 1, 0.3058306574821472, [[38478, 0.305831, " field", false], [57103, 0.227717, " research", false], [52224, 0.069457, " methods", false], [39597, 0.028572, " scene", false], [39802, 0.028022, " state", false], [55532, 0.023143, " approach", false], [61590, 0.017995, " approaches", false], [45829, 0.01575, " effort", false], [59945, 0.012382, " landscape", false], [3609, 0.011517, " AI", false]]], "model_b": [38478, 1, 0.2982555031776428, [[38478, 0.298256, " field", false], [57103, 0.081519, " research", false], [55532, 0.053041, " approach", false], [52224, 0.041508, " methods", false], [30173, 0.021069, " area", false], [45829, 0.01824, " effort", false], [46561, 0.017071, " method", false], [45775, 0.015628, " domain", false], [3609, 0.014146, " AI", false], [52571, 0.013934, " process", false]]]}, "raw_delta": -0.005208333333333315, "tuned_delta": 0.04888126408174227}, {"byte_start": 3772, "byte_end": 3773, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "7.29%", "model_b": "4.21%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6675684452056885]], "model_b": [[47, ".", "normal", 0.7943127155303955]]}, "loss": {"model_a": 7.290963707617563, "model_b": 4.209034604156033}, "topk": {"model_a": [47, 1, 0.6675684452056885, [[47, 0.667568, ".", false], [45, 0.162354, ",", false], [21265, 0.051791, " and", false], [275, 0.015237, " (", false], [31601, 0.014673, " over", false], [4706, 0.013431, " of", false], [40187, 0.00995, " while", false], [4596, 0.006824, " in", false], [5346, 0.006287, "---", false], [4423, 0.005711, " as", false]]], "model_b": [47, 1, 0.7943127155303955, [[47, 0.794313, ".", false], [45, 0.065074, ",", false], [21265, 0.030174, " and", false], [4706, 0.028016, " of", false], [275, 0.013636, " (", false], [4596, 0.009326, " in", false], [4423, 0.007075, " as", false], [21700, 0.003426, " for", false], [5346, 0.003271, "---", false], [4424, 0.002207, " at", false]]]}, "raw_delta": 0.1708984375, "tuned_delta": 0.22498803491507557}, {"byte_start": 3773, "byte_end": 3777, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 650, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "10.92% 10.92% 10.92% 10.92%", "model_b": "11.20% 11.20% 11.20% 11.20%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.08902532607316971]], "model_b": [[20996, " The", "normal", 0.08266658335924149]]}, "loss": {"model_a": 10.918834537977993, "model_b": 11.20061091315162}, "topk": {"model_a": [20996, 2, 0.08902532607316971, [[261, 0.374472, "\n\n", false], [20996, 0.089025, " The", false], [29894, 0.041615, " This", false], [3913, 0.035407, " In", false], [3918, 0.029797, " It", false], [267, 0.022017, "  ", false], [37451, 0.019905, " There", false], [275, 0.01648, " (", false], [36251, 0.015892, " Again", false], [19555, 0.014609, " But", false]]], "model_b": [20996, 2, 0.08266658335924149, [[261, 0.328054, "\n\n", false], [20996, 0.082667, " The", false], [3913, 0.056123, " In", false], [29894, 0.049278, " This", false], [267, 0.027669, "  ", false], [3918, 0.022217, " It", false], [11, 0.018361, "\n", false], [37451, 0.01832, " There", false], [300, 0.01378, " A", false], [19555, 0.012802, " But", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 3777, "byte_end": 3784, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 651, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"model_a": "15.62% 15.62% 15.62% 15.62% 15.62% 15.62% 15.62%", "model_b": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"model_a": [[47014, " recent", "normal", 0.002348215552046895]], "model_b": [[47014, " recent", "normal", 0.002644717926159501]]}, "loss": {"model_a": 15.618461938195253, "model_b": 15.296431795139677}, "topk": {"model_a": [47014, 69, 0.002348215552046895, [[38720, 0.086211, " human", false], [63885, 0.079259, " statistical", false], [38328, 0.032405, " early", false], [19678, 0.028031, " DAR", false], [46430, 0.019183, " lesson", false], [52224, 0.018234, " methods", false], [52013, 0.017128, " initial", false], [62577, 0.014863, " statistics", false], [31937, 0.014523, " same", false], [47798, 0.014323, " winner", false]]], "model_b": [47014, 60, 0.002644717926159501, [[63885, 0.069084, " statistical", false], [38720, 0.066164, " human", false], [31937, 0.026832, " same", false], [38328, 0.02149, " early", false], [47009, 0.02053, " reason", false], [62577, 0.01792, " statistics", false], [38499, 0.016617, " first", false], [31461, 0.016406, " most", false], [21952, 0.01394, " key", false], [52964, 0.012248, " special", false]]]}, "raw_delta": 0.017857142857142905, "tuned_delta": 0.07194674027221849}, {"byte_start": 3784, "byte_end": 3789, "display": {"text": " rise", "kind": "normal"}, "is_word": true, "word_id": 652, "word_key": " rise", "bytes_hex": "20 72 69 73 65", "compression": {"model_a": "12.68% 12.68% 12.68% 12.68% 12.68%", "model_b": "12.57% 12.57% 12.57% 12.57% 12.57%"}, "model_tokens": {"model_a": [[31886, " rise", "normal", 0.029765283688902855]], "model_b": [[31886, " rise", "normal", 0.030451463535428047]]}, "loss": {"model_a": 12.679936882813154, "model_b": 12.567226332743704}, "topk": {"model_a": [31886, 5, 0.029765283688902855, [[53052, 0.158568, " success", false], [59687, 0.068896, " explosion", false], [60587, 0.045996, " successes", false], [22377, 0.032422, " res", false], [31886, 0.029765, " rise", false], [56950, 0.02179, " progress", false], [63469, 0.020988, " development", false], [32499, 0.020036, " work", false], [55465, 0.017368, " advances", false], [64266, 0.016526, " breakthrough", false]]], "model_b": [31886, 5, 0.030451463535428047, [[53052, 0.062276, " success", false], [22377, 0.043769, " res", false], [40009, 0.038958, " trend", false], [60587, 0.030758, " successes", false], [31886, 0.030451, " rise", false], [39859, 0.029991, " surge", false], [59687, 0.026644, " explosion", false], [55465, 0.023281, " advances", false], [52753, 0.019787, " revival", false], [63469, 0.016423, " development", false]]]}, "raw_delta": 0.006249999999999978, "tuned_delta": 0.060339597415075566}, {"byte_start": 3789, "byte_end": 3792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 653, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.83% 0.83% 0.83%", "model_b": "2.05% 2.05% 2.05%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.871516227722168]], "model_b": [[4706, " of", "normal", 0.7106306552886963]]}, "loss": {"model_a": 0.8277181020725253, "model_b": 2.054619402307687}, "topk": {"model_a": [4706, 1, 0.871516227722168, [[4706, 0.871516, " of", false], [4596, 0.097808, " in", false], [4811, 0.015521, " to", false], [21265, 0.009588, " and", false], [45, 0.002323, ",", false], [275, 0.001096, " (", false], [37635, 0.00029, " again", false], [30917, 0.000124, " from", false], [4600, 0.000124, " is", false], [30218, 0.000119, " back", false]]], "model_b": [4706, 1, 0.7106306552886963, [[4706, 0.710631, " of", false], [4596, 0.258063, " in", false], [4811, 0.013718, " to", false], [21265, 0.005357, " and", false], [45, 0.003388, ",", false], [275, 0.000987, " (", false], [30218, 0.00095, " back", false], [37635, 0.00093, " again", false], [32227, 0.000477, " that", false], [32487, 0.000385, " with", false]]]}, "raw_delta": -0.06803385416666667, "tuned_delta": -0.013944256751591083}, {"byte_start": 3792, "byte_end": 3797, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 654, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"model_a": "2.14% 2.14% 2.14% 2.14% 2.14%", "model_b": "3.92% 3.92% 3.92% 3.92% 3.92%"}, "model_tokens": {"model_a": [[30597, " deep", "normal", 0.547441840171814]], "model_b": [[30597, " deep", "normal", 0.3374604880809784]]}, "loss": {"model_a": 2.141500451319555, "model_b": 3.9166916149133963}, "topk": {"model_a": [30597, 1, 0.547441840171814, [[30597, 0.547442, " deep", false], [46658, 0.132981, " neural", false], [60342, 0.02775, " recurrent", false], [52167, 0.023649, " machine", false], [22590, 0.022831, " the", false], [59193, 0.020559, " attention", false], [4404, 0.020213, " ``", false], [64597, 0.009582, " transformers", false], [32497, 0.008067, " word", false], [63939, 0.007948, " transformer", false]]], "model_b": [30597, 1, 0.3374604880809784, [[30597, 0.33746, " deep", false], [52167, 0.095895, " machine", false], [46658, 0.062708, " neural", false], [38864, 0.041692, " large", false], [46086, 0.036579, " genera", false], [3609, 0.027691, " AI", false], [22590, 0.025462, " the", false], [52299, 0.014196, " natural", false], [63885, 0.012435, " statistical", false], [47350, 0.010631, " speech", false]]]}, "raw_delta": -0.09843750000000001, "tuned_delta": -0.04434790258492442}, {"byte_start": 3797, "byte_end": 3806, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 655, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38%", "model_b": "0.61% 0.61% 0.61% 0.61% 0.61% 0.61% 0.61% 0.61% 0.61%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.8255179524421692]], "model_b": [[56537, " learning", "normal", 0.7393114566802979]]}, "loss": {"model_a": 0.38352895509743484, "model_b": 0.6066019187765553}, "topk": {"model_a": [56537, 1, 0.8255179524421692, [[56537, 0.825518, " learning", false], [46658, 0.135234, " neural", false], [46, 0.01012, "-", false], [56705, 0.006017, " networks", false], [31510, 0.002088, " nets", false], [47350, 0.001926, " speech", false], [56529, 0.001691, " language", false], [46086, 0.001264, " genera", false], [45, 0.001217, ",", false], [46587, 0.000945, " models", false]]], "model_b": [56537, 1, 0.7393114566802979, [[56537, 0.739311, " learning", false], [46658, 0.126678, " neural", false], [46, 0.06092, "-", false], [52299, 0.007222, " natural", false], [46086, 0.004547, " genera", false], [47350, 0.004005, " speech", false], [47202, 0.003878, " search", false], [52167, 0.003836, " machine", false], [56529, 0.003507, " language", false], [46587, 0.003172, " models", false]]]}, "raw_delta": -0.012369791666666664, "tuned_delta": 0.041719805748408924}, {"byte_start": 3806, "byte_end": 3809, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 656, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "10.19% 10.19% 10.19%", "model_b": "11.93% 11.93% 11.93%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.18572263419628143]], "model_b": [[4596, " in", "normal", 0.13691382110118866]]}, "loss": {"model_a": 10.190912235446126, "model_b": 11.928533215683485}, "topk": {"model_a": [4596, 1, 0.18572263419628143, [[4596, 0.185723, " in", false], [45, 0.147007, ",", false], [21800, 0.124324, " has", false], [4600, 0.097739, " is", false], [52224, 0.050718, " methods", false], [21265, 0.038394, " and", false], [275, 0.032991, " (", false], [22748, 0.027951, " was", false], [21413, 0.024213, " can", false], [21700, 0.021879, " for", false]]], "model_b": [4596, 2, 0.13691382110118866, [[45, 0.166459, ",", false], [4596, 0.136914, " in", false], [21800, 0.135265, " has", false], [52224, 0.055335, " methods", false], [4600, 0.04643, " is", false], [275, 0.044795, " (", false], [21265, 0.042299, " and", false], [22748, 0.028936, " was", false], [4706, 0.028266, " of", false], [62633, 0.02588, " techniques", false]]]}, "raw_delta": -0.09635416666666674, "tuned_delta": -0.04226456925159115}, {"byte_start": 3809, "byte_end": 3816, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 657, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"model_a": "3.34% 3.34% 3.34% 3.34% 3.34% 3.34% 3.34%", "model_b": "2.51% 2.51% 2.51% 2.51% 2.51% 2.51% 2.51%"}, "model_tokens": {"model_a": [[47350, " speech", "normal", 0.27548930048942566]], "model_b": [[47350, " speech", "normal", 0.38338425755500793]]}, "loss": {"model_a": 3.3410627342015617, "model_b": 2.50579705065117}, "topk": {"model_a": [47350, 1, 0.27548930048942566, [[47350, 0.275489, " speech", false], [4047, 0.223361, " NL", false], [52299, 0.202829, " natural", false], [55809, 0.074227, " computer", false], [22590, 0.034189, " the", false], [32234, 0.033955, " this", false], [3609, 0.013477, " AI", false], [62293, 0.011698, " particular", false], [56529, 0.010611, " language", false], [52167, 0.010464, " machine", false]]], "model_b": [47350, 1, 0.38338425755500793, [[47350, 0.383384, " speech", false], [52299, 0.280843, " natural", false], [4047, 0.092876, " NL", false], [22590, 0.045401, " the", false], [32234, 0.030361, " this", false], [55809, 0.025359, " computer", false], [52167, 0.014952, " machine", false], [56529, 0.013114, " language", false], [50475, 0.012187, " Natural", false], [46658, 0.007812, " neural", false]]]}, "raw_delta": 0.0463169642857143, "tuned_delta": 0.10040656170078989}, {"byte_start": 3816, "byte_end": 3828, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 658, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"model_a": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%", "model_b": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"model_a": [[63821, " recognition", "normal", 0.7280098795890808]], "model_b": [[63821, " recognition", "normal", 0.7272058129310608]]}, "loss": {"model_a": 0.47549763310549326, "model_b": 0.48136797425494376}, "topk": {"model_a": [63821, 1, 0.7280098795890808, [[63821, 0.72801, " recognition", false], [21265, 0.124131, " and", false], [62378, 0.04523, " processing", false], [21800, 0.017489, " has", false], [45, 0.016553, ",", false], [4600, 0.012477, " is", false], [275, 0.004673, " (", false], [46, 0.004609, "-", false], [22748, 0.004023, " was", false], [62634, 0.003172, " technology", false]]], "model_b": [63821, 1, 0.7272058129310608, [[63821, 0.727206, " recognition", false], [62378, 0.062853, " processing", false], [21265, 0.054349, " and", false], [21800, 0.026832, " has", false], [45, 0.018614, ",", false], [46, 0.013463, "-", false], [4600, 0.011626, " is", false], [22748, 0.006144, " was", false], [60335, 0.005318, " recognize", false], [275, 0.004477, " (", false]]]}, "raw_delta": -0.0003255208333333322, "tuned_delta": 0.05376407658174226}, {"byte_start": 3828, "byte_end": 3831, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 659, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "8.08% 8.08% 8.08%", "model_b": "7.51% 7.51% 7.51%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.2587813138961792]], "model_b": [[4600, " is", "normal", 0.28831809759140015]]}, "loss": {"model_a": 8.077589421643935, "model_b": 7.514036671296684}, "topk": {"model_a": [4600, 1, 0.2587813138961792, [[4600, 0.258781, " is", false], [21800, 0.16979, " has", false], [21265, 0.153793, " and", false], [45, 0.102155, ",", false], [22748, 0.078371, " was", false], [21413, 0.023739, " can", false], [275, 0.020406, " (", false], [39680, 0.007059, " shows", false], [22074, 0.006559, " may", false], [30135, 0.006528, " also", false]]], "model_b": [4600, 1, 0.28831809759140015, [[4600, 0.288318, " is", false], [45, 0.122653, ",", false], [21800, 0.10541, " has", false], [22748, 0.085073, " was", false], [21265, 0.053661, " and", false], [275, 0.026528, " (", false], [22074, 0.017887, " may", false], [21413, 0.017063, " can", false], [30135, 0.01557, " also", false], [39680, 0.011869, " shows", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08533959741507559}, {"byte_start": 3831, "byte_end": 3835, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 660, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.78% 10.78% 10.78% 10.78%", "model_b": "13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09131397306919098]], "model_b": [[22590, " the", "normal", 0.05363049358129501]]}, "loss": {"model_a": 10.777946350391181, "model_b": 13.173045539367}, "topk": {"model_a": [22590, 2, 0.09131397306919098, [[332, 0.252089, " a", false], [22590, 0.091314, " the", false], [4419, 0.089771, " an", false], [50919, 0.049306, " another", false], [31198, 0.035743, " just", false], [22797, 0.031289, " yet", false], [4596, 0.023604, " in", false], [47285, 0.021613, " simply", false], [21572, 0.020608, " due", false], [52906, 0.018816, " similar", false]]], "model_b": [22590, 4, 0.05363049358129501, [[332, 0.330597, " a", false], [4419, 0.081437, " an", false], [50919, 0.080014, " another", false], [22590, 0.05363, " the", false], [37810, 0.038687, " based", false], [52094, 0.021589, " largely", false], [4596, 0.019114, " in", false], [21572, 0.018747, " due", false], [30135, 0.017568, " also", false], [22226, 0.01433, " one", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07872290258492441}, {"byte_start": 3835, "byte_end": 3840, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 661, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"model_a": "8.06% 8.06% 8.06% 8.06% 8.06%", "model_b": "8.17% 8.17% 8.17% 8.17% 8.17%"}, "model_tokens": {"model_a": [[31461, " most", "normal", 0.10850495100021362]], "model_b": [[31461, " most", "normal", 0.10331621021032333]]}, "loss": {"model_a": 8.058804329965694, "model_b": 8.171514880035144}, "topk": {"model_a": [31461, 2, 0.10850495100021362, [[46404, 0.375387, " latest", false], [31461, 0.108505, " most", false], [45635, 0.106246, " culmin", false], [52299, 0.05548, " natural", false], [64328, 0.047418, " continuation", false], [52154, 0.035014, " logical", false], [47092, 0.029192, " result", false], [31515, 0.028893, " next", false], [31937, 0.018856, " same", false], [38491, 0.015832, " final", false]]], "model_b": [31461, 2, 0.10331621021032333, [[47092, 0.18501, " result", false], [31461, 0.103316, " most", false], [46404, 0.089672, " latest", false], [45635, 0.062413, " culmin", false], [52748, 0.039435, " reverse", false], [52574, 0.028417, " product", false], [46588, 0.024008, " modern", false], [45752, 0.01872, " direct", false], [56767, 0.016515, " opposite", false], [31937, 0.015127, " same", false]]]}, "raw_delta": -0.006249999999999978, "tuned_delta": 0.04783959741507561}, {"byte_start": 3840, "byte_end": 3847, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 662, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"model_a": "1.53% 1.53% 1.53% 1.53% 1.53% 1.53% 1.53%", "model_b": "4.17% 4.17% 4.17% 4.17% 4.17% 4.17% 4.17%"}, "model_tokens": {"model_a": [[47014, " recent", "normal", 0.5541421175003052]], "model_b": [[47014, " recent", "normal", 0.1992841511964798]]}, "loss": {"model_a": 1.529643179513968, "model_b": 4.166264975781465}, "topk": {"model_a": [47014, 1, 0.5541421175003052, [[47014, 0.554142, " recent", false], [56056, 0.097038, " dramatic", false], [52346, 0.083036, " obvious", false], [63878, 0.028788, " spectacular", false], [51699, 0.023407, " extreme", false], [60273, 0.023087, " prominent", false], [53296, 0.020328, " visible", false], [57323, 0.020291, " striking", false], [59829, 0.014216, " important", false], [45752, 0.011239, " direct", false]]], "model_b": [47014, 2, 0.1992841511964798, [[56056, 0.274642, " dramatic", false], [47014, 0.199284, " recent", false], [52346, 0.089415, " obvious", false], [57323, 0.086686, " striking", false], [63878, 0.029251, " spectacular", false], [63870, 0.02581, " significant", false], [59829, 0.018553, " important", false], [62477, 0.017155, " remarkable", false], [53296, 0.014375, " visible", false], [52321, 0.013948, " notable", false]]]}, "raw_delta": -0.14620535714285718, "tuned_delta": -0.09211575972778159}, {"byte_start": 3847, "byte_end": 3852, "display": {"text": " step", "kind": "normal"}, "is_word": true, "word_id": 663, "word_key": " step", "bytes_hex": "20 73 74 65 70", "compression": {"model_a": "17.47% 17.47% 17.47% 17.47% 17.47%", "model_b": "17.02% 17.02% 17.02% 17.02% 17.02%"}, "model_tokens": {"model_a": [[32115, " step", "normal", 0.007795756217092276]], "model_b": [[32115, " step", "normal", 0.008976245298981667]]}, "loss": {"model_a": 17.47013526076479, "model_b": 17.019293060486987}, "topk": {"model_a": [32115, 18, 0.007795756217092276, [[51668, 0.367121, " example", false], [64955, 0.082502, " manifestation", false], [21265, 0.05559, " and", false], [45, 0.030289, ",", false], [56467, 0.028381, " instance", false], [53275, 0.023527, " version", false], [59695, 0.021506, " extension", false], [63469, 0.018923, " development", false], [59932, 0.016977, " iteration", false], [4706, 0.016629, " of", false]]], "model_b": [32115, 15, 0.008976245298981667, [[51668, 0.28956, " example", false], [64955, 0.181301, " manifestation", false], [21265, 0.049563, " and", false], [32139, 0.025814, " such", false], [45, 0.019627, ",", false], [56467, 0.0185, " instance", false], [4706, 0.018134, " of", false], [63469, 0.016909, " development", false], [53275, 0.016036, " version", false], [46263, 0.012352, " incarn", false]]]}, "raw_delta": 0.025000000000000022, "tuned_delta": 0.07908959741507561}, {"byte_start": 3852, "byte_end": 3855, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 664, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "1.51% 1.51% 1.51%", "model_b": "1.93% 1.93% 1.93%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.7774576544761658]], "model_b": [[4596, " in", "normal", 0.7240283489227295]]}, "loss": {"model_a": 1.514548016558238, "model_b": 1.925471897019775}, "topk": {"model_a": [4596, 1, 0.7774576544761658, [[4596, 0.777458, " in", false], [37678, 0.097522, " along", false], [4706, 0.049117, " of", false], [45, 0.009862, ",", false], [4712, 0.009206, " on", false], [47, 0.007668, ".", false], [53169, 0.006621, " towards", false], [30678, 0.005657, " down", false], [47585, 0.00557, " toward", false], [30211, 0.005053, " away", false]]], "model_b": [4596, 1, 0.7240283489227295, [[4596, 0.724028, " in", false], [47585, 0.04157, " toward", false], [53169, 0.03986, " towards", false], [4706, 0.030647, " of", false], [32227, 0.028925, " that", false], [4712, 0.016245, " on", false], [37678, 0.011808, " along", false], [47, 0.010194, ".", false], [30211, 0.010161, " away", false], [45, 0.010129, ",", false]]]}, "raw_delta": -0.02278645833333333, "tuned_delta": 0.03130313908174226}, {"byte_start": 3855, "byte_end": 3860, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 665, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "1.73% 1.73% 1.73% 1.73% 1.73%", "model_b": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.6161835193634033]], "model_b": [[32234, " this", "normal", 0.5498917698860168]]}, "loss": {"model_a": 1.725880297938457, "model_b": 2.141500451319555}, "topk": {"model_a": [32234, 1, 0.6161835193634033, [[32234, 0.616184, " this", false], [32227, 0.182241, " that", false], [22590, 0.116104, " the", false], [332, 0.058396, " a", false], [4419, 0.006048, " an", false], [32464, 0.002821, " what", false], [39936, 0.002457, " these", false], [61774, 0.001212, " continuing", false], [59725, 0.00076, " following", false], [55531, 0.000565, " applying", false]]], "model_b": [32234, 1, 0.5498917698860168, [[32234, 0.549892, " this", false], [22590, 0.192025, " the", false], [32227, 0.091217, " that", false], [332, 0.089583, " a", false], [4419, 0.010919, " an", false], [32139, 0.004368, " such", false], [32464, 0.004258, " what", false], [38888, 0.003684, " lever", false], [59611, 0.002258, " embracing", false], [47497, 0.002097, " taking", false]]]}, "raw_delta": -0.023046874999999994, "tuned_delta": 0.031042722415075594}, {"byte_start": 3860, "byte_end": 3871, "display": {"text": " consistent", "kind": "normal"}, "is_word": true, "word_id": 666, "word_key": " consistent", "bytes_hex": "20 63 6f 6e 73 69 73 74 65 6e 74", "compression": {"model_a": "17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83%", "model_b": "13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22%"}, "model_tokens": {"model_a": [[61756, " consistent", "normal", 1.863027318904642e-05]], "model_b": [[61756, " consistent", "normal", 0.00030854842043481767]]}, "loss": {"model_a": 17.82875973825849, "model_b": 13.217873599053709}, "topk": {"model_a": [61756, 861, 1.863027318904642e-05, [[52571, 0.155838, " process", false], [31323, 0.116301, " long", false], [59657, 0.081685, " evolution", false], [40009, 0.073981, " trend", false], [59526, 0.063072, " direction", false], [31937, 0.042181, " same", false], [51832, 0.031156, " general", false], [45450, 0.030962, " change", false], [63797, 0.029158, " progression", false], [52427, 0.023598, " pattern", false]]], "model_b": [61756, 151, 0.00030854842043481767, [[40009, 0.272738, " trend", false], [59526, 0.094869, " direction", false], [52571, 0.091709, " process", false], [31323, 0.070773, " long", false], [52427, 0.065293, " pattern", false], [51832, 0.043413, " general", false], [59657, 0.022136, " evolution", false], [45450, 0.016036, " change", false], [51929, 0.015964, " history", false], [63797, 0.01407, " progression", false]]]}, "raw_delta": 0.2556818181818183, "tuned_delta": 0.30977141559689386}, {"byte_start": 3871, "byte_end": 3881, "display": {"text": " direction", "kind": "normal"}, "is_word": true, "word_id": 667, "word_key": " direction", "bytes_hex": "20 64 69 72 65 63 74 69 6f 6e", "compression": {"model_a": "7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83%", "model_b": "7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50%"}, "model_tokens": {"model_a": [[59526, " direction", "normal", 0.012842195108532906]], "model_b": [[59526, " direction", "normal", 0.015553847886621952]]}, "loss": {"model_a": 7.833383229826794, "model_b": 7.495251579618443}, "topk": {"model_a": [59526, 12, 0.012842195108532906, [[52427, 0.258604, " pattern", false], [40009, 0.198655, " trend", false], [45, 0.0538, ",", false], [63797, 0.03342, " progression", false], [59657, 0.032109, " evolution", false], [56950, 0.031539, " progress", false], [21265, 0.027424, " and", false], [45450, 0.026849, " change", false], [39664, 0.023627, " shift", false], [52571, 0.019469, " process", false]]], "model_b": [59526, 7, 0.015553847886621952, [[40009, 0.445391, " trend", false], [52427, 0.247425, " pattern", false], [45, 0.024252, ",", false], [51832, 0.023245, " general", false], [21265, 0.023013, " and", false], [52571, 0.017151, " process", false], [59526, 0.015554, " direction", false], [59657, 0.015232, " evolution", false], [63797, 0.009554, " progression", false], [62061, 0.008982, " historical", false]]]}, "raw_delta": 0.01874999999999999, "tuned_delta": 0.07283959741507558}, {"byte_start": 3881, "byte_end": 3882, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.78%", "model_b": "6.76%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7278621196746826]], "model_b": [[47, ".", "normal", 0.6875604391098022]]}, "loss": {"model_a": 5.776415691059325, "model_b": 6.762633004167015}, "topk": {"model_a": [47, 1, 0.7278621196746826, [[47, 0.727862, ".", false], [45, 0.125623, ",", false], [4706, 0.062274, " of", false], [5346, 0.010447, "---", false], [21265, 0.009084, " and", false], [4596, 0.006474, " in", false], [30917, 0.006027, " from", false], [53169, 0.006012, " towards", false], [275, 0.005598, " (", false], [32227, 0.005451, " that", false]]], "model_b": [47, 1, 0.6875604391098022, [[47, 0.68756, ".", false], [45, 0.121418, ",", false], [4706, 0.109738, " of", false], [5346, 0.017226, "---", false], [59, 0.009308, ":", false], [4596, 0.008968, " in", false], [275, 0.008142, " (", false], [21265, 0.005159, " and", false], [60, 0.004104, ";", false], [32227, 0.003264, " that", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 3882, "byte_end": 3887, "display": {"text": " Deep", "kind": "normal"}, "is_word": true, "word_id": 668, "word_key": " deep", "bytes_hex": "20 44 65 65 70", "compression": {"model_a": "13.98% 13.98% 13.98% 13.98% 13.98%", "model_b": "13.86% 13.86% 13.86% 13.86% 13.86%"}, "model_tokens": {"model_a": [[28753, " Deep", "normal", 0.02122342400252819]], "model_b": [[28753, " Deep", "normal", 0.021273121237754822]]}, "loss": {"model_a": 13.976108208611832, "model_b": 13.863397658542382}, "topk": {"model_a": [28753, 4, 0.02122342400252819, [[261, 0.624039, "\n\n", false], [20996, 0.042449, " The", false], [3918, 0.033713, " It", false], [28753, 0.021223, " Deep", false], [3913, 0.020742, " In", false], [267, 0.018436, "  ", false], [44900, 0.011442, " Speech", false], [37451, 0.011002, " There", false], [29894, 0.009622, " This", false], [3336, 0.008285, " \n\n", false]]], "model_b": [28753, 7, 0.021273121237754822, [[261, 0.514675, "\n\n", false], [20996, 0.058912, " The", false], [3913, 0.036517, " In", false], [267, 0.035422, "  ", false], [11, 0.032646, "\n", false], [3918, 0.028816, " It", false], [28753, 0.021273, " Deep", false], [29894, 0.015167, " This", false], [3336, 0.012879, " \n\n", false], [19555, 0.009042, " But", false]]]}, "raw_delta": 0.006249999999999978, "tuned_delta": 0.060339597415075566}, {"byte_start": 3887, "byte_end": 3896, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 669, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "model_b": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.9430890083312988]], "model_b": [[56537, " learning", "normal", 0.9395096302032471]]}, "loss": {"model_a": 0.11789601808479822, "model_b": 0.12474474942582386}, "topk": {"model_a": [56537, 1, 0.9430890083312988, [[56537, 0.943089, " learning", false], [46658, 0.019796, " neural", false], [46, 0.011293, "-", false], [56705, 0.003299, " networks", false], [47350, 0.001933, " speech", false], [31510, 0.00187, " nets", false], [55122, 0.001551, " Learning", false], [46587, 0.001416, " models", false], [45, 0.001409, ",", false], [52224, 0.001401, " methods", false]]], "model_b": [56537, 1, 0.9395096302032471, [[56537, 0.93951, " learning", false], [46658, 0.017134, " neural", false], [46, 0.007684, "-", false], [52224, 0.006353, " methods", false], [1857, 0.002766, "er", false], [47202, 0.00253, " search", false], [55122, 0.001871, " Learning", false], [47350, 0.001695, " speech", false], [56705, 0.001092, " networks", false], [61590, 0.000768, " approaches", false]]]}, "raw_delta": -0.0003797743055555551, "tuned_delta": 0.053709823109520036}, {"byte_start": 3896, "byte_end": 3904, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 670, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68%", "model_b": "8.03% 8.03% 8.03% 8.03% 8.03% 8.03% 8.03% 8.03%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.1253858208656311]], "model_b": [[52224, " methods", "normal", 0.02816818654537201]]}, "loss": {"model_a": 4.684532237261526, "model_b": 8.030626692448331}, "topk": {"model_a": [52224, 2, 0.1253858208656311, [[4600, 0.220187, " is", false], [52224, 0.125386, " methods", false], [45, 0.089534, ",", false], [21800, 0.074177, " has", false], [21413, 0.028607, " can", false], [32356, 0.025294, " uses", false], [30659, 0.0252, " does", false], [22748, 0.017888, " was", false], [4596, 0.016556, " in", false], [62633, 0.015841, " techniques", false]]], "model_b": [52224, 6, 0.02816818654537201, [[4600, 0.274082, " is", false], [45, 0.1096, ",", false], [21800, 0.075477, " has", false], [22748, 0.047108, " was", false], [32356, 0.041225, " uses", false], [52224, 0.028168, " methods", false], [4596, 0.022942, " in", false], [21413, 0.017481, " can", false], [47056, 0.014223, " relies", false], [56540, 0.013092, " leverage", false]]]}, "raw_delta": -0.185546875, "tuned_delta": -0.13145727758492443}, {"byte_start": 3904, "byte_end": 3909, "display": {"text": " rely", "kind": "normal"}, "is_word": true, "word_id": 671, "word_key": " rely", "bytes_hex": "20 72 65 6c 79", "compression": {"model_a": "17.13% 17.13% 17.13% 17.13% 17.13%", "model_b": "14.26% 14.26% 14.26% 14.26% 14.26%"}, "model_tokens": {"model_a": [[31856, " rely", "normal", 0.008645105175673962]], "model_b": [[31856, " rely", "normal", 0.019426267594099045]]}, "loss": {"model_a": 17.13200361055644, "model_b": 14.257884583785458}, "topk": {"model_a": [31856, 16, 0.008645105175673962, [[21286, 0.264944, " are", false], [45, 0.115213, ",", false], [31059, 0.094583, " have", false], [4491, 0.04506, " do", false], [21413, 0.033538, " can", false], [22681, 0.022545, " use", false], [56540, 0.019318, " leverage", false], [32187, 0.017729, " take", false], [32462, 0.015626, " were", false], [4596, 0.012693, " in", false]]], "model_b": [31856, 12, 0.019426267594099045, [[21286, 0.217893, " are", false], [45, 0.096698, ",", false], [31059, 0.087078, " have", false], [22681, 0.037074, " use", false], [32462, 0.03702, " were", false], [56540, 0.031305, " leverage", false], [21413, 0.025959, " can", false], [32187, 0.023354, " take", false], [37810, 0.020638, " based", false], [4491, 0.019986, " do", false]]]}, "raw_delta": 0.15937499999999993, "tuned_delta": 0.2134645974150755}, {"byte_start": 3909, "byte_end": 3914, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 672, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "21.19% 21.19% 21.19% 21.19% 21.19%", "model_b": "29.76% 29.76% 29.76% 29.76% 29.76%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.0027790244203060865]], "model_b": [[30788, " even", "normal", 0.00026548324967734516]]}, "loss": {"model_a": 21.18958341305665, "model_b": 29.755585218334865}, "topk": {"model_a": [30788, 25, 0.0027790244203060865, [[4712, 0.70067, " on", false], [51919, 0.120362, " heavily", false], [31458, 0.014284, " more", false], [32350, 0.014111, " upon", false], [4596, 0.010824, " in", false], [45, 0.009702, ",", false], [31466, 0.009266, " much", false], [32386, 0.008866, " very", false], [45145, 0.007483, " almost", false], [60247, 0.005988, " primarily", false]]], "model_b": [30788, 61, 0.00026548324967734516, [[4712, 0.648001, " on", false], [51919, 0.17831, " heavily", false], [32350, 0.021797, " upon", false], [56131, 0.016035, " entirely", false], [45145, 0.008907, " almost", false], [60247, 0.00782, " primarily", false], [31458, 0.005946, " more", false], [22187, 0.005343, " not", false], [45, 0.005328, ",", false], [4596, 0.005233, " in", false]]]}, "raw_delta": -0.4749999999999998, "tuned_delta": -0.42091040258492424}, {"byte_start": 3914, "byte_end": 3919, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 673, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99% 10.99%", "model_b": "8.90% 8.90% 8.90% 8.90% 8.90%"}, "model_tokens": {"model_a": [[31277, " less", "normal", 0.04748174548149109]], "model_b": [[31277, " less", "normal", 0.08496444672346115]]}, "loss": {"model_a": 10.9892786317714, "model_b": 8.904133455486571}, "topk": {"model_a": [31277, 2, 0.04748174548149109, [[31458, 0.944053, " more", false], [31277, 0.047482, " less", false], [51816, 0.004451, " further", false], [4712, 0.001177, " on", false], [45501, 0.000384, " closer", false], [51918, 0.000374, " heavier", false], [31466, 0.000311, " much", false], [57326, 0.000217, " stronger", false], [4596, 0.000203, " in", false], [51919, 0.000181, " heavily", false]]], "model_b": [31277, 2, 0.08496444672346115, [[31458, 0.895586, " more", false], [31277, 0.084964, " less", false], [4712, 0.003001, " on", false], [51816, 0.002943, " further", false], [51867, 0.002841, " greater", false], [51919, 0.002179, " heavily", false], [46397, 0.000752, " larger", false], [22190, 0.000537, " now", false], [57326, 0.000467, " stronger", false], [31466, 0.000448, " much", false]]]}, "raw_delta": 0.11562499999999998, "tuned_delta": 0.16971459741507555}, {"byte_start": 3919, "byte_end": 3922, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 674, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.55% 0.55% 0.55%", "model_b": "0.22% 0.22% 0.22%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9120094180107117]], "model_b": [[4712, " on", "normal", 0.964267909526825]]}, "loss": {"model_a": 0.5547472386230755, "model_b": 0.2186702078170324}, "topk": {"model_a": [4712, 1, 0.9120094180107117, [[4712, 0.912009, " on", false], [32226, 0.044922, " than", false], [32350, 0.022266, " upon", false], [56003, 0.007307, " directly", false], [45, 0.002262, ",", false], [51919, 0.00214, " heavily", false], [275, 0.002018, " (", false], [61983, 0.001878, " explicitly", false], [4706, 0.000545, " of", false], [4596, 0.00038, " in", false]]], "model_b": [4712, 1, 0.964267909526825, [[4712, 0.964268, " on", false], [32350, 0.006241, " upon", false], [51919, 0.006062, " heavily", false], [4706, 0.002864, " of", false], [21265, 0.002845, " and", false], [61983, 0.002655, " explicitly", false], [45, 0.002384, ",", false], [275, 0.001801, " (", false], [32226, 0.001245, " than", false], [4715, 0.000918, " or", false]]]}, "raw_delta": 0.018636067708333336, "tuned_delta": 0.07272566512340892}, {"byte_start": 3922, "byte_end": 3928, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 675, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "1.01% 1.01% 1.01% 1.01% 1.01% 1.01%", "model_b": "1.64% 1.64% 1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.7140908241271973]], "model_b": [[38720, " human", "normal", 0.5795212388038635]]}, "loss": {"model_a": 1.009698677705492, "model_b": 1.6436955218461495}, "topk": {"model_a": [38720, 1, 0.7140908241271973, [[38720, 0.714091, " human", false], [22590, 0.044683, " the", false], [59943, 0.034845, " knowledge", false], [45775, 0.01886, " domain", false], [52964, 0.017018, " special", false], [56179, 0.0119, " explicit", false], [21273, 0.011628, " any", false], [39356, 0.011557, " prior", false], [63875, 0.010436, " specialized", false], [65034, 0.009299, " understanding", false]]], "model_b": [38720, 1, 0.5795212388038635, [[38720, 0.579521, " human", false], [59943, 0.056108, " knowledge", false], [22590, 0.041026, " the", false], [52964, 0.021224, " special", false], [21273, 0.016007, " any", false], [52195, 0.013452, " massive", false], [46227, 0.013187, " humans", false], [332, 0.012524, " a", false], [63885, 0.010746, " statistical", false], [63370, 0.01038, " computation", false]]]}, "raw_delta": -0.03515624999999999, "tuned_delta": 0.018933347415075595}, {"byte_start": 3928, "byte_end": 3938, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 676, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "model_b": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.7569496035575867]], "model_b": [[59943, " knowledge", "normal", 0.6772744059562683]]}, "loss": {"model_a": 0.5001530659331854, "model_b": 0.7009187332443938}, "topk": {"model_a": [59943, 1, 0.7569496035575867, [[59943, 0.75695, " knowledge", false], [46, 0.081589, "-", false], [65034, 0.081567, " understanding", false], [38786, 0.044524, " input", false], [59683, 0.006586, " expertise", false], [45775, 0.002684, " domain", false], [62182, 0.001964, " linguistic", false], [46297, 0.00156, " inputs", false], [52022, 0.001245, " insight", false], [39356, 0.001195, " prior", false]]], "model_b": [59943, 1, 0.6772744059562683, [[59943, 0.677274, " knowledge", false], [38786, 0.144451, " input", false], [46, 0.057818, "-", false], [65034, 0.054215, " understanding", false], [59683, 0.004882, " expertise", false], [46297, 0.003512, " inputs", false], [56537, 0.002679, " learning", false], [63637, 0.00235, " information", false], [45829, 0.002213, " effort", false], [52022, 0.001802, " insight", false]]]}, "raw_delta": -0.0111328125, "tuned_delta": 0.04295678491507559}, {"byte_start": 3938, "byte_end": 3939, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "36.35%", "model_b": "31.28%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.1320059448480606]], "model_b": [[45, ",", "normal", 0.17764297127723694]]}, "loss": {"model_a": 36.34915239739771, "model_b": 31.277177644272445}, "topk": {"model_a": [45, 3, 0.1320059448480606, [[32226, 0.434867, " than", false], [21265, 0.176853, " and", false], [45, 0.132006, ",", false], [47, 0.057793, ".", false], [4706, 0.049093, " of", false], [5346, 0.038115, "---", false], [275, 0.023135, " (", false], [37598, 0.016251, " about", false], [4596, 0.013484, " in", false], [60, 0.008025, ";", false]]], "model_b": [45, 2, 0.17764297127723694, [[32226, 0.26249, " than", false], [45, 0.177643, ",", false], [21265, 0.172964, " and", false], [4706, 0.140372, " of", false], [275, 0.038526, " (", false], [47, 0.033814, ".", false], [5346, 0.030928, "---", false], [4811, 0.023756, " to", false], [4596, 0.02315, " in", false], [37598, 0.017371, " about", false]]]}, "raw_delta": 0.28125, "tuned_delta": 0.3353395974150756}, {"byte_start": 3939, "byte_end": 3943, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 677, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.07% 4.07% 4.07% 4.07%", "model_b": "4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.40637195110321045]], "model_b": [[21265, " and", "normal", 0.35582661628723145]]}, "loss": {"model_a": 4.0681464165692205, "model_b": 4.684532237261526}, "topk": {"model_a": [21265, 1, 0.40637195110321045, [[21265, 0.406372, " and", false], [21400, 0.121094, " but", false], [55495, 0.042003, " although", false], [39690, 0.036786, " since", false], [4423, 0.025259, " as", false], [52700, 0.021972, " relying", false], [40186, 0.021811, " which", false], [4788, 0.016831, " so", false], [30788, 0.015641, " even", false], [4596, 0.015513, " in", false]]], "model_b": [21265, 1, 0.35582661628723145, [[21265, 0.355827, " and", false], [21400, 0.132695, " but", false], [4596, 0.041121, " in", false], [4715, 0.028359, " or", false], [55495, 0.0274, " although", false], [4423, 0.027256, " as", false], [40085, 0.014946, " using", false], [52700, 0.014195, " relying", false], [51018, 0.012339, " because", false], [39690, 0.011695, " since", false]]]}, "raw_delta": -0.0341796875, "tuned_delta": 0.019909909915075588}, {"byte_start": 3943, "byte_end": 3947, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 678, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "20.15% 20.15% 20.15% 20.15%", "model_b": "18.17% 18.17% 18.17% 18.17%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.011399897746741772]], "model_b": [[22681, " use", "normal", 0.017957450821995735]]}, "loss": {"model_a": 20.147010824914233, "model_b": 18.174576198698855}, "topk": {"model_a": [22681, 17, 0.011399897746741772, [[31458, 0.165242, " more", false], [21286, 0.117427, " are", false], [32232, 0.065597, " they", false], [30788, 0.052148, " even", false], [31059, 0.035736, " have", false], [52028, 0.033725, " instead", false], [22590, 0.02727, " the", false], [4596, 0.022122, " in", false], [31856, 0.019772, " rely", false], [31466, 0.016966, " much", false]]], "model_b": [22681, 14, 0.017957450821995735, [[21286, 0.114785, " are", false], [32232, 0.060546, " they", false], [22590, 0.054299, " the", false], [31458, 0.04869, " more", false], [4596, 0.039472, " in", false], [30788, 0.036586, " even", false], [52028, 0.028162, " instead", false], [31856, 0.027271, " rely", false], [31059, 0.025116, " have", false], [21413, 0.023981, " can", false]]]}, "raw_delta": 0.109375, "tuned_delta": 0.16346459741507557}, {"byte_start": 3947, "byte_end": 3952, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 679, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "9.24% 9.24% 9.24% 9.24% 9.24%", "model_b": "15.22% 15.22% 15.22% 15.22% 15.22%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.07655905187129974]], "model_b": [[30788, " even", "normal", 0.014800889417529106]]}, "loss": {"model_a": 9.24226510569492, "model_b": 15.215924259375784}, "topk": {"model_a": [30788, 2, 0.07655905187129974, [[52195, 0.315936, " massive", false], [30788, 0.076559, " even", false], [31458, 0.062224, " more", false], [31466, 0.056573, " much", false], [63370, 0.054929, " computation", false], [21660, 0.038872, " far", false], [22590, 0.031434, " the", false], [332, 0.027923, " a", false], [31581, 0.024429, " only", false], [59988, 0.017011, " massively", false]]], "model_b": [30788, 10, 0.014800889417529106, [[31466, 0.157229, " much", false], [52195, 0.142968, " massive", false], [31458, 0.081367, " more", false], [332, 0.062622, " a", false], [63370, 0.037222, " computation", false], [22590, 0.032648, " the", false], [21660, 0.032309, " far", false], [51832, 0.016491, " general", false], [63885, 0.016116, " statistical", false], [30788, 0.014801, " even", false]]]}, "raw_delta": -0.33125000000000004, "tuned_delta": -0.27716040258492447}, {"byte_start": 3952, "byte_end": 3957, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 680, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"model_a": "1.01% 1.01% 1.01% 1.01% 1.01%", "model_b": "3.97% 3.97% 3.97% 3.97% 3.97%"}, "model_tokens": {"model_a": [[31458, " more", "normal", 0.7560068368911743]], "model_b": [[31458, " more", "normal", 0.333651065826416]]}, "loss": {"model_a": 1.0143949506250522, "model_b": 3.9730468899481215}, "topk": {"model_a": [31458, 1, 0.7560068368911743, [[31458, 0.756007, " more", false], [31277, 0.148203, " less", false], [46397, 0.019507, " larger", false], [51867, 0.018695, " greater", false], [38475, 0.016358, " fewer", false], [52195, 0.00631, " massive", false], [45305, 0.004635, " bigger", false], [51918, 0.003655, " heavier", false], [31466, 0.002748, " much", false], [52932, 0.002498, " smaller", false]]], "model_b": [31458, 2, 0.333651065826416, [[31277, 0.52536, " less", false], [31458, 0.333651, " more", false], [51867, 0.054376, " greater", false], [46397, 0.020322, " larger", false], [38475, 0.018139, " fewer", false], [31466, 0.006156, " much", false], [52932, 0.005954, " smaller", false], [46198, 0.004241, " higher", false], [45305, 0.00228, " bigger", false], [38940, 0.002185, " lower", false]]]}, "raw_delta": -0.1640625, "tuned_delta": -0.10997290258492441}, {"byte_start": 3957, "byte_end": 3969, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 681, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%", "model_b": "0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.8277170062065125]], "model_b": [[63370, " computation", "normal", 0.7226740121841431]]}, "loss": {"model_a": 0.2832439604609883, "model_b": 0.48723831540439433}, "topk": {"model_a": [63370, 1, 0.8277170062065125, [[63370, 0.827717, " computation", false], [52195, 0.091086, " massive", false], [4706, 0.011687, " of", false], [47202, 0.007348, " search", false], [64862, 0.006919, " computational", false], [59346, 0.005382, " computing", false], [63885, 0.003743, " statistical", false], [62577, 0.003425, " statistics", false], [51266, 0.003089, " compute", false], [64298, 0.003076, " computations", false]]], "model_b": [63370, 1, 0.7226740121841431, [[63370, 0.722674, " computation", false], [59346, 0.056647, " computing", false], [52195, 0.033442, " massive", false], [64862, 0.027166, " computational", false], [4706, 0.019484, " of", false], [62577, 0.018056, " statistics", false], [63885, 0.012712, " statistical", false], [51832, 0.011212, " general", false], [56900, 0.009361, " powerful", false], [51266, 0.005974, " compute", false]]]}, "raw_delta": -0.011311848958333337, "tuned_delta": 0.04277774845674225}, {"byte_start": 3969, "byte_end": 3970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "16.62%", "model_b": "17.89%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.38943740725517273]], "model_b": [[45, ",", "normal", 0.37782999873161316]]}, "loss": {"model_a": 16.62480613524391, "model_b": 17.892799823525227}, "topk": {"model_a": [45, 1, 0.38943740725517273, [[45, 0.389437, ",", false], [47, 0.335641, ".", false], [32226, 0.171496, " than", false], [275, 0.024748, " (", false], [4811, 0.019178, " to", false], [5346, 0.013557, "---", false], [21265, 0.007835, " and", false], [4596, 0.006923, " in", false], [22278, 0.004351, " per", false], [21700, 0.003568, " for", false]]], "model_b": [45, 1, 0.37782999873161316, [[45, 0.37783, ",", false], [47, 0.264017, ".", false], [32226, 0.182433, " than", false], [4811, 0.041959, " to", false], [4596, 0.03092, " in", false], [275, 0.019181, " (", false], [5346, 0.012807, "---", false], [21265, 0.010205, " and", false], [21700, 0.008503, " for", false], [22278, 0.006718, " per", false]]]}, "raw_delta": -0.0703125, "tuned_delta": -0.016222902584924412}, {"byte_start": 3970, "byte_end": 3979, "display": {"text": " together", "kind": "normal"}, "is_word": true, "word_id": 682, "word_key": " together", "bytes_hex": "20 74 6f 67 65 74 68 65 72", "compression": {"model_a": "22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67%", "model_b": "20.79% 20.79% 20.79% 20.79% 20.79% 20.79% 20.79% 20.79% 20.79%"}, "model_tokens": {"model_a": [[57435, " together", "normal", 1.166057882073801e-05]], "model_b": [[57435, " together", "normal", 3.148894029436633e-05]]}, "loss": {"model_a": 22.667343958411664, "model_b": 20.78883479058749}, "topk": {"model_a": [57435, 399, 1.166057882073801e-05, [[32226, 0.419946, " than", false], [21265, 0.179234, " and", false], [21400, 0.127153, " but", false], [4788, 0.052421, " so", false], [4811, 0.041217, " to", false], [40186, 0.028096, " which", false], [4596, 0.015641, " in", false], [4423, 0.010753, " as", false], [46500, 0.009051, " making", false], [55495, 0.00834, " although", false]]], "model_b": [57435, 293, 3.148894029436633e-05, [[32226, 0.428117, " than", false], [21265, 0.122553, " and", false], [4811, 0.090673, " to", false], [4596, 0.080044, " in", false], [21400, 0.066769, " but", false], [4423, 0.020523, " as", false], [4788, 0.0194, " so", false], [51018, 0.012016, " because", false], [21700, 0.010949, " for", false], [55794, 0.009873, " compared", false]]]}, "raw_delta": 0.10416666666666674, "tuned_delta": 0.15825626408174231}, {"byte_start": 3979, "byte_end": 3984, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 683, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "0.66% 0.66% 0.66% 0.66% 0.66%", "model_b": "0.62% 0.62% 0.62% 0.62% 0.62%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.8343991041183472]], "model_b": [[32487, " with", "normal", 0.8440451622009277]]}, "loss": {"model_a": 0.6551300722786797, "model_b": 0.6199080253819764}, "topk": {"model_a": [32487, 1, 0.8343991041183472, [[32487, 0.834399, " with", false], [47, 0.039435, ".", false], [4811, 0.014426, " to", false], [4596, 0.012325, " in", false], [45, 0.011111, ",", false], [57581, 0.006438, " yielding", false], [46500, 0.005494, " making", false], [56109, 0.004559, " enabling", false], [52107, 0.004248, " leading", false], [60264, 0.004239, " producing", false]]], "model_b": [32487, 1, 0.8440451622009277, [[32487, 0.844045, " with", false], [4811, 0.039822, " to", false], [45, 0.029923, ",", false], [47, 0.023023, ".", false], [46500, 0.00733, " making", false], [4596, 0.005967, " in", false], [55882, 0.003382, " creating", false], [21700, 0.00245, " for", false], [56109, 0.002026, " enabling", false], [57581, 0.001954, " yielding", false]]]}, "raw_delta": 0.001953125, "tuned_delta": 0.05604272241507559}, {"byte_start": 3984, "byte_end": 3993, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 684, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "model_b": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.01860511116683483]], "model_b": [[56537, " learning", "normal", 0.02960561029613018]]}, "loss": {"model_a": 7.983663963252727, "model_b": 7.044409379340641}, "topk": {"model_a": [56537, 6, 0.01860511116683483, [[52195, 0.365601, " massive", false], [22590, 0.073595, " the", false], [332, 0.051126, " a", false], [38864, 0.029114, " large", false], [31458, 0.019268, " more", false], [56537, 0.018605, " learning", false], [31466, 0.01559, " much", false], [45301, 0.014824, " better", false], [30789, 0.014687, " ever", false], [39193, 0.014503, " other", false]]], "model_b": [56537, 5, 0.02960561029613018, [[332, 0.107501, " a", false], [22590, 0.095537, " the", false], [63885, 0.064848, " statistical", false], [52195, 0.061392, " massive", false], [56537, 0.029606, " learning", false], [4419, 0.025034, " an", false], [22168, 0.023251, " new", false], [31458, 0.023142, " more", false], [52964, 0.019971, " special", false], [65014, 0.015532, " sophisticated", false]]]}, "raw_delta": 0.052083333333333315, "tuned_delta": 0.1061729307484089}, {"byte_start": 3993, "byte_end": 3996, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 685, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "31.93% 31.93% 31.93%", "model_b": "34.19% 34.19% 34.19%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.004880957771092653]], "model_b": [[4712, " on", "normal", 0.003417176427319646]]}, "loss": {"model_a": 31.934655853010906, "model_b": 34.18886685439991}, "topk": {"model_a": [4712, 18, 0.004880957771092653, [[47, 0.30545, ".", false], [4450, 0.176563, " by", false], [45, 0.122019, ",", false], [30917, 0.088815, " from", false], [4811, 0.039794, " to", false], [4596, 0.033555, " in", false], [61559, 0.031364, " algorithms", false], [21265, 0.019146, " and", false], [275, 0.017849, " (", false], [52224, 0.017621, " methods", false]]], "model_b": [4712, 20, 0.003417176427319646, [[4450, 0.27146, " by", false], [47, 0.136912, ".", false], [4811, 0.114867, " to", false], [45, 0.107846, ",", false], [4596, 0.081427, " in", false], [4706, 0.033578, " of", false], [62633, 0.027864, " techniques", false], [21265, 0.026944, " and", false], [30917, 0.026737, " from", false], [52224, 0.017686, " methods", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07091040258492441}, {"byte_start": 3996, "byte_end": 4001, "display": {"text": " huge", "kind": "normal"}, "is_word": true, "word_id": 686, "word_key": " huge", "bytes_hex": "20 68 75 67 65", "compression": {"model_a": "12.74% 12.74% 12.74% 12.74% 12.74%", "model_b": "10.37% 10.37% 10.37% 10.37% 10.37%"}, "model_tokens": {"model_a": [[31118, " huge", "normal", 0.02925737574696541]], "model_b": [[31118, " huge", "normal", 0.0562690831720829]]}, "loss": {"model_a": 12.73629215784788, "model_b": 10.369370606389422}, "topk": {"model_a": [31118, 5, 0.02925737574696541, [[52195, 0.548794, " massive", false], [22590, 0.085755, " the", false], [38864, 0.072956, " large", false], [332, 0.054133, " a", false], [31118, 0.029257, " huge", false], [30579, 0.023986, " data", false], [31466, 0.023553, " much", false], [32386, 0.016041, " very", false], [32373, 0.014164, " vast", false], [38720, 0.010161, " human", false]]], "model_b": [31118, 4, 0.0562690831720829, [[52195, 0.380914, " massive", false], [22590, 0.150684, " the", false], [332, 0.085207, " a", false], [31118, 0.056269, " huge", false], [38864, 0.054743, " large", false], [32373, 0.025763, " vast", false], [32386, 0.018616, " very", false], [39931, 0.015525, " their", false], [56125, 0.015343, " enormous", false], [30579, 0.014608, " data", false]]]}, "raw_delta": 0.1312500000000001, "tuned_delta": 0.18533959741507566}, {"byte_start": 4001, "byte_end": 4010, "display": {"text": " training", "kind": "normal"}, "is_word": true, "word_id": 687, "word_key": " training", "bytes_hex": "20 74 72 61 69 6e 69 6e 67", "compression": {"model_a": "9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08%", "model_b": "9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52%"}, "model_tokens": {"model_a": [[57453, " training", "normal", 0.010948601178824902]], "model_b": [[57453, " training", "normal", 0.008521446026861668]]}, "loss": {"model_a": 9.079460977816826, "model_b": 9.517779783642466}, "topk": {"model_a": [57453, 9, 0.010948601178824902, [[50897, 0.658448, " amounts", false], [55913, 0.081205, " datasets", false], [30579, 0.070438, " data", false], [45588, 0.030048, " corpor", false], [59442, 0.023973, " databases", false], [62426, 0.020156, " quantities", false], [45, 0.013483, ",", false], [63344, 0.013247, " collections", false], [57453, 0.010949, " training", false], [53304, 0.010588, " volumes", false]]], "model_b": [57453, 11, 0.008521446026861668, [[50897, 0.429333, " amounts", false], [55913, 0.140191, " datasets", false], [30579, 0.115541, " data", false], [45, 0.051261, ",", false], [31989, 0.027326, " sets", false], [53304, 0.026995, " volumes", false], [45588, 0.026567, " corpor", false], [62426, 0.016843, " quantities", false], [52333, 0.01119, " numbers", false], [63344, 0.008977, " collections", false]]]}, "raw_delta": -0.02430555555555558, "tuned_delta": 0.029784041859520008}, {"byte_start": 4010, "byte_end": 4015, "display": {"text": " sets", "kind": "normal"}, "is_word": true, "word_id": 688, "word_key": " sets", "bytes_hex": "20 73 65 74 73", "compression": {"model_a": "1.69% 1.69% 1.69% 1.69% 1.69%", "model_b": "4.03% 4.03% 4.03% 4.03% 4.03%"}, "model_tokens": {"model_a": [[31989, " sets", "normal", 0.6259512305259705]], "model_b": [[31989, " sets", "normal", 0.3260919749736786]]}, "loss": {"model_a": 1.6906582510417538, "model_b": 4.029402164982847}, "topk": {"model_a": [31989, 1, 0.6259512305259705, [[31989, 0.625951, " sets", false], [30579, 0.173782, " data", false], [55913, 0.104321, " datasets", false], [45588, 0.068904, " corpor", false], [59442, 0.011071, " databases", false], [63344, 0.004355, " collections", false], [52800, 0.001882, " samples", false], [21265, 0.001335, " and", false], [45590, 0.000819, " corpus", false], [56162, 0.000751, " examples", false]]], "model_b": [31989, 1, 0.3260919749736786, [[31989, 0.326092, " sets", false], [30579, 0.297504, " data", false], [45588, 0.242506, " corpor", false], [55913, 0.100733, " datasets", false], [52800, 0.004153, " samples", false], [59442, 0.002973, " databases", false], [63344, 0.002914, " collections", false], [22459, 0.002463, " set", false], [21265, 0.002292, " and", false], [45590, 0.001969, " corpus", false]]]}, "raw_delta": -0.1296875, "tuned_delta": -0.07559790258492442}, {"byte_start": 4015, "byte_end": 4016, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "40.01%", "model_b": "28.60%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.10759126394987106]], "model_b": [[45, ",", "normal", 0.20532141625881195]]}, "loss": {"model_a": 40.01224527465484, "model_b": 28.600302080123}, "topk": {"model_a": [45, 3, 0.10759126394987106, [[47, 0.626975, ".", false], [4706, 0.129354, " of", false], [45, 0.107591, ",", false], [32227, 0.027114, " that", false], [275, 0.018844, " (", false], [21265, 0.010868, " and", false], [5346, 0.010591, "---", false], [4811, 0.009913, " to", false], [30917, 0.007722, " from", false], [4596, 0.003982, " in", false]]], "model_b": [45, 2, 0.20532141625881195, [[47, 0.431747, ".", false], [45, 0.205321, ",", false], [4706, 0.161081, " of", false], [4811, 0.058657, " to", false], [21265, 0.024008, " and", false], [275, 0.023831, " (", false], [32227, 0.014128, " that", false], [30917, 0.009313, " from", false], [4596, 0.008887, " in", false], [4450, 0.008351, " by", false]]]}, "raw_delta": 0.6328125, "tuned_delta": 0.6869020974150756}, {"byte_start": 4016, "byte_end": 4019, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 689, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "5.82% 5.82% 5.82%", "model_b": "5.85% 5.85% 5.85%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.3826839327812195]], "model_b": [[4811, " to", "normal", 0.3767208755016327]]}, "loss": {"model_a": 5.82337842025493, "model_b": 5.846859784852732}, "topk": {"model_a": [4811, 1, 0.3826839327812195, [[4811, 0.382684, " to", false], [21265, 0.166266, " and", false], [32226, 0.067666, " than", false], [40186, 0.055081, " which", false], [4788, 0.050425, " so", false], [21400, 0.038161, " but", false], [4596, 0.026396, " in", false], [4423, 0.018309, " as", false], [21700, 0.012002, " for", false], [30322, 0.008568, " both", false]]], "model_b": [4811, 1, 0.3767208755016327, [[4811, 0.376721, " to", false], [32226, 0.172773, " than", false], [21265, 0.107117, " and", false], [4596, 0.055808, " in", false], [4423, 0.032243, " as", false], [21400, 0.023575, " but", false], [40186, 0.022079, " which", false], [21700, 0.018236, " for", false], [4788, 0.011444, " so", false], [55794, 0.009941, " compared", false]]]}, "raw_delta": -0.0013020833333333148, "tuned_delta": 0.05278751408174227}, {"byte_start": 4019, "byte_end": 4027, "display": {"text": " produce", "kind": "normal"}, "is_word": true, "word_id": 690, "word_key": " produce", "bytes_hex": "20 70 72 6f 64 75 63 65", "compression": {"model_a": "7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50%", "model_b": "7.43% 7.43% 7.43% 7.43% 7.43% 7.43% 7.43% 7.43%"}, "model_tokens": {"model_a": [[52573, " produce", "normal", 0.03572550788521767]], "model_b": [[52573, " produce", "normal", 0.03653605282306671]]}, "loss": {"model_a": 7.5022959889977825, "model_b": 7.431851895204376}, "topk": {"model_a": [52573, 3, 0.03572550788521767, [[50848, 0.177285, " achieve", false], [31358, 0.063811, " make", false], [52573, 0.035726, " produce", false], [51982, 0.032574, " improve", false], [22249, 0.030236, " out", false], [45851, 0.026567, " enable", false], [4491, 0.024796, " do", false], [39740, 0.022546, " solve", false], [38877, 0.019398, " learn", false], [30256, 0.017436, " beat", false]]], "model_b": [52573, 6, 0.03653605282306671, [[50848, 0.143961, " achieve", false], [52446, 0.05019, " perform", false], [4491, 0.049212, " do", false], [31358, 0.045967, " make", false], [51982, 0.043425, " improve", false], [52573, 0.036536, " produce", false], [56540, 0.03549, " leverage", false], [21751, 0.026873, " get", false], [38877, 0.018323, " learn", false], [22770, 0.017549, " win", false]]]}, "raw_delta": 0.00390625, "tuned_delta": 0.05799584741507559}, {"byte_start": 4027, "byte_end": 4040, "display": {"text": " dramatically", "kind": "normal"}, "is_word": true, "word_id": 691, "word_key": " dramatically", "bytes_hex": "20 64 72 61 6d 61 74 69 63 61 6c 6c 79", "compression": {"model_a": "7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41%", "model_b": "9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67% 9.67%"}, "model_tokens": {"model_a": [[64374, " dramatically", "normal", 0.004814160987734795]], "model_b": [[64374, " dramatically", "normal", 0.0009459151769988239]]}, "loss": {"model_a": 7.412886177644616, "model_b": 9.66709717903362}, "topk": {"model_a": [64374, 41, 0.004814160987734795, [[62084, 0.072649, " impressive", false], [22590, 0.070349, " the", false], [39802, 0.057424, " state", false], [45301, 0.054554, " better", false], [32386, 0.052813, " very", false], [52738, 0.043075, " results", false], [30992, 0.033619, " good", false], [62477, 0.026332, " remarkable", false], [53087, 0.025269, " systems", false], [31466, 0.025226, " much", false]]], "model_b": [64374, 107, 0.0009459151769988239, [[52738, 0.117115, " results", false], [22590, 0.108243, " the", false], [39802, 0.04961, " state", false], [332, 0.049342, " a", false], [32386, 0.040836, " very", false], [45301, 0.033994, " better", false], [30992, 0.026295, " good", false], [63750, 0.024422, " performance", false], [62084, 0.022814, " impressive", false], [46199, 0.019128, " highly", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07091040258492441}, {"byte_start": 4040, "byte_end": 4047, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 692, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"model_a": "1.45% 1.45% 1.45% 1.45% 1.45% 1.45% 1.45%", "model_b": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18%"}, "model_tokens": {"model_a": [[45301, " better", "normal", 0.5686437487602234]], "model_b": [[45301, " better", "normal", 0.634577214717865]]}, "loss": {"model_a": 1.4491356437500749, "model_b": 1.177422710546936}, "topk": {"model_a": [45301, 1, 0.5686437487602234, [[45301, 0.568644, " better", false], [56418, 0.206021, " improved", false], [31458, 0.111422, " more", false], [57350, 0.037369, " superior", false], [46198, 0.018186, " higher", false], [51867, 0.00769, " greater", false], [59593, 0.005926, " effective", false], [62603, 0.005844, " successful", false], [57326, 0.004773, " stronger", false], [46397, 0.003331, " larger", false]]], "model_b": [45301, 1, 0.634577214717865, [[45301, 0.634577, " better", false], [56418, 0.155273, " improved", false], [57350, 0.066409, " superior", false], [31458, 0.063876, " more", false], [46198, 0.011872, " higher", false], [51867, 0.00997, " greater", false], [59593, 0.009943, " effective", false], [62603, 0.007484, " successful", false], [45961, 0.00343, " faster", false], [56120, 0.0033, " enhanced", false]]]}, "raw_delta": 0.015066964285714288, "tuned_delta": 0.06915656170078988}, {"byte_start": 4047, "byte_end": 4054, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 693, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"model_a": "6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84%", "model_b": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%"}, "model_tokens": {"model_a": [[47350, " speech", "normal", 0.06968890875577927]], "model_b": [[47350, " speech", "normal", 0.017386874184012413]]}, "loss": {"model_a": 6.843140539930907, "model_b": 10.465979649306096}, "topk": {"model_a": [47350, 3, 0.06968890875577927, [[52738, 0.428004, " results", false], [63750, 0.334254, " performance", false], [47350, 0.069689, " speech", false], [53087, 0.060757, " systems", false], [63821, 0.015339, " recognition", false], [52224, 0.011108, " methods", false], [46587, 0.010234, " models", false], [32497, 0.005204, " word", false], [55434, 0.004574, " accuracy", false], [56529, 0.004012, " language", false]]], "model_b": [47350, 3, 0.017386874184012413, [[52738, 0.645166, " results", false], [63750, 0.263543, " performance", false], [47350, 0.017387, " speech", false], [53087, 0.006291, " systems", false], [64510, 0.005722, " performances", false], [52224, 0.003855, " methods", false], [56782, 0.00335, " outcomes", false], [21265, 0.002863, " and", false], [55434, 0.002579, " accuracy", false], [46587, 0.002422, " models", false]]]}, "raw_delta": -0.2008928571428572, "tuned_delta": -0.14680325972778163}, {"byte_start": 4054, "byte_end": 4066, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 694, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"model_a": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%", "model_b": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%"}, "model_tokens": {"model_a": [[63821, " recognition", "normal", 0.827271044254303]], "model_b": [[63821, " recognition", "normal", 0.7054373621940613]]}, "loss": {"model_a": 0.28471154574835084, "model_b": 0.5253955328758227}, "topk": {"model_a": [63821, 1, 0.827271044254303, [[63821, 0.827271, " recognition", false], [46, 0.077582, "-", false], [60335, 0.045979, " recognize", false], [53087, 0.012585, " systems", false], [65034, 0.009922, " understanding", false], [21265, 0.007315, " and", false], [62378, 0.003192, " processing", false], [46587, 0.001954, " models", false], [64591, 0.001364, " technologies", false], [62380, 0.001078, " processors", false]]], "model_b": [63821, 1, 0.7054373621940613, [[63821, 0.705437, " recognition", false], [46, 0.164003, "-", false], [60615, 0.014152, " synthesis", false], [65034, 0.013916, " understanding", false], [63750, 0.012278, " performance", false], [60335, 0.008374, " recognize", false], [52738, 0.0074, " results", false], [52621, 0.006098, " quality", false], [53087, 0.005171, " systems", false], [62378, 0.004345, " processing", false]]]}, "raw_delta": -0.01334635416666666, "tuned_delta": 0.04074324324840893}, {"byte_start": 4066, "byte_end": 4074, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 695, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"model_a": "2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31%", "model_b": "3.45% 3.45% 3.45% 3.45% 3.45% 3.45% 3.45% 3.45%"}, "model_tokens": {"model_a": [[53087, " systems", "normal", 0.36058366298675537]], "model_b": [[53087, " systems", "normal", 0.2196575552225113]]}, "loss": {"model_a": 2.30704407173406, "model_b": 3.451760595876914}, "topk": {"model_a": [53087, 1, 0.36058366298675537, [[53087, 0.360584, " systems", false], [47, 0.255342, ".", false], [63750, 0.091043, " performance", false], [32226, 0.072549, " than", false], [52738, 0.059611, " results", false], [21265, 0.02609, " and", false], [45, 0.021148, ",", false], [51616, 0.0197, " engines", false], [46587, 0.008751, " models", false], [55434, 0.008507, " accuracy", false]]], "model_b": [53087, 2, 0.2196575552225113, [[52738, 0.244378, " results", false], [53087, 0.219658, " systems", false], [63750, 0.163005, " performance", false], [47, 0.147746, ".", false], [32226, 0.101981, " than", false], [55434, 0.015612, " accuracy", false], [45, 0.009534, ",", false], [21265, 0.009042, " and", false], [64510, 0.007704, " performances", false], [4596, 0.005518, " in", false]]]}, "raw_delta": -0.0634765625, "tuned_delta": -0.009386965084924412}, {"byte_start": 4074, "byte_end": 4075, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.32%", "model_b": "9.44%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.7467849850654602]], "model_b": [[47, ".", "normal", 0.5890799164772034]]}, "loss": {"model_a": 5.3185290814021835, "model_b": 9.439508568316459}, "topk": {"model_a": [47, 1, 0.7467849850654602, [[47, 0.746785, ".", false], [32226, 0.159068, " than", false], [45, 0.028283, ",", false], [275, 0.008789, " (", false], [5346, 0.008286, "---", false], [32227, 0.007375, " that", false], [21265, 0.006074, " and", false], [4596, 0.00593, " in", false], [21700, 0.004052, " for", false], [39971, 0.003315, " today", false]]], "model_b": [47, 1, 0.5890799164772034, [[47, 0.58908, ".", false], [32226, 0.299006, " than", false], [45, 0.029033, ",", false], [32227, 0.014879, " that", false], [275, 0.00717, " (", false], [39971, 0.006919, " today", false], [55794, 0.006742, " compared", false], [4596, 0.006224, " in", false], [21265, 0.005294, " and", false], [32487, 0.004645, " with", false]]]}, "raw_delta": -0.228515625, "tuned_delta": -0.17442602758492443}, {"byte_start": 4075, "byte_end": 4078, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 696, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"model_a": "31.56% 31.56% 31.56%", "model_b": "30.06% 30.06% 30.06%"}, "model_tokens": {"model_a": [[3641, " As", "normal", 0.005242753308266401]], "model_b": [[3641, " As", "normal", 0.006902337074279785]]}, "loss": {"model_a": 31.55895401944607, "model_b": 30.056146685186736}, "topk": {"model_a": [3641, 16, 0.005242753308266401, [[261, 0.680003, "\n\n", false], [20996, 0.037509, " The", false], [267, 0.022622, "  ", false], [3913, 0.016002, " In", false], [29894, 0.015575, " This", false], [3918, 0.012984, " It", false], [3336, 0.012386, " \n\n", false], [275, 0.011553, " (", false], [37453, 0.00886, " These", false], [28753, 0.008466, " Deep", false]]], "model_b": [3641, 15, 0.006902337074279785, [[261, 0.44807, "\n\n", false], [20996, 0.068397, " The", false], [267, 0.042149, "  ", false], [29894, 0.039814, " This", false], [28753, 0.03064, " Deep", false], [3913, 0.029087, " In", false], [11, 0.028455, "\n", false], [37453, 0.018565, " These", false], [3918, 0.015061, " It", false], [3336, 0.012591, " \n\n", false]]]}, "raw_delta": 0.08333333333333326, "tuned_delta": 0.13742293074840883}, {"byte_start": 4078, "byte_end": 4081, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 697, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "9.20% 9.20% 9.20%", "model_b": "15.87% 15.87% 15.87%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.21443837881088257]], "model_b": [[4596, " in", "normal", 0.07181155681610107]]}, "loss": {"model_a": 9.204694922338437, "model_b": 15.873402468114245}, "topk": {"model_a": [4596, 2, 0.21443837881088257, [[32487, 0.270293, " with", false], [4596, 0.214438, " in", false], [332, 0.063033, " a", false], [22590, 0.045334, " the", false], [45150, 0.02772, " always", false], [47350, 0.018437, " speech", false], [4858, 0.016752, " we", false], [21700, 0.016353, " for", false], [31458, 0.015313, " more", false], [45285, 0.014527, " before", false]]], "model_b": [4596, 3, 0.07181155681610107, [[332, 0.247055, " a", false], [32487, 0.126972, " with", false], [4596, 0.071812, " in", false], [22590, 0.057193, " the", false], [4858, 0.03139, " we", false], [22226, 0.027179, " one", false], [32139, 0.023455, " such", false], [21700, 0.022298, " for", false], [4419, 0.019969, " an", false], [30597, 0.018148, " deep", false]]]}, "raw_delta": -0.36979166666666674, "tuned_delta": -0.31570206925159117}, {"byte_start": 4081, "byte_end": 4085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 698, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.71% 7.71% 7.71% 7.71%", "model_b": "9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.17889811098575592]], "model_b": [[22590, " the", "normal", 0.1295093446969986]]}, "loss": {"model_a": 7.713628270378002, "model_b": 9.157732193142833}, "topk": {"model_a": [22590, 3, 0.17889811098575592, [[55809, 0.350947, " computer", false], [38013, 0.180859, " chess", false], [22590, 0.178898, " the", false], [3851, 0.066754, " Go", false], [39193, 0.048008, " other", false], [31370, 0.025676, " many", false], [21256, 0.020174, " all", false], [47350, 0.017067, " speech", false], [47202, 0.012969, " search", false], [51551, 0.010352, " earlier", false]]], "model_b": [22590, 3, 0.1295093446969986, [[55809, 0.297924, " computer", false], [38013, 0.187279, " chess", false], [22590, 0.129509, " the", false], [47350, 0.088074, " speech", false], [21256, 0.046335, " all", false], [3609, 0.045676, " AI", false], [39193, 0.043317, " other", false], [3851, 0.026509, " Go", false], [31370, 0.024766, " many", false], [52299, 0.019157, " natural", false]]]}, "raw_delta": -0.080078125, "tuned_delta": -0.025988527584924412}, {"byte_start": 4085, "byte_end": 4091, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 699, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"model_a": "16.25% 16.25% 16.25% 16.25% 16.25% 16.25%", "model_b": "18.69% 18.69% 18.69% 18.69% 18.69% 18.69%"}, "model_tokens": {"model_a": [[38576, " games", "normal", 0.004468951374292374]], "model_b": [[38576, " games", "normal", 0.0019957490731030703]]}, "loss": {"model_a": 16.24910430167908, "model_b": 18.691166219850498}, "topk": {"model_a": [38576, 21, 0.004468951374292374, [[39193, 0.298413, " other", false], [30405, 0.132221, " case", false], [51551, 0.084788, " earlier", false], [38013, 0.072867, " chess", false], [56926, 0.064135, " previous", false], [37970, 0.039929, " cases", false], [55809, 0.039734, " computer", false], [22638, 0.035154, " two", false], [31636, 0.022564, " past", false], [3851, 0.016283, " Go", false]]], "model_b": [38576, 32, 0.0019957490731030703, [[30405, 0.259445, " case", false], [39193, 0.129216, " other", false], [38013, 0.111361, " chess", false], [55809, 0.092444, " computer", false], [51551, 0.038924, " earlier", false], [56926, 0.024809, " previous", false], [38328, 0.022775, " early", false], [47350, 0.019985, " speech", false], [30941, 0.017503, " game", false], [31636, 0.016457, " past", false]]]}, "raw_delta": -0.13541666666666663, "tuned_delta": -0.08132706925159104}, {"byte_start": 4091, "byte_end": 4092, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "11.20%", "model_b": "38.32%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5409867167472839]], "model_b": [[45, ",", "normal", 0.1203915923833847]]}, "loss": {"model_a": 11.20061091315162, "model_b": 38.321587023613084}, "topk": {"model_a": [45, 1, 0.5409867167472839, [[45, 0.540987, ",", false], [4706, 0.1395, " of", false], [21265, 0.069385, " and", false], [37599, 0.059481, " above", false], [60003, 0.044097, " mentioned", false], [59546, 0.016139, " discussed", false], [56162, 0.015386, " examples", false], [37970, 0.009827, " cases", false], [45285, 0.009579, " before", false], [32227, 0.006431, " that", false]]], "model_b": [45, 3, 0.1203915923833847, [[4706, 0.350845, " of", false], [60003, 0.162926, " mentioned", false], [45, 0.120392, ",", false], [21265, 0.075145, " and", false], [59546, 0.049839, " discussed", false], [37599, 0.046561, " above", false], [32227, 0.016869, " that", false], [31198, 0.013935, " just", false], [38037, 0.012636, " cited", false], [59488, 0.011999, " described", false]]]}, "raw_delta": -1.50390625, "tuned_delta": -1.4498166525849243}, {"byte_start": 4092, "byte_end": 4104, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 700, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78%", "model_b": "8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.021582767367362976]], "model_b": [[63843, " researchers", "normal", 0.003046129597350955]]}, "loss": {"model_a": 5.776415691059325, "model_b": 8.688104901186788}, "topk": {"model_a": [63843, 9, 0.021582767367362976, [[22590, 0.309165, " the", false], [39934, 0.066722, " there", false], [4601, 0.061405, " it", false], [32234, 0.054552, " this", false], [39936, 0.047268, " these", false], [38720, 0.039012, " human", false], [56537, 0.033539, " learning", false], [30597, 0.031057, " deep", false], [63843, 0.021583, " researchers", false], [31578, 0.018969, " once", false]]], "model_b": [63843, 41, 0.003046129597350955, [[22590, 0.288835, " the", false], [4601, 0.059603, " it", false], [39936, 0.053484, " these", false], [32234, 0.052184, " this", false], [39934, 0.049046, " there", false], [56537, 0.023604, " learning", false], [30597, 0.022386, " deep", false], [332, 0.015879, " a", false], [47350, 0.014626, " speech", false], [38720, 0.014184, " human", false]]]}, "raw_delta": -0.1614583333333333, "tuned_delta": -0.1073687359182577}, {"byte_start": 4104, "byte_end": 4111, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 701, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"model_a": "22.70% 22.70% 22.70% 22.70% 22.70% 22.70% 22.70%", "model_b": "16.50% 16.50% 16.50% 16.50% 16.50% 16.50% 16.50%"}, "model_tokens": {"model_a": [[45150, " always", "normal", 0.00015241364599205554]], "model_b": [[45150, " always", "normal", 0.0016627619042992592]]}, "loss": {"model_a": 22.703125085417838, "model_b": 16.50404483159807}, "topk": {"model_a": [45150, 241, 0.00015241364599205554, [[40, 0.249077, "'", false], [22762, 0.242983, " who", false], [32462, 0.036638, " were", false], [4596, 0.031876, " in", false], [21286, 0.029154, " are", false], [32487, 0.028677, " with", false], [59868, 0.027397, " initially", false], [31059, 0.027013, " have", false], [4424, 0.015884, " at", false], [21795, 0.014565, " had", false]]], "model_b": [45150, 74, 0.0016627619042992592, [[40, 0.22481, "'", false], [22762, 0.068135, " who", false], [32462, 0.063518, " were", false], [4596, 0.051735, " in", false], [31059, 0.050205, " have", false], [59868, 0.038417, " initially", false], [21286, 0.027726, " are", false], [32216, 0.016775, " tend", false], [21795, 0.012691, " had", false], [52834, 0.012073, " seeking", false]]]}, "raw_delta": 0.34375, "tuned_delta": 0.3978395974150756}, {"byte_start": 4111, "byte_end": 4117, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 702, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"model_a": "14.18% 14.18% 14.18% 14.18% 14.18% 14.18%", "model_b": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"model_a": [[40013, " tried", "normal", 0.008999734185636044]], "model_b": [[40013, " tried", "normal", 0.03359391167759895]]}, "loss": {"model_a": 14.182744217072491, "model_b": 10.190912235446126}, "topk": {"model_a": [40013, 23, 0.008999734185636044, [[21795, 0.048539, " had", false], [31059, 0.048114, " have", false], [47763, 0.042829, " wanted", false], [32435, 0.038282, " want", false], [31967, 0.026346, " seem", false], [55800, 0.022902, " complain", false], [32216, 0.02241, " tend", false], [22441, 0.018634, " say", false], [47211, 0.017705, " seemed", false], [38709, 0.017428, " hoped", false]]], "model_b": [40013, 7, 0.03359391167759895, [[47763, 0.082152, " wanted", false], [31966, 0.055662, " seek", false], [32435, 0.055518, " want", false], [47340, 0.044867, " sought", false], [31059, 0.035062, " have", false], [21795, 0.034093, " had", false], [40013, 0.033594, " tried", false], [22626, 0.029119, " try", false], [31967, 0.024356, " seem", false], [32216, 0.02294, " tend", false]]]}, "raw_delta": 0.22135416666666674, "tuned_delta": 0.2754437640817423}, {"byte_start": 4117, "byte_end": 4120, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 703, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.51% 1.51% 1.51%", "model_b": "0.33% 0.33% 0.33%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.779309093952179]], "model_b": [[4811, " to", "normal", 0.9470464587211609]]}, "loss": {"model_a": 1.514548016558238, "model_b": 0.32727151908186725}, "topk": {"model_a": [4811, 1, 0.779309093952179, [[4811, 0.779309, " to", false], [22590, 0.026492, " the", false], [52224, 0.024956, " methods", false], [38720, 0.019605, " human", false], [39931, 0.013916, " their", false], [22249, 0.010137, " out", false], [46162, 0.009724, " harder", false], [45, 0.008365, ",", false], [31048, 0.008113, " hard", false], [21700, 0.007562, " for", false]]], "model_b": [4811, 1, 0.9470464587211609, [[4811, 0.947046, " to", false], [38499, 0.007449, " first", false], [22590, 0.0037, " the", false], [39931, 0.002808, " their", false], [31048, 0.002362, " hard", false], [21700, 0.00212, " for", false], [46162, 0.002045, " harder", false], [45, 0.002005, ",", false], [332, 0.001871, " a", false], [22187, 0.001732, " not", false]]]}, "raw_delta": 0.06583658854166667, "tuned_delta": 0.11992618595674226}, {"byte_start": 4120, "byte_end": 4125, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 704, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"model_a": "13.19% 13.19% 13.19% 13.19% 13.19%", "model_b": "12.29% 12.29% 12.29% 12.29% 12.29%"}, "model_tokens": {"model_a": [[31358, " make", "normal", 0.025832204148173332]], "model_b": [[31358, " make", "normal", 0.033341385424137115]]}, "loss": {"model_a": 13.187134358125679, "model_b": 12.285449957570078}, "topk": {"model_a": [31358, 8, 0.025832204148173332, [[30858, 0.068083, " find", false], [22681, 0.062439, " use", false], [37786, 0.034549, " avoid", false], [21751, 0.034263, " get", false], [56540, 0.032047, " leverage", false], [51982, 0.031184, " improve", false], [32187, 0.027907, " take", false], [31358, 0.025832, " make", false], [37730, 0.023612, " apply", false], [37911, 0.022465, " bring", false]]], "model_b": [31358, 7, 0.033341385424137115, [[22681, 0.073532, " use", false], [37786, 0.051485, " avoid", false], [30858, 0.049588, " find", false], [56540, 0.041972, " leverage", false], [51982, 0.036383, " improve", false], [32187, 0.033753, " take", false], [31358, 0.033341, " make", false], [31205, 0.029369, " keep", false], [62683, 0.029205, " understand", false], [22770, 0.028724, " win", false]]]}, "raw_delta": 0.04999999999999993, "tuned_delta": 0.10408959741507552}, {"byte_start": 4125, "byte_end": 4133, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 705, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"model_a": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "model_b": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%"}, "model_tokens": {"model_a": [[53087, " systems", "normal", 0.00490612955763936]], "model_b": [[53087, " systems", "normal", 0.0024756642524152994]]}, "loss": {"model_a": 11.97549594487909, "model_b": 13.52526600833403}, "topk": {"model_a": [53087, 21, 0.00490612955763936, [[39931, 0.314755, " their", false], [22590, 0.159961, " the", false], [22681, 0.074439, " use", false], [332, 0.057305, " a", false], [38720, 0.051242, " human", false], [32157, 0.031961, " sure", false], [39631, 0.0204, " sense", false], [52224, 0.020064, " methods", false], [4601, 0.019969, " it", false], [56950, 0.017963, " progress", false]]], "model_b": [53087, 36, 0.0024756642524152994, [[22590, 0.232018, " the", false], [39931, 0.16381, " their", false], [22681, 0.091882, " use", false], [32157, 0.054111, " sure", false], [332, 0.045162, " a", false], [47350, 0.028474, " speech", false], [38720, 0.026343, " human", false], [56950, 0.018061, " progress", false], [39936, 0.01606, " these", false], [4601, 0.010833, " it", false]]]}, "raw_delta": -0.0859375, "tuned_delta": -0.03184790258492441}, {"byte_start": 4133, "byte_end": 4138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 706, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.82% 1.82% 1.82% 1.82% 1.82%", "model_b": "3.14% 3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.603221595287323]], "model_b": [[32227, " that", "normal", 0.4214909076690674]]}, "loss": {"model_a": 1.8174576198698855, "model_b": 3.141806583185926}, "topk": {"model_a": [32227, 1, 0.603221595287323, [[32227, 0.603222, " that", false], [37810, 0.081903, " based", false], [32499, 0.039989, " work", false], [32487, 0.030928, " with", false], [45301, 0.022007, " better", false], [31458, 0.019397, " more", false], [40085, 0.016495, " using", false], [21700, 0.014673, " for", false], [22681, 0.008881, " use", false], [4491, 0.008791, " do", false]]], "model_b": [32227, 1, 0.4214909076690674, [[32227, 0.421491, " that", false], [45301, 0.078759, " better", false], [31458, 0.074745, " more", false], [4423, 0.062175, " as", false], [37810, 0.056844, " based", false], [32499, 0.040483, " work", false], [52446, 0.016888, " perform", false], [31277, 0.016482, " less", false], [4404, 0.01432, " ``", false], [32487, 0.009387, " with", false]]]}, "raw_delta": -0.0734375, "tuned_delta": -0.019347902584924415}, {"byte_start": 4138, "byte_end": 4145, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 707, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"model_a": "6.96% 6.96% 6.96% 6.96% 6.96% 6.96% 6.96%", "model_b": "8.41% 8.41% 8.41% 8.41% 8.41% 8.41% 8.41%"}, "model_tokens": {"model_a": [[47812, " worked", "normal", 0.06686489284038544]], "model_b": [[47812, " worked", "normal", 0.038121297955513]]}, "loss": {"model_a": 6.963901843576749, "model_b": 8.413037487326823}, "topk": {"model_a": [47812, 5, 0.06686489284038544, [[32462, 0.11901, " were", false], [40219, 0.11162, " would", false], [32354, 0.090664, " used", false], [38128, 0.084713, " could", false], [47812, 0.066865, " worked", false], [21532, 0.063689, " did", false], [47054, 0.037808, " relied", false], [56540, 0.0283, " leverage", false], [32272, 0.025586, " took", false], [31351, 0.019677, " made", false]]], "model_b": [47812, 7, 0.038121297955513, [[32462, 0.153475, " were", false], [56540, 0.116962, " leverage", false], [32354, 0.094379, " used", false], [32272, 0.072094, " took", false], [47054, 0.069622, " relied", false], [21532, 0.043557, " did", false], [47812, 0.038121, " worked", false], [38128, 0.031496, " could", false], [21286, 0.017233, " are", false], [40219, 0.016985, " would", false]]]}, "raw_delta": -0.08035714285714286, "tuned_delta": -0.026267545442067275}, {"byte_start": 4145, "byte_end": 4149, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 708, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "21.70% 21.70% 21.70% 21.70%", "model_b": "18.88% 18.88% 18.88% 18.88%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.008162806741893291]], "model_b": [[22590, " the", "normal", 0.015179893001914024]]}, "loss": {"model_a": 21.696780888369172, "model_b": 18.879017136632918}, "topk": {"model_a": [22590, 15, 0.008162806741893291, [[32458, 0.341334, " well", false], [32487, 0.112616, " with", false], [4596, 0.100526, " in", false], [4712, 0.071727, " on", false], [4450, 0.061649, " by", false], [53356, 0.037994, " without", false], [21700, 0.037633, " for", false], [45301, 0.037044, " better", false], [4423, 0.019666, " as", false], [37810, 0.019405, " based", false]]], "model_b": [22590, 11, 0.015179893001914024, [[32458, 0.232775, " well", false], [45301, 0.153954, " better", false], [30273, 0.124309, " best", false], [32487, 0.100763, " with", false], [4450, 0.060807, " by", false], [21700, 0.046193, " for", false], [4712, 0.04063, " on", false], [4596, 0.036245, " in", false], [4424, 0.018792, " at", false], [4423, 0.017535, " as", false]]]}, "raw_delta": 0.15625, "tuned_delta": 0.21033959741507557}, {"byte_start": 4149, "byte_end": 4153, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 709, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"model_a": "1.51% 1.51% 1.51% 1.51%", "model_b": "7.82% 7.82% 7.82% 7.82%"}, "model_tokens": {"model_a": [[22752, " way", "normal", 0.7143092751502991]], "model_b": [[22752, " way", "normal", 0.17645211517810822]]}, "loss": {"model_a": 1.514548016558238, "model_b": 7.819294411068111}, "topk": {"model_a": [22752, 1, 0.7143092751502991, [[22752, 0.714309, " way", false], [30273, 0.117729, " best", false], [31937, 0.062102, " same", false], [39523, 0.019476, " right", false], [38499, 0.01691, " first", false], [31461, 0.013271, " most", false], [38720, 0.011546, " human", false], [4404, 0.010584, " ``", false], [51718, 0.003699, " fastest", false], [51555, 0.003047, " easiest", false]]], "model_b": [22752, 2, 0.17645211517810822, [[30273, 0.670881, " best", false], [22752, 0.176452, " way", false], [31937, 0.077818, " same", false], [31461, 0.015661, " most", false], [45301, 0.011021, " better", false], [38879, 0.01096, " least", false], [51900, 0.006811, " hardest", false], [39523, 0.003738, " right", false], [38720, 0.003564, " human", false], [51718, 0.003342, " fastest", false]]]}, "raw_delta": -0.349609375, "tuned_delta": -0.2955197775849244}, {"byte_start": 4153, "byte_end": 4157, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 710, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "15.92% 15.92% 15.92% 15.92%", "model_b": "12.54% 12.54% 12.54% 12.54%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.029294833540916443]], "model_b": [[22590, " the", "normal", 0.06187152490019798]]}, "loss": {"model_a": 15.920365197309849, "model_b": 12.539048695226342}, "topk": {"model_a": [22590, 6, 0.029294833540916443, [[32232, 0.33019, " they", false], [46227, 0.2556, " humans", false], [46787, 0.156969, " people", false], [38720, 0.070664, " human", false], [32227, 0.062082, " that", false], [22590, 0.029295, " the", false], [51685, 0.019072, " experts", false], [332, 0.015409, " a", false], [39931, 0.011945, " their", false], [4601, 0.004655, " it", false]]], "model_b": [22590, 5, 0.06187152490019798, [[32232, 0.447123, " they", false], [32227, 0.132923, " that", false], [46227, 0.114206, " humans", false], [46787, 0.080238, " people", false], [22590, 0.061872, " the", false], [38720, 0.049673, " human", false], [332, 0.026189, " a", false], [4858, 0.01444, " we", false], [39931, 0.011631, " their", false], [4404, 0.006671, " ``", false]]]}, "raw_delta": 0.1875, "tuned_delta": 0.24158959741507557}, {"byte_start": 4157, "byte_end": 4169, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 711, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "model_b": "8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.0046857683919370174]], "model_b": [[63843, " researchers", "normal", 0.0026341089978814125]]}, "loss": {"model_a": 8.077589421643935, "model_b": 8.922918547164814}, "topk": {"model_a": [63843, 13, 0.0046857683919370174, [[38720, 0.550796, " human", false], [51685, 0.110782, " experts", false], [46227, 0.071634, " humans", false], [40213, 0.048832, " world", false], [45775, 0.014298, " domain", false], [53087, 0.011699, " systems", false], [30273, 0.009457, " best", false], [47487, 0.009286, " system", false], [45929, 0.009068, " expert", false], [4404, 0.007293, " ``", false]]], "model_b": [63843, 25, 0.0026341089978814125, [[38720, 0.467195, " human", false], [46787, 0.072369, " people", false], [30273, 0.063728, " best", false], [46227, 0.049523, " humans", false], [40213, 0.03959, " world", false], [51685, 0.02263, " experts", false], [52489, 0.014436, " players", false], [46795, 0.011772, " person", false], [51832, 0.010178, " general", false], [30941, 0.009501, " game", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 4169, "byte_end": 4177, "display": {"text": " thought", "kind": "normal"}, "is_word": true, "word_id": 712, "word_key": " thought", "bytes_hex": "20 74 68 6f 75 67 68 74", "compression": {"model_a": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%", "model_b": "3.12% 3.12% 3.12% 3.12% 3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"model_a": [[53137, " thought", "normal", 0.2654259204864502]], "model_b": [[53137, " thought", "normal", 0.25046274065971375]]}, "loss": {"model_a": 3.011485009668124, "model_b": 3.1171511503582336}, "topk": {"model_a": [53137, 1, 0.2654259204864502, [[53137, 0.265426, " thought", false], [47763, 0.245852, " wanted", false], [31220, 0.126704, " knew", false], [62684, 0.075654, " understood", false], [62643, 0.044594, " themselves", false], [55616, 0.044529, " believed", false], [21532, 0.021053, " did", false], [56175, 0.019688, " expected", false], [40219, 0.015921, " would", false], [40, 0.013553, "'", false]]], "model_b": [53137, 2, 0.25046274065971375, [[47763, 0.30422, " wanted", false], [53137, 0.250463, " thought", false], [21795, 0.075189, " had", false], [38709, 0.032322, " hoped", false], [55616, 0.029923, " believed", false], [56175, 0.023008, " expected", false], [60227, 0.022226, " preferred", false], [40219, 0.021539, " would", false], [56401, 0.017724, " imagined", false], [40, 0.015194, "'", false]]]}, "raw_delta": -0.005859375, "tuned_delta": 0.04823022241507559}, {"byte_start": 4177, "byte_end": 4183, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 713, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "14.28% 14.28% 14.28% 14.28% 14.28% 14.28%", "model_b": "20.85% 20.85% 20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.008585930801928043]], "model_b": [[39931, " their", "normal", 0.0009753991034813225]]}, "loss": {"model_a": 14.276669675463697, "model_b": 20.851451762848296}, "topk": {"model_a": [39931, 20, 0.008585930801928043, [[22590, 0.207213, " the", false], [46227, 0.132329, " humans", false], [32232, 0.094845, " they", false], [47350, 0.088168, " speech", false], [46787, 0.083652, " people", false], [38720, 0.068032, " human", false], [45, 0.036853, ",", false], [22748, 0.035229, " was", false], [30273, 0.020521, " best", false], [332, 0.019366, " a", false]]], "model_b": [39931, 28, 0.0009753991034813225, [[32232, 0.667376, " they", false], [45, 0.072069, ",", false], [22590, 0.039134, " the", false], [4601, 0.030883, " it", false], [47, 0.029085, ".", false], [32227, 0.026926, " that", false], [40219, 0.025705, " would", false], [32229, 0.011071, " them", false], [30273, 0.008784, " best", false], [22748, 0.006258, " was", false]]]}, "raw_delta": -0.3645833333333334, "tuned_delta": -0.31049373591825785}, {"byte_start": 4183, "byte_end": 4187, "display": {"text": " own", "kind": "normal"}, "is_word": true, "word_id": 714, "word_key": " own", "bytes_hex": "20 6f 77 6e", "compression": {"model_a": "19.16% 19.16% 19.16% 19.16%", "model_b": "16.20% 16.20% 16.20% 16.20%"}, "model_tokens": {"model_a": [[22251, " own", "normal", 0.014240657910704613]], "model_b": [[22251, " own", "normal", 0.027667870745062828]]}, "loss": {"model_a": 19.160793511806542, "model_b": 16.202141572483473}, "topk": {"model_a": [22251, 7, 0.014240657910704613, [[53087, 0.29197, " systems", false], [38720, 0.176664, " human", false], [59943, 0.066479, " knowledge", false], [47487, 0.064513, " system", false], [45775, 0.061871, " domain", false], [52224, 0.049945, " methods", false], [22251, 0.014241, " own", false], [65034, 0.013689, " understanding", false], [47350, 0.011999, " speech", false], [38478, 0.010275, " field", false]]], "model_b": [22251, 6, 0.027667870745062828, [[53087, 0.314159, " systems", false], [52224, 0.172819, " methods", false], [47487, 0.086814, " system", false], [38720, 0.083936, " human", false], [46561, 0.030245, " method", false], [22251, 0.027668, " own", false], [52964, 0.014027, " special", false], [59943, 0.010673, " knowledge", false], [61559, 0.010422, " algorithms", false], [63363, 0.009993, " competitors", false]]]}, "raw_delta": 0.1640625, "tuned_delta": 0.21815209741507557}, {"byte_start": 4187, "byte_end": 4193, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 715, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"model_a": "12.21% 12.21% 12.21% 12.21% 12.21% 12.21%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[39026, " minds", "normal", 0.017391813918948174]], "model_b": [[39026, " minds", "normal", 0.0014171014772728086]]}, "loss": {"model_a": 12.210309590857111, "model_b": 19.724346262153794}, "topk": {"model_a": [39026, 10, 0.017391813918948174, [[38720, 0.231769, " human", false], [59943, 0.149483, " knowledge", false], [53087, 0.099329, " systems", false], [52224, 0.066865, " methods", false], [47487, 0.040331, " system", false], [65034, 0.029332, " understanding", false], [47350, 0.025544, " speech", false], [59683, 0.022126, " expertise", false], [45775, 0.017956, " domain", false], [39026, 0.017392, " minds", false]]], "model_b": [39026, 41, 0.0014171014772728086, [[53087, 0.374392, " systems", false], [52224, 0.228874, " methods", false], [47487, 0.080269, " system", false], [46561, 0.039247, " method", false], [38720, 0.026399, " human", false], [40219, 0.025104, " would", false], [52964, 0.018528, " special", false], [59943, 0.012413, " knowledge", false], [45346, 0.011428, " brains", false], [61590, 0.010432, " approaches", false]]]}, "raw_delta": -0.4166666666666666, "tuned_delta": -0.362577069251591}, {"byte_start": 4193, "byte_end": 4200, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 716, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"model_a": "1.08% 1.08% 1.08% 1.08% 1.08% 1.08% 1.08%", "model_b": "1.85% 1.85% 1.85% 1.85% 1.85% 1.85% 1.85%"}, "model_tokens": {"model_a": [[47812, " worked", "normal", 0.6561989784240723]], "model_b": [[47812, " worked", "normal", 0.48807719349861145]]}, "loss": {"model_a": 1.081820011827313, "model_b": 1.8516733225695396}, "topk": {"model_a": [47812, 1, 0.6561989784240723, [[47812, 0.656199, " worked", false], [21532, 0.13238, " did", false], [40219, 0.087434, " would", false], [47266, 0.035626, " should", false], [53137, 0.016959, " thought", false], [32499, 0.012029, " work", false], [32462, 0.009216, " were", false], [39021, 0.008043, " might", false], [56760, 0.005808, " operated", false], [39196, 0.0058, " ought", false]]], "model_b": [47812, 1, 0.48807719349861145, [[47812, 0.488077, " worked", false], [40219, 0.163777, " would", false], [47266, 0.126353, " should", false], [21532, 0.039897, " did", false], [32462, 0.03217, " were", false], [39196, 0.023795, " ought", false], [32499, 0.017258, " work", false], [39021, 0.010892, " might", false], [56760, 0.010521, " operated", false], [53137, 0.00859, " thought", false]]]}, "raw_delta": -0.042689732142857144, "tuned_delta": 0.011399865272218444}, {"byte_start": 4200, "byte_end": 4203, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"model_a": "16.62% 16.62% 16.62%", "model_b": "22.92% 22.92% 22.92%"}, "model_tokens": {"model_a": [[5346, "---", "normal", 0.06219616159796715]], "model_b": [[5346, "---", "normal", 0.022419512271881104]]}, "loss": {"model_a": 16.62480613524391, "model_b": 22.917811847454885}, "topk": {"model_a": [5346, 3, 0.06219616159796715, [[45, 0.542713, ",", false], [47, 0.252916, ".", false], [5346, 0.062196, "---", false], [275, 0.027437, " (", false], [30273, 0.022266, " best", false], [60, 0.021071, ";", false], [21265, 0.017501, " and", false], [32465, 0.007372, " when", false], [4596, 0.006008, " in", false], [21400, 0.004508, " but", false]]], "model_b": [5346, 4, 0.022419512271881104, [[45, 0.439182, ",", false], [47, 0.379996, ".", false], [275, 0.038249, " (", false], [5346, 0.02242, "---", false], [21265, 0.015912, " and", false], [60, 0.014787, ";", false], [4596, 0.012233, " in", false], [21400, 0.008615, " but", false], [22590, 0.006607, " the", false], [4450, 0.005585, " by", false]]]}, "raw_delta": -0.34895833333333326, "tuned_delta": -0.2948687359182577}, {"byte_start": 4203, "byte_end": 4207, "display": {"text": "they", "kind": "normal"}, "is_word": true, "word_id": 717, "word_key": "they", "bytes_hex": "74 68 65 79", "compression": {"model_a": "17.54% 17.54% 17.54% 17.54%", "model_b": "19.02% 19.02% 19.02% 19.02%"}, "model_tokens": {"model_a": [[27148, "they", "normal", 0.02055172808468342]], "model_b": [[27148, "they", "normal", 0.014828271232545376]]}, "loss": {"model_a": 17.540579354558197, "model_b": 19.01990532421973}, "topk": {"model_a": [27148, 14, 0.02055172808468342, [[27142, 0.101266, "that", false], [1950, 0.074633, "in", false], [7005, 0.057043, "and", false], [7195, 0.048548, "but", false], [1782, 0.043067, "by", false], [27493, 0.037862, "with", false], [8801, 0.034769, "the", false], [36003, 0.032613, "which", false], [98, 0.029583, "a", false], [49750, 0.025774, "systems", false]]], "model_b": [27148, 15, 0.014828271232545376, [[27142, 0.09448, "that", false], [7195, 0.079318, "but", false], [7005, 0.070565, "and", false], [1950, 0.065365, "in", false], [34580, 0.052607, "human", false], [1751, 0.034404, "as", false], [1782, 0.032741, "by", false], [8801, 0.03179, "the", false], [98, 0.02962, "a", false], [27493, 0.029598, "with", false]]]}, "raw_delta": -0.08203125, "tuned_delta": -0.027941652584924412}, {"byte_start": 4207, "byte_end": 4213, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 718, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"model_a": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00%", "model_b": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75%"}, "model_tokens": {"model_a": [[40013, " tried", "normal", 0.09664983302354813]], "model_b": [[40013, " tried", "normal", 0.07584866881370544]]}, "loss": {"model_a": 6.9974466501450365, "model_b": 7.748850317274705}, "topk": {"model_a": [40013, 2, 0.09664983302354813, [[47763, 0.106261, " wanted", false], [40013, 0.09665, " tried", false], [32462, 0.093518, " were", false], [21532, 0.062411, " did", false], [53137, 0.056074, " thought", false], [32354, 0.048292, " used", false], [45150, 0.035507, " always", false], [21795, 0.03244, " had", false], [47812, 0.028795, " worked", false], [40219, 0.024284, " would", false]]], "model_b": [40013, 2, 0.07584866881370544, [[32462, 0.134906, " were", false], [40013, 0.075849, " tried", false], [47763, 0.067976, " wanted", false], [21532, 0.059227, " did", false], [39115, 0.036001, " never", false], [55616, 0.029812, " believed", false], [40219, 0.029609, " would", false], [21795, 0.028838, " had", false], [45150, 0.02521, " always", false], [53137, 0.024301, " thought", false]]]}, "raw_delta": -0.041666666666666685, "tuned_delta": 0.012422930748408903}, {"byte_start": 4213, "byte_end": 4216, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 719, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.76% 0.76% 0.76%", "model_b": "0.72% 0.72% 0.72%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8819284439086914]], "model_b": [[4811, " to", "normal", 0.8880968689918518]]}, "loss": {"model_a": 0.757274008279119, "model_b": 0.7161816202329652}, "topk": {"model_a": [4811, 1, 0.8819284439086914, [[4811, 0.881928, " to", false], [52224, 0.012025, " methods", false], [38499, 0.008718, " first", false], [38720, 0.007755, " human", false], [31048, 0.007378, " hard", false], [22249, 0.005742, " out", false], [21700, 0.005071, " for", false], [22590, 0.00433, " the", false], [45, 0.00394, ",", false], [22187, 0.002952, " not", false]]], "model_b": [4811, 1, 0.8880968689918518, [[4811, 0.888097, " to", false], [22187, 0.022169, " not", false], [31048, 0.00701, " hard", false], [21700, 0.005189, " for", false], [45, 0.004699, ",", false], [39931, 0.003744, " their", false], [38720, 0.003576, " human", false], [22590, 0.003527, " the", false], [52224, 0.002833, " methods", false], [21265, 0.002758, " and", false]]]}, "raw_delta": 0.0022786458333333356, "tuned_delta": 0.056368243248408924}, {"byte_start": 4216, "byte_end": 4220, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 720, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"model_a": "19.44% 19.44% 19.44% 19.44%", "model_b": "21.70% 21.70% 21.70% 21.70%"}, "model_tokens": {"model_a": [[22339, " put", "normal", 0.013433695770800114]], "model_b": [[22339, " put", "normal", 0.008142626844346523]]}, "loss": {"model_a": 19.44256988698017, "model_b": 21.696780888369172}, "topk": {"model_a": [22339, 17, 0.013433695770800114, [[31358, 0.0724, " make", false], [22681, 0.068449, " use", false], [37923, 0.061063, " build", false], [39025, 0.049412, " mimic", false], [39043, 0.031307, " model", false], [4516, 0.025971, " em", false], [32187, 0.024617, " take", false], [45854, 0.019379, " encode", false], [4491, 0.017422, " do", false], [45616, 0.016928, " create", false]]], "model_b": [22339, 20, 0.008142626844346523, [[31358, 0.128619, " make", false], [22681, 0.075219, " use", false], [30858, 0.054056, " find", false], [32187, 0.053087, " take", false], [56540, 0.036822, " leverage", false], [4491, 0.02743, " do", false], [62683, 0.023187, " understand", false], [21751, 0.021412, " get", false], [4435, 0.020477, " be", false], [37923, 0.016479, " build", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07091040258492441}, {"byte_start": 4220, "byte_end": 4225, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 721, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "26.49% 26.49% 26.49% 26.49% 26.49%", "model_b": "22.65% 22.65% 22.65% 22.65% 22.65%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.0006495369016192853]], "model_b": [[32227, " that", "normal", 0.001884651486761868]]}, "loss": {"model_a": 26.48697926632081, "model_b": 22.654820563959504}, "topk": {"model_a": [32227, 82, 0.0006495369016192853, [[4596, 0.182866, " in", false], [39931, 0.178564, " their", false], [22590, 0.107867, " the", false], [38720, 0.078455, " human", false], [57435, 0.054727, " together", false], [21256, 0.029646, " all", false], [40210, 0.029152, " words", false], [332, 0.02602, " a", false], [59943, 0.022969, " knowledge", false], [4404, 0.021274, " ``", false]]], "model_b": [32227, 42, 0.001884651486761868, [[39931, 0.172192, " their", false], [22590, 0.159119, " the", false], [38720, 0.137904, " human", false], [62643, 0.058607, " themselves", false], [332, 0.036863, " a", false], [21256, 0.031931, " all", false], [4596, 0.031076, " in", false], [46227, 0.021294, " humans", false], [4423, 0.01807, " as", false], [57435, 0.013512, " together", false]]]}, "raw_delta": 0.2124999999999999, "tuned_delta": 0.2665895974150755}, {"byte_start": 4225, "byte_end": 4235, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 722, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59%", "model_b": "2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03% 2.03%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.23726817965507507]], "model_b": [[59943, " knowledge", "normal", 0.3202984035015106]]}, "loss": {"model_a": 2.592342651597356, "model_b": 2.028789901250105}, "topk": {"model_a": [59943, 1, 0.23726817965507507, [[59943, 0.237268, " knowledge", false], [38720, 0.216031, " human", false], [31162, 0.045316, " into", false], [52964, 0.030301, " special", false], [4596, 0.02453, " in", false], [65034, 0.023088, " understanding", false], [4404, 0.022945, " ``", false], [47487, 0.020702, " system", false], [38434, 0.015141, " extra", false], [31427, 0.014325, " mind", false]]], "model_b": [59943, 1, 0.3202984035015106, [[59943, 0.320298, " knowledge", false], [38720, 0.117511, " human", false], [31427, 0.045568, " mind", false], [52964, 0.040169, " special", false], [31162, 0.039605, " into", false], [4596, 0.036841, " in", false], [47487, 0.029725, " system", false], [63637, 0.014137, " information", false], [22752, 0.012488, " way", false], [46545, 0.010839, " mental", false]]]}, "raw_delta": 0.031249999999999993, "tuned_delta": 0.08533959741507557}, {"byte_start": 4235, "byte_end": 4238, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 723, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "9.16% 9.16% 9.16%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.21844901144504547]], "model_b": [[4596, " in", "normal", 0.10875225067138672]]}, "loss": {"model_a": 9.157732193142833, "model_b": 13.243489633160404}, "topk": {"model_a": [4596, 2, 0.21844901144504547, [[31162, 0.553753, " into", false], [4596, 0.218449, " in", false], [4706, 0.039429, " of", false], [4811, 0.038389, " to", false], [32232, 0.034851, " they", false], [56003, 0.015738, " directly", false], [45, 0.015472, ",", false], [32227, 0.009432, " that", false], [21265, 0.008139, " and", false], [46301, 0.007721, " inside", false]]], "model_b": [4596, 3, 0.10875225067138672, [[31162, 0.582186, " into", false], [4811, 0.148538, " to", false], [4596, 0.108752, " in", false], [4706, 0.029336, " of", false], [45, 0.014097, ",", false], [21265, 0.010982, " and", false], [4712, 0.008928, " on", false], [30218, 0.008631, " back", false], [275, 0.006971, " (", false], [40185, 0.006338, " where", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17247290258492443}, {"byte_start": 4238, "byte_end": 4244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 724, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "6.53% 6.53% 6.53% 6.53% 6.53% 6.53%", "model_b": "8.27% 8.27% 8.27% 8.27% 8.27% 8.27%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.11392802745103836]], "model_b": [[39931, " their", "normal", 0.06386612355709076]]}, "loss": {"model_a": 6.527819358188994, "model_b": 8.265440338426352}, "topk": {"model_a": [39931, 2, 0.11392802745103836, [[22590, 0.584285, " the", false], [39931, 0.113928, " their", false], [45, 0.050233, ",", false], [332, 0.041784, " a", false], [47, 0.038236, ".", false], [21265, 0.0143, " and", false], [4423, 0.013226, " as", false], [38559, 0.008859, " front", false], [39934, 0.008139, " there", false], [4811, 0.007723, " to", false]]], "model_b": [39931, 3, 0.06386612355709076, [[22590, 0.398207, " the", false], [332, 0.136658, " a", false], [39931, 0.063866, " their", false], [4423, 0.031069, " as", false], [39291, 0.026817, " place", false], [45, 0.021495, ",", false], [47, 0.019276, ".", false], [39934, 0.016007, " there", false], [4811, 0.015465, " to", false], [57257, 0.014064, " software", false]]]}, "raw_delta": -0.09635416666666663, "tuned_delta": -0.04226456925159104}, {"byte_start": 4244, "byte_end": 4252, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 725, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"model_a": "1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90%", "model_b": "3.40% 3.40% 3.40% 3.40% 3.40% 3.40% 3.40% 3.40%"}, "model_tokens": {"model_a": [[53087, " systems", "normal", 0.4285065233707428]], "model_b": [[53087, " systems", "normal", 0.22215737402439117]]}, "loss": {"model_a": 1.901990532421973, "model_b": 3.3989275255318594}, "topk": {"model_a": [53087, 1, 0.4285065233707428, [[53087, 0.428507, " systems", false], [46587, 0.110786, " models", false], [52224, 0.098029, " methods", false], [47487, 0.076208, " system", false], [61559, 0.048317, " algorithms", false], [56949, 0.037343, " programs", false], [47350, 0.01668, " speech", false], [30469, 0.016335, " code", false], [56567, 0.016307, " machines", false], [22251, 0.015295, " own", false]]], "model_b": [53087, 1, 0.22215737402439117, [[53087, 0.222157, " systems", false], [52224, 0.112537, " methods", false], [46587, 0.096378, " models", false], [38673, 0.0738, " heads", false], [47487, 0.056879, " system", false], [31060, 0.036403, " head", false], [61559, 0.031455, " algorithms", false], [22251, 0.031155, " own", false], [39026, 0.026759, " minds", false], [56949, 0.018546, " programs", false]]]}, "raw_delta": -0.0830078125, "tuned_delta": -0.028918215084924412}, {"byte_start": 4252, "byte_end": 4255, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"model_a": "9.25% 9.25% 9.25%", "model_b": "22.26% 22.26% 22.26%"}, "model_tokens": {"model_a": [[5346, "---", "normal", 0.2115027755498886]], "model_b": [[5346, "---", "normal", 0.02459218166768551]]}, "loss": {"model_a": 9.251657651534043, "model_b": 22.260333638716425}, "topk": {"model_a": [5346, 3, 0.2115027755498886, [[47, 0.358047, ".", false], [45, 0.223329, ",", false], [5346, 0.211503, "---", false], [21265, 0.050371, " and", false], [4596, 0.01938, " in", false], [4423, 0.014669, " as", false], [47001, 0.011381, " rather", false], [4450, 0.011237, " by", false], [4811, 0.009672, " to", false], [4788, 0.008337, " so", false]]], "model_b": [5346, 6, 0.02459218166768551, [[47, 0.410351, ".", false], [45, 0.193842, ",", false], [21265, 0.099385, " and", false], [4811, 0.047617, " to", false], [4596, 0.036577, " in", false], [5346, 0.024592, "---", false], [4423, 0.023427, " as", false], [4788, 0.022528, " so", false], [4450, 0.011764, " by", false], [275, 0.011608, " (", false]]]}, "raw_delta": -0.7213541666666666, "tuned_delta": -0.667264569251591}, {"byte_start": 4255, "byte_end": 4258, "display": {"text": "but", "kind": "normal"}, "is_word": true, "word_id": 726, "word_key": "but", "bytes_hex": "62 75 74", "compression": {"model_a": "2.45% 2.45% 2.45%", "model_b": "3.15% 3.15% 3.15%"}, "model_tokens": {"model_a": [[7195, "but", "normal", 0.6669910550117493]], "model_b": [[7195, "but", "normal", 0.5948882102966309]]}, "loss": {"model_a": 2.4538026004703233, "model_b": 3.146502856105486}, "topk": {"model_a": [7195, 1, 0.6669910550117493, [[7195, 0.666991, "but", false], [7005, 0.214964, "and", false], [35898, 0.014185, "until", false], [36003, 0.008452, "which", false], [26476, 0.008341, "only", false], [2190, 0.008284, "so", false], [36004, 0.006571, "while", false], [42135, 0.00612, "rather", false], [36002, 0.006116, "where", false], [9122, 0.003406, "yet", false]]], "model_b": [7195, 1, 0.5948882102966309, [[7195, 0.594888, "but", false], [7005, 0.165145, "and", false], [8260, 0.016896, "not", false], [27148, 0.014212, "they", false], [26476, 0.012866, "only", false], [2190, 0.012779, "so", false], [1950, 0.012201, "in", false], [8801, 0.009052, "the", false], [2215, 0.008464, "to", false], [35898, 0.007733, "until", false]]]}, "raw_delta": -0.038411458333333315, "tuned_delta": 0.015678139081742273}, {"byte_start": 4258, "byte_end": 4261, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 727, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "17.19% 17.19% 17.19%", "model_b": "17.00% 17.00% 17.00%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.057567186653614044]], "model_b": [[4601, " it", "normal", 0.059255246073007584]]}, "loss": {"model_a": 17.188358885591164, "model_b": 17.000507968808748}, "topk": {"model_a": [4601, 5, 0.057567186653614044, [[22590, 0.160855, " the", false], [32232, 0.108364, " they", false], [4596, 0.076378, " in", false], [32234, 0.060832, " this", false], [4601, 0.057567, " it", false], [32227, 0.045204, " that", false], [45, 0.039228, ",", false], [30597, 0.037068, " deep", false], [61959, 0.031903, " eventually", false], [4423, 0.023895, " as", false]]], "model_b": [4601, 4, 0.059255246073007584, [[32232, 0.122064, " they", false], [22590, 0.111072, " the", false], [4596, 0.080263, " in", false], [4601, 0.059255, " it", false], [45, 0.042864, ",", false], [39931, 0.029504, " their", false], [32234, 0.029442, " this", false], [32227, 0.029419, " that", false], [32465, 0.024116, " when", false], [39936, 0.020409, " these", false]]]}, "raw_delta": 0.01041666666666663, "tuned_delta": 0.06450626408174222}, {"byte_start": 4261, "byte_end": 4268, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 728, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"model_a": "8.86% 8.86% 8.86% 8.86% 8.86% 8.86% 8.86%", "model_b": "11.35% 11.35% 11.35% 11.35% 11.35% 11.35% 11.35%"}, "model_tokens": {"model_a": [[46936, " proved", "normal", 0.03177895024418831]], "model_b": [[46936, " proved", "normal", 0.01248219981789589]]}, "loss": {"model_a": 8.855828934028233, "model_b": 11.351562542708919}, "topk": {"model_a": [46936, 6, 0.03177895024418831, [[22748, 0.346219, " was", false], [47638, 0.1177, " turned", false], [4600, 0.101375, " is", false], [21532, 0.053398, " did", false], [40040, 0.052259, " turns", false], [46936, 0.031779, " proved", false], [39115, 0.024252, " never", false], [30633, 0.021177, " didn", false], [21800, 0.017562, " has", false], [45150, 0.014967, " always", false]]], "model_b": [46936, 12, 0.01248219981789589, [[22748, 0.328535, " was", false], [39115, 0.15937, " never", false], [4600, 0.071173, " is", false], [21532, 0.065173, " did", false], [47638, 0.040762, " turned", false], [32272, 0.032775, " took", false], [30633, 0.026758, " didn", false], [45150, 0.01916, " always", false], [47812, 0.015266, " worked", false], [40040, 0.014508, " turns", false]]]}, "raw_delta": -0.13839285714285718, "tuned_delta": -0.08430325972778159}, {"byte_start": 4268, "byte_end": 4279, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 729, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"model_a": "6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43%", "model_b": "8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"model_a": [[62676, " ultimately", "normal", 0.01972923055291176]], "model_b": [[62676, " ultimately", "normal", 0.004824909847229719]]}, "loss": {"model_a": 6.429624560780002, "model_b": 8.760683664489086}, "topk": {"model_a": [62676, 12, 0.01972923055291176, [[4811, 0.185411, " to", false], [62082, 0.059732, " impossible", false], [22187, 0.057852, " not", false], [332, 0.056209, " a", false], [21719, 0.05288, " fut", false], [31466, 0.049094, " much", false], [32227, 0.037396, " that", false], [62161, 0.035025, " irrelevant", false], [31458, 0.034246, " more", false], [31277, 0.02764, " less", false]]], "model_b": [62676, 28, 0.004824909847229719, [[4811, 0.334464, " to", false], [62082, 0.091328, " impossible", false], [59516, 0.039534, " difficult", false], [21719, 0.030594, " fut", false], [63631, 0.028042, " ineffective", false], [22187, 0.027843, " not", false], [32386, 0.025166, " very", false], [31466, 0.024038, " much", false], [332, 0.023432, " a", false], [53247, 0.017703, " useless", false]]]}, "raw_delta": -0.12926136363636367, "tuned_delta": -0.07517176622128809}, {"byte_start": 4279, "byte_end": 4287, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 730, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"model_a": "10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64%", "model_b": "9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79% 9.79%"}, "model_tokens": {"model_a": [[51336, " counter", "normal", 0.008901496417820454]], "model_b": [[51336, " counter", "normal", 0.013142944313585758]]}, "loss": {"model_a": 10.637058162804367, "model_b": 9.79172903728349}, "topk": {"model_a": [51336, 17, 0.008901496417820454, [[4811, 0.184686, " to", false], [21719, 0.145053, " fut", false], [62161, 0.087515, " irrelevant", false], [22187, 0.083214, " not", false], [31458, 0.064921, " more", false], [62082, 0.037568, " impossible", false], [31277, 0.032762, " less", false], [332, 0.031811, " a", false], [31466, 0.028849, " much", false], [32227, 0.026914, " that", false]]], "model_b": [51336, 10, 0.013142944313585758, [[4811, 0.224026, " to", false], [21719, 0.140941, " fut", false], [53247, 0.089856, " useless", false], [63631, 0.070672, " ineffective", false], [62161, 0.051259, " irrelevant", false], [62082, 0.049818, " impossible", false], [22187, 0.028112, " not", false], [60772, 0.014617, " worthless", false], [64616, 0.013169, " unsuccessful", false], [51336, 0.013143, " counter", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.10096459741507559}, {"byte_start": 4287, "byte_end": 4297, "display": {"text": "productive", "kind": "normal"}, "is_word": true, "word_id": 731, "word_key": "productive", "bytes_hex": "70 72 6f 64 75 63 74 69 76 65", "compression": {"model_a": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%", "model_b": "0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67% 0.67%"}, "model_tokens": {"model_a": [[61076, "productive", "normal", 0.8636018633842468]], "model_b": [[61076, "productive", "normal", 0.691795289516449]]}, "loss": {"model_a": 0.26416535172527406, "model_b": 0.6656966863476906}, "topk": {"model_a": [61076, 1, 0.8636018633842468, [[61076, 0.863602, "productive", false], [46, 0.113879, "-", false], [62383, 0.01852, " productive", false], [4811, 0.001983, " to", false], [49587, 0.000345, "product", false], [59918, 0.000264, " intuitive", false], [47687, 0.000215, " useful", false], [59593, 0.000179, " effective", false], [7865, 0.000142, "int", false], [52574, 9.4e-05, " product", false]]], "model_b": [61076, 1, 0.691795289516449, [[61076, 0.691795, "productive", false], [46, 0.237432, "-", false], [4811, 0.030356, " to", false], [62383, 0.027099, " productive", false], [7865, 0.008237, "int", false], [59918, 0.002087, " intuitive", false], [59593, 0.000659, " effective", false], [58227, 0.000244, "effective", false], [1843, 0.000198, "ed", false], [47687, 0.000155, " useful", false]]]}, "raw_delta": -0.022265625, "tuned_delta": 0.03182397241507559}, {"byte_start": 4297, "byte_end": 4298, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "47.06%", "model_b": "38.04%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.07382529228925705]], "model_b": [[45, ",", "normal", 0.12078883498907089]]}, "loss": {"model_a": 47.05665465399548, "model_b": 38.03981064843946}, "topk": {"model_a": [45, 3, 0.07382529228925705, [[47, 0.73699, ".", false], [4811, 0.090839, " to", false], [45, 0.073825, ",", false], [21265, 0.025615, " and", false], [4596, 0.016618, " in", false], [21700, 0.009107, " for", false], [4423, 0.007689, " as", false], [51018, 0.00695, " because", false], [275, 0.004281, " (", false], [32465, 0.00344, " when", false]]], "model_b": [45, 2, 0.12078883498907089, [[47, 0.693475, ".", false], [45, 0.120789, ",", false], [4596, 0.041834, " in", false], [4811, 0.025916, " to", false], [21265, 0.025512, " and", false], [51018, 0.016766, " because", false], [4423, 0.015891, " as", false], [32465, 0.011587, " when", false], [21700, 0.010918, " for", false], [59, 0.00377, ":", false]]]}, "raw_delta": 0.5, "tuned_delta": 0.5540895974150756}, {"byte_start": 4298, "byte_end": 4302, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 732, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.90% 4.90% 4.90% 4.90%", "model_b": "5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.3399445116519928]], "model_b": [[21265, " and", "normal", 0.2830912172794342]]}, "loss": {"model_a": 4.895864518641745, "model_b": 5.670749550369216}, "topk": {"model_a": [21265, 1, 0.3399445116519928, [[21265, 0.339945, " and", false], [4423, 0.127708, " as", false], [51018, 0.062052, " because", false], [39690, 0.030129, " since", false], [4596, 0.028861, " in", false], [30788, 0.024208, " even", false], [61953, 0.019965, " especially", false], [4424, 0.019914, " at", false], [22187, 0.019226, " not", false], [31198, 0.017515, " just", false]]], "model_b": [21265, 1, 0.2830912172794342, [[21265, 0.283091, " and", false], [4423, 0.216166, " as", false], [51018, 0.067429, " because", false], [39690, 0.043954, " since", false], [4596, 0.026255, " in", false], [30788, 0.021219, " even", false], [61953, 0.019916, " especially", false], [21700, 0.019895, " for", false], [4788, 0.017145, " so", false], [4424, 0.01461, " at", false]]]}, "raw_delta": -0.04296875, "tuned_delta": 0.011120847415075588}, {"byte_start": 4302, "byte_end": 4304, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 733, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "33.39% 33.39%", "model_b": "43.11% 43.11%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.02479836903512478]], "model_b": [[332, " a", "normal", 0.008275652304291725]]}, "loss": {"model_a": 33.39050045807464, "model_b": 43.111785401564724}, "topk": {"model_a": [332, 6, 0.02479836903512478, [[22590, 0.140634, " the", false], [32232, 0.114203, " they", false], [4601, 0.03931, " it", false], [4596, 0.032636, " in", false], [22748, 0.026399, " was", false], [332, 0.024798, " a", false], [22190, 0.021132, " now", false], [61959, 0.020945, " eventually", false], [31581, 0.01996, " only", false], [39931, 0.018339, " their", false]]], "model_b": [332, 26, 0.008275652304291725, [[22590, 0.16504, " the", false], [32232, 0.047658, " they", false], [4596, 0.039598, " in", false], [39931, 0.032123, " their", false], [4601, 0.027427, " it", false], [31581, 0.02475, " only", false], [30788, 0.018249, " even", false], [30597, 0.017724, " deep", false], [53087, 0.017622, " systems", false], [22748, 0.017265, " was", false]]]}, "raw_delta": -0.5390625, "tuned_delta": -0.4849729025849244}, {"byte_start": 4304, "byte_end": 4308, "display": {"text": " col", "kind": "normal"}, "is_word": true, "word_id": 734, "word_key": " col", "bytes_hex": "20 63 6f 6c", "compression": {"model_a": "39.73% 39.73% 39.73% 39.73%", "model_b": "47.06% 47.06% 47.06% 47.06%"}, "model_tokens": {"model_a": [[21454, " col", "normal", 0.00015093869296833873]], "model_b": [[21454, " col", "normal", 3.0208191674319096e-05]]}, "loss": {"model_a": 39.73046889948122, "model_b": 47.05665465399548}, "topk": {"model_a": [21454, 589, 0.00015093869296833873, [[38961, 0.064862, " major", false], [40166, 0.037564, " waste", false], [45301, 0.031831, " better", false], [22168, 0.028106, " new", false], [31466, 0.024427, " much", false], [52245, 0.019058, " mistake", false], [30585, 0.018882, " dead", false], [47342, 0.018667, " source", false], [59513, 0.017021, " different", false], [31458, 0.016709, " more", false]]], "model_b": [21454, 1356, 3.0208191674319096e-05, [[22031, 0.062577, " lot", false], [31466, 0.053037, " much", false], [31458, 0.045737, " more", false], [45301, 0.035002, " better", false], [31118, 0.026756, " huge", false], [38864, 0.025803, " large", false], [38629, 0.024691, " great", false], [22168, 0.024327, " new", false], [38961, 0.023301, " major", false], [21357, 0.021689, " big", false]]]}, "raw_delta": -0.40625, "tuned_delta": -0.3521604025849244}, {"byte_start": 4308, "byte_end": 4312, "display": {"text": "ossa", "kind": "normal"}, "is_word": true, "word_id": 735, "word_key": "ossa", "bytes_hex": "6f 73 73 61", "compression": {"model_a": "0.02% 0.02% 0.02% 0.02%", "model_b": "0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"model_a": [[26568, "ossa", "normal", 0.9960336089134216]], "model_b": [[26568, "ossa", "normal", 0.9936297535896301]]}, "loss": {"model_a": 0.017886195689732095, "model_b": 0.0287554992242616}, "topk": {"model_a": [26568, 1, 0.9960336089134216, [[26568, 0.996034, "ossa", false], [8420, 0.002599, "oss", false], [33773, 0.000165, "ander", false], [117, 0.000155, "t", false], [46, 0.000105, "-", false], [2102, 7.4e-05, "os", false], [112, 7e-05, "o", false], [98, 6.2e-05, "a", false], [26721, 5.8e-05, "port", false], [2218, 5.2e-05, "ts", false]]], "model_b": [26568, 1, 0.9936297535896301, [[26568, 0.99363, "ossa", false], [8420, 0.002703, "oss", false], [46, 0.000536, "-", false], [26555, 0.000467, "osal", false], [33773, 0.00028, "ander", false], [8387, 0.000245, "oph", false], [98, 0.000244, "a", false], [24385, 0.000171, "abor", false], [117, 0.000133, "t", false], [26569, 0.000119, "osse", false]]]}, "raw_delta": -0.00060272216796875, "tuned_delta": 0.05348687524710684}, {"byte_start": 4312, "byte_end": 4313, "display": {"text": "l", "kind": "normal"}, "is_word": true, "word_id": 736, "word_key": "l", "bytes_hex": "6c", "compression": {"model_a": "0.91%", "model_b": "0.17%"}, "model_tokens": {"model_a": [[109, "l", "normal", 0.9505134224891663]], "model_b": [[109, "l", "normal", 0.9902612566947937]]}, "loss": {"model_a": 0.9113704634521954, "model_b": 0.17390885655247207}, "topk": {"model_a": [109, 1, 0.9505134224891663, [[109, 0.950513, "l", false], [2018, 0.049357, "ll", false], [2025, 4.9e-05, "lt", false], [26157, 7e-06, "list", false], [2077, 7e-06, "nt", false], [2030, 5e-06, "ly", false], [2062, 5e-06, "nd", false], [2174, 4e-06, "ry", false], [40166, 4e-06, " waste", false], [8099, 3e-06, "lit", false]]], "model_b": [109, 1, 0.9902612566947937, [[109, 0.990261, "l", false], [2018, 0.009681, "ll", false], [2174, 1.3e-05, "ry", false], [2030, 5e-06, "ly", false], [34, 4e-06, "!", false], [2011, 2e-06, "le", false], [2024, 2e-06, "ls", false], [2015, 2e-06, "li", false], [8064, 2e-06, "lbl", false], [2206, 1e-06, "te", false]]]}, "raw_delta": 0.0408935546875, "tuned_delta": 0.09498315210257559}, {"byte_start": 4313, "byte_end": 4319, "display": {"text": " waste", "kind": "normal"}, "is_word": true, "word_id": 737, "word_key": " waste", "bytes_hex": "20 77 61 73 74 65", "compression": {"model_a": "0.67% 0.67% 0.67% 0.67% 0.67% 0.67%", "model_b": "7.70% 7.70% 7.70% 7.70% 7.70% 7.70%"}, "model_tokens": {"model_a": [[40166, " waste", "normal", 0.8000627756118774]], "model_b": [[40166, " waste", "normal", 0.07717099040746689]]}, "loss": {"model_a": 0.6721540616120861, "model_b": 7.7018875880791}, "topk": {"model_a": [40166, 1, 0.8000627756118774, [[40166, 0.800063, " waste", false], [52245, 0.084998, " mistake", false], [38392, 0.012419, " error", false], [31333, 0.011166, " loss", false], [51708, 0.008317, " failure", false], [32251, 0.007249, " time", false], [45157, 0.00592, " amount", false], [45829, 0.003701, " effort", false], [63494, 0.002904, " distraction", false], [22097, 0.002578, " mis", false]]], "model_b": [40166, 2, 0.07717099040746689, [[45157, 0.38708, " amount", false], [40166, 0.077171, " waste", false], [45829, 0.040266, " effort", false], [51708, 0.023832, " failure", false], [31333, 0.023656, " loss", false], [46430, 0.021358, " lesson", false], [52245, 0.020993, " mistake", false], [38392, 0.01433, " error", false], [46685, 0.013619, " number", false], [22459, 0.012455, " set", false]]]}, "raw_delta": -0.3898111979166666, "tuned_delta": -0.335721600501591}, {"byte_start": 4319, "byte_end": 4322, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 738, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.12% 0.12% 0.12%", "model_b": "0.36% 0.36% 0.36%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9799205660820007]], "model_b": [[4706, " of", "normal", 0.9418061375617981]]}, "loss": {"model_a": 0.1225433714947799, "model_b": 0.3595583954038452}, "topk": {"model_a": [4706, 1, 0.9799205660820007, [[4706, 0.979921, " of", false], [47, 0.007993, ".", false], [45, 0.003699, ",", false], [4596, 0.002837, " in", false], [4811, 0.001225, " to", false], [21700, 0.000496, " for", false], [32465, 0.000248, " when", false], [4588, 0.000233, " if", false], [115, 0.000213, "r", false], [30322, 0.000212, " both", false]]], "model_b": [4706, 1, 0.9418061375617981, [[4706, 0.941806, " of", false], [47, 0.038918, ".", false], [45, 0.008229, ",", false], [4596, 0.003892, " in", false], [4811, 0.000695, " to", false], [7592, 0.000646, "ful", false], [32465, 0.000414, " when", false], [4588, 0.000409, " if", false], [275, 0.000408, " (", false], [32227, 0.000391, " that", false]]]}, "raw_delta": -0.013142903645833336, "tuned_delta": 0.04094669376924225}, {"byte_start": 4322, "byte_end": 4333, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 739, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"model_a": "11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17%", "model_b": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%"}, "model_tokens": {"model_a": [[62496, " researcher", "normal", 0.0010917175095528364]], "model_b": [[62496, " researcher", "normal", 7.696600368944928e-05]]}, "loss": {"model_a": 11.168590870518251, "model_b": 15.574548736869486}, "topk": {"model_a": [62496, 29, 0.0010917175095528364, [[32251, 0.440795, " time", false], [45829, 0.220168, " effort", false], [57103, 0.078411, " research", false], [60406, 0.075986, " resources", false], [38720, 0.043124, " human", false], [59346, 0.021317, " computing", false], [64862, 0.011585, " computational", false], [22590, 0.011012, " the", false], [63370, 0.008455, " computation", false], [39052, 0.008243, " money", false]]], "model_b": [62496, 234, 7.696600368944928e-05, [[32251, 0.324617, " time", false], [60406, 0.177229, " resources", false], [45829, 0.097109, " effort", false], [64862, 0.0704, " computational", false], [57103, 0.035408, " research", false], [59346, 0.025855, " computing", false], [39052, 0.023635, " money", false], [38720, 0.020891, " human", false], [45860, 0.015091, " energy", false], [57516, 0.014694, " valuable", false]]]}, "raw_delta": -0.24431818181818182, "tuned_delta": -0.19022858440310625}, {"byte_start": 4333, "byte_end": 4335, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 740, "word_key": "'s", "bytes_hex": "27 73", "compression": {"model_a": "24.09% 24.09%", "model_b": "19.87% 19.87%"}, "model_tokens": {"model_a": [[460, "'s", "normal", 0.06930006295442581]], "model_b": [[460, "'s", "normal", 0.11073441058397293]]}, "loss": {"model_a": 24.091880077344992, "model_b": 19.86523444974061}, "topk": {"model_a": [460, 3, 0.06930006295442581, [[32251, 0.671968, " time", false], [45829, 0.15504, " effort", false], [460, 0.0693, "'s", false], [21265, 0.041618, " and", false], [45860, 0.011513, " energy", false], [46, 0.008188, "-", false], [60406, 0.005903, " resources", false], [51566, 0.003552, " efforts", false], [38853, 0.00325, " labor", false], [59193, 0.002949, " attention", false]]], "model_b": [460, 2, 0.11073441058397293, [[32251, 0.598311, " time", false], [460, 0.110734, "'s", false], [45829, 0.110558, " effort", false], [21265, 0.055152, " and", false], [45860, 0.036748, " energy", false], [60406, 0.020263, " resources", false], [47499, 0.017564, " talent", false], [51566, 0.005429, " efforts", false], [46, 0.004162, "-", false], [45, 0.003818, ",", false]]]}, "raw_delta": 0.234375, "tuned_delta": 0.2884645974150756}, {"byte_start": 4335, "byte_end": 4340, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 741, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"model_a": "0.51% 0.51% 0.51% 0.51% 0.51%", "model_b": "0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"model_a": [[32251, " time", "normal", 0.866916298866272]], "model_b": [[32251, " time", "normal", 0.8006796836853027]]}, "loss": {"model_a": 0.5142418846918668, "model_b": 0.8101070786241737}, "topk": {"model_a": [32251, 1, 0.866916298866272, [[32251, 0.866916, " time", false], [45829, 0.042071, " effort", false], [21265, 0.021866, " and", false], [51566, 0.018416, " efforts", false], [45860, 0.005459, " energy", false], [56903, 0.003187, " precious", false], [38720, 0.002723, " human", false], [57516, 0.002453, " valuable", false], [59193, 0.002409, " attention", false], [60406, 0.001895, " resources", false]]], "model_b": [32251, 1, 0.8006796836853027, [[32251, 0.80068, " time", false], [45829, 0.033709, " effort", false], [45860, 0.016722, " energy", false], [57516, 0.016474, " valuable", false], [51566, 0.015898, " efforts", false], [56903, 0.010467, " precious", false], [21265, 0.007929, " and", false], [60406, 0.006557, " resources", false], [47499, 0.005076, " talent", false], [64862, 0.004052, " computational", false]]]}, "raw_delta": -0.01640625, "tuned_delta": 0.03768334741507559}, {"byte_start": 4340, "byte_end": 4341, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "35.93%", "model_b": "45.65%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.13542591035366058]], "model_b": [[45, ",", "normal", 0.08081928640604019]]}, "loss": {"model_a": 35.92648783463727, "model_b": 45.647772778127354}, "topk": {"model_a": [45, 3, 0.13542591035366058, [[47, 0.598064, ".", false], [21265, 0.166502, " and", false], [45, 0.135426, ",", false], [4811, 0.028994, " to", false], [4596, 0.011701, " in", false], [275, 0.008524, " (", false], [32227, 0.005544, " that", false], [5346, 0.004165, "---", false], [4423, 0.003963, " as", false], [32465, 0.003101, " when", false]]], "model_b": [45, 3, 0.08081928640604019, [[47, 0.574879, ".", false], [21265, 0.296293, " and", false], [45, 0.080819, ",", false], [4596, 0.007969, " in", false], [275, 0.005513, " (", false], [32227, 0.004411, " that", false], [32465, 0.004243, " when", false], [4423, 0.002886, " as", false], [4811, 0.002007, " to", false], [4588, 0.00127, " if", false]]]}, "raw_delta": -0.5390625, "tuned_delta": -0.4849729025849244}, {"byte_start": 4341, "byte_end": 4346, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 742, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"model_a": "13.30% 13.30% 13.30% 13.30% 13.30%", "model_b": "10.26% 10.26% 10.26% 10.26% 10.26%"}, "model_tokens": {"model_a": [[32465, " when", "normal", 0.025247817859053612]], "model_b": [[32465, " when", "normal", 0.058145299553871155]]}, "loss": {"model_a": 13.299844908195132, "model_b": 10.256660056319973}, "topk": {"model_a": [32465, 7, 0.025247817859053612, [[4811, 0.548573, " to", false], [51018, 0.050523, " because", false], [4423, 0.044626, " as", false], [4596, 0.030249, " in", false], [21700, 0.028655, " for", false], [21265, 0.027587, " and", false], [32465, 0.025248, " when", false], [22187, 0.023942, " not", false], [39690, 0.020568, " since", false], [45860, 0.019586, " energy", false]]], "model_b": [32465, 5, 0.058145299553871155, [[45860, 0.13604, " energy", false], [45829, 0.092978, " effort", false], [21265, 0.079528, " and", false], [4423, 0.06777, " as", false], [32465, 0.058145, " when", false], [51018, 0.048808, " because", false], [4596, 0.045262, " in", false], [39052, 0.035881, " money", false], [61953, 0.031841, " especially", false], [39690, 0.031129, " since", false]]]}, "raw_delta": 0.16875000000000007, "tuned_delta": 0.22283959741507564}, {"byte_start": 4346, "byte_end": 4347, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "98.06%", "model_b": "77.77%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.004391924012452364]], "model_b": [[45, ",", "normal", 0.013129550963640213]]}, "loss": {"model_a": 98.05817856042172, "model_b": 77.77027954792068}, "topk": {"model_a": [45, 32, 0.004391924012452364, [[22590, 0.253762, " the", false], [32232, 0.102642, " they", false], [4601, 0.098824, " it", false], [30597, 0.034525, " deep", false], [32227, 0.030201, " that", false], [4596, 0.026019, " in", false], [332, 0.025607, " a", false], [39931, 0.018047, " their", false], [45301, 0.017256, " better", false], [32464, 0.016987, " what", false]]], "model_b": [45, 14, 0.013129550963640213, [[22590, 0.218766, " the", false], [4601, 0.069837, " it", false], [32232, 0.061109, " they", false], [332, 0.035266, " a", false], [55794, 0.031195, " compared", false], [52195, 0.03114, " massive", false], [39931, 0.030162, " their", false], [53087, 0.019022, " systems", false], [21256, 0.018, " all", false], [4596, 0.016145, " in", false]]]}, "raw_delta": 1.125, "tuned_delta": 1.1790895974150757}, {"byte_start": 4347, "byte_end": 4355, "display": {"text": " through", "kind": "normal"}, "is_word": true, "word_id": 743, "word_key": " through", "bytes_hex": "20 74 68 72 6f 75 67 68", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "13.03% 13.03% 13.03% 13.03% 13.03% 13.03% 13.03% 13.03%"}, "model_tokens": {"model_a": [[53140, " through", "normal", 0.0019288297044113278]], "model_b": [[53140, " through", "normal", 0.00308551755733788]]}, "loss": {"model_a": 14.088818758681281, "model_b": 13.032157351780185}, "topk": {"model_a": [53140, 38, 0.0019288297044113278, [[4596, 0.254129, " in", false], [52028, 0.21454, " instead", false], [4423, 0.069479, " as", false], [31578, 0.039127, " once", false], [4450, 0.033198, " by", false], [32487, 0.032611, " with", false], [61959, 0.02865, " eventually", false], [31601, 0.021773, " over", false], [37634, 0.021175, " after", false], [51744, 0.018751, " finally", false]]], "model_b": [53140, 26, 0.00308551755733788, [[4596, 0.253724, " in", false], [4423, 0.156314, " as", false], [52028, 0.104808, " instead", false], [32487, 0.041539, " with", false], [4450, 0.032278, " by", false], [4424, 0.029601, " at", false], [37634, 0.026169, " after", false], [21700, 0.025946, " for", false], [31578, 0.025358, " once", false], [21265, 0.021078, " and", false]]]}, "raw_delta": 0.05859375, "tuned_delta": 0.11268334741507559}, {"byte_start": 4355, "byte_end": 4361, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 744, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"model_a": "14.75% 14.75% 14.75% 14.75% 14.75% 14.75%", "model_b": "20.76% 20.76% 20.76% 20.76% 20.76% 20.76%"}, "model_tokens": {"model_a": [[37045, " Moore", "normal", 0.007424832321703434]], "model_b": [[37045, " Moore", "normal", 0.0009917125571519136]]}, "loss": {"model_a": 14.746296967419742, "model_b": 20.75752630445709}, "topk": {"model_a": [37045, 19, 0.007424832321703434, [[52195, 0.171718, " massive", false], [22590, 0.171164, " the", false], [56537, 0.057447, " learning", false], [63370, 0.047718, " computation", false], [30597, 0.036371, " deep", false], [39660, 0.023785, " sheer", false], [63885, 0.02346, " statistical", false], [332, 0.020174, " a", false], [47202, 0.019178, " search", false], [57103, 0.017832, " research", false]]], "model_b": [37045, 88, 0.0009917125571519136, [[52195, 0.209097, " massive", false], [22590, 0.163854, " the", false], [56537, 0.090961, " learning", false], [30597, 0.02941, " deep", false], [332, 0.026769, " a", false], [31978, 0.025126, " self", false], [51396, 0.017499, " decades", false], [51832, 0.017402, " general", false], [39660, 0.016893, " sheer", false], [39931, 0.013438, " their", false]]]}, "raw_delta": -0.3333333333333334, "tuned_delta": -0.27924373591825785}, {"byte_start": 4361, "byte_end": 4363, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 745, "word_key": "'s", "bytes_hex": "27 73", "compression": {"model_a": "0.04% 0.04%", "model_b": "0.03% 0.03%"}, "model_tokens": {"model_a": [[460, "'s", "normal", 0.9960860013961792]], "model_b": [[460, "'s", "normal", 0.9964474439620972]]}, "loss": {"model_a": 0.0354972191380837, "model_b": 0.032057566120827524}, "topk": {"model_a": [460, 1, 0.9960860013961792, [[460, 0.996086, "'s", false], [116, 0.001754, "s", false], [28309, 0.000765, "’s", false], [40, 0.000344, "'", false], [21265, 0.00018, " and", false], [45, 0.000148, ",", false], [46, 0.000134, "-", false], [439, 4.1e-05, "''", false], [4522, 3.6e-05, " et", false], [97, 2.3e-05, "`", false]]], "model_b": [460, 1, 0.9964474439620972, [[460, 0.996447, "'s", false], [28309, 0.001471, "’s", false], [116, 0.000703, "s", false], [21265, 0.00037, " and", false], [45, 0.000228, ",", false], [46, 0.000182, "-", false], [40, 4.7e-05, "'", false], [4715, 2.3e-05, " or", false], [274, 1.7e-05, " '", false], [101, 1.4e-05, "d", false]]]}, "raw_delta": 0.00019073486328125, "tuned_delta": 0.05428033227835684}, {"byte_start": 4363, "byte_end": 4367, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 746, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"model_a": "0.43% 0.43% 0.43% 0.43%", "model_b": "0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"model_a": [[21988, " law", "normal", 0.909474790096283]], "model_b": [[21988, " law", "normal", 0.9458680748939514]]}, "loss": {"model_a": 0.4292686965535703, "model_b": 0.25095708413901036}, "topk": {"model_a": [21988, 1, 0.909474790096283, [[21988, 0.909475, " law", false], [20267, 0.088024, " Law", false], [31259, 0.000338, " laws", false], [21265, 0.000272, " and", false], [45828, 0.000207, " effect", false], [45, 0.00013, ",", false], [53127, 8.8e-05, " theorem", false], [4715, 7.9e-05, " or", false], [275, 6.8e-05, " (", false], [46, 6.6e-05, "-", false]]], "model_b": [21988, 1, 0.9458680748939514, [[21988, 0.945868, " law", false], [20267, 0.031679, " Law", false], [21265, 0.002854, " and", false], [31907, 0.002489, " rule", false], [56537, 0.001303, " learning", false], [31259, 0.001272, " laws", false], [55836, 0.001249, " constant", false], [47205, 0.001043, " second", false], [46, 0.000635, "-", false], [60250, 0.000618, " principle", false]]]}, "raw_delta": 0.0098876953125, "tuned_delta": 0.06397729272757559}, {"byte_start": 4367, "byte_end": 4368, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.36%", "model_b": "3.91%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8766926527023315]], "model_b": [[45, ",", "normal", 0.8064049482345581]]}, "loss": {"model_a": 2.3598771420791147, "model_b": 3.9096472055340556}, "topk": {"model_a": [45, 1, 0.8766926527023315, [[45, 0.876693, ",", false], [21265, 0.085212, " and", false], [4706, 0.01144, " of", false], [4715, 0.008383, " or", false], [275, 0.003987, " (", false], [46, 0.003422, "-", false], [460, 0.000729, "'s", false], [4596, 0.000654, " in", false], [45796, 0.000635, " driven", false], [22590, 0.000513, " the", false]]], "model_b": [45, 1, 0.8064049482345581, [[45, 0.806405, ",", false], [21265, 0.158336, " and", false], [4706, 0.005903, " of", false], [4715, 0.005774, " or", false], [275, 0.004725, " (", false], [4596, 0.001941, " in", false], [46, 0.000944, "-", false], [22590, 0.000644, " the", false], [55465, 0.000602, " advances", false], [4712, 0.000527, " on", false]]]}, "raw_delta": -0.0859375, "tuned_delta": -0.03184790258492441}, {"byte_start": 4368, "byte_end": 4376, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 747, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"model_a": "7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40%", "model_b": "4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86%"}, "model_tokens": {"model_a": [[52195, " massive", "normal", 0.03779609128832817]], "model_b": [[52195, " massive", "normal", 0.1165182814002037]]}, "loss": {"model_a": 7.396629848307673, "model_b": 4.8606424717450425}, "topk": {"model_a": [52195, 6, 0.03779609128832817, [[22590, 0.273887, " the", false], [63370, 0.084655, " computation", false], [32232, 0.075957, " they", false], [4601, 0.043927, " it", false], [31458, 0.041796, " more", false], [52195, 0.037796, " massive", false], [30597, 0.027417, " deep", false], [332, 0.026901, " a", false], [45301, 0.026221, " better", false], [32227, 0.021507, " that", false]]], "model_b": [52195, 3, 0.1165182814002037, [[22590, 0.178928, " the", false], [63370, 0.142913, " computation", false], [52195, 0.116518, " massive", false], [51832, 0.030715, " general", false], [31466, 0.027823, " much", false], [59346, 0.027502, " computing", false], [4601, 0.023706, " it", false], [31458, 0.022203, " more", false], [332, 0.021684, " a", false], [53087, 0.019722, " systems", false]]]}, "raw_delta": 0.140625, "tuned_delta": 0.19471459741507557}, {"byte_start": 4376, "byte_end": 4388, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 748, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32%", "model_b": "2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37% 2.37%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.21400213241577148]], "model_b": [[63370, " computation", "normal", 0.20766384899616241]]}, "loss": {"model_a": 2.3246550951824116, "model_b": 2.371617824378016}, "topk": {"model_a": [63370, 2, 0.21400213241577148, [[50897, 0.395801, " amounts", false], [63370, 0.214002, " computation", false], [64423, 0.042162, " improvements", false], [22168, 0.035789, " new", false], [45, 0.028302, ",", false], [64862, 0.026595, " computational", false], [59847, 0.017846, " increases", false], [31458, 0.017664, " more", false], [51832, 0.014237, " general", false], [63621, 0.013986, " improvement", false]]], "model_b": [63370, 2, 0.20766384899616241, [[50897, 0.527791, " amounts", false], [63370, 0.207664, " computation", false], [59346, 0.025802, " computing", false], [62426, 0.018299, " quantities", false], [45, 0.017623, ",", false], [59847, 0.017105, " increases", false], [52333, 0.016382, " numbers", false], [64423, 0.014297, " improvements", false], [64862, 0.008347, " computational", false], [31458, 0.008133, " more", false]]]}, "raw_delta": -0.0026041666666666574, "tuned_delta": 0.05148543074840893}, {"byte_start": 4388, "byte_end": 4395, "display": {"text": " became", "kind": "normal"}, "is_word": true, "word_id": 749, "word_key": " became", "bytes_hex": "20 62 65 63 61 6d 65", "compression": {"model_a": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "model_b": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%"}, "model_tokens": {"model_a": [[45283, " became", "normal", 0.3594065308570862]], "model_b": [[45283, " became", "normal", 0.25645196437835693]]}, "loss": {"model_a": 2.616494912326524, "model_b": 3.502077805729347}, "topk": {"model_a": [45283, 1, 0.3594065308570862, [[45283, 0.359407, " became", false], [22748, 0.1922, " was", false], [30383, 0.059947, " came", false], [21265, 0.051972, " and", false], [38128, 0.042128, " could", false], [51744, 0.039702, " finally", false], [31351, 0.015692, " made", false], [61959, 0.013754, " eventually", false], [45, 0.011628, ",", false], [57094, 0.009835, " replaced", false]]], "model_b": [45283, 1, 0.25645196437835693, [[45283, 0.256452, " became", false], [22748, 0.163918, " was", false], [21265, 0.094851, " and", false], [4600, 0.072699, " is", false], [38128, 0.065869, " could", false], [51019, 0.042586, " becomes", false], [21800, 0.028037, " has", false], [21413, 0.022032, " can", false], [45, 0.017662, ",", false], [21795, 0.010828, " had", false]]]}, "raw_delta": -0.04910714285714285, "tuned_delta": 0.004982454557932739}, {"byte_start": 4395, "byte_end": 4405, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 750, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "model_b": "1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.6220821738243103]], "model_b": [[59206, " available", "normal", 0.48533299565315247]]}, "loss": {"model_a": 0.8523735349002174, "model_b": 1.296171325798678}, "topk": {"model_a": [59206, 1, 0.6220821738243103, [[59206, 0.622082, " available", false], [22590, 0.114845, " the", false], [31458, 0.033297, " more", false], [332, 0.028031, " a", false], [56895, 0.012456, " possible", false], [52648, 0.011136, " readily", false], [64430, 0.011072, " increasingly", false], [4788, 0.010731, " so", false], [31466, 0.010326, " much", false], [51178, 0.008644, " cheaper", false]]], "model_b": [59206, 1, 0.48533299565315247, [[59206, 0.485333, " available", false], [22590, 0.057887, " the", false], [31458, 0.043007, " more", false], [52648, 0.035721, " readily", false], [62675, 0.025713, " ubiquitous", false], [31466, 0.023773, " much", false], [332, 0.020789, " a", false], [47792, 0.01756, " widely", false], [64430, 0.013239, " increasingly", false], [45820, 0.011769, " easily", false]]]}, "raw_delta": -0.024609374999999992, "tuned_delta": 0.029480222415075596}, {"byte_start": 4405, "byte_end": 4409, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 751, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "12.54% 12.54% 12.54% 12.54%", "model_b": "10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.06176622211933136]], "model_b": [[21265, " and", "normal", 0.09897954761981964]]}, "loss": {"model_a": 12.539048695226342, "model_b": 10.425725881424148}, "topk": {"model_a": [21265, 4, 0.06176622211933136, [[47, 0.325989, ".", false], [4811, 0.230561, " to", false], [4424, 0.07997, " at", false], [21265, 0.061766, " and", false], [45, 0.052388, ",", false], [52028, 0.050491, " instead", false], [21700, 0.037084, " for", false], [4596, 0.036406, " in", false], [32227, 0.033453, " that", false], [4423, 0.009834, " as", false]]], "model_b": [21265, 4, 0.09897954761981964, [[47, 0.245723, ".", false], [4424, 0.201676, " at", false], [4811, 0.164062, " to", false], [21265, 0.09898, " and", false], [45, 0.045116, ",", false], [21700, 0.041593, " for", false], [4596, 0.036574, " in", false], [32227, 0.021752, " that", false], [45145, 0.014391, " almost", false], [31466, 0.014224, " much", false]]]}, "raw_delta": 0.1171875, "tuned_delta": 0.17127709741507557}, {"byte_start": 4409, "byte_end": 4411, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 752, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "43.96% 43.96%", "model_b": "38.89% 38.89%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.007724887225776911]], "model_b": [[332, " a", "normal", 0.013349362649023533]]}, "loss": {"model_a": 43.9571145270856, "model_b": 38.88513977396034}, "topk": {"model_a": [332, 22, 0.007724887225776911, [[22590, 0.157717, " the", false], [22748, 0.066187, " was", false], [38128, 0.065747, " could", false], [4601, 0.041408, " it", false], [31351, 0.039964, " made", false], [51596, 0.028288, " enabled", false], [50887, 0.026077, " allowed", false], [45, 0.015678, ",", false], [46936, 0.01519, " proved", false], [63843, 0.014301, " researchers", false]]], "model_b": [332, 11, 0.013349362649023533, [[22590, 0.084904, " the", false], [22748, 0.072187, " was", false], [38128, 0.034664, " could", false], [31458, 0.033619, " more", false], [59593, 0.023978, " effective", false], [31466, 0.02243, " much", false], [45283, 0.018349, " became", false], [51832, 0.01826, " general", false], [4601, 0.017567, " it", false], [45, 0.017546, ",", false]]]}, "raw_delta": 0.28125, "tuned_delta": 0.3353395974150756}, {"byte_start": 4411, "byte_end": 4417, "display": {"text": " means", "kind": "normal"}, "is_word": true, "word_id": 753, "word_key": " means", "bytes_hex": "20 6d 65 61 6e 73", "compression": {"model_a": "28.55% 28.55% 28.55% 28.55% 28.55% 28.55%", "model_b": "21.98% 21.98% 21.98% 21.98% 21.98% 21.98%"}, "model_tokens": {"model_a": [[38989, " means", "normal", 7.455547893187031e-05]], "model_b": [[38989, " means", "normal", 0.0006783679127693176]]}, "loss": {"model_a": 28.553339350927395, "model_b": 21.9785572635428}, "topk": {"model_a": [38989, 463, 7.455547893187031e-05, [[59513, 0.145706, " different", false], [45301, 0.142446, " better", false], [22168, 0.091024, " new", false], [31466, 0.065912, " much", false], [31458, 0.064476, " more", false], [63885, 0.048841, " statistical", false], [52907, 0.025329, " simpler", false], [47202, 0.017838, " search", false], [60315, 0.016518, " radically", false], [51832, 0.016076, " general", false]]], "model_b": [38989, 160, 0.0006783679127693176, [[31466, 0.075546, " much", false], [51832, 0.051519, " general", false], [22168, 0.041704, " new", false], [31118, 0.040642, " huge", false], [38864, 0.034805, " large", false], [45301, 0.034267, " better", false], [52195, 0.032142, " massive", false], [31458, 0.030744, " more", false], [32373, 0.030157, " vast", false], [22031, 0.02407, " lot", false]]]}, "raw_delta": 0.36458333333333326, "tuned_delta": 0.41867293074840883}, {"byte_start": 4417, "byte_end": 4421, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 754, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"model_a": "10.57% 10.57% 10.57% 10.57%", "model_b": "13.31% 13.31% 13.31% 13.31%"}, "model_tokens": {"model_a": [[22748, " was", "normal", 0.0957559198141098]], "model_b": [[22748, " was", "normal", 0.05150920897722244]]}, "loss": {"model_a": 10.566614069010962, "model_b": 13.313933726953811}, "topk": {"model_a": [22748, 3, 0.0957559198141098, [[4706, 0.502468, " of", false], [4811, 0.246519, " to", false], [22748, 0.095756, " was", false], [21700, 0.074487, " for", false], [4450, 0.01781, " by", false], [38128, 0.014682, " could", false], [32227, 0.005941, " that", false], [51680, 0.005413, " existed", false], [21795, 0.003417, " had", false], [38547, 0.003039, " found", false]]], "model_b": [22748, 4, 0.05150920897722244, [[4706, 0.539779, " of", false], [4811, 0.239649, " to", false], [21700, 0.089503, " for", false], [22748, 0.051509, " was", false], [4450, 0.015949, " by", false], [51680, 0.009929, " existed", false], [45283, 0.008647, " became", false], [38128, 0.0068, " could", false], [32227, 0.003702, " that", false], [59206, 0.002364, " available", false]]]}, "raw_delta": -0.15234375, "tuned_delta": -0.09825415258492441}, {"byte_start": 4421, "byte_end": 4427, "display": {"text": " found", "kind": "normal"}, "is_word": true, "word_id": 755, "word_key": " found", "bytes_hex": "20 66 6f 75 6e 64", "compression": {"model_a": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "model_b": "2.63% 2.63% 2.63% 2.63% 2.63% 2.63%"}, "model_tokens": {"model_a": [[38547, " found", "normal", 0.8374359011650085]], "model_b": [[38547, " found", "normal", 0.4182043969631195]]}, "loss": {"model_a": 0.5253955328758227, "model_b": 2.6299128349538394}, "topk": {"model_a": [38547, 1, 0.8374359011650085, [[38547, 0.837436, " found", false], [61885, 0.047187, " discovered", false], [51744, 0.019061, " finally", false], [56976, 0.016228, " provided", false], [59506, 0.01444, " developed", false], [51458, 0.007916, " devised", false], [47340, 0.005037, " sought", false], [56492, 0.004759, " invented", false], [46650, 0.004718, " needed", false], [59206, 0.004589, " available", false]]], "model_b": [38547, 1, 0.4182043969631195, [[38547, 0.418204, " found", false], [59206, 0.189845, " available", false], [61885, 0.138903, " discovered", false], [56976, 0.029464, " provided", false], [46650, 0.02221, " needed", false], [59506, 0.018237, " developed", false], [31351, 0.015753, " made", false], [51351, 0.009378, " created", false], [4811, 0.00734, " to", false], [4424, 0.007024, " at", false]]]}, "raw_delta": -0.11669921875000001, "tuned_delta": -0.06260962133492443}, {"byte_start": 4427, "byte_end": 4430, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 756, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.31% 1.31% 1.31%", "model_b": "0.89% 0.89% 0.89%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8043674230575562]], "model_b": [[4811, " to", "normal", 0.8625483512878418]]}, "loss": {"model_a": 1.3149564174769197, "model_b": 0.8864215135670307}, "topk": {"model_a": [4811, 1, 0.8043674230575562, [[4811, 0.804367, " to", false], [4706, 0.097612, " of", false], [21700, 0.04111, " for", false], [275, 0.012771, " (", false], [32227, 0.011524, " that", false], [45, 0.011088, ",", false], [4450, 0.006413, " by", false], [5346, 0.002836, "---", false], [22187, 0.001534, " not", false], [4596, 0.001271, " in", false]]], "model_b": [4811, 1, 0.8625483512878418, [[4811, 0.862548, " to", false], [21700, 0.05579, " for", false], [4706, 0.024703, " of", false], [32227, 0.021924, " that", false], [45, 0.006249, ",", false], [4450, 0.004554, " by", false], [4596, 0.004515, " in", false], [275, 0.003041, " (", false], [47, 0.002062, ".", false], [4424, 0.001628, " at", false]]]}, "raw_delta": 0.023763020833333332, "tuned_delta": 0.07785261824840892}, {"byte_start": 4430, "byte_end": 4434, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 757, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"model_a": "13.24% 13.24% 13.24% 13.24%", "model_b": "18.88% 18.88% 18.88% 18.88%"}, "model_tokens": {"model_a": [[22339, " put", "normal", 0.05298086255788803]], "model_b": [[22339, " put", "normal", 0.015104366466403008]]}, "loss": {"model_a": 13.243489633160404, "model_b": 18.879017136632918}, "topk": {"model_a": [22339, 6, 0.05298086255788803, [[22681, 0.133746, " use", false], [31358, 0.094149, " make", false], [56540, 0.090845, " leverage", false], [32187, 0.08296, " take", false], [53251, 0.056313, " utilize", false], [22339, 0.052981, " put", false], [37730, 0.036128, " apply", false], [37911, 0.036024, " bring", false], [51690, 0.031508, " exploit", false], [21751, 0.020391, " get", false]]], "model_b": [22339, 11, 0.015104366466403008, [[56540, 0.305945, " leverage", false], [53251, 0.087353, " utilize", false], [31358, 0.080746, " make", false], [22681, 0.077584, " use", false], [32187, 0.070676, " take", false], [51903, 0.032097, " harness", false], [37730, 0.024822, " apply", false], [51690, 0.022776, " exploit", false], [4435, 0.016464, " be", false], [51982, 0.015907, " improve", false]]]}, "raw_delta": -0.3125, "tuned_delta": -0.2584104025849244}, {"byte_start": 4434, "byte_end": 4437, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 758, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "5.80% 5.80% 5.80%", "model_b": "7.70% 7.70% 7.70%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.38305723667144775]], "model_b": [[4601, " it", "normal", 0.27781879901885986]]}, "loss": {"model_a": 5.799897055657127, "model_b": 7.7018875880791}, "topk": {"model_a": [4601, 2, 0.38305723667144775, [[32227, 0.414391, " that", false], [4601, 0.383057, " it", false], [22590, 0.058964, " the", false], [52195, 0.020023, " massive", false], [21256, 0.015544, " all", false], [32234, 0.012122, " this", false], [63370, 0.008196, " computation", false], [332, 0.008017, " a", false], [31466, 0.00777, " much", false], [31458, 0.00695, " more", false]]], "model_b": [4601, 2, 0.27781879901885986, [[32227, 0.334996, " that", false], [4601, 0.277819, " it", false], [22590, 0.101601, " the", false], [31458, 0.029079, " more", false], [32234, 0.024942, " this", false], [52195, 0.015272, " massive", false], [31466, 0.014914, " much", false], [21256, 0.014497, " all", false], [332, 0.013192, " a", false], [39944, 0.011872, " those", false]]]}, "raw_delta": -0.10546875, "tuned_delta": -0.05137915258492441}, {"byte_start": 4437, "byte_end": 4440, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 759, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.48% 1.48% 1.48%", "model_b": "0.89% 0.89% 0.89%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7803198099136353]], "model_b": [[4811, " to", "normal", 0.8600413203239441]]}, "loss": {"model_a": 1.4793259696615346, "model_b": 0.8922918547164811}, "topk": {"model_a": [4811, 1, 0.7803198099136353, [[4811, 0.78032, " to", false], [4596, 0.086069, " in", false], [31162, 0.041428, " into", false], [21256, 0.030616, " all", false], [39934, 0.015893, " there", false], [4424, 0.013482, " at", false], [40185, 0.004383, " where", false], [63507, 0.003866, " effectively", false], [46301, 0.003237, " inside", false], [56003, 0.001885, " directly", false]]], "model_b": [4811, 1, 0.8600413203239441, [[4811, 0.860041, " to", false], [31162, 0.051064, " into", false], [4596, 0.019209, " in", false], [21256, 0.009015, " all", false], [4424, 0.008739, " at", false], [31458, 0.006716, " more", false], [63507, 0.005868, " effectively", false], [56003, 0.002745, " directly", false], [57435, 0.002123, " together", false], [31466, 0.001833, " much", false]]]}, "raw_delta": 0.032552083333333336, "tuned_delta": 0.08664168074840892}, {"byte_start": 4440, "byte_end": 4445, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 760, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"model_a": "8.40% 8.40% 8.40% 8.40% 8.40%", "model_b": "7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"model_a": [[30992, " good", "normal", 0.09741509705781937]], "model_b": [[30992, " good", "normal", 0.12313564866781235]]}, "loss": {"model_a": 8.396935980174044, "model_b": 7.551606854653167}, "topk": {"model_a": [30992, 3, 0.09741509705781937, [[22681, 0.350954, " use", false], [32499, 0.243058, " work", false], [30992, 0.097415, " good", false], [59593, 0.083261, " effective", false], [45301, 0.056173, " better", false], [22590, 0.019862, " the", false], [31466, 0.017513, " much", false], [62383, 0.016633, " productive", false], [30273, 0.010195, " best", false], [31458, 0.007053, " more", false]]], "model_b": [30992, 3, 0.12313564866781235, [[22681, 0.232283, " use", false], [32499, 0.132664, " work", false], [30992, 0.123136, " good", false], [45301, 0.108756, " better", false], [59593, 0.048771, " effective", false], [31466, 0.039733, " much", false], [22590, 0.031306, " the", false], [31458, 0.019797, " more", false], [332, 0.017295, " a", false], [62383, 0.015213, " productive", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.10096459741507559}, {"byte_start": 4445, "byte_end": 4449, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 761, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "0.16% 0.16% 0.16% 0.16%", "model_b": "0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.964491605758667]], "model_b": [[22681, " use", "normal", 0.9096100926399231]]}, "loss": {"model_a": 0.1629019668972523, "model_b": 0.42706731862252634}, "topk": {"model_a": [22681, 1, 0.964491605758667, [[22681, 0.964492, " use", false], [45828, 0.00888, " effect", false], [45, 0.004338, ",", false], [59093, 0.004256, " advantage", false], [51832, 0.001895, " general", false], [32499, 0.001795, " work", false], [21265, 0.001371, " and", false], [60212, 0.000986, " practical", false], [32356, 0.000764, " uses", false], [275, 0.000744, " (", false]]], "model_b": [22681, 1, 0.9096100926399231, [[22681, 0.90961, " use", false], [50845, 0.029854, " account", false], [45828, 0.014525, " effect", false], [32356, 0.007071, " uses", false], [32499, 0.005718, " work", false], [45, 0.004781, ",", false], [52610, 0.003457, " purpose", false], [52860, 0.002998, " service", false], [59593, 0.002039, " effective", false], [40083, 0.001837, " usage", false]]]}, "raw_delta": -0.0146484375, "tuned_delta": 0.03944115991507559}, {"byte_start": 4449, "byte_end": 4450, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "3.31%", "model_b": "2.94%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8317354321479797]], "model_b": [[47, ".", "normal", 0.8490055799484253]]}, "loss": {"model_a": 3.310872408290101, "model_b": 2.9410409158747175}, "topk": {"model_a": [47, 1, 0.8317354321479797, [[47, 0.831735, ".", false], [4596, 0.047742, " in", false], [45, 0.025462, ",", false], [5346, 0.019369, "---", false], [53356, 0.011946, " without", false], [52028, 0.011257, " instead", false], [275, 0.005403, " (", false], [4450, 0.005214, " by", false], [21700, 0.003337, " for", false], [4712, 0.002923, " on", false]]], "model_b": [47, 1, 0.8490055799484253, [[47, 0.849006, ".", false], [4596, 0.067385, " in", false], [45, 0.023546, ",", false], [275, 0.004818, " (", false], [4450, 0.004503, " by", false], [5346, 0.004446, "---", false], [21700, 0.004348, " for", false], [21265, 0.002946, " and", false], [32487, 0.002404, " with", false], [53356, 0.00224, " without", false]]]}, "raw_delta": 0.0205078125, "tuned_delta": 0.07459740991507559}, {"byte_start": 4450, "byte_end": 4451, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "2.05%", "model_b": "5.25%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.7984659075737]], "model_b": [[261, "\n\n", "control", 0.5625398755073547]]}, "loss": {"model_a": 2.0516842317329615, "model_b": 5.248084987608777}, "topk": {"model_a": [261, 1, 0.7984659075737, [[261, 0.798466, "\n\n", false], [20996, 0.02136, " The", false], [267, 0.017026, "  ", false], [3913, 0.01181, " In", false], [3336, 0.009919, " \n\n", false], [3918, 0.009581, " It", false], [3328, 0.009526, "\n\n\n", false], [0, 0.007907, "[0]", false], [29894, 0.006895, " This", false], [11, 0.005135, "\n", false]]], "model_b": [261, 1, 0.5625398755073547, [[261, 0.56254, "\n\n", false], [11, 0.054229, "\n", false], [267, 0.05138, "  ", false], [20996, 0.041915, " The", false], [3913, 0.022766, " In", false], [3336, 0.020296, " \n\n", false], [29894, 0.018022, " This", false], [28753, 0.017174, " Deep", false], [0, 0.014694, "[0]", false], [3918, 0.009958, " It", false]]]}, "raw_delta": -0.17724609375, "tuned_delta": -0.12315649633492441}, {"byte_start": 4451, "byte_end": 4452, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "2.05%", "model_b": "5.25%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.7984659075737]], "model_b": [[261, "\n\n", "control", 0.5625398755073547]]}, "loss": {"model_a": 2.0516842317329615, "model_b": 5.248084987608777}, "topk": {"model_a": [261, 1, 0.7984659075737, [[261, 0.798466, "\n\n", false], [20996, 0.02136, " The", false], [267, 0.017026, "  ", false], [3913, 0.01181, " In", false], [3336, 0.009919, " \n\n", false], [3918, 0.009581, " It", false], [3328, 0.009526, "\n\n\n", false], [0, 0.007907, "[0]", false], [29894, 0.006895, " This", false], [11, 0.005135, "\n", false]]], "model_b": [261, 1, 0.5625398755073547, [[261, 0.56254, "\n\n", false], [11, 0.054229, "\n", false], [267, 0.05138, "  ", false], [20996, 0.041915, " The", false], [3913, 0.022766, " In", false], [3336, 0.020296, " \n\n", false], [29894, 0.018022, " This", false], [28753, 0.017174, " Deep", false], [0, 0.014694, "[0]", false], [3918, 0.009958, " It", false]]]}, "raw_delta": -0.17724609375, "tuned_delta": -0.12315649633492441}, {"byte_start": 4452, "byte_end": 4454, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 762, "word_key": "in", "bytes_hex": "49 6e", "compression": {"model_a": "11.48% 11.48%", "model_b": "13.24% 13.24%"}, "model_tokens": {"model_a": [[1136, "In", "normal", 0.28333574533462524]], "model_b": [[1136, "In", "normal", 0.2314680516719818]]}, "loss": {"model_a": 11.482387288325246, "model_b": 13.243489633160404}, "topk": {"model_a": [1136, 1, 0.28333574533462524, [[1136, 0.283336, "In", false], [6699, 0.119155, "The", false], [66, 0.060258, "A", false], [33504, 0.055928, "There", false], [48358, 0.034444, "Another", false], [33505, 0.029975, "These", false], [1141, 0.026713, "It", false], [24242, 0.01586, "This", false], [58094, 0.013487, "Similarly", false], [6393, 0.013408, "One", false]]], "model_b": [1136, 1, 0.2314680516719818, [[1136, 0.231468, "In", false], [6699, 0.136472, "The", false], [33504, 0.044858, "There", false], [66, 0.036009, "A", false], [24242, 0.027205, "This", false], [23560, 0.018325, "Deep", false], [48358, 0.015165, "Another", false], [1141, 0.014472, "It", false], [6393, 0.01336, "One", false], [853, 0.011574, "As", false]]]}, "raw_delta": -0.09765625, "tuned_delta": -0.04356665258492441}, {"byte_start": 4454, "byte_end": 4463, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 763, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"model_a": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05%", "model_b": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"model_a": [[55809, " computer", "normal", 0.21826326847076416]], "model_b": [[55809, " computer", "normal", 0.16911627352237701]]}, "loss": {"model_a": 3.0525773977142774, "model_b": 3.553513175800724}, "topk": {"model_a": [55809, 1, 0.21826326847076416, [[55809, 0.218263, " computer", false], [52766, 0.136421, " robotic", false], [22590, 0.083853, " the", false], [52299, 0.037856, " natural", false], [21256, 0.027232, " all", false], [52167, 0.026895, " machine", false], [65003, 0.019705, " reinforcement", false], [52209, 0.019266, " medical", false], [38744, 0.01909, " image", false], [51832, 0.017083, " general", false]]], "model_b": [55809, 1, 0.16911627352237701, [[55809, 0.169116, " computer", false], [22590, 0.132576, " the", false], [52766, 0.049694, " robotic", false], [38744, 0.046679, " image", false], [52167, 0.031518, " machine", false], [21256, 0.023187, " all", false], [39193, 0.020884, " other", false], [52209, 0.019751, " medical", false], [31370, 0.019008, " many", false], [52299, 0.018998, " natural", false]]]}, "raw_delta": -0.027777777777777762, "tuned_delta": 0.026311819637297826}, {"byte_start": 4463, "byte_end": 4470, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 764, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"model_a": "0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19%", "model_b": "1.97% 1.97% 1.97% 1.97% 1.97% 1.97% 1.97%"}, "model_tokens": {"model_a": [[47732, " vision", "normal", 0.9274498820304871]], "model_b": [[47732, " vision", "normal", 0.46053579449653625]]}, "loss": {"model_a": 0.19497918817817844, "model_b": 1.9724346262153793}, "topk": {"model_a": [47732, 1, 0.9274498820304871, [[47732, 0.92745, " vision", false], [63944, 0.012066, " translation", false], [52814, 0.008668, " science", false], [46, 0.006332, "-", false], [52766, 0.004298, " robotic", false], [56329, 0.004237, " graphics", false], [56529, 0.003973, " language", false], [31044, 0.002612, " hand", false], [38744, 0.001578, " image", false], [45032, 0.001509, " Vision", false]]], "model_b": [47732, 1, 0.46053579449653625, [[47732, 0.460536, " vision", false], [56329, 0.185182, " graphics", false], [39082, 0.025234, " music", false], [38576, 0.022399, " games", false], [52209, 0.016389, " medical", false], [38013, 0.014516, " chess", false], [38744, 0.014439, " image", false], [52814, 0.012688, " science", false], [47202, 0.011017, " search", false], [40115, 0.010525, " video", false]]]}, "raw_delta": -0.09856305803571429, "tuned_delta": -0.0444734606206387}, {"byte_start": 4470, "byte_end": 4471, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.47%", "model_b": "1.52%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9220231175422668]], "model_b": [[45, ",", "normal", 0.919212281703949]]}, "loss": {"model_a": 1.4705204579373587, "model_b": 1.5233535282824135}, "topk": {"model_a": [45, 1, 0.9220231175422668, [[45, 0.922023, ",", false], [21265, 0.036312, " and", false], [275, 0.008781, " (", false], [39934, 0.005697, " there", false], [5346, 0.003784, "---", false], [57103, 0.003593, " research", false], [22590, 0.00272, " the", false], [22614, 0.001771, " too", false], [53087, 0.001476, " systems", false], [4423, 0.001091, " as", false]]], "model_b": [45, 1, 0.919212281703949, [[45, 0.919212, ",", false], [21265, 0.01933, " and", false], [275, 0.014279, " (", false], [57103, 0.007965, " research", false], [22590, 0.006555, " the", false], [39934, 0.006288, " there", false], [4596, 0.002279, " in", false], [53087, 0.001597, " systems", false], [4601, 0.001184, " it", false], [32234, 0.000949, " this", false]]]}, "raw_delta": -0.0029296875, "tuned_delta": 0.05115990991507559}, {"byte_start": 4471, "byte_end": 4477, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 765, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"model_a": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "model_b": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"model_a": [[39934, " there", "normal", 0.11340678483247757]], "model_b": [[39934, " there", "normal", 0.13495494425296783]]}, "loss": {"model_a": 6.621744816580202, "model_b": 6.011229337037347}, "topk": {"model_a": [39934, 2, 0.11340678483247757, [[22590, 0.336809, " the", false], [39934, 0.113407, " there", false], [332, 0.059531, " a", false], [63843, 0.043764, " researchers", false], [4601, 0.026649, " it", false], [50919, 0.020071, " another", false], [37635, 0.017193, " again", false], [52224, 0.016136, " methods", false], [4596, 0.014111, " in", false], [22226, 0.01232, " one", false]]], "model_b": [39934, 2, 0.13495494425296783, [[22590, 0.263022, " the", false], [39934, 0.134955, " there", false], [332, 0.050106, " a", false], [63843, 0.036858, " researchers", false], [38328, 0.025749, " early", false], [4601, 0.018619, " it", false], [4596, 0.014946, " in", false], [32234, 0.014797, " this", false], [31466, 0.014079, " much", false], [22226, 0.014041, " one", false]]]}, "raw_delta": 0.033854166666666685, "tuned_delta": 0.08794376408174227}, {"byte_start": 4477, "byte_end": 4481, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 766, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"model_a": "9.44% 9.44% 9.44% 9.44%", "model_b": "12.33% 12.33% 12.33% 12.33%"}, "model_tokens": {"model_a": [[21800, " has", "normal", 0.12311496585607529]], "model_b": [[21800, " has", "normal", 0.06372544169425964]]}, "loss": {"model_a": 9.439508568316459, "model_b": 12.327716413846122}, "topk": {"model_a": [21800, 3, 0.12311496585607529, [[22748, 0.419516, " was", false], [32462, 0.222666, " were", false], [21800, 0.123115, " has", false], [31059, 0.101793, " have", false], [4600, 0.069628, " is", false], [21286, 0.03921, " are", false], [21795, 0.003589, " had", false], [22614, 0.002321, " too", false], [30135, 0.002106, " also", false], [37635, 0.002008, " again", false]]], "model_b": [21800, 3, 0.06372544169425964, [[22748, 0.461266, " was", false], [32462, 0.273814, " were", false], [21800, 0.063725, " has", false], [4600, 0.056866, " is", false], [21286, 0.054809, " are", false], [31059, 0.050435, " have", false], [30135, 0.007582, " also", false], [21795, 0.006675, " had", false], [22614, 0.005653, " too", false], [37828, 0.001437, " began", false]]]}, "raw_delta": -0.16015625, "tuned_delta": -0.10606665258492441}, {"byte_start": 4481, "byte_end": 4486, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 767, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"model_a": "1.05% 1.05% 1.05% 1.05% 1.05%", "model_b": "1.26% 1.26% 1.26% 1.26% 1.26%"}, "model_tokens": {"model_a": [[30259, " been", "normal", 0.747715413570404]], "model_b": [[30259, " been", "normal", 0.7056357860565186]]}, "loss": {"model_a": 1.0496169975217555, "model_b": 1.2609492789019747}, "topk": {"model_a": [30259, 1, 0.747715413570404, [[30259, 0.747715, " been", false], [30135, 0.153006, " also", false], [45150, 0.021881, " always", false], [31323, 0.012638, " long", false], [22187, 0.01022, " not", false], [56548, 0.007506, " likewise", false], [57036, 0.00583, " recently", false], [37635, 0.005008, " again", false], [60505, 0.004354, " similarly", false], [45, 0.004121, ",", false]]], "model_b": [30259, 1, 0.7056357860565186, [[30259, 0.705636, " been", false], [30135, 0.140773, " also", false], [45150, 0.072312, " always", false], [31323, 0.025192, " long", false], [22187, 0.008653, " not", false], [39115, 0.006584, " never", false], [39171, 0.00401, " often", false], [65026, 0.003298, " traditionally", false], [57036, 0.002976, " recently", false], [64409, 0.002874, " historically", false]]]}, "raw_delta": -0.011718749999999993, "tuned_delta": 0.042370847415075595}, {"byte_start": 4486, "byte_end": 4488, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 768, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "3.86% 3.86%", "model_b": "4.58% 4.58%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.6513375639915466]], "model_b": [[332, " a", "normal", 0.5983240604400635]]}, "loss": {"model_a": 3.856814135189001, "model_b": 4.578866096571416}, "topk": {"model_a": [332, 1, 0.6513375639915466, [[332, 0.651338, " a", false], [4419, 0.134001, " an", false], [52906, 0.020983, " similar", false], [50919, 0.016473, " another", false], [22590, 0.015272, " the", false], [31466, 0.01459, " much", false], [30788, 0.012737, " even", false], [45, 0.011664, ",", false], [4692, 0.007404, " no", false], [31458, 0.005878, " more", false]]], "model_b": [332, 1, 0.5983240604400635, [[332, 0.598324, " a", false], [4419, 0.099246, " an", false], [31466, 0.04828, " much", false], [22590, 0.023889, " the", false], [4692, 0.018502, " no", false], [46454, 0.015228, " little", false], [32074, 0.012101, " some", false], [52906, 0.011725, " similar", false], [50919, 0.010812, " another", false], [31277, 0.008191, " less", false]]]}, "raw_delta": -0.0400390625, "tuned_delta": 0.014050534915075588}, {"byte_start": 4488, "byte_end": 4496, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 769, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"model_a": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76%", "model_b": "2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59%"}, "model_tokens": {"model_a": [[52906, " similar", "normal", 0.45986196398735046]], "model_b": [[52906, " similar", "normal", 0.3159043788909912]]}, "loss": {"model_a": 1.7611023448351601, "model_b": 2.5888204469076856}, "topk": {"model_a": [52906, 1, 0.45986196398735046, [[52906, 0.459862, " similar", false], [31323, 0.106699, " long", false], [32386, 0.024848, " very", false], [47405, 0.01726, " steady", false], [60505, 0.014995, " similarly", false], [52427, 0.014722, " pattern", false], [38961, 0.013573, " major", false], [61774, 0.011334, " continuing", false], [51859, 0.010981, " gradual", false], [61756, 0.009168, " consistent", false]]], "model_b": [52906, 1, 0.3159043788909912, [[52906, 0.315904, " similar", false], [31323, 0.146468, " long", false], [56812, 0.024486, " parallel", false], [60505, 0.023552, " similarly", false], [32386, 0.014446, " very", false], [47436, 0.012362, " strong", false], [47405, 0.012226, " steady", false], [61756, 0.011576, " consistent", false], [38629, 0.010114, " great", false], [61774, 0.009094, " continuing", false]]]}, "raw_delta": -0.0458984375, "tuned_delta": 0.008191159915075588}, {"byte_start": 4496, "byte_end": 4504, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 770, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"model_a": "1.95% 1.95% 1.95% 1.95% 1.95% 1.95% 1.95% 1.95%", "model_b": "2.11% 2.11% 2.11% 2.11% 2.11% 2.11% 2.11% 2.11%"}, "model_tokens": {"model_a": [[52427, " pattern", "normal", 0.4187702536582947]], "model_b": [[52427, " pattern", "normal", 0.3887821137905121]]}, "loss": {"model_a": 1.946018091042852, "model_b": 2.1133228138021924}, "topk": {"model_a": [52427, 1, 0.4187702536582947, [[52427, 0.41877, " pattern", false], [39831, 0.118149, " story", false], [51929, 0.059372, " history", false], [45, 0.035831, ",", false], [39664, 0.021719, " shift", false], [59657, 0.020292, " evolution", false], [63797, 0.019084, " progression", false], [62660, 0.017703, " transition", false], [45450, 0.014281, " change", false], [45315, 0.011194, " bitter", false]]], "model_b": [52427, 1, 0.3887821137905121, [[52427, 0.388782, " pattern", false], [40009, 0.089699, " trend", false], [39831, 0.021551, " story", false], [51929, 0.017627, " history", false], [59657, 0.016044, " evolution", false], [63469, 0.014879, " development", false], [57404, 0.014161, " tendency", false], [63797, 0.012633, " progression", false], [62315, 0.012413, " phenomenon", false], [45, 0.009414, ",", false]]]}, "raw_delta": -0.00927734375, "tuned_delta": 0.04481225366507559}, {"byte_start": 4504, "byte_end": 4505, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "15.08%", "model_b": "17.75%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.4318086802959442]], "model_b": [[47, ".", "normal", 0.3697695732116699]]}, "loss": {"model_a": 15.075036071788972, "model_b": 17.751911635938416}, "topk": {"model_a": [47, 1, 0.4318086802959442, [[47, 0.431809, ".", false], [4706, 0.29945, " of", false], [45, 0.145887, ",", false], [31601, 0.020864, " over", false], [4596, 0.017669, " in", false], [59, 0.016538, ":", false], [5346, 0.008867, "---", false], [39690, 0.006442, " since", false], [21700, 0.005976, " for", false], [32487, 0.00581, " with", false]]], "model_b": [47, 1, 0.3697695732116699, [[47, 0.36977, ".", false], [4706, 0.341122, " of", false], [45, 0.111483, ",", false], [4596, 0.036863, " in", false], [31601, 0.024559, " over", false], [59, 0.016173, ":", false], [4811, 0.012249, " to", false], [32487, 0.012074, " with", false], [39690, 0.008836, " since", false], [5346, 0.008477, "---", false]]]}, "raw_delta": -0.1484375, "tuned_delta": -0.09434790258492441}, {"byte_start": 4505, "byte_end": 4511, "display": {"text": " Early", "kind": "normal"}, "is_word": true, "word_id": 771, "word_key": " early", "bytes_hex": "20 45 61 72 6c 79", "compression": {"model_a": "5.96% 5.96% 5.96% 5.96% 5.96% 5.96%", "model_b": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57%"}, "model_tokens": {"model_a": [[36607, " Early", "normal", 0.13682277500629425]], "model_b": [[36607, " Early", "normal", 0.11271493136882782]]}, "loss": {"model_a": 5.964266607841743, "model_b": 6.574782087384598}, "topk": {"model_a": [36607, 2, 0.13682277500629425, [[20996, 0.154913, " The", false], [36607, 0.136823, " Early", false], [3913, 0.09772, " In", false], [37451, 0.040401, " There", false], [19907, 0.038629, " For", false], [63222, 0.035554, " Researchers", false], [50438, 0.024645, " Methods", false], [3642, 0.01935, " At", false], [58864, 0.018602, " Initially", false], [36809, 0.018484, " Human", false]]], "model_b": [36607, 2, 0.11271493136882782, [[20996, 0.119937, " The", false], [36607, 0.112715, " Early", false], [3913, 0.11041, " In", false], [54932, 0.044093, " Computer", false], [63222, 0.03246, " Researchers", false], [36809, 0.029291, " Human", false], [37451, 0.026261, " There", false], [19907, 0.025207, " For", false], [3642, 0.02448, " At", false], [300, 0.018341, " A", false]]]}, "raw_delta": -0.03385416666666663, "tuned_delta": 0.02023543074840896}, {"byte_start": 4511, "byte_end": 4519, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 772, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "3.03% 3.03% 3.03% 3.03% 3.03% 3.03% 3.03% 3.03%", "model_b": "4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.260214626789093]], "model_b": [[52224, " methods", "normal", 0.11831909418106079]]}, "loss": {"model_a": 3.029096033116476, "model_b": 4.825420424848339}, "topk": {"model_a": [52224, 1, 0.260214626789093, [[52224, 0.260215, " methods", false], [55809, 0.103162, " computer", false], [57103, 0.098552, " research", false], [51566, 0.098348, " efforts", false], [32499, 0.053475, " work", false], [61590, 0.05319, " approaches", false], [63843, 0.046697, " researchers", false], [4712, 0.034582, " on", false], [47732, 0.029301, " vision", false], [55572, 0.025312, " attempts", false]]], "model_b": [52224, 2, 0.11831909418106079, [[57103, 0.13164, " research", false], [52224, 0.118319, " methods", false], [51566, 0.117416, " efforts", false], [55809, 0.084006, " computer", false], [61590, 0.062992, " approaches", false], [32499, 0.062757, " work", false], [47732, 0.052588, " vision", false], [63843, 0.03903, " researchers", false], [55572, 0.033117, " attempts", false], [3609, 0.029925, " AI", false]]]}, "raw_delta": -0.099609375, "tuned_delta": -0.04551977758492441}, {"byte_start": 4519, "byte_end": 4529, "display": {"text": " conceived", "kind": "normal"}, "is_word": true, "word_id": 773, "word_key": " conceived", "bytes_hex": "20 63 6f 6e 63 65 69 76 65 64", "compression": {"model_a": "19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27%", "model_b": "18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82% 18.82%"}, "model_tokens": {"model_a": [[59348, " conceived", "normal", 2.25853655138053e-05]], "model_b": [[59348, " conceived", "normal", 3.0203440473997034e-05]]}, "loss": {"model_a": 19.27350406187599, "model_b": 18.82266186159819}, "topk": {"model_a": [59348, 527, 2.25853655138053e-05, [[32462, 0.174569, " were", false], [47054, 0.143228, " relied", false], [45, 0.091219, ",", false], [32354, 0.067284, " used", false], [4596, 0.066749, " in", false], [21700, 0.04945, " for", false], [32227, 0.035534, " that", false], [40013, 0.033949, " tried", false], [4706, 0.023363, " of", false], [56427, 0.022307, " included", false]]], "model_b": [59348, 537, 3.0203440473997034e-05, [[32462, 0.191338, " were", false], [47054, 0.125212, " relied", false], [32354, 0.073703, " used", false], [45, 0.067709, ",", false], [51770, 0.067284, " focused", false], [32227, 0.062323, " that", false], [4596, 0.054192, " in", false], [37810, 0.03174, " based", false], [32272, 0.019188, " took", false], [56540, 0.015847, " leverage", false]]]}, "raw_delta": 0.025000000000000133, "tuned_delta": 0.07908959741507572}, {"byte_start": 4529, "byte_end": 4532, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 774, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "5.38% 5.38% 5.38%", "model_b": "1.66% 1.66% 1.66%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.40571919083595276]], "model_b": [[4706, " of", "normal", 0.7593581080436707]]}, "loss": {"model_a": 5.377232492896689, "model_b": 1.6554362041450505}, "topk": {"model_a": [4706, 1, 0.40571919083595276, [[4706, 0.405719, " of", false], [4450, 0.163427, " by", false], [4596, 0.088176, " in", false], [4811, 0.047341, " to", false], [4423, 0.034336, " as", false], [21265, 0.031606, " and", false], [22590, 0.016049, " the", false], [332, 0.015414, " a", false], [4712, 0.012725, " on", false], [32487, 0.012659, " with", false]]], "model_b": [4706, 1, 0.7593581080436707, [[4706, 0.759358, " of", false], [4450, 0.029551, " by", false], [4423, 0.023268, " as", false], [4596, 0.01986, " in", false], [22590, 0.01908, " the", false], [332, 0.016451, " a", false], [21265, 0.01326, " and", false], [39931, 0.011692, " their", false], [32227, 0.010789, " that", false], [4811, 0.006439, " to", false]]]}, "raw_delta": 0.20638020833333334, "tuned_delta": 0.26046980574840894}, {"byte_start": 4532, "byte_end": 4539, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 775, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"model_a": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%", "model_b": "5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09%"}, "model_tokens": {"model_a": [[47732, " vision", "normal", 0.04103774577379227]], "model_b": [[47732, " vision", "normal", 0.14037011563777924]]}, "loss": {"model_a": 8.21176864791709, "model_b": 5.092101637066235}, "topk": {"model_a": [47732, 7, 0.04103774577379227, [[4423, 0.258047, " as", false], [22590, 0.097834, " the", false], [332, 0.06878, " a", false], [4450, 0.062958, " by", false], [55809, 0.047489, " computer", false], [4596, 0.044303, " in", false], [47732, 0.041038, " vision", false], [46249, 0.025295, " images", false], [52342, 0.020283, " objects", false], [38744, 0.018771, " image", false]]], "model_b": [47732, 2, 0.14037011563777924, [[22590, 0.227281, " the", false], [47732, 0.14037, " vision", false], [55809, 0.05542, " computer", false], [332, 0.055311, " a", false], [59345, 0.03701, " computers", false], [39931, 0.036427, " their", false], [38720, 0.034301, " human", false], [38744, 0.02353, " image", false], [46249, 0.020506, " images", false], [46227, 0.018265, " humans", false]]]}, "raw_delta": 0.1729910714285714, "tuned_delta": 0.22708066884364697}, {"byte_start": 4539, "byte_end": 4542, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 776, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "2.61% 2.61% 2.61%", "model_b": "1.93% 1.93% 1.93%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.6463713645935059]], "model_b": [[4423, " as", "normal", 0.7241610884666443]]}, "loss": {"model_a": 2.606431470356037, "model_b": 1.925471897019775}, "topk": {"model_a": [4423, 1, 0.6463713645935059, [[4423, 0.646371, " as", false], [4596, 0.137363, " in", false], [56939, 0.039319, " problems", false], [53087, 0.037758, " systems", false], [39898, 0.034812, " tasks", false], [30917, 0.008588, " from", false], [4450, 0.007895, " by", false], [21265, 0.006168, " and", false], [62378, 0.005735, " processing", false], [45, 0.005301, ",", false]]], "model_b": [4423, 1, 0.7241610884666443, [[4423, 0.724161, " as", false], [4596, 0.131135, " in", false], [53087, 0.034357, " systems", false], [53140, 0.008718, " through", false], [45, 0.007889, ",", false], [4450, 0.007637, " by", false], [30917, 0.006197, " from", false], [21265, 0.006017, " and", false], [22187, 0.005151, " not", false], [275, 0.003956, " (", false]]]}, "raw_delta": 0.03776041666666667, "tuned_delta": 0.09185001408174226}, {"byte_start": 4542, "byte_end": 4552, "display": {"text": " searching", "kind": "normal"}, "is_word": true, "word_id": 777, "word_key": " searching", "bytes_hex": "20 73 65 61 72 63 68 69 6e 67", "compression": {"model_a": "14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20%", "model_b": "9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52% 9.52%"}, "model_tokens": {"model_a": [[60463, " searching", "normal", 0.00038259965367615223]], "model_b": [[60463, " searching", "normal", 0.00512682693079114]]}, "loss": {"model_a": 14.201529308750729, "model_b": 9.524041480868547}, "topk": {"model_a": [60463, 118, 0.00038259965367615223, [[332, 0.498589, " a", false], [37832, 0.07855, " being", false], [4419, 0.070187, " an", false], [22590, 0.04413, " the", false], [60522, 0.024242, " something", false], [63541, 0.017786, " essentially", false], [52906, 0.013338, " similar", false], [59927, 0.012703, " involving", false], [59134, 0.009976, " analogous", false], [46170, 0.007928, " having", false]]], "model_b": [60463, 16, 0.00512682693079114, [[332, 0.423857, " a", false], [4419, 0.053128, " an", false], [22590, 0.042831, " the", false], [37832, 0.039841, " being", false], [60522, 0.0342, " something", false], [46170, 0.019335, " having", false], [32074, 0.017881, " some", false], [4404, 0.015681, " ``", false], [4588, 0.013758, " if", false], [31198, 0.011446, " just", false]]]}, "raw_delta": 0.25937499999999997, "tuned_delta": 0.31346459741507554}, {"byte_start": 4552, "byte_end": 4556, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 778, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "3.86% 3.86% 3.86% 3.86%", "model_b": "6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.4267788529396057]], "model_b": [[21700, " for", "normal", 0.25192925333976746]]}, "loss": {"model_a": 3.856814135189001, "model_b": 6.269524347613171}, "topk": {"model_a": [21700, 1, 0.4267788529396057, [[21700, 0.426779, " for", false], [53140, 0.155739, " through", false], [332, 0.086099, " a", false], [31601, 0.063356, " over", false], [22590, 0.04669, " the", false], [4596, 0.044139, " in", false], [45, 0.022467, ",", false], [4419, 0.014625, " an", false], [21265, 0.009688, " and", false], [5346, 0.009635, "---", false]]], "model_b": [21700, 1, 0.25192925333976746, [[21700, 0.251929, " for", false], [53140, 0.220529, " through", false], [332, 0.08126, " a", false], [4596, 0.077679, " in", false], [45, 0.054558, ",", false], [22590, 0.041738, " the", false], [31601, 0.025354, " over", false], [21265, 0.019676, " and", false], [4419, 0.019508, " an", false], [37694, 0.014671, " among", false]]]}, "raw_delta": -0.1337890625, "tuned_delta": -0.07969946508492441}, {"byte_start": 4556, "byte_end": 4562, "display": {"text": " edges", "kind": "normal"}, "is_word": true, "word_id": 779, "word_key": " edges", "bytes_hex": "20 65 64 67 65 73", "compression": {"model_a": "9.86% 9.86% 9.86% 9.86% 9.86% 9.86%", "model_b": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%"}, "model_tokens": {"model_a": [[38332, " edges", "normal", 0.037653230130672455]], "model_b": [[38332, " edges", "normal", 0.009637332521378994]]}, "loss": {"model_a": 9.862173131076897, "model_b": 13.994893300290073}, "topk": {"model_a": [38332, 5, 0.037653230130672455, [[52342, 0.21613, " objects", false], [56832, 0.066548, " patterns", false], [56215, 0.053318, " features", false], [332, 0.041254, " a", false], [38332, 0.037653, " edges", false], [47734, 0.033464, " visual", false], [57271, 0.026871, " specific", false], [22590, 0.026812, " the", false], [4404, 0.023431, " ``", false], [46691, 0.022311, " object", false]]], "model_b": [38332, 17, 0.009637332521378994, [[52342, 0.207304, " objects", false], [332, 0.089049, " a", false], [47539, 0.057793, " things", false], [56832, 0.049579, " patterns", false], [22590, 0.036255, " the", false], [21265, 0.035479, " and", false], [57271, 0.034007, " specific", false], [62293, 0.024371, " particular", false], [4404, 0.022404, " ``", false], [56215, 0.019393, " features", false]]]}, "raw_delta": -0.2291666666666666, "tuned_delta": -0.175077069251591}, {"byte_start": 4562, "byte_end": 4563, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "22.12%", "model_b": "26.06%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.2914634644985199]], "model_b": [[45, ",", "normal", 0.2341333031654358]]}, "loss": {"model_a": 22.11944545112961, "model_b": 26.06431470356037}, "topk": {"model_a": [45, 2, 0.2914634644985199, [[21265, 0.336078, " and", false], [45, 0.291463, ",", false], [4596, 0.133942, " in", false], [4715, 0.097066, " or", false], [47, 0.030694, ".", false], [5346, 0.024753, "---", false], [275, 0.021554, " (", false], [4706, 0.011554, " of", false], [32227, 0.006539, " that", false], [4811, 0.006144, " to", false]]], "model_b": [45, 2, 0.2341333031654358, [[21265, 0.302598, " and", false], [45, 0.234133, ",", false], [4596, 0.200827, " in", false], [4715, 0.070067, " or", false], [275, 0.037733, " (", false], [47, 0.028381, ".", false], [4706, 0.023901, " of", false], [4811, 0.011667, " to", false], [5346, 0.01108, "---", false], [4712, 0.010073, " on", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 4563, "byte_end": 4566, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 780, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "9.02% 9.02% 9.02%", "model_b": "13.24% 13.24% 13.24%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.22449207305908203]], "model_b": [[4715, " or", "normal", 0.11065591871738434]]}, "loss": {"model_a": 9.01684400555602, "model_b": 13.243489633160404}, "topk": {"model_a": [4715, 1, 0.22449207305908203, [[4715, 0.224492, " or", false], [21265, 0.20366, " and", false], [51327, 0.091674, " corners", false], [32230, 0.055477, " then", false], [38905, 0.035899, " lines", false], [40186, 0.027468, " which", false], [47253, 0.022247, " shapes", false], [21700, 0.020649, " for", false], [40085, 0.014609, " using", false], [21643, 0.014268, " etc", false]]], "model_b": [4715, 2, 0.11065591871738434, [[51327, 0.12772, " corners", false], [4715, 0.110656, " or", false], [21265, 0.109862, " and", false], [38905, 0.0628, " lines", false], [55852, 0.040632, " contours", false], [21700, 0.030498, " for", false], [4423, 0.025297, " as", false], [59498, 0.017971, " detecting", false], [47253, 0.01693, " shapes", false], [52157, 0.012659, " looking", false]]]}, "raw_delta": -0.234375, "tuned_delta": -0.18028540258492443}, {"byte_start": 4566, "byte_end": 4578, "display": {"text": " generalized", "kind": "normal"}, "is_word": true, "word_id": 781, "word_key": " generalized", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 65 64", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47%"}, "model_tokens": {"model_a": [[63594, " generalized", "normal", 8.530707418685779e-05]], "model_b": [[63594, " generalized", "normal", 9.106906873057596e-06]]}, "loss": {"model_a": 14.088818758681281, "model_b": 17.47013526076479}, "topk": {"model_a": [63594, 518, 8.530707418685779e-05, [[21700, 0.223051, " for", false], [39193, 0.072967, " other", false], [38905, 0.047639, " lines", false], [47253, 0.040854, " shapes", false], [51327, 0.038605, " corners", false], [31458, 0.026516, " more", false], [55852, 0.024301, " contours", false], [57413, 0.020505, " textures", false], [37865, 0.019896, " blobs", false], [4423, 0.019723, " as", false]]], "model_b": [63594, 2594, 9.106906873057596e-06, [[4423, 0.111164, " as", false], [21700, 0.085486, " for", false], [59498, 0.048753, " detecting", false], [38905, 0.037151, " lines", false], [51746, 0.032181, " finding", false], [4404, 0.031725, " ``", false], [39193, 0.029944, " other", false], [55852, 0.023635, " contours", false], [52342, 0.021127, " objects", false], [56215, 0.01962, " features", false]]]}, "raw_delta": -0.1875, "tuned_delta": -0.13341040258492443}, {"byte_start": 4578, "byte_end": 4588, "display": {"text": " cylinders", "kind": "normal"}, "is_word": true, "word_id": 782, "word_key": " cylinders", "bytes_hex": "20 63 79 6c 69 6e 64 65 72 73", "compression": {"model_a": "18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94%", "model_b": "19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84%"}, "model_tokens": {"model_a": [[59439, " cylinders", "normal", 2.7507401682669297e-05]], "model_b": [[59439, " cylinders", "normal", 1.709010757622309e-05]]}, "loss": {"model_a": 18.935372411667647, "model_b": 19.837056812223242}, "topk": {"model_a": [59439, 812, 2.7507401682669297e-05, [[38332, 0.323782, " edges", false], [47253, 0.084554, " shapes", false], [30729, 0.052577, " edge", false], [57527, 0.036641, " versions", false], [4811, 0.036129, " to", false], [56215, 0.028999, " features", false], [56832, 0.026346, " patterns", false], [38541, 0.020935, " forms", false], [38905, 0.017084, " lines", false], [32229, 0.014818, " them", false]]], "model_b": [59439, 1920, 1.709010757622309e-05, [[56215, 0.060834, " features", false], [47253, 0.048752, " shapes", false], [39654, 0.036522, " shape", false], [4423, 0.031518, " as", false], [38332, 0.0301, " edges", false], [22590, 0.026433, " the", false], [46691, 0.022281, " object", false], [38744, 0.02041, " image", false], [4811, 0.019628, " to", false], [55852, 0.018966, " contours", false]]]}, "raw_delta": -0.050000000000000044, "tuned_delta": 0.004089597415075544}, {"byte_start": 4588, "byte_end": 4589, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "11.98%", "model_b": "7.15%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5074355602264404]], "model_b": [[45, ",", "normal", 0.6744356751441956]]}, "loss": {"model_a": 11.97549594487909, "model_b": 7.15007552003075}, "topk": {"model_a": [45, 1, 0.5074355602264404, [[45, 0.507436, ",", false], [47, 0.07487, ".", false], [275, 0.068072, " (", false], [4715, 0.061727, " or", false], [21265, 0.057446, " and", false], [4596, 0.04451, " in", false], [4706, 0.040184, " of", false], [5346, 0.024133, "---", false], [32227, 0.022551, " that", false], [45395, 0.010373, " called", false]]], "model_b": [45, 1, 0.6744356751441956, [[45, 0.674436, ",", false], [47, 0.132617, ".", false], [21265, 0.031843, " and", false], [275, 0.030632, " (", false], [4715, 0.027644, " or", false], [4596, 0.021642, " in", false], [5346, 0.012803, "---", false], [4706, 0.011275, " of", false], [60, 0.00822, ";", false], [32227, 0.007306, " that", false]]]}, "raw_delta": 0.267578125, "tuned_delta": 0.3216677224150756}, {"byte_start": 4589, "byte_end": 4592, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 783, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "4.77% 4.77% 4.77%", "model_b": "4.13% 4.13% 4.13%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.45057412981987]], "model_b": [[4715, " or", "normal", 0.5044907331466675]]}, "loss": {"model_a": 4.766717013353834, "model_b": 4.132720169213176}, "topk": {"model_a": [4715, 1, 0.45057412981987, [[4715, 0.450574, " or", false], [21265, 0.14221, " and", false], [4596, 0.121982, " in", false], [21643, 0.053046, " etc", false], [40186, 0.021115, " which", false], [32227, 0.018409, " that", false], [4811, 0.014874, " to", false], [32487, 0.008585, " with", false], [4423, 0.007932, " as", false], [40085, 0.007516, " using", false]]], "model_b": [4715, 1, 0.5044907331466675, [[4715, 0.504491, " or", false], [21265, 0.135086, " and", false], [4596, 0.104945, " in", false], [21643, 0.030875, " etc", false], [40186, 0.01661, " which", false], [32227, 0.016464, " that", false], [4811, 0.013682, " to", false], [4423, 0.010999, " as", false], [21400, 0.009992, " but", false], [37694, 0.009725, " among", false]]]}, "raw_delta": 0.03515625000000003, "tuned_delta": 0.08924584741507562}, {"byte_start": 4592, "byte_end": 4595, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 784, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "32.87% 32.87% 32.87%", "model_b": "33.25% 33.25% 33.25%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.004255402367562056]], "model_b": [[4596, " in", "normal", 0.003914339933544397]]}, "loss": {"model_a": 32.87391043692299, "model_b": 33.24961227048782}, "topk": {"model_a": [4596, 36, 0.004255402367562056, [[39193, 0.137982, " other", false], [63594, 0.124483, " generalized", false], [32074, 0.062221, " some", false], [38905, 0.025453, " lines", false], [31458, 0.020996, " more", false], [22590, 0.019826, " the", false], [30788, 0.019388, " even", false], [37865, 0.018238, " blobs", false], [57564, 0.014912, " whatever", false], [332, 0.011824, " a", false]]], "model_b": [4596, 45, 0.003914339933544397, [[39193, 0.122527, " other", false], [57564, 0.059795, " whatever", false], [32074, 0.030876, " some", false], [60522, 0.026333, " something", false], [30788, 0.023947, " even", false], [4423, 0.020171, " as", false], [38905, 0.020031, " lines", false], [22590, 0.017251, " the", false], [52906, 0.014361, " similar", false], [4404, 0.014354, " ``", false]]]}, "raw_delta": -0.02083333333333326, "tuned_delta": 0.03325626408174233}, {"byte_start": 4595, "byte_end": 4601, "display": {"text": " terms", "kind": "normal"}, "is_word": true, "word_id": 785, "word_key": " terms", "bytes_hex": "20 74 65 72 6d 73", "compression": {"model_a": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19%", "model_b": "21.04% 21.04% 21.04% 21.04% 21.04% 21.04%"}, "model_tokens": {"model_a": [[39920, " terms", "normal", 0.03363630920648575]], "model_b": [[39920, " terms", "normal", 0.0008972890209406614]]}, "loss": {"model_a": 10.190912235446126, "model_b": 21.039302679630715}, "topk": {"model_a": [39920, 7, 0.03363630920648575, [[32074, 0.252682, " some", false], [39193, 0.181931, " other", false], [22590, 0.094999, " the", false], [51832, 0.072975, " general", false], [332, 0.055862, " a", false], [31458, 0.03984, " more", false], [39920, 0.033636, " terms", false], [22226, 0.023774, " one", false], [53265, 0.016313, " various", false], [31370, 0.015086, " many", false]]], "model_b": [39920, 64, 0.0008972890209406614, [[32074, 0.274833, " some", false], [39193, 0.148516, " other", false], [22590, 0.142246, " the", false], [51832, 0.091873, " general", false], [332, 0.052816, " a", false], [31370, 0.029835, " many", false], [21273, 0.028507, " any", false], [22226, 0.028062, " one", false], [32234, 0.009104, " this", false], [57564, 0.005891, " whatever", false]]]}, "raw_delta": -0.6015625000000001, "tuned_delta": -0.5474729025849245}, {"byte_start": 4601, "byte_end": 4604, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 786, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.15% 0.15% 0.15%", "model_b": "0.13% 0.13% 0.13%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9748835563659668]], "model_b": [[4706, " of", "normal", 0.9782590866088867]]}, "loss": {"model_a": 0.15262886988571386, "model_b": 0.1313488832189557}, "topk": {"model_a": [4706, 1, 0.9748835563659668, [[4706, 0.974884, " of", false], [32227, 0.006181, " that", false], [31458, 0.00471, " more", false], [52906, 0.001592, " similar", false], [39193, 0.001341, " other", false], [31296, 0.000741, " like", false], [52693, 0.000488, " related", false], [56205, 0.000383, " familiar", false], [56466, 0.000291, " inspired", false], [22590, 0.000259, " the", false]]], "model_b": [4706, 1, 0.9782590866088867, [[4706, 0.978259, " of", false], [32227, 0.005613, " that", false], [31296, 0.002067, " like", false], [31458, 0.001514, " more", false], [52906, 0.001252, " similar", false], [45, 0.000317, ",", false], [32139, 0.000304, " such", false], [4423, 0.000292, " as", false], [40185, 0.000276, " where", false], [56205, 0.000262, " familiar", false]]]}, "raw_delta": 0.001180013020833333, "tuned_delta": 0.055269610435908924}, {"byte_start": 4604, "byte_end": 4607, "display": {"text": " SI", "kind": "normal"}, "is_word": true, "word_id": 787, "word_key": " si", "bytes_hex": "20 53 49", "compression": {"model_a": "45.65% 45.65% 45.65%", "model_b": "61.99% 61.99% 61.99%"}, "model_tokens": {"model_a": [[4191, " SI", "normal", 0.0005048418533988297]], "model_b": [[4191, " SI", "normal", 3.330556501168758e-05]]}, "loss": {"model_a": 45.647772778127354, "model_b": 61.99080253819764}, "topk": {"model_a": [4191, 259, 0.0005048418533988297, [[332, 0.099233, " a", false], [22590, 0.072216, " the", false], [39193, 0.029142, " other", false], [31044, 0.027975, " hand", false], [38720, 0.027118, " human", false], [32074, 0.020387, " some", false], [63885, 0.013919, " statistical", false], [51725, 0.013622, " feature", false], [59767, 0.012094, " geometric", false], [56215, 0.01152, " features", false]]], "model_b": [4191, 2104, 3.330556501168758e-05, [[22590, 0.074748, " the", false], [332, 0.029537, " a", false], [4404, 0.022178, " ``", false], [39654, 0.018245, " shape", false], [38744, 0.016155, " image", false], [38083, 0.015765, " color", false], [38720, 0.014661, " human", false], [59767, 0.013741, " geometric", false], [21835, 0.011067, " how", false], [38924, 0.010606, " local", false]]]}, "raw_delta": -0.90625, "tuned_delta": -0.8521604025849244}, {"byte_start": 4607, "byte_end": 4609, "display": {"text": "FT", "kind": "normal"}, "is_word": true, "word_id": 788, "word_key": "ft", "bytes_hex": "46 54", "compression": {"model_a": "0.00% 0.00%", "model_b": "0.08% 0.08%"}, "model_tokens": {"model_a": [[1023, "FT", "normal", 0.9994822144508362]], "model_b": [[1023, "FT", "normal", 0.9910759925842285]]}, "loss": {"model_a": 0.004609135043123271, "model_b": 0.08145098344862615}, "topk": {"model_a": [1023, 1, 0.9994822144508362, [[1023, 0.999482, "FT", false], [1885, 9.8e-05, "ft", false], [83, 7.1e-05, "R", false], [904, 2.3e-05, "CK", false], [824, 1.8e-05, "AM", false], [6493, 1.8e-05, "REN", false], [1021, 1.8e-05, "FR", false], [56907, 1e-05, " prefixes", false], [46, 9e-06, "-", false], [71, 9e-06, "F", false]]], "model_b": [1023, 1, 0.9910759925842285, [[1023, 0.991076, "FT", false], [71, 0.000768, "F", false], [83, 0.000523, "R", false], [68, 0.000436, "C", false], [69, 0.000399, "D", false], [85, 0.000326, "T", false], [1272, 0.000271, "NG", false], [1401, 0.000268, "RI", false], [84, 0.000266, "S", false], [87, 0.000259, "V", false]]]}, "raw_delta": -0.004261016845703125, "tuned_delta": 0.04982858056937246}, {"byte_start": 4609, "byte_end": 4618, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 789, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"model_a": "3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54%", "model_b": "4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48%"}, "model_tokens": {"model_a": [[56215, " features", "normal", 0.17301976680755615]], "model_b": [[56215, " features", "normal", 0.10682279616594315]]}, "loss": {"model_a": 3.5378589327355217, "model_b": 4.4771135166476075}, "topk": {"model_a": [56215, 2, 0.17301976680755615, [[45, 0.186963, ",", false], [56215, 0.17302, " features", false], [275, 0.143896, " (", false], [4715, 0.07172, " or", false], [63458, 0.064991, " descriptors", false], [21265, 0.063587, " and", false], [47, 0.047308, ".", false], [5346, 0.034819, "---", false], [46, 0.026713, "-", false], [59940, 0.0221, " keypoints", false]]], "model_b": [56215, 3, 0.10682279616594315, [[45, 0.26291, ",", false], [275, 0.117911, " (", false], [56215, 0.106823, " features", false], [4715, 0.082903, " or", false], [21265, 0.065976, " and", false], [47, 0.04931, ".", false], [63458, 0.030074, " descriptors", false], [46, 0.013847, "-", false], [460, 0.009896, "'s", false], [21700, 0.008868, " for", false]]]}, "raw_delta": -0.052083333333333356, "tuned_delta": 0.0020062640817422317}, {"byte_start": 4618, "byte_end": 4619, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "20.57%", "model_b": "21.98%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.32082709670066833]], "model_b": [[47, ".", "normal", 0.29580068588256836]]}, "loss": {"model_a": 20.56967538767467, "model_b": 21.9785572635428}, "topk": {"model_a": [47, 2, 0.32082709670066833, [[45, 0.36196, ",", false], [47, 0.320827, ".", false], [275, 0.078872, " (", false], [5346, 0.051381, "---", false], [21265, 0.047438, " and", false], [4715, 0.037554, " or", false], [32227, 0.027323, " that", false], [4596, 0.008005, " in", false], [60, 0.007978, ";", false], [4706, 0.005888, " of", false]]], "model_b": [47, 2, 0.29580068588256836, [[45, 0.455843, ",", false], [47, 0.295801, ".", false], [275, 0.037636, " (", false], [21265, 0.031232, " and", false], [4715, 0.030041, " or", false], [4423, 0.021212, " as", false], [5346, 0.02049, "---", false], [4706, 0.008761, " of", false], [21700, 0.007565, " for", false], [60, 0.007349, ";", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.024035402584924412}, {"byte_start": 4619, "byte_end": 4623, "display": {"text": " But", "kind": "normal"}, "is_word": true, "word_id": 790, "word_key": " but", "bytes_hex": "20 42 75 74", "compression": {"model_a": "15.29% 15.29% 15.29% 15.29%", "model_b": "14.09% 14.09% 14.09% 14.09%"}, "model_tokens": {"model_a": [[19555, " But", "normal", 0.03335017338395119]], "model_b": [[19555, " But", "normal", 0.04401867091655731]]}, "loss": {"model_a": 15.286368353169191, "model_b": 14.088818758681281}, "topk": {"model_a": [19555, 5, 0.03335017338395119, [[37453, 0.272282, " These", false], [20996, 0.05809, " The", false], [36918, 0.0496, " Later", false], [29894, 0.039383, " This", false], [19555, 0.03335, " But", false], [3913, 0.032863, " In", false], [29890, 0.032073, " Then", false], [19407, 0.026237, " All", false], [29421, 0.022944, " More", false], [37451, 0.022828, " There", false]]], "model_b": [19555, 5, 0.04401867091655731, [[37453, 0.163121, " These", false], [36918, 0.112786, " Later", false], [20996, 0.06418, " The", false], [3913, 0.052714, " In", false], [19555, 0.044019, " But", false], [3641, 0.041841, " As", false], [29894, 0.037163, " This", false], [29521, 0.035283, " Over", false], [30032, 0.016004, " When", false], [36607, 0.015528, " Early", false]]]}, "raw_delta": 0.06640625, "tuned_delta": 0.12049584741507559}, {"byte_start": 4623, "byte_end": 4629, "display": {"text": " today", "kind": "normal"}, "is_word": true, "word_id": 791, "word_key": " today", "bytes_hex": "20 74 6f 64 61 79", "compression": {"model_a": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "model_b": "21.04% 21.04% 21.04% 21.04% 21.04% 21.04%"}, "model_tokens": {"model_a": [[39971, " today", "normal", 0.0005062879645265639]], "model_b": [[39971, " today", "normal", 0.0009074409608729184]]}, "loss": {"model_a": 22.823886389063677, "model_b": 21.039302679630715}, "topk": {"model_a": [39971, 107, 0.0005062879645265639, [[22590, 0.115556, " the", false], [39936, 0.114644, " these", false], [45, 0.089872, ",", false], [4423, 0.055648, " as", false], [4596, 0.053503, " in", false], [32487, 0.031316, " with", false], [4601, 0.027264, " it", false], [39944, 0.024523, " those", false], [32465, 0.023059, " when", false], [32230, 0.020954, " then", false]]], "model_b": [39971, 87, 0.0009074409608729184, [[39936, 0.116477, " these", false], [4423, 0.09563, " as", false], [22590, 0.084273, " the", false], [45, 0.056879, ",", false], [4596, 0.054307, " in", false], [32465, 0.046372, " when", false], [31601, 0.034711, " over", false], [32234, 0.031153, " this", false], [4601, 0.02915, " it", false], [32487, 0.025508, " with", false]]]}, "raw_delta": 0.09895833333333326, "tuned_delta": 0.15304793074840883}, {"byte_start": 4629, "byte_end": 4633, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 792, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"model_a": "23.67% 23.67% 23.67% 23.67%", "model_b": "21.98% 21.98% 21.98% 21.98%"}, "model_tokens": {"model_a": [[21256, " all", "normal", 0.005297759082168341]], "model_b": [[21256, " all", "normal", 0.007622078526765108]]}, "loss": {"model_a": 23.669215514584554, "model_b": 21.9785572635428}, "topk": {"model_a": [21256, 13, 0.005297759082168341, [[45, 0.489995, ",", false], [460, 0.2643, "'s", false], [22590, 0.055336, " the", false], [39934, 0.021747, " there", false], [4601, 0.021558, " it", false], [4858, 0.019624, " we", false], [30597, 0.01306, " deep", false], [39936, 0.0102, " these", false], [31461, 0.009053, " most", false], [47732, 0.007525, " vision", false]]], "model_b": [21256, 13, 0.007622078526765108, [[45, 0.549021, ",", false], [22590, 0.056682, " the", false], [460, 0.045968, "'s", false], [4601, 0.035218, " it", false], [4858, 0.03469, " we", false], [39934, 0.029093, " there", false], [39936, 0.028505, " these", false], [31461, 0.024206, " most", false], [47732, 0.018204, " vision", false], [332, 0.011516, " a", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 4633, "byte_end": 4638, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 793, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "15.44% 15.44% 15.44% 15.44% 15.44%", "model_b": "20.74% 20.74% 20.74% 20.74% 20.74%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.013896853663027287]], "model_b": [[32234, " this", "normal", 0.003247368149459362]]}, "loss": {"model_a": 15.441345359514685, "model_b": 20.738741212778844}, "topk": {"model_a": [32234, 14, 0.013896853663027287, [[22590, 0.211601, " the", false], [4706, 0.135503, " of", false], [52224, 0.088675, " methods", false], [39936, 0.073791, " these", false], [55809, 0.047185, " computer", false], [62603, 0.039381, " successful", false], [32227, 0.034496, " that", false], [47732, 0.03381, " vision", false], [38961, 0.030639, " major", false], [39944, 0.024235, " those", false]]], "model_b": [32234, 35, 0.003247368149459362, [[47732, 0.22687, " vision", false], [4706, 0.108843, " of", false], [52224, 0.073682, " methods", false], [22590, 0.07097, " the", false], [38961, 0.046009, " major", false], [46588, 0.033165, " modern", false], [32227, 0.027381, " that", false], [38841, 0.025858, " kinds", false], [55809, 0.02393, " computer", false], [40050, 0.016744, " types", false]]]}, "raw_delta": -0.29374999999999996, "tuned_delta": -0.23966040258492438}, {"byte_start": 4638, "byte_end": 4641, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 794, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "4.93% 4.93% 4.93%", "model_b": "6.72% 6.72% 6.72%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.4382253587245941]], "model_b": [[4600, " is", "normal", 0.3232213854789734]]}, "loss": {"model_a": 4.931086565538449, "model_b": 6.71567027497141}, "topk": {"model_a": [4600, 1, 0.4382253587245941, [[4600, 0.438225, " is", false], [21800, 0.212744, " has", false], [32499, 0.052106, " work", false], [39620, 0.047211, " seems", false], [57103, 0.026847, " research", false], [38720, 0.020936, " human", false], [31615, 0.01203, " pale", false], [45829, 0.010238, " effort", false], [38932, 0.008502, " looks", false], [22748, 0.007898, " was", false]]], "model_b": [4600, 1, 0.3232213854789734, [[4600, 0.323221, " is", false], [32499, 0.12639, " work", false], [21800, 0.113202, " has", false], [47732, 0.06301, " vision", false], [63370, 0.039675, " computation", false], [21413, 0.03415, " can", false], [57103, 0.029598, " research", false], [63637, 0.017594, " information", false], [45829, 0.014153, " effort", false], [59346, 0.009431, " computing", false]]]}, "raw_delta": -0.09895833333333331, "tuned_delta": -0.04486873591825773}, {"byte_start": 4641, "byte_end": 4651, "display": {"text": " discarded", "kind": "normal"}, "is_word": true, "word_id": 795, "word_key": " discarded", "bytes_hex": "20 64 69 73 63 61 72 64 65 64", "compression": {"model_a": "11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38%", "model_b": "11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50%"}, "model_tokens": {"model_a": [[59536, " discarded", "normal", 0.001785344211384654]], "model_b": [[59536, " discarded", "normal", 0.0016992810415104032]]}, "loss": {"model_a": 11.383765557014474, "model_b": 11.496476107083927}, "topk": {"model_a": [59536, 92, 0.001785344211384654, [[332, 0.061481, " a", false], [30666, 0.042728, " done", false], [45290, 0.038686, " behind", false], [38319, 0.03661, " dwarf", false], [62161, 0.033108, " irrelevant", false], [31968, 0.025987, " seen", false], [52094, 0.023844, " largely", false], [56738, 0.023731, " obsolete", false], [31323, 0.02197, " long", false], [4596, 0.021353, " in", false]]], "model_b": [59536, 96, 0.0016992810415104032, [[30666, 0.134737, " done", false], [57094, 0.055155, " replaced", false], [37832, 0.051843, " being", false], [30991, 0.031512, " gone", false], [52094, 0.028803, " largely", false], [56738, 0.028299, " obsolete", false], [31198, 0.02773, " just", false], [332, 0.021828, " a", false], [31968, 0.017104, " seen", false], [47285, 0.014857, " simply", false]]]}, "raw_delta": -0.006249999999999978, "tuned_delta": 0.04783959741507561}, {"byte_start": 4651, "byte_end": 4652, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "39.45%", "model_b": "49.59%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.11266692727804184]], "model_b": [[47, ".", "normal", 0.06343134492635727]]}, "loss": {"model_a": 39.44869252430759, "model_b": 49.59264203055811}, "topk": {"model_a": [47, 3, 0.11266692727804184, [[4596, 0.366475, " in", false], [45, 0.223278, ",", false], [47, 0.112667, ".", false], [21265, 0.099154, " and", false], [4423, 0.083951, " as", false], [21700, 0.02073, " for", false], [60, 0.018032, ";", false], [5346, 0.015629, "---", false], [51018, 0.011631, " because", false], [4450, 0.007607, " by", false]]], "model_b": [47, 5, 0.06343134492635727, [[4596, 0.380206, " in", false], [45, 0.195533, ",", false], [21265, 0.160988, " and", false], [4423, 0.082849, " as", false], [47, 0.063431, ".", false], [21700, 0.041147, " for", false], [4811, 0.013347, " to", false], [51018, 0.010088, " because", false], [5346, 0.008726, "---", false], [60, 0.006046, ";", false]]]}, "raw_delta": -0.5625, "tuned_delta": -0.5084104025849244}, {"byte_start": 4652, "byte_end": 4659, "display": {"text": " Modern", "kind": "normal"}, "is_word": true, "word_id": 796, "word_key": " modern", "bytes_hex": "20 4d 6f 64 65 72 6e", "compression": {"model_a": "10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71%", "model_b": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"model_a": [[44593, " Modern", "normal", 0.01586654782295227]], "model_b": [[44593, " Modern", "normal", 0.010616261512041092]]}, "loss": {"model_a": 10.707502256597774, "model_b": 11.673592685764493}, "topk": {"model_a": [44593, 13, 0.01586654782295227, [[50342, 0.261398, " Instead", false], [20996, 0.157116, " The", false], [45032, 0.039057, " Vision", false], [28753, 0.030913, " Deep", false], [3913, 0.030549, " In", false], [3918, 0.027309, " It", false], [36607, 0.026227, " Early", false], [37451, 0.020768, " There", false], [54932, 0.017308, " Computer", false], [50438, 0.017166, " Methods", false]]], "model_b": [44593, 15, 0.010616261512041092, [[50342, 0.238998, " Instead", false], [20996, 0.092075, " The", false], [45032, 0.039518, " Vision", false], [3913, 0.037723, " In", false], [54932, 0.035664, " Computer", false], [44757, 0.02723, " Rather", false], [37451, 0.026981, " There", false], [3918, 0.020395, " It", false], [300, 0.01798, " A", false], [50438, 0.015181, " Methods", false]]]}, "raw_delta": -0.0535714285714286, "tuned_delta": 0.000518168843646985}, {"byte_start": 4659, "byte_end": 4664, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 797, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"model_a": "14.77% 14.77% 14.77% 14.77% 14.77%", "model_b": "15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"model_a": [[30597, " deep", "normal", 0.01665862463414669]], "model_b": [[30597, " deep", "normal", 0.012739308178424835]]}, "loss": {"model_a": 14.765082059097983, "model_b": 15.779477009723035}, "topk": {"model_a": [30597, 7, 0.01665862463414669, [[52224, 0.420391, " methods", false], [55809, 0.195413, " computer", false], [47732, 0.122881, " vision", false], [53087, 0.054055, " systems", false], [61590, 0.051621, " approaches", false], [57103, 0.025345, " research", false], [30597, 0.016659, " deep", false], [38744, 0.009217, " image", false], [45, 0.008537, ",", false], [62633, 0.00787, " techniques", false]]], "model_b": [30597, 7, 0.012739308178424835, [[52224, 0.469946, " methods", false], [47732, 0.282951, " vision", false], [55809, 0.0747, " computer", false], [61590, 0.043885, " approaches", false], [53087, 0.013385, " systems", false], [62633, 0.012771, " techniques", false], [30597, 0.012739, " deep", false], [38744, 0.00978, " image", false], [61559, 0.006982, " algorithms", false], [47734, 0.005485, " visual", false]]]}, "raw_delta": -0.05625000000000002, "tuned_delta": -0.002160402584924434}, {"byte_start": 4664, "byte_end": 4665, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "45.93%", "model_b": "46.77%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.0782984271645546]], "model_b": [[46, "-", "normal", 0.07506144046783447]]}, "loss": {"model_a": 45.92954915330098, "model_b": 46.77487827882186}, "topk": {"model_a": [46, 2, 0.0782984271645546, [[56537, 0.619999, " learning", false], [46, 0.078298, "-", false], [63421, 0.061007, " convolution", false], [46658, 0.059126, " neural", false], [47732, 0.048795, " vision", false], [56705, 0.03477, " networks", false], [52224, 0.018726, " methods", false], [19593, 0.016758, " CNN", false], [47734, 0.009307, " visual", false], [52307, 0.008272, " network", false]]], "model_b": [46, 2, 0.07506144046783447, [[56537, 0.813567, " learning", false], [46, 0.075061, "-", false], [46658, 0.054387, " neural", false], [47732, 0.01373, " vision", false], [63421, 0.009785, " convolution", false], [56705, 0.003914, " networks", false], [38744, 0.002901, " image", false], [51725, 0.001244, " feature", false], [52167, 0.001241, " machine", false], [55809, 0.001178, " computer", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 4665, "byte_end": 4673, "display": {"text": "learning", "kind": "normal"}, "is_word": true, "word_id": 798, "word_key": "learning", "bytes_hex": "6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "model_b": "0.04% 0.04% 0.04% 0.04% 0.04% 0.04% 0.04% 0.04%"}, "model_tokens": {"model_a": [[54126, "learning", "normal", 0.9556092023849487]], "model_b": [[54126, "learning", "normal", 0.9822267293930054]]}, "loss": {"model_a": 0.10236407379354369, "model_b": 0.04017514724155209}, "topk": {"model_a": [54126, 1, 0.9556092023849487, [[54126, 0.955609, "learning", false], [26312, 0.015156, "neur", false], [49434, 0.007119, "network", false], [42506, 0.003838, "vision", false], [34973, 0.002883, "learn", false], [34733, 0.002452, "image", false], [8235, 0.00164, "net", false], [63048, 0.001544, "convolution", false], [5695, 0.001108, "CNN", false], [49143, 0.000885, "feature", false]]], "model_b": [54126, 1, 0.9822267293930054, [[54126, 0.982227, "learning", false], [26312, 0.006169, "neur", false], [49434, 0.002567, "network", false], [34973, 0.001317, "learn", false], [26665, 0.000971, "perc", false], [42506, 0.000701, "vision", false], [34733, 0.000499, "image", false], [41101, 0.000344, "belief", false], [56537, 0.000287, " learning", false], [63048, 0.000256, "convolution", false]]]}, "raw_delta": 0.003448486328125, "tuned_delta": 0.05753808374320059}, {"byte_start": 4673, "byte_end": 4680, "display": {"text": " neural", "kind": "normal"}, "is_word": true, "word_id": 799, "word_key": " neural", "bytes_hex": "20 6e 65 75 72 61 6c", "compression": {"model_a": "16.58% 16.58% 16.58% 16.58% 16.58% 16.58% 16.58%", "model_b": "18.36% 18.36% 18.36% 18.36% 18.36% 18.36% 18.36%"}, "model_tokens": {"model_a": [[46658, " neural", "normal", 0.0016307620098814368]], "model_b": [[46658, " neural", "normal", 0.0008197693969123065]]}, "loss": {"model_a": 16.58455236736196, "model_b": 18.355718154167608}, "topk": {"model_a": [46658, 21, 0.0016307620098814368, [[52224, 0.451256, " methods", false], [46, 0.134434, "-", false], [61590, 0.09121, " approaches", false], [47732, 0.086641, " vision", false], [53087, 0.081947, " systems", false], [55809, 0.04924, " computer", false], [62633, 0.015111, " techniques", false], [46587, 0.010419, " models", false], [57103, 0.008534, " research", false], [37810, 0.008078, " based", false]]], "model_b": [46658, 22, 0.0008197693969123065, [[52224, 0.433007, " methods", false], [47732, 0.142516, " vision", false], [46, 0.114347, "-", false], [61590, 0.10191, " approaches", false], [53087, 0.066032, " systems", false], [37810, 0.032343, " based", false], [62633, 0.024164, " techniques", false], [61559, 0.015665, " algorithms", false], [46587, 0.012331, " models", false], [55809, 0.005118, " computer", false]]]}, "raw_delta": -0.0982142857142857, "tuned_delta": -0.04412468829921011}, {"byte_start": 4680, "byte_end": 4689, "display": {"text": " networks", "kind": "normal"}, "is_word": true, "word_id": 800, "word_key": " networks", "bytes_hex": "20 6e 65 74 77 6f 72 6b 73", "compression": {"model_a": "0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%", "model_b": "0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88%"}, "model_tokens": {"model_a": [[56705, " networks", "normal", 0.6159466505050659]], "model_b": [[56705, " networks", "normal", 0.646662175655365]]}, "loss": {"model_a": 0.9666495092761881, "model_b": 0.8766376116512797}, "topk": {"model_a": [56705, 1, 0.6159466505050659, [[56705, 0.615947, " networks", false], [46, 0.126019, "-", false], [52307, 0.115085, " network", false], [31510, 0.090473, " nets", false], [22166, 0.016425, " net", false], [53087, 0.00905, " systems", false], [47732, 0.007823, " vision", false], [61590, 0.004813, " approaches", false], [52224, 0.004112, " methods", false], [64833, 0.002053, " architectures", false]]], "model_b": [56705, 1, 0.646662175655365, [[56705, 0.646662, " networks", false], [46, 0.171414, "-", false], [31510, 0.072039, " nets", false], [52307, 0.060877, " network", false], [47732, 0.007043, " vision", false], [22166, 0.007005, " net", false], [53087, 0.004873, " systems", false], [64833, 0.004231, " architectures", false], [38744, 0.002929, " image", false], [46587, 0.002871, " models", false]]]}, "raw_delta": 0.004991319444444441, "tuned_delta": 0.05908091685952003}, {"byte_start": 4689, "byte_end": 4693, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 801, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"model_a": "16.70% 16.70% 16.70% 16.70%", "model_b": "15.71% 15.71% 15.71% 15.71%"}, "model_tokens": {"model_a": [[22681, " use", "normal", 0.024639911949634552]], "model_b": [[22681, " use", "normal", 0.030336573719978333]]}, "loss": {"model_a": 16.69525022903732, "model_b": 15.70903291592963}, "topk": {"model_a": [22681, 9, 0.024639911949634552, [[45, 0.127213, ",", false], [21286, 0.116796, " are", false], [31059, 0.107893, " have", false], [38877, 0.066003, " learn", false], [21413, 0.041754, " can", false], [4491, 0.038278, " do", false], [32227, 0.031818, " that", false], [32499, 0.024642, " work", false], [22681, 0.02464, " use", false], [32187, 0.019137, " take", false]]], "model_b": [22681, 5, 0.030336573719978333, [[21286, 0.234739, " are", false], [45, 0.120157, ",", false], [31059, 0.08096, " have", false], [21413, 0.044474, " can", false], [22681, 0.030337, " use", false], [32187, 0.028404, " take", false], [4491, 0.024627, " do", false], [38877, 0.021763, " learn", false], [32227, 0.020756, " that", false], [275, 0.016306, " (", false]]]}, "raw_delta": 0.0546875, "tuned_delta": 0.10877709741507559}, {"byte_start": 4693, "byte_end": 4698, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 802, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "15.33% 15.33% 15.33% 15.33% 15.33%", "model_b": "17.58% 17.58% 17.58% 17.58% 17.58%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.014325984753668308]], "model_b": [[31581, " only", "normal", 0.007598234340548515]]}, "loss": {"model_a": 15.328634809445234, "model_b": 17.58284581083424}, "topk": {"model_a": [31581, 8, 0.014325984753668308, [[52195, 0.390215, " massive", false], [332, 0.05208, " a", false], [63421, 0.047013, " convolution", false], [59988, 0.031819, " massively", false], [56640, 0.026825, " millions", false], [22590, 0.02301, " the", false], [31118, 0.019377, " huge", false], [31581, 0.014326, " only", false], [56125, 0.013456, " enormous", false], [32386, 0.013305, " very", false]]], "model_b": [31581, 20, 0.007598234340548515, [[52195, 0.174146, " massive", false], [332, 0.092728, " a", false], [31466, 0.040131, " much", false], [22590, 0.03944, " the", false], [31118, 0.027695, " huge", false], [30597, 0.027085, " deep", false], [38864, 0.023787, " large", false], [63421, 0.020575, " convolution", false], [56125, 0.017168, " enormous", false], [32386, 0.015799, " very", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07091040258492441}, {"byte_start": 4698, "byte_end": 4702, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 803, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "10.64% 10.64% 10.64% 10.64%", "model_b": "10.85% 10.85% 10.85% 10.85%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.09487435966730118]], "model_b": [[22590, " the", "normal", 0.0907275378704071]]}, "loss": {"model_a": 10.637058162804367, "model_b": 10.848390444184586}, "topk": {"model_a": [22590, 2, 0.09487435966730118, [[332, 0.18061, " a", false], [22590, 0.094874, " the", false], [52195, 0.076957, " massive", false], [63421, 0.053056, " convolution", false], [32386, 0.039989, " very", false], [63885, 0.02103, " statistical", false], [47284, 0.018884, " simple", false], [62577, 0.018354, " statistics", false], [22363, 0.017736, " raw", false], [22226, 0.016553, " one", false]]], "model_b": [22590, 2, 0.0907275378704071, [[332, 0.208104, " a", false], [22590, 0.090728, " the", false], [32386, 0.06208, " very", false], [52195, 0.047352, " massive", false], [63421, 0.027582, " convolution", false], [52112, 0.022417, " learned", false], [47284, 0.021077, " simple", false], [39720, 0.015526, " small", false], [22226, 0.012513, " one", false], [31466, 0.011313, " much", false]]]}, "raw_delta": -0.01171875, "tuned_delta": 0.04237084741507559}, {"byte_start": 4702, "byte_end": 4710, "display": {"text": " notions", "kind": "normal"}, "is_word": true, "word_id": 804, "word_key": " notions", "bytes_hex": "20 6e 6f 74 69 6f 6e 73", "compression": {"model_a": "18.74% 18.74% 18.74% 18.74% 18.74% 18.74% 18.74% 18.74%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[52326, " notions", "normal", 0.00024144651251845062]], "model_b": [[52326, " notions", "normal", 0.00015514640836045146]]}, "loss": {"model_a": 18.738128949046104, "model_b": 19.724346262153794}, "topk": {"model_a": [52326, 396, 0.00024144651251845062, [[22363, 0.082594, " raw", false], [63370, 0.056164, " computation", false], [52195, 0.048287, " massive", false], [63885, 0.035906, " statistical", false], [31461, 0.034227, " most", false], [37812, 0.027825, " basic", false], [30579, 0.026856, " data", false], [62577, 0.022559, " statistics", false], [32386, 0.021313, " very", false], [31937, 0.013605, " same", false]]], "model_b": [52326, 541, 0.00015514640836045146, [[31461, 0.161888, " most", false], [57234, 0.027553, " simplest", false], [38332, 0.025661, " edges", false], [63637, 0.025568, " information", false], [56215, 0.023699, " features", false], [62577, 0.023046, " statistics", false], [30579, 0.017859, " data", false], [22363, 0.016249, " raw", false], [38879, 0.014402, " least", false], [38720, 0.01407, " human", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 4710, "byte_end": 4713, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 805, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.01% 1.01% 1.01%", "model_b": "0.64% 0.64% 0.64%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8455100655555725]], "model_b": [[4706, " of", "normal", 0.8996827006340027]]}, "loss": {"model_a": 1.009698677705492, "model_b": 0.6369320147153829}, "topk": {"model_a": [4706, 1, 0.8455100655555725, [[4706, 0.84551, " of", false], [32227, 0.097821, " that", false], [4404, 0.004486, " ``", false], [21265, 0.003961, " and", false], [30917, 0.003564, " from", false], [56412, 0.002612, " implicit", false], [38547, 0.002136, " found", false], [52112, 0.002092, " learned", false], [45, 0.002004, ",", false], [46650, 0.001869, " needed", false]]], "model_b": [4706, 1, 0.8996827006340027, [[4706, 0.899683, " of", false], [32227, 0.041392, " that", false], [21265, 0.017543, " and", false], [45, 0.002926, ",", false], [4858, 0.002181, " we", false], [31461, 0.001522, " most", false], [45534, 0.001139, " common", false], [32232, 0.001055, " they", false], [56412, 0.001026, " implicit", false], [60050, 0.000966, " necessary", false]]]}, "raw_delta": 0.02067057291666667, "tuned_delta": 0.07476017033174226}, {"byte_start": 4713, "byte_end": 4725, "display": {"text": " convolution", "kind": "normal"}, "is_word": true, "word_id": 806, "word_key": " convolution", "bytes_hex": "20 63 6f 6e 76 6f 6c 75 74 69 6f 6e", "compression": {"model_a": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "model_b": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%"}, "model_tokens": {"model_a": [[63421, " convolution", "normal", 0.14818428456783295]], "model_b": [[63421, " convolution", "normal", 0.01971733197569847]]}, "loss": {"model_a": 2.864726480931861, "model_b": 5.9173038786461385}, "topk": {"model_a": [63421, 1, 0.14818428456783295, [[63421, 0.148184, " convolution", false], [4404, 0.105011, " ``", false], [46826, 0.047699, " pixels", false], [38332, 0.043432, " edges", false], [332, 0.040121, " a", false], [56324, 0.03039, " gradient", false], [59770, 0.018632, " gradients", false], [62554, 0.017616, " similarity", false], [39289, 0.015778, " pixel", false], [22590, 0.015391, " the", false]]], "model_b": [63421, 4, 0.01971733197569847, [[38332, 0.222722, " edges", false], [4404, 0.02133, " ``", false], [38924, 0.020583, " local", false], [63421, 0.019717, " convolution", false], [46826, 0.01876, " pixels", false], [38744, 0.017015, " image", false], [30729, 0.016487, " edge", false], [22590, 0.015491, " the", false], [39654, 0.015009, " shape", false], [56024, 0.013605, " distance", false]]]}, "raw_delta": -0.1692708333333333, "tuned_delta": -0.1151812359182577}, {"byte_start": 4725, "byte_end": 4729, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 807, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "3.22% 3.22% 3.22% 3.22%", "model_b": "5.71% 5.71% 5.71% 5.71%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.4923631250858307]], "model_b": [[21265, " and", "normal", 0.28277409076690674]]}, "loss": {"model_a": 3.2228172910483432, "model_b": 5.705971597265919}, "topk": {"model_a": [21265, 1, 0.4923631250858307, [[21265, 0.492363, " and", false], [116, 0.196919, "s", false], [45, 0.143742, ",", false], [1744, 0.079053, "al", false], [275, 0.020357, " (", false], [32487, 0.007552, " with", false], [5346, 0.006894, "---", false], [4706, 0.006807, " of", false], [4596, 0.004937, " in", false], [4715, 0.003917, " or", false]]], "model_b": [21265, 1, 0.28277409076690674, [[21265, 0.282774, " and", false], [116, 0.259397, "s", false], [45, 0.199269, ",", false], [1744, 0.159241, "al", false], [275, 0.03681, " (", false], [4715, 0.007282, " or", false], [32487, 0.007224, " with", false], [4596, 0.00465, " in", false], [4706, 0.003959, " of", false], [4712, 0.003532, " on", false]]]}, "raw_delta": -0.1376953125, "tuned_delta": -0.08360571508492441}, {"byte_start": 4729, "byte_end": 4737, "display": {"text": " certain", "kind": "normal"}, "is_word": true, "word_id": 808, "word_key": " certain", "bytes_hex": "20 63 65 72 74 61 69 6e", "compression": {"model_a": "20.01% 20.01% 20.01% 20.01% 20.01% 20.01% 20.01% 20.01%", "model_b": "24.09% 24.09% 24.09% 24.09% 24.09% 24.09% 24.09% 24.09%"}, "model_tokens": {"model_a": [[51161, " certain", "normal", 0.00014390598516911268]], "model_b": [[51161, " certain", "normal", 2.3310218239203095e-05]]}, "loss": {"model_a": 20.00612263732742, "model_b": 24.091880077344992}, "topk": {"model_a": [51161, 315, 0.00014390598516911268, [[52513, 0.516895, " pooling", false], [56324, 0.021, " gradient", false], [30218, 0.01963, " back", false], [46528, 0.018212, " matrix", false], [22590, 0.017681, " the", false], [61531, 0.01542, " activation", false], [4706, 0.012175, " of", false], [22073, 0.01208, " max", false], [46442, 0.012005, " linear", false], [332, 0.011744, " a", false]]], "model_b": [51161, 868, 2.3310218239203095e-05, [[52513, 0.640392, " pooling", false], [61531, 0.0354, " activation", false], [22590, 0.010133, " the", false], [51725, 0.009507, " feature", false], [31978, 0.008871, " self", false], [4706, 0.006222, " of", false], [38924, 0.006194, " local", false], [64968, 0.005971, " normalization", false], [37816, 0.005231, " batch", false], [56537, 0.005018, " learning", false]]]}, "raw_delta": -0.2265625, "tuned_delta": -0.17247290258492443}, {"byte_start": 4737, "byte_end": 4743, "display": {"text": " kinds", "kind": "normal"}, "is_word": true, "word_id": 809, "word_key": " kinds", "bytes_hex": "20 6b 69 6e 64 73", "compression": {"model_a": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19%", "model_b": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%"}, "model_tokens": {"model_a": [[38841, " kinds", "normal", 0.09110265225172043]], "model_b": [[38841, " kinds", "normal", 0.14126449823379517]]}, "loss": {"model_a": 7.185297566927454, "model_b": 5.8938225140483365}, "topk": {"model_a": [38841, 2, 0.09110265225172043, [[39193, 0.10053, " other", false], [38841, 0.091103, " kinds", false], [40050, 0.085254, " types", false], [38541, 0.050381, " forms", false], [47284, 0.044576, " simple", false], [57520, 0.03626, " variants", false], [37812, 0.029429, " basic", false], [64481, 0.01774, " mathematical", false], [65135, 0.01715, " generalization", false], [46442, 0.015364, " linear", false]]], "model_b": [38841, 2, 0.14126449823379517, [[40050, 0.151409, " types", false], [38841, 0.141264, " kinds", false], [39193, 0.077632, " other", false], [64481, 0.076825, " mathematical", false], [62577, 0.025814, " statistics", false], [46442, 0.018819, " linear", false], [65135, 0.014628, " generalization", false], [63885, 0.01447, " statistical", false], [38541, 0.012348, " forms", false], [52964, 0.011998, " special", false]]]}, "raw_delta": 0.07161458333333331, "tuned_delta": 0.1257041807484089}, {"byte_start": 4743, "byte_end": 4746, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 810, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.01% 0.01% 0.01%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9987161159515381]], "model_b": [[4706, " of", "normal", 0.9979907274246216]]}, "loss": {"model_a": 0.0077506847988839086, "model_b": 0.012107578620741726}, "topk": {"model_a": [4706, 1, 0.9987161159515381, [[4706, 0.998716, " of", false], [21265, 0.000264, " and", false], [275, 0.000172, " (", false], [45, 4.1e-05, ",", false], [4715, 3.8e-05, " or", false], [46442, 2.2e-05, " linear", false], [63421, 1.9e-05, " convolution", false], [4588, 1.9e-05, " if", false], [267, 1.8e-05, "  ", false], [59751, 1.4e-05, " functions", false]]], "model_b": [4706, 1, 0.9979907274246216, [[4706, 0.997991, " of", false], [275, 0.000231, " (", false], [65135, 9.9e-05, " generalization", false], [11, 9.5e-05, "\n", false], [45, 6.4e-05, ",", false], [32227, 5.1e-05, " that", false], [63421, 4.3e-05, " convolution", false], [4715, 3.8e-05, " or", false], [332, 3.3e-05, " a", false], [21265, 2.9e-05, " and", false]]]}, "raw_delta": -0.00024159749348958334, "tuned_delta": 0.053847999921586}, {"byte_start": 4746, "byte_end": 4753, "display": {"text": " invari", "kind": "normal"}, "is_word": true, "word_id": 811, "word_key": " invari", "bytes_hex": "20 69 6e 76 61 72 69", "compression": {"model_a": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "model_b": "11.03% 11.03% 11.03% 11.03% 11.03% 11.03% 11.03%"}, "model_tokens": {"model_a": [[46326, " invari", "normal", 0.002731385873630643]], "model_b": [[46326, " invari", "normal", 0.013857589103281498]]}, "loss": {"model_a": 15.215924259375784, "model_b": 11.029532399653347}, "topk": {"model_a": [46326, 55, 0.002731385873630643, [[52513, 0.215602, " pooling", false], [61531, 0.075048, " activation", false], [51743, 0.038729, " filters", false], [31333, 0.029012, " loss", false], [60060, 0.028117, " nonlinear", false], [22184, 0.024564, " non", false], [46442, 0.016425, " linear", false], [51725, 0.015429, " feature", false], [60342, 0.013442, " recurrent", false], [46528, 0.013061, " matrix", false]]], "model_b": [46326, 10, 0.013857589103281498, [[52513, 0.247242, " pooling", false], [61531, 0.035063, " activation", false], [65135, 0.028863, " generalization", false], [62577, 0.027179, " statistics", false], [51725, 0.021433, " feature", false], [64481, 0.020904, " mathematical", false], [46442, 0.019541, " linear", false], [63885, 0.015524, " statistical", false], [31978, 0.01437, " self", false], [46326, 0.013858, " invari", false]]]}, "raw_delta": 0.23214285714285715, "tuned_delta": 0.2862324545579327}, {"byte_start": 4753, "byte_end": 4758, "display": {"text": "ances", "kind": "normal"}, "is_word": true, "word_id": 812, "word_key": "ances", "bytes_hex": "61 6e 63 65 73", "compression": {"model_a": "8.68% 8.68% 8.68% 8.68% 8.68%", "model_b": "5.72% 5.72% 5.72% 5.72% 5.72%"}, "model_tokens": {"model_a": [[33764, "ances", "normal", 0.09060946851968765]], "model_b": [[33764, "ances", "normal", 0.20574714243412018]]}, "loss": {"model_a": 8.67871235534767, "model_b": 5.720060416024601}, "topk": {"model_a": [33764, 2, 0.09060946851968765, [[24566, 0.908214, "ance", false], [33764, 0.090609, "ances", false], [48811, 0.000398, "ability", false], [24569, 0.000238, "ancy", false], [24381, 0.000137, "able", false], [40971, 5.8e-05, "ancies", false], [33944, 4e-05, "ation", false], [24622, 2.5e-05, "anza", false], [25250, 2.1e-05, "ence", false], [46, 1.9e-05, "-", false]]], "model_b": [33764, 2, 0.20574714243412018, [[24566, 0.79021, "ance", false], [33764, 0.205747, "ances", false], [48811, 0.00067, "ability", false], [24569, 0.000644, "ancy", false], [8218, 0.000567, "nce", false], [24381, 0.000375, "able", false], [7473, 0.000371, "ent", false], [25250, 0.000332, "ence", false], [40971, 0.000162, "ancies", false], [33598, 0.000146, "ables", false]]]}, "raw_delta": 0.1640625, "tuned_delta": 0.21815209741507557}, {"byte_start": 4758, "byte_end": 4759, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "21.98%", "model_b": "26.63%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.2971969246864319]], "model_b": [[45, ",", "normal", 0.22715118527412415]]}, "loss": {"model_a": 21.9785572635428, "model_b": 26.627867453907623}, "topk": {"model_a": [45, 1, 0.2971969246864319, [[45, 0.297197, ",", false], [47, 0.152599, ".", false], [4811, 0.123485, " to", false], [32227, 0.102124, " that", false], [275, 0.093389, " (", false], [5346, 0.036716, "---", false], [21265, 0.035848, " and", false], [4596, 0.017245, " in", false], [4706, 0.014828, " of", false], [60, 0.01097, ";", false]]], "model_b": [45, 1, 0.22715118527412415, [[45, 0.227151, ",", false], [47, 0.197129, ".", false], [32227, 0.122174, " that", false], [4811, 0.092086, " to", false], [275, 0.050611, " (", false], [4706, 0.049301, " of", false], [5346, 0.046477, "---", false], [4596, 0.034272, " in", false], [21265, 0.025866, " and", false], [60, 0.00717, ";", false]]]}, "raw_delta": -0.2578125, "tuned_delta": -0.20372290258492443}, {"byte_start": 4759, "byte_end": 4763, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 813, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "4.39% 4.39% 4.39% 4.39%", "model_b": "4.12% 4.12% 4.12% 4.12%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.3746629059314728]], "model_b": [[21265, " and", "normal", 0.3995138704776764]]}, "loss": {"model_a": 4.385144838639549, "model_b": 4.120979486914275}, "topk": {"model_a": [21265, 1, 0.3746629059314728, [[21265, 0.374663, " and", false], [21400, 0.168011, " but", false], [40186, 0.054604, " which", false], [32139, 0.051539, " such", false], [32487, 0.02725, " with", false], [53356, 0.025751, " without", false], [22187, 0.020457, " not", false], [4423, 0.014145, " as", false], [31296, 0.013973, " like", false], [22797, 0.012327, " yet", false]]], "model_b": [21265, 1, 0.3995138704776764, [[21265, 0.399514, " and", false], [21400, 0.059716, " but", false], [40186, 0.046823, " which", false], [32139, 0.045452, " such", false], [4715, 0.029969, " or", false], [4423, 0.016692, " as", false], [4811, 0.015874, " to", false], [32487, 0.015697, " with", false], [53356, 0.015134, " without", false], [31296, 0.015109, " like", false]]]}, "raw_delta": 0.0146484375, "tuned_delta": 0.06873803491507559}, {"byte_start": 4763, "byte_end": 4771, "display": {"text": " perform", "kind": "normal"}, "is_word": true, "word_id": 814, "word_key": " perform", "bytes_hex": "20 70 65 72 66 6f 72 6d", "compression": {"model_a": "12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19%", "model_b": "14.58% 14.58% 14.58% 14.58% 14.58% 14.58% 14.58% 14.58%"}, "model_tokens": {"model_a": [[52446, " perform", "normal", 0.004482059273868799]], "model_b": [[52446, " perform", "normal", 0.001536969793960452]]}, "loss": {"model_a": 12.186828226259308, "model_b": 14.581927415235127}, "topk": {"model_a": [52446, 38, 0.004482059273868799, [[32232, 0.14487, " they", false], [39936, 0.089294, " these", false], [22590, 0.065345, " the", false], [4491, 0.037091, " do", false], [21286, 0.032853, " are", false], [22797, 0.0274, " yet", false], [31059, 0.025442, " have", false], [38877, 0.025026, " learn", false], [39944, 0.020124, " those", false], [4596, 0.019057, " in", false]]], "model_b": [52446, 83, 0.001536969793960452, [[22590, 0.075299, " the", false], [39936, 0.072458, " these", false], [32232, 0.070421, " they", false], [21286, 0.043625, " are", false], [30788, 0.024817, " even", false], [32230, 0.023655, " then", false], [4596, 0.023468, " in", false], [32234, 0.019862, " this", false], [31466, 0.019515, " much", false], [21256, 0.019298, " all", false]]]}, "raw_delta": -0.1328125, "tuned_delta": -0.07872290258492441}, {"byte_start": 4771, "byte_end": 4776, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 815, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"model_a": "13.41% 13.41% 13.41% 13.41% 13.41%", "model_b": "7.78% 7.78% 7.78% 7.78% 7.78%"}, "model_tokens": {"model_a": [[31466, " much", "normal", 0.024248937144875526]], "model_b": [[31466, " much", "normal", 0.11659453809261322]]}, "loss": {"model_a": 13.412555458264581, "model_b": 7.777027954792068}, "topk": {"model_a": [31466, 9, 0.024248937144875526, [[22590, 0.094189, " the", false], [39931, 0.087639, " their", false], [32386, 0.046725, " very", false], [32458, 0.044061, " well", false], [50892, 0.04163, " amazing", false], [332, 0.038638, " a", false], [52195, 0.03686, " massive", false], [62478, 0.029377, " remarkably", false], [31466, 0.024249, " much", false], [21256, 0.021847, " all", false]]], "model_b": [31466, 2, 0.11659453809261322, [[45301, 0.133609, " better", false], [31466, 0.116595, " much", false], [32458, 0.085868, " well", false], [32386, 0.04933, " very", false], [21660, 0.037997, " far", false], [59699, 0.029549, " extremely", false], [4788, 0.024512, " so", false], [4423, 0.024132, " as", false], [50892, 0.023101, " amazing", false], [62478, 0.021898, " remarkably", false]]]}, "raw_delta": 0.3125, "tuned_delta": 0.3665895974150756}, {"byte_start": 4776, "byte_end": 4783, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 816, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"model_a": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%", "model_b": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"model_a": [[45301, " better", "normal", 0.7511299252510071]], "model_b": [[45301, " better", "normal", 0.9336152076721191]]}, "loss": {"model_a": 0.7295995428602808, "model_b": 0.17485230423720519}, "topk": {"model_a": [45301, 1, 0.7511299252510071, [[45301, 0.75113, " better", false], [31458, 0.154028, " more", false], [45, 0.019599, ",", false], [4706, 0.016179, " of", false], [22590, 0.012248, " the", false], [31466, 0.008137, " much", false], [31277, 0.004959, " less", false], [45961, 0.004018, " faster", false], [46198, 0.003279, " higher", false], [4715, 0.003223, " or", false]]], "model_b": [45301, 1, 0.9336152076721191, [[45301, 0.933615, " better", false], [31458, 0.029074, " more", false], [45, 0.009008, ",", false], [31466, 0.006404, " much", false], [40216, 0.004251, " worse", false], [31277, 0.002721, " less", false], [4423, 0.001973, " as", false], [45961, 0.001492, " faster", false], [4706, 0.001137, " of", false], [46198, 0.001017, " higher", false]]]}, "raw_delta": 0.03076171875, "tuned_delta": 0.08485131616507559}, {"byte_start": 4783, "byte_end": 4784, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "16.27%", "model_b": "27.19%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.4038146436214447]], "model_b": [[47, ".", "normal", 0.22015078365802765]]}, "loss": {"model_a": 16.272585666276882, "model_b": 27.191420204254875}, "topk": {"model_a": [47, 1, 0.4038146436214447, [[47, 0.403815, ".", false], [32226, 0.226057, " than", false], [45, 0.066152, ",", false], [4712, 0.066079, " on", false], [4596, 0.038707, " in", false], [4424, 0.032568, " at", false], [5346, 0.027397, "---", false], [32487, 0.021845, " with", false], [21265, 0.010803, " and", false], [4450, 0.01077, " by", false]]], "model_b": [47, 2, 0.22015078365802765, [[32226, 0.413576, " than", false], [47, 0.220151, ".", false], [4712, 0.065965, " on", false], [4596, 0.055225, " in", false], [45, 0.053293, ",", false], [4424, 0.050227, " at", false], [32487, 0.027703, " with", false], [32465, 0.01374, " when", false], [21265, 0.0091, " and", false], [40085, 0.007372, " using", false]]]}, "raw_delta": -0.60546875, "tuned_delta": -0.5513791525849244}, {"byte_start": 4784, "byte_end": 4785, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "23.81%", "model_b": "25.08%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.07171101123094559]], "model_b": [[261, "\n\n", "control", 0.06187887489795685]]}, "loss": {"model_a": 23.810103702171368, "model_b": 25.078097390452683}, "topk": {"model_a": [261, 3, 0.07171101123094559, [[20996, 0.140689, " The", false], [29894, 0.09324, " This", false], [261, 0.071711, "\n\n", false], [36251, 0.06361, " Again", false], [3913, 0.044152, " In", false], [3918, 0.03636, " It", false], [37451, 0.033717, " There", false], [29893, 0.02838, " They", false], [37453, 0.021943, " These", false], [3641, 0.021111, " As", false]]], "model_b": [261, 3, 0.06187887489795685, [[20996, 0.149396, " The", false], [29894, 0.068749, " This", false], [261, 0.061879, "\n\n", false], [3913, 0.049441, " In", false], [37453, 0.044535, " These", false], [19555, 0.043805, " But", false], [36251, 0.031002, " Again", false], [37451, 0.025569, " There", false], [19417, 0.02317, " And", false], [28753, 0.021917, " Deep", false]]]}, "raw_delta": -0.0703125, "tuned_delta": -0.016222902584924412}, {"byte_start": 4785, "byte_end": 4786, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "23.81%", "model_b": "25.08%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.07171101123094559]], "model_b": [[261, "\n\n", "control", 0.06187887489795685]]}, "loss": {"model_a": 23.810103702171368, "model_b": 25.078097390452683}, "topk": {"model_a": [261, 3, 0.07171101123094559, [[20996, 0.140689, " The", false], [29894, 0.09324, " This", false], [261, 0.071711, "\n\n", false], [36251, 0.06361, " Again", false], [3913, 0.044152, " In", false], [3918, 0.03636, " It", false], [37451, 0.033717, " There", false], [29893, 0.02838, " They", false], [37453, 0.021943, " These", false], [3641, 0.021111, " As", false]]], "model_b": [261, 3, 0.06187887489795685, [[20996, 0.149396, " The", false], [29894, 0.068749, " This", false], [261, 0.061879, "\n\n", false], [3913, 0.049441, " In", false], [37453, 0.044535, " These", false], [19555, 0.043805, " But", false], [36251, 0.031002, " Again", false], [37451, 0.025569, " There", false], [19417, 0.02317, " And", false], [28753, 0.021917, " Deep", false]]]}, "raw_delta": -0.0703125, "tuned_delta": -0.016222902584924412}, {"byte_start": 4786, "byte_end": 4790, "display": {"text": "This", "kind": "normal"}, "is_word": true, "word_id": 817, "word_key": "this", "bytes_hex": "54 68 69 73", "compression": {"model_a": "17.40% 17.40% 17.40% 17.40%", "model_b": "17.19% 17.19% 17.19% 17.19%"}, "model_tokens": {"model_a": [[24242, "This", "normal", 0.02099331095814705]], "model_b": [[24242, "This", "normal", 0.022140920162200928]]}, "loss": {"model_a": 17.399691166971383, "model_b": 17.188358885591164}, "topk": {"model_a": [24242, 8, 0.02099331095814705, [[1136, 0.236235, "In", false], [6699, 0.114129, "The", false], [33504, 0.068052, "There", false], [33505, 0.045878, "These", false], [1141, 0.035715, "It", false], [66, 0.034916, "A", false], [5559, 0.028935, "All", false], [24242, 0.020993, "This", false], [1461, 0.013711, "So", false], [58094, 0.013548, "Similarly", false]]], "model_b": [24242, 5, 0.022140920162200928, [[1136, 0.33933, "In", false], [6699, 0.119163, "The", false], [33504, 0.039976, "There", false], [66, 0.025559, "A", false], [24242, 0.022141, "This", false], [33505, 0.019194, "These", false], [6393, 0.013962, "One", false], [1141, 0.013633, "It", false], [48504, 0.012817, "Finally", false], [53454, 0.012615, "Computer", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06580834741507559}, {"byte_start": 4790, "byte_end": 4793, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 818, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "8.55% 8.55% 8.55%", "model_b": "7.56% 7.56% 7.56%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.24036209285259247]], "model_b": [[4600, " is", "normal", 0.2822357714176178]]}, "loss": {"model_a": 8.547216713599978, "model_b": 7.560999400492288}, "topk": {"model_a": [4600, 1, 0.24036209285259247, [[4600, 0.240362, " is", false], [52427, 0.215301, " pattern", false], [46430, 0.023896, " lesson", false], [31937, 0.021227, " same", false], [21800, 0.019253, " has", false], [45315, 0.016246, " bitter", false], [51832, 0.015342, " general", false], [21365, 0.013791, " bit", false], [30659, 0.013637, " does", false], [31254, 0.012731, " last", false]]], "model_b": [4600, 1, 0.2822357714176178, [[4600, 0.282236, " is", false], [52427, 0.129236, " pattern", false], [38875, 0.019555, " leads", false], [31937, 0.019461, " same", false], [22748, 0.017131, " was", false], [21800, 0.015006, " has", false], [30659, 0.014813, " does", false], [46430, 0.014212, " lesson", false], [51668, 0.013886, " example", false], [50938, 0.012931, " applies", false]]]}, "raw_delta": 0.0546875, "tuned_delta": 0.10877709741507559}, {"byte_start": 4793, "byte_end": 4795, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 819, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "18.60% 18.60%", "model_b": "18.32% 18.32%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.12615233659744263]], "model_b": [[332, " a", "normal", 0.13184314966201782]]}, "loss": {"model_a": 18.597240761459293, "model_b": 18.315464386285665}, "topk": {"model_a": [332, 2, 0.12615233659744263, [[22187, 0.401821, " not", false], [332, 0.126152, " a", false], [22590, 0.077981, " the", false], [21256, 0.03986, " all", false], [31198, 0.037754, " just", false], [4419, 0.028315, " an", false], [32313, 0.019864, " true", false], [22226, 0.015876, " one", false], [31581, 0.015499, " only", false], [4450, 0.013564, " by", false]]], "model_b": [332, 2, 0.13184314966201782, [[22187, 0.380914, " not", false], [332, 0.131843, " a", false], [22590, 0.062282, " the", false], [4419, 0.033021, " an", false], [31198, 0.032981, " just", false], [21256, 0.023509, " all", false], [32313, 0.023351, " true", false], [31581, 0.018865, " only", false], [22763, 0.018805, " why", false], [30135, 0.014224, " also", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 4795, "byte_end": 4799, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 820, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"model_a": "23.11% 23.11% 23.11% 23.11%", "model_b": "20.71% 20.71% 20.71% 20.71%"}, "model_tokens": {"model_a": [[21357, " big", "normal", 0.005916913505643606]], "model_b": [[21357, " big", "normal", 0.01023633498698473]]}, "loss": {"model_a": 23.1056627642373, "model_b": 20.710563575261485}, "topk": {"model_a": [21357, 23, 0.005916913505643606, [[52427, 0.151616, " pattern", false], [51832, 0.138843, " general", false], [32386, 0.077253, " very", false], [46430, 0.050761, " lesson", false], [45534, 0.025772, " common", false], [30992, 0.019185, " good", false], [31323, 0.018731, " long", false], [21365, 0.016426, " bit", false], [53216, 0.013408, " typical", false], [39831, 0.011666, " story", false]]], "model_b": [21357, 16, 0.01023633498698473, [[32386, 0.066538, " very", false], [52427, 0.05967, " pattern", false], [31323, 0.031689, " long", false], [53060, 0.030448, " summary", false], [51832, 0.029106, " general", false], [30992, 0.027765, " good", false], [65135, 0.019029, " generalization", false], [47284, 0.014781, " simple", false], [39720, 0.012084, " small", false], [21365, 0.011911, " bit", false]]]}, "raw_delta": 0.1328125, "tuned_delta": 0.18690209741507557}, {"byte_start": 4799, "byte_end": 4806, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 821, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%", "model_b": "2.56% 2.56% 2.56% 2.56% 2.56% 2.56% 2.56%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.39640820026397705]], "model_b": [[46430, " lesson", "normal", 0.3726769983768463]]}, "loss": {"model_a": 2.3649088630643575, "model_b": 2.556114260503604}, "topk": {"model_a": [46430, 1, 0.39640820026397705, [[46430, 0.396408, " lesson", false], [45450, 0.077684, " change", false], [30587, 0.046992, " deal", false], [39932, 0.036886, " theme", false], [45, 0.034727, ",", false], [39831, 0.03342, " story", false], [52427, 0.027727, " pattern", false], [31633, 0.022082, " part", false], [39981, 0.019946, " topic", false], [21265, 0.018497, " and", false]]], "model_b": [46430, 1, 0.3726769983768463, [[46430, 0.372677, " lesson", false], [39831, 0.062088, " story", false], [52569, 0.038592, " problem", false], [52427, 0.036689, " pattern", false], [45, 0.024217, ",", false], [30587, 0.022668, " deal", false], [47009, 0.021353, " reason", false], [61863, 0.020002, " difference", false], [45450, 0.014832, " change", false], [39932, 0.014302, " theme", false]]]}, "raw_delta": -0.010602678571428575, "tuned_delta": 0.04348691884364701}, {"byte_start": 4806, "byte_end": 4807, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "29.87%", "model_b": "31.00%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.1890116184949875]], "model_b": [[47, ".", "normal", 0.1789960265159607]]}, "loss": {"model_a": 29.868295768404316, "model_b": 30.99540126909882}, "topk": {"model_a": [47, 1, 0.1890116184949875, [[47, 0.189012, ".", false], [21700, 0.179171, " for", false], [45, 0.177697, ",", false], [32227, 0.080117, " that", false], [4811, 0.075661, " to", false], [59, 0.068448, ":", false], [4596, 0.064481, " in", false], [37598, 0.036516, " about", false], [4706, 0.02082, " of", false], [30917, 0.019844, " from", false]]], "model_b": [47, 2, 0.1789960265159607, [[21700, 0.190356, " for", false], [47, 0.178996, ".", false], [45, 0.170386, ",", false], [32227, 0.094499, " that", false], [4596, 0.083188, " in", false], [4811, 0.062195, " to", false], [5346, 0.045376, "---", false], [30917, 0.038367, " from", false], [4706, 0.030461, " of", false], [59, 0.02908, ":", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.008410402584924412}, {"byte_start": 4807, "byte_end": 4810, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 822, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"model_a": "25.92% 25.92% 25.92%", "model_b": "25.92% 25.92% 25.92%"}, "model_tokens": {"model_a": [[3641, " As", "normal", 0.013599949888885021]], "model_b": [[3641, " As", "normal", 0.013539464212954044]]}, "loss": {"model_a": 25.92342651597356, "model_b": 25.92342651597356}, "topk": {"model_a": [3641, 10, 0.013599949888885021, [[3918, 0.215962, " It", false], [20996, 0.140166, " The", false], [3913, 0.047111, " In", false], [3908, 0.041719, " If", false], [37451, 0.028886, " There", false], [30032, 0.027224, " When", false], [4331, 0.021836, " We", false], [300, 0.014039, " A", false], [19907, 0.013748, " For", false], [3641, 0.0136, " As", false]]], "model_b": [3641, 11, 0.013539464212954044, [[3918, 0.228491, " It", false], [20996, 0.108859, " The", false], [3913, 0.047717, " In", false], [3908, 0.043741, " If", false], [37451, 0.033726, " There", false], [4331, 0.026479, " We", false], [30032, 0.022937, " When", false], [19555, 0.015801, " But", false], [19417, 0.014896, " And", false], [54932, 0.014257, " Computer", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 4810, "byte_end": 4812, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 823, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "20.57% 20.57%", "model_b": "20.99% 20.99%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.10101870447397232]], "model_b": [[332, " a", "normal", 0.09662576019763947]]}, "loss": {"model_a": 20.56967538767467, "model_b": 20.99233995043511}, "topk": {"model_a": [332, 1, 0.10101870447397232, [[332, 0.101019, " a", false], [22590, 0.071726, " the", false], [3609, 0.069767, " AI", false], [31323, 0.066281, " long", false], [4858, 0.05641, " we", false], [308, 0.036531, " I", false], [4596, 0.028283, " in", false], [21660, 0.025114, " far", false], [63843, 0.022032, " researchers", false], [32079, 0.021067, " soon", false]]], "model_b": [332, 1, 0.09662576019763947, [[332, 0.096626, " a", false], [4858, 0.070922, " we", false], [22590, 0.068303, " the", false], [4596, 0.062986, " in", false], [31323, 0.056028, " long", false], [32487, 0.045097, " with", false], [3609, 0.036582, " AI", false], [308, 0.025202, " I", false], [21660, 0.023506, " far", false], [37045, 0.022564, " Moore", false]]]}, "raw_delta": -0.0234375, "tuned_delta": 0.030652097415075588}, {"byte_start": 4812, "byte_end": 4818, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 824, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"model_a": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "model_b": "13.71% 13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"model_a": [[38478, " field", "normal", 0.014523682184517384]], "model_b": [[38478, " field", "normal", 0.010570116341114044]]}, "loss": {"model_a": 12.679936882813154, "model_b": 13.713116925116447}, "topk": {"model_a": [38478, 10, 0.014523682184517384, [[51832, 0.243275, " general", false], [62496, 0.057557, " researcher", false], [47092, 0.05675, " result", false], [31907, 0.044584, " rule", false], [46530, 0.026454, " matter", false], [60212, 0.025288, " practical", false], [57103, 0.016576, " research", false], [52942, 0.016178, " society", false], [21458, 0.01524, " cor", false], [38478, 0.014524, " field", false]]], "model_b": [38478, 13, 0.010570116341114044, [[51832, 0.125845, " general", false], [47092, 0.101292, " result", false], [62496, 0.059665, " researcher", false], [31907, 0.053537, " rule", false], [63388, 0.029326, " consequence", false], [46530, 0.028851, " matter", false], [60212, 0.025235, " practical", false], [57103, 0.019097, " research", false], [55809, 0.016802, " computer", false], [62391, 0.012164, " programmer", false]]]}, "raw_delta": -0.05729166666666663, "tuned_delta": -0.0032020692515910415}, {"byte_start": 4818, "byte_end": 4819, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "8.84%", "model_b": "7.89%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.6092252731323242]], "model_b": [[45, ",", "normal", 0.6458930373191833]]}, "loss": {"model_a": 8.840733771072504, "model_b": 7.889738504861517}, "topk": {"model_a": [45, 1, 0.6092252731323242, [[45, 0.609225, ",", false], [4706, 0.171511, " of", false], [4858, 0.034033, " we", false], [32227, 0.02243, " that", false], [38642, 0.02184, " grows", false], [46531, 0.019879, " mature", false], [39072, 0.009967, " moves", false], [55981, 0.008931, " develops", false], [62394, 0.007743, " progresses", false], [4596, 0.005394, " in", false]]], "model_b": [45, 1, 0.6458930373191833, [[45, 0.645893, ",", false], [4706, 0.08517, " of", false], [32227, 0.029977, " that", false], [4601, 0.025711, " it", false], [46531, 0.023351, " mature", false], [4858, 0.016772, " we", false], [55981, 0.010808, " develops", false], [55465, 0.010039, " advances", false], [4596, 0.009136, " in", false], [21800, 0.009076, " has", false]]]}, "raw_delta": 0.052734375, "tuned_delta": 0.10682397241507559}, {"byte_start": 4819, "byte_end": 4822, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 825, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "9.44% 9.44% 9.44%", "model_b": "13.81% 13.81% 13.81%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.20773224532604218]], "model_b": [[4858, " we", "normal", 0.10175453871488571]]}, "loss": {"model_a": 9.439508568316459, "model_b": 13.807042383507657}, "topk": {"model_a": [4858, 2, 0.20773224532604218, [[3609, 0.41938, " AI", false], [4858, 0.207732, " we", false], [55809, 0.154025, " computer", false], [4601, 0.037014, " it", false], [61594, 0.028619, " artificial", false], [52167, 0.022356, " machine", false], [22590, 0.017376, " the", false], [22248, 0.007635, " our", false], [21265, 0.006665, " and", false], [39934, 0.004918, " there", false]]], "model_b": [4858, 3, 0.10175453871488571, [[3609, 0.277586, " AI", false], [55809, 0.235011, " computer", false], [4858, 0.101755, " we", false], [4601, 0.069409, " it", false], [22590, 0.054967, " the", false], [21265, 0.026637, " and", false], [61594, 0.02021, " artificial", false], [57103, 0.018753, " research", false], [39934, 0.01336, " there", false], [52299, 0.01033, " natural", false]]]}, "raw_delta": -0.2421875, "tuned_delta": -0.18809790258492443}, {"byte_start": 4822, "byte_end": 4828, "display": {"text": " still", "kind": "normal"}, "is_word": true, "word_id": 826, "word_key": " still", "bytes_hex": "20 73 74 69 6c 6c", "compression": {"model_a": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%", "model_b": "17.00% 17.00% 17.00% 17.00% 17.00% 17.00%"}, "model_tokens": {"model_a": [[39820, " still", "normal", 0.0035765713546425104]], "model_b": [[39820, " still", "normal", 0.0034649791195988655]]}, "loss": {"model_a": 16.90658251041754, "model_b": 17.000507968808748}, "topk": {"model_a": [39820, 29, 0.0035765713546425104, [[31059, 0.240231, " have", false], [31506, 0.153746, " need", false], [47266, 0.14672, " should", false], [21286, 0.097353, " are", false], [31475, 0.035653, " must", false], [21413, 0.029261, " can", false], [32216, 0.019803, " tend", false], [4491, 0.012959, " do", false], [5231, 0.01285, "'ve", false], [22190, 0.010097, " now", false]]], "model_b": [39820, 23, 0.0034649791195988655, [[31059, 0.283669, " have", false], [47266, 0.130027, " should", false], [21286, 0.115964, " are", false], [31506, 0.060245, " need", false], [21413, 0.040049, " can", false], [32216, 0.028883, " tend", false], [31475, 0.02835, " must", false], [22190, 0.014974, " now", false], [5231, 0.011703, "'ve", false], [32462, 0.011219, " were", false]]]}, "raw_delta": -0.00520833333333337, "tuned_delta": 0.04888126408174222}, {"byte_start": 4828, "byte_end": 4833, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 827, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "4.85% 4.85% 4.85% 4.85% 4.85%", "model_b": "3.41% 3.41% 3.41% 3.41% 3.41%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.2598569095134735]], "model_b": [[31059, " have", "normal", 0.38848116993904114]]}, "loss": {"model_a": 4.846553652986361, "model_b": 3.40949413960087}, "topk": {"model_a": [31059, 1, 0.2598569095134735, [[31059, 0.259857, " have", false], [32216, 0.091551, " tend", false], [31506, 0.051154, " need", false], [4491, 0.040088, " do", false], [39942, 0.037661, " think", false], [31967, 0.021362, " seem", false], [57328, 0.017307, " struggle", false], [39761, 0.016216, " spend", false], [39171, 0.015666, " often", false], [21556, 0.013541, " don", false]]], "model_b": [31059, 1, 0.38848116993904114, [[31059, 0.388481, " have", false], [31506, 0.107937, " need", false], [4491, 0.034949, " do", false], [32216, 0.027292, " tend", false], [39761, 0.022639, " spend", false], [21286, 0.017356, " are", false], [22681, 0.017126, " use", false], [51025, 0.016274, " believe", false], [31967, 0.012303, " seem", false], [31856, 0.01164, " rely", false]]]}, "raw_delta": 0.0796875, "tuned_delta": 0.1337770974150756}, {"byte_start": 4833, "byte_end": 4837, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 828, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "8.95% 8.95% 8.95% 8.95%", "model_b": "17.75% 17.75% 17.75% 17.75%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.13639238476753235]], "model_b": [[22187, " not", "normal", 0.019650762900710106]]}, "loss": {"model_a": 8.946399911762613, "model_b": 17.751911635938416}, "topk": {"model_a": [22187, 2, 0.13639238476753235, [[332, 0.311102, " a", false], [22187, 0.136392, " not", false], [4811, 0.079346, " to", false], [31466, 0.069057, " much", false], [31370, 0.05811, " many", false], [32074, 0.036899, " some", false], [22590, 0.031385, " the", false], [4419, 0.018718, " an", false], [31335, 0.014693, " lots", false], [22614, 0.013194, " too", false]]], "model_b": [22187, 8, 0.019650762900710106, [[332, 0.442304, " a", false], [31466, 0.142253, " much", false], [4811, 0.051131, " to", false], [31370, 0.041009, " many", false], [4419, 0.021647, " an", false], [22590, 0.021309, " the", false], [32074, 0.019921, " some", false], [22187, 0.019651, " not", false], [22614, 0.01706, " too", false], [4788, 0.009909, " so", false]]]}, "raw_delta": -0.48828125, "tuned_delta": -0.4341916525849244}, {"byte_start": 4837, "byte_end": 4848, "display": {"text": " thoroughly", "kind": "normal"}, "is_word": true, "word_id": 829, "word_key": " thoroughly", "bytes_hex": "20 74 68 6f 72 6f 75 67 68 6c 79", "compression": {"model_a": "11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73%", "model_b": "13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83% 13.83%"}, "model_tokens": {"model_a": [[62646, " thoroughly", "normal", 0.0007897895411588252]], "model_b": [[62646, " thoroughly", "normal", 0.00021059098071418703]]}, "loss": {"model_a": 11.732143620865504, "model_b": 13.832658417614352}, "topk": {"model_a": [62646, 94, 0.0007897895411588252, [[52112, 0.217577, " learned", false], [38566, 0.205699, " fully", false], [22797, 0.046931, " yet", false], [39423, 0.026941, " quite", false], [46112, 0.023693, " gotten", false], [56098, 0.023239, " embraced", false], [30482, 0.023224, " come", false], [56480, 0.021566, " internal", false], [61717, 0.019571, " completely", false], [31351, 0.019036, " made", false]]], "model_b": [62646, 245, 0.00021059098071418703, [[52112, 0.274349, " learned", false], [51738, 0.048523, " figured", false], [46526, 0.042825, " master", false], [38566, 0.037531, " fully", false], [22797, 0.032267, " yet", false], [31351, 0.030779, " made", false], [52643, 0.030348, " reached", false], [46112, 0.021251, " gotten", false], [30666, 0.019607, " done", false], [30259, 0.019411, " been", false]]]}, "raw_delta": -0.11647727272727285, "tuned_delta": -0.06238767531219726}, {"byte_start": 4848, "byte_end": 4856, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 830, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"model_a": "4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47%", "model_b": "3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06%"}, "model_tokens": {"model_a": [[52112, " learned", "normal", 0.13818806409835815]], "model_b": [[52112, " learned", "normal", 0.2576465904712677]]}, "loss": {"model_a": 4.473199955881307, "model_b": 3.064318080013179}, "topk": {"model_a": [52112, 2, 0.13818806409835815, [[56480, 0.196796, " internal", false], [52112, 0.138188, " learned", false], [56098, 0.117499, " embraced", false], [62684, 0.083172, " understood", false], [55423, 0.064751, " absorbed", false], [38625, 0.036738, " grasp", false], [45746, 0.028517, " digest", false], [37761, 0.024372, " assim", false], [62141, 0.023075, " integrated", false], [63289, 0.020703, " appreciated", false]]], "model_b": [52112, 1, 0.2576465904712677, [[52112, 0.257647, " learned", false], [62684, 0.149414, " understood", false], [59685, 0.057336, " exploited", false], [63289, 0.045117, " appreciated", false], [46526, 0.032668, " master", false], [56182, 0.030012, " explored", false], [56098, 0.029287, " embraced", false], [38625, 0.020212, " grasp", false], [31428, 0.017572, " mine", false], [56480, 0.0175, " internal", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13221459741507557}, {"byte_start": 4856, "byte_end": 4859, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 831, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "2.24% 2.24% 2.24%", "model_b": "38.32% 38.32% 38.32%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.6888904571533203]], "model_b": [[4601, " it", "normal", 0.0016924608498811722]]}, "loss": {"model_a": 2.242470319090104, "model_b": 38.321587023613084}, "topk": {"model_a": [4601, 1, 0.6888904571533203, [[4601, 0.68889, " it", false], [32234, 0.105858, " this", false], [22590, 0.045903, " the", false], [32227, 0.035526, " that", false], [30917, 0.025735, " from", false], [4811, 0.025269, " to", false], [21835, 0.023128, " how", false], [32464, 0.009804, " what", false], [21265, 0.006502, " and", false], [22248, 0.003925, " our", false]]], "model_b": [4601, 25, 0.0016924608498811722, [[21835, 0.266821, " how", false], [4811, 0.203572, " to", false], [30917, 0.195244, " from", false], [22590, 0.131856, " the", false], [32227, 0.047189, " that", false], [32464, 0.032799, " what", false], [21256, 0.013488, " all", false], [37598, 0.011818, " about", false], [32234, 0.010346, " this", false], [45, 0.009145, ",", false]]]}, "raw_delta": -2.0006510416666665, "tuned_delta": -1.9465614442515908}, {"byte_start": 4859, "byte_end": 4860, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "25.64%", "model_b": "26.35%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.24268387258052826]], "model_b": [[45, ",", "normal", 0.23818154633045197]]}, "loss": {"model_a": 25.641650140799932, "model_b": 26.346091078734}, "topk": {"model_a": [45, 2, 0.24268387258052826, [[47, 0.653606, ".", false], [45, 0.242684, ",", false], [5346, 0.018404, "---", false], [21265, 0.017578, " and", false], [22797, 0.01482, " yet", false], [60, 0.007195, ";", false], [59, 0.006336, ":", false], [4715, 0.005869, " or", false], [275, 0.005326, " (", false], [4596, 0.004724, " in", false]]], "model_b": [45, 2, 0.23818154633045197, [[47, 0.548507, ".", false], [45, 0.238182, ",", false], [5346, 0.036713, "---", false], [21265, 0.0246, " and", false], [22797, 0.017601, " yet", false], [60, 0.014457, ";", false], [32458, 0.013761, " well", false], [4596, 0.012396, " in", false], [22590, 0.012023, " the", false], [21256, 0.010343, " all", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.015027097415075588}, {"byte_start": 4860, "byte_end": 4863, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 832, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "24.80% 24.80% 24.80%", "model_b": "26.67% 26.67% 26.67%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.016042407602071762]], "model_b": [[4423, " as", "normal", 0.011628666892647743]]}, "loss": {"model_a": 24.796321015279055, "model_b": 26.67483018310323}, "topk": {"model_a": [4423, 7, 0.016042407602071762, [[21265, 0.345716, " and", false], [21400, 0.33421, " but", false], [55495, 0.042687, " although", false], [4715, 0.038293, " or", false], [30788, 0.025219, " even", false], [51018, 0.023825, " because", false], [4423, 0.016042, " as", false], [22185, 0.014719, " nor", false], [4788, 0.014672, " so", false], [47544, 0.013463, " though", false]]], "model_b": [4423, 11, 0.011628666892647743, [[21265, 0.396458, " and", false], [21400, 0.327381, " but", false], [4715, 0.035884, " or", false], [55495, 0.024004, " although", false], [22185, 0.019788, " nor", false], [51450, 0.019248, " despite", false], [30788, 0.01683, " even", false], [51018, 0.013401, " because", false], [4596, 0.013081, " in", false], [4788, 0.011668, " so", false]]]}, "raw_delta": -0.10416666666666674, "tuned_delta": -0.05007706925159115}, {"byte_start": 4863, "byte_end": 4866, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 833, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "11.74% 11.74% 11.74%", "model_b": "12.02% 12.02% 12.02%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.14369505643844604]], "model_b": [[4858, " we", "normal", 0.13420267403125763]]}, "loss": {"model_a": 11.740682298901067, "model_b": 12.022458674074693}, "topk": {"model_a": [4858, 2, 0.14369505643844604, [[4601, 0.162894, " it", false], [4858, 0.143695, " we", false], [59655, 0.108984, " evidenced", false], [39934, 0.053337, " there", false], [332, 0.045773, " a", false], [22590, 0.035668, " the", false], [31370, 0.030317, " many", false], [4600, 0.026523, " is", false], [308, 0.020256, " I", false], [31466, 0.017239, " much", false]]], "model_b": [4858, 1, 0.13420267403125763, [[4858, 0.134203, " we", false], [332, 0.096282, " a", false], [4601, 0.071266, " it", false], [39934, 0.053579, " there", false], [22590, 0.049095, " the", false], [59655, 0.03835, " evidenced", false], [4491, 0.034169, " do", false], [21660, 0.031121, " far", false], [4596, 0.020969, " in", false], [308, 0.020623, " I", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 4866, "byte_end": 4870, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 834, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99%", "model_b": "12.61% 12.61% 12.61% 12.61%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.08767735213041306]], "model_b": [[21286, " are", "normal", 0.06092755123972893]]}, "loss": {"model_a": 10.9892786317714, "model_b": 12.609492789019747}, "topk": {"model_a": [21286, 3, 0.08767735213041306, [[31059, 0.244129, " have", false], [39820, 0.097822, " still", false], [21286, 0.087677, " are", false], [47266, 0.058725, " should", false], [55851, 0.035146, " continue", false], [22449, 0.023081, " see", false], [21413, 0.022533, " can", false], [21532, 0.018698, " did", false], [32475, 0.018211, " will", false], [31967, 0.017509, " seem", false]]], "model_b": [21286, 4, 0.06092755123972893, [[31059, 0.307849, " have", false], [47266, 0.083716, " should", false], [39820, 0.079268, " still", false], [21286, 0.060928, " are", false], [4491, 0.046544, " do", false], [21532, 0.025419, " did", false], [55851, 0.024543, " continue", false], [31506, 0.020441, " need", false], [38877, 0.0187, " learn", false], [21413, 0.016055, " can", false]]]}, "raw_delta": -0.08984375, "tuned_delta": -0.03575415258492441}, {"byte_start": 4870, "byte_end": 4881, "display": {"text": " continuing", "kind": "normal"}, "is_word": true, "word_id": 835, "word_key": " continuing", "bytes_hex": "20 63 6f 6e 74 69 6e 75 69 6e 67", "compression": {"model_a": "9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43%", "model_b": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%"}, "model_tokens": {"model_a": [[61774, " continuing", "normal", 0.0032059645745903254]], "model_b": [[61774, " continuing", "normal", 0.005715612322092056]]}, "loss": {"model_a": 9.42670055126311, "model_b": 8.45329125520877}, "topk": {"model_a": [61774, 22, 0.0032059645745903254, [[39820, 0.631963, " still", false], [21256, 0.022194, " all", false], [22187, 0.021499, " not", false], [4596, 0.015967, " in", false], [4788, 0.014402, " so", false], [22190, 0.012031, " now", false], [22614, 0.01169, " too", false], [39364, 0.011389, " prone", false], [61760, 0.007598, " constantly", false], [39171, 0.00746, " often", false]]], "model_b": [61774, 21, 0.005715612322092056, [[39820, 0.3714, " still", false], [22187, 0.047946, " not", false], [56537, 0.029437, " learning", false], [61760, 0.02836, " constantly", false], [31198, 0.01984, " just", false], [4596, 0.019727, " in", false], [31581, 0.018095, " only", false], [39171, 0.014359, " often", false], [21256, 0.014231, " all", false], [45150, 0.013179, " always", false]]]}, "raw_delta": 0.05397727272727271, "tuned_delta": 0.1080668701423483}, {"byte_start": 4881, "byte_end": 4884, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 836, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.42% 0.42% 0.42%", "model_b": "0.77% 0.77% 0.77%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.932659924030304]], "model_b": [[4811, " to", "normal", 0.8786829710006714]]}, "loss": {"model_a": 0.41972939218571315, "model_b": 0.7748850317274705}, "topk": {"model_a": [4811, 1, 0.932659924030304, [[4811, 0.93266, " to", false], [22590, 0.011447, " the", false], [45, 0.00952, ",", false], [22248, 0.006447, " our", false], [4596, 0.00543, " in", false], [32487, 0.004372, " with", false], [332, 0.003248, " a", false], [4712, 0.002375, " on", false], [51566, 0.001911, " efforts", false], [57103, 0.001478, " research", false]]], "model_b": [4811, 1, 0.8786829710006714, [[4811, 0.878683, " to", false], [22248, 0.016532, " our", false], [22590, 0.015451, " the", false], [32487, 0.012612, " with", false], [4596, 0.010376, " in", false], [4712, 0.008804, " on", false], [30678, 0.008786, " down", false], [332, 0.005117, " a", false], [45, 0.003488, ",", false], [4419, 0.00209, " an", false]]]}, "raw_delta": -0.019694010416666668, "tuned_delta": 0.03439558699840892}, {"byte_start": 4884, "byte_end": 4889, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 837, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"model_a": "12.57% 12.57% 12.57% 12.57% 12.57%", "model_b": "10.88% 10.88% 10.88% 10.88% 10.88%"}, "model_tokens": {"model_a": [[31358, " make", "normal", 0.030505675822496414]], "model_b": [[31358, " make", "normal", 0.04907158389687538]]}, "loss": {"model_a": 12.567226332743704, "model_b": 10.87656808170195}, "topk": {"model_a": [31358, 5, 0.030505675822496414, [[46330, 0.081087, " invest", false], [22626, 0.051773, " try", false], [46960, 0.033906, " pursue", false], [22339, 0.033775, " put", false], [31358, 0.030506, " make", false], [31856, 0.027364, " rely", false], [39761, 0.024688, " spend", false], [4435, 0.023275, " be", false], [38530, 0.021599, " focus", false], [40166, 0.02144, " waste", false]]], "model_b": [31358, 2, 0.04907158389687538, [[38877, 0.088805, " learn", false], [31358, 0.049072, " make", false], [57328, 0.033485, " struggle", false], [22626, 0.032805, " try", false], [46330, 0.032463, " invest", false], [4491, 0.031343, " do", false], [47202, 0.030891, " search", false], [39761, 0.027957, " spend", false], [46960, 0.02547, " pursue", false], [37923, 0.022432, " build", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 4889, "byte_end": 4893, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 838, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.98% 11.98% 11.98% 11.98%", "model_b": "14.93% 14.93% 14.93% 14.93%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.0704706534743309]], "model_b": [[22590, " the", "normal", 0.03633382171392441]]}, "loss": {"model_a": 11.97549594487909, "model_b": 14.934147884202158}, "topk": {"model_a": [22590, 2, 0.0704706534743309, [[51566, 0.085147, " efforts", false], [22590, 0.070471, " the", false], [56950, 0.069084, " progress", false], [52224, 0.054982, " methods", false], [22681, 0.033814, " use", false], [56652, 0.033148, " mistakes", false], [57103, 0.028527, " research", false], [332, 0.021892, " a", false], [38961, 0.020088, " major", false], [22248, 0.019366, " our", false]]], "model_b": [22590, 4, 0.03633382171392441, [[56950, 0.150702, " progress", false], [56652, 0.101347, " mistakes", false], [22168, 0.051238, " new", false], [22590, 0.036334, " the", false], [31458, 0.027313, " more", false], [31118, 0.024028, " huge", false], [38629, 0.022104, " great", false], [22248, 0.017239, " our", false], [332, 0.016382, " a", false], [51566, 0.016092, " efforts", false]]]}, "raw_delta": -0.1640625, "tuned_delta": -0.10997290258492441}, {"byte_start": 4893, "byte_end": 4898, "display": {"text": " same", "kind": "normal"}, "is_word": true, "word_id": 839, "word_key": " same", "bytes_hex": "20 73 61 6d 65", "compression": {"model_a": "3.92% 3.92% 3.92% 3.92% 3.92%", "model_b": "3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"model_a": [[31937, " same", "normal", 0.3347090482711792]], "model_b": [[31937, " same", "normal", 0.37217479944229126]]}, "loss": {"model_a": 3.9166916149133963, "model_b": 3.5785599647050454}, "topk": {"model_a": [31937, 1, 0.3347090482711792, [[31937, 0.334709, " same", false], [52245, 0.240849, " mistake", false], [56652, 0.058142, " mistakes", false], [38720, 0.027209, " human", false], [62660, 0.017263, " transition", false], [45829, 0.016415, " effort", false], [38392, 0.0125, " error", false], [22221, 0.011733, " old", false], [45315, 0.009555, " bitter", false], [38841, 0.007034, " kinds", false]]], "model_b": [31937, 1, 0.37217479944229126, [[31937, 0.372175, " same", false], [56652, 0.147803, " mistakes", false], [52245, 0.042006, " mistake", false], [31461, 0.027574, " most", false], [38841, 0.018152, " kinds", false], [45829, 0.017456, " effort", false], [40229, 0.011643, " wrong", false], [47202, 0.008713, " search", false], [51039, 0.008367, " biggest", false], [38392, 0.007341, " error", false]]]}, "raw_delta": 0.018750000000000017, "tuned_delta": 0.0728395974150756}, {"byte_start": 4898, "byte_end": 4903, "display": {"text": " kind", "kind": "normal"}, "is_word": true, "word_id": 840, "word_key": " kind", "bytes_hex": "20 6b 69 6e 64", "compression": {"model_a": "18.15% 18.15% 18.15% 18.15% 18.15%", "model_b": "18.37% 18.37% 18.37% 18.37% 18.37%"}, "model_tokens": {"model_a": [[31214, " kind", "normal", 0.006520731840282679]], "model_b": [[31214, " kind", "normal", 0.006122685968875885]]}, "loss": {"model_a": 18.146398561181492, "model_b": 18.37181966132039}, "topk": {"model_a": [31214, 7, 0.006520731840282679, [[56652, 0.735291, " mistakes", false], [52245, 0.111483, " mistake", false], [38841, 0.024679, " kinds", false], [45888, 0.015524, " errors", false], [22221, 0.006977, " old", false], [39745, 0.00681, " sorts", false], [31214, 0.006521, " kind", false], [38392, 0.005356, " error", false], [37812, 0.004696, " basic", false], [21325, 0.004467, " bad", false]]], "model_b": [31214, 5, 0.006122685968875885, [[56652, 0.789385, " mistakes", false], [52245, 0.035274, " mistake", false], [38841, 0.02441, " kinds", false], [45888, 0.021584, " errors", false], [31214, 0.006123, " kind", false], [37812, 0.004997, " basic", false], [63591, 0.004106, " fundamental", false], [4440, 0.003681, " bl", false], [38392, 0.003463, " error", false], [45, 0.002984, ",", false]]]}, "raw_delta": -0.012499999999999956, "tuned_delta": 0.04158959741507563}, {"byte_start": 4903, "byte_end": 4906, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 841, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.03% 0.03% 0.03%", "model_b": "0.03% 0.03% 0.03%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9945980310440063]], "model_b": [[4706, " of", "normal", 0.9947562217712402]]}, "loss": {"model_a": 0.0326537726438186, "model_b": 0.03173653183921695}, "topk": {"model_a": [4706, 1, 0.9945980310440063, [[4706, 0.994598, " of", false], [56652, 0.00315, " mistakes", false], [45888, 0.000598, " errors", false], [45, 0.00014, ",", false], [46, 0.000104, "-", false], [275, 9.5e-05, " (", false], [51566, 8.9e-05, " efforts", false], [21265, 7.7e-05, " and", false], [52245, 6.1e-05, " mistake", false], [4715, 5.9e-05, " or", false]]], "model_b": [4706, 1, 0.9947562217712402, [[4706, 0.994756, " of", false], [56652, 0.001682, " mistakes", false], [45888, 0.000502, " errors", false], [46, 0.00038, "-", false], [21265, 0.00027, " and", false], [45, 0.000176, ",", false], [8579, 0.000153, "red", false], [7513, 0.000126, "est", false], [26151, 0.000102, "ling", false], [275, 9e-05, " (", false]]]}, "raw_delta": 5.086263020833348e-05, "tuned_delta": 0.054140460045283924}, {"byte_start": 4906, "byte_end": 4915, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 842, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"model_a": "1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01%", "model_b": "0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%"}, "model_tokens": {"model_a": [[56652, " mistakes", "normal", 0.6053490042686462]], "model_b": [[56652, " mistakes", "normal", 0.614142119884491]]}, "loss": {"model_a": 1.009698677705492, "model_b": 0.9666495092761881}, "topk": {"model_a": [56652, 1, 0.6053490042686462, [[56652, 0.605349, " mistakes", false], [52245, 0.041975, " mistake", false], [51566, 0.025594, " efforts", false], [45888, 0.024898, " errors", false], [57103, 0.021704, " research", false], [45829, 0.018067, " effort", false], [63678, 0.015487, " investments", false], [52224, 0.015085, " methods", false], [38392, 0.011439, " error", false], [38720, 0.011376, " human", false]]], "model_b": [56652, 1, 0.614142119884491, [[56652, 0.614142, " mistakes", false], [52245, 0.034786, " mistake", false], [56950, 0.032418, " progress", false], [45888, 0.030599, " errors", false], [57103, 0.011722, " research", false], [45829, 0.009187, " effort", false], [37862, 0.006944, " blind", false], [4440, 0.006197, " bl", false], [38392, 0.006025, " error", false], [51566, 0.005916, " efforts", false]]]}, "raw_delta": 0.002387152777777783, "tuned_delta": 0.05647675019285337}, {"byte_start": 4915, "byte_end": 4916, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "29.45%", "model_b": "20.71%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.19574415683746338]], "model_b": [[47, ".", "normal", 0.31922832131385803]]}, "loss": {"model_a": 29.445631205643878, "model_b": 20.710563575261485}, "topk": {"model_a": [47, 1, 0.19574415683746338, [[47, 0.195744, ".", false], [4596, 0.162787, " in", false], [31601, 0.138742, " over", false], [32227, 0.107937, " that", false], [45, 0.106589, ",", false], [4423, 0.057475, " as", false], [4858, 0.039757, " we", false], [37635, 0.023249, " again", false], [32487, 0.022469, " with", false], [4712, 0.011689, " on", false]]], "model_b": [47, 1, 0.31922832131385803, [[47, 0.319228, ".", false], [31601, 0.124298, " over", false], [45, 0.082858, ",", false], [4596, 0.077729, " in", false], [32227, 0.069499, " that", false], [4858, 0.051341, " we", false], [4423, 0.034066, " as", false], [32487, 0.026505, " with", false], [21265, 0.025062, " and", false], [37635, 0.013468, " again", false]]]}, "raw_delta": 0.484375, "tuned_delta": 0.5384645974150756}, {"byte_start": 4916, "byte_end": 4919, "display": {"text": " To", "kind": "normal"}, "is_word": true, "word_id": 843, "word_key": " to", "bytes_hex": "20 54 6f", "compression": {"model_a": "31.18% 31.18% 31.18%", "model_b": "29.49% 29.49% 29.49%"}, "model_tokens": {"model_a": [[4255, " To", "normal", 0.005641411058604717]], "model_b": [[4255, " To", "normal", 0.007396377623081207]]}, "loss": {"model_a": 31.183252185881237, "model_b": 29.492593934839483}, "topk": {"model_a": [4255, 27, 0.005641411058604717, [[4331, 0.134701, " We", false], [20996, 0.081061, " The", false], [261, 0.066953, "\n\n", false], [3913, 0.061582, " In", false], [19555, 0.053585, " But", false], [3918, 0.046274, " It", false], [37451, 0.045053, " There", false], [19907, 0.026815, " For", false], [29894, 0.023136, " This", false], [308, 0.020625, " I", false]]], "model_b": [4255, 23, 0.007396377623081207, [[4331, 0.130516, " We", false], [19555, 0.126163, " But", false], [20996, 0.086231, " The", false], [261, 0.05452, "\n\n", false], [3918, 0.049515, " It", false], [19417, 0.036525, " And", false], [3913, 0.031918, " In", false], [37451, 0.028469, " There", false], [29894, 0.024615, " This", false], [3908, 0.01714, " If", false]]]}, "raw_delta": 0.09375, "tuned_delta": 0.14783959741507557}, {"byte_start": 4919, "byte_end": 4923, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 844, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"model_a": "16.77% 16.77% 16.77% 16.77%", "model_b": "21.13% 21.13% 21.13% 21.13%"}, "model_tokens": {"model_a": [[22449, " see", "normal", 0.024376166984438896]], "model_b": [[22449, " see", "normal", 0.009082840755581856]]}, "loss": {"model_a": 16.765694322830726, "model_b": 21.133228138021924}, "topk": {"model_a": [22449, 10, 0.024376166984438896, [[4435, 0.099156, " be", false], [31358, 0.060039, " make", false], [32187, 0.040712, " take", false], [22590, 0.034171, " the", false], [21751, 0.032115, " get", false], [37786, 0.028702, " avoid", false], [62683, 0.027854, " understand", false], [4491, 0.026741, " do", false], [32074, 0.024892, " some", false], [22449, 0.024376, " see", false]]], "model_b": [22449, 18, 0.009082840755581856, [[4435, 0.098411, " be", false], [31358, 0.064955, " make", false], [38877, 0.054882, " learn", false], [37786, 0.046762, " avoid", false], [21751, 0.040256, " get", false], [4491, 0.035129, " do", false], [22590, 0.034387, " the", false], [51982, 0.024144, " improve", false], [32074, 0.019841, " some", false], [22339, 0.019763, " put", false]]]}, "raw_delta": -0.2421875, "tuned_delta": -0.18809790258492443}, {"byte_start": 4923, "byte_end": 4928, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 845, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "8.17% 8.17% 8.17% 8.17% 8.17%", "model_b": "8.23% 8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.10356917977333069]], "model_b": [[32234, " this", "normal", 0.10378582030534744]]}, "loss": {"model_a": 8.171514880035144, "model_b": 8.22787015506987}, "topk": {"model_a": [32234, 4, 0.10356917977333069, [[22590, 0.18071, " the", false], [22763, 0.165182, " why", false], [21835, 0.145519, " how", false], [32234, 0.103569, " this", false], [32464, 0.063456, " what", false], [4601, 0.061808, " it", false], [32227, 0.048837, " that", false], [332, 0.033685, " a", false], [4419, 0.01726, " an", false], [40185, 0.012608, " where", false]]], "model_b": [32234, 3, 0.10378582030534744, [[21835, 0.184012, " how", false], [22590, 0.167791, " the", false], [32234, 0.103786, " this", false], [32464, 0.072837, " what", false], [32227, 0.061716, " that", false], [4601, 0.044405, " it", false], [40185, 0.039136, " where", false], [332, 0.036233, " a", false], [4588, 0.033223, " if", false], [22763, 0.032183, " why", false]]]}, "raw_delta": -0.003124999999999989, "tuned_delta": 0.0509645974150756}, {"byte_start": 4928, "byte_end": 4929, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "13.38%", "model_b": "13.38%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.4706677496433258]], "model_b": [[45, ",", "normal", 0.4683462679386139]]}, "loss": {"model_a": 13.384377820747218, "model_b": 13.384377820747218}, "topk": {"model_a": [45, 1, 0.4706677496433258, [[45, 0.470668, ",", false], [46430, 0.121789, " lesson", false], [52427, 0.058859, " pattern", false], [4596, 0.052895, " in", false], [31458, 0.052536, " more", false], [51208, 0.042406, " clearly", false], [4423, 0.019694, " as", false], [4600, 0.010563, " is", false], [52245, 0.009951, " mistake", false], [31461, 0.008372, " most", false]]], "model_b": [45, 1, 0.4683462679386139, [[45, 0.468346, ",", false], [46430, 0.094982, " lesson", false], [4600, 0.057864, " is", false], [4596, 0.047043, " in", false], [51208, 0.0361, " clearly", false], [4858, 0.027298, " we", false], [52427, 0.019244, " pattern", false], [21700, 0.010541, " for", false], [31458, 0.00992, " more", false], [4423, 0.009323, " as", false]]]}, "raw_delta": 0.0, "tuned_delta": 0.05408959741507559}, {"byte_start": 4929, "byte_end": 4933, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 846, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "23.81% 23.81% 23.81% 23.81%", "model_b": "21.27% 21.27% 21.27% 21.27%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.005093383602797985]], "model_b": [[21265, " and", "normal", 0.008927552029490471]]}, "loss": {"model_a": 23.810103702171368, "model_b": 21.274116325608734}, "topk": {"model_a": [21265, 21, 0.005093383602797985, [[4601, 0.200636, " it", false], [4858, 0.164141, " we", false], [55832, 0.134672, " consider", false], [22001, 0.075261, " let", false], [22226, 0.072453, " one", false], [31324, 0.061285, " look", false], [31198, 0.038013, " just", false], [51250, 0.030382, " compare", false], [32187, 0.022115, " take", false], [308, 0.014481, " I", false]]], "model_b": [21265, 16, 0.008927552029490471, [[4858, 0.223276, " we", false], [55832, 0.139677, " consider", false], [31324, 0.131082, " look", false], [22001, 0.053526, " let", false], [4601, 0.052921, " it", false], [22226, 0.0445, " one", false], [31198, 0.043922, " just", false], [32187, 0.029859, " take", false], [39942, 0.023996, " think", false], [22799, 0.016037, " you", false]]]}, "raw_delta": 0.140625, "tuned_delta": 0.19471459741507557}, {"byte_start": 4933, "byte_end": 4936, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 847, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "3.36% 3.36% 3.36%", "model_b": "3.94% 3.94% 3.94%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.5713860392570496]], "model_b": [[4811, " to", "normal", 0.5181233286857605]]}, "loss": {"model_a": 3.357835137485705, "model_b": 3.9448692524307587}, "topk": {"model_a": [4811, 1, 0.5713860392570496, [[4811, 0.571386, " to", false], [22590, 0.063481, " the", false], [21835, 0.021663, " how", false], [38877, 0.020491, " learn", false], [22763, 0.018488, " why", false], [21902, 0.015733, " its", false], [30135, 0.014389, " also", false], [39193, 0.013611, " other", false], [22449, 0.012867, " see", false], [32464, 0.012248, " what", false]]], "model_b": [4811, 1, 0.5181233286857605, [[4811, 0.518123, " to", false], [22590, 0.061491, " the", false], [30135, 0.025626, " also", false], [62683, 0.022518, " understand", false], [46726, 0.017475, " others", false], [39193, 0.015963, " other", false], [52448, 0.01593, " perhaps", false], [31458, 0.01488, " more", false], [32464, 0.014475, " what", false], [38877, 0.013625, " learn", false]]]}, "raw_delta": -0.03255208333333334, "tuned_delta": 0.021537514081742246}, {"byte_start": 4936, "byte_end": 4948, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 848, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"model_a": "13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34%", "model_b": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50%"}, "model_tokens": {"model_a": [[63507, " effectively", "normal", 0.00013784487964585423]], "model_b": [[63507, " effectively", "normal", 3.1913514249026775e-05]]}, "loss": {"model_a": 13.337415091551614, "model_b": 15.49770063454941}, "topk": {"model_a": [63507, 303, 0.00013784487964585423, [[22449, 0.225273, " see", false], [62683, 0.158171, " understand", false], [38877, 0.087, " learn", false], [37786, 0.046839, " avoid", false], [61588, 0.041666, " appreciate", false], [21751, 0.03552, " get", false], [4435, 0.029543, " be", false], [31358, 0.026092, " make", false], [52653, 0.012859, " realize", false], [22626, 0.012111, " try", false]]], "model_b": [63507, 823, 3.1913514249026775e-05, [[22449, 0.16467, " see", false], [62683, 0.158266, " understand", false], [38877, 0.073291, " learn", false], [61588, 0.032785, " appreciate", false], [21751, 0.03003, " get", false], [4435, 0.024383, " be", false], [32187, 0.018885, " take", false], [31358, 0.018722, " make", false], [31223, 0.017019, " know", false], [37786, 0.016514, " avoid", false]]]}, "raw_delta": -0.11979166666666659, "tuned_delta": -0.065702069251591}, {"byte_start": 4948, "byte_end": 4955, "display": {"text": " resist", "kind": "normal"}, "is_word": true, "word_id": 849, "word_key": " resist", "bytes_hex": "20 72 65 73 69 73 74", "compression": {"model_a": "15.14% 15.14% 15.14% 15.14% 15.14% 15.14% 15.14%", "model_b": "19.48% 19.48% 19.48% 19.48% 19.48% 19.48% 19.48%"}, "model_tokens": {"model_a": [[47087, " resist", "normal", 0.0028409697115421295]], "model_b": [[47087, " resist", "normal", 0.0005201094318181276]]}, "loss": {"model_a": 15.135416723611891, "model_b": 19.48282365486211}, "topk": {"model_a": [47087, 42, 0.0028409697115421295, [[38877, 0.119497, " learn", false], [37730, 0.104816, " apply", false], [37786, 0.085516, " avoid", false], [22681, 0.059306, " use", false], [51336, 0.03759, " counter", false], [50855, 0.031638, " address", false], [56540, 0.030998, " leverage", false], [32187, 0.024057, " take", false], [31358, 0.020605, " make", false], [45522, 0.019548, " combat", false]]], "model_b": [47087, 198, 0.0005201094318181276, [[38877, 0.100315, " learn", false], [37730, 0.09169, " apply", false], [22681, 0.073556, " use", false], [56540, 0.052636, " leverage", false], [50855, 0.043503, " address", false], [37786, 0.027812, " avoid", false], [45450, 0.015833, " change", false], [31358, 0.015264, " make", false], [32187, 0.014889, " take", false], [51903, 0.014714, " harness", false]]]}, "raw_delta": -0.24107142857142844, "tuned_delta": -0.18698183115635286}, {"byte_start": 4955, "byte_end": 4958, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 850, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "13.24% 13.24% 13.24%", "model_b": "7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.10896933078765869]], "model_b": [[4601, " it", "normal", 0.26866498589515686]]}, "loss": {"model_a": 13.243489633160404, "model_b": 7.889738504861517}, "topk": {"model_a": [4601, 2, 0.10896933078765869, [[22590, 0.456799, " the", false], [4601, 0.108969, " it", false], [32234, 0.092467, " this", false], [46500, 0.056916, " making", false], [39936, 0.042893, " these", false], [39944, 0.017961, " those", false], [60384, 0.017759, " repeating", false], [32227, 0.017459, " that", false], [332, 0.011967, " a", false], [51709, 0.011382, " falling", false]]], "model_b": [4601, 2, 0.26866498589515686, [[22590, 0.318319, " the", false], [4601, 0.268665, " it", false], [32229, 0.072165, " them", false], [21902, 0.035101, " its", false], [32234, 0.028133, " this", false], [332, 0.019004, " a", false], [39936, 0.017411, " these", false], [39944, 0.013989, " those", false], [32139, 0.012486, " such", false], [51816, 0.012232, " further", false]]]}, "raw_delta": 0.296875, "tuned_delta": 0.3509645974150756}, {"byte_start": 4958, "byte_end": 4959, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "0.99%", "model_b": "2.17%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9466332197189331]], "model_b": [[45, ",", "normal", 0.8876431584358215]]}, "loss": {"model_a": 0.9862173131076897, "model_b": 2.1661558841472472}, "topk": {"model_a": [45, 1, 0.9466332197189331, [[45, 0.946633, ",", false], [4596, 0.017383, " in", false], [275, 0.004334, " (", false], [4423, 0.003516, " as", false], [32465, 0.003453, " when", false], [37635, 0.001884, " again", false], [4600, 0.001832, " is", false], [5346, 0.001451, "---", false], [21265, 0.001444, " and", false], [38606, 0.001085, " going", false]]], "model_b": [45, 1, 0.8876431584358215, [[45, 0.887643, ",", false], [4596, 0.025394, " in", false], [4600, 0.021765, " is", false], [5346, 0.021735, "---", false], [57102, 0.004313, " requires", false], [4423, 0.00367, " as", false], [21265, 0.003373, " and", false], [275, 0.003179, " (", false], [21700, 0.003031, " for", false], [32465, 0.002071, " when", false]]]}, "raw_delta": -0.0654296875, "tuned_delta": -0.011340090084924412}, {"byte_start": 4959, "byte_end": 4962, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 851, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "5.24% 5.24% 5.24%", "model_b": "2.74% 2.74% 2.74%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.4178939163684845]], "model_b": [[4858, " we", "normal", 0.6350927352905273]]}, "loss": {"model_a": 5.236344305309876, "model_b": 2.735578975643949}, "topk": {"model_a": [4858, 1, 0.4178939163684845, [[4858, 0.417894, " we", false], [4601, 0.204802, " it", false], [22226, 0.090999, " one", false], [4600, 0.042974, " is", false], [57102, 0.038263, " requires", false], [22590, 0.028853, " the", false], [22799, 0.022359, " you", false], [308, 0.020666, " I", false], [332, 0.015554, " a", false], [22001, 0.011749, " let", false]]], "model_b": [4858, 1, 0.6350927352905273, [[4858, 0.635093, " we", false], [4600, 0.077392, " is", false], [4601, 0.033292, " it", false], [22226, 0.033215, " one", false], [22590, 0.023954, " the", false], [22799, 0.014503, " you", false], [39934, 0.012796, " there", false], [332, 0.011612, " a", false], [21256, 0.009899, " all", false], [57102, 0.009593, " requires", false]]]}, "raw_delta": 0.13867187499999997, "tuned_delta": 0.19276147241507557}, {"byte_start": 4962, "byte_end": 4967, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 852, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "10.09% 10.09% 10.09% 10.09% 10.09%", "model_b": "9.35% 9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.06028171628713608]], "model_b": [[31059, " have", "normal", 0.07308510690927505]]}, "loss": {"model_a": 10.087594231215798, "model_b": 9.354975655764372}, "topk": {"model_a": [31059, 4, 0.06028171628713608, [[31506, 0.592673, " need", false], [31475, 0.151163, " must", false], [47266, 0.062411, " should", false], [31059, 0.060282, " have", false], [21413, 0.039595, " can", false], [32475, 0.0155, " will", false], [38499, 0.011462, " first", false], [40219, 0.006171, " would", false], [39021, 0.005365, " might", false], [22074, 0.005097, " may", false]]], "model_b": [31059, 3, 0.07308510690927505, [[31506, 0.552233, " need", false], [31475, 0.228827, " must", false], [31059, 0.073085, " have", false], [47266, 0.036759, " should", false], [32475, 0.03217, " will", false], [38499, 0.012193, " first", false], [21413, 0.009301, " can", false], [21286, 0.006594, " are", false], [21256, 0.006501, " all", false], [40219, 0.003835, " would", false]]]}, "raw_delta": 0.04062499999999991, "tuned_delta": 0.0947145974150755}, {"byte_start": 4967, "byte_end": 4970, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 853, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.45% 0.45% 0.45%", "model_b": "1.31% 1.31% 1.31%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.928294837474823]], "model_b": [[4811, " to", "normal", 0.8038654923439026]]}, "loss": {"model_a": 0.44614592735824055, "model_b": 1.3149564174769197}, "topk": {"model_a": [4811, 1, 0.928294837474823, [[4811, 0.928295, " to", false], [31581, 0.01285, " only", false], [332, 0.010268, " a", false], [22638, 0.004383, " two", false], [32074, 0.001995, " some", false], [22590, 0.0017, " the", false], [4419, 0.001557, " an", false], [39946, 0.00145, " three", false], [30259, 0.001226, " been", false], [38499, 0.001074, " first", false]]], "model_b": [4811, 1, 0.8038654923439026, [[4811, 0.803865, " to", false], [332, 0.040013, " a", false], [22638, 0.023451, " two", false], [39946, 0.012727, " three", false], [31581, 0.009976, " only", false], [22590, 0.008279, " the", false], [21772, 0.006679, " got", false], [4419, 0.005236, " an", false], [22187, 0.00467, " not", false], [30259, 0.004405, " been", false]]]}, "raw_delta": -0.04817708333333334, "tuned_delta": 0.005912514081742246}, {"byte_start": 4970, "byte_end": 4981, "display": {"text": " understand", "kind": "normal"}, "is_word": true, "word_id": 854, "word_key": " understand", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64", "compression": {"model_a": "3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23%", "model_b": "4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07%"}, "model_tokens": {"model_a": [[62683, " understand", "normal", 0.1398772895336151]], "model_b": [[62683, " understand", "normal", 0.08320644497871399]]}, "loss": {"model_a": 3.2276202974433486, "model_b": 4.072949422964226}, "topk": {"model_a": [62683, 1, 0.1398772895336151, [[62683, 0.139877, " understand", false], [4435, 0.068481, " be", false], [31324, 0.067404, " look", false], [38877, 0.032759, " learn", false], [60335, 0.030881, " recognize", false], [21295, 0.02982, " ask", false], [31059, 0.029113, " have", false], [39942, 0.026514, " think", false], [22449, 0.026296, " see", false], [31205, 0.026092, " keep", false]]], "model_b": [62683, 1, 0.08320644497871399, [[62683, 0.083206, " understand", false], [38877, 0.081346, " learn", false], [4435, 0.078016, " be", false], [31324, 0.046975, " look", false], [31358, 0.029488, " make", false], [32187, 0.025072, " take", false], [22449, 0.02335, " see", false], [31059, 0.023162, " have", false], [31205, 0.020448, " keep", false], [4491, 0.018379, " do", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 4981, "byte_end": 4985, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 855, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.39% 5.39% 5.39% 5.39%", "model_b": "5.46% 5.46% 5.46% 5.46%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.30333784222602844]], "model_b": [[22590, " the", "normal", 0.29525914788246155]]}, "loss": {"model_a": 5.3889731751955905, "model_b": 5.459417268988997}, "topk": {"model_a": [22590, 1, 0.30333784222602844, [[22590, 0.303338, " the", false], [32464, 0.13074, " what", false], [22763, 0.109415, " why", false], [4601, 0.106478, " it", false], [21835, 0.086119, " how", false], [32227, 0.026279, " that", false], [21902, 0.019398, " its", false], [332, 0.01811, " a", false], [21265, 0.016685, " and", false], [51665, 0.014394, " exactly", false]]], "model_b": [22590, 1, 0.29525914788246155, [[22590, 0.295259, " the", false], [4601, 0.094833, " it", false], [32464, 0.093145, " what", false], [21835, 0.082463, " how", false], [32227, 0.072779, " that", false], [22763, 0.072283, " why", false], [21902, 0.039473, " its", false], [32234, 0.03504, " this", false], [21265, 0.021879, " and", false], [40185, 0.015124, " where", false]]]}, "raw_delta": -0.00390625, "tuned_delta": 0.05018334741507559}, {"byte_start": 4985, "byte_end": 4992, "display": {"text": " appeal", "kind": "normal"}, "is_word": true, "word_id": 856, "word_key": " appeal", "bytes_hex": "20 61 70 70 65 61 6c", "compression": {"model_a": "20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77%", "model_b": "23.83% 23.83% 23.83% 23.83% 23.83% 23.83% 23.83%"}, "model_tokens": {"model_a": [[45184, " appeal", "normal", 0.0003196117759216577]], "model_b": [[45184, " appeal", "normal", 9.380631672684103e-05]]}, "loss": {"model_a": 20.770944227084403, "model_b": 23.83023058611234}, "topk": {"model_a": [45184, 292, 0.0003196117759216577, [[46642, 0.095806, " nature", false], [46430, 0.050476, " lesson", false], [52127, 0.03419, " lessons", false], [51929, 0.030761, " history", false], [52654, 0.028853, " reasons", false], [51832, 0.024896, " general", false], [37812, 0.024573, " basic", false], [62680, 0.02384, " underlying", false], [62418, 0.023291, " psychology", false], [52427, 0.018902, " pattern", false]]], "model_b": [45184, 685, 9.380631672684103e-05, [[46642, 0.062022, " nature", false], [52127, 0.046621, " lessons", false], [51929, 0.045488, " history", false], [51832, 0.043688, " general", false], [21357, 0.040638, " big", false], [63591, 0.026475, " fundamental", false], [37812, 0.023251, " basic", false], [62680, 0.021589, " underlying", false], [46430, 0.017957, " lesson", false], [31894, 0.015559, " role", false]]]}, "raw_delta": -0.1696428571428572, "tuned_delta": -0.11555325972778162}, {"byte_start": 4992, "byte_end": 4995, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 857, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.87% 0.87% 0.87%", "model_b": "1.09% 1.09% 1.09%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8628022074699402]], "model_b": [[4706, " of", "normal", 0.8330783843994141]]}, "loss": {"model_a": 0.8746808312681296, "model_b": 1.0918834537977993}, "topk": {"model_a": [4706, 1, 0.8628022074699402, [[4706, 0.862802, " of", false], [4811, 0.039641, " to", false], [21265, 0.036568, " and", false], [32227, 0.016825, " that", false], [45, 0.013967, ",", false], [21700, 0.004149, " for", false], [47, 0.004116, ".", false], [5346, 0.003409, "---", false], [4601, 0.00203, " it", false], [4858, 0.001565, " we", false]]], "model_b": [4706, 1, 0.8330783843994141, [[4706, 0.833078, " of", false], [21265, 0.070195, " and", false], [32227, 0.029912, " that", false], [4811, 0.017513, " to", false], [45, 0.010267, ",", false], [4858, 0.004138, " we", false], [275, 0.003149, " (", false], [21700, 0.002807, " for", false], [4601, 0.002431, " it", false], [4596, 0.002057, " in", false]]]}, "raw_delta": -0.012044270833333336, "tuned_delta": 0.04204532658174225}, {"byte_start": 4995, "byte_end": 5001, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 858, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%", "model_b": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.04402855783700943]], "model_b": [[39936, " these", "normal", 0.06200062483549118]]}, "loss": {"model_a": 9.392545839120855, "model_b": 8.359365796817562}, "topk": {"model_a": [39936, 4, 0.04402855783700943, [[22590, 0.314405, " the", false], [38720, 0.228851, " human", false], [52224, 0.077048, " methods", false], [39936, 0.044029, " these", false], [22248, 0.018348, " our", false], [32234, 0.013944, " this", false], [332, 0.012823, " a", false], [47629, 0.012164, " trying", false], [61590, 0.010988, " approaches", false], [57103, 0.010512, " research", false]]], "model_b": [39936, 3, 0.06200062483549118, [[38720, 0.180967, " human", false], [22590, 0.179702, " the", false], [39936, 0.062001, " these", false], [51832, 0.04402, " general", false], [22248, 0.037848, " our", false], [52224, 0.023493, " methods", false], [332, 0.018763, " a", false], [32234, 0.016698, " this", false], [61590, 0.015134, " approaches", false], [47202, 0.012754, " search", false]]]}, "raw_delta": 0.057291666666666685, "tuned_delta": 0.11138126408174227}, {"byte_start": 5001, "byte_end": 5010, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 859, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"model_a": "12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90%", "model_b": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90%"}, "model_tokens": {"model_a": [[56652, " mistakes", "normal", 0.0015993948327377439]], "model_b": [[56652, " mistakes", "normal", 0.004365015774965286]]}, "loss": {"model_a": 12.899096285725975, "model_b": 10.89535317338019}, "topk": {"model_a": [56652, 46, 0.0015993948327377439, [[38720, 0.193543, " human", false], [39193, 0.121086, " other", false], [52224, 0.072802, " methods", false], [22221, 0.069215, " old", false], [39174, 0.066841, " older", false], [51551, 0.065484, " earlier", false], [63277, 0.037843, " alternative", false], [61590, 0.034219, " approaches", false], [38841, 0.024445, " kinds", false], [52964, 0.019217, " special", false]]], "model_b": [56652, 24, 0.004365015774965286, [[52224, 0.142379, " methods", false], [38720, 0.107792, " human", false], [61590, 0.1012, " approaches", false], [52964, 0.066832, " special", false], [51832, 0.058479, " general", false], [38841, 0.051975, " kinds", false], [22638, 0.026677, " two", false], [59513, 0.016836, " different", false], [62293, 0.014113, " particular", false], [56832, 0.014077, " patterns", false]]]}, "raw_delta": 0.11111111111111116, "tuned_delta": 0.16520070852618673}, {"byte_start": 5010, "byte_end": 5011, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "12.89%", "model_b": "16.06%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.4857923090457916]], "model_b": [[47, ".", "normal", 0.4106141924858093]]}, "loss": {"model_a": 12.891269164193373, "model_b": 16.061253384896663}, "topk": {"model_a": [47, 1, 0.4857923090457916, [[47, 0.485792, ".", false], [45, 0.262081, ",", false], [21265, 0.14136, " and", false], [4811, 0.021574, " to", false], [5346, 0.019084, "---", false], [4596, 0.017449, " in", false], [21700, 0.006586, " for", false], [59, 0.005962, ":", false], [4423, 0.005793, " as", false], [60, 0.004013, ";", false]]], "model_b": [47, 1, 0.4106141924858093, [[47, 0.410614, ".", false], [45, 0.249173, ",", false], [21265, 0.186577, " and", false], [4811, 0.032177, " to", false], [4596, 0.026834, " in", false], [5346, 0.016433, "---", false], [59, 0.012205, ":", false], [4423, 0.008302, " as", false], [21700, 0.008262, " for", false], [275, 0.006206, " (", false]]]}, "raw_delta": -0.17578125, "tuned_delta": -0.12169165258492441}, {"byte_start": 5011, "byte_end": 5014, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 860, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"model_a": "17.47% 17.47% 17.47%", "model_b": "14.75% 14.75% 14.75%"}, "model_tokens": {"model_a": [[4331, " We", "normal", 0.054759811609983444]], "model_b": [[4331, " We", "normal", 0.08745554089546204]]}, "loss": {"model_a": 17.47013526076479, "model_b": 14.746296967419742}, "topk": {"model_a": [4331, 3, 0.054759811609983444, [[261, 0.395245, "\n\n", false], [20996, 0.077614, " The", false], [4331, 0.05476, " We", false], [3913, 0.027977, " In", false], [29893, 0.024518, " They", false], [3918, 0.024238, " It", false], [37451, 0.022188, " There", false], [21152, 0.021068, " Why", false], [4255, 0.01825, " To", false], [19417, 0.018046, " And", false]]], "model_b": [4331, 3, 0.08745554089546204, [[261, 0.149922, "\n\n", false], [20996, 0.095608, " The", false], [4331, 0.087456, " We", false], [29893, 0.051478, " They", false], [3918, 0.04088, " It", false], [3913, 0.03684, " In", false], [11, 0.030137, "\n", false], [19417, 0.026097, " And", false], [29894, 0.02532, " This", false], [4255, 0.023046, " To", false]]]}, "raw_delta": 0.15104166666666663, "tuned_delta": 0.2051312640817422}, {"byte_start": 5014, "byte_end": 5019, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 861, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "4.17% 4.17% 4.17% 4.17% 4.17%", "model_b": "4.40% 4.40% 4.40% 4.40% 4.40%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.3120371997356415]], "model_b": [[31059, " have", "normal", 0.29344964027404785]]}, "loss": {"model_a": 4.170290352569659, "model_b": 4.39571145270856}, "topk": {"model_a": [31059, 1, 0.3120371997356415, [[31059, 0.312037, " have", false], [31506, 0.105877, " need", false], [21413, 0.104254, " can", false], [32475, 0.072976, " will", false], [31475, 0.061082, " must", false], [21286, 0.043713, " are", false], [47266, 0.030198, " should", false], [30135, 0.02125, " also", false], [4491, 0.015971, " do", false], [31223, 0.011014, " know", false]]], "model_b": [31059, 1, 0.29344964027404785, [[31059, 0.29345, " have", false], [31506, 0.21561, " need", false], [31475, 0.131209, " must", false], [21413, 0.058895, " can", false], [47266, 0.042451, " should", false], [21286, 0.037785, " are", false], [32475, 0.030765, " will", false], [30135, 0.017338, " also", false], [4491, 0.013525, " do", false], [45409, 0.013315, " cannot", false]]]}, "raw_delta": -0.012499999999999983, "tuned_delta": 0.041589597415075605}, {"byte_start": 5019, "byte_end": 5022, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 862, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.97% 0.97% 0.97%", "model_b": "1.50% 1.50% 1.50%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8508479595184326]], "model_b": [[4811, " to", "normal", 0.7797873020172119]]}, "loss": {"model_a": 0.9686062896593381, "model_b": 1.5028073342593367}, "topk": {"model_a": [4811, 1, 0.8508479595184326, [[4811, 0.850848, " to", false], [332, 0.01689, " a", false], [31968, 0.012974, " seen", false], [50888, 0.009887, " already", false], [30259, 0.006838, " been", false], [30135, 0.006364, " also", false], [22590, 0.004833, " the", false], [21256, 0.004547, " all", false], [22638, 0.003885, " two", false], [4419, 0.003203, " an", false]]], "model_b": [4811, 1, 0.7797873020172119, [[4811, 0.779787, " to", false], [22187, 0.03495, " not", false], [332, 0.024667, " a", false], [30259, 0.014671, " been", false], [50888, 0.012498, " already", false], [31968, 0.012376, " seen", false], [52112, 0.010977, " learned", false], [4419, 0.006323, " an", false], [22590, 0.005337, " the", false], [30135, 0.004884, " also", false]]]}, "raw_delta": -0.02962239583333333, "tuned_delta": 0.02446720158174226}, {"byte_start": 5022, "byte_end": 5028, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 863, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"model_a": "12.77% 12.77% 12.77% 12.77% 12.77% 12.77%", "model_b": "9.96% 9.96% 9.96% 9.96% 9.96% 9.96%"}, "model_tokens": {"model_a": [[38877, " learn", "normal", 0.014352542348206043]], "model_b": [[38877, " learn", "normal", 0.03632981330156326]]}, "loss": {"model_a": 12.773862341204364, "model_b": 9.956098589468107}, "topk": {"model_a": [38877, 6, 0.014352542348206043, [[62683, 0.66888, " understand", false], [22449, 0.067032, " see", false], [21295, 0.023327, " ask", false], [4435, 0.022155, " be", false], [31223, 0.01982, " know", false], [38877, 0.014353, " learn", false], [60335, 0.014054, " recognize", false], [31324, 0.009366, " look", false], [52653, 0.008152, " realize", false], [61588, 0.008049, " appreciate", false]]], "model_b": [38877, 3, 0.03632981330156326, [[62683, 0.440481, " understand", false], [22449, 0.090168, " see", false], [38877, 0.03633, " learn", false], [4435, 0.0356, " be", false], [60335, 0.031771, " recognize", false], [31324, 0.025747, " look", false], [52653, 0.01924, " realize", false], [61588, 0.017052, " appreciate", false], [31223, 0.016822, " know", false], [21295, 0.014445, " ask", false]]]}, "raw_delta": 0.15625, "tuned_delta": 0.21033959741507557}, {"byte_start": 5028, "byte_end": 5032, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 864, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "9.72% 9.72% 9.72% 9.72%", "model_b": "10.28% 10.28% 10.28% 10.28%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.11565075069665909]], "model_b": [[22590, " the", "normal", 0.10198646038770676]]}, "loss": {"model_a": 9.721284943490085, "model_b": 10.284837693837336}, "topk": {"model_a": [22590, 3, 0.11565075069665909, [[4811, 0.235363, " to", false], [22763, 0.144022, " why", false], [22590, 0.115651, " the", false], [21835, 0.103323, " how", false], [32464, 0.080975, " what", false], [30917, 0.060809, " from", false], [37598, 0.044134, " about", false], [32227, 0.039768, " that", false], [22187, 0.019824, " not", false], [45, 0.014333, ",", false]]], "model_b": [22590, 4, 0.10198646038770676, [[32227, 0.248917, " that", false], [4811, 0.123651, " to", false], [30917, 0.116052, " from", false], [22590, 0.101986, " the", false], [21835, 0.091853, " how", false], [22763, 0.070308, " why", false], [32464, 0.039529, " what", false], [22187, 0.020869, " not", false], [37598, 0.019821, " about", false], [45, 0.014048, ",", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 5032, "byte_end": 5039, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 865, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "5.84% 5.84% 5.84% 5.84% 5.84% 5.84% 5.84%", "model_b": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.10421230643987656]], "model_b": [[45315, " bitter", "normal", 0.005056930240243673]]}, "loss": {"model_a": 5.836796342882247, "model_b": 13.605773544097923}, "topk": {"model_a": [45315, 3, 0.10421230643987656, [[46430, 0.132265, " lesson", false], [52127, 0.115146, " lessons", false], [45315, 0.104212, " bitter", false], [52654, 0.052029, " reasons", false], [62418, 0.025685, " psychology", false], [51929, 0.021571, " history", false], [46642, 0.013865, " nature", false], [64997, 0.013822, " psychological", false], [39831, 0.012239, " story", false], [51832, 0.012164, " general", false]]], "model_b": [45315, 24, 0.005056930240243673, [[52127, 0.277837, " lessons", false], [46430, 0.146436, " lesson", false], [40093, 0.028719, " value", false], [45184, 0.017779, " appeal", false], [61863, 0.013022, " difference", false], [21357, 0.012425, " big", false], [51929, 0.011917, " history", false], [40029, 0.010525, " truth", false], [52427, 0.008351, " pattern", false], [52654, 0.008336, " reasons", false]]]}, "raw_delta": -0.4308035714285713, "tuned_delta": -0.3767139740134957}, {"byte_start": 5039, "byte_end": 5046, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 866, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "1.09% 1.09% 1.09% 1.09% 1.09% 1.09% 1.09%", "model_b": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.657513439655304]], "model_b": [[46430, " lesson", "normal", 0.8061118125915527]]}, "loss": {"model_a": 1.086851732812556, "model_b": 0.5560051688693864}, "topk": {"model_a": [46430, 1, 0.657513439655304, [[46430, 0.657513, " lesson", false], [52127, 0.284651, " lessons", false], [45, 0.010466, ",", false], [7513, 0.006494, "est", false], [40029, 0.004498, " truth", false], [39899, 0.004173, " taste", false], [21265, 0.003299, " and", false], [46, 0.002331, "-", false], [39831, 0.001557, " story", false], [47009, 0.000994, " reason", false]]], "model_b": [46430, 1, 0.8061118125915527, [[46430, 0.806112, " lesson", false], [52127, 0.119506, " lessons", false], [39899, 0.011993, " taste", false], [46, 0.007919, "-", false], [40029, 0.005562, " truth", false], [7513, 0.004391, "est", false], [45, 0.004267, ",", false], [31683, 0.00214, " pill", false], [21265, 0.001453, " and", false], [61979, 0.001439, " experience", false]]]}, "raw_delta": 0.029436383928571428, "tuned_delta": 0.08352598134364701}, {"byte_start": 5046, "byte_end": 5051, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 867, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "9.07% 9.07% 9.07% 9.07% 9.07%", "model_b": "4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.07928112149238586]], "model_b": [[32227, " that", "normal", 0.2505127191543579]]}, "loss": {"model_a": 9.073199280590746, "model_b": 4.959264203055811}, "topk": {"model_a": [32227, 5, 0.07928112149238586, [[47, 0.258066, ".", false], [4706, 0.171253, " of", false], [45, 0.126456, ",", false], [21265, 0.081146, " and", false], [32227, 0.079281, " that", false], [59, 0.034091, ":", false], [4596, 0.02317, " in", false], [32458, 0.021089, " well", false], [5346, 0.019392, "---", false], [30917, 0.0171, " from", false]]], "model_b": [32227, 1, 0.2505127191543579, [[32227, 0.250513, " that", false], [47, 0.18129, ".", false], [4706, 0.14123, " of", false], [45, 0.134943, ",", false], [21265, 0.059613, " and", false], [4450, 0.036807, " by", false], [4596, 0.018782, " in", false], [37598, 0.018312, " about", false], [30917, 0.011599, " from", false], [4788, 0.010439, " so", false]]]}, "raw_delta": 0.228125, "tuned_delta": 0.2822145974150756}, {"byte_start": 5051, "byte_end": 5060, "display": {"text": " building", "kind": "normal"}, "is_word": true, "word_id": 868, "word_key": " building", "bytes_hex": "20 62 75 69 6c 64 69 6e 67", "compression": {"model_a": "20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16%", "model_b": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%"}, "model_tokens": {"model_a": [[55666, " building", "normal", 4.278751293895766e-05]], "model_b": [[55666, " building", "normal", 0.001178168342448771]]}, "loss": {"model_a": 20.162665067979436, "model_b": 13.52526600833403}, "topk": {"model_a": [55666, 749, 4.278751293895766e-05, [[22590, 0.094302, " the", false], [4858, 0.088073, " we", false], [63370, 0.064448, " computation", false], [51832, 0.053794, " general", false], [52195, 0.052991, " massive", false], [47202, 0.049379, " search", false], [45, 0.046746, ",", false], [4601, 0.035439, " it", false], [37045, 0.026211, " Moore", false], [39936, 0.020011, " these", false]]], "model_b": [55666, 96, 0.001178168342448771, [[22590, 0.110835, " the", false], [52195, 0.061399, " massive", false], [39936, 0.043393, " these", false], [51832, 0.038756, " general", false], [45, 0.035468, ",", false], [4858, 0.03341, " we", false], [39934, 0.028027, " there", false], [32465, 0.024091, " when", false], [32232, 0.018795, " they", false], [4600, 0.018325, " is", false]]]}, "raw_delta": 0.3680555555555556, "tuned_delta": 0.42214515297063115}, {"byte_start": 5060, "byte_end": 5063, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 869, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "28.74% 28.74% 28.74%", "model_b": "35.32% 35.32% 35.32%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.008279256522655487]], "model_b": [[4596, " in", "normal", 0.0028462193440645933]]}, "loss": {"model_a": 28.741190267709815, "model_b": 35.31597235509441}, "topk": {"model_a": [4596, 16, 0.008279256522655487, [[52224, 0.157471, " methods", false], [53087, 0.139396, " systems", false], [332, 0.113857, " a", false], [4712, 0.054041, " on", false], [38720, 0.04874, " human", false], [22248, 0.045829, " our", false], [3609, 0.031711, " AI", false], [51832, 0.031, " general", false], [22590, 0.020907, " the", false], [47202, 0.017241, " search", false]]], "model_b": [4596, 52, 0.0028462193440645933, [[332, 0.132513, " a", false], [51832, 0.063713, " general", false], [53087, 0.059398, " systems", false], [3609, 0.043854, " AI", false], [52224, 0.042292, " methods", false], [52195, 0.035333, " massive", false], [4712, 0.033505, " on", false], [38864, 0.03234, " large", false], [4419, 0.031237, " an", false], [45301, 0.023538, " better", false]]]}, "raw_delta": -0.36458333333333326, "tuned_delta": -0.3104937359182577}, {"byte_start": 5063, "byte_end": 5067, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 870, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"model_a": "41.14% 41.14% 41.14% 41.14%", "model_b": "42.83% 42.83% 42.83% 42.83%"}, "model_tokens": {"model_a": [[21835, " how", "normal", 0.00010841196490218863]], "model_b": [[21835, " how", "normal", 7.234295480884612e-05]]}, "loss": {"model_a": 41.13935077534934, "model_b": 42.830009026391096}, "topk": {"model_a": [21835, 259, 0.00010841196490218863, [[38720, 0.438515, " human", false], [22248, 0.067943, " our", false], [22590, 0.053666, " the", false], [52195, 0.038905, " massive", false], [332, 0.032204, " a", false], [59943, 0.028475, " knowledge", false], [51832, 0.027865, " general", false], [47202, 0.016437, " search", false], [31458, 0.013131, " more", false], [21256, 0.011241, " all", false]]], "model_b": [21835, 513, 7.234295480884612e-05, [[38720, 0.240491, " human", false], [51832, 0.098882, " general", false], [31458, 0.059464, " more", false], [52195, 0.047187, " massive", false], [22590, 0.036613, " the", false], [332, 0.03222, " a", false], [63370, 0.029948, " computation", false], [59943, 0.029572, " knowledge", false], [38864, 0.018932, " large", false], [64862, 0.013895, " computational", false]]]}, "raw_delta": -0.09375, "tuned_delta": -0.03966040258492441}, {"byte_start": 5067, "byte_end": 5070, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 871, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "7.61% 7.61% 7.61%", "model_b": "11.74% 11.74% 11.74%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.28450843691825867]], "model_b": [[4858, " we", "normal", 0.1433609127998352]]}, "loss": {"model_a": 7.607962129687892, "model_b": 11.740682298901067}, "topk": {"model_a": [4858, 1, 0.28450843691825867, [[4858, 0.284508, " we", false], [46227, 0.172225, " humans", false], [46787, 0.076883, " people", false], [22590, 0.06279, " the", false], [4811, 0.061105, " to", false], [22248, 0.060481, " our", false], [38720, 0.056891, " human", false], [332, 0.045204, " a", false], [22226, 0.030347, " one", false], [22799, 0.024038, " you", false]]], "model_b": [4858, 1, 0.1433609127998352, [[4858, 0.143361, " we", false], [4811, 0.129897, " to", false], [31466, 0.092133, " much", false], [22590, 0.084648, " the", false], [47539, 0.063606, " things", false], [46227, 0.040393, " humans", false], [332, 0.03939, " a", false], [22799, 0.031403, " you", false], [63370, 0.0296, " computation", false], [38720, 0.028084, " human", false]]]}, "raw_delta": -0.22916666666666663, "tuned_delta": -0.17507706925159106}, {"byte_start": 5070, "byte_end": 5076, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 872, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "2.14% 2.14% 2.14% 2.14% 2.14% 2.14%", "model_b": "5.12% 5.12% 5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.4875118136405945]], "model_b": [[39942, " think", "normal", 0.1816624402999878]]}, "loss": {"model_a": 2.1368041783999945, "model_b": 5.118937482320866}, "topk": {"model_a": [39942, 1, 0.4875118136405945, [[39942, 0.487512, " think", false], [62683, 0.0669, " understand", false], [31223, 0.06606, " know", false], [32435, 0.048042, " want", false], [45, 0.026571, ",", false], [60112, 0.025746, " ourselves", false], [46227, 0.023297, " humans", false], [22449, 0.017294, " see", false], [4423, 0.015454, " as", false], [51968, 0.014877, " imagine", false]]], "model_b": [39942, 2, 0.1816624402999878, [[22681, 0.182723, " use", false], [39942, 0.181662, " think", false], [4491, 0.110555, " do", false], [31358, 0.02823, " make", false], [32435, 0.026335, " want", false], [62683, 0.026043, " understand", false], [55532, 0.022498, " approach", false], [21286, 0.019917, " are", false], [21413, 0.018506, " can", false], [37923, 0.017136, " build", false]]]}, "raw_delta": -0.16536458333333337, "tuned_delta": -0.11127498591825778}, {"byte_start": 5076, "byte_end": 5079, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 873, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "9.11% 9.11% 9.11%", "model_b": "19.16% 19.16% 19.16%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.2213239073753357]], "model_b": [[4858, " we", "normal", 0.04153769090771675]]}, "loss": {"model_a": 9.11076946394723, "model_b": 19.160793511806542}, "topk": {"model_a": [4858, 1, 0.2213239073753357, [[4858, 0.221324, " we", false], [37598, 0.146123, " about", false], [4600, 0.145352, " is", false], [22248, 0.106594, " our", false], [45, 0.070646, ",", false], [22590, 0.044996, " the", false], [21265, 0.027026, " and", false], [5346, 0.018853, "---", false], [47001, 0.014404, " rather", false], [4706, 0.01332, " of", false]]], "model_b": [4858, 6, 0.04153769090771675, [[37598, 0.160517, " about", false], [4600, 0.157399, " is", false], [21265, 0.071787, " and", false], [45, 0.067255, ",", false], [4706, 0.061989, " of", false], [4858, 0.041538, " we", false], [21413, 0.030317, " can", false], [32475, 0.025004, " will", false], [38964, 0.017931, " makes", false], [22590, 0.017421, " the", false]]]}, "raw_delta": -0.5572916666666666, "tuned_delta": -0.503202069251591}, {"byte_start": 5079, "byte_end": 5085, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 874, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "3.19% 3.19% 3.19% 3.19% 3.19% 3.19%", "model_b": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.3434136211872101]], "model_b": [[39942, " think", "normal", 0.0945916548371315]]}, "loss": {"model_a": 3.193465585301091, "model_b": 7.044409379340641}, "topk": {"model_a": [39942, 1, 0.3434136211872101, [[39942, 0.343414, " think", false], [21286, 0.160343, " are", false], [47266, 0.076611, " should", false], [31223, 0.051239, " know", false], [32475, 0.046138, " will", false], [62683, 0.035482, " understand", false], [32499, 0.026556, " work", false], [21413, 0.024884, " can", false], [32435, 0.02415, " want", false], [5230, 0.022209, "'re", false]]], "model_b": [39942, 4, 0.0945916548371315, [[47266, 0.18119, " should", false], [21286, 0.174446, " are", false], [21413, 0.106328, " can", false], [39942, 0.094592, " think", false], [37923, 0.084667, " build", false], [32475, 0.057176, " will", false], [4491, 0.057069, " do", false], [32435, 0.027892, " want", false], [39196, 0.017717, " ought", false], [31223, 0.017321, " know", false]]]}, "raw_delta": -0.21354166666666666, "tuned_delta": -0.15945206925159106}, {"byte_start": 5085, "byte_end": 5090, "display": {"text": " does", "kind": "normal"}, "is_word": true, "word_id": 875, "word_key": " does", "bytes_hex": "20 64 6f 65 73", "compression": {"model_a": "17.36% 17.36% 17.36% 17.36% 17.36%", "model_b": "20.74% 20.74% 20.74% 20.74% 20.74%"}, "model_tokens": {"model_a": [[30659, " does", "normal", 0.008141069673001766]], "model_b": [[30659, " does", "normal", 0.0032249775249511003]]}, "loss": {"model_a": 17.35742471069534, "model_b": 20.738741212778844}, "topk": {"model_a": [30659, 15, 0.008141069673001766, [[4600, 0.35955, " is", false], [45, 0.160617, ",", false], [5346, 0.054572, "---", false], [32475, 0.034889, " will", false], [38964, 0.02888, " makes", false], [37598, 0.028654, " about", false], [38686, 0.028542, " helps", false], [21265, 0.024325, " and", false], [40212, 0.01893, " works", false], [275, 0.0153, " (", false]]], "model_b": [30659, 32, 0.0032249775249511003, [[4600, 0.235916, " is", false], [45, 0.131282, ",", false], [4858, 0.056899, " we", false], [37598, 0.054531, " about", false], [32475, 0.052972, " will", false], [21265, 0.040283, " and", false], [21413, 0.03487, " can", false], [47, 0.026694, ".", false], [275, 0.02604, " (", false], [5346, 0.024952, "---", false]]]}, "raw_delta": -0.1874999999999999, "tuned_delta": -0.13341040258492431}, {"byte_start": 5090, "byte_end": 5094, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 876, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "0.43% 0.43% 0.43% 0.43%", "model_b": "0.55% 0.55% 0.55% 0.55%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.9085621237754822]], "model_b": [[22187, " not", "normal", 0.8862698674201965]]}, "loss": {"model_a": 0.4314700744846143, "model_b": 0.5459417268988996}, "topk": {"model_a": [22187, 1, 0.9085621237754822, [[22187, 0.908562, " not", false], [31458, 0.014172, " more", false], [4835, 0.013025, " us", false], [31466, 0.007076, " much", false], [4692, 0.004324, " no", false], [332, 0.004023, " a", false], [21660, 0.003528, " far", false], [31049, 0.002812, " harm", false], [45, 0.002667, ",", false], [4788, 0.002106, " so", false]]], "model_b": [22187, 1, 0.8862698674201965, [[22187, 0.88627, " not", false], [46454, 0.016941, " little", false], [31458, 0.01043, " more", false], [52323, 0.009835, " nothing", false], [4692, 0.009091, " no", false], [31466, 0.003725, " much", false], [32386, 0.003556, " very", false], [45, 0.003174, ",", false], [55448, 0.002908, " actually", false], [31262, 0.002875, " lead", false]]]}, "raw_delta": -0.00634765625, "tuned_delta": 0.04774194116507559}, {"byte_start": 5094, "byte_end": 5099, "display": {"text": " work", "kind": "normal"}, "is_word": true, "word_id": 877, "word_key": " work", "bytes_hex": "20 77 6f 72 6b", "compression": {"model_a": "4.28% 4.28% 4.28% 4.28% 4.28%", "model_b": "10.59% 10.59% 10.59% 10.59% 10.59%"}, "model_tokens": {"model_a": [[32499, " work", "normal", 0.30648013949394226]], "model_b": [[32499, " work", "normal", 0.05347270891070366]]}, "loss": {"model_a": 4.28300090263911, "model_b": 10.594791706528325}, "topk": {"model_a": [32499, 1, 0.30648013949394226, [[32499, 0.30648, " work", false], [31073, 0.153813, " help", false], [31358, 0.117898, " make", false], [31262, 0.044946, " lead", false], [22269, 0.030662, " pay", false], [51982, 0.022369, " improve", false], [40239, 0.021061, " yield", false], [63717, 0.017719, " necessarily", false], [45150, 0.014854, " always", false], [45851, 0.013678, " enable", false]]], "model_b": [32499, 6, 0.05347270891070366, [[31358, 0.130771, " make", false], [63717, 0.121208, " necessarily", false], [46530, 0.072827, " matter", false], [31073, 0.062868, " help", false], [45150, 0.056096, " always", false], [32499, 0.053473, " work", false], [31262, 0.052641, " lead", false], [4596, 0.026197, " in", false], [31391, 0.022333, " mean", false], [51982, 0.022149, " improve", false]]]}, "raw_delta": -0.35000000000000003, "tuned_delta": -0.29591040258492446}, {"byte_start": 5099, "byte_end": 5102, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 878, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "22.17% 22.17% 22.17%", "model_b": "14.56% 14.56% 14.56%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.025334522128105164]], "model_b": [[4596, " in", "normal", 0.08847399801015854]]}, "loss": {"model_a": 22.166408180325217, "model_b": 14.558446050637324}, "topk": {"model_a": [4596, 5, 0.025334522128105164, [[47, 0.557546, ".", false], [45, 0.203756, ",", false], [21265, 0.032659, " and", false], [4423, 0.030164, " as", false], [4596, 0.025335, " in", false], [32458, 0.024674, " well", false], [5346, 0.018759, "---", false], [21700, 0.01802, " for", false], [32386, 0.013154, " very", false], [60, 0.012424, ";", false]]], "model_b": [4596, 3, 0.08847399801015854, [[47, 0.337844, ".", false], [45, 0.220601, ",", false], [4596, 0.088474, " in", false], [32458, 0.059706, " well", false], [21700, 0.036834, " for", false], [21265, 0.033026, " and", false], [4423, 0.02704, " as", false], [32386, 0.025285, " very", false], [60, 0.018135, ";", false], [32465, 0.018064, " when", false]]]}, "raw_delta": 0.42187500000000017, "tuned_delta": 0.47596459741507574}, {"byte_start": 5102, "byte_end": 5106, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 879, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "8.03% 8.03% 8.03% 8.03%", "model_b": "8.07% 8.07% 8.07% 8.07%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.16564661264419556]], "model_b": [[22590, " the", "normal", 0.16911444067955017]]}, "loss": {"model_a": 8.030626692448331, "model_b": 8.065848739345034}, "topk": {"model_a": [22590, 3, 0.16564661264419556, [[3609, 0.307636, " AI", false], [51832, 0.246449, " general", false], [22590, 0.165647, " the", false], [332, 0.034936, " a", false], [56901, 0.033283, " practice", false], [32234, 0.027718, " this", false], [52167, 0.018159, " machine", false], [31461, 0.016012, " most", false], [55809, 0.013437, " computer", false], [61594, 0.008507, " artificial", false]]], "model_b": [22590, 2, 0.16911444067955017, [[56901, 0.440426, " practice", false], [22590, 0.169114, " the", false], [3609, 0.052609, " AI", false], [51832, 0.04753, " general", false], [55809, 0.028794, " computer", false], [21273, 0.023927, " any", false], [31835, 0.017474, " real", false], [31461, 0.016446, " most", false], [332, 0.014336, " a", false], [31370, 0.014277, " many", false]]]}, "raw_delta": -0.001953125, "tuned_delta": 0.05213647241507559}, {"byte_start": 5106, "byte_end": 5111, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 880, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"model_a": "1.67% 1.67% 1.67% 1.67% 1.67%", "model_b": "2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"model_a": [[31323, " long", "normal", 0.6261128783226013]], "model_b": [[31323, " long", "normal", 0.4621831178665161]]}, "loss": {"model_a": 1.669525022903732, "model_b": 2.8036749329775748}, "topk": {"model_a": [31323, 1, 0.6261128783226013, [[31323, 0.626113, " long", false], [51832, 0.051677, " general", false], [30807, 0.041278, " face", false], [31835, 0.024926, " real", false], [21616, 0.023988, " end", false], [46470, 0.020722, " longer", false], [3609, 0.013909, " AI", false], [51310, 0.012343, " context", false], [31937, 0.011603, " same", false], [56916, 0.011568, " presence", false]]], "model_b": [31323, 1, 0.4621831178665161, [[31323, 0.462183, " long", false], [31835, 0.184873, " real", false], [40213, 0.03709, " world", false], [22752, 0.035727, " way", false], [21616, 0.027734, " end", false], [30807, 0.022962, " face", false], [38478, 0.01598, " field", false], [55809, 0.015599, " computer", false], [51832, 0.012982, " general", false], [21357, 0.008937, " big", false]]]}, "raw_delta": -0.06289062499999999, "tuned_delta": -0.008801027584924404}, {"byte_start": 5111, "byte_end": 5115, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 881, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "0.52% 0.52% 0.52% 0.52%", "model_b": "0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.892048180103302]], "model_b": [[22418, " run", "normal", 0.8901070356369019]]}, "loss": {"model_a": 0.5151224358642844, "model_b": 0.5239279475884602}, "topk": {"model_a": [22418, 1, 0.892048180103302, [[22418, 0.892048, " run", false], [32219, 0.094978, " term", false], [46, 0.008566, "-", false], [31057, 0.001793, " haul", false], [45, 0.000386, ",", false], [4715, 0.00027, " or", false], [21265, 0.000258, " and", false], [39438, 0.000208, " range", false], [8661, 0.000132, "run", false], [32251, 7.4e-05, " time", false]]], "model_b": [22418, 1, 0.8901070356369019, [[22418, 0.890107, " run", false], [32219, 0.09376, " term", false], [46, 0.01041, "-", false], [31057, 0.00097, " haul", false], [39438, 0.000647, " range", false], [8661, 0.000495, "run", false], [31908, 0.000456, " runs", false], [39920, 0.000439, " terms", false], [30941, 0.000439, " game", false], [45, 0.000352, ",", false]]]}, "raw_delta": -0.00048828125, "tuned_delta": 0.05360131616507559}, {"byte_start": 5115, "byte_end": 5116, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "6.83%", "model_b": "9.09%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6870548129081726]], "model_b": [[47, ".", "normal", 0.6046167016029358]]}, "loss": {"model_a": 6.833077097960421, "model_b": 9.087288099349427}, "topk": {"model_a": [47, 1, 0.6870548129081726, [[47, 0.687055, ".", false], [45, 0.201355, ",", false], [21265, 0.039974, " and", false], [5346, 0.014201, "---", false], [60, 0.012268, ";", false], [4423, 0.004079, " as", false], [4596, 0.004047, " in", false], [4588, 0.003963, " if", false], [275, 0.003757, " (", false], [51018, 0.003714, " because", false]]], "model_b": [47, 1, 0.6046167016029358, [[47, 0.604617, ".", false], [45, 0.266359, ",", false], [21265, 0.02605, " and", false], [5346, 0.022796, "---", false], [60, 0.01746, ";", false], [51018, 0.006953, " because", false], [4596, 0.006807, " in", false], [275, 0.006146, " (", false], [21700, 0.005893, " for", false], [32465, 0.005156, " when", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07091040258492441}, {"byte_start": 5116, "byte_end": 5120, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 882, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "12.54% 12.54% 12.54% 12.54%", "model_b": "12.89% 12.89% 12.89% 12.89%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.0623793862760067]], "model_b": [[20996, " The", "normal", 0.058125950396060944]]}, "loss": {"model_a": 12.539048695226342, "model_b": 12.891269164193373}, "topk": {"model_a": [20996, 3, 0.0623793862760067, [[261, 0.353309, "\n\n", false], [4331, 0.110811, " We", false], [20996, 0.062379, " The", false], [3918, 0.047851, " It", false], [29894, 0.028177, " This", false], [19417, 0.027652, " And", false], [3913, 0.022502, " In", false], [4255, 0.019988, " To", false], [267, 0.018998, "  ", false], [37451, 0.0166, " There", false]]], "model_b": [20996, 3, 0.058125950396060944, [[4331, 0.24612, " We", false], [261, 0.120132, "\n\n", false], [20996, 0.058126, " The", false], [19417, 0.058107, " And", false], [29894, 0.038731, " This", false], [3918, 0.034043, " It", false], [11, 0.028809, "\n", false], [0, 0.022946, "[0]", false], [267, 0.021781, "  ", false], [3913, 0.021644, " In", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03455834741507559}, {"byte_start": 5120, "byte_end": 5127, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 883, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%", "model_b": "6.92% 6.92% 6.92% 6.92% 6.92% 6.92% 6.92%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.04283943399786949]], "model_b": [[45315, " bitter", "normal", 0.06761566549539566]]}, "loss": {"model_a": 8.091007344271251, "model_b": 6.9236480756948025}, "topk": {"model_a": [45315, 3, 0.04283943399786949, [[46430, 0.077597, " lesson", false], [45184, 0.045862, " appeal", false], [45315, 0.042839, " bitter", false], [47009, 0.029321, " reason", false], [31581, 0.023927, " only", false], [31461, 0.023058, " most", false], [38720, 0.021002, " human", false], [30273, 0.015989, " best", false], [52127, 0.013819, " lessons", false], [21357, 0.013423, " big", false]]], "model_b": [45315, 1, 0.06761566549539566, [[45315, 0.067616, " bitter", false], [46430, 0.052968, " lesson", false], [31581, 0.044809, " only", false], [30273, 0.04376, " best", false], [31461, 0.037081, " most", false], [52127, 0.032481, " lessons", false], [21357, 0.021928, " big", false], [21952, 0.017595, " key", false], [38720, 0.014693, " human", false], [51039, 0.01281, " biggest", false]]]}, "raw_delta": 0.06473214285714285, "tuned_delta": 0.11882174027221844}, {"byte_start": 5127, "byte_end": 5134, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 884, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%", "model_b": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.8862361311912537]], "model_b": [[46430, " lesson", "normal", 0.9035728573799133]]}, "loss": {"model_a": 0.3119667010850856, "model_b": 0.25913363074003065}, "topk": {"model_a": [46430, 1, 0.8862361311912537, [[46430, 0.886236, " lesson", false], [52127, 0.043298, " lessons", false], [7513, 0.027198, "est", false], [31633, 0.006349, " part", false], [39899, 0.004205, " taste", false], [46, 0.003502, "-", false], [40029, 0.002673, " truth", false], [47009, 0.001869, " reason", false], [45, 0.001406, ",", false], [21265, 0.000988, " and", false]]], "model_b": [46430, 1, 0.9035728573799133, [[46430, 0.903573, " lesson", false], [52127, 0.033317, " lessons", false], [7513, 0.02089, "est", false], [46, 0.00777, "-", false], [39899, 0.002451, " taste", false], [45, 0.001715, ",", false], [31333, 0.001368, " loss", false], [61979, 0.000979, " experience", false], [52221, 0.000948, " message", false], [65126, 0.000875, " disappointment", false]]]}, "raw_delta": 0.002929687500000002, "tuned_delta": 0.05701928491507559}, {"byte_start": 5134, "byte_end": 5137, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 885, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "2.97% 2.97% 2.97%", "model_b": "4.81% 4.81% 4.81%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.6106763482093811]], "model_b": [[4600, " is", "normal", 0.4486593008041382]]}, "loss": {"model_a": 2.9703926216219703, "model_b": 4.8136797425494375}, "topk": {"model_a": [4600, 1, 0.6106763482093811, [[4600, 0.610676, " is", false], [4706, 0.043832, " of", false], [32227, 0.043181, " that", false], [45, 0.030191, ",", false], [21800, 0.025671, " has", false], [30135, 0.023286, " also", false], [21413, 0.01885, " can", false], [50938, 0.010327, " applies", false], [30659, 0.009446, " does", false], [4596, 0.009378, " in", false]]], "model_b": [4600, 1, 0.4486593008041382, [[4600, 0.448659, " is", false], [32227, 0.083596, " that", false], [21800, 0.053711, " has", false], [4706, 0.037408, " of", false], [21413, 0.030209, " can", false], [30135, 0.026424, " also", false], [45, 0.023434, ",", false], [22748, 0.018499, " was", false], [38087, 0.016896, " comes", false], [4596, 0.016731, " in", false]]]}, "raw_delta": -0.10221354166666667, "tuned_delta": -0.04812394425159108}, {"byte_start": 5137, "byte_end": 5143, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 886, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "19.44% 19.44% 19.44% 19.44% 19.44% 19.44%", "model_b": "20.66% 20.66% 20.66% 20.66% 20.66% 20.66%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.0015793975908309221]], "model_b": [[37810, " based", "normal", 0.001031332416459918]]}, "loss": {"model_a": 19.44256988698017, "model_b": 20.66360084606588}, "topk": {"model_a": [37810, 43, 0.0015793975908309221, [[32227, 0.501362, " that", false], [22187, 0.062458, " not", false], [22590, 0.047505, " the", false], [30135, 0.030121, " also", false], [32234, 0.028763, " this", false], [332, 0.024128, " a", false], [4811, 0.019839, " to", false], [59, 0.018992, ":", false], [45, 0.015691, ",", false], [37598, 0.014904, " about", false]]], "model_b": [37810, 61, 0.001031332416459918, [[32227, 0.584053, " that", false], [22187, 0.054618, " not", false], [22590, 0.046165, " the", false], [30135, 0.024394, " also", false], [332, 0.017413, " a", false], [32234, 0.014775, " this", false], [4811, 0.014462, " to", false], [22226, 0.010413, " one", false], [45, 0.008403, ",", false], [4596, 0.007357, " in", false]]]}, "raw_delta": -0.06770833333333326, "tuned_delta": -0.013618735918257671}, {"byte_start": 5143, "byte_end": 5146, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 887, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.58% 0.58% 0.58%", "model_b": "1.07% 1.07% 1.07%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9080391526222229]], "model_b": [[4712, " on", "normal", 0.8363717794418335]]}, "loss": {"model_a": 0.584098944370328, "model_b": 1.0742724303494477}, "topk": {"model_a": [4712, 1, 0.9080391526222229, [[4712, 0.908039, " on", false], [4596, 0.039021, " in", false], [22187, 0.012283, " not", false], [32350, 0.010816, " upon", false], [45, 0.007775, ",", false], [46768, 0.001574, " partly", false], [31458, 0.001391, " more", false], [45202, 0.001182, " around", false], [60247, 0.001127, " primarily", false], [30322, 0.001012, " both", false]]], "model_b": [4712, 1, 0.8363717794418335, [[4712, 0.836372, " on", false], [4596, 0.07748, " in", false], [22187, 0.022995, " not", false], [32350, 0.022786, " upon", false], [45, 0.005899, ",", false], [52094, 0.003098, " largely", false], [46768, 0.001792, " partly", false], [31458, 0.001641, " more", false], [56131, 0.001633, " entirely", false], [60247, 0.001495, " primarily", false]]]}, "raw_delta": -0.027180989583333332, "tuned_delta": 0.026908607831742256}, {"byte_start": 5146, "byte_end": 5150, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 888, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "4.31% 4.31% 4.31% 4.31%", "model_b": "4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.3865814208984375]], "model_b": [[22590, " the", "normal", 0.3693031668663025]]}, "loss": {"model_a": 4.314700744846142, "model_b": 4.490810979329659}, "topk": {"model_a": [22590, 1, 0.3865814208984375, [[22590, 0.386581, " the", false], [332, 0.141616, " a", false], [37045, 0.07456, " Moore", false], [22638, 0.044492, " two", false], [4419, 0.029966, " an", false], [32464, 0.023575, " what", false], [32234, 0.016644, " this", false], [21835, 0.016211, " how", false], [39946, 0.013038, " three", false], [65034, 0.010476, " understanding", false]]], "model_b": [22590, 1, 0.3693031668663025, [[22590, 0.369303, " the", false], [332, 0.158001, " a", false], [22638, 0.058696, " two", false], [4419, 0.031316, " an", false], [22248, 0.018184, " our", false], [32234, 0.014934, " this", false], [37045, 0.013183, " Moore", false], [39946, 0.013075, " three", false], [32464, 0.011829, " what", false], [57103, 0.01064, " research", false]]]}, "raw_delta": -0.009765625, "tuned_delta": 0.04432397241507559}, {"byte_start": 5150, "byte_end": 5161, "display": {"text": " historical", "kind": "normal"}, "is_word": true, "word_id": 889, "word_key": " historical", "bytes_hex": "20 68 69 73 74 6f 72 69 63 61 6c", "compression": {"model_a": "10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96%", "model_b": "10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55%"}, "model_tokens": {"model_a": [[62061, " historical", "normal", 0.001241572666913271]], "model_b": [[62061, " historical", "normal", 0.001612336840480566]]}, "loss": {"model_a": 10.963662597664705, "model_b": 10.553806051957613}, "topk": {"model_a": [62061, 110, 0.001241572666913271, [[30808, 0.136299, " fact", false], [63729, 0.073991, " observation", false], [59725, 0.059779, " following", false], [51832, 0.027097, " general", false], [31135, 0.023824, " idea", false], [46681, 0.015575, " notion", false], [47284, 0.013786, " simple", false], [60250, 0.01375, " principle", false], [52022, 0.011658, " insight", false], [63820, 0.011656, " realization", false]]], "model_b": [62061, 77, 0.001612336840480566, [[30808, 0.111415, " fact", false], [63729, 0.066346, " observation", false], [61606, 0.027877, " assumption", false], [63820, 0.026319, " realization", false], [31135, 0.024879, " idea", false], [45294, 0.023406, " belief", false], [60250, 0.02261, " principle", false], [65034, 0.014619, " understanding", false], [31937, 0.014438, " same", false], [46681, 0.013923, " notion", false]]]}, "raw_delta": 0.022727272727272707, "tuned_delta": 0.0768168701423483}, {"byte_start": 5161, "byte_end": 5174, "display": {"text": " observations", "kind": "normal"}, "is_word": true, "word_id": 890, "word_key": " observations", "bytes_hex": "20 6f 62 73 65 72 76 61 74 69 6f 6e 73", "compression": {"model_a": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "model_b": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58%"}, "model_tokens": {"model_a": [[64495, " observations", "normal", 0.007574328221380711]], "model_b": [[64495, " observations", "normal", 0.0020737757440656424]]}, "loss": {"model_a": 6.762633004167015, "model_b": 8.583341889904288}, "topk": {"model_a": [64495, 16, 0.007574328221380711, [[52427, 0.168155, " pattern", false], [30808, 0.118657, " fact", false], [47024, 0.104024, " record", false], [56157, 0.058514, " evidence", false], [56162, 0.051737, " examples", false], [61979, 0.050051, " experience", false], [51668, 0.034355, " example", false], [38440, 0.024553, " facts", false], [63729, 0.022453, " observation", false], [30579, 0.018244, " data", false]]], "model_b": [64495, 52, 0.0020737757440656424, [[52427, 0.138763, " pattern", false], [47024, 0.113858, " record", false], [30808, 0.112859, " fact", false], [61979, 0.078223, " experience", false], [53052, 0.034837, " success", false], [51708, 0.021428, " failure", false], [56157, 0.021077, " evidence", false], [38440, 0.02006, " facts", false], [56832, 0.016586, " patterns", false], [52127, 0.016575, " lessons", false]]]}, "raw_delta": -0.10096153846153842, "tuned_delta": -0.046871941046462834}, {"byte_start": 5174, "byte_end": 5179, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 891, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.56% 3.56% 3.56% 3.56% 3.56%", "model_b": "1.31% 1.31% 1.31% 1.31% 1.31%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.3737061023712158]], "model_b": [[32227, " that", "normal", 0.6979579329490662]]}, "loss": {"model_a": 3.5644711459463645, "model_b": 1.3102601445573594}, "topk": {"model_a": [32227, 1, 0.3737061023712158, [[32227, 0.373706, " that", false], [4706, 0.160495, " of", false], [45, 0.045392, ",", false], [37599, 0.043534, " above", false], [47, 0.033779, ".", false], [59488, 0.032704, " described", false], [4596, 0.030989, " in", false], [37598, 0.023491, " about", false], [31198, 0.022236, " just", false], [21265, 0.021996, " and", false]]], "model_b": [32227, 1, 0.6979579329490662, [[32227, 0.697958, " that", false], [4706, 0.111832, " of", false], [45, 0.029659, ",", false], [37599, 0.021577, " above", false], [21265, 0.016705, " and", false], [37598, 0.015338, " about", false], [4596, 0.009509, " in", false], [59488, 0.00943, " described", false], [31351, 0.008861, " made", false], [59, 0.006609, ":", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17908959741507557}, {"byte_start": 5179, "byte_end": 5181, "display": {"text": " 1", "kind": "normal"}, "is_word": true, "word_id": 892, "word_key": " 1", "bytes_hex": "20 31", "compression": {"model_a": "46.77% 46.77%", "model_b": "67.34% 67.34%"}, "model_tokens": {"model_a": [[284, " 1", "normal", 0.005633039399981499]], "model_b": [[284, " 1", "normal", 0.0005747947143390775]]}, "loss": {"model_a": 46.77487827882186, "model_b": 67.34455366649652}, "topk": {"model_a": [284, 32, 0.005633039399981499, [[22590, 0.096831, " the", false], [4858, 0.070248, " we", false], [45, 0.060374, ",", false], [59, 0.051346, ":", false], [47202, 0.042919, " search", false], [38720, 0.027865, " human", false], [52224, 0.02731, " methods", false], [63370, 0.02686, " computation", false], [4596, 0.024258, " in", false], [52195, 0.02262, " massive", false]]], "model_b": [284, 155, 0.0005747947143390775, [[22590, 0.116387, " the", false], [38720, 0.05816, " human", false], [4858, 0.057076, " we", false], [45, 0.053819, ",", false], [52195, 0.037853, " massive", false], [32465, 0.02819, " when", false], [39934, 0.018457, " there", false], [46227, 0.017793, " humans", false], [39936, 0.01765, " these", false], [332, 0.016701, " a", false]]]}, "raw_delta": -1.140625, "tuned_delta": -1.0865354025849243}, {"byte_start": 5181, "byte_end": 5182, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "1.57%", "model_b": "0.88%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.916594922542572]], "model_b": [[42, ")", "normal", 0.9522035121917725]]}, "loss": {"model_a": 1.5673810869032927, "model_b": 0.884953928279668}, "topk": {"model_a": [42, 1, 0.916594922542572, [[42, 0.916595, ")", false], [47, 0.053489, ".", false], [580, 0.00931, ".)", false], [48, 0.007099, "/", false], [45, 0.003575, ",", false], [46, 0.001759, "-", false], [59, 0.001194, ":", false], [499, 0.000951, ").", false], [276, 0.000381, " )", false], [98, 0.000339, "a", false]]], "model_b": [42, 1, 0.9522035121917725, [[42, 0.952204, ")", false], [47, 0.030034, ".", false], [580, 0.007377, ".)", false], [45, 0.002746, ",", false], [59, 0.001583, ":", false], [46, 0.000818, "-", false], [48, 0.000793, "/", false], [499, 0.000482, ").", false], [2195, 0.000375, "st", false], [1668, 0.000246, "\\.", false]]]}, "raw_delta": 0.037841796875, "tuned_delta": 0.09193139429007559}, {"byte_start": 5182, "byte_end": 5185, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 893, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "28.93% 28.93% 28.93%", "model_b": "24.42% 24.42% 24.42%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.008249612525105476]], "model_b": [[3609, " AI", "normal", 0.017233099788427353]]}, "loss": {"model_a": 28.929041184492235, "model_b": 24.420619181714223}, "topk": {"model_a": [3609, 22, 0.008249612525105476, [[22590, 0.111227, " the", false], [52195, 0.106297, " massive", false], [47202, 0.079443, " search", false], [63370, 0.044649, " computation", false], [52224, 0.037926, " methods", false], [38720, 0.037749, " human", false], [4596, 0.023473, " in", false], [39934, 0.02338, " there", false], [4858, 0.022097, " we", false], [37045, 0.021416, " Moore", false]]], "model_b": [3609, 13, 0.017233099788427353, [[22590, 0.130621, " the", false], [38720, 0.077728, " human", false], [4858, 0.049762, " we", false], [39934, 0.044545, " there", false], [4601, 0.027845, " it", false], [46227, 0.027731, " humans", false], [52195, 0.027448, " massive", false], [32465, 0.02314, " when", false], [31461, 0.022613, " most", false], [51832, 0.019704, " general", false]]]}, "raw_delta": 0.25, "tuned_delta": 0.3040895974150756}, {"byte_start": 5185, "byte_end": 5197, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 894, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"model_a": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%", "model_b": "3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19% 3.19%"}, "model_tokens": {"model_a": [[63843, " researchers", "normal", 0.20665737986564636]], "model_b": [[63843, " researchers", "normal", 0.1198546439409256]]}, "loss": {"model_a": 2.3598771420791147, "model_b": 3.1934655853010896}, "topk": {"model_a": [63843, 2, 0.20665737986564636, [[57103, 0.355594, " research", false], [63843, 0.206657, " researchers", false], [52224, 0.08492, " methods", false], [53087, 0.043916, " systems", false], [4600, 0.032844, " is", false], [21800, 0.028624, " has", false], [56950, 0.017856, " progress", false], [56949, 0.012839, " programs", false], [62633, 0.010243, " techniques", false], [22748, 0.008962, " was", false]]], "model_b": [63843, 2, 0.1198546439409256, [[57103, 0.394819, " research", false], [63843, 0.119855, " researchers", false], [4600, 0.075718, " is", false], [52224, 0.053141, " methods", false], [21800, 0.04689, " has", false], [53087, 0.021688, " systems", false], [61590, 0.010815, " approaches", false], [22748, 0.010323, " was", false], [59758, 0.008887, " generally", false], [39914, 0.008886, " tends", false]]]}, "raw_delta": -0.04622395833333335, "tuned_delta": 0.007865639081742239}, {"byte_start": 5197, "byte_end": 5202, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 895, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "6.09% 6.09% 6.09% 6.09% 6.09%", "model_b": "7.66% 7.66% 7.66% 7.66% 7.66%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.18479271233081818]], "model_b": [[31059, " have", "normal", 0.12053146213293076]]}, "loss": {"model_a": 6.086369703750314, "model_b": 7.664317404722617}, "topk": {"model_a": [31059, 1, 0.18479271233081818, [[31059, 0.184793, " have", false], [40, 0.125531, "'", false], [21286, 0.08591, " are", false], [32216, 0.043883, " tend", false], [22762, 0.039098, " who", false], [45, 0.029817, ",", false], [4491, 0.018315, " do", false], [39171, 0.017601, " often", false], [32462, 0.016839, " were", false], [45150, 0.01482, " always", false]]], "model_b": [31059, 1, 0.12053146213293076, [[31059, 0.120531, " have", false], [21286, 0.079481, " are", false], [32216, 0.061018, " tend", false], [40, 0.052517, "'", false], [32462, 0.049706, " were", false], [45, 0.032782, ",", false], [22762, 0.031552, " who", false], [39171, 0.030386, " often", false], [45150, 0.019568, " always", false], [4596, 0.019281, " in", false]]]}, "raw_delta": -0.08749999999999997, "tuned_delta": -0.03341040258492438}, {"byte_start": 5202, "byte_end": 5208, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 896, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "model_b": "10.66% 10.66% 10.66% 10.66% 10.66% 10.66%"}, "model_tokens": {"model_a": [[39171, " often", "normal", 0.02140750177204609]], "model_b": [[39171, " often", "normal", 0.0289636068046093]]}, "loss": {"model_a": 11.55283138211865, "model_b": 10.66053952740217}, "topk": {"model_a": [39171, 7, 0.02140750177204609, [[30259, 0.153282, " been", false], [22187, 0.071969, " not", false], [45150, 0.064603, " always", false], [332, 0.051983, " a", false], [47518, 0.030179, " tended", false], [21795, 0.028723, " had", false], [39171, 0.021408, " often", false], [31351, 0.020213, " made", false], [39762, 0.019188, " spent", false], [56495, 0.018302, " invested", false]]], "model_b": [39171, 7, 0.0289636068046093, [[30259, 0.149343, " been", false], [45150, 0.114232, " always", false], [332, 0.058166, " a", false], [47518, 0.049271, " tended", false], [22187, 0.048999, " not", false], [31351, 0.039643, " made", false], [39171, 0.028964, " often", false], [59758, 0.016461, " generally", false], [39115, 0.015971, " never", false], [39762, 0.014802, " spent", false]]]}, "raw_delta": 0.04947916666666663, "tuned_delta": 0.10356876408174222}, {"byte_start": 5208, "byte_end": 5214, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 897, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"model_a": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "model_b": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%"}, "model_tokens": {"model_a": [[40013, " tried", "normal", 0.049675680696964264]], "model_b": [[40013, " tried", "normal", 0.029330095276236534]]}, "loss": {"model_a": 9.01684400555602, "model_b": 10.613576798206566}, "topk": {"model_a": [40013, 3, 0.049675680696964264, [[30259, 0.175788, " been", false], [31351, 0.056235, " made", false], [40013, 0.049676, " tried", false], [21795, 0.033501, " had", false], [53137, 0.027602, " thought", false], [45953, 0.026995, " failed", false], [22187, 0.026353, " not", false], [56495, 0.02413, " invested", false], [37924, 0.023808, " built", false], [56651, 0.02061, " mistaken", false]]], "model_b": [40013, 4, 0.029330095276236534, [[30259, 0.235617, " been", false], [31351, 0.094101, " made", false], [52611, 0.035785, " pursued", false], [40013, 0.02933, " tried", false], [31601, 0.023822, " over", false], [45953, 0.023721, " failed", false], [22187, 0.020789, " not", false], [30666, 0.01761, " done", false], [65176, 0.017441, " underestimated", false], [32354, 0.01675, " used", false]]]}, "raw_delta": -0.08854166666666663, "tuned_delta": -0.03445206925159104}, {"byte_start": 5214, "byte_end": 5217, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 898, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.89% 1.89% 1.89%", "model_b": "0.67% 0.67% 0.67%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7269521951675415]], "model_b": [[4811, " to", "normal", 0.8940441608428955]]}, "loss": {"model_a": 1.890249850123072, "model_b": 0.6692188910373609}, "topk": {"model_a": [4811, 1, 0.7269521951675415, [[4811, 0.726952, " to", false], [52224, 0.101673, " methods", false], [22590, 0.010989, " the", false], [39931, 0.010568, " their", false], [45, 0.010553, ",", false], [61590, 0.008753, " approaches", false], [38720, 0.00633, " human", false], [32448, 0.005422, " ways", false], [55666, 0.005143, " building", false], [22249, 0.005037, " out", false]]], "model_b": [4811, 1, 0.8940441608428955, [[4811, 0.894044, " to", false], [52224, 0.010511, " methods", false], [39931, 0.005805, " their", false], [31048, 0.005665, " hard", false], [61590, 0.005121, " approaches", false], [45, 0.004494, ",", false], [22614, 0.004352, " too", false], [22590, 0.003436, " the", false], [47539, 0.002477, " things", false], [21265, 0.002103, " and", false]]]}, "raw_delta": 0.06770833333333333, "tuned_delta": 0.12179793074840892}, {"byte_start": 5217, "byte_end": 5223, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 899, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"model_a": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%", "model_b": "10.05% 10.05% 10.05% 10.05% 10.05% 10.05%"}, "model_tokens": {"model_a": [[37923, " build", "normal", 0.1399841010570526]], "model_b": [[37923, " build", "normal", 0.0352366603910923]]}, "loss": {"model_a": 5.8938225140483365, "model_b": 10.050024047859313}, "topk": {"model_a": [37923, 1, 0.1399841010570526, [[37923, 0.139984, " build", false], [31358, 0.06772, " make", false], [22339, 0.065152, " put", false], [22681, 0.050738, " use", false], [56540, 0.044043, " leverage", false], [32187, 0.04041, " take", false], [51982, 0.034896, " improve", false], [37730, 0.029011, " apply", false], [4491, 0.023135, " do", false], [39740, 0.022475, " solve", false]]], "model_b": [37923, 7, 0.0352366603910923, [[22681, 0.103473, " use", false], [31358, 0.096861, " make", false], [39740, 0.056077, " solve", false], [56540, 0.054038, " leverage", false], [4491, 0.045234, " do", false], [37730, 0.040987, " apply", false], [37923, 0.035237, " build", false], [32187, 0.022546, " take", false], [51982, 0.022286, " improve", false], [22339, 0.016935, " put", false]]]}, "raw_delta": -0.23046874999999997, "tuned_delta": -0.17637915258492437}, {"byte_start": 5223, "byte_end": 5233, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 900, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"model_a": "9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30%", "model_b": "10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26% 10.26%"}, "model_tokens": {"model_a": [[59943, " knowledge", "normal", 0.005743762012571096]], "model_b": [[59943, " knowledge", "normal", 0.0034443626645952463]]}, "loss": {"model_a": 9.298620380729647, "model_b": 10.256660056319971}, "topk": {"model_a": [59943, 17, 0.005743762012571096, [[4596, 0.161759, " in", false], [3609, 0.158346, " AI", false], [53087, 0.150292, " systems", false], [52224, 0.127166, " methods", false], [39931, 0.11992, " their", false], [332, 0.023776, " a", false], [63659, 0.017988, " intelligent", false], [64452, 0.01705, " intelligence", false], [22590, 0.015152, " the", false], [51832, 0.011605, " general", false]]], "model_b": [59943, 28, 0.0034443626645952463, [[4596, 0.403129, " in", false], [53087, 0.076017, " systems", false], [3609, 0.056226, " AI", false], [52224, 0.052723, " methods", false], [39931, 0.043898, " their", false], [4712, 0.025005, " on", false], [31162, 0.024469, " into", false], [332, 0.02078, " a", false], [51832, 0.018878, " general", false], [60521, 0.010292, " solutions", false]]]}, "raw_delta": -0.05312499999999998, "tuned_delta": 0.0009645974150756104}, {"byte_start": 5233, "byte_end": 5238, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 901, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"model_a": "3.97% 3.97% 3.97% 3.97% 3.97%", "model_b": "3.37% 3.37% 3.37% 3.37% 3.37%"}, "model_tokens": {"model_a": [[31162, " into", "normal", 0.3309861421585083]], "model_b": [[31162, " into", "normal", 0.3904026448726654]]}, "loss": {"model_a": 3.9730468899481215, "model_b": 3.3672276833248262}, "topk": {"model_a": [31162, 2, 0.3309861421585083, [[46, 0.366979, "-", false], [31162, 0.330986, " into", false], [4706, 0.061737, " of", false], [21265, 0.034483, " and", false], [53087, 0.027927, " systems", false], [4596, 0.027338, " in", false], [37598, 0.023705, " about", false], [56003, 0.015832, " directly", false], [4715, 0.012908, " or", false], [45, 0.011031, ",", false]]], "model_b": [31162, 1, 0.3904026448726654, [[31162, 0.390403, " into", false], [46, 0.291939, "-", false], [4596, 0.052488, " in", false], [4706, 0.028362, " of", false], [32227, 0.024681, " that", false], [56003, 0.020381, " directly", false], [53087, 0.017799, " systems", false], [37810, 0.017249, " based", false], [30917, 0.01173, " from", false], [21265, 0.011453, " and", false]]]}, "raw_delta": 0.033593750000000006, "tuned_delta": 0.0876833474150756}, {"byte_start": 5238, "byte_end": 5244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 902, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57%", "model_b": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.5923572778701782]], "model_b": [[39931, " their", "normal", 0.5617438554763794]]}, "loss": {"model_a": 1.573251428052743, "model_b": 1.7611023448351601}, "topk": {"model_a": [39931, 1, 0.5923572778701782, [[39931, 0.592357, " their", false], [3609, 0.124498, " AI", false], [52224, 0.06675, " methods", false], [53087, 0.061587, " systems", false], [22590, 0.058529, " the", false], [56949, 0.011045, " programs", false], [332, 0.008555, " a", false], [61559, 0.005536, " algorithms", false], [56567, 0.004553, " machines", false], [4419, 0.003581, " an", false]]], "model_b": [39931, 1, 0.5617438554763794, [[39931, 0.561744, " their", false], [3609, 0.190308, " AI", false], [22590, 0.056376, " the", false], [53087, 0.029268, " systems", false], [52224, 0.021943, " methods", false], [332, 0.014577, " a", false], [61559, 0.011758, " algorithms", false], [55809, 0.009182, " computer", false], [59345, 0.008482, " computers", false], [51832, 0.008227, " general", false]]]}, "raw_delta": -0.010416666666666671, "tuned_delta": 0.04367293074840892}, {"byte_start": 5244, "byte_end": 5251, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 903, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"model_a": "13.28% 13.28% 13.28% 13.28% 13.28% 13.28% 13.28%", "model_b": "15.46% 15.46% 15.46% 15.46% 15.46% 15.46% 15.46%"}, "model_tokens": {"model_a": [[45124, " agents", "normal", 0.00581713393330574]], "model_b": [[45124, " agents", "normal", 0.002509651007130742]]}, "loss": {"model_a": 13.283743401042354, "model_b": 15.45744686666746}, "topk": {"model_a": [45124, 11, 0.00581713393330574, [[53087, 0.363531, " systems", false], [52224, 0.312871, " methods", false], [3609, 0.080099, " AI", false], [56949, 0.060257, " programs", false], [61590, 0.020752, " approaches", false], [57103, 0.019518, " research", false], [61559, 0.019268, " algorithms", false], [46587, 0.017875, " models", false], [32499, 0.012338, " work", false], [56567, 0.006306, " machines", false]]], "model_b": [45124, 20, 0.002509651007130742, [[52224, 0.471205, " methods", false], [53087, 0.219157, " systems", false], [3609, 0.083869, " AI", false], [61590, 0.03064, " approaches", false], [61559, 0.025836, " algorithms", false], [57103, 0.022188, " research", false], [46587, 0.010499, " models", false], [62633, 0.010452, " techniques", false], [56949, 0.010309, " programs", false], [60521, 0.006603, " solutions", false]]]}, "raw_delta": -0.12053571428571419, "tuned_delta": -0.0664461168706386}, {"byte_start": 5251, "byte_end": 5252, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "15.15%", "model_b": "18.32%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.434590220451355]], "model_b": [[45, ",", "normal", 0.36264654994010925]]}, "loss": {"model_a": 15.145480165582377, "model_b": 18.315464386285665}, "topk": {"model_a": [45, 1, 0.434590220451355, [[45, 0.43459, ",", false], [21265, 0.131458, " and", false], [4596, 0.063392, " in", false], [4811, 0.052394, " to", false], [275, 0.039203, " (", false], [60, 0.034373, ";", false], [45285, 0.022127, " before", false], [32227, 0.019831, " that", false], [21400, 0.018695, " but", false], [5346, 0.015708, "---", false]]], "model_b": [45, 1, 0.36264654994010925, [[45, 0.362647, ",", false], [4596, 0.080076, " in", false], [21265, 0.068882, " and", false], [4450, 0.065342, " by", false], [4811, 0.044381, " to", false], [275, 0.037526, " (", false], [4715, 0.032949, " or", false], [32227, 0.023624, " that", false], [53356, 0.020972, " without", false], [60, 0.020163, ";", false]]]}, "raw_delta": -0.17578125, "tuned_delta": -0.12169165258492441}, {"byte_start": 5252, "byte_end": 5254, "display": {"text": " 2", "kind": "normal"}, "is_word": true, "word_id": 904, "word_key": " 2", "bytes_hex": "20 32", "compression": {"model_a": "20.01% 20.01%", "model_b": "32.40% 32.40%"}, "model_tokens": {"model_a": [[285, " 2", "normal", 0.10914670675992966]], "model_b": [[285, " 2", "normal", 0.0272633396089077]]}, "loss": {"model_a": 20.00612263732742, "model_b": 32.404283144966946}, "topk": {"model_a": [285, 2, 0.10914670675992966, [[21265, 0.421511, " and", false], [285, 0.109147, " 2", false], [21400, 0.065315, " but", false], [4596, 0.03874, " in", false], [4423, 0.02439, " as", false], [30788, 0.021679, " even", false], [4715, 0.021674, " or", false], [4811, 0.01869, " to", false], [32487, 0.017204, " with", false], [40186, 0.015772, " which", false]]], "model_b": [285, 4, 0.0272633396089077, [[21265, 0.406147, " and", false], [21400, 0.121215, " but", false], [4715, 0.065361, " or", false], [285, 0.027263, " 2", false], [30788, 0.026324, " even", false], [31581, 0.026323, " only", false], [4811, 0.024387, " to", false], [47001, 0.020346, " rather", false], [4596, 0.015308, " in", false], [4423, 0.01427, " as", false]]]}, "raw_delta": -0.6875, "tuned_delta": -0.6334104025849244}, {"byte_start": 5254, "byte_end": 5255, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "0.02%", "model_b": "0.02%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.998727023601532]], "model_b": [[42, ")", "normal", 0.9988815188407898]]}, "loss": {"model_a": 0.022839296034580986, "model_b": 0.020225159741466294}, "topk": {"model_a": [42, 1, 0.998727023601532, [[42, 0.998727, ")", false], [497, 0.000637, "),", false], [276, 9.6e-05, " )", false], [48, 8.6e-05, "/", false], [98, 7.4e-05, "a", false], [499, 4.8e-05, ").", false], [47, 4.8e-05, ".", false], [580, 3.9e-05, ".)", false], [45, 2.7e-05, ",", false], [46, 1.9e-05, "-", false]]], "model_b": [42, 1, 0.9988815188407898, [[42, 0.998882, ")", false], [276, 0.000183, " )", false], [497, 0.000166, "),", false], [47, 7.8e-05, ".", false], [45, 7.3e-05, ",", false], [499, 5.5e-05, ").", false], [580, 4.1e-05, ".)", false], [286, 2.4e-05, " 3", false], [46, 2.3e-05, "-", false], [489, 2.1e-05, ")\"", false]]]}, "raw_delta": 0.00014495849609375, "tuned_delta": 0.05423455591116934}, {"byte_start": 5255, "byte_end": 5260, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 905, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "7.89% 7.89% 7.89% 7.89% 7.89%", "model_b": "11.78% 11.78% 11.78% 11.78% 11.78%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.11136122792959213]], "model_b": [[32234, " this", "normal", 0.0379231832921505]]}, "loss": {"model_a": 7.889738504861517, "model_b": 11.778252482257551}, "topk": {"model_a": [32234, 2, 0.11136122792959213, [[32227, 0.199419, " that", false], [32234, 0.111361, " this", false], [22590, 0.085605, " the", false], [39936, 0.050789, " these", false], [32232, 0.045699, " they", false], [32465, 0.041929, " when", false], [4596, 0.026535, " in", false], [32139, 0.025946, " such", false], [59943, 0.02394, " knowledge", false], [39944, 0.022067, " those", false]]], "model_b": [32234, 5, 0.0379231832921505, [[3609, 0.20071, " AI", false], [22590, 0.115594, " the", false], [32232, 0.079027, " they", false], [39936, 0.045353, " these", false], [32234, 0.037923, " this", false], [39931, 0.036237, " their", false], [32227, 0.035232, " that", false], [32465, 0.032329, " when", false], [21265, 0.020016, " and", false], [45124, 0.018701, " agents", false]]]}, "raw_delta": -0.21562499999999996, "tuned_delta": -0.16153540258492438}, {"byte_start": 5260, "byte_end": 5267, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 906, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"model_a": "11.59% 11.59% 11.59% 11.59% 11.59% 11.59% 11.59%", "model_b": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%"}, "model_tokens": {"model_a": [[45150, " always", "normal", 0.011080559343099594]], "model_b": [[45150, " always", "normal", 0.005045089405030012]]}, "loss": {"model_a": 11.593085150000599, "model_b": 13.605773544097923}, "topk": {"model_a": [45150, 11, 0.011080559343099594, [[59943, 0.251005, " knowledge", false], [21800, 0.201708, " has", false], [4600, 0.065389, " is", false], [39171, 0.044568, " often", false], [55532, 0.03673, " approach", false], [45829, 0.034193, " effort", false], [22748, 0.025524, " was", false], [30659, 0.021778, " does", false], [38964, 0.017035, " makes", false], [38720, 0.012337, " human", false]]], "model_b": [45150, 27, 0.005045089405030012, [[21800, 0.199865, " has", false], [55532, 0.07615, " approach", false], [4600, 0.061248, " is", false], [39171, 0.052191, " often", false], [21532, 0.046801, " did", false], [39914, 0.045478, " tends", false], [21994, 0.03206, " led", false], [22748, 0.03041, " was", false], [59943, 0.027802, " knowledge", false], [38875, 0.018383, " leads", false]]]}, "raw_delta": -0.1116071428571428, "tuned_delta": -0.057517545442067206}, {"byte_start": 5267, "byte_end": 5273, "display": {"text": " helps", "kind": "normal"}, "is_word": true, "word_id": 907, "word_key": " helps", "bytes_hex": "20 68 65 6c 70 73", "compression": {"model_a": "21.32% 21.32% 21.32% 21.32% 21.32% 21.32%", "model_b": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%"}, "model_tokens": {"model_a": [[38686, " helps", "normal", 0.0008338545449078083]], "model_b": [[38686, " helps", "normal", 0.0006232532323338091]]}, "loss": {"model_a": 21.32107905480434, "model_b": 22.166408180325217}, "topk": {"model_a": [38686, 105, 0.0008338545449078083, [[38964, 0.06304, " makes", false], [21800, 0.059982, " has", false], [40040, 0.056542, " turns", false], [38875, 0.053095, " leads", false], [38442, 0.047763, " fails", false], [39620, 0.042737, " seems", false], [46936, 0.042604, " proved", false], [31351, 0.03373, " made", false], [47638, 0.033328, " turned", false], [45953, 0.029506, " failed", false]]], "model_b": [38686, 102, 0.0006232532323338091, [[38442, 0.122931, " fails", false], [21994, 0.122602, " led", false], [45953, 0.097936, " failed", false], [38875, 0.066501, " leads", false], [46936, 0.057306, " proved", false], [31351, 0.043756, " made", false], [47812, 0.040553, " worked", false], [38964, 0.032757, " makes", false], [21532, 0.029149, " did", false], [40212, 0.02795, " works", false]]]}, "raw_delta": -0.046875, "tuned_delta": 0.007214597415075588}, {"byte_start": 5273, "byte_end": 5276, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 908, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "8.03% 8.03% 8.03%", "model_b": "23.76% 23.76% 23.76%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.2614516019821167]], "model_b": [[4596, " in", "normal", 0.01918860897421837]]}, "loss": {"model_a": 8.030626692448331, "model_b": 23.763140972975762}, "topk": {"model_a": [4596, 1, 0.2614516019821167, [[4596, 0.261452, " in", false], [31581, 0.076774, " only", false], [45, 0.072435, ",", false], [32229, 0.070311, " them", false], [332, 0.051969, " a", false], [4424, 0.043171, " at", false], [21700, 0.040395, " for", false], [4811, 0.039668, " to", false], [22590, 0.035948, " the", false], [32465, 0.021311, " when", false]]], "model_b": [4596, 7, 0.01918860897421837, [[45, 0.196504, ",", false], [22590, 0.193482, " the", false], [32229, 0.180915, " them", false], [4811, 0.058689, " to", false], [39931, 0.050486, " their", false], [3609, 0.020522, " AI", false], [4596, 0.019189, " in", false], [63750, 0.01272, " performance", false], [32487, 0.012078, " with", false], [275, 0.009089, " (", false]]]}, "raw_delta": -0.8723958333333334, "tuned_delta": -0.8183062359182578}, {"byte_start": 5276, "byte_end": 5280, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 909, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "1.21% 1.21% 1.21% 1.21%", "model_b": "1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.7659869194030762]], "model_b": [[22590, " the", "normal", 0.7791318297386169]]}, "loss": {"model_a": 1.2063551062120847, "model_b": 1.1359110124186784}, "topk": {"model_a": [22590, 1, 0.7659869194030762, [[22590, 0.765987, " the", false], [32074, 0.070148, " some", false], [39675, 0.019721, " short", false], [332, 0.012314, " a", false], [38576, 0.005521, " games", false], [46639, 0.00543, " narrow", false], [39720, 0.003654, " small", false], [51515, 0.003286, " domains", false], [38328, 0.003227, " early", false], [47535, 0.002907, " theory", false]]], "model_b": [22590, 1, 0.7791318297386169, [[22590, 0.779132, " the", false], [32074, 0.040786, " some", false], [39675, 0.015999, " short", false], [332, 0.014595, " a", false], [22226, 0.006176, " one", false], [39920, 0.005319, " terms", false], [56901, 0.0053, " practice", false], [31323, 0.005044, " long", false], [46500, 0.004312, " making", false], [38864, 0.003821, " large", false]]]}, "raw_delta": 0.00390625, "tuned_delta": 0.05799584741507559}, {"byte_start": 5280, "byte_end": 5286, "display": {"text": " short", "kind": "normal"}, "is_word": true, "word_id": 910, "word_key": " short", "bytes_hex": "20 73 68 6f 72 74", "compression": {"model_a": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29%", "model_b": "2.63% 2.63% 2.63% 2.63% 2.63% 2.63%"}, "model_tokens": {"model_a": [[39675, " short", "normal", 0.9099187254905701]], "model_b": [[39675, " short", "normal", 0.42023706436157227]]}, "loss": {"model_a": 0.2861791310357135, "model_b": 2.6299128349538394}, "topk": {"model_a": [39675, 1, 0.9099187254905701, [[39675, 0.909919, " short", false], [59220, 0.012985, " beginning", false], [31323, 0.009941, " long", false], [38328, 0.008594, " early", false], [52888, 0.008279, " shorter", false], [38499, 0.006497, " first", false], [31503, 0.004843, " near", false], [52013, 0.004601, " initial", false], [59816, 0.003968, " immediate", false], [32386, 0.003736, " very", false]]], "model_b": [39675, 2, 0.42023706436157227, [[31323, 0.516137, " long", false], [39675, 0.420237, " short", false], [46470, 0.012704, " longer", false], [38328, 0.007976, " early", false], [21616, 0.003511, " end", false], [52013, 0.003091, " initial", false], [30807, 0.002274, " face", false], [32386, 0.001892, " very", false], [59816, 0.001568, " immediate", false], [59220, 0.001356, " beginning", false]]]}, "raw_delta": -0.12996419270833334, "tuned_delta": -0.07587459529325775}, {"byte_start": 5286, "byte_end": 5291, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 911, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"model_a": "3.75% 3.75% 3.75% 3.75% 3.75%", "model_b": "4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"model_a": [[32219, " term", "normal", 0.35302820801734924]], "model_b": [[32219, " term", "normal", 0.25318074226379395]]}, "loss": {"model_a": 3.7476257898092213, "model_b": 4.959264203055811}, "topk": {"model_a": [32219, 2, 0.35302820801734924, [[22418, 0.618986, " run", false], [32219, 0.353028, " term", false], [46, 0.0225, "-", false], [4811, 0.000834, " to", false], [4715, 0.000747, " or", false], [21265, 0.000664, " and", false], [8661, 0.000368, "run", false], [32251, 0.00029, " time", false], [45, 0.000235, ",", false], [39438, 0.00019, " range", false]]], "model_b": [32219, 2, 0.25318074226379395, [[22418, 0.724421, " run", false], [32219, 0.253181, " term", false], [46, 0.016459, "-", false], [39920, 0.000955, " terms", false], [31908, 0.000636, " runs", false], [39438, 0.000519, " range", false], [21265, 0.000432, " and", false], [4811, 0.000316, " to", false], [32251, 0.000287, " time", false], [8661, 0.000248, "run", false]]]}, "raw_delta": -0.06718750000000001, "tuned_delta": -0.013097902584924423}, {"byte_start": 5291, "byte_end": 5292, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "4.61%", "model_b": "4.72%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.775114893913269]], "model_b": [[45, ",", "normal", 0.7714399695396423]]}, "loss": {"model_a": 4.61408814346812, "model_b": 4.719754284158229}, "topk": {"model_a": [45, 1, 0.775114893913269, [[45, 0.775115, ",", false], [21400, 0.097752, " but", false], [275, 0.036147, " (", false], [21265, 0.029023, " and", false], [32465, 0.008431, " when", false], [5346, 0.005627, "---", false], [4450, 0.004008, " by", false], [4596, 0.003845, " in", false], [51018, 0.002883, " because", false], [4424, 0.002792, " at", false]]], "model_b": [45, 1, 0.7714399695396423, [[45, 0.77144, ",", false], [21400, 0.081278, " but", false], [275, 0.027869, " (", false], [4811, 0.025754, " to", false], [21265, 0.021871, " and", false], [32465, 0.011544, " when", false], [4450, 0.00865, " by", false], [32487, 0.006654, " with", false], [4596, 0.003675, " in", false], [5346, 0.003167, "---", false]]]}, "raw_delta": -0.005859375, "tuned_delta": 0.04823022241507559}, {"byte_start": 5292, "byte_end": 5296, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 912, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "6.38% 6.38% 6.38% 6.38%", "model_b": "7.01% 7.01% 7.01% 7.01%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.2431361973285675]], "model_b": [[21265, " and", "normal", 0.2092275768518448]]}, "loss": {"model_a": 6.37519048830328, "model_b": 7.009187332443938}, "topk": {"model_a": [21265, 3, 0.2431361973285675, [[21400, 0.359584, " but", false], [286, 0.278356, " 3", false], [21265, 0.243136, " and", false], [32465, 0.008133, " when", false], [30788, 0.007754, " even", false], [40076, 0.007155, " until", false], [4423, 0.006963, " as", false], [51018, 0.006009, " because", false], [4596, 0.004779, " in", false], [39171, 0.004488, " often", false]]], "model_b": [21265, 2, 0.2092275768518448, [[21400, 0.543361, " but", false], [21265, 0.209228, " and", false], [286, 0.157301, " 3", false], [30788, 0.005291, " even", false], [32465, 0.004856, " when", false], [4423, 0.004417, " as", false], [4715, 0.003947, " or", false], [40076, 0.00372, " until", false], [51018, 0.00259, " because", false], [32230, 0.00232, " then", false]]]}, "raw_delta": -0.03515625, "tuned_delta": 0.018933347415075588}, {"byte_start": 5296, "byte_end": 5299, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 913, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "35.32% 35.32% 35.32%", "model_b": "24.61% 24.61% 24.61%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.0027636028826236725]], "model_b": [[4600, " is", "normal", 0.01663871854543686]]}, "loss": {"model_a": 35.31597235509441, "model_b": 24.60847009849664}, "topk": {"model_a": [4600, 9, 0.0027636028826236725, [[286, 0.91861, " 3", false], [39171, 0.007677, " often", false], [45, 0.006756, ",", false], [60523, 0.005081, " sometimes", false], [32230, 0.004573, " then", false], [31581, 0.004088, " only", false], [32227, 0.003895, " that", false], [4596, 0.003376, " in", false], [4600, 0.002764, " is", false], [61959, 0.001976, " eventually", false]]], "model_b": [4600, 4, 0.01663871854543686, [[286, 0.688539, " 3", false], [61959, 0.035168, " eventually", false], [45, 0.025929, ",", false], [4600, 0.016639, " is", false], [32230, 0.010734, " then", false], [38875, 0.010159, " leads", false], [4596, 0.009388, " in", false], [39171, 0.007824, " often", false], [38442, 0.007822, " fails", false], [22187, 0.007409, " not", false]]]}, "raw_delta": 0.59375, "tuned_delta": 0.6478395974150756}, {"byte_start": 5299, "byte_end": 5310, "display": {"text": " personally", "kind": "normal"}, "is_word": true, "word_id": 914, "word_key": " personally", "bytes_hex": "20 70 65 72 73 6f 6e 61 6c 6c 79", "compression": {"model_a": "13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22%", "model_b": "16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80% 16.80%"}, "model_tokens": {"model_a": [[62309, " personally", "normal", 0.000304235378280282]], "model_b": [[62309, " personally", "normal", 3.568957981769927e-05]]}, "loss": {"model_a": 13.217873599053709, "model_b": 16.804118373990764}, "topk": {"model_a": [62309, 245, 0.000304235378280282, [[39171, 0.140777, " often", false], [332, 0.053596, " a", false], [60645, 0.042091, " therefore", false], [22187, 0.032508, " not", false], [60523, 0.03211, " sometimes", false], [45150, 0.029338, " always", false], [32386, 0.026068, " very", false], [30724, 0.025437, " easy", false], [32239, 0.022997, " thus", false], [57403, 0.020189, " tempting", false]]], "model_b": [62309, 897, 3.568957981769927e-05, [[22187, 0.122064, " not", false], [39171, 0.084578, " often", false], [51336, 0.064987, " counter", false], [332, 0.050766, " a", false], [59758, 0.028713, " generally", false], [62676, 0.025881, " ultimately", false], [60523, 0.022163, " sometimes", false], [53248, 0.019177, " usually", false], [39115, 0.018201, " never", false], [22590, 0.017031, " the", false]]]}, "raw_delta": -0.19886363636363633, "tuned_delta": -0.14477403894856072}, {"byte_start": 5310, "byte_end": 5321, "display": {"text": " satisfying", "kind": "normal"}, "is_word": true, "word_id": 915, "word_key": " satisfying", "bytes_hex": "20 73 61 74 69 73 66 79 69 6e 67", "compression": {"model_a": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35%", "model_b": "1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84%"}, "model_tokens": {"model_a": [[62527, " satisfying", "normal", 0.4378766119480133]], "model_b": [[62527, " satisfying", "normal", 0.3251973092556]]}, "loss": {"model_a": 1.3512457991280684, "model_b": 1.8443544556819134}, "topk": {"model_a": [62527, 1, 0.4378766119480133, [[62527, 0.437877, " satisfying", false], [31004, 0.107398, " grat", false], [59154, 0.107104, " appealing", false], [60428, 0.096222, " rewarding", false], [61694, 0.034863, " comforting", false], [32386, 0.025518, " very", false], [21265, 0.021764, " and", false], [56874, 0.021491, " pleasing", false], [61617, 0.018987, " attractive", false], [62029, 0.007011, " fulfilling", false]]], "model_b": [62527, 1, 0.3251973092556, [[62527, 0.325197, " satisfying", false], [60428, 0.110326, " rewarding", false], [31004, 0.032396, " grat", false], [61617, 0.024928, " attractive", false], [51336, 0.024147, " counter", false], [59154, 0.023204, " appealing", false], [61636, 0.022481, " beneficial", false], [47687, 0.020739, " useful", false], [59636, 0.020493, " enjoyable", false], [31458, 0.02046, " more", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.026745847415075588}, {"byte_start": 5321, "byte_end": 5324, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 916, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "8.88% 8.88% 8.88%", "model_b": "12.87% 12.87% 12.87%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.2312353104352951]], "model_b": [[4811, " to", "normal", 0.11646636575460434]]}, "loss": {"model_a": 8.875955817969208, "model_b": 12.86778779959557}, "topk": {"model_a": [4811, 2, 0.2312353104352951, [[45, 0.579151, ",", false], [4811, 0.231235, " to", false], [21700, 0.060822, " for", false], [21265, 0.035763, " and", false], [4596, 0.024416, " in", false], [275, 0.010831, " (", false], [4423, 0.009268, " as", false], [51018, 0.007781, " because", false], [47, 0.005236, ".", false], [21400, 0.004564, " but", false]]], "model_b": [4811, 2, 0.11646636575460434, [[45, 0.657605, ",", false], [4811, 0.116466, " to", false], [21700, 0.074476, " for", false], [275, 0.035649, " (", false], [21265, 0.024786, " and", false], [4596, 0.014069, " in", false], [60, 0.013269, ";", false], [32465, 0.011202, " when", false], [21400, 0.009716, " but", false], [5346, 0.008416, "---", false]]]}, "raw_delta": -0.22135416666666663, "tuned_delta": -0.16726456925159106}, {"byte_start": 5324, "byte_end": 5328, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 917, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.68% 2.68% 2.68% 2.68%", "model_b": "3.19% 3.19% 3.19% 3.19%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.559503436088562]], "model_b": [[22590, " the", "normal", 0.4871147572994232]]}, "loss": {"model_a": 2.6768755641494435, "model_b": 3.18759524415164}, "topk": {"model_a": [22590, 1, 0.559503436088562, [[22590, 0.559503, " the", false], [63843, 0.091696, " researchers", false], [4491, 0.072447, " do", false], [39944, 0.046482, " those", false], [32229, 0.034027, " them", false], [31059, 0.016784, " have", false], [31370, 0.013396, " many", false], [32499, 0.011874, " work", false], [332, 0.010146, " a", false], [3609, 0.008619, " AI", false]]], "model_b": [22590, 1, 0.4871147572994232, [[22590, 0.487115, " the", false], [22449, 0.076709, " see", false], [63843, 0.053493, " researchers", false], [32229, 0.033474, " them", false], [32074, 0.028798, " some", false], [39944, 0.026801, " those", false], [31223, 0.026273, " know", false], [332, 0.022602, " a", false], [31370, 0.018264, " many", false], [3609, 0.01081, " AI", false]]]}, "raw_delta": -0.0283203125, "tuned_delta": 0.025769284915075588}, {"byte_start": 5328, "byte_end": 5339, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 918, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"model_a": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "model_b": "2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78%"}, "model_tokens": {"model_a": [[62496, " researcher", "normal", 0.4059281349182129]], "model_b": [[62496, " researcher", "normal", 0.18503358960151672]]}, "loss": {"model_a": 1.4729219611348614, "model_b": 2.779339700576216}, "topk": {"model_a": [62496, 1, 0.4059281349182129, [[62496, 0.405928, " researcher", false], [63843, 0.350129, " researchers", false], [37636, 0.06722, " agent", false], [3609, 0.037711, " AI", false], [38720, 0.021742, " human", false], [45124, 0.018909, " agents", false], [62105, 0.009099, " individual", false], [46787, 0.007936, " people", false], [57103, 0.004754, " research", false], [64951, 0.004345, " investigators", false]]], "model_b": [62496, 2, 0.18503358960151672, [[63843, 0.230718, " researchers", false], [62496, 0.185034, " researcher", false], [37636, 0.166019, " agent", false], [3609, 0.137714, " AI", false], [45124, 0.071079, " agents", false], [38720, 0.037695, " human", false], [62105, 0.017622, " individual", false], [57103, 0.015407, " research", false], [46787, 0.011403, " people", false], [46795, 0.006465, " person", false]]]}, "raw_delta": -0.0724431818181818, "tuned_delta": -0.018353584403106207}, {"byte_start": 5339, "byte_end": 5340, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.82%", "model_b": "3.82%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8550218939781189]], "model_b": [[45, ",", "normal", 0.8068479895591736]]}, "loss": {"model_a": 2.8177637517362566, "model_b": 3.821592088292298}, "topk": {"model_a": [45, 1, 0.8550218939781189, [[45, 0.855022, ",", false], [22762, 0.026986, " who", false], [21265, 0.019284, " and", false], [275, 0.015934, " (", false], [47, 0.009862, ".", false], [4596, 0.007708, " in", false], [286, 0.00665, " 3", false], [51018, 0.006173, " because", false], [4811, 0.004574, " to", false], [60, 0.003876, ";", false]]], "model_b": [45, 1, 0.8068479895591736, [[45, 0.806848, ",", false], [275, 0.041571, " (", false], [22762, 0.026875, " who", false], [21265, 0.018391, " and", false], [60, 0.01521, ";", false], [47, 0.011316, ".", false], [4596, 0.007034, " in", false], [21400, 0.00606, " but", false], [32465, 0.005791, " when", false], [4424, 0.004872, " at", false]]]}, "raw_delta": -0.0556640625, "tuned_delta": -0.0015744650849244118}, {"byte_start": 5340, "byte_end": 5344, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 919, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "6.06% 6.06% 6.06% 6.06%", "model_b": "5.42% 5.42% 5.42% 5.42%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.26175305247306824]], "model_b": [[21400, " but", "normal", 0.3018230199813843]]}, "loss": {"model_a": 6.058192066232952, "model_b": 5.424195222092293}, "topk": {"model_a": [21400, 3, 0.26175305247306824, [[286, 0.423515, " 3", false], [21265, 0.266668, " and", false], [21400, 0.261753, " but", false], [22762, 0.008996, " who", false], [30788, 0.003798, " even", false], [51018, 0.003428, " because", false], [4423, 0.002328, " as", false], [40187, 0.002235, " while", false], [4788, 0.002218, " so", false], [22797, 0.001451, " yet", false]]], "model_b": [21400, 2, 0.3018230199813843, [[21265, 0.445451, " and", false], [21400, 0.301823, " but", false], [286, 0.193622, " 3", false], [30788, 0.006811, " even", false], [40187, 0.006204, " while", false], [22762, 0.005069, " who", false], [62461, 0.002469, " regardless", false], [4715, 0.002263, " or", false], [22187, 0.001599, " not", false], [22797, 0.001546, " yet", false]]]}, "raw_delta": 0.03515625, "tuned_delta": 0.08924584741507559}, {"byte_start": 5344, "byte_end": 5346, "display": {"text": " 3", "kind": "normal"}, "is_word": true, "word_id": 920, "word_key": " 3", "bytes_hex": "20 33", "compression": {"model_a": "2.91% 2.91%", "model_b": "19.30% 19.30%"}, "model_tokens": {"model_a": [[286, " 3", "normal", 0.7265291213989258]], "model_b": [[286, " 3", "normal", 0.11727403849363327]]}, "loss": {"model_a": 2.9058188689780144, "model_b": 19.301681699393356}, "topk": {"model_a": [286, 1, 0.7265291213989258, [[286, 0.726529, " 3", false], [45, 0.033719, ",", false], [4600, 0.025319, " is", false], [4596, 0.019004, " in", false], [4601, 0.018985, " it", false], [32227, 0.013282, " that", false], [31601, 0.012459, " over", false], [61959, 0.011353, " eventually", false], [62676, 0.010438, " ultimately", false], [30659, 0.00992, " does", false]]], "model_b": [286, 1, 0.11727403849363327, [[286, 0.117274, " 3", false], [4600, 0.090716, " is", false], [4601, 0.085785, " it", false], [61959, 0.064582, " eventually", false], [62676, 0.055315, " ultimately", false], [4596, 0.046424, " in", false], [30659, 0.046177, " does", false], [38442, 0.038159, " fails", false], [22187, 0.037002, " not", false], [45, 0.029397, ",", false]]]}, "raw_delta": -0.9091796875, "tuned_delta": -0.8550900900849244}, {"byte_start": 5346, "byte_end": 5347, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "0.01%", "model_b": "0.03%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.9992398023605347]], "model_b": [[42, ")", "normal", 0.9982853531837463]]}, "loss": {"model_a": 0.013827405129369813, "model_b": 0.03095687715530555}, "topk": {"model_a": [42, 1, 0.9992398023605347, [[42, 0.99924, ")", false], [497, 0.000284, "),", false], [499, 4.7e-05, ").", false], [47, 4.6e-05, ".", false], [276, 4.5e-05, " )", false], [45, 3.8e-05, ",", false], [98, 2.8e-05, "a", false], [4600, 2.5e-05, " is", false], [30659, 1.8e-05, " does", false], [4596, 1.2e-05, " in", false]]], "model_b": [42, 1, 0.9982853531837463, [[42, 0.998285, ")", false], [497, 0.000354, "),", false], [45, 0.000261, ",", false], [276, 0.000132, " )", false], [499, 0.000106, ").", false], [47, 4.3e-05, ".", false], [46, 4.2e-05, "-", false], [4600, 3.1e-05, " is", false], [493, 2.9e-05, ")(", false], [98, 2.4e-05, "a", false]]]}, "raw_delta": -0.000949859619140625, "tuned_delta": 0.05313973779593496}, {"byte_start": 5347, "byte_end": 5350, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 921, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "13.24% 13.24% 13.24%", "model_b": "14.28% 14.28% 14.28%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.11017217487096786]], "model_b": [[4596, " in", "normal", 0.0911039486527443]]}, "loss": {"model_a": 13.243489633160404, "model_b": 14.276669675463697}, "topk": {"model_a": [4596, 2, 0.11017217487096786, [[4601, 0.222461, " it", false], [4596, 0.110172, " in", false], [22590, 0.107652, " the", false], [32234, 0.077103, " this", false], [31601, 0.042091, " over", false], [32227, 0.032452, " that", false], [32465, 0.02627, " when", false], [61959, 0.02495, " eventually", false], [4423, 0.018162, " as", false], [31578, 0.014734, " once", false]]], "model_b": [4596, 3, 0.0911039486527443, [[4601, 0.325464, " it", false], [32234, 0.115428, " this", false], [4596, 0.091104, " in", false], [22590, 0.065696, " the", false], [31601, 0.050854, " over", false], [32465, 0.035607, " when", false], [32227, 0.021295, " that", false], [4423, 0.01855, " as", false], [39936, 0.016965, " these", false], [61959, 0.016826, " eventually", false]]]}, "raw_delta": -0.05729166666666663, "tuned_delta": -0.0032020692515910415}, {"byte_start": 5350, "byte_end": 5354, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 922, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.63% 0.63% 0.63% 0.63%", "model_b": "0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.8694505095481873]], "model_b": [[22590, " the", "normal", 0.8033708333969116]]}, "loss": {"model_a": 0.6295940882785698, "model_b": 0.9906200689697776}, "topk": {"model_a": [22590, 1, 0.8694505095481873, [[22590, 0.869451, " the", false], [51832, 0.030552, " general", false], [56901, 0.02449, " practice", false], [332, 0.012814, " a", false], [31461, 0.007921, " most", false], [45145, 0.004309, " almost", false], [30808, 0.003205, " fact", false], [31323, 0.00295, " long", false], [21256, 0.002759, " all", false], [31370, 0.002502, " many", false]]], "model_b": [22590, 1, 0.8033708333969116, [[22590, 0.803371, " the", false], [56901, 0.048825, " practice", false], [51832, 0.033012, " general", false], [31461, 0.012972, " most", false], [31323, 0.009248, " long", false], [31370, 0.008678, " many", false], [332, 0.007559, " a", false], [39920, 0.004081, " terms", false], [52652, 0.004075, " reality", false], [21256, 0.003864, " all", false]]]}, "raw_delta": -0.02001953125, "tuned_delta": 0.03407006616507559}, {"byte_start": 5354, "byte_end": 5359, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 923, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"model_a": "0.46% 0.46% 0.46% 0.46% 0.46%", "model_b": "0.35% 0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"model_a": [[31323, " long", "normal", 0.8808698058128357]], "model_b": [[31323, " long", "normal", 0.9076931476593018]]}, "loss": {"model_a": 0.4578866096571417, "model_b": 0.3522204689670321}, "topk": {"model_a": [31323, 1, 0.8808698058128357, [[31323, 0.88087, " long", false], [46470, 0.079796, " longer", false], [21616, 0.012357, " end", false], [32386, 0.004316, " very", false], [50837, 0.002124, " absence", false], [46536, 0.002025, " medium", false], [31466, 0.001539, " much", false], [39675, 0.000905, " short", false], [30405, 0.000877, " case", false], [46397, 0.000751, " larger", false]]], "model_b": [31323, 1, 0.9076931476593018, [[31323, 0.907693, " long", false], [46470, 0.055758, " longer", false], [21616, 0.016914, " end", false], [46536, 0.001798, " medium", false], [39675, 0.000888, " short", false], [46064, 0.000742, " future", false], [51310, 0.000732, " context", false], [21357, 0.00069, " big", false], [38621, 0.000669, " grand", false], [51832, 0.000631, " general", false]]]}, "raw_delta": 0.005859375, "tuned_delta": 0.05994897241507559}, {"byte_start": 5359, "byte_end": 5363, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 924, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"model_a": "1.63% 1.63% 1.63% 1.63%", "model_b": "1.00% 1.00% 1.00% 1.00%"}, "model_tokens": {"model_a": [[22418, " run", "normal", 0.696638822555542]], "model_b": [[22418, " run", "normal", 0.8015767931938171]]}, "loss": {"model_a": 1.6290196689725231, "model_b": 0.9950228248318655}, "topk": {"model_a": [22418, 1, 0.696638822555542, [[22418, 0.696639, " run", false], [32219, 0.29224, " term", false], [46, 0.007287, "-", false], [31057, 0.000752, " haul", false], [32251, 0.000254, " time", false], [45, 0.000249, ",", false], [27132, 0.000197, "term", false], [39438, 0.000183, " range", false], [39920, 0.000141, " terms", false], [32186, 0.000122, " tail", false]]], "model_b": [22418, 1, 0.8015767931938171, [[22418, 0.801577, " run", false], [32219, 0.186583, " term", false], [46, 0.006717, "-", false], [45, 0.000583, ",", false], [31057, 0.000565, " haul", false], [30941, 0.00046, " game", false], [39438, 0.000366, " range", false], [39920, 0.000271, " terms", false], [31908, 0.000265, " runs", false], [32398, 0.000198, " view", false]]]}, "raw_delta": 0.03515625, "tuned_delta": 0.08924584741507559}, {"byte_start": 5363, "byte_end": 5366, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 925, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "10.05% 10.05% 10.05%", "model_b": "9.53% 9.53% 9.53%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.1925484836101532]], "model_b": [[4601, " it", "normal", 0.20724616944789886]]}, "loss": {"model_a": 10.050024047859313, "model_b": 9.533434026707669}, "topk": {"model_a": [4601, 2, 0.1925484836101532, [[45, 0.570428, ",", false], [4601, 0.192548, " it", false], [32234, 0.07024, " this", false], [22590, 0.046824, " the", false], [39936, 0.011848, " these", false], [32139, 0.011633, " such", false], [275, 0.005885, " (", false], [32227, 0.005665, " that", false], [4600, 0.003679, " is", false], [39934, 0.00306, " there", false]]], "model_b": [4601, 2, 0.20724616944789886, [[45, 0.535182, ",", false], [4601, 0.207246, " it", false], [32234, 0.0723, " this", false], [22590, 0.03778, " the", false], [39936, 0.014139, " these", false], [30659, 0.008527, " does", false], [4600, 0.007387, " is", false], [3609, 0.006653, " AI", false], [32227, 0.006169, " that", false], [52195, 0.004738, " massive", false]]]}, "raw_delta": 0.02864583333333326, "tuned_delta": 0.08273543074840885}, {"byte_start": 5366, "byte_end": 5374, "display": {"text": " plateau", "kind": "normal"}, "is_word": true, "word_id": 926, "word_key": " plateau", "bytes_hex": "20 70 6c 61 74 65 61 75", "compression": {"model_a": "30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 30.01%", "model_b": "28.18% 28.18% 28.18% 28.18% 28.18% 28.18% 28.18% 28.18%"}, "model_tokens": {"model_a": [[52488, " plateau", "normal", 1.6992586324704462e-06]], "model_b": [[52488, " plateau", "normal", 3.7790293845318956e-06]]}, "loss": {"model_a": 30.00918395599113, "model_b": 28.177637517362562}, "topk": {"model_a": [52488, 1640, 1.6992586324704462e-06, [[4600, 0.294624, " is", false], [30659, 0.109196, " does", false], [45150, 0.05864, " always", false], [39115, 0.052263, " never", false], [21800, 0.03202, " has", false], [45145, 0.023423, " almost", false], [39914, 0.020226, " tends", false], [38964, 0.018081, " makes", false], [39171, 0.016802, " often", false], [38724, 0.016613, " hurts", false]]], "model_b": [52488, 1269, 3.7790293845318956e-06, [[4600, 0.169707, " is", false], [30659, 0.162826, " does", false], [39115, 0.054043, " never", false], [38964, 0.048222, " makes", false], [45150, 0.047492, " always", false], [38875, 0.041253, " leads", false], [38442, 0.035432, " fails", false], [51019, 0.032904, " becomes", false], [21800, 0.030277, " has", false], [40212, 0.022499, " works", false]]]}, "raw_delta": 0.1015625, "tuned_delta": 0.15565209741507557}, {"byte_start": 5374, "byte_end": 5375, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 927, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.13%", "model_b": "0.06%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9926484227180481]], "model_b": [[116, "s", "normal", 0.9968969821929932]]}, "loss": {"model_a": 0.13318336482815898, "model_b": 0.05613513724162073}, "topk": {"model_a": [116, 1, 0.9926484227180481, [[116, 0.992648, "s", false], [1843, 0.005989, "ed", false], [460, 0.000225, "'s", false], [121, 0.000156, "x", false], [45, 0.000103, ",", false], [4715, 0.000102, " or", false], [4600, 8.1e-05, " is", false], [21265, 5.1e-05, " and", false], [9091, 4.7e-05, "xes", false], [46, 4.7e-05, "-", false]]], "model_b": [116, 1, 0.9968969821929932, [[116, 0.996897, "s", false], [121, 0.001192, "x", false], [1843, 0.000643, "ed", false], [45, 0.000178, ",", false], [21265, 0.000116, " and", false], [22249, 7.9e-05, " out", false], [4715, 7.3e-05, " or", false], [4596, 6.5e-05, " in", false], [47, 5.1e-05, ".", false], [460, 5.1e-05, "'s", false]]]}, "raw_delta": 0.0042724609375, "tuned_delta": 0.05836205835257559}, {"byte_start": 5375, "byte_end": 5379, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 928, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "6.73% 6.73% 6.73% 6.73%", "model_b": "7.96% 7.96% 7.96% 7.96%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.22643521428108215]], "model_b": [[21265, " and", "normal", 0.1735711246728897]]}, "loss": {"model_a": 6.727410957270312, "model_b": 7.960182598654924}, "topk": {"model_a": [21265, 3, 0.22643521428108215, [[45, 0.35756, ",", false], [4715, 0.231589, " or", false], [21265, 0.226435, " and", false], [4596, 0.037887, " in", false], [22249, 0.032709, " out", false], [275, 0.013597, " (", false], [4424, 0.01314, " at", false], [47, 0.01166, ".", false], [4423, 0.008217, " as", false], [40187, 0.005346, " while", false]]], "model_b": [21265, 2, 0.1735711246728897, [[45, 0.27842, ",", false], [21265, 0.173571, " and", false], [47, 0.095837, ".", false], [63750, 0.082231, " performance", false], [4715, 0.081027, " or", false], [22590, 0.060753, " the", false], [4596, 0.02827, " in", false], [4423, 0.01985, " as", false], [275, 0.014987, " (", false], [22249, 0.013751, " out", false]]]}, "raw_delta": -0.068359375, "tuned_delta": -0.014269777584924412}, {"byte_start": 5379, "byte_end": 5384, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 929, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "13.58% 13.58% 13.58% 13.58% 13.58%", "model_b": "10.26% 10.26% 10.26% 10.26% 10.26%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.022958513349294662]], "model_b": [[30788, " even", "normal", 0.05880230665206909]]}, "loss": {"model_a": 13.581621283368756, "model_b": 10.256660056319973}, "topk": {"model_a": [30788, 7, 0.022958513349294662, [[32230, 0.113568, " then", false], [4600, 0.086859, " is", false], [30659, 0.068003, " does", false], [51019, 0.050926, " becomes", false], [22590, 0.045561, " the", false], [61959, 0.045538, " eventually", false], [30788, 0.022959, " even", false], [39115, 0.021391, " never", false], [39171, 0.021272, " often", false], [38442, 0.018677, " fails", false]]], "model_b": [30788, 3, 0.05880230665206909, [[61959, 0.096449, " eventually", false], [30659, 0.062961, " does", false], [30788, 0.058802, " even", false], [38442, 0.057173, " fails", false], [4600, 0.048762, " is", false], [51019, 0.044917, " becomes", false], [32230, 0.036254, " then", false], [22590, 0.028768, " the", false], [39115, 0.028513, " never", false], [39171, 0.024968, " often", false]]]}, "raw_delta": 0.18437500000000007, "tuned_delta": 0.23846459741507564}, {"byte_start": 5384, "byte_end": 5392, "display": {"text": " inhibit", "kind": "normal"}, "is_word": true, "word_id": 930, "word_key": " inhibit", "bytes_hex": "20 69 6e 68 69 62 69 74", "compression": {"model_a": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%", "model_b": "13.88% 13.88% 13.88% 13.88% 13.88% 13.88% 13.88% 13.88%"}, "model_tokens": {"model_a": [[52011, " inhibit", "normal", 0.010673652403056622]], "model_b": [[52011, " inhibit", "normal", 0.0021511260420084]]}, "loss": {"model_a": 10.214393600043929, "model_b": 13.877486477301062}, "topk": {"model_a": [52011, 26, 0.010673652403056622, [[38724, 0.084977, " hurts", false], [55929, 0.064589, " declines", false], [52688, 0.057091, " regress", false], [46201, 0.05617, " hinder", false], [51417, 0.048086, " degrade", false], [31049, 0.03523, " harm", false], [51019, 0.029307, " becomes", false], [59456, 0.029264, " decreases", false], [30218, 0.02554, " back", false], [30965, 0.024325, " gets", false]]], "model_b": [52011, 72, 0.0021511260420084, [[52748, 0.068634, " reverse", false], [38442, 0.066529, " fails", false], [55929, 0.044002, " declines", false], [38447, 0.038188, " falls", false], [60523, 0.03552, " sometimes", false], [40216, 0.033267, " worse", false], [38875, 0.027053, " leads", false], [52688, 0.026868, " regress", false], [51417, 0.024493, " degrade", false], [30965, 0.024418, " gets", false]]]}, "raw_delta": -0.203125, "tuned_delta": -0.14903540258492443}, {"byte_start": 5392, "byte_end": 5393, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 931, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.01%", "model_b": "0.00%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9995808005332947]], "model_b": [[116, "s", "normal", 0.9997748732566833]]}, "loss": {"model_a": 0.007567236637963579, "model_b": 0.0040415922952760025}, "topk": {"model_a": [116, 1, 0.9995808005332947, [[116, 0.999581, "s", false], [56950, 6.1e-05, " progress", false], [7856, 5.4e-05, "ing", false], [63750, 4.3e-05, " performance", false], [22590, 3e-05, " the", false], [56537, 2.6e-05, " learning", false], [46132, 1.6e-05, " growth", false], [7938, 1.1e-05, "ive", false], [57103, 9e-06, " research", false], [63469, 8e-06, " development", false]]], "model_b": [116, 1, 0.9997748732566833, [[116, 0.999775, "s", false], [7856, 3.9e-05, "ing", false], [2184, 1.4e-05, "si", false], [8752, 1.2e-05, "sth", false], [2176, 1e-05, "sa", false], [7938, 9e-06, "ive", false], [22590, 9e-06, " the", false], [8705, 6e-06, "ses", false], [45, 5e-06, ",", false], [10402, 5e-06, "们", false]]]}, "raw_delta": 0.00019550323486328125, "tuned_delta": 0.05428510064993887}, {"byte_start": 5393, "byte_end": 5401, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 932, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"model_a": "6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13%", "model_b": "6.94% 6.94% 6.94% 6.94% 6.94% 6.94% 6.94% 6.94%"}, "model_tokens": {"model_a": [[51816, " further", "normal", 0.06583872437477112]], "model_b": [[51816, " further", "normal", 0.04612430930137634]]}, "loss": {"model_a": 6.128636160026358, "model_b": 6.938743238650531}, "topk": {"model_a": [51816, 3, 0.06583872437477112, [[56950, 0.604828, " progress", false], [22590, 0.073033, " the", false], [51816, 0.065839, " further", false], [63750, 0.054296, " performance", false], [56537, 0.025818, " learning", false], [63621, 0.023078, " improvement", false], [57103, 0.022705, " research", false], [45, 0.020699, ",", false], [46064, 0.00738, " future", false], [63469, 0.007257, " development", false]]], "model_b": [51816, 4, 0.04612430930137634, [[56950, 0.258362, " progress", false], [63750, 0.232161, " performance", false], [22590, 0.115315, " the", false], [51816, 0.046124, " further", false], [46132, 0.035524, " growth", false], [63621, 0.026632, " improvement", false], [56537, 0.021987, " learning", false], [57103, 0.018307, " research", false], [3609, 0.016189, " AI", false], [53052, 0.013832, " success", false]]]}, "raw_delta": -0.044921875, "tuned_delta": 0.009167722415075588}, {"byte_start": 5401, "byte_end": 5410, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 933, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"model_a": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "model_b": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21%"}, "model_tokens": {"model_a": [[56950, " progress", "normal", 0.7676780223846436]], "model_b": [[56950, " progress", "normal", 0.5445321798324585]]}, "loss": {"model_a": 0.5283307034505481, "model_b": 1.2132038375531107}, "topk": {"model_a": [56950, 1, 0.7676780223846436, [[56950, 0.767678, " progress", false], [63621, 0.064471, " improvement", false], [57103, 0.03445, " research", false], [63469, 0.026276, " development", false], [63750, 0.017198, " performance", false], [56537, 0.0125, " learning", false], [64423, 0.009459, " improvements", false], [46132, 0.007171, " growth", false], [55465, 0.005687, " advances", false], [53052, 0.00488, " success", false]]], "model_b": [56950, 1, 0.5445321798324585, [[56950, 0.544532, " progress", false], [63621, 0.136027, " improvement", false], [46132, 0.051639, " growth", false], [63750, 0.027893, " performance", false], [38575, 0.026848, " gains", false], [63265, 0.024929, " advancement", false], [56537, 0.022304, " learning", false], [57103, 0.017195, " research", false], [53052, 0.017126, " success", false], [64423, 0.016987, " improvements", false]]]}, "raw_delta": -0.03797743055555555, "tuned_delta": 0.016112166859520036}, {"byte_start": 5410, "byte_end": 5411, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "16.84%", "model_b": "32.26%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.39145898818969727]], "model_b": [[45, ",", "normal", 0.16725587844848633]]}, "loss": {"model_a": 16.83613841662413, "model_b": 32.263394957380136}, "topk": {"model_a": [45, 2, 0.39145898818969727, [[47, 0.44562, ".", false], [45, 0.391459, ",", false], [21265, 0.018936, " and", false], [4450, 0.015545, " by", false], [4596, 0.015309, " in", false], [5346, 0.015023, "---", false], [51018, 0.014348, " because", false], [4423, 0.014031, " as", false], [275, 0.01284, " (", false], [60, 0.007438, ";", false]]], "model_b": [45, 2, 0.16725587844848633, [[47, 0.662412, ".", false], [45, 0.167256, ",", false], [4596, 0.030271, " in", false], [51018, 0.025666, " because", false], [275, 0.014004, " (", false], [4450, 0.013803, " by", false], [21265, 0.0127, " and", false], [4423, 0.008189, " as", false], [32465, 0.008154, " when", false], [5346, 0.007063, "---", false]]]}, "raw_delta": -0.85546875, "tuned_delta": -0.8013791525849244}, {"byte_start": 5411, "byte_end": 5415, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 934, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "2.89% 2.89% 2.89% 2.89%", "model_b": "3.63% 3.63% 3.63% 3.63%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.5252609848976135]], "model_b": [[21265, " and", "normal", 0.4452229142189026]]}, "loss": {"model_a": 2.8882078455296627, "model_b": 3.62787083036043}, "topk": {"model_a": [21265, 1, 0.5252609848976135, [[21265, 0.525261, " and", false], [287, 0.108301, " 4", false], [51018, 0.057239, " because", false], [40187, 0.045891, " while", false], [4423, 0.03307, " as", false], [53339, 0.019971, " whereas", false], [4715, 0.009878, " or", false], [32465, 0.0089, " when", false], [61953, 0.008477, " especially", false], [40186, 0.008407, " which", false]]], "model_b": [21265, 1, 0.4452229142189026, [[21265, 0.445223, " and", false], [51018, 0.112964, " because", false], [287, 0.086072, " 4", false], [4423, 0.073744, " as", false], [32465, 0.015144, " when", false], [21572, 0.012936, " due", false], [4715, 0.011803, " or", false], [4788, 0.011763, " so", false], [4588, 0.008857, " if", false], [52107, 0.008597, " leading", false]]]}, "raw_delta": -0.041015625, "tuned_delta": 0.013073972415075588}, {"byte_start": 5415, "byte_end": 5417, "display": {"text": " 4", "kind": "normal"}, "is_word": true, "word_id": 935, "word_key": " 4", "bytes_hex": "20 34", "compression": {"model_a": "1.51% 1.51%", "model_b": "4.97% 4.97%"}, "model_tokens": {"model_a": [[287, " 4", "normal", 0.8443912863731384]], "model_b": [[287, " 4", "normal", 0.5801259279251099]]}, "loss": {"model_a": 1.514548016558238, "model_b": 4.966308612435152}, "topk": {"model_a": [287, 1, 0.8443912863731384, [[287, 0.844391, " 4", false], [4600, 0.015825, " is", false], [32227, 0.010586, " that", false], [22590, 0.008069, " the", false], [51744, 0.007588, " finally", false], [61959, 0.006686, " eventually", false], [4601, 0.00656, " it", false], [45, 0.005482, ",", false], [30788, 0.004141, " even", false], [32234, 0.003679, " this", false]]], "model_b": [287, 1, 0.5801259279251099, [[287, 0.580126, " 4", false], [51744, 0.057454, " finally", false], [61959, 0.027027, " eventually", false], [45, 0.02438, ",", false], [62676, 0.02021, " ultimately", false], [22590, 0.020025, " the", false], [4600, 0.017413, " is", false], [4601, 0.015063, " it", false], [32227, 0.014568, " that", false], [4596, 0.010776, " in", false]]]}, "raw_delta": -0.19140625, "tuned_delta": -0.13731665258492443}, {"byte_start": 5417, "byte_end": 5418, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"model_a": "0.02%", "model_b": "0.02%"}, "model_tokens": {"model_a": [[42, ")", "normal", 0.9990647435188293]], "model_b": [[42, ")", "normal", 0.9987460374832153]]}, "loss": {"model_a": 0.016716713663865, "model_b": 0.02256412379320049}, "topk": {"model_a": [42, 1, 0.9990647435188293, [[42, 0.999065, ")", false], [47, 0.000141, ".", false], [497, 0.000141, "),", false], [499, 0.00012, ").", false], [276, 0.00012, " )", false], [98, 6.4e-05, "a", false], [45, 4.3e-05, ",", false], [580, 3.9e-05, ".)", false], [22590, 3e-05, " the", false], [32227, 1.7e-05, " that", false]]], "model_b": [42, 1, 0.9987460374832153, [[42, 0.998746, ")", false], [497, 0.000316, "),", false], [499, 0.000149, ").", false], [45, 0.000108, ",", false], [276, 0.000108, " )", false], [564, 4.9e-05, "-)", false], [47, 3.2e-05, ".", false], [46, 2.6e-05, "-", false], [5308, 2.5e-05, ")--", false], [580, 2.4e-05, ".)", false]]]}, "raw_delta": -0.000324249267578125, "tuned_delta": 0.05376534814749746}, {"byte_start": 5418, "byte_end": 5431, "display": {"text": " breakthrough", "kind": "normal"}, "is_word": true, "word_id": 936, "word_key": " breakthrough", "bytes_hex": "20 62 72 65 61 6b 74 68 72 6f 75 67 68", "compression": {"model_a": "13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01%", "model_b": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%"}, "model_tokens": {"model_a": [[64266, " breakthrough", "normal", 8.692935080034658e-05]], "model_b": [[64266, " breakthrough", "normal", 0.00017870469309855253]]}, "loss": {"model_a": 13.005063469551951, "model_b": 11.964658391987795}, "topk": {"model_a": [64266, 358, 8.692935080034658e-05, [[22590, 0.210888, " the", false], [4601, 0.071538, " it", false], [4596, 0.059609, " in", false], [52028, 0.043644, " instead", false], [39934, 0.032084, " there", false], [52224, 0.030895, " methods", false], [32234, 0.029483, " this", false], [32465, 0.027287, " when", false], [332, 0.02339, " a", false], [32227, 0.02271, " that", false]]], "model_b": [64266, 256, 0.00017870469309855253, [[22590, 0.203655, " the", false], [4601, 0.095474, " it", false], [32234, 0.072982, " this", false], [4596, 0.046852, " in", false], [32465, 0.04456, " when", false], [3609, 0.043638, " AI", false], [39934, 0.033207, " there", false], [32227, 0.022218, " that", false], [39936, 0.017176, " these", false], [4858, 0.01376, " we", false]]]}, "raw_delta": 0.05769230769230771, "tuned_delta": 0.1117819051073833}, {"byte_start": 5431, "byte_end": 5440, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 937, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"model_a": "5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01%", "model_b": "9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46%"}, "model_tokens": {"model_a": [[56950, " progress", "normal", 0.08195258677005768]], "model_b": [[56950, " progress", "normal", 0.009049524553120136]]}, "loss": {"model_a": 5.009357780864455, "model_b": 9.455162811381658}, "topk": {"model_a": [56950, 2, 0.08195258677005768, [[116, 0.784498, "s", false], [56950, 0.081953, " progress", false], [52224, 0.054013, " methods", false], [63750, 0.008182, " performance", false], [64423, 0.008025, " improvements", false], [62633, 0.007093, " techniques", false], [57103, 0.006015, " research", false], [55465, 0.005452, " advances", false], [52738, 0.005396, " results", false], [61590, 0.004307, " approaches", false]]], "model_b": [56950, 2, 0.009049524553120136, [[116, 0.882624, "s", false], [56950, 0.00905, " progress", false], [52738, 0.008718, " results", false], [57103, 0.007082, " research", false], [63484, 0.006885, " discoveries", false], [52224, 0.005479, " methods", false], [64423, 0.005442, " improvements", false], [63750, 0.003925, " performance", false], [55465, 0.003275, " advances", false], [60587, 0.003119, " successes", false]]]}, "raw_delta": -0.24652777777777773, "tuned_delta": -0.19243818036270216}, {"byte_start": 5440, "byte_end": 5451, "display": {"text": " eventually", "kind": "normal"}, "is_word": true, "word_id": 938, "word_key": " eventually", "bytes_hex": "20 65 76 65 6e 74 75 61 6c 6c 79", "compression": {"model_a": "11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12%", "model_b": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"model_a": [[61959, " eventually", "normal", 0.0011185797629877925]], "model_b": [[61959, " eventually", "normal", 0.007088968064635992]]}, "loss": {"model_a": 11.117358802304864, "model_b": 8.094666777715064}, "topk": {"model_a": [61959, 47, 0.0011185797629877925, [[4600, 0.260561, " is", false], [38087, 0.154675, " comes", false], [21800, 0.089359, " has", false], [4596, 0.076166, " in", false], [45150, 0.053771, " always", false], [21413, 0.050387, " can", false], [46697, 0.026159, " occurs", false], [45, 0.02253, ",", false], [51896, 0.020185, " happens", false], [45145, 0.019772, " almost", false]]], "model_b": [61959, 19, 0.007088968064635992, [[4600, 0.248987, " is", false], [4596, 0.161395, " in", false], [38087, 0.068235, " comes", false], [21800, 0.04492, " has", false], [39171, 0.035265, " often", false], [21413, 0.02843, " can", false], [45, 0.024241, ",", false], [46697, 0.022858, " occurs", false], [51896, 0.022739, " happens", false], [30659, 0.019764, " does", false]]]}, "raw_delta": 0.16761363636363633, "tuned_delta": 0.22170323377871193}, {"byte_start": 5451, "byte_end": 5459, "display": {"text": " arrives", "kind": "normal"}, "is_word": true, "word_id": 939, "word_key": " arrives", "bytes_hex": "20 61 72 72 69 76 65 73", "compression": {"model_a": "9.09% 9.09% 9.09% 9.09% 9.09% 9.09% 9.09% 9.09%", "model_b": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%"}, "model_tokens": {"model_a": [[50956, " arrives", "normal", 0.017871713265776634]], "model_b": [[50956, " arrives", "normal", 0.02296433039009571]]}, "loss": {"model_a": 9.087288099349427, "model_b": 8.523735349002175}, "topk": {"model_a": [50956, 7, 0.017871713265776634, [[38087, 0.660999, " comes", false], [46697, 0.061924, " occurs", false], [51896, 0.038454, " happens", false], [57102, 0.028955, " requires", false], [30659, 0.025431, " does", false], [4600, 0.018528, " is", false], [50956, 0.017872, " arrives", false], [45199, 0.009327, " arises", false], [51586, 0.008961, " emerges", false], [52738, 0.007925, " results", false]]], "model_b": [50956, 10, 0.02296433039009571, [[38087, 0.289598, " comes", false], [46697, 0.103988, " occurs", false], [51896, 0.066013, " happens", false], [39828, 0.040898, " stops", false], [52488, 0.031788, " plateau", false], [51019, 0.026981, " becomes", false], [57102, 0.02367, " requires", false], [39888, 0.023204, " takes", false], [38875, 0.022995, " leads", false], [50956, 0.022964, " arrives", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08533959741507559}, {"byte_start": 5459, "byte_end": 5462, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 940, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "14.18% 14.18% 14.18%", "model_b": "19.63% 19.63% 19.63%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.09448861330747604]], "model_b": [[4450, " by", "normal", 0.03840164840221405]]}, "loss": {"model_a": 14.182744217072491, "model_b": 19.630420803762586}, "topk": {"model_a": [4450, 3, 0.09448861330747604, [[32465, 0.256046, " when", false], [30917, 0.128342, " from", false], [4450, 0.094489, " by", false], [31581, 0.090725, " only", false], [53140, 0.079759, " through", false], [22705, 0.040717, " via", false], [32487, 0.039308, " with", false], [45, 0.035888, ",", false], [4596, 0.028899, " in", false], [32227, 0.028239, " that", false]]], "model_b": [4450, 6, 0.03840164840221405, [[47, 0.207413, ".", false], [45, 0.207349, ",", false], [32465, 0.110717, " when", false], [4596, 0.07988, " in", false], [53140, 0.052335, " through", false], [4450, 0.038402, " by", false], [21265, 0.032371, " and", false], [30917, 0.02783, " from", false], [31581, 0.023201, " only", false], [4424, 0.01908, " at", false]]]}, "raw_delta": -0.30208333333333337, "tuned_delta": -0.2479937359182578}, {"byte_start": 5462, "byte_end": 5465, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 941, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"model_a": "33.81% 33.81% 33.81%", "model_b": "30.81% 30.81% 30.81%"}, "model_tokens": {"model_a": [[4419, " an", "normal", 0.003557920688763261]], "model_b": [[4419, " an", "normal", 0.0058524818159639835]]}, "loss": {"model_a": 33.81316502083508, "model_b": 30.8075503523164}, "topk": {"model_a": [4419, 44, 0.003557920688763261, [[38888, 0.094816, " lever", false], [40085, 0.070304, " using", false], [47497, 0.067727, " taking", false], [59611, 0.067172, " embracing", false], [38989, 0.049284, " means", false], [55666, 0.038724, " building", false], [332, 0.035454, " a", false], [46500, 0.0348, " making", false], [39193, 0.034005, " other", false], [55586, 0.02101, " avoiding", false]]], "model_b": [4419, 25, 0.0058524818159639835, [[38888, 0.215584, " lever", false], [332, 0.056861, " a", false], [22590, 0.054658, " the", false], [38989, 0.05397, " means", false], [40085, 0.034778, " using", false], [47497, 0.028609, " taking", false], [56537, 0.021043, " learning", false], [55531, 0.02, " applying", false], [61984, 0.017756, " exploiting", false], [47285, 0.015181, " simply", false]]]}, "raw_delta": 0.16666666666666674, "tuned_delta": 0.22075626408174231}, {"byte_start": 5465, "byte_end": 5474, "display": {"text": " opposing", "kind": "normal"}, "is_word": true, "word_id": 942, "word_key": " opposing", "bytes_hex": "20 6f 70 70 6f 73 69 6e 67", "compression": {"model_a": "13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90%", "model_b": "16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66% 16.66%"}, "model_tokens": {"model_a": [[56766, " opposing", "normal", 0.0009504445479251444]], "model_b": [[56766, " opposing", "normal", 0.0002500218106433749]]}, "loss": {"model_a": 13.900967841898863, "model_b": 16.65611462137431}, "topk": {"model_a": [56766, 55, 0.0009504445479251444, [[63277, 0.399267, " alternative", false], [56131, 0.25246, " entirely", false], [55532, 0.084354, " approach", false], [59121, 0.017096, " alternate", false], [56767, 0.014497, " opposite", false], [63627, 0.01305, " independent", false], [39193, 0.011962, " other", false], [62688, 0.008506, " unexpected", false], [37636, 0.006338, " agent", false], [63621, 0.00584, " improvement", false]]], "model_b": [56766, 235, 0.0002500218106433749, [[56131, 0.471181, " entirely", false], [62688, 0.078722, " unexpected", false], [63627, 0.017513, " independent", false], [37636, 0.017392, " agent", false], [59113, 0.016331, " algorithm", false], [55430, 0.014577, " accident", false], [63277, 0.011766, " alternative", false], [61566, 0.011303, " altogether", false], [52391, 0.011237, " outside", false], [53235, 0.009373, " unknown", false]]]}, "raw_delta": -0.1527777777777778, "tuned_delta": -0.0986881803627022}, {"byte_start": 5474, "byte_end": 5483, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 943, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20%", "model_b": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.1232675313949585]], "model_b": [[55532, " approach", "normal", 0.014843225479125977]]}, "loss": {"model_a": 4.195337141473982, "model_b": 8.45329125520877}, "topk": {"model_a": [55532, 2, 0.1232675313949585, [[39552, 0.302602, " route", false], [55532, 0.123268, " approach", false], [46561, 0.1229, " method", false], [31637, 0.07388, " path", false], [45, 0.073874, ",", false], [57317, 0.051959, " strategy", false], [38536, 0.035433, " force", false], [38989, 0.025893, " means", false], [59526, 0.019725, " direction", false], [51832, 0.016345, " general", false]]], "model_b": [55532, 12, 0.014843225479125977, [[38536, 0.180919, " force", false], [39552, 0.117344, " route", false], [59994, 0.11418, " mechanism", false], [46561, 0.089305, " method", false], [57317, 0.05123, " strategy", false], [45, 0.035886, ",", false], [31637, 0.035202, " path", false], [52571, 0.034749, " process", false], [40009, 0.03445, " trend", false], [38989, 0.032857, " means", false]]]}, "raw_delta": -0.2361111111111111, "tuned_delta": -0.18202151369603553}, {"byte_start": 5483, "byte_end": 5489, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 944, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"model_a": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%", "model_b": "12.87% 12.87% 12.87% 12.87% 12.87% 12.87%"}, "model_tokens": {"model_a": [[37810, " based", "normal", 0.029513614252209663]], "model_b": [[37810, " based", "normal", 0.013707584701478481]]}, "loss": {"model_a": 10.613576798206566, "model_b": 12.86778779959557}, "topk": {"model_a": [37810, 5, 0.029513614252209663, [[32227, 0.381868, " that", false], [45, 0.224016, ",", false], [47, 0.123714, ".", false], [5346, 0.114852, "---", false], [37810, 0.029514, " based", false], [4706, 0.020603, " of", false], [59, 0.019219, ":", false], [4811, 0.013707, " to", false], [275, 0.01159, " (", false], [21265, 0.00929, " and", false]]], "model_b": [37810, 8, 0.013707584701478481, [[47, 0.370026, ".", false], [45, 0.228005, ",", false], [32227, 0.134062, " that", false], [5346, 0.104069, "---", false], [275, 0.027305, " (", false], [59, 0.016403, ":", false], [4811, 0.014847, " to", false], [37810, 0.013708, " based", false], [21265, 0.009173, " and", false], [568, 0.005919, "--", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07091040258492441}, {"byte_start": 5489, "byte_end": 5492, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 945, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"model_a": "0.50% 0.50% 0.50%", "model_b": "0.57% 0.57% 0.57%"}, "model_tokens": {"model_a": [[4712, " on", "normal", 0.9195689558982849]], "model_b": [[4712, " on", "normal", 0.909875214099884]]}, "loss": {"model_a": 0.504849338852746, "model_b": 0.5694230914967019}, "topk": {"model_a": [4712, 1, 0.9195689558982849, [[4712, 0.919569, " on", false], [31581, 0.01471, " only", false], [47330, 0.011791, " solely", false], [31458, 0.00854, " more", false], [46957, 0.007562, " purely", false], [22187, 0.00604, " not", false], [4596, 0.003631, " in", false], [52028, 0.003594, " instead", false], [56131, 0.003026, " entirely", false], [47285, 0.001941, " simply", false]]], "model_b": [4712, 1, 0.909875214099884, [[4712, 0.909875, " on", false], [4596, 0.021324, " in", false], [32350, 0.013442, " upon", false], [56131, 0.007959, " entirely", false], [47330, 0.00627, " solely", false], [31458, 0.005792, " more", false], [31581, 0.003822, " only", false], [46957, 0.003182, " purely", false], [45, 0.002831, ",", false], [52094, 0.002588, " largely", false]]]}, "raw_delta": -0.003580729166666668, "tuned_delta": 0.05050886824840892}, {"byte_start": 5492, "byte_end": 5500, "display": {"text": " scaling", "kind": "normal"}, "is_word": true, "word_id": 946, "word_key": " scaling", "bytes_hex": "20 73 63 61 6c 69 6e 67", "compression": {"model_a": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78% 15.78% 15.78%", "model_b": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%"}, "model_tokens": {"model_a": [[52805, " scaling", "normal", 0.0008995500393211842]], "model_b": [[52805, " scaling", "normal", 0.0009920340962707996]]}, "loss": {"model_a": 15.779477009723035, "model_b": 15.568144728342816}, "topk": {"model_a": [52805, 51, 0.0008995500393211842, [[52195, 0.47432, " massive", false], [63370, 0.151678, " computation", false], [59988, 0.039656, " massively", false], [38888, 0.027267, " lever", false], [22590, 0.026972, " the", false], [47202, 0.024024, " search", false], [51832, 0.022338, " general", false], [31458, 0.013133, " more", false], [332, 0.012098, " a", false], [31466, 0.011167, " much", false]]], "model_b": [52805, 69, 0.0009920340962707996, [[52195, 0.302584, " massive", false], [51832, 0.087174, " general", false], [38888, 0.059777, " lever", false], [56537, 0.057654, " learning", false], [22590, 0.054307, " the", false], [63370, 0.027445, " computation", false], [332, 0.023829, " a", false], [30597, 0.0167, " deep", false], [59346, 0.015604, " computing", false], [65135, 0.015323, " generalization", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06580834741507559}, {"byte_start": 5500, "byte_end": 5512, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 947, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "model_b": "3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.3625050485134125]], "model_b": [[63370, " computation", "normal", 0.09871537983417511]]}, "loss": {"model_a": 1.514548016558238, "model_b": 3.4752419604747162}, "topk": {"model_a": [63370, 2, 0.3625050485134125, [[4833, 0.368705, " up", false], [63370, 0.362505, " computation", false], [21265, 0.043918, " and", false], [45, 0.027719, ",", false], [52195, 0.02201, " massive", false], [47, 0.017585, ".", false], [4706, 0.012807, " of", false], [64862, 0.011428, " computational", false], [22590, 0.010869, " the", false], [46, 0.008844, "-", false]]], "model_b": [63370, 2, 0.09871537983417511, [[4833, 0.356973, " up", false], [63370, 0.098715, " computation", false], [30678, 0.066451, " down", false], [22590, 0.051615, " the", false], [21265, 0.046685, " and", false], [47, 0.030088, ".", false], [46, 0.025252, "-", false], [45, 0.023831, ",", false], [4811, 0.01922, " to", false], [30218, 0.014933, " back", false]]]}, "raw_delta": -0.10872395833333333, "tuned_delta": -0.05463436091825774}, {"byte_start": 5512, "byte_end": 5515, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 948, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "26.30% 26.30% 26.30%", "model_b": "27.80% 27.80% 27.80%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.012551532126963139]], "model_b": [[4450, " by", "normal", 0.009829221293330193]]}, "loss": {"model_a": 26.299128349538393, "model_b": 27.80193568379773}, "topk": {"model_a": [4450, 10, 0.012551532126963139, [[21265, 0.341814, " and", false], [47, 0.206012, ".", false], [45, 0.134494, ",", false], [4811, 0.054574, " to", false], [4833, 0.028509, " up", false], [275, 0.020292, " (", false], [4596, 0.020291, " in", false], [47001, 0.020043, " rather", false], [5346, 0.017119, "---", false], [4450, 0.012552, " by", false]]], "model_b": [4450, 13, 0.009829221293330193, [[47, 0.319527, ".", false], [21265, 0.203658, " and", false], [45, 0.12133, ",", false], [4811, 0.052727, " to", false], [47001, 0.033987, " rather", false], [4833, 0.031188, " up", false], [32487, 0.019978, " with", false], [4596, 0.019771, " in", false], [275, 0.019609, " (", false], [30678, 0.017582, " down", false]]]}, "raw_delta": -0.08333333333333348, "tuned_delta": -0.029243735918257893}, {"byte_start": 5515, "byte_end": 5522, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 949, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%", "model_b": "14.49% 14.49% 14.49% 14.49% 14.49% 14.49% 14.49%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.010901223868131638]], "model_b": [[47202, " search", "normal", 0.003589645028114319]]}, "loss": {"model_a": 11.673592685764493, "model_b": 14.49135643750075}, "topk": {"model_a": [47202, 12, 0.010901223868131638, [[37045, 0.371462, " Moore", false], [52195, 0.17144, " massive", false], [332, 0.047983, " a", false], [59988, 0.040987, " massively", false], [38888, 0.038125, " lever", false], [40085, 0.022373, " using", false], [46718, 0.016342, " orders", false], [22590, 0.014957, " the", false], [51832, 0.013006, " general", false], [38989, 0.012471, " means", false]]], "model_b": [47202, 31, 0.003589645028114319, [[52195, 0.133972, " massive", false], [38888, 0.10828, " lever", false], [38989, 0.091481, " means", false], [332, 0.086192, " a", false], [22590, 0.064938, " the", false], [59988, 0.033708, " massively", false], [47497, 0.02664, " taking", false], [51832, 0.018934, " general", false], [37045, 0.017494, " Moore", false], [55531, 0.015809, " applying", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10216040258492441}, {"byte_start": 5522, "byte_end": 5526, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 950, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "3.73% 3.73% 3.73% 3.73%", "model_b": "7.33% 7.33% 7.33% 7.33%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.4349638819694519]], "model_b": [[21265, " and", "normal", 0.19632764160633087]]}, "loss": {"model_a": 3.7335369710505395, "model_b": 7.326185754514267}, "topk": {"model_a": [21265, 1, 0.4349638819694519, [[21265, 0.434964, " and", false], [4715, 0.385931, " or", false], [45, 0.078134, ",", false], [47, 0.034275, ".", false], [275, 0.02465, " (", false], [48, 0.009226, "/", false], [5346, 0.004794, "---", false], [4596, 0.004341, " in", false], [52224, 0.002546, " methods", false], [4811, 0.001489, " to", false]]], "model_b": [21265, 2, 0.19632764160633087, [[47, 0.34322, ".", false], [21265, 0.196328, " and", false], [45, 0.142498, ",", false], [4715, 0.108907, " or", false], [275, 0.028384, " (", false], [46, 0.027679, "-", false], [47001, 0.021832, " rather", false], [4596, 0.013271, " in", false], [52028, 0.012299, " instead", false], [52224, 0.01129, " methods", false]]]}, "raw_delta": -0.19921875, "tuned_delta": -0.14512915258492443}, {"byte_start": 5526, "byte_end": 5535, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 951, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90%", "model_b": "1.61% 1.61% 1.61% 1.61% 1.61% 1.61% 1.61% 1.61% 1.61%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.6373797059059143]], "model_b": [[56537, " learning", "normal", 0.4473676085472107]]}, "loss": {"model_a": 0.9040325370153822, "model_b": 1.6123870357157468}, "topk": {"model_a": [56537, 1, 0.6373797059059143, [[56537, 0.63738, " learning", false], [48, 0.146796, "/", false], [4450, 0.081643, " by", false], [31978, 0.01792, " self", false], [38888, 0.013293, " lever", false], [62577, 0.009892, " statistics", false], [63885, 0.008487, " statistical", false], [45, 0.005723, ",", false], [32230, 0.004032, " then", false], [22590, 0.003748, " the", false]]], "model_b": [56537, 1, 0.4473676085472107, [[56537, 0.447368, " learning", false], [38888, 0.100571, " lever", false], [65135, 0.059654, " generalization", false], [4450, 0.054201, " by", false], [51832, 0.029917, " general", false], [30597, 0.022367, " deep", false], [48, 0.014097, "/", false], [39193, 0.013869, " other", false], [22590, 0.012718, " the", false], [40085, 0.011187, " using", false]]]}, "raw_delta": -0.03927951388888889, "tuned_delta": 0.0148100835261867}, {"byte_start": 5535, "byte_end": 5536, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "10.57%", "model_b": "9.65%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5536013841629028]], "model_b": [[47, ".", "normal", 0.5882070064544678]]}, "loss": {"model_a": 10.566614069010962, "model_b": 9.650840849696678}, "topk": {"model_a": [47, 1, 0.5536013841629028, [[47, 0.553601, ".", false], [45, 0.187041, ",", false], [5346, 0.050885, "---", false], [4450, 0.040365, " by", false], [21265, 0.031979, " and", false], [275, 0.019057, " (", false], [4596, 0.01244, " in", false], [4712, 0.008232, " on", false], [4811, 0.007784, " to", false], [47001, 0.007466, " rather", false]]], "model_b": [47, 1, 0.5882070064544678, [[47, 0.588207, ".", false], [45, 0.125995, ",", false], [4450, 0.071512, " by", false], [4712, 0.044546, " on", false], [4596, 0.024752, " in", false], [275, 0.013975, " (", false], [21265, 0.012848, " and", false], [4811, 0.011858, " to", false], [5346, 0.007518, "---", false], [32487, 0.005509, " with", false]]]}, "raw_delta": 0.05078125, "tuned_delta": 0.10487084741507559}, {"byte_start": 5536, "byte_end": 5540, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 952, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "11.69% 11.69% 11.69% 11.69%", "model_b": "10.36% 10.36% 10.36% 10.36%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.07541705667972565]], "model_b": [[20996, " The", "normal", 0.10263341665267944]]}, "loss": {"model_a": 11.693719569705465, "model_b": 10.355281787630743}, "topk": {"model_a": [20996, 2, 0.07541705667972565, [[261, 0.52264, "\n\n", false], [20996, 0.075417, " The", false], [29894, 0.042126, " This", false], [4331, 0.03552, " We", false], [267, 0.034, "  ", false], [3913, 0.02105, " In", false], [3918, 0.017224, " It", false], [3336, 0.013511, " \n\n", false], [37453, 0.013192, " These", false], [4255, 0.012783, " To", false]]], "model_b": [20996, 2, 0.10263341665267944, [[261, 0.302991, "\n\n", false], [20996, 0.102633, " The", false], [29894, 0.074797, " This", false], [267, 0.048001, "  ", false], [3913, 0.031745, " In", false], [11, 0.030649, "\n", false], [37453, 0.028891, " These", false], [3918, 0.02559, " It", false], [4331, 0.024429, " We", false], [19417, 0.014607, " And", false]]]}, "raw_delta": 0.07421875, "tuned_delta": 0.12830834741507557}, {"byte_start": 5540, "byte_end": 5549, "display": {"text": " eventual", "kind": "normal"}, "is_word": true, "word_id": 953, "word_key": " eventual", "bytes_hex": "20 65 76 65 6e 74 75 61 6c", "compression": {"model_a": "16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28%", "model_b": "17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28%"}, "model_tokens": {"model_a": [[56154, " eventual", "normal", 0.00029455721960403025]], "model_b": [[56154, " eventual", "normal", 0.00017978671530727297]]}, "loss": {"model_a": 16.28041278780948, "model_b": 17.282284343982372}, "topk": {"model_a": [56154, 332, 0.00029455721960403025, [[45315, 0.201228, " bitter", false], [46430, 0.107066, " lesson", false], [47009, 0.022126, " reason", false], [45184, 0.021001, " appeal", false], [21952, 0.020405, " key", false], [52127, 0.015971, " lessons", false], [38499, 0.013635, " first", false], [31461, 0.012251, " most", false], [21365, 0.011016, " bit", false], [62061, 0.009609, " historical", false]]], "model_b": [56154, 379, 0.00017978671530727297, [[45315, 0.513794, " bitter", false], [46430, 0.014808, " lesson", false], [61640, 0.013501, " bitterness", false], [31461, 0.011341, " most", false], [21952, 0.011107, " key", false], [31581, 0.01007, " only", false], [38499, 0.008863, " first", false], [52127, 0.008118, " lessons", false], [21357, 0.007025, " big", false], [38720, 0.006903, " human", false]]]}, "raw_delta": -0.05555555555555558, "tuned_delta": -0.001465958140479992}, {"byte_start": 5549, "byte_end": 5557, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 954, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"model_a": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%", "model_b": "7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"model_a": [[53052, " success", "normal", 0.1292545348405838]], "model_b": [[53052, " success", "normal", 0.0381464846432209]]}, "loss": {"model_a": 4.61408814346812, "model_b": 7.361407801410969}, "topk": {"model_a": [53052, 1, 0.1292545348405838, [[53052, 0.129255, " success", false], [64266, 0.089544, " breakthrough", false], [57260, 0.039538, " solution", false], [47798, 0.032321, " winner", false], [53198, 0.026578, " triumph", false], [7933, 0.026454, "ity", false], [56950, 0.022981, " progress", false], [46430, 0.018824, " lesson", false], [53283, 0.017154, " victory", false], [52382, 0.015983, " outcome", false]]], "model_b": [53052, 4, 0.0381464846432209, [[47798, 0.161343, " winner", false], [46430, 0.081783, " lesson", false], [47092, 0.076889, " result", false], [53052, 0.038146, " success", false], [52382, 0.028275, " outcome", false], [53353, 0.02573, " winners", false], [64266, 0.023792, " breakthrough", false], [53283, 0.020265, " victory", false], [53198, 0.018395, " triumph", false], [31637, 0.018244, " path", false]]]}, "raw_delta": -0.15234375, "tuned_delta": -0.09825415258492441}, {"byte_start": 5557, "byte_end": 5560, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 955, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "17.09% 17.09% 17.09%", "model_b": "16.91% 16.91% 16.91%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.05810806155204773]], "model_b": [[4600, " is", "normal", 0.059561144560575485]]}, "loss": {"model_a": 17.094433427199956, "model_b": 16.90658251041754}, "topk": {"model_a": [4600, 2, 0.05810806155204773, [[4706, 0.784938, " of", false], [4600, 0.058108, " is", false], [4596, 0.0279, " in", false], [38087, 0.012747, " comes", false], [45, 0.007718, ",", false], [51434, 0.007197, " depends", false], [32475, 0.0068, " will", false], [4450, 0.006312, " by", false], [21800, 0.00585, " has", false], [22748, 0.004845, " was", false]]], "model_b": [4600, 2, 0.059561144560575485, [[4706, 0.711358, " of", false], [4600, 0.059561, " is", false], [4596, 0.048818, " in", false], [38087, 0.020594, " comes", false], [4715, 0.019867, " or", false], [39831, 0.012078, " story", false], [45, 0.011101, ",", false], [51434, 0.009026, " depends", false], [21265, 0.008624, " and", false], [32475, 0.008168, " will", false]]]}, "raw_delta": 0.01041666666666663, "tuned_delta": 0.06450626408174222}, {"byte_start": 5560, "byte_end": 5565, "display": {"text": " ting", "kind": "normal"}, "is_word": true, "word_id": 956, "word_key": " ting", "bytes_hex": "20 74 69 6e 67", "compression": {"model_a": "49.59% 49.59% 49.59% 49.59% 49.59%", "model_b": "48.24% 48.24% 48.24% 48.24% 48.24%"}, "model_tokens": {"model_a": [[32252, " ting", "normal", 1.0751234640338225e-06]], "model_b": [[32252, " ting", "normal", 1.5756770608277293e-06]]}, "loss": {"model_a": 49.59264203055811, "model_b": 48.2401154297247}, "topk": {"model_a": [32252, 4981, 1.0751234640338225e-06, [[37810, 0.134978, " based", false], [22187, 0.130543, " not", false], [21572, 0.056394, " due", false], [45150, 0.056135, " always", false], [332, 0.044849, " a", false], [22590, 0.039081, " the", false], [4596, 0.016419, " in", false], [4450, 0.014284, " by", false], [62109, 0.01383, " inevitable", false], [39171, 0.012576, " often", false]]], "model_b": [32252, 3951, 1.5756770608277293e-06, [[22187, 0.145104, " not", false], [22590, 0.091116, " the", false], [332, 0.083791, " a", false], [37810, 0.074785, " based", false], [21572, 0.068347, " due", false], [32227, 0.038097, " that", false], [45150, 0.021523, " always", false], [39171, 0.018907, " often", false], [4596, 0.018725, " in", false], [61853, 0.015816, " determined", false]]]}, "raw_delta": 0.07500000000000018, "tuned_delta": 0.12908959741507575}, {"byte_start": 5565, "byte_end": 5567, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 957, "word_key": "ed", "bytes_hex": "65 64", "compression": {"model_a": "0.01% 0.01%", "model_b": "0.03% 0.03%"}, "model_tokens": {"model_a": [[1843, "ed", "normal", 0.9993645548820496]], "model_b": [[1843, "ed", "normal", 0.996370792388916]]}, "loss": {"model_a": 0.005744220538817808, "model_b": 0.032883082844969005}, "topk": {"model_a": [1843, 1, 0.9993645548820496, [[1843, 0.999365, "ed", false], [1858, 0.000125, "es", false], [25206, 0.000118, "eing", false], [102, 0.000106, "e", false], [8067, 7.6e-05, "led", false], [7856, 4.4e-05, "ing", false], [2030, 2.7e-05, "ly", false], [101, 1.7e-05, "d", false], [26151, 1.4e-05, "ling", false], [116, 1.2e-05, "s", false]]], "model_b": [1843, 1, 0.996370792388916, [[1843, 0.996371, "ed", false], [8067, 0.000667, "led", false], [2030, 0.000592, "ly", false], [1858, 0.000545, "es", false], [102, 0.000469, "e", false], [26151, 0.000315, "ling", false], [7856, 0.00027, "ing", false], [25206, 0.000205, "eing", false], [34780, 9.1e-05, "ingly", false], [25195, 8.1e-05, "edly", false]]]}, "raw_delta": -0.0015048980712890625, "tuned_delta": 0.052584699343786526}, {"byte_start": 5567, "byte_end": 5572, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 958, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "0.46% 0.46% 0.46% 0.46% 0.46%", "model_b": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.8810338377952576]], "model_b": [[32487, " with", "normal", 0.8236837387084961]]}, "loss": {"model_a": 0.4578866096571417, "model_b": 0.6973965285547234}, "topk": {"model_a": [32487, 1, 0.8810338377952576, [[32487, 0.881034, " with", false], [4450, 0.08964, " by", false], [45, 0.007895, ",", false], [4596, 0.005228, " in", false], [332, 0.00273, " a", false], [57263, 0.002144, " somewhat", false], [57245, 0.001472, " slightly", false], [4706, 0.000865, " of", false], [22187, 0.000576, " not", false], [30322, 0.000513, " both", false]]], "model_b": [32487, 1, 0.8236837387084961, [[32487, 0.823684, " with", false], [4450, 0.127868, " by", false], [45, 0.010039, ",", false], [4596, 0.008854, " in", false], [31458, 0.002661, " more", false], [22187, 0.002222, " not", false], [21265, 0.002126, " and", false], [21400, 0.001696, " but", false], [4706, 0.001376, " of", false], [4424, 0.001305, " at", false]]]}, "raw_delta": -0.01328125, "tuned_delta": 0.04080834741507559}, {"byte_start": 5572, "byte_end": 5583, "display": {"text": " bitterness", "kind": "normal"}, "is_word": true, "word_id": 959, "word_key": " bitterness", "bytes_hex": "20 62 69 74 74 65 72 6e 65 73 73", "compression": {"model_a": "3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16%", "model_b": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"model_a": [[61640, " bitterness", "normal", 0.14697323739528656]], "model_b": [[61640, " bitterness", "normal", 0.05831221863627434]]}, "loss": {"model_a": 3.1635802121766146, "model_b": 4.662118207418171}, "topk": {"model_a": [61640, 2, 0.14697323739528656, [[332, 0.148044, " a", false], [61640, 0.146973, " bitterness", false], [22590, 0.103511, " the", false], [45315, 0.088484, " bitter", false], [52793, 0.071181, " sadness", false], [47048, 0.04781, " regret", false], [38805, 0.041348, " irony", false], [65126, 0.040868, " disappointment", false], [53178, 0.034561, " tragedy", false], [63588, 0.019909, " frustration", false]]], "model_b": [61640, 4, 0.05831221863627434, [[332, 0.125423, " a", false], [22590, 0.11137, " the", false], [65126, 0.092464, " disappointment", false], [61640, 0.058312, " bitterness", false], [45315, 0.055581, " bitter", false], [63588, 0.053278, " frustration", false], [38805, 0.031247, " irony", false], [57361, 0.022622, " surprise", false], [47048, 0.019798, " regret", false], [52793, 0.017912, " sadness", false]]]}, "raw_delta": -0.08309659090909094, "tuned_delta": -0.02900699349401535}, {"byte_start": 5583, "byte_end": 5584, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "17.33%", "model_b": "17.47%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.38802972435951233]], "model_b": [[45, ",", "normal", 0.3822399377822876]]}, "loss": {"model_a": 17.329247073177978, "model_b": 17.47013526076479}, "topk": {"model_a": [45, 1, 0.38802972435951233, [[45, 0.38803, ",", false], [51018, 0.203718, " because", false], [21700, 0.081682, " for", false], [47, 0.058162, ".", false], [4423, 0.036781, " as", false], [5346, 0.032045, "---", false], [32227, 0.026848, " that", false], [21265, 0.025683, " and", false], [4596, 0.022714, " in", false], [59, 0.020702, ":", false]]], "model_b": [45, 1, 0.3822399377822876, [[45, 0.38224, ",", false], [47, 0.158381, ".", false], [51018, 0.063661, " because", false], [21700, 0.062245, " for", false], [21265, 0.058761, " and", false], [4596, 0.045561, " in", false], [4811, 0.03516, " to", false], [4450, 0.024117, " by", false], [32465, 0.021822, " when", false], [4423, 0.019755, " as", false]]]}, "raw_delta": -0.0078125, "tuned_delta": 0.04627709741507559}, {"byte_start": 5584, "byte_end": 5588, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 960, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "12.61% 12.61% 12.61% 12.61%", "model_b": "7.43% 7.43% 7.43% 7.43%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.061159905046224594]], "model_b": [[21265, " and", "normal", 0.19467103481292725]]}, "loss": {"model_a": 12.609492789019747, "model_b": 7.431851895204376}, "topk": {"model_a": [21265, 4, 0.061159905046224594, [[51018, 0.275527, " because", false], [21400, 0.27325, " but", false], [4423, 0.179361, " as", false], [21265, 0.06116, " and", false], [21700, 0.025996, " for", false], [4596, 0.025641, " in", false], [39690, 0.025492, " since", false], [22187, 0.016954, " not", false], [40186, 0.0074, " which", false], [4706, 0.006747, " of", false]]], "model_b": [21265, 2, 0.19467103481292725, [[21400, 0.309089, " but", false], [21265, 0.194671, " and", false], [4423, 0.103634, " as", false], [51018, 0.090012, " because", false], [4596, 0.019912, " in", false], [22187, 0.019857, " not", false], [40186, 0.018416, " which", false], [21700, 0.018235, " for", false], [30788, 0.013888, " even", false], [39690, 0.013328, " since", false]]]}, "raw_delta": 0.287109375, "tuned_delta": 0.3411989724150756}, {"byte_start": 5588, "byte_end": 5594, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 961, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"model_a": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%", "model_b": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%"}, "model_tokens": {"model_a": [[39171, " often", "normal", 0.0061404891312122345]], "model_b": [[39171, " often", "normal", 0.016824999824166298]]}, "loss": {"model_a": 15.309849717766994, "model_b": 12.30423504924832}, "topk": {"model_a": [39171, 27, 0.0061404891312122345, [[22590, 0.157922, " the", false], [4601, 0.092219, " it", false], [4858, 0.064718, " we", false], [4600, 0.05719, " is", false], [32234, 0.048891, " this", false], [32227, 0.028623, " that", false], [63843, 0.028011, " researchers", false], [4788, 0.023514, " so", false], [39934, 0.0213, " there", false], [4596, 0.017706, " in", false]]], "model_b": [39171, 10, 0.016824999824166298, [[22590, 0.151424, " the", false], [4600, 0.088762, " is", false], [4601, 0.076661, " it", false], [32234, 0.057752, " this", false], [4858, 0.032, " we", false], [32227, 0.023666, " that", false], [4596, 0.02173, " in", false], [332, 0.020934, " a", false], [39934, 0.018658, " there", false], [39171, 0.016825, " often", false]]]}, "raw_delta": 0.16666666666666674, "tuned_delta": 0.22075626408174231}, {"byte_start": 5594, "byte_end": 5605, "display": {"text": " incomplete", "kind": "normal"}, "is_word": true, "word_id": 962, "word_key": " incomplete", "bytes_hex": "20 69 6e 63 6f 6d 70 6c 65 74 65", "compression": {"model_a": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12%", "model_b": "13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32%"}, "model_tokens": {"model_a": [[62091, " incomplete", "normal", 0.0003408551274333149]], "model_b": [[62091, " incomplete", "normal", 0.00029930341406725347]]}, "loss": {"model_a": 13.11540946262694, "model_b": 13.32033773548048}, "topk": {"model_a": [62091, 280, 0.0003408551274333149, [[32487, 0.058794, " with", false], [22590, 0.058553, " the", false], [56501, 0.050013, " involves", false], [4600, 0.035464, " is", false], [4601, 0.030968, " it", false], [332, 0.026724, " a", false], [38087, 0.02284, " comes", false], [38875, 0.02024, " leads", false], [63843, 0.018899, " researchers", false], [39934, 0.018716, " there", false]]], "model_b": [62091, 390, 0.00029930341406725347, [[32487, 0.125947, " with", false], [22590, 0.059558, " the", false], [4600, 0.032461, " is", false], [332, 0.023696, " a", false], [38087, 0.018386, " comes", false], [45, 0.015497, ",", false], [4601, 0.013173, " it", false], [21800, 0.012828, " has", false], [63250, 0.012512, " accompanied", false], [22187, 0.012352, " not", false]]]}, "raw_delta": -0.011363636363636354, "tuned_delta": 0.042725961051439235}, {"byte_start": 5605, "byte_end": 5607, "display": {"text": "ly", "kind": "normal"}, "is_word": true, "word_id": 963, "word_key": "ly", "bytes_hex": "6c 79", "compression": {"model_a": "12.33% 12.33%", "model_b": "22.26% 22.26%"}, "model_tokens": {"model_a": [[2030, "ly", "normal", 0.25676867365837097]], "model_b": [[2030, "ly", "normal", 0.08574552834033966]]}, "loss": {"model_a": 12.327716413846122, "model_b": 22.260333638716425}, "topk": {"model_a": [2030, 2, 0.25676867365837097, [[45, 0.295248, ",", false], [2030, 0.256769, "ly", false], [47, 0.073437, ".", false], [53052, 0.042392, " success", false], [65034, 0.038996, " understanding", false], [4596, 0.032127, " in", false], [21265, 0.03028, " and", false], [64561, 0.023254, " satisfaction", false], [4715, 0.022527, " or", false], [26307, 0.012927, "ness", false]]], "model_b": [2030, 4, 0.08574552834033966, [[45, 0.194161, ",", false], [47, 0.191433, ".", false], [65034, 0.122689, " understanding", false], [2030, 0.085746, "ly", false], [59943, 0.056563, " knowledge", false], [21265, 0.041037, " and", false], [4715, 0.040282, " or", false], [26307, 0.038381, "ness", false], [53052, 0.025824, " success", false], [4596, 0.009793, " in", false]]]}, "raw_delta": -0.55078125, "tuned_delta": -0.4966916525849244}, {"byte_start": 5607, "byte_end": 5614, "display": {"text": " digest", "kind": "normal"}, "is_word": true, "word_id": 964, "word_key": " digest", "bytes_hex": "20 64 69 67 65 73 74", "compression": {"model_a": "15.94% 15.94% 15.94% 15.94% 15.94% 15.94% 15.94%", "model_b": "22.86% 22.86% 22.86% 22.86% 22.86% 22.86% 22.86%"}, "model_tokens": {"model_a": [[45746, " digest", "normal", 0.0020771108102053404]], "model_b": [[45746, " digest", "normal", 0.00014032830949872732]]}, "loss": {"model_a": 15.940492081250818, "model_b": 22.864140156945616}, "topk": {"model_a": [45746, 26, 0.0020771108102053404, [[62684, 0.53488, " understood", false], [63289, 0.202622, " appreciated", false], [62438, 0.040571, " recognized", false], [64238, 0.017612, " acknowledged", false], [57027, 0.015666, " realized", false], [55428, 0.01557, " accepted", false], [52112, 0.011024, " learned", false], [38625, 0.010959, " grasp", false], [4788, 0.007556, " so", false], [45, 0.006183, ",", false]]], "model_b": [45746, 217, 0.00014032830949872732, [[62684, 0.494364, " understood", false], [59684, 0.167814, " explained", false], [59938, 0.062414, " justified", false], [63289, 0.023993, " appreciated", false], [56178, 0.012564, " explains", false], [62438, 0.007986, " recognized", false], [59488, 0.007929, " described", false], [64290, 0.006609, " communicated", false], [61618, 0.006546, " attributed", false], [21265, 0.005743, " and", false]]]}, "raw_delta": -0.38392857142857145, "tuned_delta": -0.3298389740134959}, {"byte_start": 5614, "byte_end": 5616, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 965, "word_key": "ed", "bytes_hex": "65 64", "compression": {"model_a": "0.06% 0.06%", "model_b": "0.16% 0.16%"}, "model_tokens": {"model_a": [[1843, "ed", "normal", 0.9938040971755981]], "model_b": [[1843, "ed", "normal", 0.982073187828064]]}, "loss": {"model_a": 0.05668548172438172, "model_b": 0.1629019668972523}, "topk": {"model_a": [1843, 1, 0.9938040971755981, [[1843, 0.993804, "ed", false], [25656, 0.005733, "ible", false], [7856, 0.000103, "ing", false], [24381, 0.000103, "able", false], [116, 0.000102, "s", false], [45, 2.4e-05, ",", false], [47, 1.9e-05, ".", false], [7779, 1.6e-05, "ied", false], [4450, 5e-06, " by", false], [46, 5e-06, "-", false]]], "model_b": [1843, 1, 0.982073187828064, [[1843, 0.982073, "ed", false], [25656, 0.015343, "ible", false], [7856, 0.000839, "ing", false], [24381, 0.000793, "able", false], [116, 0.000464, "s", false], [47, 0.000116, ".", false], [45, 6.2e-05, ",", false], [101, 2.1e-05, "d", false], [49224, 1.8e-05, "ibility", false], [4450, 1.8e-05, " by", false]]]}, "raw_delta": -0.005889892578125, "tuned_delta": 0.04819970483695059}, {"byte_start": 5616, "byte_end": 5617, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "17.47%", "model_b": "30.57%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.3821512460708618]], "model_b": [[45, ",", "normal", 0.1826041042804718]]}, "loss": {"model_a": 17.47013526076479, "model_b": 30.572736706338382}, "topk": {"model_a": [45, 1, 0.3821512460708618, [[45, 0.382151, ",", false], [4450, 0.263127, " by", false], [47, 0.176273, ".", false], [4596, 0.023382, " in", false], [5346, 0.018755, "---", false], [21265, 0.012854, " and", false], [32465, 0.012324, " when", false], [40076, 0.010249, " until", false], [4423, 0.009236, " as", false], [4424, 0.008984, " at", false]]], "model_b": [45, 3, 0.1826041042804718, [[47, 0.400301, ".", false], [4450, 0.22053, " by", false], [45, 0.182604, ",", false], [21265, 0.036468, " and", false], [4596, 0.024431, " in", false], [4715, 0.014967, " or", false], [4423, 0.00813, " as", false], [31162, 0.007758, " into", false], [21700, 0.006634, " for", false], [40076, 0.006518, " until", false]]]}, "raw_delta": -0.7265625, "tuned_delta": -0.6724729025849244}, {"byte_start": 5617, "byte_end": 5625, "display": {"text": " because", "kind": "normal"}, "is_word": true, "word_id": 966, "word_key": " because", "bytes_hex": "20 62 65 63 61 75 73 65", "compression": {"model_a": "3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66%", "model_b": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[51018, " because", "normal", 0.19768062233924866]], "model_b": [[51018, " because", "normal", 0.13597191870212555]]}, "loss": {"model_a": 3.6630928772571334, "model_b": 4.490810979329659}, "topk": {"model_a": [51018, 2, 0.19768062233924866, [[21400, 0.39533, " but", false], [51018, 0.197681, " because", false], [4423, 0.095918, " as", false], [21265, 0.050934, " and", false], [4450, 0.050033, " by", false], [21700, 0.022768, " for", false], [4788, 0.01819, " so", false], [4596, 0.017289, " in", false], [32465, 0.014035, " when", false], [30788, 0.012179, " even", false]]], "model_b": [51018, 2, 0.13597191870212555, [[21400, 0.247077, " but", false], [51018, 0.135972, " because", false], [21265, 0.103139, " and", false], [4423, 0.096299, " as", false], [4450, 0.066969, " by", false], [21700, 0.05063, " for", false], [4596, 0.03065, " in", false], [32465, 0.019228, " when", false], [30788, 0.016087, " even", false], [39690, 0.013466, " since", false]]]}, "raw_delta": -0.0458984375, "tuned_delta": 0.008191159915075588}, {"byte_start": 5625, "byte_end": 5628, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 967, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "9.77% 9.77% 9.77%", "model_b": "12.68% 12.68% 12.68%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.19962885975837708]], "model_b": [[4601, " it", "normal", 0.12248010188341141]]}, "loss": {"model_a": 9.768247672685687, "model_b": 12.679936882813154}, "topk": {"model_a": [4601, 2, 0.19962885975837708, [[22590, 0.319802, " the", false], [4601, 0.199629, " it", false], [4706, 0.09383, " of", false], [4858, 0.073552, " we", false], [63843, 0.061128, " researchers", false], [284, 0.019924, " 1", false], [39934, 0.014404, " there", false], [46787, 0.00946, " people", false], [332, 0.009233, " a", false], [3609, 0.009022, " AI", false]]], "model_b": [4601, 2, 0.12248010188341141, [[22590, 0.392797, " the", false], [4601, 0.12248, " it", false], [4706, 0.092981, " of", false], [4858, 0.043238, " we", false], [63843, 0.02567, " researchers", false], [39934, 0.020438, " there", false], [3609, 0.014837, " AI", false], [32234, 0.014827, " this", false], [39936, 0.011932, " these", false], [31461, 0.011845, " most", false]]]}, "raw_delta": -0.16145833333333337, "tuned_delta": -0.10736873591825778}, {"byte_start": 5628, "byte_end": 5631, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 968, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "7.51% 7.51% 7.51%", "model_b": "4.91% 4.91% 4.91%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.2882640063762665]], "model_b": [[4600, " is", "normal", 0.4421278238296509]]}, "loss": {"model_a": 7.514036671296684, "model_b": 4.907605200940647}, "topk": {"model_a": [4600, 1, 0.2882640063762665, [[4600, 0.288264, " is", false], [30659, 0.062116, " does", false], [22748, 0.06041, " was", false], [21800, 0.039604, " has", false], [56501, 0.034766, " involves", false], [39888, 0.033837, " takes", false], [38087, 0.029904, " comes", false], [39620, 0.024831, " seems", false], [57102, 0.022864, " requires", false], [31908, 0.015377, " runs", false]]], "model_b": [4600, 1, 0.4421278238296509, [[4600, 0.442128, " is", false], [30659, 0.067042, " does", false], [22748, 0.06235, " was", false], [39888, 0.032855, " takes", false], [21800, 0.025947, " has", false], [38087, 0.025394, " comes", false], [39620, 0.013348, " seems", false], [39115, 0.011137, " never", false], [56501, 0.010485, " involves", false], [45409, 0.010477, " cannot", false]]]}, "raw_delta": 0.14453125, "tuned_delta": 0.19862084741507557}, {"byte_start": 5631, "byte_end": 5639, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 969, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"model_a": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "model_b": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"model_a": [[53052, " success", "normal", 4.079076097696088e-05]], "model_b": [[53052, " success", "normal", 2.5472303605056368e-05]]}, "loss": {"model_a": 22.823886389063677, "model_b": 23.810103702171368}, "topk": {"model_a": [53052, 865, 4.079076097696088e-05, [[22187, 0.132184, " not", false], [4788, 0.095865, " so", false], [332, 0.071927, " a", false], [31048, 0.07044, " hard", false], [45315, 0.059021, " bitter", false], [22590, 0.038532, " the", false], [37810, 0.036888, " based", false], [51336, 0.034481, " counter", false], [59516, 0.029296, " difficult", false], [31968, 0.0164, " seen", false]]], "model_b": [53052, 1256, 2.5472303605056368e-05, [[22187, 0.249272, " not", false], [332, 0.077311, " a", false], [22590, 0.04709, " the", false], [31048, 0.044452, " hard", false], [4788, 0.039108, " so", false], [37810, 0.039034, " based", false], [22614, 0.029452, " too", false], [4419, 0.020179, " an", false], [59516, 0.017842, " difficult", false], [39115, 0.015624, " never", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 5639, "byte_end": 5644, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 970, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"model_a": "22.09% 22.09% 22.09% 22.09% 22.09%", "model_b": "17.92% 17.92% 17.92% 17.92% 17.92%"}, "model_tokens": {"model_a": [[31601, " over", "normal", 0.002152421046048403]], "model_b": [[31601, " over", "normal", 0.006983359344303608]]}, "loss": {"model_a": 22.09126781361225, "model_b": 17.92097746104259}, "topk": {"model_a": [31601, 41, 0.002152421046048403, [[32227, 0.142402, " that", false], [37810, 0.117379, " based", false], [4596, 0.089234, " in", false], [37634, 0.072337, " after", false], [4450, 0.053094, " by", false], [4424, 0.04055, " at", false], [50870, 0.038967, " against", false], [31581, 0.036845, " only", false], [55437, 0.031206, " achieved", false], [37924, 0.029755, " built", false]]], "model_b": [31601, 21, 0.006983359344303608, [[32227, 0.177777, " that", false], [4596, 0.166345, " in", false], [37810, 0.095687, " based", false], [4712, 0.050553, " on", false], [4450, 0.049588, " by", false], [4424, 0.046085, " at", false], [4600, 0.037017, " is", false], [4706, 0.031531, " of", false], [21700, 0.018705, " for", false], [45, 0.017446, ",", false]]]}, "raw_delta": 0.2312500000000001, "tuned_delta": 0.2853395974150757}, {"byte_start": 5644, "byte_end": 5646, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 971, "word_key": " a", "bytes_hex": "20 61", "compression": {"model_a": "10.99% 10.99%", "model_b": "10.64% 10.64%"}, "model_tokens": {"model_a": [[332, " a", "normal", 0.2956809997558594]], "model_b": [[332, " a", "normal", 0.3095007538795471]]}, "loss": {"model_a": 10.9892786317714, "model_b": 10.637058162804367}, "topk": {"model_a": [332, 1, 0.2956809997558594, [[332, 0.295681, " a", false], [22590, 0.156365, " the", false], [38720, 0.056497, " human", false], [4419, 0.04167, " an", false], [51396, 0.025634, " decades", false], [32464, 0.022762, " what", false], [32251, 0.022253, " time", false], [32139, 0.019951, " such", false], [31370, 0.016971, " many", false], [60522, 0.016744, " something", false]]], "model_b": [332, 1, 0.3095007538795471, [[332, 0.309501, " a", false], [22590, 0.157754, " the", false], [32251, 0.069427, " time", false], [4419, 0.042261, " an", false], [21265, 0.020543, " and", false], [31370, 0.019521, " many", false], [40186, 0.017869, " which", false], [51396, 0.015695, " decades", false], [40237, 0.015634, " years", false], [60522, 0.013249, " something", false]]]}, "raw_delta": 0.01953125, "tuned_delta": 0.07362084741507559}, {"byte_start": 5646, "byte_end": 5654, "display": {"text": " favored", "kind": "normal"}, "is_word": true, "word_id": 972, "word_key": " favored", "bytes_hex": "20 66 61 76 6f 72 65 64", "compression": {"model_a": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "model_b": "25.36% 25.36% 25.36% 25.36% 25.36% 25.36% 25.36% 25.36%"}, "model_tokens": {"model_a": [[51722, " favored", "normal", 2.4290700821438804e-05]], "model_b": [[51722, " favored", "normal", 1.3200866305851378e-05]]}, "loss": {"model_a": 23.95099188975818, "model_b": 25.359873765626308}, "topk": {"model_a": [51722, 888, 2.4290700821438804e-05, [[31323, 0.379958, " long", false], [32386, 0.105367, " very", false], [46470, 0.065834, " longer", false], [31466, 0.057021, " much", false], [46790, 0.019398, " period", false], [31118, 0.015977, " huge", false], [62471, 0.015084, " relatively", false], [39675, 0.014525, " short", false], [38864, 0.014124, " large", false], [32251, 0.013945, " time", false]]], "model_b": [51722, 1449, 1.3200866305851378e-05, [[31323, 0.322348, " long", false], [46790, 0.107053, " period", false], [39675, 0.08134, " short", false], [31466, 0.053327, " much", false], [46470, 0.0458, " longer", false], [32386, 0.034988, " very", false], [32251, 0.019746, " time", false], [56546, 0.016532, " lifetime", false], [62471, 0.011573, " relatively", false], [38720, 0.010905, " human", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.024035402584924412}, {"byte_start": 5654, "byte_end": 5655, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "68.47%", "model_b": "67.63%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.022521788254380226]], "model_b": [[45, ",", "normal", 0.02341831848025322]]}, "loss": {"model_a": 68.47165916719104, "model_b": 67.62633004167016}, "topk": {"model_a": [45, 6, 0.022521788254380226, [[55532, 0.449047, " approach", false], [46561, 0.125214, " method", false], [22752, 0.052567, " way", false], [38720, 0.037699, " human", false], [21400, 0.036149, " but", false], [45, 0.022522, ",", false], [21265, 0.015819, " and", false], [63277, 0.0157, " alternative", false], [57317, 0.01437, " strategy", false], [31135, 0.013747, " idea", false]]], "model_b": [45, 8, 0.02341831848025322, [[55532, 0.161313, " approach", false], [46561, 0.078737, " method", false], [31637, 0.078305, " path", false], [57317, 0.060175, " strategy", false], [56810, 0.03049, " paradigm", false], [39552, 0.026557, " route", false], [22752, 0.024621, " way", false], [45, 0.023418, ",", false], [38720, 0.02277, " human", false], [21400, 0.019571, " but", false]]]}, "raw_delta": 0.046875, "tuned_delta": 0.10096459741507559}, {"byte_start": 5655, "byte_end": 5661, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 973, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"model_a": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "model_b": "9.63% 9.63% 9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"model_a": [[38720, " human", "normal", 0.13161326944828033]], "model_b": [[38720, " human", "normal", 0.04061727598309517]]}, "loss": {"model_a": 6.058192066232952, "model_b": 9.627359485098875}, "topk": {"model_a": [38720, 2, 0.13161326944828033, [[21400, 0.261989, " but", false], [38720, 0.131613, " human", false], [21265, 0.067886, " and", false], [56847, 0.044525, " personal", false], [39675, 0.027583, " short", false], [31323, 0.023109, " long", false], [62309, 0.018654, " personally", false], [47544, 0.016238, " though", false], [30437, 0.014396, " cher", false], [56205, 0.014345, " familiar", false]]], "model_b": [38720, 3, 0.04061727598309517, [[21400, 0.2456, " but", false], [21265, 0.066528, " and", false], [38720, 0.040617, " human", false], [31323, 0.028656, " long", false], [39675, 0.028265, " short", false], [31277, 0.018946, " less", false], [47001, 0.016217, " rather", false], [56205, 0.015914, " familiar", false], [22797, 0.013138, " yet", false], [39171, 0.012085, " often", false]]]}, "raw_delta": -0.19791666666666663, "tuned_delta": -0.14382706925159106}, {"byte_start": 5661, "byte_end": 5662, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "5.32%", "model_b": "0.92%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.7443927526473999]], "model_b": [[46, "-", "normal", 0.9506463408470154]]}, "loss": {"model_a": 5.3185290814021835, "model_b": 0.9201759751763712}, "topk": {"model_a": [46, 1, 0.7443927526473999, [[46, 0.744393, "-", false], [22752, 0.057986, " way", false], [55532, 0.045527, " approach", false], [45, 0.028108, ",", false], [2030, 0.022282, "ly", false], [34864, 0.015767, "istic", false], [46561, 0.007028, " method", false], [7919, 0.00693, "ist", false], [65034, 0.005707, " understanding", false], [59943, 0.004915, " knowledge", false]]], "model_b": [46, 1, 0.9506463408470154, [[46, 0.950646, "-", false], [59943, 0.011479, " knowledge", false], [55532, 0.002708, " approach", false], [38786, 0.002484, " input", false], [2030, 0.001868, "ly", false], [34864, 0.001207, "istic", false], [45, 0.001019, ",", false], [26031, 0.001009, "ized", false], [45775, 0.000862, " domain", false], [7919, 0.000845, "ist", false]]]}, "raw_delta": 0.243896484375, "tuned_delta": 0.2979860817900756}, {"byte_start": 5662, "byte_end": 5669, "display": {"text": "centric", "kind": "normal"}, "is_word": true, "word_id": 974, "word_key": "centric", "bytes_hex": "63 65 6e 74 72 69 63", "compression": {"model_a": "6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "model_b": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%"}, "model_tokens": {"model_a": [[48948, "centric", "normal", 0.07364126294851303]], "model_b": [[48948, "centric", "normal", 0.07499963790178299]]}, "loss": {"model_a": 6.722379236285069, "model_b": 6.6821254684031235}, "topk": {"model_a": [48948, 2, 0.07364126294851303, [[58313, 0.387243, "knowledge", false], [48948, 0.073641, "centric", false], [34011, 0.066124, "based", false], [42430, 0.059761, "unders", false], [54208, 0.030905, "oriented", false], [53835, 0.029211, "centered", false], [26148, 0.025906, "like", false], [41273, 0.022095, "driven", false], [54087, 0.018048, "inspired", false], [54012, 0.015996, "friendly", false]]], "model_b": [48948, 2, 0.07499963790178299, [[58313, 0.43173, "knowledge", false], [48948, 0.075, "centric", false], [34011, 0.07073, "based", false], [53835, 0.035267, "centered", false], [53908, 0.024097, "directed", false], [26085, 0.019617, "know", false], [49037, 0.01505, "defined", false], [34232, 0.014328, "domin", false], [34795, 0.013945, "input", false], [54359, 0.008906, "specific", false]]]}, "raw_delta": 0.002232142857142849, "tuned_delta": 0.05632174027221844}, {"byte_start": 5669, "byte_end": 5678, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 975, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"model_a": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%", "model_b": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%"}, "model_tokens": {"model_a": [[55532, " approach", "normal", 0.5075794458389282]], "model_b": [[55532, " approach", "normal", 0.3070255219936371]]}, "loss": {"model_a": 1.3697462682051245, "model_b": 2.3637907028454146}, "topk": {"model_a": [55532, 1, 0.5075794458389282, [[55532, 0.507579, " approach", false], [45, 0.133189, ",", false], [46561, 0.05707, " method", false], [22752, 0.054261, " way", false], [32398, 0.042187, " view", false], [46681, 0.016602, " notion", false], [57317, 0.013877, " strategy", false], [56810, 0.010144, " paradigm", false], [63708, 0.008959, " methodology", false], [31135, 0.008109, " idea", false]]], "model_b": [55532, 1, 0.3070255219936371, [[55532, 0.307026, " approach", false], [45, 0.114671, ",", false], [56810, 0.059006, " paradigm", false], [46561, 0.053211, " method", false], [57317, 0.051148, " strategy", false], [31637, 0.040796, " path", false], [22752, 0.035587, " way", false], [45775, 0.021689, " domain", false], [39043, 0.015533, " model", false], [32398, 0.012945, " view", false]]]}, "raw_delta": -0.05512152777777779, "tuned_delta": -0.001031930362702202}, {"byte_start": 5678, "byte_end": 5679, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "11.55%", "model_b": "14.16%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.5315477252006531]], "model_b": [[47, ".", "normal", 0.4533803462982178]]}, "loss": {"model_a": 11.55283138211865, "model_b": 14.159262852474688}, "topk": {"model_a": [47, 1, 0.5315477252006531, [[47, 0.531548, ".", false], [32227, 0.152361, " that", false], [45, 0.149682, ",", false], [4811, 0.070093, " to", false], [21265, 0.015953, " and", false], [5346, 0.013315, "---", false], [60, 0.006668, ";", false], [4596, 0.005774, " in", false], [47001, 0.005749, " rather", false], [275, 0.005231, " (", false]]], "model_b": [47, 1, 0.4533803462982178, [[47, 0.45338, ".", false], [45, 0.222844, ",", false], [32227, 0.126112, " that", false], [4811, 0.056543, " to", false], [47001, 0.021133, " rather", false], [21265, 0.020674, " and", false], [5346, 0.0177, "---", false], [275, 0.009495, " (", false], [37810, 0.006391, " based", false], [60, 0.005107, ";", false]]]}, "raw_delta": -0.14453125, "tuned_delta": -0.09044165258492441}, {"byte_start": 5679, "byte_end": 5680, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "9.65%", "model_b": "11.62%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.34259605407714844]], "model_b": [[261, "\n\n", "control", 0.2752617299556732]]}, "loss": {"model_a": 9.650840849696678, "model_b": 11.623275475912058}, "topk": {"model_a": [261, 1, 0.34259605407714844, [[261, 0.342596, "\n\n", false], [19555, 0.139247, " But", false], [20996, 0.086645, " The", false], [3918, 0.042543, " It", false], [29894, 0.041358, " This", false], [4331, 0.037635, " We", false], [267, 0.021008, "  ", false], [3913, 0.018412, " In", false], [19417, 0.011484, " And", false], [37451, 0.00935, " There", false]]], "model_b": [261, 1, 0.2752617299556732, [[261, 0.275262, "\n\n", false], [20996, 0.097603, " The", false], [29894, 0.07245, " This", false], [19555, 0.072445, " But", false], [3918, 0.0456, " It", false], [11, 0.028037, "\n", false], [267, 0.027651, "  ", false], [4331, 0.027451, " We", false], [3913, 0.026779, " In", false], [19417, 0.019095, " And", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05528540258492441}, {"byte_start": 5680, "byte_end": 5681, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "9.65%", "model_b": "11.62%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.34259605407714844]], "model_b": [[261, "\n\n", "control", 0.2752617299556732]]}, "loss": {"model_a": 9.650840849696678, "model_b": 11.623275475912058}, "topk": {"model_a": [261, 1, 0.34259605407714844, [[261, 0.342596, "\n\n", false], [19555, 0.139247, " But", false], [20996, 0.086645, " The", false], [3918, 0.042543, " It", false], [29894, 0.041358, " This", false], [4331, 0.037635, " We", false], [267, 0.021008, "  ", false], [3913, 0.018412, " In", false], [19417, 0.011484, " And", false], [37451, 0.00935, " There", false]]], "model_b": [261, 1, 0.2752617299556732, [[261, 0.275262, "\n\n", false], [20996, 0.097603, " The", false], [29894, 0.07245, " This", false], [19555, 0.072445, " But", false], [3918, 0.0456, " It", false], [11, 0.028037, "\n", false], [267, 0.027651, "  ", false], [4331, 0.027451, " We", false], [3913, 0.026779, " In", false], [19417, 0.019095, " And", false]]]}, "raw_delta": -0.109375, "tuned_delta": -0.05528540258492441}, {"byte_start": 5681, "byte_end": 5684, "display": {"text": "One", "kind": "normal"}, "is_word": true, "word_id": 976, "word_key": "one", "bytes_hex": "4f 6e 65", "compression": {"model_a": "24.04% 24.04% 24.04%", "model_b": "27.05% 27.05% 27.05%"}, "model_tokens": {"model_a": [[6393, "One", "normal", 0.018186720088124275]], "model_b": [[6393, "One", "normal", 0.011030742898583412]]}, "loss": {"model_a": 24.044917348149387, "model_b": 27.05053201666806}, "topk": {"model_a": [6393, 12, 0.018186720088124275, [[6699, 0.173339, "The", false], [1136, 0.074415, "In", false], [24242, 0.05702, "This", false], [1589, 0.045547, "We", false], [1500, 0.041338, "To", false], [33504, 0.039424, "There", false], [66, 0.031859, "A", false], [1141, 0.030634, "It", false], [74, 0.030074, "I", false], [24326, 0.022752, "What", false]]], "model_b": [6393, 14, 0.011030742898583412, [[6699, 0.174873, "The", false], [24242, 0.069819, "This", false], [1136, 0.045399, "In", false], [33504, 0.039347, "There", false], [1141, 0.028028, "It", false], [1589, 0.028025, "We", false], [5658, 0.027596, "But", false], [1500, 0.017622, "To", false], [74, 0.017284, "I", false], [66, 0.016299, "A", false]]]}, "raw_delta": -0.16666666666666674, "tuned_delta": -0.11257706925159115}, {"byte_start": 5684, "byte_end": 5690, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 977, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "model_b": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02%"}, "model_tokens": {"model_a": [[39941, " thing", "normal", 0.021191934123635292]], "model_b": [[39941, " thing", "normal", 0.018186992034316063]]}, "loss": {"model_a": 11.55283138211865, "model_b": 12.022458674074693}, "topk": {"model_a": [39941, 7, 0.021191934123635292, [[4706, 0.154792, " of", false], [22752, 0.140198, " way", false], [47009, 0.063192, " reason", false], [21413, 0.045563, " can", false], [39021, 0.041041, " might", false], [51668, 0.022052, " example", false], [39941, 0.021192, " thing", false], [46430, 0.017946, " lesson", false], [56895, 0.016454, " possible", false], [59829, 0.015548, " important", false]]], "model_b": [39941, 9, 0.018186992034316063, [[4706, 0.230806, " of", false], [22752, 0.1064, " way", false], [21413, 0.050285, " can", false], [47009, 0.044247, " reason", false], [38491, 0.031379, " final", false], [39021, 0.027043, " might", false], [59829, 0.023367, " important", false], [51668, 0.02264, " example", false], [39941, 0.018187, " thing", false], [46430, 0.014988, " lesson", false]]]}, "raw_delta": -0.02604166666666663, "tuned_delta": 0.02804793074840896}, {"byte_start": 5690, "byte_end": 5695, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 978, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "2.49% 2.49% 2.49% 2.49% 2.49%", "model_b": "2.87% 2.87% 2.87% 2.87% 2.87%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.49741557240486145]], "model_b": [[32227, " that", "normal", 0.4525791108608246]]}, "loss": {"model_a": 2.4937209202865867, "model_b": 2.8741190267709813}, "topk": {"model_a": [32227, 1, 0.49741557240486145, [[32227, 0.497416, " that", false], [4858, 0.150318, " we", false], [4811, 0.113244, " to", false], [4600, 0.033267, " is", false], [32234, 0.03034, " this", false], [308, 0.026921, " I", false], [22590, 0.02312, " the", false], [37598, 0.010763, " about", false], [3609, 0.006933, " AI", false], [39936, 0.004753, " these", false]]], "model_b": [32227, 1, 0.4525791108608246, [[32227, 0.452579, " that", false], [4600, 0.126138, " is", false], [4858, 0.106203, " we", false], [4811, 0.049225, " to", false], [22590, 0.035975, " the", false], [308, 0.033473, " I", false], [3609, 0.026936, " AI", false], [32234, 0.018122, " this", false], [37598, 0.013129, " about", false], [21800, 0.010946, " has", false]]]}, "raw_delta": -0.021093749999999994, "tuned_delta": 0.032995847415075594}, {"byte_start": 5695, "byte_end": 5702, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 979, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%", "model_b": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.013386623933911324]], "model_b": [[47266, " should", "normal", 0.014780030585825443]]}, "loss": {"model_a": 11.110039935417243, "model_b": 10.868517328125558}, "topk": {"model_a": [47266, 16, 0.013386623933911324, [[4600, 0.196296, " is", false], [21800, 0.078812, " has", false], [4858, 0.062292, " we", false], [38964, 0.04568, " makes", false], [21413, 0.045268, " can", false], [22590, 0.029351, " the", false], [39021, 0.021661, " might", false], [38686, 0.021108, " helps", false], [308, 0.019905, " I", false], [32234, 0.019869, " this", false]]], "model_b": [47266, 14, 0.014780030585825443, [[4600, 0.219838, " is", false], [21800, 0.115689, " has", false], [21413, 0.050468, " can", false], [4858, 0.042143, " we", false], [22590, 0.031374, " the", false], [38964, 0.030727, " makes", false], [22074, 0.025844, " may", false], [3609, 0.024024, " AI", false], [308, 0.020887, " I", false], [39620, 0.02078, " seems", false]]]}, "raw_delta": 0.013392857142857206, "tuned_delta": 0.0674824545579328}, {"byte_start": 5702, "byte_end": 5705, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 980, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "2.14% 2.14% 2.14%", "model_b": "4.46% 4.46% 4.46%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.7007312774658203]], "model_b": [[4435, " be", "normal", 0.4726240932941437]]}, "loss": {"model_a": 2.1368041783999945, "model_b": 4.461459273582406}, "topk": {"model_a": [4435, 1, 0.7007312774658203, [[4435, 0.700731, " be", false], [31073, 0.056464, " help", false], [22187, 0.049648, " not", false], [31059, 0.023253, " have", false], [31358, 0.013951, " make", false], [30135, 0.010645, " also", false], [30482, 0.010423, " come", false], [45284, 0.008644, " become", false], [45150, 0.006725, " always", false], [47428, 0.00665, " strike", false]]], "model_b": [4435, 1, 0.4726240932941437, [[4435, 0.472624, " be", false], [22187, 0.10081, " not", false], [31073, 0.060817, " help", false], [31059, 0.054067, " have", false], [31358, 0.027264, " make", false], [30482, 0.023442, " come", false], [47063, 0.014779, " remind", false], [46159, 0.012235, " happen", false], [47428, 0.0116, " strike", false], [45450, 0.009238, " change", false]]]}, "raw_delta": -0.12890625, "tuned_delta": -0.07481665258492441}, {"byte_start": 5705, "byte_end": 5713, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 981, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"model_a": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57%", "model_b": "7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"model_a": [[52112, " learned", "normal", 0.08431340008974075]], "model_b": [[52112, " learned", "normal", 0.03853078931570053]]}, "loss": {"model_a": 5.565083409679106, "model_b": 7.361407801410969}, "topk": {"model_a": [52112, 2, 0.08431340008974075, [[38049, 0.299266, " clear", false], [52112, 0.084313, " learned", false], [39140, 0.082093, " noted", false], [52346, 0.057422, " obvious", false], [62684, 0.037237, " understood", false], [61934, 0.02881, " emphasized", false], [31207, 0.024649, " kept", false], [55524, 0.021464, " apparent", false], [31351, 0.018904, " made", false], [63289, 0.017947, " appreciated", false]]], "model_b": [52112, 5, 0.03853078931570053, [[38049, 0.178091, " clear", false], [39140, 0.06547, " noted", false], [52346, 0.06436, " obvious", false], [61934, 0.061393, " emphasized", false], [52112, 0.038531, " learned", false], [37890, 0.036065, " borne", false], [30666, 0.034696, " done", false], [37620, 0.025057, " added", false], [52506, 0.021937, " pointed", false], [31929, 0.02136, " said", false]]]}, "raw_delta": -0.099609375, "tuned_delta": -0.04551977758492441}, {"byte_start": 5713, "byte_end": 5718, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 982, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"model_a": "2.13% 2.13% 2.13% 2.13% 2.13%", "model_b": "1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"model_a": [[30917, " from", "normal", 0.5561042428016663]], "model_b": [[30917, " from", "normal", 0.6450085043907166]]}, "loss": {"model_a": 2.1274116325608734, "model_b": 1.570903291592963}, "topk": {"model_a": [30917, 1, 0.5561042428016663, [[30917, 0.556104, " from", false], [4600, 0.269363, " is", false], [45, 0.045566, ",", false], [31077, 0.017917, " here", false], [4450, 0.014278, " by", false], [37598, 0.013777, " about", false], [4596, 0.012411, " in", false], [21265, 0.00878, " and", false], [31458, 0.00544, " more", false], [32458, 0.004925, " well", false]]], "model_b": [30917, 1, 0.6450085043907166, [[30917, 0.645009, " from", false], [4600, 0.186247, " is", false], [4596, 0.032483, " in", false], [45, 0.02719, ",", false], [31077, 0.018396, " here", false], [37598, 0.015167, " about", false], [4450, 0.011644, " by", false], [21265, 0.004889, " and", false], [4423, 0.003803, " as", false], [59, 0.002956, ":", false]]]}, "raw_delta": 0.030859374999999994, "tuned_delta": 0.08494897241507558}, {"byte_start": 5718, "byte_end": 5722, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 983, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.99% 5.99% 5.99% 5.99%", "model_b": "5.88% 5.88% 5.88% 5.88%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.26441845297813416]], "model_b": [[22590, " the", "normal", 0.2745579779148102]]}, "loss": {"model_a": 5.987747972439545, "model_b": 5.882081831749435}, "topk": {"model_a": [22590, 2, 0.26441845297813416, [[32234, 0.383667, " this", false], [22590, 0.264418, " the", false], [39936, 0.180487, " these", false], [21256, 0.056352, " all", false], [3609, 0.018239, " AI", false], [45315, 0.013758, " bitter", false], [51929, 0.008418, " history", false], [55809, 0.003554, " computer", false], [31636, 0.003259, " past", false], [22248, 0.00314, " our", false]]], "model_b": [22590, 2, 0.2745579779148102, [[32234, 0.378935, " this", false], [22590, 0.274558, " the", false], [21256, 0.103133, " all", false], [39936, 0.068581, " these", false], [3609, 0.067152, " AI", false], [51929, 0.010893, " history", false], [55809, 0.010161, " computer", false], [45315, 0.004953, " bitter", false], [332, 0.00274, " a", false], [22248, 0.002733, " our", false]]]}, "raw_delta": 0.005859375, "tuned_delta": 0.05994897241507559}, {"byte_start": 5722, "byte_end": 5729, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 984, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76%", "model_b": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.7465822100639343]], "model_b": [[45315, " bitter", "normal", 0.8156770467758179]]}, "loss": {"model_a": 0.7597898687717407, "model_b": 0.5157514009874397}, "topk": {"model_a": [45315, 1, 0.7465822100639343, [[45315, 0.746582, " bitter", false], [51929, 0.04974, " history", false], [31636, 0.011954, " past", false], [37599, 0.011739, " above", false], [60587, 0.009584, " successes", false], [61640, 0.008671, " bitterness", false], [62061, 0.007071, " historical", false], [3609, 0.00692, " AI", false], [56162, 0.006886, " examples", false], [52427, 0.005523, " pattern", false]]], "model_b": [45315, 1, 0.8156770467758179, [[45315, 0.815677, " bitter", false], [51929, 0.047212, " history", false], [19523, 0.012799, " Bit", false], [37599, 0.011353, " above", false], [61640, 0.009898, " bitterness", false], [3609, 0.008693, " AI", false], [31636, 0.007824, " past", false], [56162, 0.003357, " examples", false], [52127, 0.002835, " lessons", false], [55809, 0.002485, " computer", false]]]}, "raw_delta": 0.013532366071428575, "tuned_delta": 0.06762196348650416}, {"byte_start": 5729, "byte_end": 5736, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 985, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "model_b": "0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.5590899586677551]], "model_b": [[46430, " lesson", "normal", 0.6845353841781616]]}, "loss": {"model_a": 1.4893894116320212, "model_b": 0.97112215015196}, "topk": {"model_a": [46430, 1, 0.5590899586677551, [[46430, 0.55909, " lesson", false], [52127, 0.399026, " lessons", false], [61979, 0.008515, " experience", false], [46, 0.007213, "-", false], [31636, 0.002694, " past", false], [63558, 0.002306, " experiences", false], [51929, 0.002008, " history", false], [39899, 0.001541, " taste", false], [45, 0.001254, ",", false], [39831, 0.000541, " story", false]]], "model_b": [46430, 1, 0.6845353841781616, [[46430, 0.684535, " lesson", false], [52127, 0.188879, " lessons", false], [46, 0.03985, "-", false], [51929, 0.030076, " history", false], [61979, 0.014516, " experience", false], [7513, 0.002343, "est", false], [31333, 0.001925, " loss", false], [39831, 0.001752, " story", false], [65126, 0.001574, " disappointment", false], [53052, 0.001197, " success", false]]]}, "raw_delta": 0.028738839285714277, "tuned_delta": 0.08282843670078986}, {"byte_start": 5736, "byte_end": 5739, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 986, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "1.06% 1.06% 1.06%", "model_b": "1.22% 1.22% 1.22%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.8394970297813416]], "model_b": [[4600, " is", "normal", 0.8170072436332703]]}, "loss": {"model_a": 1.0566614069010962, "model_b": 1.2151606179362606}, "topk": {"model_a": [4600, 1, 0.8394970297813416, [[4600, 0.839497, " is", false], [4706, 0.056035, " of", false], [45, 0.04297, ",", false], [4596, 0.011184, " in", false], [32227, 0.009509, " that", false], [37598, 0.00805, " about", false], [59, 0.004939, ":", false], [21265, 0.004035, " and", false], [5346, 0.002418, "---", false], [4712, 0.001878, " on", false]]], "model_b": [4600, 1, 0.8170072436332703, [[4600, 0.817007, " is", false], [4706, 0.053004, " of", false], [45, 0.045489, ",", false], [5346, 0.014849, "---", false], [4596, 0.011126, " in", false], [32227, 0.010677, " that", false], [59, 0.006985, ":", false], [21265, 0.006857, " and", false], [37598, 0.006439, " about", false], [4712, 0.001985, " on", false]]]}, "raw_delta": -0.0087890625, "tuned_delta": 0.04530053491507559}, {"byte_start": 5739, "byte_end": 5743, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 987, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.27% 11.27% 11.27% 11.27%", "model_b": "10.64% 10.64% 10.64% 10.64%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.08066534996032715]], "model_b": [[22590, " the", "normal", 0.09512507915496826]]}, "loss": {"model_a": 11.271055006945026, "model_b": 10.637058162804367}, "topk": {"model_a": [22590, 3, 0.08066534996032715, [[32227, 0.687518, " that", false], [4811, 0.096033, " to", false], [22590, 0.080665, " the", false], [22187, 0.028248, " not", false], [21835, 0.022794, " how", false], [32234, 0.014226, " this", false], [332, 0.013353, " a", false], [45, 0.005186, ",", false], [59, 0.005085, ":", false], [32464, 0.004776, " what", false]]], "model_b": [22590, 2, 0.09512507915496826, [[32227, 0.676448, " that", false], [22590, 0.095125, " the", false], [4811, 0.07234, " to", false], [32234, 0.037054, " this", false], [21835, 0.029573, " how", false], [22187, 0.022881, " not", false], [332, 0.009424, " a", false], [32464, 0.005733, " what", false], [59, 0.002838, ":", false], [45, 0.002798, ",", false]]]}, "raw_delta": 0.03515625, "tuned_delta": 0.08924584741507559}, {"byte_start": 5743, "byte_end": 5749, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 988, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"model_a": "16.72% 16.72% 16.72% 16.72% 16.72% 16.72%", "model_b": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%"}, "model_tokens": {"model_a": [[38629, " great", "normal", 0.0038409861735999584]], "model_b": [[38629, " great", "normal", 0.0036425036378204823]]}, "loss": {"model_a": 16.718731593635123, "model_b": 16.90658251041754}, "topk": {"model_a": [38629, 27, 0.0038409861735999584, [[62079, 0.236673, " importance", false], [31506, 0.113577, " need", false], [40093, 0.043038, " value", false], [59725, 0.018497, " following", false], [30808, 0.015713, " fact", false], [45661, 0.013849, " danger", false], [21719, 0.012937, " fut", false], [31135, 0.008465, " idea", false], [60051, 0.008357, " necessity", false], [63820, 0.008164, " realization", false]]], "model_b": [38629, 29, 0.0036425036378204823, [[62079, 0.272124, " importance", false], [40093, 0.070946, " value", false], [31506, 0.050858, " need", false], [30808, 0.018133, " fact", false], [61863, 0.017828, " difference", false], [31894, 0.017554, " role", false], [39339, 0.014811, " power", false], [46430, 0.012003, " lesson", false], [60051, 0.010391, " necessity", false], [45661, 0.009915, " danger", false]]]}, "raw_delta": -0.01041666666666663, "tuned_delta": 0.04367293074840896}, {"byte_start": 5749, "byte_end": 5755, "display": {"text": " power", "kind": "normal"}, "is_word": true, "word_id": 989, "word_key": " power", "bytes_hex": "20 70 6f 77 65 72", "compression": {"model_a": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84%", "model_b": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83%"}, "model_tokens": {"model_a": [[39339, " power", "normal", 0.07397116720676422]], "model_b": [[39339, " power", "normal", 0.05299679934978485]]}, "loss": {"model_a": 7.842775775665913, "model_b": 8.828993088773602}, "topk": {"model_a": [39339, 3, 0.07397116720676422, [[62079, 0.249328, " importance", false], [40093, 0.20345, " value", false], [39339, 0.073971, " power", false], [60211, 0.029027, " potential", false], [59093, 0.028662, " advantage", false], [51030, 0.02592, " benefit", false], [45661, 0.018144, " danger", false], [61865, 0.018045, " difficulty", false], [31506, 0.01731, " need", false], [30510, 0.013183, " cost", false]]], "model_b": [39339, 3, 0.05299679934978485, [[40093, 0.158352, " value", false], [62079, 0.119425, " importance", false], [39339, 0.052997, " power", false], [45661, 0.044343, " danger", false], [60211, 0.034057, " potential", false], [51030, 0.03195, " benefit", false], [61865, 0.030171, " difficulty", false], [31506, 0.016955, " need", false], [61863, 0.014748, " difference", false], [59093, 0.013744, " advantage", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 5755, "byte_end": 5758, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 990, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "1.32% 1.32% 1.32%", "model_b": "1.16% 1.16% 1.16%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.8027152419090271]], "model_b": [[4706, " of", "normal", 0.8272742629051208]]}, "loss": {"model_a": 1.3208267586263702, "model_b": 1.1564572064417553}, "topk": {"model_a": [4706, 1, 0.8027152419090271, [[4706, 0.802715, " of", false], [32227, 0.08327, " that", false], [21265, 0.047147, " and", false], [4596, 0.011247, " in", false], [45, 0.009468, ",", false], [4811, 0.008144, " to", false], [4858, 0.003839, " we", false], [59206, 0.003084, " available", false], [56454, 0.001722, " inherent", false], [275, 0.001532, " (", false]]], "model_b": [4706, 1, 0.8272742629051208, [[4706, 0.827274, " of", false], [32227, 0.07818, " that", false], [21265, 0.032341, " and", false], [4596, 0.007528, " in", false], [45, 0.00653, ",", false], [4811, 0.004823, " to", false], [22590, 0.002489, " the", false], [56454, 0.002477, " inherent", false], [275, 0.001792, " (", false], [4858, 0.001404, " we", false]]]}, "raw_delta": 0.009114583333333329, "tuned_delta": 0.06320418074840892}, {"byte_start": 5758, "byte_end": 5766, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 991, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%", "model_b": "8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.039375290274620056]], "model_b": [[51832, " general", "normal", 0.019680190831422806]]}, "loss": {"model_a": 7.290963707617563, "model_b": 8.875955817969208}, "topk": {"model_a": [51832, 7, 0.039375290274620056, [[63370, 0.118311, " computation", false], [22590, 0.097759, " the", false], [47202, 0.095433, " search", false], [52195, 0.082458, " massive", false], [37045, 0.044575, " Moore", false], [56537, 0.043099, " learning", false], [51832, 0.039375, " general", false], [30597, 0.034995, " deep", false], [38720, 0.030198, " human", false], [52805, 0.030027, " scaling", false]]], "model_b": [51832, 8, 0.019680190831422806, [[22590, 0.096556, " the", false], [38720, 0.068984, " human", false], [56537, 0.068204, " learning", false], [52805, 0.039087, " scaling", false], [65135, 0.025946, " generalization", false], [31978, 0.023359, " self", false], [332, 0.020946, " a", false], [51832, 0.01968, " general", false], [63370, 0.015114, " computation", false], [38888, 0.014645, " lever", false]]]}, "raw_delta": -0.087890625, "tuned_delta": -0.03380102758492441}, {"byte_start": 5766, "byte_end": 5774, "display": {"text": " purpose", "kind": "normal"}, "is_word": true, "word_id": 992, "word_key": " purpose", "bytes_hex": "20 70 75 72 70 6f 73 65", "compression": {"model_a": "15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00%", "model_b": "18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60%"}, "model_tokens": {"model_a": [[52610, " purpose", "normal", 0.0012786333682015538]], "model_b": [[52610, " purpose", "normal", 0.0002528812037780881]]}, "loss": {"model_a": 15.004591977995565, "model_b": 18.597240761459293}, "topk": {"model_a": [52610, 24, 0.0012786333682015538, [[52224, 0.728638, " methods", false], [7933, 0.05501, "ity", false], [45, 0.035518, ",", false], [63370, 0.027367, " computation", false], [61590, 0.025408, " approaches", false], [47202, 0.021693, " search", false], [46, 0.015861, "-", false], [62633, 0.00846, " techniques", false], [64862, 0.006902, " computational", false], [61559, 0.006029, " algorithms", false]]], "model_b": [52610, 103, 0.0002528812037780881, [[52224, 0.567935, " methods", false], [45, 0.048378, ",", false], [46, 0.035781, "-", false], [56537, 0.03194, " learning", false], [34932, 0.024064, "izing", false], [61590, 0.023599, " approaches", false], [62370, 0.023576, " principles", false], [3609, 0.022001, " AI", false], [62581, 0.016756, " strategies", false], [47202, 0.014667, " search", false]]]}, "raw_delta": -0.19921875, "tuned_delta": -0.14512915258492443}, {"byte_start": 5774, "byte_end": 5782, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 993, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49%", "model_b": "3.89% 3.89% 3.89% 3.89% 3.89% 3.89% 3.89% 3.89%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.21236179769039154]], "model_b": [[52224, " methods", "normal", 0.17806246876716614]]}, "loss": {"model_a": 3.4869826427736172, "model_b": 3.892036182085704}, "topk": {"model_a": [52224, 2, 0.21236179769039154, [[63370, 0.399466, " computation", false], [52224, 0.212362, " methods", false], [45, 0.075849, ",", false], [47202, 0.046389, " search", false], [59346, 0.036532, " computing", false], [61590, 0.018706, " approaches", false], [52167, 0.017686, " machine", false], [64862, 0.016841, " computational", false], [56537, 0.015442, " learning", false], [61559, 0.013269, " algorithms", false]]], "model_b": [52224, 1, 0.17806246876716614, [[52224, 0.178062, " methods", false], [3609, 0.095613, " AI", false], [45, 0.067559, ",", false], [47202, 0.051849, " search", false], [63370, 0.051303, " computation", false], [59346, 0.050886, " computing", false], [56537, 0.050013, " learning", false], [61559, 0.036276, " algorithms", false], [61590, 0.027818, " approaches", false], [62633, 0.021956, " techniques", false]]]}, "raw_delta": -0.0224609375, "tuned_delta": 0.03162865991507559}, {"byte_start": 5782, "byte_end": 5783, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "35.36%", "model_b": "30.01%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.14271970093250275]], "model_b": [[45, ",", "normal", 0.19035430252552032]]}, "loss": {"model_a": 35.362935084290015, "model_b": 30.00918395599113}, "topk": {"model_a": [45, 3, 0.14271970093250275, [[47, 0.2773, ".", false], [32227, 0.192116, " that", false], [45, 0.14272, ",", false], [37810, 0.105475, " based", false], [21700, 0.036589, " for", false], [4811, 0.028232, " to", false], [38888, 0.027374, " lever", false], [4596, 0.022836, " in", false], [5346, 0.021902, "---", false], [21265, 0.020357, " and", false]]], "model_b": [45, 2, 0.19035430252552032, [[47, 0.322801, ".", false], [45, 0.190354, ",", false], [4811, 0.093301, " to", false], [32227, 0.071557, " that", false], [5346, 0.056546, "---", false], [4596, 0.038158, " in", false], [37810, 0.028878, " based", false], [21265, 0.027061, " and", false], [31601, 0.022343, " over", false], [275, 0.016784, " (", false]]]}, "raw_delta": 0.296875, "tuned_delta": 0.3509645974150756}, {"byte_start": 5783, "byte_end": 5786, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 994, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "25.17% 25.17% 25.17%", "model_b": "31.00% 31.00% 31.00%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.015138182789087296]], "model_b": [[4706, " of", "normal", 0.005742176435887814]]}, "loss": {"model_a": 25.172022848843888, "model_b": 30.99540126909882}, "topk": {"model_a": [4706, 13, 0.015138182789087296, [[21265, 0.219321, " and", false], [40186, 0.088054, " which", false], [37810, 0.070383, " based", false], [32139, 0.05106, " such", false], [61953, 0.048148, " especially", false], [31296, 0.045576, " like", false], [4423, 0.035435, " as", false], [4596, 0.028835, " in", false], [32227, 0.023601, " that", false], [30788, 0.018099, " even", false]]], "model_b": [4706, 28, 0.005742176435887814, [[21265, 0.200061, " and", false], [30788, 0.069876, " even", false], [37810, 0.053307, " based", false], [40186, 0.052455, " which", false], [32465, 0.043169, " when", false], [61953, 0.034159, " especially", false], [4596, 0.03266, " in", false], [32227, 0.029875, " that", false], [32139, 0.027058, " such", false], [4423, 0.025231, " as", false]]]}, "raw_delta": -0.32291666666666674, "tuned_delta": -0.26882706925159117}, {"byte_start": 5786, "byte_end": 5794, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 995, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50%", "model_b": "9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.3314961791038513]], "model_b": [[52224, " methods", "normal", 0.012439017184078693]]}, "loss": {"model_a": 2.5007653296659274, "model_b": 9.932617224870304}, "topk": {"model_a": [52224, 1, 0.3314961791038513, [[52224, 0.331496, " methods", false], [63370, 0.076128, " computation", false], [51832, 0.061012, " general", false], [22590, 0.052537, " the", false], [47202, 0.045617, " search", false], [38888, 0.031043, " lever", false], [52195, 0.021047, " massive", false], [56537, 0.017199, " learning", false], [52805, 0.016802, " scaling", false], [39944, 0.015506, " those", false]]], "model_b": [52224, 16, 0.012439017184078693, [[52195, 0.101128, " massive", false], [52805, 0.063346, " scaling", false], [51832, 0.05546, " general", false], [56537, 0.051596, " learning", false], [40186, 0.046681, " which", false], [22590, 0.041732, " the", false], [47202, 0.040414, " search", false], [38888, 0.036119, " lever", false], [63370, 0.028692, " computation", false], [39590, 0.019601, " scale", false]]]}, "raw_delta": -0.412109375, "tuned_delta": -0.3580197775849244}, {"byte_start": 5794, "byte_end": 5799, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 996, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "0.99% 0.99% 0.99% 0.99% 0.99%", "model_b": "1.46% 1.46% 1.46% 1.46% 1.46%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.7592579126358032]], "model_b": [[32227, " that", "normal", 0.6696622371673584]]}, "loss": {"model_a": 0.9932617224870304, "model_b": 1.4581927415235125}, "topk": {"model_a": [32227, 1, 0.7592579126358032, [[32227, 0.759258, " that", false], [37810, 0.087618, " based", false], [22187, 0.0145, " not", false], [31296, 0.012691, " like", false], [37924, 0.008564, " built", false], [40191, 0.007539, " whose", false], [38888, 0.007425, " lever", false], [21700, 0.007131, " for", false], [4596, 0.006644, " in", false], [55966, 0.006543, " designed", false]]], "model_b": [32227, 1, 0.6696622371673584, [[32227, 0.669662, " that", false], [37810, 0.166664, " based", false], [32487, 0.015728, " with", false], [40191, 0.007735, " whose", false], [31296, 0.007427, " like", false], [21700, 0.005965, " for", false], [40185, 0.005925, " where", false], [22187, 0.005681, " not", false], [40186, 0.005294, " which", false], [37924, 0.005221, " built", false]]]}, "raw_delta": -0.02578125, "tuned_delta": 0.02830834741507559}, {"byte_start": 5799, "byte_end": 5808, "display": {"text": " continue", "kind": "normal"}, "is_word": true, "word_id": 997, "word_key": " continue", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65", "compression": {"model_a": "20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04%", "model_b": "20.41% 20.41% 20.41% 20.41% 20.41% 20.41% 20.41% 20.41% 20.41%"}, "model_tokens": {"model_a": [[55851, " continue", "normal", 4.608542803907767e-05]], "model_b": [[55851, " continue", "normal", 3.690290031954646e-05]]}, "loss": {"model_a": 20.03743112345782, "model_b": 20.413132957022658}, "topk": {"model_a": [55851, 480, 4.608542803907767e-05, [[21286, 0.197445, " are", false], [21413, 0.136272, " can", false], [4491, 0.12731, " do", false], [56540, 0.060552, " leverage", false], [32499, 0.054995, " work", false], [31358, 0.031331, " make", false], [39590, 0.030566, " scale", false], [22681, 0.029318, " use", false], [32187, 0.028249, " take", false], [37730, 0.015528, " apply", false]]], "model_b": [55851, 630, 3.690290031954646e-05, [[21286, 0.156154, " are", false], [56540, 0.156023, " leverage", false], [21413, 0.144458, " can", false], [4491, 0.068109, " do", false], [32187, 0.043945, " take", false], [39590, 0.043452, " scale", false], [22681, 0.031968, " use", false], [32499, 0.027552, " work", false], [31856, 0.015526, " rely", false], [31059, 0.013772, " have", false]]]}, "raw_delta": -0.02083333333333326, "tuned_delta": 0.03325626408174233}, {"byte_start": 5808, "byte_end": 5811, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 998, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.42% 0.42% 0.42%", "model_b": "0.27% 0.27% 0.27%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9320844411849976]], "model_b": [[4811, " to", "normal", 0.9567081332206726]]}, "loss": {"model_a": 0.42266456276043846, "model_b": 0.2656329370126367}, "topk": {"model_a": [4811, 1, 0.9320844411849976, [[4811, 0.932084, " to", false], [38888, 0.003386, " lever", false], [22590, 0.003359, " the", false], [45, 0.003307, ",", false], [4596, 0.002794, " in", false], [52805, 0.002777, " scaling", false], [53362, 0.002759, " working", false], [39931, 0.002388, " their", false], [4712, 0.002205, " on", false], [59832, 0.001889, " improving", false]]], "model_b": [4811, 1, 0.9567081332206726, [[4811, 0.956708, " to", false], [52805, 0.00418, " scaling", false], [22590, 0.003756, " the", false], [4712, 0.001707, " on", false], [45, 0.001532, ",", false], [4596, 0.001358, " in", false], [30788, 0.001103, " even", false], [21265, 0.001012, " and", false], [22187, 0.000924, " not", false], [59346, 0.000739, " computing", false]]]}, "raw_delta": 0.008707682291666666, "tuned_delta": 0.06279727970674226}, {"byte_start": 5811, "byte_end": 5817, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 999, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"model_a": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "model_b": "5.71% 5.71% 5.71% 5.71% 5.71% 5.71%"}, "model_tokens": {"model_a": [[39590, " scale", "normal", 0.1392880231142044]], "model_b": [[39590, " scale", "normal", 0.1488090306520462]]}, "loss": {"model_a": 5.9173038786461385, "model_b": 5.705971597265919}, "topk": {"model_a": [39590, 2, 0.1392880231142044, [[32499, 0.140866, " work", false], [39590, 0.139288, " scale", false], [51982, 0.134192, " improve", false], [4435, 0.07867, " be", false], [56540, 0.040068, " leverage", false], [31358, 0.025031, " make", false], [52573, 0.024293, " produce", false], [38877, 0.020745, " learn", false], [21751, 0.019687, " get", false], [31017, 0.019045, " grow", false]]], "model_b": [39590, 1, 0.1488090306520462, [[39590, 0.148809, " scale", false], [4435, 0.132966, " be", false], [51982, 0.064837, " improve", false], [56540, 0.030342, " leverage", false], [32499, 0.030155, " work", false], [45910, 0.027204, " evolve", false], [31358, 0.024289, " make", false], [31017, 0.02318, " grow", false], [56041, 0.022869, " dominate", false], [22681, 0.01541, " use", false]]]}, "raw_delta": 0.01171875, "tuned_delta": 0.06580834741507559}, {"byte_start": 5817, "byte_end": 5822, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 1000, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"model_a": "6.82% 6.82% 6.82% 6.82% 6.82%", "model_b": "6.20% 6.20% 6.20% 6.20% 6.20%"}, "model_tokens": {"model_a": [[32487, " with", "normal", 0.14969824254512787]], "model_b": [[32487, " with", "normal", 0.1804630607366562]]}, "loss": {"model_a": 6.81898827920174, "model_b": 6.199080253819764}, "topk": {"model_a": [32487, 1, 0.14969824254512787, [[32487, 0.149698, " with", false], [4596, 0.095813, " in", false], [4423, 0.094629, " as", false], [21265, 0.084582, " and", false], [45, 0.080031, ",", false], [63370, 0.05234, " computation", false], [47, 0.046884, ".", false], [64911, 0.036911, " exponentially", false], [4833, 0.028026, " up", false], [39931, 0.021112, " their", false]]], "model_b": [32487, 2, 0.1804630607366562, [[63370, 0.185081, " computation", false], [32487, 0.180463, " with", false], [64911, 0.079293, " exponentially", false], [32458, 0.049571, " well", false], [59988, 0.034906, " massively", false], [4811, 0.032499, " to", false], [4596, 0.032149, " in", false], [47, 0.026817, ".", false], [45, 0.026112, ",", false], [30788, 0.025339, " even", false]]]}, "raw_delta": 0.03437499999999999, "tuned_delta": 0.08846459741507558}, {"byte_start": 5822, "byte_end": 5832, "display": {"text": " increased", "kind": "normal"}, "is_word": true, "word_id": 1001, "word_key": " increased", "bytes_hex": "20 69 6e 63 72 65 61 73 65 64", "compression": {"model_a": "6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09%", "model_b": "9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[59846, " increased", "normal", 0.03413951396942139]], "model_b": [[59846, " increased", "normal", 0.004896621685475111]]}, "loss": {"model_a": 6.0863697037503135, "model_b": 9.580396755903271}, "topk": {"model_a": [59846, 6, 0.03413951396942139, [[22590, 0.22892, " the", false], [63370, 0.133219, " computation", false], [31458, 0.076002, " more", false], [30789, 0.057314, " ever", false], [62092, 0.051011, " increasing", false], [59846, 0.03414, " increased", false], [37045, 0.03338, " Moore", false], [61535, 0.02794, " additional", false], [51816, 0.027925, " further", false], [52195, 0.024579, " massive", false]]], "model_b": [59846, 25, 0.004896621685475111, [[63370, 0.167779, " computation", false], [52195, 0.131501, " massive", false], [22590, 0.104534, " the", false], [62092, 0.057211, " increasing", false], [59346, 0.055336, " computing", false], [332, 0.030502, " a", false], [64911, 0.022719, " exponentially", false], [32251, 0.018296, " time", false], [52731, 0.017258, " respect", false], [38864, 0.016415, " large", false]]]}, "raw_delta": -0.19375, "tuned_delta": -0.1396604025849244}, {"byte_start": 5832, "byte_end": 5844, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 1002, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%", "model_b": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.45999717712402344]], "model_b": [[63370, " computation", "normal", 0.4044737219810486]]}, "loss": {"model_a": 1.1623275475912058, "model_b": 1.3501784643736228}, "topk": {"model_a": [63370, 1, 0.45999717712402344, [[63370, 0.459997, " computation", false], [64862, 0.124821, " computational", false], [59346, 0.078693, " computing", false], [60406, 0.063126, " resources", false], [50897, 0.021716, " amounts", false], [51266, 0.021144, " compute", false], [39339, 0.015046, " power", false], [59206, 0.014973, " available", false], [56353, 0.012508, " hardware", false], [30579, 0.010723, " data", false]]], "model_b": [63370, 1, 0.4044737219810486, [[63370, 0.404474, " computation", false], [64862, 0.096341, " computational", false], [59346, 0.080655, " computing", false], [61720, 0.035001, " complexity", false], [30579, 0.030749, " data", false], [45157, 0.029381, " amount", false], [50897, 0.025754, " amounts", false], [51266, 0.017794, " compute", false], [32031, 0.017248, " size", false], [57453, 0.012027, " training", false]]]}, "raw_delta": -0.010416666666666671, "tuned_delta": 0.04367293074840892}, {"byte_start": 5844, "byte_end": 5849, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 1003, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"model_a": "17.47% 17.47% 17.47% 17.47% 17.47%", "model_b": "16.12% 16.12% 16.12% 16.12% 16.12%"}, "model_tokens": {"model_a": [[30788, " even", "normal", 0.007824920117855072]], "model_b": [[30788, " even", "normal", 0.011292358860373497]]}, "loss": {"model_a": 17.47013526076479, "model_b": 16.11760865993139}, "topk": {"model_a": [30788, 8, 0.007824920117855072, [[47, 0.437822, ".", false], [45, 0.262274, ",", false], [21265, 0.148169, " and", false], [5346, 0.016194, "---", false], [31601, 0.01369, " over", false], [4423, 0.009461, " as", false], [275, 0.008932, " (", false], [30788, 0.007825, " even", false], [4596, 0.007705, " in", false], [59206, 0.00638, " available", false]]], "model_b": [30788, 5, 0.011292358860373497, [[47, 0.487173, ".", false], [45, 0.261033, ",", false], [21265, 0.104812, " and", false], [275, 0.014031, " (", false], [30788, 0.011292, " even", false], [4596, 0.009357, " in", false], [5346, 0.008385, "---", false], [53356, 0.006647, " without", false], [4450, 0.006469, " by", false], [62461, 0.005027, " regardless", false]]]}, "raw_delta": 0.07499999999999996, "tuned_delta": 0.12908959741507553}, {"byte_start": 5849, "byte_end": 5852, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1004, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "6.39% 6.39% 6.39%", "model_b": "7.04% 7.04% 7.04%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.34426066279411316]], "model_b": [[4423, " as", "normal", 0.30528897047042847]]}, "loss": {"model_a": 6.386931170602182, "model_b": 7.044409379340641}, "topk": {"model_a": [4423, 1, 0.34426066279411316, [[4423, 0.344261, " as", false], [32465, 0.230062, " when", false], [4596, 0.099522, " in", false], [4588, 0.095085, " if", false], [47544, 0.068938, " though", false], [37634, 0.057283, " after", false], [40187, 0.019861, " while", false], [53356, 0.007973, " without", false], [31601, 0.007471, " over", false], [21700, 0.006294, " for", false]]], "model_b": [4423, 1, 0.30528897047042847, [[4423, 0.305289, " as", false], [32465, 0.218397, " when", false], [47544, 0.157762, " though", false], [4596, 0.101826, " in", false], [4588, 0.054736, " if", false], [37634, 0.026758, " after", false], [40187, 0.019981, " while", false], [32487, 0.019165, " with", false], [53356, 0.014435, " without", false], [4424, 0.014387, " at", false]]]}, "raw_delta": -0.036458333333333315, "tuned_delta": 0.017631264081742273}, {"byte_start": 5852, "byte_end": 5856, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1005, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "5.92% 5.92% 5.92% 5.92%", "model_b": "8.07% 8.07% 8.07% 8.07%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.2669343650341034]], "model_b": [[22590, " the", "normal", 0.16463494300842285]]}, "loss": {"model_a": 5.9173038786461385, "model_b": 8.065848739345034}, "topk": {"model_a": [22590, 1, 0.2669343650341034, [[22590, 0.266934, " the", false], [32232, 0.183427, " they", false], [4858, 0.110678, " we", false], [38720, 0.074014, " human", false], [39931, 0.037862, " their", false], [31458, 0.024239, " more", false], [39193, 0.018828, " other", false], [22248, 0.018089, " our", false], [63370, 0.014987, " computation", false], [46227, 0.011221, " humans", false]]], "model_b": [22590, 2, 0.16463494300842285, [[32232, 0.267723, " they", false], [22590, 0.164635, " the", false], [39931, 0.065515, " their", false], [31458, 0.038771, " more", false], [4858, 0.038482, " we", false], [63370, 0.029932, " computation", false], [38720, 0.029254, " human", false], [47202, 0.020168, " search", false], [39193, 0.019575, " other", false], [3609, 0.015121, " AI", false]]]}, "raw_delta": -0.119140625, "tuned_delta": -0.06505102758492441}, {"byte_start": 5856, "byte_end": 5866, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 1006, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"model_a": "8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57%", "model_b": "9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07% 9.07%"}, "model_tokens": {"model_a": [[59206, " available", "normal", 0.008583514019846916]], "model_b": [[59206, " available", "normal", 0.006606848910450935]]}, "loss": {"model_a": 8.56600180527822, "model_b": 9.073199280590744}, "topk": {"model_a": [59206, 23, 0.008583514019846916, [[45775, 0.115198, " domain", false], [52569, 0.100676, " problem", false], [38720, 0.061424, " human", false], [62680, 0.036014, " underlying", false], [52224, 0.029215, " methods", false], [45157, 0.026914, " amount", false], [56939, 0.021285, " problems", false], [37636, 0.019084, " agent", false], [57103, 0.018668, " research", false], [59943, 0.018022, " knowledge", false]]], "model_b": [59206, 21, 0.006606848910450935, [[46685, 0.163365, " number", false], [45157, 0.082914, " amount", false], [64862, 0.050957, " computational", false], [63370, 0.043565, " computation", false], [30510, 0.042845, " cost", false], [61720, 0.028336, " complexity", false], [52569, 0.022476, " problem", false], [38720, 0.020906, " human", false], [32251, 0.016126, " time", false], [32031, 0.014076, " size", false]]]}, "raw_delta": -0.028125000000000067, "tuned_delta": 0.02596459741507552}, {"byte_start": 5866, "byte_end": 5878, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 1007, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"model_a": "3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62%", "model_b": "1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63%"}, "model_tokens": {"model_a": [[63370, " computation", "normal", 0.09044206142425537]], "model_b": [[63370, " computation", "normal", 0.33823850750923157]]}, "loss": {"model_a": 3.6161301480615293, "model_b": 1.631954839547248}, "topk": {"model_a": [63370, 3, 0.09044206142425537, [[38720, 0.459459, " human", false], [59943, 0.184088, " knowledge", false], [63370, 0.090442, " computation", false], [30579, 0.044916, " data", false], [45775, 0.032191, " domain", false], [63637, 0.028861, " information", false], [45157, 0.010843, " amount", false], [60406, 0.010127, " resources", false], [64862, 0.008399, " computational", false], [22363, 0.007413, " raw", false]]], "model_b": [63370, 1, 0.33823850750923157, [[63370, 0.338239, " computation", false], [64862, 0.122806, " computational", false], [30579, 0.055708, " data", false], [63637, 0.042078, " information", false], [45157, 0.040587, " amount", false], [59943, 0.038906, " knowledge", false], [60406, 0.033514, " resources", false], [59346, 0.031786, " computing", false], [38720, 0.019141, " human", false], [32251, 0.018369, " time", false]]]}, "raw_delta": 0.11002604166666667, "tuned_delta": 0.16411563908174226}, {"byte_start": 5878, "byte_end": 5886, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 1008, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"model_a": "8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07%", "model_b": "6.02% 6.02% 6.02% 6.02% 6.02% 6.02% 6.02% 6.02%"}, "model_tokens": {"model_a": [[51019, " becomes", "normal", 0.027750374749302864]], "model_b": [[51019, " becomes", "normal", 0.06954191625118256]]}, "loss": {"model_a": 8.065848739345034, "model_b": 6.022970019336248}, "topk": {"model_a": [51019, 6, 0.027750374749302864, [[59847, 0.466229, " increases", false], [38642, 0.213637, " grows", false], [4600, 0.039365, " is", false], [59393, 0.036534, " continues", false], [47181, 0.030308, " scales", false], [51019, 0.02775, " becomes", false], [46342, 0.025315, " itself", false], [30659, 0.019472, " does", false], [51682, 0.007159, " expands", false], [51165, 0.007093, " changes", false]]], "model_b": [51019, 4, 0.06954191625118256, [[59847, 0.275121, " increases", false], [4600, 0.135981, " is", false], [38642, 0.120365, " grows", false], [51019, 0.069542, " becomes", false], [47181, 0.054568, " scales", false], [30965, 0.032458, " gets", false], [51521, 0.031248, " doubles", false], [59456, 0.025819, " decreases", false], [59393, 0.025064, " continues", false], [47273, 0.012728, " shrink", false]]]}, "raw_delta": 0.11328125, "tuned_delta": 0.16737084741507557}, {"byte_start": 5886, "byte_end": 5891, "display": {"text": " very", "kind": "normal"}, "is_word": true, "word_id": 1009, "word_key": " very", "bytes_hex": "20 76 65 72 79", "compression": {"model_a": "14.77% 14.77% 14.77% 14.77% 14.77%", "model_b": "24.01% 24.01% 24.01% 24.01% 24.01%"}, "model_tokens": {"model_a": [[32386, " very", "normal", 0.016866842284798622]], "model_b": [[32386, " very", "normal", 0.0012929176446050406]]}, "loss": {"model_a": 14.765082059097983, "model_b": 24.007347164792904}, "topk": {"model_a": [32386, 15, 0.016866842284798622, [[31458, 0.198606, " more", false], [64430, 0.078598, " increasingly", false], [30789, 0.071104, " ever", false], [51867, 0.060054, " greater", false], [47708, 0.049904, " vastly", false], [46397, 0.046751, " larger", false], [32373, 0.040181, " vast", false], [59988, 0.036478, " massively", false], [31466, 0.030799, " much", false], [31277, 0.03058, " less", false]]], "model_b": [32386, 50, 0.0012929176446050406, [[31458, 0.196263, " more", false], [64911, 0.119086, " exponentially", false], [30789, 0.076658, " ever", false], [64430, 0.065054, " increasingly", false], [51867, 0.064711, " greater", false], [31277, 0.051354, " less", false], [31466, 0.043816, " much", false], [46397, 0.040961, " larger", false], [32373, 0.019087, " vast", false], [59988, 0.017067, " massively", false]]]}, "raw_delta": -0.5125000000000001, "tuned_delta": -0.4584104025849245}, {"byte_start": 5891, "byte_end": 5897, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 1010, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"model_a": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "model_b": "8.92% 8.92% 8.92% 8.92% 8.92% 8.92%"}, "model_tokens": {"model_a": [[38629, " great", "normal", 0.009130761958658695]], "model_b": [[38629, " great", "normal", 0.05116667598485947]]}, "loss": {"model_a": 14.088818758681281, "model_b": 8.922918547164812}, "topk": {"model_a": [38629, 11, 0.009130761958658695, [[38864, 0.648381, " large", false], [45, 0.039464, ",", false], [31466, 0.039348, " much", false], [52195, 0.03162, " massive", false], [59682, 0.029665, " expensive", false], [52140, 0.024815, " limited", false], [38006, 0.021361, " cheap", false], [55425, 0.016649, " abundant", false], [32386, 0.013949, " very", false], [31082, 0.012535, " high", false]]], "model_b": [38629, 4, 0.05116667598485947, [[38864, 0.398158, " large", false], [31466, 0.202229, " much", false], [52195, 0.053145, " massive", false], [38629, 0.051167, " great", false], [52140, 0.049841, " limited", false], [45, 0.019734, ",", false], [39720, 0.018025, " small", false], [21357, 0.015587, " big", false], [59513, 0.011506, " different", false], [31118, 0.010629, " huge", false]]]}, "raw_delta": 0.2864583333333333, "tuned_delta": 0.3405479307484089}, {"byte_start": 5897, "byte_end": 5898, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "3.12%", "model_b": "5.28%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.8422117233276367]], "model_b": [[47, ".", "normal", 0.746638298034668]]}, "loss": {"model_a": 3.1171511503582336, "model_b": 5.283307034505481}, "topk": {"model_a": [47, 1, 0.8422117233276367, [[47, 0.842212, ".", false], [45, 0.091486, ",", false], [21265, 0.017741, " and", false], [5346, 0.015824, "---", false], [275, 0.009558, " (", false], [46272, 0.004551, " indeed", false], [4596, 0.002794, " in", false], [59, 0.002333, ":", false], [31601, 0.001695, " over", false], [60, 0.001498, ";", false]]], "model_b": [47, 1, 0.746638298034668, [[47, 0.746638, ".", false], [45, 0.12479, ",", false], [21265, 0.032502, " and", false], [5346, 0.018545, "---", false], [275, 0.014675, " (", false], [46272, 0.011562, " indeed", false], [21400, 0.007949, " but", false], [4596, 0.006562, " in", false], [57070, 0.00439, " relative", false], [37635, 0.003627, " again", false]]]}, "raw_delta": -0.1201171875, "tuned_delta": -0.06602759008492441}, {"byte_start": 5898, "byte_end": 5902, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 1011, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"model_a": "9.51% 9.51% 9.51% 9.51%", "model_b": "8.88% 8.88% 8.88% 8.88%"}, "model_tokens": {"model_a": [[20996, " The", "normal", 0.12276290357112885]], "model_b": [[20996, " The", "normal", 0.13883841037750244]]}, "loss": {"model_a": 9.509952662109866, "model_b": 8.875955817969208}, "topk": {"model_a": [20996, 1, 0.12276290357112885, [[20996, 0.122763, " The", false], [29894, 0.100596, " This", false], [37453, 0.074076, " These", false], [49964, 0.050826, " Another", false], [3913, 0.046974, " In", false], [3918, 0.040912, " It", false], [4331, 0.037225, " We", false], [19555, 0.025029, " But", false], [37451, 0.023522, " There", false], [300, 0.022858, " A", false]]], "model_b": [20996, 1, 0.13883841037750244, [[20996, 0.138838, " The", false], [29894, 0.125697, " This", false], [3913, 0.053278, " In", false], [37453, 0.050492, " These", false], [3918, 0.047602, " It", false], [37451, 0.032697, " There", false], [29834, 0.02457, " Such", false], [4331, 0.022575, " We", false], [300, 0.020023, " A", false], [29889, 0.01843, " That", false]]]}, "raw_delta": 0.03515625, "tuned_delta": 0.08924584741507559}, {"byte_start": 5902, "byte_end": 5906, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 1012, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"model_a": "25.22% 25.22% 25.22% 25.22%", "model_b": "25.92% 25.92% 25.92% 25.92%"}, "model_tokens": {"model_a": [[22638, " two", "normal", 0.0037508720997720957]], "model_b": [[22638, " two", "normal", 0.0031534130685031414]]}, "loss": {"model_a": 25.218985578039494, "model_b": 25.92342651597356}, "topk": {"model_a": [22638, 44, 0.0037508720997720957, [[52224, 0.048183, " methods", false], [45315, 0.046474, " bitter", false], [39193, 0.042814, " other", false], [51832, 0.032339, " general", false], [31461, 0.029584, " most", false], [39339, 0.023737, " power", false], [46430, 0.02333, " lesson", false], [38720, 0.022358, " human", false], [38629, 0.0196, " great", false], [31458, 0.013139, " more", false]]], "model_b": [22638, 46, 0.0031534130685031414, [[45315, 0.111914, " bitter", false], [51832, 0.032683, " general", false], [39339, 0.031557, " power", false], [38629, 0.029531, " great", false], [52224, 0.026168, " methods", false], [31461, 0.025873, " most", false], [38720, 0.017132, " human", false], [46430, 0.016857, " lesson", false], [30273, 0.01232, " best", false], [56331, 0.011739, " greatest", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.015027097415075588}, {"byte_start": 5906, "byte_end": 5914, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1013, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83%", "model_b": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.04795757681131363]], "model_b": [[52224, " methods", "normal", 0.041161324828863144]]}, "loss": {"model_a": 6.833077097960421, "model_b": 7.185297566927454}, "topk": {"model_a": [52224, 3, 0.04795757681131363, [[31461, 0.227209, " most", false], [56162, 0.089797, " examples", false], [52224, 0.047958, " methods", false], [31356, 0.043051, " main", false], [61590, 0.040895, " approaches", false], [51832, 0.034791, " general", false], [39193, 0.028591, " other", false], [21357, 0.027638, " big", false], [38629, 0.026169, " great", false], [38841, 0.021979, " kinds", false]]], "model_b": [52224, 5, 0.041161324828863144, [[31461, 0.244422, " most", false], [61590, 0.073023, " approaches", false], [31356, 0.063172, " main", false], [38961, 0.041548, " major", false], [52224, 0.041161, " methods", false], [51200, 0.019709, " classes", false], [51832, 0.016396, " general", false], [59829, 0.015607, " important", false], [51039, 0.01405, " biggest", false], [46, 0.014009, "-", false]]]}, "raw_delta": -0.01953125, "tuned_delta": 0.03455834741507559}, {"byte_start": 5914, "byte_end": 5919, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1014, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "1.85% 1.85% 1.85% 1.85% 1.85%", "model_b": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.600534975528717]], "model_b": [[32227, " that", "normal", 0.5430541038513184]]}, "loss": {"model_a": 1.8456352573872479, "model_b": 2.141500451319555}, "topk": {"model_a": [32227, 1, 0.600534975528717, [[32227, 0.600535, " that", false], [31461, 0.0362, " most", false], [60003, 0.033344, " mentioned", false], [4596, 0.032641, " in", false], [45, 0.031235, ",", false], [4706, 0.024974, " of", false], [21286, 0.022882, " are", false], [4858, 0.018746, " we", false], [59546, 0.018099, " discussed", false], [5346, 0.010903, "---", false]]], "model_b": [32227, 1, 0.5430541038513184, [[32227, 0.543054, " that", false], [4706, 0.059561, " of", false], [31461, 0.044783, " most", false], [4596, 0.034774, " in", false], [21286, 0.030687, " are", false], [45, 0.028833, ",", false], [60003, 0.026279, " mentioned", false], [4858, 0.011292, " we", false], [21700, 0.011172, " for", false], [59546, 0.009987, " discussed", false]]]}, "raw_delta": -0.016406249999999997, "tuned_delta": 0.03768334741507559}, {"byte_start": 5919, "byte_end": 5924, "display": {"text": " seem", "kind": "normal"}, "is_word": true, "word_id": 1015, "word_key": " seem", "bytes_hex": "20 73 65 65 6d", "compression": {"model_a": "17.02% 17.02% 17.02% 17.02% 17.02%", "model_b": "18.94% 18.94% 18.94% 18.94% 18.94%"}, "model_tokens": {"model_a": [[31967, " seem", "normal", 0.008849682286381721]], "model_b": [[31967, " seem", "normal", 0.0053069875575602055]]}, "loss": {"model_a": 17.019293060486987, "model_b": 18.935372411667643}, "topk": {"model_a": [31967, 16, 0.008849682286381721, [[31059, 0.280323, " have", false], [21286, 0.099518, " are", false], [56041, 0.072332, " dominate", false], [22777, 0.031133, " won", false], [39590, 0.029646, " scale", false], [56540, 0.02449, " leverage", false], [4491, 0.02119, " do", false], [22770, 0.0181, " win", false], [31461, 0.014474, " most", false], [52597, 0.013958, " provide", false]]], "model_b": [31967, 30, 0.0053069875575602055, [[31059, 0.1188, " have", false], [21286, 0.086141, " are", false], [32462, 0.070374, " were", false], [31461, 0.048436, " most", false], [59572, 0.046493, " dominated", false], [30383, 0.02285, " came", false], [56041, 0.02215, " dominate", false], [21994, 0.021849, " led", false], [31351, 0.02161, " made", false], [32475, 0.016462, " will", false]]]}, "raw_delta": -0.10625000000000007, "tuned_delta": -0.05216040258492448}, {"byte_start": 5924, "byte_end": 5927, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1016, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "2.90% 2.90% 2.90%", "model_b": "2.08% 2.08% 2.08%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.6157535910606384]], "model_b": [[4811, " to", "normal", 0.7094117403030396]]}, "loss": {"model_a": 2.8999485278285637, "model_b": 2.078100766905489}, "topk": {"model_a": [4811, 1, 0.6157535910606384, [[4811, 0.615754, " to", false], [31461, 0.208454, " most", false], [30273, 0.025807, " best", false], [46439, 0.015218, " likely", false], [22590, 0.013669, " the", false], [31296, 0.008436, " like", false], [61953, 0.006983, " especially", false], [45, 0.006332, ",", false], [55971, 0.005988, " destined", false], [64507, 0.004612, " particularly", false]]], "model_b": [4811, 1, 0.7094117403030396, [[4811, 0.709412, " to", false], [31461, 0.131879, " most", false], [22590, 0.020382, " the", false], [30273, 0.013539, " best", false], [64507, 0.011202, " particularly", false], [46439, 0.010556, " likely", false], [31296, 0.009147, " like", false], [38879, 0.004853, " least", false], [61953, 0.004299, " especially", false], [55971, 0.003983, " destined", false]]]}, "raw_delta": 0.04557291666666666, "tuned_delta": 0.09966251408174225}, {"byte_start": 5927, "byte_end": 5933, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 1017, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"model_a": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "model_b": "20.01% 20.01% 20.01% 20.01% 20.01% 20.01%"}, "model_tokens": {"model_a": [[39590, " scale", "normal", 0.021370796486735344]], "model_b": [[39590, " scale", "normal", 0.0012743016704916954]]}, "loss": {"model_a": 11.55283138211865, "model_b": 20.00612263732742}, "topk": {"model_a": [39590, 7, 0.021370796486735344, [[4435, 0.256499, " be", false], [31059, 0.189022, " have", false], [56041, 0.07728, " dominate", false], [4491, 0.042717, " do", false], [32499, 0.026914, " work", false], [22770, 0.021801, " win", false], [39590, 0.021371, " scale", false], [52597, 0.020961, " provide", false], [39169, 0.015354, " offer", false], [4660, 0.012185, " me", false]]], "model_b": [39590, 61, 0.0012743016704916954, [[4435, 0.335181, " be", false], [31059, 0.193648, " have", false], [56041, 0.097275, " dominate", false], [32499, 0.016571, " work", false], [31358, 0.012322, " make", false], [4491, 0.010988, " do", false], [31461, 0.010109, " most", false], [30482, 0.009574, " come", false], [39797, 0.009309, " stand", false], [30273, 0.008793, " best", false]]]}, "raw_delta": -0.46875, "tuned_delta": -0.4146604025849244}, {"byte_start": 5933, "byte_end": 5945, "display": {"text": " arbitrarily", "kind": "normal"}, "is_word": true, "word_id": 1018, "word_key": " arbitrarily", "bytes_hex": "20 61 72 62 69 74 72 61 72 69 6c 79", "compression": {"model_a": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "model_b": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"model_a": [[63293, " arbitrarily", "normal", 3.4344517189310864e-05]], "model_b": [[63293, " arbitrarily", "normal", 0.00022085424279794097]]}, "loss": {"model_a": 15.49770063454941, "model_b": 12.679936882813154}, "topk": {"model_a": [63293, 355, 3.4344517189310864e-05, [[30273, 0.288058, " best", false], [31461, 0.157965, " most", false], [32487, 0.118358, " with", false], [22590, 0.108727, " the", false], [4596, 0.055994, " in", false], [21286, 0.028604, " are", false], [32234, 0.019026, " this", false], [4811, 0.012696, " to", false], [32458, 0.012521, " well", false], [4424, 0.010743, " at", false]]], "model_b": [63293, 211, 0.00022085424279794097, [[30273, 0.162416, " best", false], [32458, 0.121651, " well", false], [22590, 0.110565, " the", false], [31461, 0.091273, " most", false], [32487, 0.089879, " with", false], [32386, 0.027849, " very", false], [4596, 0.024829, " in", false], [45301, 0.020598, " better", false], [51718, 0.020307, " fastest", false], [4423, 0.013413, " as", false]]]}, "raw_delta": 0.15625, "tuned_delta": 0.21033959741507557}, {"byte_start": 5945, "byte_end": 5948, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1019, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "25.92% 25.92% 25.92%", "model_b": "23.48% 23.48% 23.48%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.013327537104487419]], "model_b": [[4596, " in", "normal", 0.020022490993142128]]}, "loss": {"model_a": 25.92342651597356, "model_b": 23.481364597802134}, "topk": {"model_a": [4596, 7, 0.013327537104487419, [[32458, 0.580077, " well", false], [21286, 0.163976, " are", false], [45, 0.059394, ",", false], [32487, 0.055862, " with", false], [5346, 0.020386, "---", false], [30826, 0.01591, " fast", false], [4596, 0.013328, " in", false], [275, 0.010466, " (", false], [21265, 0.007186, " and", false], [21660, 0.005985, " far", false]]], "model_b": [4596, 6, 0.020022490993142128, [[32458, 0.639265, " well", false], [21286, 0.071104, " are", false], [32487, 0.055871, " with", false], [30826, 0.040919, " fast", false], [45, 0.025143, ",", false], [4596, 0.020022, " in", false], [52628, 0.014153, " quickly", false], [21265, 0.00746, " and", false], [4423, 0.007176, " as", false], [38864, 0.007099, " large", false]]]}, "raw_delta": 0.13541666666666674, "tuned_delta": 0.18950626408174231}, {"byte_start": 5948, "byte_end": 5953, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1020, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "2.27% 2.27% 2.27% 2.27% 2.27%", "model_b": "7.89% 7.89% 7.89% 7.89% 7.89%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.5358603000640869]], "model_b": [[32234, " this", "normal", 0.11190338432788849]]}, "loss": {"model_a": 2.2682998201476865, "model_b": 7.889738504861517}, "topk": {"model_a": [32234, 1, 0.5358603000640869, [[32234, 0.53586, " this", false], [22590, 0.103242, " the", false], [39339, 0.034922, " power", false], [332, 0.029159, " a", false], [32227, 0.024856, " that", false], [39931, 0.024263, " their", false], [3609, 0.01975, " AI", false], [21256, 0.018288, " all", false], [63370, 0.016905, " computation", false], [39920, 0.014474, " terms", false]]], "model_b": [32234, 2, 0.11190338432788849, [[22590, 0.34562, " the", false], [32234, 0.111903, " this", false], [56901, 0.060235, " practice", false], [3609, 0.034883, " AI", false], [51832, 0.031766, " general", false], [32251, 0.031298, " time", false], [55809, 0.024486, " computer", false], [39920, 0.020089, " terms", false], [332, 0.019825, " a", false], [39339, 0.014915, " power", false]]]}, "raw_delta": -0.31171875, "tuned_delta": -0.2576291525849244}, {"byte_start": 5953, "byte_end": 5957, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 1021, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"model_a": "1.24% 1.24% 1.24% 1.24%", "model_b": "6.09% 6.09% 6.09% 6.09%"}, "model_tokens": {"model_a": [[22752, " way", "normal", 0.7598547339439392]], "model_b": [[22752, " way", "normal", 0.2594517171382904]]}, "loss": {"model_a": 1.241577153108788, "model_b": 6.093414113129654}, "topk": {"model_a": [22752, 1, 0.7598547339439392, [[22752, 0.759855, " way", false], [51717, 0.051551, " fashion", false], [46505, 0.041358, " manner", false], [39631, 0.038833, " sense", false], [47043, 0.037563, " regard", false], [52731, 0.021625, " respect", false], [59526, 0.009479, " direction", false], [51310, 0.007768, " context", false], [30405, 0.004511, " case", false], [32375, 0.003053, " vein", false]]], "model_b": [22752, 1, 0.2594517171382904, [[22752, 0.259452, " way", false], [52731, 0.213546, " respect", false], [47043, 0.16237, " regard", false], [39631, 0.111307, " sense", false], [59526, 0.046427, " direction", false], [46505, 0.041878, " manner", false], [51717, 0.026391, " fashion", false], [51310, 0.024967, " context", false], [30405, 0.009652, " case", false], [47045, 0.007085, " regime", false]]]}, "raw_delta": -0.26904296875, "tuned_delta": -0.21495337133492443}, {"byte_start": 5957, "byte_end": 5961, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1022, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "0.63% 0.63% 0.63% 0.63%", "model_b": "1.88% 1.88% 1.88% 1.88%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.8693117499351501]], "model_b": [[21286, " are", "normal", 0.6551818251609802]]}, "loss": {"model_a": 0.6295940882785698, "model_b": 1.8843795089736215}, "topk": {"model_a": [21286, 1, 0.8693117499351501, [[21286, 0.869312, " are", false], [45, 0.06059, ",", false], [5346, 0.015101, "---", false], [4596, 0.010288, " in", false], [275, 0.007978, " (", false], [21265, 0.006446, " and", false], [31059, 0.002976, " have", false], [21700, 0.001804, " for", false], [32462, 0.001268, " were", false], [32227, 0.001243, " that", false]]], "model_b": [21286, 1, 0.6551818251609802, [[21286, 0.655182, " are", false], [45, 0.132472, ",", false], [5346, 0.0479, "---", false], [275, 0.022097, " (", false], [32462, 0.019868, " were", false], [31059, 0.018138, " have", false], [4596, 0.011671, " in", false], [568, 0.009593, "--", false], [21265, 0.007748, " and", false], [51987, 0.005461, " include", false]]]}, "raw_delta": -0.069580078125, "tuned_delta": -0.015490480709924412}, {"byte_start": 5961, "byte_end": 5968, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1023, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "2.07% 2.07% 2.07% 2.07% 2.07% 2.07% 2.07%", "model_b": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.45155325531959534]], "model_b": [[47202, " search", "normal", 0.12801921367645264]]}, "loss": {"model_a": 2.073069045920245, "model_b": 5.273243592534995}, "topk": {"model_a": [47202, 1, 0.45155325531959534, [[47202, 0.451553, " search", false], [56537, 0.216898, " learning", false], [30597, 0.063031, " deep", false], [22590, 0.024574, " the", false], [52224, 0.015205, " methods", false], [275, 0.014344, " (", false], [51832, 0.014287, " general", false], [59, 0.014113, ":", false], [31978, 0.013708, " self", false], [284, 0.012589, " 1", false]]], "model_b": [47202, 2, 0.12801921367645264, [[30597, 0.305391, " deep", false], [47202, 0.128019, " search", false], [56537, 0.062627, " learning", false], [22590, 0.049917, " the", false], [46658, 0.035381, " neural", false], [51832, 0.021637, " general", false], [52167, 0.021371, " machine", false], [65003, 0.016191, " reinforcement", false], [52195, 0.013896, " massive", false], [28753, 0.010792, " Deep", false]]]}, "raw_delta": -0.17745535714285718, "tuned_delta": -0.12336575972778159}, {"byte_start": 5968, "byte_end": 5972, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1024, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "0.75% 0.75% 0.75% 0.75%", "model_b": "1.89% 1.89% 1.89% 1.89%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.8481370210647583]], "model_b": [[21265, " and", "normal", 0.6555535197257996]]}, "loss": {"model_a": 0.752871252417031, "model_b": 1.8931850206977971}, "topk": {"model_a": [21265, 1, 0.8481370210647583, [[21265, 0.848137, " and", false], [275, 0.037155, " (", false], [45, 0.035785, ",", false], [4450, 0.014302, " by", false], [46, 0.009083, "-", false], [21700, 0.007965, " for", false], [4596, 0.007037, " in", false], [48, 0.006575, "/", false], [52224, 0.006182, " methods", false], [5346, 0.005235, "---", false]]], "model_b": [21265, 1, 0.6555535197257996, [[21265, 0.655554, " and", false], [4450, 0.107473, " by", false], [45, 0.062937, ",", false], [46, 0.037404, "-", false], [275, 0.03134, " (", false], [52224, 0.029604, " methods", false], [37810, 0.018898, " based", false], [4596, 0.006183, " in", false], [61559, 0.00507, " algorithms", false], [4423, 0.003749, " as", false]]]}, "raw_delta": -0.063232421875, "tuned_delta": -0.009142824459924412}, {"byte_start": 5972, "byte_end": 5981, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 1025, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"model_a": "0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09%", "model_b": "0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59%"}, "model_tokens": {"model_a": [[56537, " learning", "normal", 0.955946683883667]], "model_b": [[56537, " learning", "normal", 0.7469292879104614]]}, "loss": {"model_a": 0.09001189762490819, "model_b": 0.5870341149450534}, "topk": {"model_a": [56537, 1, 0.955946683883667, [[56537, 0.955947, " learning", false], [31978, 0.007853, " self", false], [30597, 0.007209, " deep", false], [63885, 0.002888, " statistical", false], [63370, 0.002856, " computation", false], [62577, 0.002222, " statistics", false], [52167, 0.002175, " machine", false], [22590, 0.001699, " the", false], [45, 0.001113, ",", false], [38877, 0.000974, " learn", false]]], "model_b": [56537, 1, 0.7469292879104614, [[56537, 0.746929, " learning", false], [30597, 0.083072, " deep", false], [65135, 0.030154, " generalization", false], [51832, 0.026597, " general", false], [52167, 0.011836, " machine", false], [31978, 0.010438, " self", false], [46658, 0.005244, " neural", false], [63370, 0.004824, " computation", false], [22590, 0.004709, " the", false], [63885, 0.003757, " statistical", false]]]}, "raw_delta": -0.02756076388888889, "tuned_delta": 0.026528833526186697}, {"byte_start": 5981, "byte_end": 5982, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "6.62%", "model_b": "9.58%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6958373785018921]], "model_b": [[47, ".", "normal", 0.5903457403182983]]}, "loss": {"model_a": 6.621744816580202, "model_b": 9.580396755903271}, "topk": {"model_a": [47, 1, 0.6958373785018921, [[47, 0.695837, ".", false], [45, 0.143549, ",", false], [4450, 0.058391, " by", false], [5346, 0.044315, "---", false], [275, 0.020473, " (", false], [60, 0.008673, ";", false], [37810, 0.003398, " based", false], [59, 0.002846, ":", false], [4596, 0.002768, " in", false], [22705, 0.002312, " via", false]]], "model_b": [47, 1, 0.5903457403182983, [[47, 0.590346, ".", false], [4450, 0.157851, " by", false], [45, 0.151121, ",", false], [275, 0.018267, " (", false], [4596, 0.014825, " in", false], [5346, 0.00767, "---", false], [4712, 0.007089, " on", false], [4706, 0.005371, " of", false], [60, 0.004862, ";", false], [4423, 0.003983, " as", false]]]}, "raw_delta": -0.1640625, "tuned_delta": -0.10997290258492441}, {"byte_start": 5982, "byte_end": 5983, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "30.29%", "model_b": "31.42%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.03502431884407997]], "model_b": [[261, "\n\n", "control", 0.030500805005431175]]}, "loss": {"model_a": 30.290960331164754, "model_b": 31.41806583185926}, "topk": {"model_a": [261, 7, 0.03502431884407997, [[20996, 0.118947, " The", false], [44844, 0.08454, " Search", false], [37453, 0.06573, " These", false], [29893, 0.049894, " They", false], [3913, 0.043841, " In", false], [28530, 0.038686, " Both", false], [261, 0.035024, "\n\n", false], [29894, 0.030989, " This", false], [37451, 0.02994, " There", false], [3918, 0.029626, " It", false]]], "model_b": [261, 8, 0.030500805005431175, [[20996, 0.127131, " The", false], [44844, 0.066171, " Search", false], [37453, 0.059307, " These", false], [3913, 0.049243, " In", false], [29894, 0.045524, " This", false], [29893, 0.036254, " They", false], [3918, 0.031884, " It", false], [261, 0.030501, "\n\n", false], [19417, 0.023107, " And", false], [4331, 0.023058, " We", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.008410402584924412}, {"byte_start": 5983, "byte_end": 5984, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "30.29%", "model_b": "31.42%"}, "model_tokens": {"model_a": [[261, "\n\n", "control", 0.03502431884407997]], "model_b": [[261, "\n\n", "control", 0.030500805005431175]]}, "loss": {"model_a": 30.290960331164754, "model_b": 31.41806583185926}, "topk": {"model_a": [261, 7, 0.03502431884407997, [[20996, 0.118947, " The", false], [44844, 0.08454, " Search", false], [37453, 0.06573, " These", false], [29893, 0.049894, " They", false], [3913, 0.043841, " In", false], [28530, 0.038686, " Both", false], [261, 0.035024, "\n\n", false], [29894, 0.030989, " This", false], [37451, 0.02994, " There", false], [3918, 0.029626, " It", false]]], "model_b": [261, 8, 0.030500805005431175, [[20996, 0.127131, " The", false], [44844, 0.066171, " Search", false], [37453, 0.059307, " These", false], [3913, 0.049243, " In", false], [29894, 0.045524, " This", false], [29893, 0.036254, " They", false], [3918, 0.031884, " It", false], [261, 0.030501, "\n\n", false], [19417, 0.023107, " And", false], [4331, 0.023058, " We", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.008410402584924412}, {"byte_start": 5984, "byte_end": 5987, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 1026, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"model_a": "10.75% 10.75% 10.75%", "model_b": "12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[6699, "The", "normal", 0.167260080575943]], "model_b": [[6699, "The", "normal", 0.12846434116363525]]}, "loss": {"model_a": 10.754464985793378, "model_b": 12.398160507639528}, "topk": {"model_a": [6699, 1, 0.167260080575943, [[6699, 0.16726, "The", false], [1136, 0.07729, "In", false], [40754, 0.060815, "Search", false], [48358, 0.059455, "Another", false], [66, 0.048495, "A", false], [33504, 0.04158, "There", false], [24242, 0.032702, "This", false], [1141, 0.027615, "It", false], [1589, 0.026254, "We", false], [6393, 0.021957, "One", false]]], "model_b": [6699, 1, 0.12846434116363525, [[6699, 0.128464, "The", false], [24100, 0.052748, "Rich", false], [60897, 0.042348, "References", false], [40754, 0.036733, "Search", false], [1136, 0.034755, "In", false], [24242, 0.029958, "This", false], [33504, 0.022382, "There", false], [6393, 0.020846, "One", false], [66, 0.019672, "A", false], [1141, 0.012684, "It", false]]]}, "raw_delta": -0.09114583333333337, "tuned_delta": -0.03705623591825778}, {"byte_start": 5987, "byte_end": 5994, "display": {"text": " second", "kind": "normal"}, "is_word": true, "word_id": 1027, "word_key": " second", "bytes_hex": "20 73 65 63 6f 6e 64", "compression": {"model_a": "7.53% 7.53% 7.53% 7.53% 7.53% 7.53% 7.53%", "model_b": "9.82% 9.82% 9.82% 9.82% 9.82% 9.82% 9.82%"}, "model_tokens": {"model_a": [[47205, " second", "normal", 0.05338800325989723]], "model_b": [[47205, " second", "normal", 0.022051727399230003]]}, "loss": {"model_a": 7.527454593924, "model_b": 9.821919363194949}, "topk": {"model_a": [47205, 2, 0.05338800325989723, [[39193, 0.078959, " other", false], [47205, 0.053388, " second", false], [45315, 0.042152, " bitter", false], [38499, 0.040274, " first", false], [47202, 0.0356, " search", false], [46430, 0.021967, " lesson", false], [31515, 0.020945, " next", false], [31461, 0.020122, " most", false], [45184, 0.018424, " appeal", false], [19523, 0.017487, " Bit", false]]], "model_b": [47205, 5, 0.022051727399230003, [[45315, 0.190955, " bitter", false], [19523, 0.124299, " Bit", false], [39193, 0.033055, " other", false], [38499, 0.024276, " first", false], [47205, 0.022052, " second", false], [61640, 0.019732, " bitterness", false], [46430, 0.016931, " lesson", false], [31461, 0.016842, " most", false], [31515, 0.013313, " next", false], [22638, 0.011452, " two", false]]]}, "raw_delta": -0.1272321428571428, "tuned_delta": -0.0731425454420672}, {"byte_start": 5994, "byte_end": 6002, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 1028, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"model_a": "10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92%", "model_b": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55%"}, "model_tokens": {"model_a": [[51832, " general", "normal", 0.007929818704724312]], "model_b": [[51832, " general", "normal", 0.006038366816937923]]}, "loss": {"model_a": 10.918834537977993, "model_b": 11.55283138211865}, "topk": {"model_a": [51832, 13, 0.007929818704724312, [[46430, 0.444956, " lesson", false], [39941, 0.236752, " thing", false], [21357, 0.0326, " big", false], [45, 0.02639, ",", false], [59829, 0.022833, " important", false], [4600, 0.018489, " is", false], [38629, 0.016371, " great", false], [45315, 0.013829, " bitter", false], [38961, 0.01184, " major", false], [21365, 0.011642, " bit", false]]], "model_b": [51832, 24, 0.006038366816937923, [[46430, 0.161736, " lesson", false], [59829, 0.136222, " important", false], [39941, 0.086031, " thing", false], [21357, 0.035364, " big", false], [39310, 0.034302, " point", false], [38961, 0.033234, " major", false], [31633, 0.031134, " part", false], [4600, 0.026348, " is", false], [31461, 0.021473, " most", false], [32115, 0.016938, " step", false]]]}, "raw_delta": -0.03515625, "tuned_delta": 0.018933347415075588}, {"byte_start": 6002, "byte_end": 6008, "display": {"text": " point", "kind": "normal"}, "is_word": true, "word_id": 1029, "word_key": " point", "bytes_hex": "20 70 6f 69 6e 74", "compression": {"model_a": "11.93% 11.93% 11.93% 11.93% 11.93% 11.93%", "model_b": "20.10% 20.10% 20.10% 20.10% 20.10% 20.10%"}, "model_tokens": {"model_a": [[39310, " point", "normal", 0.01900864765048027]], "model_b": [[39310, " point", "normal", 0.0012440521968528628]]}, "loss": {"model_a": 11.928533215683485, "model_b": 20.100048095718627}, "topk": {"model_a": [39310, 6, 0.01900864765048027, [[46430, 0.635106, " lesson", false], [46561, 0.116598, " method", false], [60250, 0.032214, " principle", false], [63729, 0.022525, " observation", false], [52610, 0.020929, " purpose", false], [39310, 0.019009, " point", false], [38046, 0.014627, " class", false], [55532, 0.012005, " approach", false], [52022, 0.011643, " insight", false], [46, 0.009202, "-", false]]], "model_b": [39310, 29, 0.0012440521968528628, [[52610, 0.392581, " purpose", false], [46, 0.178759, "-", false], [46561, 0.162494, " method", false], [46430, 0.043698, " lesson", false], [60250, 0.04147, " principle", false], [55532, 0.018281, " approach", false], [45, 0.010862, ",", false], [22752, 0.006442, " way", false], [38046, 0.005975, " class", false], [7933, 0.005968, "ity", false]]]}, "raw_delta": -0.45312499999999994, "tuned_delta": -0.39903540258492437}, {"byte_start": 6008, "byte_end": 6011, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1030, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "13.90% 13.90% 13.90%", "model_b": "12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.09831735491752625]], "model_b": [[4811, " to", "normal", 0.1260164976119995]]}, "loss": {"model_a": 13.900967841898865, "model_b": 12.398160507639528}, "topk": {"model_a": [4811, 3, 0.09831735491752625, [[4600, 0.585693, " is", false], [32227, 0.135859, " that", false], [4811, 0.098317, " to", false], [45, 0.039834, ",", false], [4706, 0.025722, " of", false], [4858, 0.01797, " we", false], [30917, 0.014022, " from", false], [37598, 0.009947, " about", false], [47266, 0.00759, " should", false], [55817, 0.005214, " concerns", false]]], "model_b": [4811, 2, 0.1260164976119995, [[4600, 0.492258, " is", false], [4811, 0.126016, " to", false], [4706, 0.086831, " of", false], [32227, 0.083312, " that", false], [37598, 0.031041, " about", false], [45, 0.024347, ",", false], [30917, 0.023627, " from", false], [4596, 0.022776, " in", false], [4858, 0.009326, " we", false], [308, 0.009312, " I", false]]]}, "raw_delta": 0.08333333333333337, "tuned_delta": 0.13742293074840894}, {"byte_start": 6011, "byte_end": 6014, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1031, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "6.11% 6.11% 6.11%", "model_b": "5.80% 5.80% 5.80%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.3609258234500885]], "model_b": [[4435, " be", "normal", 0.38262802362442017]]}, "loss": {"model_a": 6.105154795428556, "model_b": 5.799897055657127}, "topk": {"model_a": [4435, 1, 0.3609258234500885, [[4435, 0.360926, " be", false], [38877, 0.262821, " learn", false], [32187, 0.127006, " take", false], [31539, 0.038513, " note", false], [31358, 0.035555, " make", false], [62683, 0.03092, " understand", false], [30681, 0.01531, " draw", false], [38625, 0.012491, " grasp", false], [31205, 0.008879, " keep", false], [45846, 0.007584, " emerge", false]]], "model_b": [4435, 1, 0.38262802362442017, [[4435, 0.382628, " be", false], [32187, 0.138045, " take", false], [38877, 0.092672, " learn", false], [31358, 0.076718, " make", false], [30681, 0.04365, " draw", false], [31539, 0.037066, " note", false], [45846, 0.032117, " emerge", false], [57083, 0.021425, " remember", false], [55832, 0.01412, " consider", false], [22449, 0.012537, " see", false]]]}, "raw_delta": 0.01692708333333337, "tuned_delta": 0.07101668074840896}, {"byte_start": 6014, "byte_end": 6022, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 1032, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"model_a": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "model_b": "2.15% 2.15% 2.15% 2.15% 2.15% 2.15% 2.15% 2.15%"}, "model_tokens": {"model_a": [[52112, " learned", "normal", 0.8210574984550476]], "model_b": [[52112, " learned", "normal", 0.3857969343662262]]}, "loss": {"model_a": 0.4468797200019219, "model_b": 2.1485448606988955}, "topk": {"model_a": [52112, 1, 0.8210574984550476, [[52112, 0.821057, " learned", false], [31351, 0.078871, " made", false], [38297, 0.025474, " drawn", false], [39887, 0.010846, " taken", false], [51438, 0.009887, " derived", false], [62684, 0.009239, " understood", false], [39140, 0.005854, " noted", false], [59697, 0.004733, " extracted", false], [46071, 0.002809, " gained", false], [21762, 0.002261, " gle", false]]], "model_b": [52112, 1, 0.3857969343662262, [[52112, 0.385797, " learned", false], [31351, 0.311686, " made", false], [39887, 0.047178, " taken", false], [38297, 0.041412, " drawn", false], [39140, 0.019116, " noted", false], [61934, 0.017914, " emphasized", false], [21762, 0.015496, " gle", false], [62684, 0.008347, " understood", false], [61755, 0.007096, " considered", false], [62479, 0.006382, " remembered", false]]]}, "raw_delta": -0.0943603515625, "tuned_delta": -0.04027075414742441}, {"byte_start": 6022, "byte_end": 6027, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 1033, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"model_a": "3.86% 3.86% 3.86% 3.86% 3.86%", "model_b": "3.69% 3.69% 3.69% 3.69% 3.69%"}, "model_tokens": {"model_a": [[30917, " from", "normal", 0.3454531133174896]], "model_b": [[30917, " from", "normal", 0.359998881816864]]}, "loss": {"model_a": 3.860336339878671, "model_b": 3.6912705147744957}, "topk": {"model_a": [30917, 2, 0.3454531133174896, [[4600, 0.592108, " is", false], [30917, 0.345453, " from", false], [45, 0.019722, ",", false], [4450, 0.00699, " by", false], [31077, 0.004617, " here", false], [37598, 0.003657, " about", false], [4596, 0.003493, " in", false], [21800, 0.002493, " has", false], [47266, 0.002059, " should", false], [52694, 0.001808, " relates", false]]], "model_b": [30917, 2, 0.359998881816864, [[4600, 0.547813, " is", false], [30917, 0.359999, " from", false], [4596, 0.019646, " in", false], [45, 0.018889, ",", false], [37598, 0.008936, " about", false], [4450, 0.00467, " by", false], [31077, 0.003713, " here", false], [55817, 0.003186, " concerns", false], [5346, 0.002384, "---", false], [275, 0.002363, " (", false]]]}, "raw_delta": 0.009374999999999994, "tuned_delta": 0.06346459741507558}, {"byte_start": 6027, "byte_end": 6031, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1034, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "0.91% 0.91% 0.91% 0.91%", "model_b": "1.89% 1.89% 1.89% 1.89%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.8171052932739258]], "model_b": [[22590, " the", "normal", 0.65935879945755]]}, "loss": {"model_a": 0.9069677075901075, "model_b": 1.8931850206977971}, "topk": {"model_a": [22590, 1, 0.8171052932739258, [[22590, 0.817105, " the", false], [32234, 0.11575, " this", false], [45315, 0.014828, " bitter", false], [39936, 0.010304, " these", false], [51929, 0.00431, " history", false], [3609, 0.003942, " AI", false], [31636, 0.00205, " past", false], [21256, 0.001959, " all", false], [22248, 0.001788, " our", false], [332, 0.001571, " a", false]]], "model_b": [22590, 1, 0.65935879945755, [[22590, 0.659359, " the", false], [32234, 0.276609, " this", false], [3609, 0.012171, " AI", false], [39936, 0.01136, " these", false], [45315, 0.003199, " bitter", false], [21256, 0.001723, " all", false], [52195, 0.001426, " massive", false], [55809, 0.001336, " computer", false], [32227, 0.001328, " that", false], [51929, 0.00125, " history", false]]]}, "raw_delta": -0.0546875, "tuned_delta": -0.0005979025849244118}, {"byte_start": 6031, "byte_end": 6038, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 1035, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"model_a": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "model_b": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"model_a": [[45315, " bitter", "normal", 0.9597883820533752]], "model_b": [[45315, " bitter", "normal", 0.908475935459137]]}, "loss": {"model_a": 0.10566614069010961, "model_b": 0.2503281190158549}, "topk": {"model_a": [45315, 1, 0.9597883820533752, [[45315, 0.959788, " bitter", false], [61640, 0.012349, " bitterness", false], [51929, 0.003987, " history", false], [21365, 0.00252, " bit", false], [31636, 0.001694, " past", false], [19523, 0.001433, " Bit", false], [62061, 0.001389, " historical", false], [46430, 0.001035, " lesson", false], [52127, 0.000987, " lessons", false], [31323, 0.000483, " long", false]]], "model_b": [45315, 1, 0.908475935459137, [[45315, 0.908476, " bitter", false], [19523, 0.013777, " Bit", false], [61640, 0.010368, " bitterness", false], [51929, 0.00867, " history", false], [46430, 0.004193, " lesson", false], [3609, 0.003232, " AI", false], [21365, 0.002868, " bit", false], [37599, 0.002789, " above", false], [31636, 0.002537, " past", false], [52127, 0.001607, " lessons", false]]]}, "raw_delta": -0.008021763392857142, "tuned_delta": 0.046067834022218444}, {"byte_start": 6038, "byte_end": 6045, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 1036, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"model_a": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "model_b": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"model_a": [[46430, " lesson", "normal", 0.9592282176017761]], "model_b": [[46430, " lesson", "normal", 0.9774532318115234]]}, "loss": {"model_a": 0.10692407093642042, "model_b": 0.05880823901503125}, "topk": {"model_a": [46430, 1, 0.9592282176017761, [[46430, 0.959228, " lesson", false], [52127, 0.034556, " lessons", false], [61979, 0.002478, " experience", false], [46, 0.000568, "-", false], [31636, 0.000347, " past", false], [26127, 0.000233, "less", false], [39899, 0.000181, " taste", false], [4600, 0.000177, " is", false], [51929, 0.000101, " history", false], [45, 9.6e-05, ",", false]]], "model_b": [46430, 1, 0.9774532318115234, [[46430, 0.977453, " lesson", false], [46, 0.006995, "-", false], [52127, 0.005646, " lessons", false], [61979, 0.002277, " experience", false], [51929, 0.000815, " history", false], [31333, 0.000622, " loss", false], [26127, 0.000256, "less", false], [65126, 0.000231, " disappointment", false], [31277, 0.000216, " less", false], [45, 0.000201, ",", false]]]}, "raw_delta": 0.0026681082589285715, "tuned_delta": 0.05675770567400416}, {"byte_start": 6045, "byte_end": 6048, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1037, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "0.28% 0.28% 0.28%", "model_b": "0.55% 0.55% 0.55%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.9542855620384216]], "model_b": [[4600, " is", "normal", 0.9125254154205322]]}, "loss": {"model_a": 0.28324396046098826, "model_b": 0.5518120680483501}, "topk": {"model_a": [4600, 1, 0.9542855620384216, [[4600, 0.954286, " is", false], [45, 0.014459, ",", false], [21800, 0.004434, " has", false], [55817, 0.004251, " concerns", false], [4706, 0.003805, " of", false], [4596, 0.002038, " in", false], [47266, 0.001625, " should", false], [52694, 0.001195, " relates", false], [275, 0.001172, " (", false], [37598, 0.001067, " about", false]]], "model_b": [4600, 1, 0.9125254154205322, [[4600, 0.912525, " is", false], [4706, 0.020361, " of", false], [45, 0.018265, ",", false], [52694, 0.006189, " relates", false], [55817, 0.004713, " concerns", false], [4596, 0.004494, " in", false], [37598, 0.003289, " about", false], [5346, 0.003194, "---", false], [275, 0.001943, " (", false], [21800, 0.001939, " has", false]]]}, "raw_delta": -0.014892578125, "tuned_delta": 0.03919701929007559}, {"byte_start": 6048, "byte_end": 6053, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1038, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "0.97% 0.97% 0.97% 0.97% 0.97%", "model_b": "1.20% 1.20% 1.20% 1.20% 1.20%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.7683013677597046]], "model_b": [[32227, " that", "normal", 0.7134303450584412]]}, "loss": {"model_a": 0.9650840849696678, "model_b": 1.2045940038672498}, "topk": {"model_a": [32227, 1, 0.7683013677597046, [[32227, 0.768301, " that", false], [22590, 0.12915, " the", false], [21835, 0.018802, " how", false], [4811, 0.015453, " to", false], [32234, 0.009228, " this", false], [332, 0.009012, " a", false], [37598, 0.005823, " about", false], [32464, 0.005314, " what", false], [45, 0.005166, ",", false], [22763, 0.002526, " why", false]]], "model_b": [32227, 1, 0.7134303450584412, [[32227, 0.71343, " that", false], [22590, 0.150942, " the", false], [4811, 0.043339, " to", false], [32234, 0.017664, " this", false], [21835, 0.009953, " how", false], [22187, 0.006641, " not", false], [332, 0.006151, " a", false], [37598, 0.003754, " about", false], [32464, 0.002511, " what", false], [45, 0.001971, ",", false]]]}, "raw_delta": -0.013281250000000008, "tuned_delta": 0.04080834741507558}, {"byte_start": 6053, "byte_end": 6057, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1039, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "7.89% 7.89% 7.89% 7.89%", "model_b": "8.38% 8.38% 8.38% 8.38%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.17340393364429474]], "model_b": [[22590, " the", "normal", 0.15479716658592224]]}, "loss": {"model_a": 7.889738504861517, "model_b": 8.382847161415363}, "topk": {"model_a": [22590, 1, 0.17340393364429474, [[22590, 0.173404, " the", false], [45, 0.061805, ",", false], [4601, 0.060114, " it", false], [38720, 0.053581, " human", false], [39934, 0.048522, " there", false], [4858, 0.031781, " we", false], [47202, 0.026266, " search", false], [4596, 0.02513, " in", false], [56537, 0.020867, " learning", false], [52224, 0.018407, " methods", false]]], "model_b": [22590, 1, 0.15479716658592224, [[22590, 0.154797, " the", false], [39934, 0.055198, " there", false], [4601, 0.052815, " it", false], [3609, 0.051109, " AI", false], [4858, 0.041662, " we", false], [45, 0.034385, ",", false], [4596, 0.021727, " in", false], [38720, 0.020338, " human", false], [32465, 0.018241, " when", false], [332, 0.016659, " a", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.026745847415075588}, {"byte_start": 6057, "byte_end": 6064, "display": {"text": " actual", "kind": "normal"}, "is_word": true, "word_id": 1040, "word_key": " actual", "bytes_hex": "20 61 63 74 75 61 6c", "compression": {"model_a": "18.36% 18.36% 18.36% 18.36% 18.36% 18.36% 18.36%", "model_b": "19.89% 19.89% 19.89% 19.89% 19.89% 19.89% 19.89%"}, "model_tokens": {"model_a": [[45098, " actual", "normal", 0.0008110906346701086]], "model_b": [[45098, " actual", "normal", 0.0004469075647648424]]}, "loss": {"model_a": 18.355718154167608, "model_b": 19.88536133368158}, "topk": {"model_a": [45098, 177, 0.0008110906346701086, [[38720, 0.093456, " human", false], [52224, 0.041066, " methods", false], [22638, 0.032892, " two", false], [31461, 0.029555, " most", false], [47202, 0.023482, " search", false], [45184, 0.020337, " appeal", false], [30273, 0.018515, " best", false], [22752, 0.015234, " way", false], [31581, 0.014188, " only", false], [22681, 0.011798, " use", false]]], "model_b": [45098, 338, 0.0004469075647648424, [[38720, 0.058655, " human", false], [30273, 0.036407, " best", false], [31461, 0.034876, " most", false], [52224, 0.024133, " methods", false], [22681, 0.022929, " use", false], [31458, 0.014815, " more", false], [22638, 0.01344, " two", false], [38629, 0.013129, " great", false], [56331, 0.010691, " greatest", false], [22752, 0.010675, " way", false]]]}, "raw_delta": -0.0848214285714286, "tuned_delta": -0.030731831156353015}, {"byte_start": 6064, "byte_end": 6073, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1041, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"model_a": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "model_b": "17.16% 17.16% 17.16% 17.16% 17.16% 17.16% 17.16% 17.16% 17.16%"}, "model_tokens": {"model_a": [[55847, " contents", "normal", 0.000837124593090266]], "model_b": [[55847, " contents", "normal", 0.00019002864428330213]]}, "loss": {"model_a": 14.214052703202896, "model_b": 17.157050399460765}, "topk": {"model_a": [55847, 198, 0.000837124593090266, [[52224, 0.063427, " methods", false], [56950, 0.028036, " progress", false], [53052, 0.021613, " success", false], [38720, 0.020718, " human", false], [63370, 0.020555, " computation", false], [57103, 0.019124, " research", false], [22752, 0.015117, " way", false], [62633, 0.014898, " techniques", false], [52571, 0.013858, " process", false], [51308, 0.013646, " content", false]]], "model_b": [55847, 535, 0.00019002864428330213, [[52224, 0.044025, " methods", false], [22681, 0.031992, " use", false], [40093, 0.029674, " value", false], [63287, 0.020079, " application", false], [57103, 0.019206, " research", false], [38720, 0.018215, " human", false], [46642, 0.017722, " nature", false], [53052, 0.014999, " success", false], [63750, 0.014494, " performance", false], [65137, 0.012823, " implementation", false]]]}, "raw_delta": -0.16319444444444442, "tuned_delta": -0.10910484702936883}, {"byte_start": 6073, "byte_end": 6076, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1042, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.24% 0.24% 0.24%", "model_b": "0.28% 0.28% 0.28%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9604994058609009]], "model_b": [[4706, " of", "normal", 0.9546859860420227]]}, "loss": {"model_a": 0.24361915770219716, "model_b": 0.280308789886263}, "topk": {"model_a": [4706, 1, 0.9604994058609009, [[4706, 0.960499, " of", false], [21265, 0.014781, " and", false], [45, 0.00482, ",", false], [32227, 0.004616, " that", false], [4715, 0.004418, " or", false], [275, 0.001733, " (", false], [21286, 0.001075, " are", false], [4596, 0.001068, " in", false], [46530, 0.000867, " matter", false], [5346, 0.000758, "---", false]]], "model_b": [4706, 1, 0.9546859860420227, [[4706, 0.954686, " of", false], [21265, 0.018824, " and", false], [45, 0.004695, ",", false], [32227, 0.003541, " that", false], [275, 0.003206, " (", false], [4715, 0.002991, " or", false], [21286, 0.002871, " are", false], [4596, 0.000983, " in", false], [46530, 0.000571, " matter", false], [4858, 0.000507, " we", false]]]}, "raw_delta": -0.002034505208333332, "tuned_delta": 0.05205509220674226}, {"byte_start": 6076, "byte_end": 6082, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1043, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"model_a": "24.04% 24.04% 24.04% 24.04% 24.04% 24.04%", "model_b": "19.35% 19.35% 19.35% 19.35% 19.35% 19.35%"}, "model_tokens": {"model_a": [[39026, " minds", "normal", 0.0003299340314697474]], "model_b": [[39026, " minds", "normal", 0.0015786489238962531]]}, "loss": {"model_a": 24.044917348149387, "model_b": 19.348644428588962}, "topk": {"model_a": [39026, 91, 0.0003299340314697474, [[22590, 0.358819, " the", false], [332, 0.089015, " a", false], [59943, 0.077085, " knowledge", false], [38720, 0.056439, " human", false], [3609, 0.052565, " AI", false], [39936, 0.036217, " these", false], [22248, 0.029482, " our", false], [32464, 0.027882, " what", false], [52224, 0.025358, " methods", false], [4419, 0.022947, " an", false]]], "model_b": [39026, 43, 0.0015786489238962531, [[22590, 0.340837, " the", false], [22248, 0.107207, " our", false], [332, 0.09652, " a", false], [59943, 0.05291, " knowledge", false], [3609, 0.045529, " AI", false], [38720, 0.038732, " human", false], [57103, 0.029437, " research", false], [4419, 0.028578, " an", false], [32464, 0.019534, " what", false], [22226, 0.015216, " one", false]]]}, "raw_delta": 0.2604166666666665, "tuned_delta": 0.3145062640817421}, {"byte_start": 6082, "byte_end": 6086, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1044, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "5.67% 5.67% 5.67% 5.67%", "model_b": "4.47% 4.47% 4.47% 4.47%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.2817038893699646]], "model_b": [[21286, " are", "normal", 0.37576478719711304]]}, "loss": {"model_a": 5.670749550369216, "model_b": 4.473199955881307}, "topk": {"model_a": [21286, 1, 0.2817038893699646, [[21286, 0.281704, " are", false], [45, 0.179858, ",", false], [21265, 0.077366, " and", false], [4600, 0.053538, " is", false], [5346, 0.048175, "---", false], [4491, 0.045656, " do", false], [4715, 0.031378, " or", false], [275, 0.027799, " (", false], [4706, 0.024976, " of", false], [32227, 0.022278, " that", false]]], "model_b": [21286, 1, 0.37576478719711304, [[21286, 0.375765, " are", false], [45, 0.083798, ",", false], [4491, 0.068886, " do", false], [4600, 0.060064, " is", false], [21265, 0.042067, " and", false], [21413, 0.029307, " can", false], [47266, 0.027702, " should", false], [46530, 0.024246, " matter", false], [275, 0.024025, " (", false], [45409, 0.020087, " cannot", false]]]}, "raw_delta": 0.06640625, "tuned_delta": 0.12049584741507559}, {"byte_start": 6086, "byte_end": 6097, "display": {"text": " tremendous", "kind": "normal"}, "is_word": true, "word_id": 1045, "word_key": " tremendous", "bytes_hex": "20 74 72 65 6d 65 6e 64 6f 75 73", "compression": {"model_a": "14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96%", "model_b": "13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94% 13.94%"}, "model_tokens": {"model_a": [[62670, " tremendous", "normal", 0.00010990122973453254]], "model_b": [[62670, " tremendous", "normal", 0.00020859426876995713]]}, "loss": {"model_a": 14.959763918308859, "model_b": 13.93512255404112}, "topk": {"model_a": [62670, 312, 0.00010990122973453254, [[22187, 0.270501, " not", false], [62161, 0.149868, " irrelevant", false], [31277, 0.042152, " less", false], [39171, 0.030398, " often", false], [31466, 0.028387, " much", false], [32386, 0.027819, " very", false], [4706, 0.02619, " of", false], [332, 0.018336, " a", false], [45, 0.015417, ",", false], [52094, 0.015258, " largely", false]]], "model_b": [62670, 273, 0.00020859426876995713, [[22187, 0.372409, " not", false], [62161, 0.028799, " irrelevant", false], [39171, 0.026646, " often", false], [31277, 0.022723, " less", false], [32386, 0.021618, " very", false], [52094, 0.018516, " largely", false], [21660, 0.015849, " far", false], [31466, 0.015658, " much", false], [332, 0.015646, " a", false], [46999, 0.013262, " rarely", false]]]}, "raw_delta": 0.05681818181818188, "tuned_delta": 0.11090777923325747}, {"byte_start": 6097, "byte_end": 6099, "display": {"text": "ly", "kind": "normal"}, "is_word": true, "word_id": 1046, "word_key": "ly", "bytes_hex": "6c 79", "compression": {"model_a": "0.06% 0.06%", "model_b": "0.11% 0.11%"}, "model_tokens": {"model_a": [[2030, "ly", "normal", 0.9931179285049438]], "model_b": [[2030, "ly", "normal", 0.9877553582191467]]}, "loss": {"model_a": 0.0621889265519916, "model_b": 0.1111695855177195}, "topk": {"model_a": [2030, 1, 0.9931179285049438, [[2030, 0.993118, "ly", false], [52957, 0.000829, " sources", false], [60081, 0.000535, " obstacles", false], [60042, 0.000333, " mysteries", false], [40166, 0.000328, " waste", false], [45, 0.000271, ",", false], [62426, 0.000226, " quantities", false], [61720, 0.000225, " complexity", false], [31601, 0.000181, " over", false], [50897, 0.000166, " amounts", false]]], "model_b": [2030, 1, 0.9877553582191467, [[2030, 0.987755, "ly", false], [45, 0.001052, ",", false], [21265, 0.000714, " and", false], [61669, 0.00047, " challenges", false], [47, 0.000431, ".", false], [52957, 0.000373, " sources", false], [50897, 0.000364, " amounts", false], [63637, 0.000316, " information", false], [60042, 0.000225, " mysteries", false], [61720, 0.000193, " complexity", false]]]}, "raw_delta": -0.002716064453125, "tuned_delta": 0.05137353296195059}, {"byte_start": 6099, "byte_end": 6100, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "96.37%", "model_b": "93.55%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.004739854019135237]], "model_b": [[45, ",", "normal", 0.005597678478807211]]}, "loss": {"model_a": 96.36752030937997, "model_b": 93.54975655764372}, "topk": {"model_a": [45, 17, 0.004739854019135237, [[51258, 0.180527, " complex", false], [63366, 0.161625, " complicated", false], [59516, 0.145637, " difficult", false], [31048, 0.101267, " hard", false], [31458, 0.064857, " more", false], [59829, 0.042214, " important", false], [31277, 0.034056, " less", false], [51507, 0.024857, " diverse", false], [57518, 0.017939, " variable", false], [46162, 0.016899, " harder", false]]], "model_b": [45, 23, 0.005597678478807211, [[51258, 0.165356, " complex", false], [59829, 0.129949, " important", false], [59516, 0.100227, " difficult", false], [31458, 0.069649, " more", false], [31048, 0.055625, " hard", false], [63366, 0.043306, " complicated", false], [31277, 0.03579, " less", false], [59513, 0.0234, " different", false], [51507, 0.021419, " diverse", false], [57518, 0.014062, " variable", false]]]}, "raw_delta": 0.15625, "tuned_delta": 0.21033959741507557}, {"byte_start": 6100, "byte_end": 6105, "display": {"text": " irre", "kind": "normal"}, "is_word": true, "word_id": 1047, "word_key": " irre", "bytes_hex": "20 69 72 72 65", "compression": {"model_a": "18.82% 18.82% 18.82% 18.82% 18.82%", "model_b": "18.94% 18.94% 18.94% 18.94% 18.94%"}, "model_tokens": {"model_a": [[31170, " irre", "normal", 0.005436149891465902]], "model_b": [[31170, " irre", "normal", 0.005171467550098896]]}, "loss": {"model_a": 18.822661861598192, "model_b": 18.935372411667643}, "topk": {"model_a": [31170, 36, 0.005436149891465902, [[21265, 0.095776, " and", false], [52448, 0.0491, " perhaps", false], [46269, 0.048716, " incomp", false], [30788, 0.037951, " even", false], [64911, 0.03376, " exponentially", false], [59988, 0.029059, " massively", false], [47708, 0.02749, " vastly", false], [21400, 0.025175, " but", false], [45145, 0.019054, " almost", false], [31427, 0.017959, " mind", false]]], "model_b": [31170, 30, 0.005171467550098896, [[21265, 0.16667, " and", false], [56125, 0.064894, " enormous", false], [62670, 0.045657, " tremendous", false], [59988, 0.031598, " massively", false], [21400, 0.031306, " but", false], [4596, 0.024208, " in", false], [62388, 0.021387, " profoundly", false], [52448, 0.020605, " perhaps", false], [59699, 0.016522, " extremely", false], [30788, 0.016352, " even", false]]]}, "raw_delta": -0.006250000000000089, "tuned_delta": 0.0478395974150755}, {"byte_start": 6105, "byte_end": 6108, "display": {"text": "dee", "kind": "normal"}, "is_word": true, "word_id": 1048, "word_key": "dee", "bytes_hex": "64 65 65", "compression": {"model_a": "20.57% 20.57% 20.57%", "model_b": "23.39% 23.39% 23.39%"}, "model_tokens": {"model_a": [[7333, "dee", "normal", 0.03222240135073662]], "model_b": [[7333, "dee", "normal", 0.020415039733052254]]}, "loss": {"model_a": 20.56967538767467, "model_b": 23.38743913941093}, "topk": {"model_a": [7333, 5, 0.03222240135073662, [[7387, 0.633821, "duc", false], [27190, 0.09252, "trie", false], [27418, 0.069613, "vers", false], [35986, 0.054719, "vocab", false], [7333, 0.032222, "dee", false], [34176, 0.020238, "cover", false], [35389, 0.016771, "place", false], [26645, 0.010755, "para", false], [25053, 0.009233, "conc", false], [7595, 0.009066, "fut", false]]], "model_b": [7333, 8, 0.020415039733052254, [[7387, 0.507765, "duc", false], [35986, 0.150297, "vocab", false], [27418, 0.057865, "vers", false], [35389, 0.052378, "place", false], [34176, 0.040072, "cover", false], [27190, 0.039981, "trie", false], [7595, 0.022164, "fut", false], [7333, 0.020415, "dee", false], [35054, 0.016646, "media", false], [26645, 0.015069, "para", false]]]}, "raw_delta": -0.15625, "tuned_delta": -0.10216040258492441}, {"byte_start": 6108, "byte_end": 6110, "display": {"text": "ma", "kind": "normal"}, "is_word": true, "word_id": 1049, "word_key": "ma", "bytes_hex": "6d 61", "compression": {"model_a": "0.03% 0.03%", "model_b": "0.01% 0.01%"}, "model_tokens": {"model_a": [[2034, "ma", "normal", 0.9963411688804626]], "model_b": [[2034, "ma", "normal", 0.998660683631897]]}, "loss": {"model_a": 0.03302066896565926, "model_b": 0.012107578620741726}, "topk": {"model_a": [2034, 1, 0.9963411688804626, [[2034, 0.996341, "ma", false], [2035, 0.000865, "mb", false], [110, 0.0008, "m", false], [2045, 0.000411, "ml", false], [26251, 0.000358, "ming", false], [2049, 0.000295, "mp", false], [8179, 0.000263, "mma", false], [8157, 8.4e-05, "med", false], [26202, 6.7e-05, "mall", false], [8150, 4.7e-05, "mar", false]]], "model_b": [2034, 1, 0.998660683631897, [[2034, 0.998661, "ma", false], [1814, 0.000545, "da", false], [2049, 0.000111, "mp", false], [8179, 7e-05, "mma", false], [8050, 6.5e-05, "lab", false], [8144, 5.3e-05, "mai", false], [2111, 4.9e-05, "pa", false], [2042, 4.6e-05, "mi", false], [2035, 3e-05, "mb", false], [8193, 2.6e-05, "mpl", false]]]}, "raw_delta": 0.00115966796875, "tuned_delta": 0.05524926538382559}, {"byte_start": 6110, "byte_end": 6113, "display": {"text": "bly", "kind": "normal"}, "is_word": true, "word_id": 1050, "word_key": "bly", "bytes_hex": "62 6c 79", "compression": {"model_a": "0.01% 0.01% 0.01%", "model_b": "0.02% 0.02% 0.02%"}, "model_tokens": {"model_a": [[7166, "bly", "normal", 0.9980254173278809]], "model_b": [[7166, "bly", "normal", 0.9965394735336304]]}, "loss": {"model_a": 0.011740682298901068, "model_b": 0.020821366264457363}, "topk": {"model_a": [7166, 1, 0.9980254173278809, [[7166, 0.998025, "bly", false], [7162, 0.001919, "ble", false], [1770, 2.1e-05, "bl", false], [7154, 9e-06, "bil", false], [24890, 5e-06, "blem", false], [7141, 3e-06, "bel", false], [34005, 1e-06, "bably", false], [46, 1e-06, "-", false], [24383, 1e-06, "ably", false], [25658, 1e-06, "ibly", false]]], "model_b": [7166, 1, 0.9965394735336304, [[7166, 0.996539, "bly", false], [7162, 0.003311, "ble", false], [1770, 6.7e-05, "bl", false], [24890, 5.2e-05, "blem", false], [7154, 1.4e-05, "bil", false], [24383, 1e-05, "ably", false], [7141, 3e-06, "bel", false], [1925, 1e-06, "hl", false], [24892, 1e-06, "bles", false], [1782, 0.0, "by", false]]]}, "raw_delta": -0.0005035400390625001, "tuned_delta": 0.05358605737601309}, {"byte_start": 6113, "byte_end": 6121, "display": {"text": " complex", "kind": "normal"}, "is_word": true, "word_id": 1051, "word_key": " complex", "bytes_hex": "20 63 6f 6d 70 6c 65 78", "compression": {"model_a": "4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83%", "model_b": "5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32%"}, "model_tokens": {"model_a": [[51258, " complex", "normal", 0.11706952005624771]], "model_b": [[51258, " complex", "normal", 0.09542275220155716]]}, "loss": {"model_a": 4.825420424848339, "model_b": 5.3185290814021835}, "topk": {"model_a": [51258, 2, 0.11706952005624771, [[59516, 0.150604, " difficult", false], [51258, 0.11707, " complex", false], [31048, 0.110542, " hard", false], [63366, 0.104429, " complicated", false], [45, 0.103886, ",", false], [39011, 0.080194, " messy", false], [59829, 0.038833, " important", false], [62161, 0.021655, " irrelevant", false], [46706, 0.016982, " opaque", false], [62590, 0.010168, " subjective", false]]], "model_b": [51258, 2, 0.09542275220155716, [[45, 0.22942, ",", false], [51258, 0.095423, " complex", false], [46706, 0.04907, " opaque", false], [40090, 0.036077, " vague", false], [63366, 0.035279, " complicated", false], [59513, 0.031628, " different", false], [62091, 0.022277, " incomplete", false], [59516, 0.020512, " difficult", false], [39011, 0.020357, " messy", false], [52140, 0.016796, " limited", false]]]}, "raw_delta": -0.02734375, "tuned_delta": 0.026745847415075588}, {"byte_start": 6121, "byte_end": 6122, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"model_a": "83.97%", "model_b": "84.53%"}, "model_tokens": {"model_a": [[60, ";", "normal", 0.009439690038561821]], "model_b": [[60, ";", "normal", 0.009243614040315151]]}, "loss": {"model_a": 83.96935980174044, "model_b": 84.5329125520877}, "topk": {"model_a": [60, 6, 0.009439690038561821, [[47, 0.448298, ".", false], [45, 0.296146, ",", false], [5346, 0.111241, "---", false], [21265, 0.068237, " and", false], [4596, 0.010706, " in", false], [60, 0.00944, ";", false], [275, 0.008439, " (", false], [4811, 0.006937, " to", false], [21700, 0.006069, " for", false], [59, 0.004702, ":", false]]], "model_b": [60, 5, 0.009243614040315151, [[47, 0.522248, ".", false], [45, 0.293426, ",", false], [21265, 0.090052, " and", false], [5346, 0.01239, "---", false], [60, 0.009244, ";", false], [53087, 0.007762, " systems", false], [275, 0.007438, " (", false], [4596, 0.005834, " in", false], [4811, 0.004016, " to", false], [47539, 0.003018, " things", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 6122, "byte_end": 6125, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1052, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "17.94% 17.94% 17.94%", "model_b": "17.66% 17.66% 17.66%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.050800591707229614]], "model_b": [[4858, " we", "normal", 0.0536351203918457]]}, "loss": {"model_a": 17.939762552720833, "model_b": 17.657986177547205}, "topk": {"model_a": [4858, 6, 0.050800591707229614, [[32232, 0.087932, " they", false], [22590, 0.087926, " the", false], [21265, 0.084758, " and", false], [39934, 0.063725, " there", false], [32227, 0.058954, " that", false], [4858, 0.050801, " we", false], [4601, 0.042259, " it", false], [32234, 0.036455, " this", false], [21400, 0.033681, " but", false], [4596, 0.028743, " in", false]]], "model_b": [4858, 5, 0.0536351203918457, [[21265, 0.133405, " and", false], [32227, 0.09854, " that", false], [32232, 0.094843, " they", false], [22590, 0.055273, " the", false], [4858, 0.053635, " we", false], [39934, 0.036603, " there", false], [4601, 0.035188, " it", false], [30788, 0.034039, " even", false], [4596, 0.024216, " in", false], [32234, 0.019053, " this", false]]]}, "raw_delta": 0.015625, "tuned_delta": 0.06971459741507559}, {"byte_start": 6125, "byte_end": 6132, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1053, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%", "model_b": "9.46% 9.46% 9.46% 9.46% 9.46% 9.46% 9.46%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.03814317286014557]], "model_b": [[47266, " should", "normal", 0.02549530752003193]]}, "loss": {"model_a": 8.45329125520877, "model_b": 9.45963545225743}, "topk": {"model_a": [47266, 7, 0.03814317286014557, [[31059, 0.14752, " have", false], [4491, 0.145967, " do", false], [21286, 0.117571, " are", false], [45409, 0.09505, " cannot", false], [21413, 0.086851, " can", false], [32475, 0.040993, " will", false], [47266, 0.038143, " should", false], [31223, 0.036915, " know", false], [46227, 0.026478, " humans", false], [21556, 0.022666, " don", false]]], "model_b": [47266, 10, 0.02549530752003193, [[45409, 0.167376, " cannot", false], [4491, 0.152936, " do", false], [21413, 0.105049, " can", false], [31059, 0.099424, " have", false], [31223, 0.079568, " know", false], [21286, 0.078647, " are", false], [47285, 0.045156, " simply", false], [32475, 0.038683, " will", false], [21556, 0.028628, " don", false], [47266, 0.025495, " should", false]]]}, "raw_delta": -0.0558035714285714, "tuned_delta": -0.0017139740134958087}, {"byte_start": 6132, "byte_end": 6137, "display": {"text": " stop", "kind": "normal"}, "is_word": true, "word_id": 1054, "word_key": " stop", "bytes_hex": "20 73 74 6f 70", "compression": {"model_a": "15.33% 15.33% 15.33% 15.33% 15.33%", "model_b": "16.57% 16.57% 16.57% 16.57% 16.57%"}, "model_tokens": {"model_a": [[32122, " stop", "normal", 0.014346488751471043]], "model_b": [[32122, " stop", "normal", 0.010112185962498188]]}, "loss": {"model_a": 15.328634809445234, "model_b": 16.568450860209186}, "topk": {"model_a": [32122, 9, 0.014346488751471043, [[22187, 0.429127, " not", false], [39115, 0.097004, " never", false], [45926, 0.063851, " expect", false], [4435, 0.056317, " be", false], [60645, 0.028603, " therefore", false], [31059, 0.020275, " have", false], [45084, 0.017353, " accept", false], [45150, 0.015625, " always", false], [32122, 0.014346, " stop", false], [38877, 0.010446, " learn", false]]], "model_b": [32122, 9, 0.010112185962498188, [[22187, 0.477783, " not", false], [39115, 0.135274, " never", false], [4435, 0.053413, " be", false], [60645, 0.022949, " therefore", false], [37786, 0.014123, " avoid", false], [38877, 0.013876, " learn", false], [45150, 0.01321, " always", false], [40007, 0.012131, " treat", false], [32122, 0.010112, " stop", false], [45926, 0.007682, " expect", false]]]}, "raw_delta": -0.06874999999999998, "tuned_delta": -0.01466040258492439}, {"byte_start": 6137, "byte_end": 6144, "display": {"text": " trying", "kind": "normal"}, "is_word": true, "word_id": 1055, "word_key": " trying", "bytes_hex": "20 74 72 79 69 6e 67", "compression": {"model_a": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "model_b": "2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17%"}, "model_tokens": {"model_a": [[47629, " trying", "normal", 0.5826796889305115]], "model_b": [[47629, " trying", "normal", 0.4303467571735382]]}, "loss": {"model_a": 1.3786915499566683, "model_b": 2.173703465625112}, "topk": {"model_a": [47629, 1, 0.5826796889305115, [[47629, 0.58268, " trying", false], [57419, 0.094989, " thinking", false], [62360, 0.044284, " pretending", false], [59681, 0.017607, " expecting", false], [53320, 0.016909, " wasting", false], [52157, 0.015668, " looking", false], [46500, 0.01265, " making", false], [46217, 0.010758, " hoping", false], [59224, 0.010693, " believing", false], [59813, 0.008519, " imagining", false]]], "model_b": [47629, 1, 0.4303467571735382, [[47629, 0.430347, " trying", false], [57419, 0.100668, " thinking", false], [52157, 0.032723, " looking", false], [62360, 0.023229, " pretending", false], [57577, 0.020825, " worrying", false], [55562, 0.015385, " assuming", false], [52834, 0.014787, " seeking", false], [46500, 0.013612, " making", false], [60463, 0.0128, " searching", false], [57463, 0.010612, " treating", false]]]}, "raw_delta": -0.04408482142857143, "tuned_delta": 0.010004775986504157}, {"byte_start": 6144, "byte_end": 6147, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1056, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.21% 0.21% 0.21%", "model_b": "0.12% 0.12% 0.12%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.9659410715103149]], "model_b": [[4811, " to", "normal", 0.9807488918304443]]}, "loss": {"model_a": 0.20839711080549397, "model_b": 0.11740682298901069}, "topk": {"model_a": [4811, 1, 0.9659410715103149, [[4811, 0.965941, " to", false], [47, 0.00777, ".", false], [45, 0.005024, ",", false], [4788, 0.004535, " so", false], [21265, 0.002311, " and", false], [4596, 0.002285, " in", false], [21700, 0.001095, " for", false], [275, 0.000932, " (", false], [63461, 0.000789, " desperately", false], [22614, 0.000692, " too", false]]], "model_b": [4811, 1, 0.9807488918304443, [[4811, 0.980749, " to", false], [22614, 0.002585, " too", false], [45, 0.002192, ",", false], [21700, 0.002108, " for", false], [4788, 0.001463, " so", false], [31048, 0.000945, " hard", false], [4596, 0.000725, " in", false], [21265, 0.000711, " and", false], [63461, 0.000703, " desperately", false], [47, 0.000594, ".", false]]]}, "raw_delta": 0.005045572916666667, "tuned_delta": 0.05913517033174225}, {"byte_start": 6147, "byte_end": 6152, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1057, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"model_a": "17.58% 17.58% 17.58% 17.58% 17.58%", "model_b": "15.44% 15.44% 15.44% 15.44% 15.44%"}, "model_tokens": {"model_a": [[30858, " find", "normal", 0.007629687432199717]], "model_b": [[30858, " find", "normal", 0.013792444951832294]]}, "loss": {"model_a": 17.58284581083424, "model_b": 15.441345359514685}, "topk": {"model_a": [30858, 25, 0.007629687432199717, [[39043, 0.101693, " model", false], [62683, 0.084843, " understand", false], [37923, 0.08271, " build", false], [22339, 0.0639, " put", false], [31358, 0.046281, " make", false], [47030, 0.026574, " reduce", false], [51133, 0.019362, " capture", false], [39025, 0.019198, " mimic", false], [60386, 0.01884, " replicate", false], [63292, 0.0171, " approximate", false]]], "model_b": [30858, 9, 0.013792444951832294, [[62683, 0.339641, " understand", false], [39043, 0.036773, " model", false], [37923, 0.029776, " build", false], [31358, 0.02941, " make", false], [38877, 0.024958, " learn", false], [51133, 0.020414, " capture", false], [31223, 0.019619, " know", false], [51698, 0.014046, " extract", false], [30858, 0.013792, " find", false], [22339, 0.013228, " put", false]]]}, "raw_delta": 0.11875000000000002, "tuned_delta": 0.1728395974150756}, {"byte_start": 6152, "byte_end": 6159, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1058, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"model_a": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "model_b": "12.16% 12.16% 12.16% 12.16% 12.16% 12.16% 12.16%"}, "model_tokens": {"model_a": [[47284, " simple", "normal", 0.1009325236082077]], "model_b": [[47284, " simple", "normal", 0.008955161087214947]]}, "loss": {"model_a": 5.9173038786461385, "model_b": 12.156637900347851}, "topk": {"model_a": [47284, 2, 0.1009325236082077, [[332, 0.133364, " a", false], [47284, 0.100933, " simple", false], [32448, 0.100101, " ways", false], [22590, 0.068825, " the", false], [22249, 0.047653, " out", false], [51832, 0.037114, " general", false], [32229, 0.029899, " them", false], [4419, 0.026561, " an", false], [30724, 0.01999, " easy", false], [38720, 0.017781, " human", false]]], "model_b": [47284, 13, 0.008955161087214947, [[22249, 0.159289, " out", false], [22590, 0.159008, " the", false], [332, 0.097493, " a", false], [32229, 0.086038, " them", false], [32448, 0.062825, " ways", false], [32464, 0.027799, " what", false], [32074, 0.017478, " some", false], [56832, 0.017307, " patterns", false], [21265, 0.016444, " and", false], [47539, 0.011876, " things", false]]]}, "raw_delta": -0.34598214285714285, "tuned_delta": -0.2918925454420673}, {"byte_start": 6159, "byte_end": 6164, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1059, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "7.78% 7.78% 7.78% 7.78% 7.78%", "model_b": "8.85% 8.85% 8.85% 8.85% 8.85%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.11449906975030899]], "model_b": [[32448, " ways", "normal", 0.08646023273468018]]}, "loss": {"model_a": 7.777027954792068, "model_b": 8.847778180451845}, "topk": {"model_a": [32448, 2, 0.11449906975030899, [[45, 0.191352, ",", false], [32448, 0.114499, " ways", false], [46587, 0.089249, " models", false], [64392, 0.067039, " explanations", false], [65275, 0.04155, " representations", false], [64351, 0.041112, " descriptions", false], [39558, 0.03746, " rules", false], [60521, 0.022346, " solutions", false], [38720, 0.021478, " human", false], [51832, 0.018319, " general", false]]], "model_b": [32448, 2, 0.08646023273468018, [[45, 0.140434, ",", false], [32448, 0.08646, " ways", false], [60521, 0.056974, " solutions", false], [56832, 0.047862, " patterns", false], [64392, 0.038162, " explanations", false], [50921, 0.037529, " answers", false], [46587, 0.032264, " models", false], [39558, 0.031717, " rules", false], [65275, 0.026727, " representations", false], [21265, 0.024851, " and", false]]]}, "raw_delta": -0.059374999999999956, "tuned_delta": -0.005285402584924367}, {"byte_start": 6164, "byte_end": 6167, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1060, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "1.48% 1.48% 1.48%", "model_b": "1.56% 1.56% 1.56%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.7835110425949097]], "model_b": [[4811, " to", "normal", 0.771757960319519]]}, "loss": {"model_a": 1.4793259696615346, "model_b": 1.5615107457538422}, "topk": {"model_a": [4811, 1, 0.7835110425949097, [[4811, 0.783511, " to", false], [4706, 0.169309, " of", false], [21700, 0.014905, " for", false], [4596, 0.011627, " in", false], [32227, 0.004023, " that", false], [45202, 0.002926, " around", false], [45, 0.002862, ",", false], [275, 0.001867, " (", false], [31162, 0.001472, " into", false], [22249, 0.001421, " out", false]]], "model_b": [4811, 1, 0.771757960319519, [[4811, 0.771758, " to", false], [4706, 0.194793, " of", false], [32227, 0.005725, " that", false], [21700, 0.004519, " for", false], [4596, 0.004191, " in", false], [45, 0.003174, ",", false], [22249, 0.002996, " out", false], [45202, 0.002536, " around", false], [31162, 0.001646, " into", false], [275, 0.001474, " (", false]]]}, "raw_delta": -0.004557291666666671, "tuned_delta": 0.04953230574840892}, {"byte_start": 6167, "byte_end": 6173, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1061, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "model_b": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.005826219916343689]], "model_b": [[39942, " think", "normal", 0.01265944167971611]]}, "loss": {"model_a": 15.49770063454941, "model_b": 13.149564174769196}, "topk": {"model_a": [39942, 23, 0.005826219916343689, [[60389, 0.137841, " represent", false], [55961, 0.131746, " describe", false], [39043, 0.102576, " model", false], [22339, 0.062984, " put", false], [51133, 0.049694, " capture", false], [62683, 0.039643, " understand", false], [51688, 0.036405, " explain", false], [37923, 0.034396, " build", false], [45854, 0.031101, " encode", false], [31358, 0.024102, " make", false]]], "model_b": [39942, 12, 0.01265944167971611, [[62683, 0.201703, " understand", false], [31358, 0.062455, " make", false], [51133, 0.050918, " capture", false], [60389, 0.03772, " represent", false], [39043, 0.034275, " model", false], [51698, 0.02085, " extract", false], [55961, 0.017061, " describe", false], [22681, 0.016939, " use", false], [37923, 0.016437, " build", false], [39740, 0.013792, " solve", false]]]}, "raw_delta": 0.13020833333333337, "tuned_delta": 0.18429793074840894}, {"byte_start": 6173, "byte_end": 6179, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1062, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"model_a": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23%", "model_b": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05%"}, "model_tokens": {"model_a": [[37598, " about", "normal", 0.4756644070148468]], "model_b": [[37598, " about", "normal", 0.36165663599967957]]}, "loss": {"model_a": 2.230729636791203, "model_b": 3.052577397714278}, "topk": {"model_a": [37598, 1, 0.4756644070148468, [[37598, 0.475664, " about", false], [31296, 0.232608, " like", false], [47, 0.046353, ".", false], [4706, 0.038336, " of", false], [21265, 0.033355, " and", false], [45, 0.02902, ",", false], [32227, 0.024073, " that", false], [4596, 0.022565, " in", false], [4715, 0.009774, " or", false], [4423, 0.008723, " as", false]]], "model_b": [37598, 1, 0.36165663599967957, [[37598, 0.361657, " about", false], [47, 0.148879, ".", false], [45, 0.082195, ",", false], [4706, 0.056886, " of", false], [31296, 0.045901, " like", false], [21265, 0.040731, " and", false], [4596, 0.034046, " in", false], [32227, 0.026283, " that", false], [4715, 0.023914, " or", false], [45301, 0.022267, " better", false]]]}, "raw_delta": -0.04557291666666668, "tuned_delta": 0.00851668074840891}, {"byte_start": 6179, "byte_end": 6183, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1063, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "9.65% 9.65% 9.65% 9.65%", "model_b": "12.40% 12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.11691730469465256]], "model_b": [[22590, " the", "normal", 0.06507348269224167]]}, "loss": {"model_a": 9.650840849696678, "model_b": 12.398160507639528}, "topk": {"model_a": [22590, 3, 0.11691730469465256, [[32229, 0.388506, " them", false], [39026, 0.163565, " minds", false], [22590, 0.116917, " the", false], [21835, 0.04894, " how", false], [4601, 0.024438, " it", false], [32464, 0.024369, " what", false], [51258, 0.022859, " complex", false], [22248, 0.017387, " our", false], [38720, 0.016553, " human", false], [21265, 0.016518, " and", false]]], "model_b": [22590, 2, 0.06507348269224167, [[32229, 0.501081, " them", false], [22590, 0.065073, " the", false], [51258, 0.047483, " complex", false], [4601, 0.039828, " it", false], [39936, 0.031246, " these", false], [47539, 0.026156, " things", false], [22248, 0.023069, " our", false], [39026, 0.021438, " minds", false], [21265, 0.019386, " and", false], [21835, 0.015373, " how", false]]]}, "raw_delta": -0.15234375, "tuned_delta": -0.09825415258492441}, {"byte_start": 6183, "byte_end": 6192, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1064, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"model_a": "4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04%", "model_b": "5.64% 5.64% 5.64% 5.64% 5.64% 5.64% 5.64% 5.64% 5.64%"}, "model_tokens": {"model_a": [[55847, " contents", "normal", 0.13328483700752258]], "model_b": [[55847, " contents", "normal", 0.05913321673870087]]}, "loss": {"model_a": 4.038794710821968, "model_b": 5.635527503472513}, "topk": {"model_a": [55847, 3, 0.13328483700752258, [[40213, 0.245528, " world", false], [31427, 0.235026, " mind", false], [55847, 0.133285, " contents", false], [39026, 0.099565, " minds", false], [51258, 0.037006, " complex", false], [38720, 0.03131, " human", false], [61720, 0.025837, " complexity", false], [37898, 0.010584, " brain", false], [22752, 0.010093, " way", false], [52569, 0.007788, " problem", false]]], "model_b": [55847, 3, 0.05913321673870087, [[40213, 0.365807, " world", false], [31427, 0.204147, " mind", false], [55847, 0.059133, " contents", false], [51258, 0.031935, " complex", false], [39026, 0.031611, " minds", false], [38720, 0.024944, " human", false], [46545, 0.014422, " mental", false], [61720, 0.013257, " complexity", false], [37898, 0.012476, " brain", false], [47539, 0.01089, " things", false]]]}, "raw_delta": -0.08854166666666664, "tuned_delta": -0.034452069251591055}, {"byte_start": 6192, "byte_end": 6195, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1065, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.49% 0.49% 0.49%", "model_b": "0.78% 0.78% 0.78%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9207640290260315]], "model_b": [[4706, " of", "normal", 0.8789111375808716]]}, "loss": {"model_a": 0.49310865655384484, "model_b": 0.7807553728769211}, "topk": {"model_a": [4706, 1, 0.9207640290260315, [[4706, 0.920764, " of", false], [47, 0.030662, ".", false], [45, 0.017317, ",", false], [21265, 0.012963, " and", false], [4596, 0.003097, " in", false], [32227, 0.002232, " that", false], [60, 0.001965, ";", false], [275, 0.001528, " (", false], [4715, 0.001405, " or", false], [5346, 0.001029, "---", false]]], "model_b": [4706, 1, 0.8789111375808716, [[4706, 0.878911, " of", false], [47, 0.061291, ".", false], [45, 0.02444, ",", false], [21265, 0.010185, " and", false], [4715, 0.003075, " or", false], [275, 0.002984, " (", false], [4596, 0.002317, " in", false], [32227, 0.002232, " that", false], [4450, 0.002082, " by", false], [4858, 0.000847, " we", false]]]}, "raw_delta": -0.015950520833333336, "tuned_delta": 0.03813907658174225}, {"byte_start": 6195, "byte_end": 6201, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1066, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"model_a": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36%", "model_b": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"model_a": [[39026, " minds", "normal", 0.888293981552124]], "model_b": [[39026, " minds", "normal", 0.6757315397262573]]}, "loss": {"model_a": 0.3580908101164826, "model_b": 1.1564572064417553}, "topk": {"model_a": [39026, 1, 0.888293981552124, [[39026, 0.888294, " minds", false], [22248, 0.031547, " our", false], [22590, 0.020458, " the", false], [38720, 0.011497, " human", false], [332, 0.010313, " a", false], [39193, 0.004367, " other", false], [31427, 0.002685, " mind", false], [39944, 0.002133, " those", false], [39931, 0.001903, " their", false], [45124, 0.001894, " agents", false]]], "model_b": [39026, 1, 0.6757315397262573, [[39026, 0.675732, " minds", false], [22248, 0.144836, " our", false], [22590, 0.051884, " the", false], [31427, 0.016338, " mind", false], [332, 0.012474, " a", false], [46787, 0.009988, " people", false], [38720, 0.008475, " human", false], [39193, 0.007555, " other", false], [39936, 0.00683, " these", false], [39931, 0.006538, " their", false]]]}, "raw_delta": -0.04427083333333334, "tuned_delta": 0.009818764081742246}, {"byte_start": 6201, "byte_end": 6202, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "25.36%", "model_b": "29.87%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.24629829823970795]], "model_b": [[45, ",", "normal", 0.18801335990428925]]}, "loss": {"model_a": 25.359873765626308, "model_b": 29.868295768404316}, "topk": {"model_a": [45, 2, 0.24629829823970795, [[47, 0.460899, ".", false], [45, 0.246298, ",", false], [21265, 0.113674, " and", false], [32227, 0.028732, " that", false], [60, 0.024096, ";", false], [4596, 0.021667, " in", false], [275, 0.01893, " (", false], [5346, 0.013782, "---", false], [4423, 0.011644, " as", false], [4450, 0.006186, " by", false]]], "model_b": [45, 2, 0.18801335990428925, [[47, 0.589083, ".", false], [45, 0.188013, ",", false], [21265, 0.077078, " and", false], [275, 0.016849, " (", false], [4596, 0.014734, " in", false], [32227, 0.013703, " that", false], [4450, 0.013271, " by", false], [4715, 0.011981, " or", false], [5346, 0.010373, "---", false], [4423, 0.007524, " as", false]]]}, "raw_delta": -0.25, "tuned_delta": -0.19591040258492443}, {"byte_start": 6202, "byte_end": 6207, "display": {"text": " such", "kind": "normal"}, "is_word": true, "word_id": 1067, "word_key": " such", "bytes_hex": "20 73 75 63 68", "compression": {"model_a": "16.46% 16.46% 16.46% 16.46% 16.46%", "model_b": "19.39% 19.39% 19.39% 19.39% 19.39%"}, "model_tokens": {"model_a": [[32139, " such", "normal", 0.010573497042059898]], "model_b": [[32139, " such", "normal", 0.0047678533010184765]]}, "loss": {"model_a": 16.45574031013974, "model_b": 19.386214611945444}, "topk": {"model_a": [32139, 11, 0.010573497042059898, [[21265, 0.57877, " and", false], [51018, 0.057204, " because", false], [4715, 0.055497, " or", false], [4423, 0.024738, " as", false], [21400, 0.022354, " but", false], [40186, 0.015172, " which", false], [4596, 0.015118, " in", false], [4811, 0.015016, " to", false], [4858, 0.014407, " we", false], [30788, 0.011805, " even", false]]], "model_b": [32139, 14, 0.0047678533010184765, [[21265, 0.612814, " and", false], [4715, 0.073326, " or", false], [51018, 0.04163, " because", false], [40186, 0.033134, " which", false], [21400, 0.026562, " but", false], [4423, 0.016692, " as", false], [4811, 0.011527, " to", false], [61953, 0.011255, " especially", false], [30788, 0.011133, " even", false], [4596, 0.010087, " in", false]]]}, "raw_delta": -0.16249999999999998, "tuned_delta": -0.10841040258492439}, {"byte_start": 6207, "byte_end": 6210, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1068, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "0.15% 0.15% 0.15%", "model_b": "0.25% 0.25% 0.25%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.9750046133995056]], "model_b": [[4423, " as", "normal", 0.9595021605491638]]}, "loss": {"model_a": 0.15189507724203258, "model_b": 0.2494894988516477}, "topk": {"model_a": [4423, 1, 0.9750046133995056, [[4423, 0.975005, " as", false], [32227, 0.018112, " that", false], [4450, 0.001033, " by", false], [332, 0.000722, " a", false], [32448, 0.000585, " ways", false], [52224, 0.000458, " methods", false], [47284, 0.000318, " simple", false], [4419, 0.00031, " an", false], [4600, 0.000204, " is", false], [57419, 0.000197, " thinking", false]]], "model_b": [4423, 1, 0.9595021605491638, [[4423, 0.959502, " as", false], [32227, 0.0263, " that", false], [332, 0.002319, " a", false], [52224, 0.001224, " methods", false], [47539, 0.001046, " things", false], [57419, 0.000606, " thinking", false], [61590, 0.000458, " approaches", false], [32448, 0.000339, " ways", false], [4419, 0.000273, " an", false], [51566, 0.000272, " efforts", false]]]}, "raw_delta": -0.005411783854166667, "tuned_delta": 0.048677813560908924}, {"byte_start": 6210, "byte_end": 6217, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1069, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"model_a": "8.65% 8.65% 8.65% 8.65% 8.65% 8.65% 8.65%", "model_b": "11.43% 11.43% 11.43% 11.43% 11.43% 11.43% 11.43%"}, "model_tokens": {"model_a": [[47284, " simple", "normal", 0.035057224333286285]], "model_b": [[47284, " simple", "normal", 0.011646258644759655]]}, "loss": {"model_a": 8.654560094618503, "model_b": 11.432070078472808}, "topk": {"model_a": [47284, 4, 0.035057224333286285, [[4450, 0.208841, " by", false], [4596, 0.087361, " in", false], [22590, 0.072713, " the", false], [47284, 0.035057, " simple", false], [53140, 0.033118, " through", false], [4404, 0.030458, " ``", false], [55666, 0.023463, " building", false], [40085, 0.020275, " using", false], [47629, 0.019979, " trying", false], [38720, 0.0189, " human", false]]], "model_b": [47284, 15, 0.011646258644759655, [[22590, 0.10855, " the", false], [4404, 0.066077, " ``", false], [4596, 0.054936, " in", false], [4450, 0.046657, " by", false], [38720, 0.035511, " human", false], [60463, 0.026024, " searching", false], [39944, 0.025243, " those", false], [40085, 0.019172, " using", false], [59943, 0.017592, " knowledge", false], [53140, 0.016148, " through", false]]]}, "raw_delta": -0.15401785714285707, "tuned_delta": -0.09992825972778148}, {"byte_start": 6217, "byte_end": 6222, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1070, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"model_a": "14.31% 14.31% 14.31% 14.31% 14.31%", "model_b": "14.88% 14.88% 14.88% 14.88% 14.88%"}, "model_tokens": {"model_a": [[32448, " ways", "normal", 0.018915539607405663]], "model_b": [[32448, " ways", "normal", 0.01601019687950611]]}, "loss": {"model_a": 14.314239858820182, "model_b": 14.877792609167432}, "topk": {"model_a": [32448, 9, 0.018915539607405663, [[65275, 0.091285, " representations", false], [46587, 0.084383, " models", false], [39558, 0.03865, " rules", false], [57375, 0.034939, " symbolic", false], [59943, 0.031659, " knowledge", false], [46658, 0.030362, " neural", false], [45, 0.026188, ",", false], [38720, 0.020902, " human", false], [32448, 0.018916, " ways", false], [45432, 0.016186, " causal", false]]], "model_b": [32448, 10, 0.01601019687950611, [[65275, 0.073761, " representations", false], [46587, 0.032793, " models", false], [59943, 0.029271, " knowledge", false], [47202, 0.028657, " search", false], [39558, 0.023779, " rules", false], [46658, 0.023352, " neural", false], [52224, 0.021068, " methods", false], [46545, 0.016467, " mental", false], [45, 0.016183, ",", false], [32448, 0.01601, " ways", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 6222, "byte_end": 6225, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1071, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "0.97% 0.97% 0.97%", "model_b": "2.10% 2.10% 2.10%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.8508548140525818]], "model_b": [[4811, " to", "normal", 0.7045447826385498]]}, "loss": {"model_a": 0.9686062896593381, "model_b": 2.101582131503291}, "topk": {"model_a": [4811, 1, 0.8508548140525818, [[4811, 0.850855, " to", false], [4706, 0.124952, " of", false], [21700, 0.012865, " for", false], [32227, 0.004086, " that", false], [4596, 0.002308, " in", false], [37810, 0.000481, " based", false], [275, 0.000468, " (", false], [45, 0.000425, ",", false], [31296, 0.000404, " like", false], [4858, 0.000321, " we", false]]], "model_b": [4811, 1, 0.7045447826385498, [[4811, 0.704545, " to", false], [4706, 0.245795, " of", false], [32227, 0.020152, " that", false], [37810, 0.005725, " based", false], [21700, 0.003351, " for", false], [4596, 0.002184, " in", false], [31296, 0.002073, " like", false], [4858, 0.001992, " we", false], [40085, 0.001028, " using", false], [45, 0.000895, ",", false]]]}, "raw_delta": -0.06282552083333333, "tuned_delta": -0.00873592341825774}, {"byte_start": 6225, "byte_end": 6231, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1072, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"model_a": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "model_b": "4.86% 4.86% 4.86% 4.86% 4.86% 4.86%"}, "model_tokens": {"model_a": [[39942, " think", "normal", 0.13201920688152313]], "model_b": [[39942, " think", "normal", 0.19595016539096832]]}, "loss": {"model_a": 6.058192066232952, "model_b": 4.8606424717450425}, "topk": {"model_a": [39942, 1, 0.13201920688152313, [[39942, 0.132019, " think", false], [60389, 0.107778, " represent", false], [37923, 0.069077, " build", false], [55961, 0.051718, " describe", false], [39043, 0.043258, " model", false], [22339, 0.038955, " put", false], [45688, 0.029868, " define", false], [62683, 0.022644, " understand", false], [45854, 0.020946, " encode", false], [30858, 0.01596, " find", false]]], "model_b": [39942, 1, 0.19595016539096832, [[39942, 0.19595, " think", false], [60389, 0.05535, " represent", false], [62683, 0.037924, " understand", false], [31358, 0.031327, " make", false], [37923, 0.026439, " build", false], [39043, 0.024074, " model", false], [30858, 0.023455, " find", false], [22681, 0.021201, " use", false], [4491, 0.01677, " do", false], [55961, 0.015401, " describe", false]]]}, "raw_delta": 0.06640625, "tuned_delta": 0.12049584741507559}, {"byte_start": 6231, "byte_end": 6237, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1073, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"model_a": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "model_b": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68%"}, "model_tokens": {"model_a": [[37598, " about", "normal", 0.9247358441352844]], "model_b": [[37598, " about", "normal", 0.7993412613868713]]}, "loss": {"model_a": 0.23334606069065872, "model_b": 0.6780244027615366}, "topk": {"model_a": [37598, 1, 0.9247358441352844, [[37598, 0.924736, " about", false], [4706, 0.036857, " of", false], [4596, 0.010728, " in", false], [32227, 0.010199, " that", false], [31296, 0.002625, " like", false], [32464, 0.000647, " what", false], [21835, 0.000568, " how", false], [4423, 0.000511, " as", false], [21265, 0.000486, " and", false], [4450, 0.000474, " by", false]]], "model_b": [37598, 1, 0.7993412613868713, [[37598, 0.799341, " about", false], [4706, 0.038099, " of", false], [4596, 0.033663, " in", false], [32227, 0.021379, " that", false], [31296, 0.015301, " like", false], [45, 0.006746, ",", false], [47, 0.005113, ".", false], [31581, 0.003726, " only", false], [4715, 0.003163, " or", false], [32487, 0.003129, " with", false]]]}, "raw_delta": -0.024658203125, "tuned_delta": 0.029431394290075588}, {"byte_start": 6237, "byte_end": 6243, "display": {"text": " space", "kind": "normal"}, "is_word": true, "word_id": 1074, "word_key": " space", "bytes_hex": "20 73 70 61 63 65", "compression": {"model_a": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "model_b": "20.29% 20.29% 20.29% 20.29% 20.29% 20.29%"}, "model_tokens": {"model_a": [[39750, " space", "normal", 0.0006307411240413785]], "model_b": [[39750, " space", "normal", 0.0011665511410683393]]}, "loss": {"model_a": 22.166408180325217, "model_b": 20.287899012501047}, "topk": {"model_a": [39750, 139, 0.0006307411240413785, [[22590, 0.225832, " the", false], [21835, 0.108221, " how", false], [32464, 0.067001, " what", false], [38720, 0.056188, " human", false], [59943, 0.037485, " knowledge", false], [4404, 0.021567, " ``", false], [47732, 0.019219, " vision", false], [332, 0.013843, " a", false], [56529, 0.012784, " language", false], [47284, 0.009938, " simple", false]]], "model_b": [39750, 104, 0.0011665511410683393, [[22590, 0.221669, " the", false], [21835, 0.061872, " how", false], [59943, 0.041899, " knowledge", false], [332, 0.030619, " a", false], [32464, 0.028897, " what", false], [38720, 0.016669, " human", false], [40210, 0.01582, " words", false], [52333, 0.012043, " numbers", false], [47539, 0.011956, " things", false], [39931, 0.009695, " their", false]]]}, "raw_delta": 0.10416666666666674, "tuned_delta": 0.15825626408174231}, {"byte_start": 6243, "byte_end": 6244, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "19.44%", "model_b": "22.12%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.34336769580841064]], "model_b": [[45, ",", "normal", 0.2936798632144928]]}, "loss": {"model_a": 19.44256988698017, "model_b": 22.11944545112961}, "topk": {"model_a": [45, 1, 0.34336769580841064, [[45, 0.343368, ",", false], [21265, 0.199534, " and", false], [4715, 0.192438, " or", false], [47, 0.139316, ".", false], [275, 0.023966, " (", false], [4423, 0.017262, " as", false], [4596, 0.015951, " in", false], [46, 0.008148, "-", false], [5346, 0.007209, "---", false], [27165, 0.006575, "time", false]]], "model_b": [45, 1, 0.2936798632144928, [[45, 0.29368, ",", false], [21265, 0.260394, " and", false], [47, 0.178787, ".", false], [4715, 0.176623, " or", false], [275, 0.017334, " (", false], [46, 0.012282, "-", false], [4596, 0.011862, " in", false], [27165, 0.007631, "time", false], [60, 0.005865, ";", false], [4423, 0.002765, " as", false]]]}, "raw_delta": -0.1484375, "tuned_delta": -0.09434790258492441}, {"byte_start": 6244, "byte_end": 6252, "display": {"text": " objects", "kind": "normal"}, "is_word": true, "word_id": 1075, "word_key": " objects", "bytes_hex": "20 6f 62 6a 65 63 74 73", "compression": {"model_a": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[52342, " objects", "normal", 0.011667819693684578]], "model_b": [[52342, " objects", "normal", 0.003143582958728075]]}, "loss": {"model_a": 10.00306131866371, "model_b": 12.96171325798678}, "topk": {"model_a": [52342, 9, 0.011667819693684578, [[4715, 0.350322, " or", false], [47284, 0.133252, " simple", false], [21265, 0.098674, " and", false], [32251, 0.069816, " time", false], [37598, 0.050554, " about", false], [32139, 0.026637, " such", false], [4811, 0.016945, " to", false], [4423, 0.015397, " as", false], [52342, 0.011668, " objects", false], [31296, 0.010183, " like", false]]], "model_b": [52342, 20, 0.003143582958728075, [[4715, 0.273911, " or", false], [32251, 0.188297, " time", false], [21265, 0.117869, " and", false], [47284, 0.106087, " simple", false], [21700, 0.035293, " for", false], [4423, 0.016421, " as", false], [32139, 0.014527, " such", false], [51018, 0.013939, " because", false], [4811, 0.01028, " to", false], [22590, 0.00897, " the", false]]]}, "raw_delta": -0.1640625, "tuned_delta": -0.10997290258492441}, {"byte_start": 6252, "byte_end": 6253, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "1.02%", "model_b": "1.96%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.9446302056312561]], "model_b": [[45, ",", "normal", 0.897297739982605]]}, "loss": {"model_a": 1.021439360004393, "model_b": 1.9636291144912037}, "topk": {"model_a": [45, 1, 0.9446302056312561, [[45, 0.94463, ",", false], [21265, 0.029621, " and", false], [4596, 0.009174, " in", false], [4715, 0.008865, " or", false], [275, 0.002056, " (", false], [4706, 0.000879, " of", false], [4423, 0.000522, " as", false], [32227, 0.000505, " that", false], [32487, 0.000495, " with", false], [21643, 0.000247, " etc", false]]], "model_b": [45, 1, 0.897297739982605, [[45, 0.897298, ",", false], [21265, 0.062745, " and", false], [4715, 0.017632, " or", false], [4596, 0.011473, " in", false], [275, 0.00194, " (", false], [21643, 0.00188, " etc", false], [4706, 0.0008, " of", false], [47, 0.000799, ".", false], [32227, 0.00066, " that", false], [48, 0.000219, "/", false]]]}, "raw_delta": -0.05224609375, "tuned_delta": 0.0018435036650755882}, {"byte_start": 6253, "byte_end": 6262, "display": {"text": " multiple", "kind": "normal"}, "is_word": true, "word_id": 1076, "word_key": " multiple", "bytes_hex": "20 6d 75 6c 74 69 70 6c 65", "compression": {"model_a": "21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29%", "model_b": "19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41%"}, "model_tokens": {"model_a": [[56679, " multiple", "normal", 2.4625243895570748e-05]], "model_b": [[56679, " multiple", "normal", 6.331051554298028e-05]]}, "loss": {"model_a": 21.289770568673937, "model_b": 19.41126140084977}, "topk": {"model_a": [56679, 800, 2.4625243895570748e-05, [[21265, 0.170301, " and", false], [4715, 0.131235, " or", false], [50851, 0.091448, " actions", false], [45909, 0.031345, " events", false], [38604, 0.030503, " goals", false], [46606, 0.025559, " motion", false], [55816, 0.023921, " concepts", false], [47184, 0.02296, " scenes", false], [21643, 0.022612, " etc", false], [61661, 0.022446, " categories", false]]], "model_b": [56679, 600, 6.331051554298028e-05, [[21265, 0.237593, " and", false], [4715, 0.12759, " or", false], [21643, 0.061543, " etc", false], [32251, 0.056206, " time", false], [45909, 0.024363, " events", false], [46787, 0.02236, " people", false], [52333, 0.021197, " numbers", false], [50851, 0.019606, " actions", false], [22590, 0.018816, " the", false], [45519, 0.018733, " colors", false]]]}, "raw_delta": 0.10416666666666674, "tuned_delta": 0.15825626408174231}, {"byte_start": 6262, "byte_end": 6269, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1077, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"model_a": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "model_b": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"model_a": [[45124, " agents", "normal", 0.017348535358905792]], "model_b": [[45124, " agents", "normal", 0.07870946079492569]]}, "loss": {"model_a": 10.465979649306096, "model_b": 6.561364164757282}, "topk": {"model_a": [45124, 3, 0.017348535358905792, [[52342, 0.716978, " objects", false], [46691, 0.041405, " object", false], [45124, 0.017349, " agents", false], [47539, 0.016985, " things", false], [46, 0.011421, "-", false], [55816, 0.009144, " concepts", false], [38604, 0.009136, " goals", false], [9098, 0.005825, "xin", false], [56215, 0.005649, " features", false], [65275, 0.005428, " representations", false]]], "model_b": [45124, 2, 0.07870946079492569, [[52342, 0.094085, " objects", false], [45124, 0.078709, " agents", false], [61867, 0.047188, " dimensions", false], [65275, 0.046373, " representations", false], [46, 0.045273, "-", false], [47398, 0.039364, " states", false], [47814, 0.031878, " worlds", false], [60725, 0.01973, " variables", false], [46297, 0.019027, " inputs", false], [47539, 0.015876, " things", false]]]}, "raw_delta": 0.2165178571428572, "tuned_delta": 0.2706074545579328}, {"byte_start": 6269, "byte_end": 6270, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "2.89%", "model_b": "3.35%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.8509618043899536]], "model_b": [[45, ",", "normal", 0.8318135142326355]]}, "loss": {"model_a": 2.8882078455296627, "model_b": 3.3460944551868046}, "topk": {"model_a": [45, 1, 0.8509618043899536, [[45, 0.850962, ",", false], [21265, 0.02726, " and", false], [63662, 0.024319, " interacting", false], [4596, 0.018076, " in", false], [45094, 0.01261, " acting", false], [47, 0.01086, ".", false], [4715, 0.007671, " or", false], [45580, 0.005719, " cooper", false], [53362, 0.00465, " working", false], [275, 0.004206, " (", false]]], "model_b": [45, 1, 0.8318135142326355, [[45, 0.831814, ",", false], [47, 0.034729, ".", false], [21265, 0.025945, " and", false], [4596, 0.022985, " in", false], [63662, 0.018519, " interacting", false], [4715, 0.011896, " or", false], [21643, 0.009255, " etc", false], [275, 0.005833, " (", false], [32487, 0.002652, " with", false], [60, 0.002254, ";", false]]]}, "raw_delta": -0.025390625, "tuned_delta": 0.028698972415075588}, {"byte_start": 6270, "byte_end": 6273, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 1078, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"model_a": "12.96% 12.96% 12.96%", "model_b": "11.55% 11.55% 11.55%"}, "model_tokens": {"model_a": [[4715, " or", "normal", 0.11574005335569382]], "model_b": [[4715, " or", "normal", 0.14381541311740875]]}, "loss": {"model_a": 12.96171325798678, "model_b": 11.55283138211865}, "topk": {"model_a": [4715, 3, 0.11574005335569382, [[21643, 0.148393, " etc", false], [21265, 0.147212, " and", false], [4715, 0.11574, " or", false], [38604, 0.038784, " goals", false], [50851, 0.031208, " actions", false], [45432, 0.023302, " causal", false], [32251, 0.017653, " time", false], [56529, 0.016348, " language", false], [22590, 0.012422, " the", false], [62143, 0.009965, " intentions", false]]], "model_b": [4715, 3, 0.14381541311740875, [[21643, 0.267488, " etc", false], [21265, 0.212959, " and", false], [4715, 0.143815, " or", false], [47284, 0.017277, " simple", false], [22590, 0.015382, " the", false], [56679, 0.01402, " multiple", false], [32251, 0.007998, " time", false], [38604, 0.005504, " goals", false], [52342, 0.004647, " objects", false], [59943, 0.004391, " knowledge", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13221459741507557}, {"byte_start": 6273, "byte_end": 6280, "display": {"text": " symmet", "kind": "normal"}, "is_word": true, "word_id": 1079, "word_key": " symmet", "bytes_hex": "20 73 79 6d 6d 65 74", "compression": {"model_a": "24.31% 24.31% 24.31% 24.31% 24.31% 24.31% 24.31%", "model_b": "20.21% 20.21% 20.21% 20.21% 20.21% 20.21% 20.21%"}, "model_tokens": {"model_a": [[47484, " symmet", "normal", 7.686301978537813e-05]], "model_b": [[47484, " symmet", "normal", 0.0003942466573789716]]}, "loss": {"model_a": 24.313275800695703, "model_b": 20.20739147673715}, "topk": {"model_a": [47484, 763, 7.686301978537813e-05, [[30788, 0.082493, " even", false], [22590, 0.076892, " the", false], [45432, 0.03283, " causal", false], [38604, 0.027743, " goals", false], [47284, 0.024737, " simple", false], [39193, 0.023756, " other", false], [50851, 0.023154, " actions", false], [56529, 0.020575, " language", false], [38720, 0.017794, " human", false], [55816, 0.016268, " concepts", false]]], "model_b": [47484, 282, 0.0003942466573789716, [[30788, 0.079024, " even", false], [22590, 0.071227, " the", false], [47284, 0.056024, " simple", false], [39193, 0.044038, " other", false], [56679, 0.023925, " multiple", false], [32251, 0.014491, " time", false], [21835, 0.014256, " how", false], [55521, 0.01421, " anything", false], [31370, 0.013188, " many", false], [21273, 0.012577, " any", false]]]}, "raw_delta": 0.22767857142857162, "tuned_delta": 0.2817681688436472}, {"byte_start": 6280, "byte_end": 6284, "display": {"text": "ries", "kind": "normal"}, "is_word": true, "word_id": 1080, "word_key": "ries", "bytes_hex": "72 69 65 73", "compression": {"model_a": "0.00% 0.00% 0.00% 0.00%", "model_b": "0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"model_a": [[26892, "ries", "normal", 0.9992349147796631]], "model_b": [[26892, "ries", "normal", 0.9974856376647949]]}, "loss": {"model_a": 0.003456851282342453, "model_b": 0.011488441077635615}, "topk": {"model_a": [26892, 1, 0.9992349147796631, [[26892, 0.999235, "ries", false], [8623, 0.000359, "riz", false], [7789, 0.000162, "ies", false], [122, 3.4e-05, "y", false], [1939, 2.9e-05, "ic", false], [8608, 2.6e-05, "rie", false], [8619, 2e-05, "ris", false], [26910, 1.2e-05, "rise", false], [2159, 1e-05, "ri", false], [42193, 7e-06, "rising", false]]], "model_b": [26892, 1, 0.9974856376647949, [[26892, 0.997486, "ries", false], [8623, 0.001648, "riz", false], [2174, 9.4e-05, "ry", false], [8604, 8.4e-05, "ria", false], [8562, 5.9e-05, "ral", false], [34367, 4.2e-05, "eries", false], [8619, 4e-05, "ris", false], [8608, 3.7e-05, "rie", false], [7503, 3.2e-05, "ery", false], [115, 2.7e-05, "r", false]]]}, "raw_delta": -0.00044536590576171875, "tuned_delta": 0.05364423150931387}, {"byte_start": 6284, "byte_end": 6285, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "8.91%", "model_b": "12.26%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.6068022847175598]], "model_b": [[47, ".", "normal", 0.5059229731559753]]}, "loss": {"model_a": 8.91117786486591, "model_b": 12.257272320052715}, "topk": {"model_a": [47, 1, 0.6068022847175598, [[47, 0.606802, ".", false], [45, 0.272887, ",", false], [4706, 0.022284, " of", false], [4596, 0.019909, " in", false], [60, 0.0176, ";", false], [275, 0.013365, " (", false], [21265, 0.012714, " and", false], [4715, 0.011999, " or", false], [5346, 0.004998, "---", false], [32227, 0.002968, " that", false]]], "model_b": [47, 1, 0.5059229731559753, [[47, 0.505923, ".", false], [45, 0.288255, ",", false], [4706, 0.059319, " of", false], [4596, 0.046065, " in", false], [60, 0.020716, ";", false], [21265, 0.016995, " and", false], [4715, 0.01667, " or", false], [275, 0.011619, " (", false], [5346, 0.010407, "---", false], [21643, 0.003215, " etc", false]]]}, "raw_delta": -0.185546875, "tuned_delta": -0.13145727758492443}, {"byte_start": 6285, "byte_end": 6289, "display": {"text": " All", "kind": "normal"}, "is_word": true, "word_id": 1081, "word_key": " all", "bytes_hex": "20 41 6c 6c", "compression": {"model_a": "20.99% 20.99% 20.99% 20.99%", "model_b": "19.44% 19.44% 19.44% 19.44%"}, "model_tokens": {"model_a": [[19407, " All", "normal", 0.009374026209115982]], "model_b": [[19407, " All", "normal", 0.013401389122009277]]}, "loss": {"model_a": 20.99233995043511, "model_b": 19.44256988698017}, "topk": {"model_a": [19407, 16, 0.009374026209115982, [[20996, 0.144864, " The", false], [4331, 0.105113, " We", false], [50342, 0.064783, " Instead", false], [29894, 0.05346, " This", false], [37453, 0.052519, " These", false], [261, 0.047597, "\n\n", false], [3913, 0.030471, " In", false], [37451, 0.029898, " There", false], [3918, 0.029551, " It", false], [29834, 0.018962, " Such", false]]], "model_b": [19407, 13, 0.013401389122009277, [[4331, 0.118807, " We", false], [20996, 0.113571, " The", false], [50342, 0.079823, " Instead", false], [261, 0.070687, "\n\n", false], [29894, 0.046043, " This", false], [37453, 0.039638, " These", false], [29834, 0.036767, " Such", false], [3918, 0.033268, " It", false], [3913, 0.023347, " In", false], [37451, 0.022648, " There", false]]]}, "raw_delta": 0.0859375, "tuned_delta": 0.14002709741507557}, {"byte_start": 6289, "byte_end": 6295, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1082, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "4.25% 4.25% 4.25% 4.25% 4.25% 4.25%", "model_b": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.24104814231395721]], "model_b": [[39936, " these", "normal", 0.13651275634765625]]}, "loss": {"model_a": 4.250126992202187, "model_b": 6.011229337037347}, "topk": {"model_a": [39936, 2, 0.24104814231395721, [[4706, 0.345517, " of", false], [39936, 0.241048, " these", false], [32139, 0.116757, " such", false], [22590, 0.064086, " the", false], [32234, 0.035297, " this", false], [39944, 0.032699, " those", false], [32227, 0.021556, " that", false], [22248, 0.015256, " our", false], [4858, 0.014967, " we", false], [55572, 0.007599, " attempts", false]]], "model_b": [39936, 2, 0.13651275634765625, [[4706, 0.259507, " of", false], [39936, 0.136513, " these", false], [4858, 0.074053, " we", false], [22590, 0.07082, " the", false], [32227, 0.057931, " that", false], [32139, 0.052531, " such", false], [32234, 0.035066, " this", false], [22614, 0.018745, " too", false], [51258, 0.016805, " complex", false], [55572, 0.016382, " attempts", false]]]}, "raw_delta": -0.09765624999999999, "tuned_delta": -0.0435666525849244}, {"byte_start": 6295, "byte_end": 6299, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1083, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "7.96% 7.96% 7.96% 7.96%", "model_b": "7.64% 7.64% 7.64% 7.64%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.17364351451396942]], "model_b": [[21286, " are", "normal", 0.1855344921350479]]}, "loss": {"model_a": 7.960182598654924, "model_b": 7.643184176584596}, "topk": {"model_a": [21286, 1, 0.17364351451396942, [[21286, 0.173644, " are", false], [47539, 0.109253, " things", false], [47284, 0.097019, " simple", false], [32448, 0.038409, " ways", false], [61590, 0.034588, " approaches", false], [51566, 0.033651, " efforts", false], [55572, 0.031193, " attempts", false], [38735, 0.030757, " ideas", false], [55816, 0.027786, " concepts", false], [52326, 0.027406, " notions", false]]], "model_b": [21286, 2, 0.1855344921350479, [[47539, 0.206066, " things", false], [21286, 0.185534, " are", false], [61590, 0.046857, " approaches", false], [47284, 0.031225, " simple", false], [52224, 0.028617, " methods", false], [32448, 0.026453, " ways", false], [21413, 0.020001, " can", false], [38735, 0.018738, " ideas", false], [56939, 0.016775, " problems", false], [31059, 0.015534, " have", false]]]}, "raw_delta": 0.017578125, "tuned_delta": 0.07166772241507559}, {"byte_start": 6299, "byte_end": 6304, "display": {"text": " part", "kind": "normal"}, "is_word": true, "word_id": 1084, "word_key": " part", "bytes_hex": "20 70 61 72 74", "compression": {"model_a": "20.18% 20.18% 20.18% 20.18% 20.18%", "model_b": "20.74% 20.74% 20.74% 20.74% 20.74%"}, "model_tokens": {"model_a": [[31633, " part", "normal", 0.0036934264935553074]], "model_b": [[31633, " part", "normal", 0.003138284431770444]]}, "loss": {"model_a": 20.175188462431596, "model_b": 20.738741212778844}, "topk": {"model_a": [31633, 47, 0.0036934264935553074, [[32386, 0.047963, " very", false], [22614, 0.043635, " too", false], [47284, 0.039228, " simple", false], [51258, 0.038984, " complex", false], [59829, 0.028351, " important", false], [32448, 0.026706, " ways", false], [59699, 0.016265, " extremely", false], [47539, 0.014897, " things", false], [63366, 0.014604, " complicated", false], [56162, 0.014202, " examples", false]]], "model_b": [31633, 60, 0.003138284431770444, [[59829, 0.035443, " important", false], [32386, 0.029244, " very", false], [51258, 0.02484, " complex", false], [47284, 0.02152, " simple", false], [22614, 0.021368, " too", false], [31198, 0.020861, " just", false], [47687, 0.019867, " useful", false], [22187, 0.019012, " not", false], [53199, 0.014752, " trivial", false], [63667, 0.013222, " interesting", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 6304, "byte_end": 6307, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1085, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"model_a": "0.06% 0.06% 0.06%", "model_b": "0.19% 0.19% 0.19%"}, "model_tokens": {"model_a": [[4706, " of", "normal", 0.9901755452156067]], "model_b": [[4706, " of", "normal", 0.9693933725357056]]}, "loss": {"model_a": 0.05980410046002732, "model_b": 0.18711712413873577}, "topk": {"model_a": [4706, 1, 0.9901755452156067, [[4706, 0.990176, " of", false], [21265, 0.007056, " and", false], [46, 0.000809, "-", false], [45, 0.000642, ",", false], [22590, 0.000218, " the", false], [275, 8.5e-05, " (", false], [4596, 7.1e-05, " in", false], [4715, 6.4e-05, " or", false], [38720, 3.4e-05, " human", false], [568, 3.3e-05, "--", false]]], "model_b": [4706, 1, 0.9693933725357056, [[4706, 0.969393, " of", false], [21265, 0.025955, " and", false], [45, 0.001918, ",", false], [46, 0.000735, "-", false], [4715, 0.000266, " or", false], [22590, 0.000176, " the", false], [4811, 0.000165, " to", false], [275, 0.000147, " (", false], [21400, 9.6e-05, " but", false], [4596, 8.3e-05, " in", false]]]}, "raw_delta": -0.007059733072916667, "tuned_delta": 0.047029864342158924}, {"byte_start": 6307, "byte_end": 6311, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1086, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "2.48% 2.48% 2.48% 2.48%", "model_b": "2.57% 2.57% 2.57% 2.57%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.5780766606330872]], "model_b": [[22590, " the", "normal", 0.5661008954048157]]}, "loss": {"model_a": 2.483154306217576, "model_b": 2.571209423459334}, "topk": {"model_a": [22590, 1, 0.5780766606330872, [[22590, 0.578077, " the", false], [32464, 0.069887, " what", false], [22248, 0.044835, " our", false], [38720, 0.038102, " human", false], [332, 0.037381, " a", false], [39026, 0.037153, " minds", false], [21835, 0.025059, " how", false], [52652, 0.020581, " reality", false], [51258, 0.012993, " complex", false], [57419, 0.012202, " thinking", false]]], "model_b": [22590, 1, 0.5661008954048157, [[22590, 0.566101, " the", false], [332, 0.072277, " a", false], [22248, 0.046247, " our", false], [32464, 0.037108, " what", false], [31427, 0.031537, " mind", false], [51258, 0.025248, " complex", false], [38720, 0.016677, " human", false], [4419, 0.012696, " an", false], [39026, 0.011429, " minds", false], [21835, 0.008753, " how", false]]]}, "raw_delta": -0.0048828125, "tuned_delta": 0.04920678491507559}, {"byte_start": 6311, "byte_end": 6321, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1087, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"model_a": "18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15%", "model_b": "21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19% 21.19%"}, "model_tokens": {"model_a": [[59163, " arbitrary", "normal", 4.2606767237884924e-05]], "model_b": [[59163, " arbitrary", "normal", 8.092461030173581e-06]]}, "loss": {"model_a": 18.14639856118149, "model_b": 21.189583413056653}, "topk": {"model_a": [59163, 890, 4.2606767237884924e-05, [[61720, 0.181785, " complexity", false], [55847, 0.125567, " contents", false], [31427, 0.062453, " mind", false], [38720, 0.041804, " human", false], [51258, 0.037608, " complex", false], [51308, 0.031101, " content", false], [52569, 0.030807, " problem", false], [31835, 0.030627, " real", false], [45098, 0.02853, " actual", false], [22752, 0.020391, " way", false]]], "model_b": [59163, 3266, 8.092461030173581e-06, [[31427, 0.111659, " mind", false], [52569, 0.058696, " problem", false], [38720, 0.058473, " human", false], [51258, 0.035318, " complex", false], [61720, 0.033678, " complexity", false], [46545, 0.031795, " mental", false], [55847, 0.031329, " contents", false], [51832, 0.023493, " general", false], [31937, 0.018202, " same", false], [60572, 0.017647, " structure", false]]]}, "raw_delta": -0.16874999999999996, "tuned_delta": -0.11466040258492437}, {"byte_start": 6321, "byte_end": 6322, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "41.98%", "model_b": "42.27%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.09706572443246841]], "model_b": [[45, ",", "normal", 0.09600146859884262]]}, "loss": {"model_a": 41.98467990087022, "model_b": 42.26645627604385}, "topk": {"model_a": [45, 2, 0.09706572443246841, [[61720, 0.483272, " complexity", false], [45, 0.097066, ",", false], [60572, 0.036714, " structure", false], [21265, 0.025786, " and", false], [55847, 0.017039, " contents", false], [64294, 0.016393, " complexities", false], [22752, 0.014772, " way", false], [51308, 0.013878, " content", false], [38720, 0.011606, " human", false], [46642, 0.01099, " nature", false]]], "model_b": [45, 2, 0.09600146859884262, [[61720, 0.124122, " complexity", false], [45, 0.096001, ",", false], [21265, 0.059999, " and", false], [60572, 0.042285, " structure", false], [38720, 0.029692, " human", false], [22459, 0.02368, " set", false], [46545, 0.021885, " mental", false], [62586, 0.013014, " structures", false], [46642, 0.012459, " nature", false], [31427, 0.011565, " mind", false]]]}, "raw_delta": -0.015625, "tuned_delta": 0.03846459741507559}, {"byte_start": 6322, "byte_end": 6332, "display": {"text": " intrinsic", "kind": "normal"}, "is_word": true, "word_id": 1088, "word_key": " intrinsic", "bytes_hex": "20 69 6e 74 72 69 6e 73 69 63", "compression": {"model_a": "11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05%", "model_b": "13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19% 13.19%"}, "model_tokens": {"model_a": [[59914, " intrinsic", "normal", 0.0021597729064524174]], "model_b": [[59914, " intrinsic", "normal", 0.0006655046599917114]]}, "loss": {"model_a": 11.045633906806124, "model_b": 13.18713435812568}, "topk": {"model_a": [59914, 48, 0.0021597729064524174, [[51258, 0.14994, " complex", false], [38720, 0.13498, " human", false], [63366, 0.035795, " complicated", false], [39011, 0.035125, " messy", false], [21265, 0.025959, " and", false], [62590, 0.017408, " subjective", false], [47284, 0.015247, " simple", false], [21861, 0.010734, " idi", false], [21400, 0.010487, " but", false], [22184, 0.009928, " non", false]]], "model_b": [59914, 211, 0.0006655046599917114, [[51258, 0.09761, " complex", false], [38720, 0.074974, " human", false], [21265, 0.051943, " and", false], [22184, 0.039278, " non", false], [21400, 0.025588, " but", false], [63366, 0.023766, " complicated", false], [62590, 0.01542, " subjective", false], [39011, 0.009646, " messy", false], [4832, 0.009573, " un", false], [46199, 0.008962, " highly", false]]]}, "raw_delta": -0.11874999999999991, "tuned_delta": -0.06466040258492432}, {"byte_start": 6332, "byte_end": 6336, "display": {"text": "ally", "kind": "normal"}, "is_word": true, "word_id": 1089, "word_key": "ally", "bytes_hex": "61 6c 6c 79", "compression": {"model_a": "5.21% 5.21% 5.21% 5.21%", "model_b": "9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"model_a": [[24525, "ally", "normal", 0.31128764152526855]], "model_b": [[24525, "ally", "normal", 0.12008100003004074]]}, "loss": {"model_a": 5.212862940712074, "model_b": 9.580396755903271}, "topk": {"model_a": [24525, 2, 0.31128764152526855, [[61720, 0.50613, " complexity", false], [24525, 0.311288, "ally", false], [45, 0.042785, ",", false], [60572, 0.038159, " structure", false], [64294, 0.013609, " complexities", false], [57141, 0.005051, " richness", false], [51308, 0.003488, " content", false], [64295, 0.003359, " complication", false], [61865, 0.00298, " difficulty", false], [62404, 0.002233, " properties", false]]], "model_b": [24525, 2, 0.12008100003004074, [[61720, 0.236419, " complexity", false], [24525, 0.120081, "ally", false], [60572, 0.116478, " structure", false], [45, 0.101052, ",", false], [46642, 0.028703, " nature", false], [62404, 0.021471, " properties", false], [31633, 0.016099, " part", false], [64294, 0.015654, " complexities", false], [51308, 0.014679, " content", false], [56215, 0.013182, " features", false]]]}, "raw_delta": -0.2421875, "tuned_delta": -0.18809790258492443}, {"byte_start": 6336, "byte_end": 6337, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "75.52%", "model_b": "82.28%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.015309866517782211]], "model_b": [[46, "-", "normal", 0.010312858037650585]]}, "loss": {"model_a": 75.51606854653167, "model_b": 82.27870155069868}, "topk": {"model_a": [46, 8, 0.015309866517782211, [[51258, 0.472701, " complex", false], [63366, 0.071237, " complicated", false], [39011, 0.056884, " messy", false], [59516, 0.031709, " difficult", false], [31048, 0.025811, " hard", false], [38797, 0.016166, " intra", false], [38720, 0.015675, " human", false], [46, 0.01531, "-", false], [47284, 0.015209, " simple", false], [63682, 0.0082, " irreducible", false]]], "model_b": [46, 7, 0.010312858037650585, [[51258, 0.485884, " complex", false], [63366, 0.15364, " complicated", false], [22184, 0.021109, " non", false], [38720, 0.019111, " human", false], [59516, 0.015276, " difficult", false], [39011, 0.010394, " messy", false], [46, 0.010313, "-", false], [46992, 0.0099, " random", false], [47284, 0.00798, " simple", false], [62234, 0.007844, " mysterious", false]]]}, "raw_delta": -0.375, "tuned_delta": -0.3209104025849244}, {"byte_start": 6337, "byte_end": 6344, "display": {"text": "complex", "kind": "normal"}, "is_word": true, "word_id": 1090, "word_key": "complex", "bytes_hex": "63 6f 6d 70 6c 65 78", "compression": {"model_a": "1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55%", "model_b": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"model_a": [[48997, "complex", "normal", 0.5483301281929016]], "model_b": [[48997, "complex", "normal", 0.5431040525436401]]}, "loss": {"model_a": 1.549770063454941, "model_b": 1.569896947395914}, "topk": {"model_a": [48997, 1, 0.5483301281929016, [[48997, 0.54833, "complex", false], [34165, 0.060053, "compl", false], [1954, 0.020722, "ir", false], [25136, 0.019341, "diff", false], [2239, 0.01678, "un", false], [25554, 0.015088, "hard", false], [25888, 0.01363, "intr", false], [42268, 0.011343, "simple", false], [7849, 0.009677, "imp", false], [58259, 0.007121, "generated", false]]], "model_b": [48997, 1, 0.5431040525436401, [[48997, 0.543104, "complex", false], [34165, 0.043051, "compl", false], [1954, 0.030008, "ir", false], [25136, 0.023231, "diff", false], [2239, 0.02293, "un", false], [8256, 0.015176, "non", false], [7852, 0.011135, "inc", false], [7857, 0.007401, "inh", false], [7855, 0.007307, "inf", false], [8943, 0.006266, "uns", false]]]}, "raw_delta": -0.0011160714285714246, "tuned_delta": 0.052973525986504164}, {"byte_start": 6344, "byte_end": 6345, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "44.80%", "model_b": "38.60%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.08270533382892609]], "model_b": [[45, ",", "normal", 0.11626581102609634]]}, "loss": {"model_a": 44.80244365260648, "model_b": 38.60336339878671}, "topk": {"model_a": [45, 4, 0.08270533382892609, [[55847, 0.305905, " contents", false], [46642, 0.132776, " nature", false], [60572, 0.132112, " structure", false], [45, 0.082705, ",", false], [51308, 0.0699, " content", false], [46, 0.012652, "-", false], [56480, 0.012218, " internal", false], [38720, 0.012206, " human", false], [61720, 0.011211, " complexity", false], [22752, 0.009044, " way", false]]], "model_b": [45, 1, 0.11626581102609634, [[45, 0.116266, ",", false], [60572, 0.114351, " structure", false], [46642, 0.107379, " nature", false], [62586, 0.031687, " structures", false], [55847, 0.03087, " contents", false], [38720, 0.026619, " human", false], [40213, 0.023597, " world", false], [46545, 0.020805, " mental", false], [31633, 0.018071, " part", false], [21265, 0.013869, " and", false]]]}, "raw_delta": 0.34375, "tuned_delta": 0.3978395974150756}, {"byte_start": 6345, "byte_end": 6353, "display": {"text": " outside", "kind": "normal"}, "is_word": true, "word_id": 1091, "word_key": " outside", "bytes_hex": "20 6f 75 74 73 69 64 65", "compression": {"model_a": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[52391, " outside", "normal", 2.3365817469311878e-05]], "model_b": [[52391, " outside", "normal", 0.000163972785230726]]}, "loss": {"model_a": 23.95099188975818, "model_b": 19.724346262153794}, "topk": {"model_a": [52391, 1867, 2.3365817469311878e-05, [[55847, 0.087454, " contents", false], [21265, 0.054203, " and", false], [60572, 0.047959, " structure", false], [38720, 0.045599, " human", false], [51308, 0.027095, " content", false], [46642, 0.026357, " nature", false], [39011, 0.023997, " messy", false], [56480, 0.021559, " internal", false], [31835, 0.020745, " real", false], [63682, 0.016748, " irreducible", false]]], "model_b": [52391, 624, 0.000163972785230726, [[21265, 0.212024, " and", false], [60572, 0.030113, " structure", false], [38720, 0.029599, " human", false], [31427, 0.023046, " mind", false], [22184, 0.022534, " non", false], [31633, 0.019582, " part", false], [56480, 0.015355, " internal", false], [46545, 0.015069, " mental", false], [21400, 0.013077, " but", false], [55847, 0.011727, " contents", false]]]}, "raw_delta": 0.234375, "tuned_delta": 0.2884645974150756}, {"byte_start": 6353, "byte_end": 6359, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 1092, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"model_a": "6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "model_b": "4.91% 4.91% 4.91% 4.91% 4.91% 4.91%"}, "model_tokens": {"model_a": [[40213, " world", "normal", 0.10787786543369293]], "model_b": [[40213, " world", "normal", 0.19624193012714386]]}, "loss": {"model_a": 6.71567027497141, "model_b": 4.907605200940647}, "topk": {"model_a": [40213, 2, 0.10787786543369293, [[46, 0.657547, "-", false], [40213, 0.107878, " world", false], [22590, 0.025483, " the", false], [4706, 0.024886, " of", false], [46642, 0.017877, " nature", false], [52652, 0.014205, " reality", false], [32398, 0.009414, " view", false], [60572, 0.007526, " structure", false], [63536, 0.006055, " environment", false], [63637, 0.00572, " information", false]]], "model_b": [40213, 2, 0.19624193012714386, [[46, 0.365903, "-", false], [40213, 0.196242, " world", false], [4706, 0.067014, " of", false], [22590, 0.030281, " the", false], [60572, 0.020643, " structure", false], [115, 0.019933, "r", false], [63536, 0.01282, " environment", false], [45, 0.011169, ",", false], [32398, 0.009627, " view", false], [63637, 0.00917, " information", false]]]}, "raw_delta": 0.10026041666666663, "tuned_delta": 0.1543500140817422}, {"byte_start": 6359, "byte_end": 6360, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "19.30%", "model_b": "28.46%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.3428715169429779]], "model_b": [[47, ".", "normal", 0.20563165843486786]]}, "loss": {"model_a": 19.301681699393356, "model_b": 28.45941389253619}, "topk": {"model_a": [47, 1, 0.3428715169429779, [[47, 0.342872, ".", false], [45, 0.246875, ",", false], [32227, 0.111944, " that", false], [4706, 0.060651, " of", false], [4858, 0.051275, " we", false], [60, 0.036922, ";", false], [5346, 0.034979, "---", false], [21265, 0.023958, " and", false], [4596, 0.020023, " in", false], [4811, 0.008261, " to", false]]], "model_b": [47, 2, 0.20563165843486786, [[45, 0.253004, ",", false], [47, 0.205632, ".", false], [32227, 0.186502, " that", false], [4706, 0.152375, " of", false], [4858, 0.039173, " we", false], [60, 0.029136, ";", false], [4811, 0.019161, " to", false], [21265, 0.013748, " and", false], [4596, 0.013518, " in", false], [275, 0.010636, " (", false]]]}, "raw_delta": -0.5078125, "tuned_delta": -0.4537229025849244}, {"byte_start": 6360, "byte_end": 6365, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 1093, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"model_a": "11.21% 11.21% 11.21% 11.21% 11.21%", "model_b": "13.36% 13.36% 13.36% 13.36% 13.36%"}, "model_tokens": {"model_a": [[29893, " They", "normal", 0.04504038393497467]], "model_b": [[29893, " They", "normal", 0.0244978629052639]]}, "loss": {"model_a": 11.214699731910299, "model_b": 13.356200183229856}, "topk": {"model_a": [29893, 4, 0.04504038393497467, [[20996, 0.153233, " The", false], [4331, 0.128593, " We", false], [50342, 0.049215, " Instead", false], [29893, 0.04504, " They", false], [261, 0.042059, "\n\n", false], [30031, 0.036273, " What", false], [3918, 0.031607, " It", false], [19555, 0.030127, " But", false], [37451, 0.027606, " There", false], [20571, 0.027526, " Our", false]]], "model_b": [29893, 9, 0.0244978629052639, [[20996, 0.128955, " The", false], [4331, 0.123136, " We", false], [261, 0.053078, "\n\n", false], [19555, 0.049723, " But", false], [19407, 0.037249, " All", false], [19417, 0.028631, " And", false], [3918, 0.028004, " It", false], [3913, 0.024734, " In", false], [29893, 0.024498, " They", false], [37451, 0.02287, " There", false]]]}, "raw_delta": -0.11875000000000002, "tuned_delta": -0.06466040258492443}, {"byte_start": 6365, "byte_end": 6369, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1094, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"model_a": "3.29% 3.29% 3.29% 3.29%", "model_b": "2.76% 2.76% 2.76% 2.76%"}, "model_tokens": {"model_a": [[21286, " are", "normal", 0.4786088466644287]], "model_b": [[21286, " are", "normal", 0.5470673441886902]]}, "loss": {"model_a": 3.29326138484175, "model_b": 2.7649306813912014}, "topk": {"model_a": [21286, 1, 0.4786088466644287, [[21286, 0.478609, " are", false], [4491, 0.081424, " do", false], [47266, 0.067275, " should", false], [31059, 0.052875, " have", false], [45409, 0.041094, " cannot", false], [21413, 0.041028, " can", false], [22074, 0.019537, " may", false], [32475, 0.017421, " will", false], [31506, 0.015219, " need", false], [21256, 0.013112, " all", false]]], "model_b": [21286, 1, 0.5470673441886902, [[21286, 0.547067, " are", false], [4491, 0.095347, " do", false], [47266, 0.07655, " should", false], [45409, 0.043867, " cannot", false], [21413, 0.038354, " can", false], [31059, 0.034671, " have", false], [22074, 0.010998, " may", false], [21256, 0.009159, " all", false], [32475, 0.00876, " will", false], [31506, 0.008616, " need", false]]]}, "raw_delta": 0.029296875, "tuned_delta": 0.08338647241507559}, {"byte_start": 6369, "byte_end": 6373, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1095, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "5.11% 5.11% 5.11% 5.11%", "model_b": "5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.32195380330085754]], "model_b": [[22187, " not", "normal", 0.28380754590034485]]}, "loss": {"model_a": 5.107196800021964, "model_b": 5.670749550369216}, "topk": {"model_a": [22187, 1, 0.32195380330085754, [[22187, 0.321954, " not", false], [31633, 0.051663, " part", false], [22590, 0.04268, " the", false], [21256, 0.039106, " all", false], [332, 0.013656, " a", false], [31296, 0.012447, " like", false], [31198, 0.011998, " just", false], [45, 0.011522, ",", false], [32464, 0.011268, " what", false], [39934, 0.01115, " there", false]]], "model_b": [22187, 1, 0.28380754590034485, [[22187, 0.283808, " not", false], [21256, 0.043251, " all", false], [31633, 0.043105, " part", false], [22590, 0.037616, " the", false], [31198, 0.026589, " just", false], [47285, 0.017917, " simply", false], [52391, 0.017075, " outside", false], [4692, 0.014967, " no", false], [332, 0.014375, " a", false], [31581, 0.013478, " only", false]]]}, "raw_delta": -0.03125, "tuned_delta": 0.022839597415075588}, {"byte_start": 6373, "byte_end": 6378, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1096, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"model_a": "17.36% 17.36% 17.36% 17.36% 17.36%", "model_b": "14.88% 14.88% 14.88% 14.88% 14.88%"}, "model_tokens": {"model_a": [[32464, " what", "normal", 0.00808615144342184]], "model_b": [[32464, " what", "normal", 0.016299165785312653]]}, "loss": {"model_a": 17.35742471069534, "model_b": 14.877792609167432}, "topk": {"model_a": [32464, 19, 0.00808615144342184, [[31633, 0.116338, " part", false], [59914, 0.103823, " intrinsic", false], [22590, 0.088474, " the", false], [47284, 0.050883, " simple", false], [45, 0.024164, ",", false], [4596, 0.022836, " in", false], [47539, 0.021188, " things", false], [63591, 0.016011, " fundamental", false], [4811, 0.01387, " to", false], [332, 0.012946, " a", false]]], "model_b": [32464, 8, 0.016299165785312653, [[22590, 0.135856, " the", false], [31633, 0.08837, " part", false], [39239, 0.033019, " parts", false], [47539, 0.02499, " things", false], [45, 0.023574, ",", false], [47284, 0.016965, " simple", false], [31198, 0.016805, " just", false], [32464, 0.016299, " what", false], [47687, 0.015355, " useful", false], [332, 0.014812, " a", false]]]}, "raw_delta": 0.13750000000000007, "tuned_delta": 0.19158959741507564}, {"byte_start": 6378, "byte_end": 6385, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1097, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%", "model_b": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.018452977761626244]], "model_b": [[47266, " should", "normal", 0.00651921983808279]]}, "loss": {"model_a": 10.304964577778307, "model_b": 12.96171325798678}, "topk": {"model_a": [47266, 7, 0.018452977761626244, [[4858, 0.266663, " we", false], [39026, 0.116671, " minds", false], [4600, 0.110939, " is", false], [22590, 0.081737, " the", false], [3609, 0.038492, " AI", false], [38964, 0.02024, " makes", false], [47266, 0.018453, " should", false], [21286, 0.018429, " are", false], [52201, 0.016266, " matters", false], [332, 0.01494, " a", false]]], "model_b": [47266, 21, 0.00651921983808279, [[4858, 0.345438, " we", false], [22590, 0.09852, " the", false], [39026, 0.059116, " minds", false], [4600, 0.04466, " is", false], [22799, 0.033688, " you", false], [21286, 0.027676, " are", false], [52201, 0.026611, " matters", false], [46787, 0.024403, " people", false], [31427, 0.021059, " mind", false], [332, 0.021024, " a", false]]]}, "raw_delta": -0.1473214285714286, "tuned_delta": -0.09323183115635301}, {"byte_start": 6385, "byte_end": 6388, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1098, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "0.68% 0.68% 0.68%", "model_b": "0.86% 0.86% 0.86%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.8929682374000549]], "model_b": [[4435, " be", "normal", 0.8666996359825134]]}, "loss": {"model_a": 0.6838947439109873, "model_b": 0.8629401489692285}, "topk": {"model_a": [4435, 1, 0.8929682374000549, [[4435, 0.892968, " be", false], [46530, 0.010812, " matter", false], [38649, 0.010182, " guide", false], [38306, 0.009278, " drive", false], [51273, 0.005512, " concern", false], [38377, 0.004994, " enter", false], [4715, 0.004612, " or", false], [4559, 0.002851, " go", false], [31059, 0.002417, " have", false], [47008, 0.002415, " really", false]]], "model_b": [4435, 1, 0.8666996359825134, [[4435, 0.8667, " be", false], [46530, 0.031652, " matter", false], [51273, 0.010099, " concern", false], [56477, 0.005399, " interest", false], [56675, 0.005304, " motivate", false], [4715, 0.004459, " or", false], [38649, 0.004344, " guide", false], [38129, 0.003953, " count", false], [38377, 0.003841, " enter", false], [38306, 0.003588, " drive", false]]]}, "raw_delta": -0.009928385416666664, "tuned_delta": 0.044161211998408924}, {"byte_start": 6388, "byte_end": 6394, "display": {"text": " built", "kind": "normal"}, "is_word": true, "word_id": 1099, "word_key": " built", "bytes_hex": "20 62 75 69 6c 74", "compression": {"model_a": "11.32% 11.32% 11.32% 11.32% 11.32% 11.32%", "model_b": "17.38% 17.38% 17.38% 17.38% 17.38% 17.38%"}, "model_tokens": {"model_a": [[37924, " built", "normal", 0.02331293746829033]], "model_b": [[37924, " built", "normal", 0.0030444329604506493]]}, "loss": {"model_a": 11.318017736140629, "model_b": 17.37620980237358}, "topk": {"model_a": [37924, 10, 0.02331293746829033, [[22339, 0.094739, " put", false], [22590, 0.071422, " the", false], [53137, 0.060476, " thought", false], [52249, 0.054899, " modeled", false], [53035, 0.049894, " studied", false], [4596, 0.044018, " in", false], [52112, 0.035605, " learned", false], [39887, 0.026018, " taken", false], [61755, 0.025804, " considered", false], [37924, 0.023313, " built", false]]], "model_b": [37924, 40, 0.0030444329604506493, [[53137, 0.18473, " thought", false], [22590, 0.097333, " the", false], [53035, 0.049439, " studied", false], [61755, 0.047753, " considered", false], [47340, 0.043364, " sought", false], [52112, 0.034839, " learned", false], [57173, 0.026424, " searched", false], [51770, 0.025646, " focused", false], [64466, 0.02126, " investigated", false], [59080, 0.019911, " addressed", false]]]}, "raw_delta": -0.3359375, "tuned_delta": -0.2818479025849244}, {"byte_start": 6394, "byte_end": 6397, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1100, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "14.46% 14.46% 14.46%", "model_b": "10.05% 10.05% 10.05%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.09114251285791397]], "model_b": [[4596, " in", "normal", 0.18705400824546814]]}, "loss": {"model_a": 14.464520592246117, "model_b": 10.050024047859313}, "topk": {"model_a": [4596, 2, 0.09114251285791397, [[31162, 0.839627, " into", false], [4596, 0.091143, " in", false], [46, 0.010649, "-", false], [46301, 0.008812, " inside", false], [47, 0.006814, ".", false], [4450, 0.005827, " by", false], [45, 0.004704, ",", false], [21265, 0.002709, " and", false], [4423, 0.002373, " as", false], [4715, 0.002369, " or", false]]], "model_b": [4596, 2, 0.18705400824546814, [[31162, 0.764708, " into", false], [4596, 0.187054, " in", false], [4712, 0.006951, " on", false], [4833, 0.006522, " up", false], [46, 0.006364, "-", false], [32350, 0.00372, " upon", false], [45, 0.0021, ",", false], [46301, 0.001784, " inside", false], [4423, 0.001773, " as", false], [47, 0.001767, ".", false]]]}, "raw_delta": 0.24479166666666674, "tuned_delta": 0.2988812640817423}, {"byte_start": 6397, "byte_end": 6398, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "40.86%", "model_b": "35.22%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.10549722611904144]], "model_b": [[45, ",", "normal", 0.14022842049598694]]}, "loss": {"model_a": 40.857574400175714, "model_b": 35.222046896703205}, "topk": {"model_a": [45, 3, 0.10549722611904144, [[4811, 0.373112, " to", false], [47, 0.221567, ".", false], [45, 0.105497, ",", false], [4423, 0.03443, " as", false], [22590, 0.026247, " the", false], [22248, 0.023031, " our", false], [3609, 0.021817, " AI", false], [4450, 0.019882, " by", false], [60, 0.016826, ";", false], [21265, 0.01213, " and", false]]], "model_b": [45, 3, 0.14022842049598694, [[47, 0.224094, ".", false], [4811, 0.195724, " to", false], [45, 0.140228, ",", false], [3609, 0.052707, " AI", false], [60, 0.039483, ";", false], [4423, 0.037077, " as", false], [22590, 0.031068, " the", false], [22248, 0.028916, " our", false], [45124, 0.017316, " agents", false], [31162, 0.016302, " into", false]]]}, "raw_delta": 0.3125, "tuned_delta": 0.3665895974150756}, {"byte_start": 6398, "byte_end": 6401, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1101, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"model_a": "15.97% 15.97% 15.97%", "model_b": "20.85% 20.85% 20.85%"}, "model_tokens": {"model_a": [[4423, " as", "normal", 0.07138797640800476]], "model_b": [[4423, " as", "normal", 0.031737927347421646]]}, "loss": {"model_a": 15.967327926505453, "model_b": 20.851451762848296}, "topk": {"model_a": [4423, 4, 0.07138797640800476, [[21265, 0.209805, " and", false], [21400, 0.142508, " but", false], [4715, 0.100561, " or", false], [4423, 0.071388, " as", false], [32232, 0.054404, " they", false], [51018, 0.043878, " because", false], [4596, 0.038, " in", false], [22185, 0.03465, " nor", false], [4811, 0.014699, " to", false], [30788, 0.013509, " even", false]]], "model_b": [4423, 6, 0.031737927347421646, [[21265, 0.278308, " and", false], [21400, 0.185147, " but", false], [4715, 0.177852, " or", false], [22185, 0.047072, " nor", false], [51018, 0.038965, " because", false], [4423, 0.031738, " as", false], [32232, 0.020835, " they", false], [22187, 0.013806, " not", false], [4596, 0.010812, " in", false], [40186, 0.009334, " which", false]]]}, "raw_delta": -0.27083333333333337, "tuned_delta": -0.2167437359182578}, {"byte_start": 6401, "byte_end": 6407, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 1102, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"model_a": "16.25% 16.25% 16.25% 16.25% 16.25% 16.25%", "model_b": "18.32% 18.32% 18.32% 18.32% 18.32% 18.32%"}, "model_tokens": {"model_a": [[39931, " their", "normal", 0.004446817561984062]], "model_b": [[39931, " their", "normal", 0.00223975395783782]]}, "loss": {"model_a": 16.24910430167908, "model_b": 18.315464386285665}, "topk": {"model_a": [39931, 34, 0.004446817561984062, [[32232, 0.149974, " they", false], [22590, 0.073455, " the", false], [31633, 0.059053, " part", false], [332, 0.055842, " a", false], [4858, 0.039236, " we", false], [55666, 0.032336, " building", false], [4601, 0.030379, " it", false], [4588, 0.020821, " if", false], [4596, 0.01615, " in", false], [47284, 0.014415, " simple", false]]], "model_b": [39931, 49, 0.00223975395783782, [[332, 0.101566, " a", false], [22590, 0.085453, " the", false], [32232, 0.080176, " they", false], [4858, 0.069637, " we", false], [4588, 0.053242, " if", false], [31633, 0.030433, " part", false], [4596, 0.027324, " in", false], [4419, 0.025698, " an", false], [4601, 0.022165, " it", false], [47284, 0.019287, " simple", false]]]}, "raw_delta": -0.11458333333333337, "tuned_delta": -0.06049373591825778}, {"byte_start": 6407, "byte_end": 6418, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1103, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"model_a": "3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43%", "model_b": "5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23% 5.23%"}, "model_tokens": {"model_a": [[61720, " complexity", "normal", 0.12213197350502014]], "model_b": [[61720, " complexity", "normal", 0.04138169437646866]]}, "loss": {"model_a": 3.432548570296895, "model_b": 5.225670957765423}, "topk": {"model_a": [61720, 1, 0.12213197350502014, [[61720, 0.122132, " complexity", false], [55847, 0.066168, " contents", false], [56916, 0.057216, " presence", false], [32386, 0.027796, " very", false], [22681, 0.027666, " use", false], [59677, 0.024985, " existence", false], [59914, 0.024313, " intrinsic", false], [51308, 0.017714, " content", false], [45098, 0.013721, " actual", false], [40093, 0.013424, " value", false]]], "model_b": [61720, 2, 0.04138169437646866, [[56916, 0.058357, " presence", false], [61720, 0.041382, " complexity", false], [59914, 0.027206, " intrinsic", false], [59677, 0.026961, " existence", false], [22681, 0.021438, " use", false], [40093, 0.018432, " value", false], [56480, 0.018247, " internal", false], [55666, 0.016791, " building", false], [31410, 0.016573, " mere", false], [22251, 0.015248, " own", false]]]}, "raw_delta": -0.09943181818181822, "tuned_delta": -0.04534222076674263}, {"byte_start": 6418, "byte_end": 6421, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1104, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "7.51% 7.51% 7.51%", "model_b": "7.09% 7.09% 7.09%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.2833641767501831]], "model_b": [[4600, " is", "normal", 0.3053942322731018]]}, "loss": {"model_a": 7.514036671296684, "model_b": 7.0913721085362456}, "topk": {"model_a": [4600, 1, 0.2833641767501831, [[4600, 0.283364, " is", false], [38964, 0.068425, " makes", false], [40219, 0.049537, " would", false], [32475, 0.048743, " will", false], [21265, 0.043867, " and", false], [45409, 0.03087, " cannot", false], [21413, 0.028453, " can", false], [30659, 0.026134, " does", false], [47266, 0.023127, " should", false], [21800, 0.017332, " has", false]]], "model_b": [4600, 1, 0.3053942322731018, [[4600, 0.305394, " is", false], [38964, 0.091797, " makes", false], [21265, 0.062869, " and", false], [40219, 0.033211, " would", false], [21413, 0.029448, " can", false], [47266, 0.01817, " should", false], [30659, 0.017897, " does", false], [32475, 0.016788, " will", false], [45, 0.014677, ",", false], [45409, 0.014378, " cannot", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07752709741507559}, {"byte_start": 6421, "byte_end": 6429, "display": {"text": " endless", "kind": "normal"}, "is_word": true, "word_id": 1105, "word_key": " endless", "bytes_hex": "20 65 6e 64 6c 65 73 73", "compression": {"model_a": "18.32% 18.32% 18.32% 18.32% 18.32% 18.32% 18.32% 18.32%", "model_b": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%"}, "model_tokens": {"model_a": [[51607, " endless", "normal", 0.000289862509816885]], "model_b": [[51607, " endless", "normal", 0.00015300532686524093]]}, "loss": {"model_a": 18.315464386285665, "model_b": 19.724346262153794}, "topk": {"model_a": [51607, 273, 0.000289862509816885, [[22187, 0.170304, " not", false], [332, 0.078675, " a", false], [4419, 0.050049, " an", false], [22614, 0.042854, " too", false], [31633, 0.025791, " part", false], [45302, 0.024152, " beyond", false], [22590, 0.021548, " the", false], [31581, 0.020269, " only", false], [52391, 0.017648, " outside", false], [62161, 0.01734, " irrelevant", false]]], "model_b": [51607, 454, 0.00015300532686524093, [[22187, 0.14609, " not", false], [22614, 0.069662, " too", false], [59914, 0.041591, " intrinsic", false], [45302, 0.036831, " beyond", false], [47285, 0.035641, " simply", false], [332, 0.027518, " a", false], [4788, 0.023186, " so", false], [62161, 0.022301, " irrelevant", false], [56454, 0.021485, " inherent", false], [22590, 0.020371, " the", false]]]}, "raw_delta": -0.078125, "tuned_delta": -0.024035402584924412}, {"byte_start": 6429, "byte_end": 6430, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"model_a": "80.02%", "model_b": "95.24%"}, "model_tokens": {"model_a": [[60, ";", "normal", 0.011825809255242348]], "model_b": [[60, ";", "normal", 0.004989249631762505]]}, "loss": {"model_a": 80.02449054930968, "model_b": 95.24041480868547}, "topk": {"model_a": [60, 5, 0.011825809255242348, [[2030, 0.495472, "ly", false], [47, 0.196249, ".", false], [21265, 0.134506, " and", false], [45, 0.127318, ",", false], [60, 0.011826, ";", false], [4596, 0.006734, " in", false], [5346, 0.004611, "---", false], [275, 0.003209, " (", false], [4811, 0.0014, " to", false], [21400, 0.00136, " but", false]]], "model_b": [60, 6, 0.004989249631762505, [[2030, 0.564235, "ly", false], [47, 0.215706, ".", false], [45, 0.091124, ",", false], [21265, 0.090656, " and", false], [4596, 0.006071, " in", false], [60, 0.004989, ";", false], [275, 0.003537, " (", false], [4811, 0.003304, " to", false], [45302, 0.002354, " beyond", false], [4715, 0.00147, " or", false]]]}, "raw_delta": -0.84375, "tuned_delta": -0.7896604025849244}, {"byte_start": 6430, "byte_end": 6438, "display": {"text": " instead", "kind": "normal"}, "is_word": true, "word_id": 1106, "word_key": " instead", "bytes_hex": "20 69 6e 73 74 65 61 64", "compression": {"model_a": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "model_b": "4.19% 4.19% 4.19% 4.19% 4.19% 4.19% 4.19% 4.19%"}, "model_tokens": {"model_a": [[52028, " instead", "normal", 0.07251709699630737]], "model_b": [[52028, " instead", "normal", 0.1568000614643097]]}, "loss": {"model_a": 5.952525925542842, "model_b": 4.191423580707681}, "topk": {"model_a": [52028, 4, 0.07251709699630737, [[32232, 0.255238, " they", false], [4858, 0.121006, " we", false], [22590, 0.081521, " the", false], [52028, 0.072517, " instead", false], [4601, 0.057043, " it", false], [32464, 0.048157, " what", false], [21265, 0.034372, " and", false], [47001, 0.029379, " rather", false], [39934, 0.022412, " there", false], [21256, 0.019508, " all", false]]], "model_b": [52028, 2, 0.1568000614643097, [[32232, 0.227774, " they", false], [52028, 0.1568, " instead", false], [4858, 0.084703, " we", false], [22590, 0.058013, " the", false], [47001, 0.041544, " rather", false], [21265, 0.04094, " and", false], [4601, 0.034678, " it", false], [21256, 0.025717, " all", false], [39931, 0.022529, " their", false], [32464, 0.01926, " what", false]]]}, "raw_delta": 0.09765625, "tuned_delta": 0.15174584741507557}, {"byte_start": 6438, "byte_end": 6441, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1107, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "9.25% 9.25% 9.25%", "model_b": "11.79% 11.79% 11.79%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.21421262621879578]], "model_b": [[4858, " we", "normal", 0.1405961960554123]]}, "loss": {"model_a": 9.251657651534043, "model_b": 11.787645028096673}, "topk": {"model_a": [4858, 2, 0.21421262621879578, [[45, 0.604138, ",", false], [4858, 0.214213, " we", false], [32232, 0.065456, " they", false], [22590, 0.028203, " the", false], [32464, 0.019365, " what", false], [4706, 0.01548, " of", false], [4601, 0.00581, " it", false], [22226, 0.005753, " one", false], [21256, 0.003854, " all", false], [22248, 0.003193, " our", false]]], "model_b": [4858, 2, 0.1405961960554123, [[45, 0.728288, ",", false], [4858, 0.140596, " we", false], [32232, 0.049672, " they", false], [22590, 0.015996, " the", false], [4706, 0.01047, " of", false], [4601, 0.007, " it", false], [21256, 0.004624, " all", false], [39936, 0.004618, " these", false], [22248, 0.002869, " our", false], [32464, 0.002846, " what", false]]]}, "raw_delta": -0.140625, "tuned_delta": -0.08653540258492441}, {"byte_start": 6441, "byte_end": 6448, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1108, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%", "model_b": "0.35% 0.35% 0.35% 0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.906289279460907]], "model_b": [[47266, " should", "normal", 0.8708916902542114]]}, "loss": {"model_a": 0.2541019097547874, "model_b": 0.3522204689670321}, "topk": {"model_a": [47266, 1, 0.906289279460907, [[47266, 0.906289, " should", false], [31475, 0.028844, " must", false], [31506, 0.016706, " need", false], [31059, 0.011331, " have", false], [21286, 0.006538, " are", false], [21413, 0.004479, " can", false], [39196, 0.004147, " ought", false], [37923, 0.002255, " build", false], [38530, 0.001249, " focus", false], [32435, 0.001146, " want", false]]], "model_b": [47266, 1, 0.8708916902542114, [[47266, 0.870892, " should", false], [31506, 0.052343, " need", false], [31475, 0.023585, " must", false], [31059, 0.014998, " have", false], [21286, 0.009796, " are", false], [21413, 0.003751, " can", false], [32435, 0.003155, " want", false], [39196, 0.002566, " ought", false], [37923, 0.001661, " build", false], [32475, 0.001368, " will", false]]]}, "raw_delta": -0.005440848214285713, "tuned_delta": 0.048648749200789876}, {"byte_start": 6448, "byte_end": 6454, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 1109, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"model_a": "5.24% 5.24% 5.24% 5.24% 5.24% 5.24%", "model_b": "4.18% 4.18% 4.18% 4.18% 4.18% 4.18%"}, "model_tokens": {"model_a": [[37923, " build", "normal", 0.1764019876718521]], "model_b": [[37923, " build", "normal", 0.25247105956077576]]}, "loss": {"model_a": 5.236344305309876, "model_b": 4.179682898408781}, "topk": {"model_a": [37923, 1, 0.1764019876718521, [[37923, 0.176402, " build", false], [38530, 0.130243, " focus", false], [4435, 0.106596, " be", false], [22626, 0.042721, " try", false], [38877, 0.039922, " learn", false], [31966, 0.029626, " seek", false], [63373, 0.025807, " concentrate", false], [22681, 0.019599, " use", false], [32122, 0.01863, " stop", false], [32499, 0.017251, " work", false]]], "model_b": [37923, 1, 0.25247105956077576, [[37923, 0.252471, " build", false], [4435, 0.11638, " be", false], [38530, 0.083869, " focus", false], [38877, 0.061984, " learn", false], [22626, 0.053088, " try", false], [22681, 0.037038, " use", false], [31966, 0.035156, " seek", false], [39942, 0.025552, " think", false], [39801, 0.020159, " start", false], [31324, 0.012899, " look", false]]]}, "raw_delta": 0.05859374999999998, "tuned_delta": 0.11268334741507557}, {"byte_start": 6454, "byte_end": 6457, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1110, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "8.59% 8.59% 8.59%", "model_b": "4.77% 4.77% 4.77%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.23957906663417816]], "model_b": [[4596, " in", "normal", 0.4502284526824951]]}, "loss": {"model_a": 8.594179442795582, "model_b": 4.766717013353834}, "topk": {"model_a": [4596, 1, 0.23957906663417816, [[4596, 0.239579, " in", false], [52224, 0.107285, " methods", false], [53087, 0.0647, " systems", false], [22590, 0.039648, " the", false], [45124, 0.035094, " agents", false], [56567, 0.026681, " machines", false], [22248, 0.026088, " our", false], [332, 0.02571, " a", false], [51258, 0.018846, " complex", false], [51832, 0.017426, " general", false]]], "model_b": [4596, 1, 0.4502284526824951, [[4596, 0.450228, " in", false], [52224, 0.064811, " methods", false], [53087, 0.039067, " systems", false], [51832, 0.02709, " general", false], [332, 0.026059, " a", false], [22590, 0.017122, " the", false], [47284, 0.016846, " simple", false], [31162, 0.016203, " into", false], [3609, 0.012395, " AI", false], [22248, 0.011912, " our", false]]]}, "raw_delta": 0.21223958333333334, "tuned_delta": 0.26632918074840894}, {"byte_start": 6457, "byte_end": 6462, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1111, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "14.77% 14.77% 14.77% 14.77% 14.77%", "model_b": "15.55% 15.55% 15.55% 15.55% 15.55%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.016717543825507164]], "model_b": [[31581, " only", "normal", 0.013624908402562141]]}, "loss": {"model_a": 14.765082059097983, "model_b": 15.554055909584136}, "topk": {"model_a": [31581, 13, 0.016717543825507164, [[22590, 0.186146, " the", false], [52224, 0.08146, " methods", false], [63370, 0.050588, " computation", false], [332, 0.040078, " a", false], [51832, 0.035239, " general", false], [32464, 0.034387, " what", false], [64862, 0.024996, " computational", false], [61720, 0.021238, " complexity", false], [32448, 0.020215, " ways", false], [63293, 0.019996, " arbitrarily", false]]], "model_b": [31581, 9, 0.013624908402562141, [[22590, 0.160676, " the", false], [51832, 0.096966, " general", false], [52224, 0.080463, " methods", false], [332, 0.0638, " a", false], [32464, 0.0254, " what", false], [47284, 0.023154, " simple", false], [56900, 0.022515, " powerful", false], [32448, 0.019659, " ways", false], [31581, 0.013625, " only", false], [4419, 0.013077, " an", false]]]}, "raw_delta": -0.04375000000000007, "tuned_delta": 0.010339597415075522}, {"byte_start": 6462, "byte_end": 6466, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1112, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "4.28% 4.28% 4.28% 4.28%", "model_b": "4.05% 4.05% 4.05% 4.05%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.39054688811302185]], "model_b": [[22590, " the", "normal", 0.40691736340522766]]}, "loss": {"model_a": 4.27947869794944, "model_b": 4.050535393120868}, "topk": {"model_a": [22590, 1, 0.39054688811302185, [[22590, 0.390547, " the", false], [32464, 0.233915, " what", false], [332, 0.038416, " a", false], [47284, 0.035673, " simple", false], [39944, 0.034469, " those", false], [32227, 0.025262, " that", false], [4423, 0.020501, " as", false], [39931, 0.012705, " their", false], [21835, 0.010207, " how", false], [32386, 0.008919, " very", false]]], "model_b": [22590, 1, 0.40691736340522766, [[22590, 0.406917, " the", false], [32464, 0.233602, " what", false], [39944, 0.148495, " those", false], [32227, 0.030755, " that", false], [332, 0.018116, " a", false], [52224, 0.014862, " methods", false], [47284, 0.00952, " simple", false], [32139, 0.00861, " such", false], [51832, 0.008318, " general", false], [4423, 0.005873, " as", false]]]}, "raw_delta": 0.0126953125, "tuned_delta": 0.06678490991507559}, {"byte_start": 6466, "byte_end": 6471, "display": {"text": " meta", "kind": "normal"}, "is_word": true, "word_id": 1113, "word_key": " meta", "bytes_hex": "20 6d 65 74 61", "compression": {"model_a": "36.07% 36.07% 36.07% 36.07% 36.07%", "model_b": "34.04% 34.04% 34.04% 34.04% 34.04%"}, "model_tokens": {"model_a": [[31416, " meta", "normal", 4.4256728870095685e-05]], "model_b": [[31416, " meta", "normal", 7.876606832724065e-05]]}, "loss": {"model_a": 36.06737602222408, "model_b": 34.038586120973974}, "topk": {"model_a": [31416, 991, 4.4256728870095685e-05, [[47284, 0.065649, " simple", false], [57234, 0.046452, " simplest", false], [47539, 0.043642, " things", false], [52236, 0.040481, " minimal", false], [32386, 0.032835, " very", false], [61720, 0.030334, " complexity", false], [64862, 0.028558, " computational", false], [59644, 0.026121, " essential", false], [39239, 0.025282, " parts", false], [60050, 0.021958, " necessary", false]]], "model_b": [31416, 692, 7.876606832724065e-05, [[31461, 0.087997, " most", false], [47539, 0.087296, " things", false], [52224, 0.056433, " methods", false], [57234, 0.052172, " simplest", false], [47284, 0.044938, " simple", false], [38841, 0.024545, " kinds", false], [39239, 0.024472, " parts", false], [60050, 0.02431, " necessary", false], [39979, 0.021226, " tools", false], [51832, 0.019263, " general", false]]]}, "raw_delta": 0.11250000000000004, "tuned_delta": 0.16658959741507562}, {"byte_start": 6471, "byte_end": 6472, "display": {"text": "-", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d", "compression": {"model_a": "4.14%", "model_b": "4.47%"}, "model_tokens": {"model_a": [[46, "-", "normal", 0.7969080805778503]], "model_b": [[46, "-", "normal", 0.7813253998756409]]}, "loss": {"model_a": 4.138590510362627, "model_b": 4.473199955881307}, "topk": {"model_a": [46, 1, 0.7969080805778503, [[46, 0.796908, "-", false], [58313, 0.018115, "knowledge", false], [1798, 0.017464, "co", false], [63039, 0.01384, "computation", false], [38887, 0.010467, " level", false], [59943, 0.009418, " knowledge", false], [65275, 0.006507, " representations", false], [58449, 0.006226, "structure", false], [45, 0.005619, ",", false], [65062, 0.005469, "representation", false]]], "model_b": [46, 1, 0.7813253998756409, [[46, 0.781325, "-", false], [59943, 0.04773, " knowledge", false], [58313, 0.017234, "knowledge", false], [1798, 0.017024, "co", false], [63637, 0.007215, " information", false], [38887, 0.007157, " level", false], [34991, 0.00691, "level", false], [58257, 0.004613, "functions", false], [42364, 0.003727, "theory", false], [35074, 0.0036, "model", false]]]}, "raw_delta": -0.0185546875, "tuned_delta": 0.03553490991507559}, {"byte_start": 6472, "byte_end": 6479, "display": {"text": "methods", "kind": "normal"}, "is_word": true, "word_id": 1114, "word_key": "methods", "bytes_hex": "6d 65 74 68 6f 64 73", "compression": {"model_a": "14.33% 14.33% 14.33% 14.33% 14.33% 14.33% 14.33%", "model_b": "12.08% 12.08% 12.08% 12.08% 12.08% 12.08% 12.08%"}, "model_tokens": {"model_a": [[49411, "methods", "normal", 0.003857108997181058]], "model_b": [[49411, "methods", "normal", 0.009321354329586029]]}, "loss": {"model_a": 14.330341365972957, "model_b": 12.076130364583953}, "topk": {"model_a": [49411, 29, 0.003857108997181058, [[34991, 0.276112, "level", false], [58313, 0.109986, "knowledge", false], [58449, 0.047423, "structure", false], [61078, 0.041044, "properties", false], [63039, 0.039024, "computation", false], [61110, 0.034753, "structures", false], [48997, 0.029643, "complex", false], [65062, 0.024003, "representation", false], [1798, 0.020883, "co", false], [41034, 0.018273, "aspect", false]]], "model_b": [49411, 17, 0.009321354329586029, [[34991, 0.293571, "level", false], [58313, 0.166369, "knowledge", false], [1798, 0.042067, "co", false], [63069, 0.030269, "information", false], [8801, 0.01746, "the", false], [53988, 0.015645, "features", false], [63039, 0.014396, "computation", false], [42364, 0.012858, "theory", false], [58257, 0.011854, "functions", false], [33992, 0.011726, "aware", false]]]}, "raw_delta": 0.125, "tuned_delta": 0.17908959741507557}, {"byte_start": 6479, "byte_end": 6484, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1115, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "2.59% 2.59% 2.59% 2.59% 2.59%", "model_b": "2.78% 2.78% 2.78% 2.78% 2.78%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.4841887652873993]], "model_b": [[32227, " that", "normal", 0.46446260809898376]]}, "loss": {"model_a": 2.5923426515973556, "model_b": 2.7754972954602124}, "topk": {"model_a": [32227, 1, 0.4841887652873993, [[32227, 0.484189, " that", false], [45, 0.140237, ",", false], [21700, 0.078195, " for", false], [4706, 0.052582, " of", false], [4811, 0.045515, " to", false], [46650, 0.034676, " needed", false], [21265, 0.030126, " and", false], [5346, 0.023119, "---", false], [4858, 0.018807, " we", false], [47, 0.011374, ".", false]]], "model_b": [32227, 1, 0.46446260809898376, [[32227, 0.464463, " that", false], [45, 0.133062, ",", false], [4706, 0.055353, " of", false], [5346, 0.049022, "---", false], [60050, 0.04747, " necessary", false], [21265, 0.045329, " and", false], [46650, 0.044001, " needed", false], [275, 0.025968, " (", false], [4858, 0.022126, " we", false], [4811, 0.016805, " to", false]]]}, "raw_delta": -0.010156250000000006, "tuned_delta": 0.04393334741507558}, {"byte_start": 6484, "byte_end": 6488, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1116, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "10.85% 10.85% 10.85% 10.85%", "model_b": "10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.09099408984184265]], "model_b": [[21413, " can", "normal", 0.09972461313009262]]}, "loss": {"model_a": 10.848390444184586, "model_b": 10.425725881424148}, "topk": {"model_a": [21413, 3, 0.09099408984184265, [[21286, 0.136156, " are", false], [45851, 0.123109, " enable", false], [21413, 0.090994, " can", false], [37675, 0.072854, " allow", false], [39590, 0.067388, " scale", false], [31358, 0.042277, " make", false], [4858, 0.038587, " we", false], [56540, 0.027955, " leverage", false], [32475, 0.023036, " will", false], [22001, 0.016404, " let", false]]], "model_b": [21413, 2, 0.09972461313009262, [[21286, 0.159571, " are", false], [21413, 0.099725, " can", false], [45851, 0.086815, " enable", false], [4858, 0.074008, " we", false], [37675, 0.066487, " allow", false], [31358, 0.044713, " make", false], [39590, 0.025917, " scale", false], [31073, 0.019496, " help", false], [32475, 0.017347, " will", false], [31059, 0.016314, " have", false]]]}, "raw_delta": 0.0234375, "tuned_delta": 0.07752709741507559}, {"byte_start": 6488, "byte_end": 6493, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1117, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"model_a": "17.47% 17.47% 17.47% 17.47% 17.47%", "model_b": "21.75% 21.75% 21.75% 21.75% 21.75%"}, "model_tokens": {"model_a": [[30858, " find", "normal", 0.007948637008666992]], "model_b": [[30858, " find", "normal", 0.002400430617853999]]}, "loss": {"model_a": 17.47013526076479, "model_b": 21.7531361634039}, "topk": {"model_a": [30858, 21, 0.007948637008666992, [[39590, 0.169593, " scale", false], [4435, 0.10789, " be", false], [56540, 0.056821, " leverage", false], [32187, 0.045987, " take", false], [38877, 0.039794, " learn", false], [46158, 0.038689, " handle", false], [30587, 0.033412, " deal", false], [31358, 0.031685, " make", false], [22681, 0.029003, " use", false], [30498, 0.014938, " cope", false]]], "model_b": [30858, 59, 0.002400430617853999, [[4435, 0.227059, " be", false], [32187, 0.046731, " take", false], [39590, 0.045397, " scale", false], [46158, 0.037581, " handle", false], [31073, 0.027903, " help", false], [31358, 0.02513, " make", false], [63507, 0.023163, " effectively", false], [30587, 0.02203, " deal", false], [4491, 0.018764, " do", false], [22681, 0.014903, " use", false]]]}, "raw_delta": -0.23750000000000004, "tuned_delta": -0.18341040258492447}, {"byte_start": 6493, "byte_end": 6497, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1118, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"model_a": "10.71% 10.71% 10.71% 10.71%", "model_b": "12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"model_a": [[21265, " and", "normal", 0.09242917597293854]], "model_b": [[21265, " and", "normal", 0.06313180178403854]]}, "loss": {"model_a": 10.707502256597774, "model_b": 12.468604601432935}, "topk": {"model_a": [21265, 2, 0.09242917597293854, [[22590, 0.143574, " the", false], [21265, 0.092429, " and", false], [32448, 0.066946, " ways", false], [47284, 0.051276, " simple", false], [332, 0.046749, " a", false], [60521, 0.039924, " solutions", false], [51832, 0.039444, " general", false], [45, 0.02658, ",", false], [39931, 0.021251, " their", false], [30992, 0.020643, " good", false]]], "model_b": [21265, 2, 0.06313180178403854, [[22590, 0.155057, " the", false], [21265, 0.063132, " and", false], [32229, 0.05966, " them", false], [332, 0.058604, " a", false], [32448, 0.053463, " ways", false], [47284, 0.044162, " simple", false], [39931, 0.038607, " their", false], [39936, 0.038573, " these", false], [56832, 0.025977, " patterns", false], [51832, 0.025348, " general", false]]]}, "raw_delta": -0.09765625, "tuned_delta": -0.04356665258492441}, {"byte_start": 6497, "byte_end": 6505, "display": {"text": " capture", "kind": "normal"}, "is_word": true, "word_id": 1119, "word_key": " capture", "bytes_hex": "20 63 61 70 74 75 72 65", "compression": {"model_a": "15.43% 15.43% 15.43% 15.43% 15.43% 15.43% 15.43% 15.43%", "model_b": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"model_a": [[51133, " capture", "normal", 0.0010759427677839994]], "model_b": [[51133, " capture", "normal", 0.00839635543525219]]}, "loss": {"model_a": 15.427256540756003, "model_b": 10.777946350391181}, "topk": {"model_a": [51133, 73, 0.0010759427677839994, [[22681, 0.197043, " use", false], [51690, 0.185724, " exploit", false], [38877, 0.064263, " learn", false], [53251, 0.042735, " utilize", false], [39590, 0.035183, " scale", false], [56540, 0.033831, " leverage", false], [31358, 0.023954, " make", false], [37923, 0.021228, " build", false], [32187, 0.019547, " take", false], [46158, 0.0159, " handle", false]]], "model_b": [51133, 22, 0.00839635543525219, [[22681, 0.129816, " use", false], [37730, 0.076201, " apply", false], [51690, 0.051966, " exploit", false], [47009, 0.041096, " reason", false], [62683, 0.034191, " understand", false], [38877, 0.033924, " learn", false], [62193, 0.028079, " manipulate", false], [53251, 0.023744, " utilize", false], [55961, 0.022007, " describe", false], [51688, 0.019947, " explain", false]]]}, "raw_delta": 0.2578125, "tuned_delta": 0.3119020974150756}, {"byte_start": 6505, "byte_end": 6510, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1120, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"model_a": "15.44% 15.44% 15.44% 15.44% 15.44%", "model_b": "11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"model_a": [[32234, " this", "normal", 0.013306764885783195]], "model_b": [[32234, " this", "normal", 0.03937821835279465]]}, "loss": {"model_a": 15.441345359514685, "model_b": 11.6655419321881}, "topk": {"model_a": [32234, 14, 0.013306764885783195, [[22590, 0.359031, " the", false], [39936, 0.073763, " these", false], [51832, 0.064023, " general", false], [39931, 0.036997, " their", false], [32139, 0.024921, " such", false], [32229, 0.021877, " them", false], [56832, 0.020125, " patterns", false], [61720, 0.019906, " complexity", false], [21256, 0.019791, " all", false], [39944, 0.017567, " those", false]]], "model_b": [32234, 5, 0.03937821835279465, [[22590, 0.301355, " the", false], [39936, 0.149466, " these", false], [32229, 0.05391, " them", false], [39944, 0.049965, " those", false], [32234, 0.039378, " this", false], [39931, 0.031507, " their", false], [32139, 0.029348, " such", false], [32464, 0.024175, " what", false], [332, 0.019321, " a", false], [32227, 0.016902, " that", false]]]}, "raw_delta": 0.209375, "tuned_delta": 0.2634645974150756}, {"byte_start": 6510, "byte_end": 6520, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1121, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"model_a": "7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61%", "model_b": "9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75% 9.75%"}, "model_tokens": {"model_a": [[59163, " arbitrary", "normal", 0.014749602414667606]], "model_b": [[59163, " arbitrary", "normal", 0.004454689100384712]]}, "loss": {"model_a": 7.607962129687892, "model_b": 9.74946258100745}, "topk": {"model_a": [59163, 5, 0.014749602414667606, [[61720, 0.625683, " complexity", false], [51607, 0.073259, " endless", false], [59914, 0.039681, " intrinsic", false], [51258, 0.032856, " complex", false], [59163, 0.01475, " arbitrary", false], [56454, 0.012652, " inherent", false], [51832, 0.008986, " general", false], [62680, 0.008116, " underlying", false], [51970, 0.007768, " immense", false], [56125, 0.00605, " enormous", false]]], "model_b": [59163, 15, 0.004454689100384712, [[61720, 0.562641, " complexity", false], [51258, 0.077921, " complex", false], [52391, 0.032897, " outside", false], [60572, 0.014279, " structure", false], [59914, 0.013711, " intrinsic", false], [62555, 0.011779, " simplicity", false], [47284, 0.011557, " simple", false], [47, 0.010936, ".", false], [40213, 0.008724, " world", false], [56191, 0.007098, " external", false]]]}, "raw_delta": -0.11875, "tuned_delta": -0.0646604025849244}, {"byte_start": 6520, "byte_end": 6531, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1122, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"model_a": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "model_b": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"model_a": [[61720, " complexity", "normal", 0.7334807515144348]], "model_b": [[61720, " complexity", "normal", 0.7788721919059753]]}, "loss": {"model_a": 0.4995126650805183, "model_b": 0.4098565457070919}, "topk": {"model_a": [61720, 1, 0.7334807515144348, [[61720, 0.733481, " complexity", false], [45, 0.195163, ",", false], [21265, 0.010069, " and", false], [59914, 0.006533, " intrinsic", false], [51258, 0.0063, " complex", false], [51308, 0.003801, " content", false], [52391, 0.003504, " outside", false], [60572, 0.00273, " structure", false], [57141, 0.002073, " richness", false], [46, 0.001871, "-", false]]], "model_b": [61720, 1, 0.7788721919059753, [[61720, 0.778872, " complexity", false], [45, 0.077852, ",", false], [60572, 0.021152, " structure", false], [57141, 0.015602, " richness", false], [51258, 0.013216, " complex", false], [21265, 0.00899, " and", false], [51308, 0.007234, " content", false], [52391, 0.004387, " outside", false], [59914, 0.004257, " intrinsic", false], [46, 0.004142, "-", false]]]}, "raw_delta": 0.004971590909090909, "tuned_delta": 0.0590611883241665}, {"byte_start": 6531, "byte_end": 6532, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "15.43%", "model_b": "10.07%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.4203220009803772]], "model_b": [[47, ".", "normal", 0.5704280734062195]]}, "loss": {"model_a": 15.427256540756003, "model_b": 10.073505412457116}, "topk": {"model_a": [47, 1, 0.4203220009803772, [[47, 0.420322, ".", false], [45, 0.279181, ",", false], [4596, 0.054462, " in", false], [21265, 0.044779, " and", false], [5346, 0.037457, "---", false], [4423, 0.016962, " as", false], [4706, 0.010517, " of", false], [275, 0.009552, " (", false], [53356, 0.008911, " without", false], [4450, 0.008732, " by", false]]], "model_b": [47, 1, 0.5704280734062195, [[47, 0.570428, ".", false], [45, 0.170882, ",", false], [4596, 0.068942, " in", false], [21265, 0.028186, " and", false], [5346, 0.019216, "---", false], [4706, 0.016798, " of", false], [275, 0.015338, " (", false], [47806, 0.009967, " within", false], [53356, 0.009321, " without", false], [4450, 0.00616, " by", false]]]}, "raw_delta": 0.296875, "tuned_delta": 0.3509645974150756}, {"byte_start": 6532, "byte_end": 6536, "display": {"text": " Ess", "kind": "normal"}, "is_word": true, "word_id": 1123, "word_key": " ess", "bytes_hex": "20 45 73 73", "compression": {"model_a": "53.54% 53.54% 53.54% 53.54%", "model_b": "52.13% 52.13% 52.13% 52.13%"}, "model_tokens": {"model_a": [[19840, " Ess", "normal", 6.738956926710671e-06]], "model_b": [[19840, " Ess", "normal", 9.41731377679389e-06]]}, "loss": {"model_a": 53.53751128298887, "model_b": 52.12862940712074}, "topk": {"model_a": [19840, 1310, 6.738956926710671e-06, [[261, 0.271875, "\n\n", false], [20996, 0.103626, " The", false], [29894, 0.061958, " This", false], [37453, 0.0587, " These", false], [3913, 0.046762, " In", false], [4331, 0.04389, " We", false], [19417, 0.019997, " And", false], [29889, 0.018439, " That", false], [44844, 0.018096, " Search", false], [3918, 0.015744, " It", false]]], "model_b": [19840, 1194, 9.41731377679389e-06, [[261, 0.259948, "\n\n", false], [20996, 0.090349, " The", false], [29894, 0.089715, " This", false], [37453, 0.051331, " These", false], [4331, 0.043517, " We", false], [3913, 0.034944, " In", false], [267, 0.019289, "  ", false], [29386, 0.018712, " Meta", false], [29834, 0.017458, " Such", false], [29889, 0.015811, " That", false]]]}, "raw_delta": 0.078125, "tuned_delta": 0.13221459741507557}, {"byte_start": 6536, "byte_end": 6542, "display": {"text": "ential", "kind": "normal"}, "is_word": true, "word_id": 1124, "word_key": "ential", "bytes_hex": "65 6e 74 69 61 6c", "compression": {"model_a": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "model_b": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"model_a": [[41342, "ential", "normal", 0.9601582884788513]], "model_b": [[41342, "ential", "normal", 0.9260962009429932]]}, "loss": {"model_a": 0.12180957885109858, "model_b": 0.23041089011593346}, "topk": {"model_a": [41342, 1, 0.9601582884788513, [[41342, 0.960158, "ential", false], [25250, 0.015994, "ence", false], [49107, 0.013168, "entials", false], [53953, 0.007634, "entially", false], [34307, 0.000815, "ences", false], [25288, 0.000435, "enti", false], [1853, 0.00034, "en", false], [7473, 0.00012, "ent", false], [34340, 7.5e-05, "ental", false], [41317, 6.8e-05, "encial", false]]], "model_b": [41342, 1, 0.9260962009429932, [[41342, 0.926096, "ential", false], [49107, 0.031629, "entials", false], [53953, 0.020026, "entially", false], [25250, 0.015675, "ence", false], [25288, 0.002095, "enti", false], [1853, 0.001338, "en", false], [34307, 0.000531, "ences", false], [7473, 0.000517, "ent", false], [7472, 0.000145, "ens", false], [7464, 0.000128, "ene", false]]]}, "raw_delta": -0.006022135416666667, "tuned_delta": 0.048067461998408924}, {"byte_start": 6542, "byte_end": 6545, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1125, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "5.52% 5.52% 5.52%", "model_b": "6.76% 6.76% 6.76%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.39990708231925964]], "model_b": [[4811, " to", "normal", 0.3221414387226105]]}, "loss": {"model_a": 5.518120680483502, "model_b": 6.762633004167015}, "topk": {"model_a": [4811, 1, 0.39990708231925964, [[4811, 0.399907, " to", false], [37694, 0.15518, " among", false], [39239, 0.050831, " parts", false], [31416, 0.036344, " meta", false], [52224, 0.029773, " methods", false], [56089, 0.027284, " elements", false], [31077, 0.025508, " here", false], [4596, 0.022025, " in", false], [4600, 0.016106, " is", false], [61723, 0.015299, " components", false]]], "model_b": [4811, 1, 0.3221414387226105, [[4811, 0.322141, " to", false], [52224, 0.071543, " methods", false], [21700, 0.055804, " for", false], [45, 0.037219, ",", false], [31416, 0.032524, " meta", false], [39239, 0.020744, " parts", false], [4600, 0.020305, " is", false], [4596, 0.017272, " in", false], [56089, 0.014163, " elements", false], [59943, 0.013643, " knowledge", false]]]}, "raw_delta": -0.06901041666666669, "tuned_delta": -0.014920819251591097}, {"byte_start": 6545, "byte_end": 6551, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1126, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"model_a": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "model_b": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%"}, "model_tokens": {"model_a": [[39936, " these", "normal", 0.06746024638414383]], "model_b": [[39936, " these", "normal", 0.04735719785094261]]}, "loss": {"model_a": 8.077589421643935, "model_b": 9.11076946394723}, "topk": {"model_a": [39936, 3, 0.06746024638414383, [[32234, 0.572183, " this", false], [22590, 0.095323, " the", false], [39936, 0.06746, " these", false], [32227, 0.044333, " that", false], [55666, 0.027429, " building", false], [32139, 0.023214, " such", false], [38279, 0.017045, " doing", false], [21256, 0.013936, " all", false], [59258, 0.008388, " capturing", false], [22248, 0.008175, " our", false]]], "model_b": [39936, 3, 0.04735719785094261, [[32234, 0.626186, " this", false], [22590, 0.08517, " the", false], [39936, 0.047357, " these", false], [55666, 0.032903, " building", false], [21256, 0.032485, " all", false], [32227, 0.017142, " that", false], [32139, 0.01626, " such", false], [56537, 0.0135, " learning", false], [38279, 0.010818, " doing", false], [21273, 0.008298, " any", false]]]}, "raw_delta": -0.057291666666666685, "tuned_delta": -0.003202069251591097}, {"byte_start": 6551, "byte_end": 6559, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1127, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76%", "model_b": "1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94% 1.94%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.2920089364051819]], "model_b": [[52224, " methods", "normal", 0.42409810423851013]]}, "loss": {"model_a": 2.7649306813912014, "model_b": 1.9372125793186763}, "topk": {"model_a": [52224, 2, 0.2920089364051819, [[31416, 0.408875, " meta", false], [52224, 0.292009, " methods", false], [21286, 0.170203, " are", false], [51832, 0.040912, " general", false], [4600, 0.013271, " is", false], [22638, 0.009858, " two", false], [51258, 0.004377, " complex", false], [45, 0.002604, ",", false], [61590, 0.002591, " approaches", false], [38841, 0.0024, " kinds", false]]], "model_b": [52224, 1, 0.42409810423851013, [[52224, 0.424098, " methods", false], [31416, 0.311151, " meta", false], [4600, 0.060227, " is", false], [21286, 0.057758, " are", false], [51566, 0.010231, " efforts", false], [22168, 0.005958, " new", false], [61590, 0.005681, " approaches", false], [51832, 0.005555, " general", false], [45, 0.004582, ",", false], [47266, 0.003637, " should", false]]]}, "raw_delta": 0.0458984375, "tuned_delta": 0.09998803491507559}, {"byte_start": 6559, "byte_end": 6562, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1128, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"model_a": "5.52% 5.52% 5.52%", "model_b": "3.87% 3.87% 3.87%"}, "model_tokens": {"model_a": [[4600, " is", "normal", 0.399360716342926]], "model_b": [[4600, " is", "normal", 0.5204273462295532]]}, "loss": {"model_a": 5.518120680483502, "model_b": 3.8744251586373526}, "topk": {"model_a": [4600, 2, 0.399360716342926, [[21286, 0.506034, " are", false], [4600, 0.399361, " is", false], [45, 0.030381, ",", false], [32475, 0.019346, " will", false], [4706, 0.008176, " of", false], [40219, 0.00761, " would", false], [21700, 0.00412, " for", false], [47266, 0.004055, " should", false], [4596, 0.002645, " in", false], [275, 0.00246, " (", false]]], "model_b": [4600, 1, 0.5204273462295532, [[4600, 0.520427, " is", false], [21286, 0.275943, " are", false], [45, 0.059421, ",", false], [47266, 0.037921, " should", false], [32475, 0.0354, " will", false], [40219, 0.016288, " would", false], [5346, 0.01343, "---", false], [31475, 0.005547, " must", false], [4706, 0.00534, " of", false], [32227, 0.003964, " that", false]]]}, "raw_delta": 0.09114583333333331, "tuned_delta": 0.1452354307484089}, {"byte_start": 6562, "byte_end": 6567, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1129, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "10.14% 10.14% 10.14% 10.14% 10.14%", "model_b": "9.97% 9.97% 9.97% 9.97% 9.97%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.06073502078652382]], "model_b": [[32227, " that", "normal", 0.06255469471216202]]}, "loss": {"model_a": 10.143949506250523, "model_b": 9.974883681146347}, "topk": {"model_a": [32227, 3, 0.06073502078652382, [[22590, 0.308303, " the", false], [56537, 0.130619, " learning", false], [32227, 0.060735, " that", false], [332, 0.056023, " a", false], [52195, 0.03967, " massive", false], [63370, 0.020971, " computation", false], [4811, 0.019743, " to", false], [47202, 0.018603, " search", false], [4419, 0.014295, " an", false], [51832, 0.012133, " general", false]]], "model_b": [32227, 4, 0.06255469471216202, [[22590, 0.373344, " the", false], [332, 0.086519, " a", false], [56537, 0.070469, " learning", false], [32227, 0.062555, " that", false], [4419, 0.021904, " an", false], [47202, 0.017553, " search", false], [52805, 0.017288, " scaling", false], [30597, 0.011975, " deep", false], [65034, 0.011931, " understanding", false], [39931, 0.011405, " their", false]]]}, "raw_delta": 0.009375000000000022, "tuned_delta": 0.06346459741507561}, {"byte_start": 6567, "byte_end": 6572, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 1130, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"model_a": "0.92% 0.92% 0.92% 0.92% 0.92%", "model_b": "1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"model_a": [[32232, " they", "normal", 0.7772095799446106]], "model_b": [[32232, " they", "normal", 0.6539618968963623]]}, "loss": {"model_a": 0.9157732193142833, "model_b": 1.5215924259375786}, "topk": {"model_a": [32232, 1, 0.7772095799446106, [[32232, 0.77721, " they", false], [4858, 0.062873, " we", false], [22590, 0.038953, " the", false], [39931, 0.016339, " their", false], [45, 0.014259, ",", false], [39934, 0.013089, " there", false], [4706, 0.00529, " of", false], [63370, 0.003693, " computation", false], [21256, 0.003647, " all", false], [22226, 0.002853, " one", false]]], "model_b": [32232, 1, 0.6539618968963623, [[32232, 0.653962, " they", false], [4858, 0.08155, " we", false], [22590, 0.069111, " the", false], [4706, 0.026546, " of", false], [39931, 0.021329, " their", false], [21256, 0.016169, " all", false], [39934, 0.009984, " there", false], [45, 0.008997, ",", false], [39936, 0.008354, " these", false], [4601, 0.003466, " it", false]]]}, "raw_delta": -0.033593750000000006, "tuned_delta": 0.020495847415075583}, {"byte_start": 6572, "byte_end": 6576, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1131, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "10.92% 10.92% 10.92% 10.92%", "model_b": "15.85% 15.85% 15.85% 15.85%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.08924920856952667]], "model_b": [[21413, " can", "normal", 0.02996295504271984]]}, "loss": {"model_a": 10.918834537977993, "model_b": 15.849921103516442}, "topk": {"model_a": [21413, 4, 0.08924920856952667, [[39590, 0.152068, " scale", false], [21286, 0.13008, " are", false], [4435, 0.102596, " be", false], [21413, 0.089249, " can", false], [47266, 0.029672, " should", false], [22681, 0.026512, " use", false], [31059, 0.026283, " have", false], [4491, 0.025239, " do", false], [31475, 0.022251, " must", false], [38877, 0.018636, " learn", false]]], "model_b": [21413, 5, 0.02996295504271984, [[4435, 0.238135, " be", false], [21286, 0.12445, " are", false], [47266, 0.109681, " should", false], [4491, 0.032387, " do", false], [21413, 0.029963, " can", false], [22681, 0.028644, " use", false], [32187, 0.022654, " take", false], [22187, 0.022185, " not", false], [31059, 0.021961, " have", false], [31475, 0.020662, " must", false]]]}, "raw_delta": -0.2734375, "tuned_delta": -0.21934790258492443}, {"byte_start": 6576, "byte_end": 6581, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1132, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"model_a": "11.95% 11.95% 11.95% 11.95% 11.95%", "model_b": "12.91% 12.91% 12.91% 12.91% 12.91%"}, "model_tokens": {"model_a": [[30858, " find", "normal", 0.03652869537472725]], "model_b": [[30858, " find", "normal", 0.02808455564081669]]}, "loss": {"model_a": 11.947318307361726, "model_b": 12.905357982952053}, "topk": {"model_a": [30858, 5, 0.03652869537472725, [[39590, 0.266831, " scale", false], [4435, 0.13724, " be", false], [38877, 0.076261, " learn", false], [56540, 0.03888, " leverage", false], [30858, 0.036529, " find", false], [22681, 0.022034, " use", false], [32187, 0.021203, " take", false], [51133, 0.020645, " capture", false], [31358, 0.015494, " make", false], [46158, 0.01403, " handle", false]]], "model_b": [30858, 5, 0.02808455564081669, [[4435, 0.37558, " be", false], [51133, 0.039607, " capture", false], [39590, 0.038255, " scale", false], [32187, 0.030612, " take", false], [30858, 0.028085, " find", false], [38877, 0.027758, " learn", false], [22681, 0.024445, " use", false], [32499, 0.016237, " work", false], [4491, 0.015294, " do", false], [31581, 0.01316, " only", false]]]}, "raw_delta": -0.05312499999999998, "tuned_delta": 0.0009645974150756104}, {"byte_start": 6581, "byte_end": 6586, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 1133, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"model_a": "21.87% 21.87% 21.87% 21.87% 21.87%", "model_b": "25.81% 25.81% 25.81% 25.81% 25.81%"}, "model_tokens": {"model_a": [[30992, " good", "normal", 0.002304589608684182]], "model_b": [[30992, " good", "normal", 0.0007694609230384231]]}, "loss": {"model_a": 21.86584671347335, "model_b": 25.810715965904105}, "topk": {"model_a": [30992, 41, 0.002304589608684182, [[21265, 0.329588, " and", false], [59163, 0.074517, " arbitrary", false], [22590, 0.0678, " the", false], [63293, 0.052614, " arbitrarily", false], [45, 0.03914, ",", false], [32448, 0.020771, " ways", false], [332, 0.019164, " a", false], [60572, 0.014226, " structure", false], [22168, 0.012742, " new", false], [56832, 0.012013, " patterns", false]]], "model_b": [30992, 85, 0.0007694609230384231, [[21265, 0.3593, " and", false], [22590, 0.07697, " the", false], [332, 0.049907, " a", false], [45, 0.031108, ",", false], [59163, 0.028737, " arbitrary", false], [32234, 0.026611, " this", false], [39936, 0.024702, " these", false], [47284, 0.021668, " simple", false], [51832, 0.020891, " general", false], [32448, 0.018919, " ways", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 6586, "byte_end": 6600, "display": {"text": " approximation", "kind": "normal"}, "is_word": true, "word_id": 1134, "word_key": " approximation", "bytes_hex": "20 61 70 70 72 6f 78 69 6d 61 74 69 6f 6e", "compression": {"model_a": "2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70%", "model_b": "2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92%"}, "model_tokens": {"model_a": [[64831, " approximation", "normal", 0.12326377630233765]], "model_b": [[64831, " approximation", "normal", 0.10401476174592972]]}, "loss": {"model_a": 2.6970024480904167, "model_b": 2.9183981714411233}, "topk": {"model_a": [64831, 1, 0.12326377630233765, [[64831, 0.123264, " approximation", false], [32448, 0.108896, " ways", false], [65275, 0.081583, " representations", false], [60521, 0.070758, " solutions", false], [45, 0.067439, ",", false], [63245, 0.06578, " abstraction", false], [65135, 0.033084, " generalization", false], [45865, 0.014931, " enough", false], [63292, 0.014699, " approximate", false], [51832, 0.013353, " general", false]]], "model_b": [64831, 2, 0.10401476174592972, [[32448, 0.147748, " ways", false], [64831, 0.104015, " approximation", false], [52224, 0.089219, " methods", false], [65135, 0.044832, " generalization", false], [60521, 0.039986, " solutions", false], [31416, 0.039682, " meta", false], [51832, 0.037761, " general", false], [45, 0.035852, ",", false], [65275, 0.022791, " representations", false], [45865, 0.015867, " enough", false]]]}, "raw_delta": -0.012276785714285726, "tuned_delta": 0.04181281170078986}, {"byte_start": 6600, "byte_end": 6601, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 1135, "word_key": "s", "bytes_hex": "73", "compression": {"model_a": "0.16%", "model_b": "0.21%"}, "model_tokens": {"model_a": [[116, "s", "normal", 0.9911762475967407]], "model_b": [[116, "s", "normal", 0.9885990619659424]]}, "loss": {"model_a": 0.16070058896620837, "model_b": 0.2080302144836533}, "topk": {"model_a": [116, 1, 0.9911762475967407, [[116, 0.991176, "s", false], [4811, 0.003564, " to", false], [60521, 0.00062, " solutions", false], [52224, 0.000595, " methods", false], [4706, 0.000563, " of", false], [45, 0.000471, ",", false], [4596, 0.000233, " in", false], [61559, 0.00019, " algorithms", false], [21265, 0.00013, " and", false], [59751, 0.000118, " functions", false]]], "model_b": [116, 1, 0.9885990619659424, [[116, 0.988599, "s", false], [4811, 0.002745, " to", false], [4706, 0.001607, " of", false], [52224, 0.001607, " methods", false], [21700, 0.000432, " for", false], [45, 0.000406, ",", false], [61559, 0.000306, " algorithms", false], [62581, 0.000287, " strategies", false], [52811, 0.000277, " schemes", false], [4596, 0.000216, " in", false]]]}, "raw_delta": -0.00262451171875, "tuned_delta": 0.05146508569632559}, {"byte_start": 6601, "byte_end": 6602, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "41.42%", "model_b": "48.75%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.10104823857545853]], "model_b": [[45, ",", "normal", 0.06780724227428436]]}, "loss": {"model_a": 41.42112715052297, "model_b": 48.747312905037234}, "topk": {"model_a": [45, 2, 0.10104823857545853, [[4811, 0.558979, " to", false], [45, 0.101048, ",", false], [4706, 0.070776, " of", false], [4596, 0.035331, " in", false], [32227, 0.032384, " that", false], [21265, 0.02019, " and", false], [21700, 0.019779, " for", false], [47, 0.018619, ".", false], [5346, 0.011841, "---", false], [52628, 0.011646, " quickly", false]]], "model_b": [45, 3, 0.06780724227428436, [[4811, 0.478021, " to", false], [4706, 0.219155, " of", false], [45, 0.067807, ",", false], [21700, 0.067409, " for", false], [32227, 0.028048, " that", false], [275, 0.017175, " (", false], [4596, 0.016892, " in", false], [47, 0.016377, ".", false], [21265, 0.013876, " and", false], [5346, 0.012421, "---", false]]]}, "raw_delta": -0.40625, "tuned_delta": -0.3521604025849244}, {"byte_start": 6602, "byte_end": 6606, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 1136, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"model_a": "19.87% 19.87% 19.87% 19.87%", "model_b": "15.29% 15.29% 15.29% 15.29%"}, "model_tokens": {"model_a": [[21400, " but", "normal", 0.012224591337144375]], "model_b": [[21400, " but", "normal", 0.03358496353030205]]}, "loss": {"model_a": 19.86523444974061, "model_b": 15.286368353169191}, "topk": {"model_a": [21400, 15, 0.012224591337144375, [[21265, 0.19839, " and", false], [4715, 0.069173, " or", false], [4596, 0.059257, " in", false], [30788, 0.057941, " even", false], [22187, 0.051335, " not", false], [32227, 0.044996, " that", false], [4788, 0.028376, " so", false], [32487, 0.025229, " with", false], [47001, 0.021421, " rather", false], [4423, 0.018659, " as", false]]], "model_b": [21400, 8, 0.03358496353030205, [[21265, 0.166691, " and", false], [4715, 0.085767, " or", false], [32227, 0.045087, " that", false], [30788, 0.043943, " even", false], [40186, 0.042233, " which", false], [22187, 0.034163, " not", false], [4596, 0.034112, " in", false], [21400, 0.033585, " but", false], [4423, 0.028837, " as", false], [32139, 0.027813, " such", false]]]}, "raw_delta": 0.25390625, "tuned_delta": 0.3079958474150756}, {"byte_start": 6606, "byte_end": 6610, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1137, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "16.98% 16.98% 16.98% 16.98%", "model_b": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.02291511557996273]], "model_b": [[22590, " the", "normal", 0.0772312730550766]]}, "loss": {"model_a": 16.977026604210945, "model_b": 11.623275475912058}, "topk": {"model_a": [22590, 10, 0.02291511557996273, [[22187, 0.216743, " not", false], [32232, 0.156106, " they", false], [32227, 0.085494, " that", false], [4692, 0.044768, " no", false], [39115, 0.041982, " never", false], [45409, 0.033733, " cannot", false], [30135, 0.033562, " also", false], [21413, 0.030949, " can", false], [4491, 0.02292, " do", false], [22590, 0.022915, " the", false]]], "model_b": [22590, 3, 0.0772312730550766, [[32232, 0.14138, " they", false], [22187, 0.107709, " not", false], [22590, 0.077231, " the", false], [39936, 0.065337, " these", false], [32227, 0.061315, " that", false], [32234, 0.047941, " this", false], [31581, 0.040356, " only", false], [4601, 0.025506, " it", false], [4596, 0.024791, " in", false], [4858, 0.021724, " we", false]]]}, "raw_delta": 0.296875, "tuned_delta": 0.3509645974150756}, {"byte_start": 6610, "byte_end": 6617, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1138, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"model_a": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "model_b": "12.40% 12.40% 12.40% 12.40% 12.40% 12.40% 12.40%"}, "model_tokens": {"model_a": [[47202, " search", "normal", 0.009381993673741817]], "model_b": [[47202, " search", "normal", 0.008173836395144463]]}, "loss": {"model_a": 11.99562282882006, "model_b": 12.398160507639528}, "topk": {"model_a": [47202, 10, 0.009381993673741817, [[64831, 0.394329, " approximation", false], [30992, 0.052952, " good", false], [52224, 0.051282, " methods", false], [30273, 0.027662, " best", false], [31458, 0.017874, " more", false], [21952, 0.016672, " key", false], [52621, 0.011775, " quality", false], [61720, 0.011335, " complexity", false], [31581, 0.011079, " only", false], [47202, 0.009382, " search", false]]], "model_b": [47202, 20, 0.008173836395144463, [[64831, 0.065013, " approximation", false], [52224, 0.051809, " methods", false], [45098, 0.03771, " actual", false], [31458, 0.028871, " more", false], [30992, 0.028552, " good", false], [61720, 0.023908, " complexity", false], [31416, 0.021839, " meta", false], [30273, 0.019426, " best", false], [38419, 0.017812, " exact", false], [46561, 0.017576, " method", false]]]}, "raw_delta": -0.022321428571428603, "tuned_delta": 0.031768168843646985}, {"byte_start": 6617, "byte_end": 6621, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 1139, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"model_a": "7.54% 7.54% 7.54% 7.54%", "model_b": "11.48% 11.48% 11.48% 11.48%"}, "model_tokens": {"model_a": [[21700, " for", "normal", 0.18933232128620148]], "model_b": [[21700, " for", "normal", 0.07979524880647659]]}, "loss": {"model_a": 7.537518035894486, "model_b": 11.482387288325246}, "topk": {"model_a": [21700, 1, 0.18933232128620148, [[21700, 0.189332, " for", false], [21265, 0.129636, " and", false], [39750, 0.097165, " space", false], [4600, 0.083052, " is", false], [31475, 0.05847, " must", false], [4715, 0.041544, " or", false], [52224, 0.033567, " methods", false], [47266, 0.02919, " should", false], [46, 0.02581, "-", false], [21413, 0.023306, " can", false]]], "model_b": [21700, 4, 0.07979524880647659, [[21265, 0.330968, " and", false], [52224, 0.098755, " methods", false], [46, 0.08921, "-", false], [21700, 0.079795, " for", false], [4600, 0.04821, " is", false], [4715, 0.038105, " or", false], [47266, 0.02708, " should", false], [46561, 0.019566, " method", false], [45, 0.017743, ",", false], [52571, 0.016782, " process", false]]]}, "raw_delta": -0.21875, "tuned_delta": -0.16466040258492443}, {"byte_start": 6621, "byte_end": 6626, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 1140, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"model_a": "12.62% 12.62% 12.62% 12.62% 12.62%", "model_b": "14.88% 14.88% 14.88% 14.88% 14.88%"}, "model_tokens": {"model_a": [[32229, " them", "normal", 0.030142957344651222]], "model_b": [[32229, " them", "normal", 0.015942580997943878]]}, "loss": {"model_a": 12.623581607778428, "model_b": 14.877792609167432}, "topk": {"model_a": [32229, 8, 0.030142957344651222, [[30992, 0.348829, " good", false], [39936, 0.10654, " these", false], [64831, 0.106388, " approximation", false], [32139, 0.081604, " such", false], [22590, 0.078889, " the", false], [45301, 0.035198, " better", false], [332, 0.034523, " a", false], [32229, 0.030143, " them", false], [39944, 0.026664, " those", false], [4419, 0.014202, " an", false]]], "model_b": [32229, 11, 0.015942580997943878, [[39936, 0.163754, " these", false], [30992, 0.147761, " good", false], [64831, 0.137453, " approximation", false], [32139, 0.103121, " such", false], [22590, 0.064668, " the", false], [38419, 0.039068, " exact", false], [39944, 0.036164, " those", false], [332, 0.032478, " a", false], [32234, 0.018344, " this", false], [21265, 0.018267, " and", false]]]}, "raw_delta": -0.125, "tuned_delta": -0.07091040258492441}, {"byte_start": 6626, "byte_end": 6633, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1141, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"model_a": "5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80%", "model_b": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%"}, "model_tokens": {"model_a": [[47266, " should", "normal", 0.10533887892961502]], "model_b": [[47266, " should", "normal", 0.1771937906742096]]}, "loss": {"model_a": 5.7965425750002995, "model_b": 4.488295118837037}, "topk": {"model_a": [47266, 3, 0.10533887892961502, [[4600, 0.299148, " is", false], [31475, 0.192366, " must", false], [47266, 0.105339, " should", false], [21800, 0.055008, " has", false], [21413, 0.050542, " can", false], [32475, 0.035463, " will", false], [45409, 0.03245, " cannot", false], [39105, 0.022745, " needs", false], [45, 0.021985, ",", false], [22074, 0.020177, " may", false]]], "model_b": [47266, 2, 0.1771937906742096, [[4600, 0.43126, " is", false], [47266, 0.177194, " should", false], [31475, 0.045265, " must", false], [21413, 0.041717, " can", false], [21265, 0.038899, " and", false], [45, 0.034057, ",", false], [57102, 0.024104, " requires", false], [32475, 0.019661, " will", false], [21800, 0.017318, " has", false], [22074, 0.01155, " may", false]]]}, "raw_delta": 0.07254464285714289, "tuned_delta": 0.12663424027221848}, {"byte_start": 6633, "byte_end": 6636, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1142, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "6.11% 6.11% 6.11%", "model_b": "4.25% 4.25% 4.25%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.3649194836616516]], "model_b": [[4435, " be", "normal", 0.4975404739379883]]}, "loss": {"model_a": 6.105154795428556, "model_b": 4.250126992202187}, "topk": {"model_a": [4435, 1, 0.3649194836616516, [[4435, 0.364919, " be", false], [22187, 0.33217, " not", false], [39115, 0.05579, " never", false], [45150, 0.028503, " always", false], [55851, 0.022339, " continue", false], [52570, 0.013133, " proceed", false], [32122, 0.01283, " stop", false], [31581, 0.012715, " only", false], [52051, 0.009601, " involve", false], [31059, 0.008831, " have", false]]], "model_b": [4435, 1, 0.4975404739379883, [[4435, 0.49754, " be", false], [22187, 0.222004, " not", false], [32122, 0.048689, " stop", false], [39115, 0.032498, " never", false], [55851, 0.013038, " continue", false], [32187, 0.01242, " take", false], [31581, 0.010286, " only", false], [37982, 0.009159, " cease", false], [45150, 0.009137, " always", false], [21616, 0.008367, " end", false]]]}, "raw_delta": 0.10286458333333333, "tuned_delta": 0.15695418074840892}, {"byte_start": 6636, "byte_end": 6639, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1143, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "29.49% 29.49% 29.49%", "model_b": "38.51% 38.51% 38.51%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.007502478547394276]], "model_b": [[4450, " by", "normal", 0.001659934874624014]]}, "loss": {"model_a": 29.492593934839483, "model_b": 38.5094379403955}, "topk": {"model_a": [4450, 21, 0.007502478547394276, [[37810, 0.06737, " based", false], [46141, 0.062068, " guided", false], [30666, 0.044607, " done", false], [37862, 0.038172, " blind", false], [332, 0.025393, " a", false], [45796, 0.022783, " driven", false], [64862, 0.015573, " computational", false], [31269, 0.014314, " left", false], [4423, 0.013196, " as", false], [4596, 0.012941, " in", false]]], "model_b": [4450, 79, 0.001659934874624014, [[30666, 0.128099, " done", false], [53017, 0.039624, " stopped", false], [52140, 0.038689, " limited", false], [332, 0.035178, " a", false], [37810, 0.031093, " based", false], [52611, 0.02663, " pursued", false], [22590, 0.024904, " the", false], [45796, 0.021703, " driven", false], [59051, 0.020304, " abandoned", false], [4423, 0.019235, " as", false]]]}, "raw_delta": -0.4999999999999998, "tuned_delta": -0.4459104025849242}, {"byte_start": 6639, "byte_end": 6643, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1144, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"model_a": "40.01% 40.01% 40.01% 40.01%", "model_b": "31.14% 31.14% 31.14% 31.14%"}, "model_tokens": {"model_a": [[22248, " our", "normal", 0.0001352092222077772]], "model_b": [[22248, " our", "normal", 0.0010137023637071252]]}, "loss": {"model_a": 40.01224527465484, "model_b": 31.13628945668563}, "topk": {"model_a": [22248, 451, 0.0001352092222077772, [[37920, 0.195743, " brute", false], [38989, 0.049722, " means", false], [332, 0.043044, " a", false], [52195, 0.039637, " massive", false], [52224, 0.034644, " methods", false], [56537, 0.030646, " learning", false], [47202, 0.028058, " search", false], [22590, 0.027791, " the", false], [31978, 0.022344, " self", false], [63370, 0.018677, " computation", false]]], "model_b": [22248, 117, 0.0010137023637071252, [[38989, 0.074853, " means", false], [46342, 0.05959, " itself", false], [22590, 0.054064, " the", false], [332, 0.044797, " a", false], [46, 0.030378, "-", false], [52224, 0.029902, " methods", false], [47202, 0.021461, " search", false], [56537, 0.020601, " learning", false], [21265, 0.016776, " and", false], [4692, 0.016032, " no", false]]]}, "raw_delta": 0.4921875, "tuned_delta": 0.5462770974150756}, {"byte_start": 6643, "byte_end": 6651, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1145, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"model_a": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%", "model_b": "7.47% 7.47% 7.47% 7.47% 7.47% 7.47% 7.47% 7.47%"}, "model_tokens": {"model_a": [[52224, " methods", "normal", 0.02609674073755741]], "model_b": [[52224, " methods", "normal", 0.03672027215361595]]}, "loss": {"model_a": 8.206736926931846, "model_b": 7.467073942101079}, "topk": {"model_a": [52224, 6, 0.02609674073755741, [[22251, 0.204277, " own", false], [30273, 0.091332, " best", false], [39026, 0.059926, " minds", false], [31461, 0.036086, " most", false], [45124, 0.027058, " agents", false], [52224, 0.026097, " methods", false], [56567, 0.017254, " machines", false], [51832, 0.012683, " general", false], [37636, 0.009412, " agent", false], [59345, 0.008894, " computers", false]]], "model_b": [52224, 4, 0.03672027215361595, [[22251, 0.216851, " own", false], [30273, 0.048249, " best", false], [39026, 0.03751, " minds", false], [52224, 0.03672, " methods", false], [51832, 0.030478, " general", false], [65034, 0.023191, " understanding", false], [45124, 0.022479, " agents", false], [50836, 0.021075, " ability", false], [38720, 0.017008, " human", false], [38989, 0.014784, " means", false]]]}, "raw_delta": 0.041015625, "tuned_delta": 0.09510522241507559}, {"byte_start": 6651, "byte_end": 6652, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "16.41%", "model_b": "10.50%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.405602365732193]], "model_b": [[45, ",", "normal", 0.5560961961746216]]}, "loss": {"model_a": 16.413473853863692, "model_b": 10.496169975217555}, "topk": {"model_a": [45, 1, 0.405602365732193, [[45, 0.405602, ",", false], [4706, 0.148247, " of", false], [21265, 0.041474, " and", false], [47, 0.041302, ".", false], [40, 0.040812, "'", false], [32227, 0.031499, " that", false], [22187, 0.028501, " not", false], [5346, 0.026753, "---", false], [47001, 0.02564, " rather", false], [21700, 0.024731, " for", false]]], "model_b": [45, 1, 0.5560961961746216, [[45, 0.556096, ",", false], [47, 0.098212, ".", false], [4706, 0.068008, " of", false], [21265, 0.038346, " and", false], [5346, 0.034876, "---", false], [62643, 0.024008, " themselves", false], [47001, 0.020011, " rather", false], [275, 0.018572, " (", false], [32227, 0.01708, " that", false], [60, 0.012547, ";", false]]]}, "raw_delta": 0.328125, "tuned_delta": 0.3822145974150756}, {"byte_start": 6652, "byte_end": 6656, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1146, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "2.02% 2.02% 2.02% 2.02%", "model_b": "3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.6416407227516174]], "model_b": [[22187, " not", "normal", 0.4872523248195648]]}, "loss": {"model_a": 2.0164621848362585, "model_b": 3.275650361393398}, "topk": {"model_a": [22187, 1, 0.6416407227516174, [[22187, 0.641641, " not", false], [21265, 0.117235, " and", false], [47001, 0.027668, " rather", false], [40186, 0.022936, " which", false], [4450, 0.020288, " by", false], [4423, 0.011753, " as", false], [4596, 0.008012, " in", false], [53356, 0.00778, " without", false], [40085, 0.007262, " using", false], [32487, 0.007185, " with", false]]], "model_b": [22187, 1, 0.4872523248195648, [[22187, 0.487252, " not", false], [21265, 0.150234, " and", false], [47001, 0.043585, " rather", false], [4423, 0.035366, " as", false], [40186, 0.026515, " which", false], [4596, 0.018619, " in", false], [4715, 0.015693, " or", false], [4450, 0.014448, " by", false], [37810, 0.013135, " based", false], [40085, 0.010924, " using", false]]]}, "raw_delta": -0.06982421875, "tuned_delta": -0.015734621334924412}, {"byte_start": 6656, "byte_end": 6659, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1147, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"model_a": "1.90% 1.90% 1.90%", "model_b": "4.60% 4.60% 4.60%"}, "model_tokens": {"model_a": [[4450, " by", "normal", 0.7286056876182556]], "model_b": [[4450, " by", "normal", 0.46313583850860596]]}, "loss": {"model_a": 1.901990532421973, "model_b": 4.602347461169218}, "topk": {"model_a": [4450, 1, 0.7286056876182556, [[4450, 0.728606, " by", false], [22590, 0.084609, " the", false], [22248, 0.033014, " our", false], [31597, 0.014343, " ours", false], [4596, 0.009855, " in", false], [39944, 0.007908, " those", false], [38720, 0.007643, " human", false], [53140, 0.007051, " through", false], [332, 0.004437, " a", false], [21700, 0.004273, " for", false]]], "model_b": [4450, 1, 0.46313583850860596, [[4450, 0.463136, " by", false], [22590, 0.119297, " the", false], [31597, 0.060535, " ours", false], [22248, 0.044549, " our", false], [39944, 0.028738, " those", false], [38720, 0.026317, " human", false], [4596, 0.015126, " in", false], [47533, 0.01231, " theirs", false], [39931, 0.012054, " their", false], [21700, 0.01182, " for", false]]]}, "raw_delta": -0.14973958333333331, "tuned_delta": -0.09564998591825773}, {"byte_start": 6659, "byte_end": 6662, "display": {"text": " us", "kind": "normal"}, "is_word": true, "word_id": 1148, "word_key": " us", "bytes_hex": "20 75 73", "compression": {"model_a": "34.19% 34.19% 34.19%", "model_b": "37.76% 37.76% 37.76%"}, "model_tokens": {"model_a": [[4835, " us", "normal", 0.0033956430852413177]], "model_b": [[4835, " us", "normal", 0.0018961166497319937]]}, "loss": {"model_a": 34.18886685439991, "model_b": 37.758034273265835}, "topk": {"model_a": [4835, 30, 0.0033956430852413177, [[22590, 0.292774, " the", false], [38720, 0.098065, " human", false], [22248, 0.091586, " our", false], [31044, 0.032349, " hand", false], [52224, 0.028213, " methods", false], [21273, 0.026857, " any", false], [31597, 0.025495, " ours", false], [39944, 0.023, " those", false], [32074, 0.019273, " some", false], [332, 0.016666, " a", false]]], "model_b": [4835, 39, 0.0018961166497319937, [[22590, 0.15904, " the", false], [22248, 0.102534, " our", false], [38720, 0.079382, " human", false], [39944, 0.055191, " those", false], [52224, 0.053181, " methods", false], [39193, 0.052233, " other", false], [31597, 0.051563, " ours", false], [46227, 0.0505, " humans", false], [46726, 0.037634, " others", false], [21273, 0.023799, " any", false]]]}, "raw_delta": -0.19791666666666674, "tuned_delta": -0.14382706925159117}, {"byte_start": 6662, "byte_end": 6663, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "16.70%", "model_b": "9.23%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.39389297366142273]], "model_b": [[47, ".", "normal", 0.6027293801307678]]}, "loss": {"model_a": 16.69525022903732, "model_b": 9.22817628693624}, "topk": {"model_a": [47, 1, 0.39389297366142273, [[47, 0.393893, ".", false], [45, 0.128652, ",", false], [47629, 0.049454, " trying", false], [57419, 0.036062, " thinking", false], [55666, 0.018745, " building", false], [52157, 0.017178, " looking", false], [60, 0.012904, ";", false], [52614, 0.011, " putting", false], [52087, 0.010164, " knowing", false], [46227, 0.010145, " humans", false]]], "model_b": [47, 1, 0.6027293801307678, [[47, 0.602729, ".", false], [45, 0.101886, ",", false], [46227, 0.04032, " humans", false], [4423, 0.039096, " as", false], [47629, 0.031636, " trying", false], [60, 0.015828, ";", false], [275, 0.008998, " (", false], [40085, 0.008043, " using", false], [60463, 0.007573, " searching", false], [4596, 0.007469, " in", false]]]}, "raw_delta": 0.4140625, "tuned_delta": 0.4681520974150756}, {"byte_start": 6663, "byte_end": 6666, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 1149, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"model_a": "15.59% 15.59% 15.59%", "model_b": "15.97% 15.97% 15.97%"}, "model_tokens": {"model_a": [[4331, " We", "normal", 0.07419870793819427]], "model_b": [[4331, " We", "normal", 0.06958331912755966]]}, "loss": {"model_a": 15.591626092940619, "model_b": 15.967327926505453}, "topk": {"model_a": [4331, 3, 0.07419870793819427, [[261, 0.339053, "\n\n", false], [20996, 0.092401, " The", false], [4331, 0.074199, " We", false], [29894, 0.062721, " This", false], [3913, 0.032627, " In", false], [20571, 0.022018, " Our", false], [37453, 0.020734, " These", false], [3918, 0.01711, " It", false], [19417, 0.014782, " And", false], [44844, 0.013491, " Search", false]]], "model_b": [4331, 3, 0.06958331912755966, [[261, 0.300483, "\n\n", false], [20996, 0.096308, " The", false], [4331, 0.069583, " We", false], [29894, 0.068996, " This", false], [3913, 0.030618, " In", false], [37453, 0.026581, " These", false], [267, 0.018079, "  ", false], [19417, 0.017108, " And", false], [11, 0.015377, "\n", false], [3918, 0.015344, " It", false]]]}, "raw_delta": -0.02083333333333326, "tuned_delta": 0.03325626408174233}, {"byte_start": 6666, "byte_end": 6671, "display": {"text": " want", "kind": "normal"}, "is_word": true, "word_id": 1150, "word_key": " want", "bytes_hex": "20 77 61 6e 74", "compression": {"model_a": "17.02% 17.02% 17.02% 17.02% 17.02%", "model_b": "17.81% 17.81% 17.81% 17.81% 17.81%"}, "model_tokens": {"model_a": [[32435, " want", "normal", 0.008886758238077164]], "model_b": [[32435, " want", "normal", 0.007189247291535139]]}, "loss": {"model_a": 17.019293060486987, "model_b": 17.808266910973142}, "topk": {"model_a": [32435, 10, 0.008886758238077164, [[47266, 0.570663, " should", false], [21286, 0.064686, " are", false], [21413, 0.054047, " can", false], [31059, 0.046024, " have", false], [4491, 0.032473, " do", false], [31475, 0.03148, " must", false], [31506, 0.028998, " need", false], [45409, 0.025182, " cannot", false], [32475, 0.018433, " will", false], [32435, 0.008887, " want", false]]], "model_b": [32435, 12, 0.007189247291535139, [[47266, 0.630574, " should", false], [21286, 0.049952, " are", false], [21413, 0.049179, " can", false], [31059, 0.042266, " have", false], [31506, 0.034601, " need", false], [4491, 0.024134, " do", false], [31475, 0.02027, " must", false], [45409, 0.018247, " cannot", false], [22074, 0.011065, " may", false], [32475, 0.007582, " will", false]]]}, "raw_delta": -0.04375000000000007, "tuned_delta": 0.010339597415075522}, {"byte_start": 6671, "byte_end": 6674, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 1151, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"model_a": "34.19% 34.19% 34.19%", "model_b": "31.37% 31.37% 31.37%"}, "model_tokens": {"model_a": [[3609, " AI", "normal", 0.003392708720639348]], "model_b": [[3609, " AI", "normal", 0.005401396658271551]]}, "loss": {"model_a": 34.18886685439991, "model_b": 31.371103102663653}, "topk": {"model_a": [3609, 20, 0.003392708720639348, [[4811, 0.401271, " to", false], [22248, 0.151508, " our", false], [52224, 0.088485, " methods", false], [22590, 0.065865, " the", false], [332, 0.043564, " a", false], [30992, 0.025533, " good", false], [39936, 0.018421, " these", false], [32229, 0.014171, " them", false], [4419, 0.009503, " an", false], [47202, 0.009064, " search", false]]], "model_b": [3609, 16, 0.005401396658271551, [[4811, 0.340378, " to", false], [52224, 0.132836, " methods", false], [22248, 0.072672, " our", false], [22590, 0.060302, " the", false], [32229, 0.036429, " them", false], [39936, 0.032443, " these", false], [332, 0.02744, " a", false], [51832, 0.015779, " general", false], [31416, 0.014543, " meta", false], [30992, 0.012802, " good", false]]]}, "raw_delta": 0.15625, "tuned_delta": 0.21033959741507557}, {"byte_start": 6674, "byte_end": 6681, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1152, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"model_a": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%", "model_b": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"model_a": [[45124, " agents", "normal", 0.17387990653514862]], "model_b": [[45124, " agents", "normal", 0.12804022431373596]]}, "loss": {"model_a": 4.488295118837037, "model_b": 5.273243592534995}, "topk": {"model_a": [45124, 3, 0.17387990653514862, [[53087, 0.249089, " systems", false], [4811, 0.187299, " to", false], [45124, 0.17388, " agents", false], [52224, 0.147139, " methods", false], [63843, 0.054576, " researchers", false], [57103, 0.040544, " research", false], [32227, 0.031342, " that", false], [116, 0.0199, "s", false], [56949, 0.015795, " programs", false], [45, 0.011397, ",", false]]], "model_b": [45124, 3, 0.12804022431373596, [[4811, 0.325599, " to", false], [52224, 0.160268, " methods", false], [45124, 0.12804, " agents", false], [53087, 0.103678, " systems", false], [57103, 0.089948, " research", false], [63843, 0.067823, " researchers", false], [32227, 0.01213, " that", false], [22187, 0.01172, " not", false], [116, 0.006778, "s", false], [39979, 0.0061, " tools", false]]]}, "raw_delta": -0.04352678571428573, "tuned_delta": 0.010562811700789855}, {"byte_start": 6681, "byte_end": 6686, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1153, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"model_a": "3.32% 3.32% 3.32% 3.32% 3.32%", "model_b": "4.54% 4.54% 4.54% 4.54% 4.54%"}, "model_tokens": {"model_a": [[32227, " that", "normal", 0.40044909715652466]], "model_b": [[32227, " that", "normal", 0.2834429442882538]]}, "loss": {"model_a": 3.324961227048783, "model_b": 4.536599640295373}, "topk": {"model_a": [32227, 2, 0.40044909715652466, [[4811, 0.464835, " to", false], [32227, 0.400449, " that", false], [45, 0.031049, ",", false], [22762, 0.028127, " who", false], [32487, 0.013456, " with", false], [40191, 0.010205, " whose", false], [21265, 0.004849, " and", false], [275, 0.004232, " (", false], [4596, 0.004068, " in", false], [51127, 0.003754, " capable", false]]], "model_b": [32227, 2, 0.2834429442882538, [[4811, 0.549134, " to", false], [32227, 0.283443, " that", false], [45, 0.023855, ",", false], [32487, 0.016307, " with", false], [37924, 0.013614, " built", false], [21265, 0.012173, " and", false], [22187, 0.009831, " not", false], [40191, 0.007915, " whose", false], [37810, 0.007106, " based", false], [4423, 0.005008, " as", false]]]}, "raw_delta": -0.06718750000000001, "tuned_delta": -0.013097902584924423}, {"byte_start": 6686, "byte_end": 6690, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1154, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "4.54% 4.54% 4.54% 4.54%", "model_b": "6.34% 6.34% 6.34% 6.34%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.36886271834373474]], "model_b": [[21413, " can", "normal", 0.24692228436470032]]}, "loss": {"model_a": 4.543644049674714, "model_b": 6.339968441406577}, "topk": {"model_a": [21413, 1, 0.36886271834373474, [[21413, 0.368863, " can", false], [21286, 0.16787, " are", false], [30858, 0.046551, " find", false], [31059, 0.036646, " have", false], [4491, 0.033468, " do", false], [38877, 0.027849, " learn", false], [32475, 0.021242, " will", false], [47202, 0.018657, " search", false], [39942, 0.018343, " think", false], [4858, 0.015148, " we", false]]], "model_b": [21413, 1, 0.24692228436470032, [[21413, 0.246922, " can", false], [21286, 0.210794, " are", false], [4491, 0.041124, " do", false], [22681, 0.03312, " use", false], [31059, 0.029968, " have", false], [38877, 0.028413, " learn", false], [32499, 0.021762, " work", false], [32475, 0.021259, " will", false], [30858, 0.018576, " find", false], [39942, 0.018389, " think", false]]]}, "raw_delta": -0.099609375, "tuned_delta": -0.04551977758492441}, {"byte_start": 6690, "byte_end": 6699, "display": {"text": " discover", "kind": "normal"}, "is_word": true, "word_id": 1155, "word_key": " discover", "bytes_hex": "20 64 69 73 63 6f 76 65 72", "compression": {"model_a": "7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83%", "model_b": "7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51% 7.51%"}, "model_tokens": {"model_a": [[56010, " discover", "normal", 0.020210230723023415]], "model_b": [[56010, " discover", "normal", 0.023604130372405052]]}, "loss": {"model_a": 7.827121532600711, "model_b": 7.514036671296683}, "topk": {"model_a": [56010, 8, 0.020210230723023415, [[30858, 0.271751, " find", false], [38877, 0.074894, " learn", false], [47202, 0.05126, " search", false], [4491, 0.046526, " do", false], [39942, 0.033556, " think", false], [4435, 0.030315, " be", false], [37923, 0.023489, " build", false], [56010, 0.02021, " discover", false], [63292, 0.018048, " approximate", false], [22681, 0.015947, " use", false]]], "model_b": [56010, 9, 0.023604130372405052, [[30858, 0.126856, " find", false], [38877, 0.072631, " learn", false], [4491, 0.0616, " do", false], [39942, 0.047469, " think", false], [4435, 0.044435, " be", false], [22681, 0.039728, " use", false], [47009, 0.031288, " reason", false], [47202, 0.025897, " search", false], [56010, 0.023604, " discover", false], [37923, 0.022824, " build", false]]]}, "raw_delta": 0.017361111111111105, "tuned_delta": 0.0714507085261867}, {"byte_start": 6699, "byte_end": 6704, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 1156, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"model_a": "36.29% 36.29% 36.29% 36.29% 36.29%", "model_b": "32.91% 32.91% 32.91% 32.91% 32.91%"}, "model_tokens": {"model_a": [[31296, " like", "normal", 4.271131911082193e-05]], "model_b": [[31296, " like", "normal", 0.00010660818952601403]]}, "loss": {"model_a": 36.292797122362984, "model_b": 32.91148062027948}, "topk": {"model_a": [31296, 531, 4.271131911082193e-05, [[22590, 0.153616, " the", false], [21265, 0.079406, " and", false], [30992, 0.072583, " good", false], [45, 0.061582, ",", false], [39936, 0.05371, " these", false], [39931, 0.053492, " their", false], [22168, 0.034159, " new", false], [52224, 0.032527, " methods", false], [32464, 0.032322, " what", false], [21835, 0.031038, " how", false]]], "model_b": [31296, 355, 0.00010660818952601403, [[21265, 0.14099, " and", false], [22590, 0.130123, " the", false], [39936, 0.081343, " these", false], [45, 0.043921, ",", false], [51832, 0.038535, " general", false], [39931, 0.034699, " their", false], [32234, 0.033049, " this", false], [59163, 0.025606, " arbitrary", false], [32464, 0.022976, " what", false], [30992, 0.018181, " good", false]]]}, "raw_delta": 0.18750000000000022, "tuned_delta": 0.2415895974150758}, {"byte_start": 6704, "byte_end": 6707, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1157, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "15.31% 15.31% 15.31%", "model_b": "20.10% 20.10% 20.10%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.07806975394487381]], "model_b": [[4858, " we", "normal", 0.035303108394145966]]}, "loss": {"model_a": 15.309849717766994, "model_b": 20.100048095718627}, "topk": {"model_a": [4858, 3, 0.07806975394487381, [[4835, 0.405959, " us", false], [32234, 0.104065, " this", false], [4858, 0.07807, " we", false], [46227, 0.065164, " humans", false], [46, 0.050487, "-", false], [26307, 0.028313, "ness", false], [22590, 0.02622, " the", false], [52224, 0.024994, " methods", false], [38720, 0.024662, " human", false], [22248, 0.015617, " our", false]]], "model_b": [4858, 5, 0.035303108394145966, [[46, 0.098422, "-", false], [22590, 0.084608, " the", false], [46227, 0.07663, " humans", false], [332, 0.045861, " a", false], [4858, 0.035303, " we", false], [32234, 0.035123, " this", false], [4835, 0.026458, " us", false], [38720, 0.016619, " human", false], [21273, 0.014751, " any", false], [60112, 0.014718, " ourselves", false]]]}, "raw_delta": -0.2656249999999999, "tuned_delta": -0.21153540258492431}, {"byte_start": 6707, "byte_end": 6711, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1158, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "14.02% 14.02% 14.02% 14.02%", "model_b": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.04430075362324715]], "model_b": [[21413, " can", "normal", 0.07588315010070801]]}, "loss": {"model_a": 14.018374664887876, "model_b": 11.623275475912058}, "topk": {"model_a": [21413, 3, 0.04430075362324715, [[4491, 0.835724, " do", false], [56010, 0.045945, " discover", false], [21413, 0.044301, " can", false], [31059, 0.014708, " have", false], [21532, 0.010558, " did", false], [46227, 0.009851, " humans", false], [40219, 0.005348, " would", false], [60112, 0.002919, " ourselves", false], [39021, 0.002612, " might", false], [61885, 0.002538, " discovered", false]]], "model_b": [21413, 3, 0.07588315010070801, [[4491, 0.352417, " do", false], [56010, 0.312373, " discover", false], [21413, 0.075883, " can", false], [30858, 0.044453, " find", false], [46227, 0.018916, " humans", false], [40219, 0.017476, " would", false], [21532, 0.013869, " did", false], [61885, 0.013184, " discovered", false], [31059, 0.01273, " have", false], [22449, 0.011261, " see", false]]]}, "raw_delta": 0.1328125, "tuned_delta": 0.18690209741507557}, {"byte_start": 6711, "byte_end": 6712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"model_a": "11.27%", "model_b": "22.54%"}, "model_tokens": {"model_a": [[45, ",", "normal", 0.5405202507972717]], "model_b": [[45, ",", "normal", 0.2890419661998749]]}, "loss": {"model_a": 11.271055006945026, "model_b": 22.542110013890053}, "topk": {"model_a": [45, 1, 0.5405202507972717, [[45, 0.54052, ",", false], [47, 0.162355, ".", false], [56010, 0.068789, " discover", false], [5346, 0.058311, "---", false], [60, 0.035383, ";", false], [21265, 0.019231, " and", false], [59, 0.016769, ":", false], [4596, 0.013378, " in", false], [275, 0.007809, " (", false], [22590, 0.005136, " the", false]]], "model_b": [45, 1, 0.2890419661998749, [[45, 0.289042, ",", false], [56010, 0.209486, " discover", false], [47, 0.119284, ".", false], [30858, 0.078899, " find", false], [60, 0.034697, ";", false], [4596, 0.020341, " in", false], [21265, 0.018861, " and", false], [47202, 0.013848, " search", false], [39942, 0.013234, " think", false], [22449, 0.012177, " see", false]]]}, "raw_delta": -0.625, "tuned_delta": -0.5709104025849244}, {"byte_start": 6712, "byte_end": 6716, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1159, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"model_a": "7.82% 7.82% 7.82% 7.82%", "model_b": "11.41% 11.41% 11.41% 11.41%"}, "model_tokens": {"model_a": [[22187, " not", "normal", 0.17512939870357513]], "model_b": [[22187, " not", "normal", 0.08069377392530441]]}, "loss": {"model_a": 7.819294411068111, "model_b": 11.411943194531839}, "topk": {"model_a": [22187, 2, 0.17512939870357513, [[21265, 0.190424, " and", false], [22187, 0.175129, " not", false], [21400, 0.152519, " but", false], [47001, 0.042702, " rather", false], [32227, 0.042439, " that", false], [4450, 0.039707, " by", false], [4596, 0.027738, " in", false], [4788, 0.02235, " so", false], [4715, 0.021353, " or", false], [53356, 0.020909, " without", false]]], "model_b": [22187, 3, 0.08069377392530441, [[21400, 0.323052, " but", false], [21265, 0.184992, " and", false], [22187, 0.080694, " not", false], [4450, 0.043472, " by", false], [32227, 0.042436, " that", false], [4596, 0.026953, " in", false], [4715, 0.022931, " or", false], [53356, 0.022919, " without", false], [47001, 0.019048, " rather", false], [4423, 0.014045, " as", false]]]}, "raw_delta": -0.19921875, "tuned_delta": -0.14512915258492443}, {"byte_start": 6716, "byte_end": 6722, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 1160, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"model_a": "21.23% 21.23% 21.23% 21.23% 21.23% 21.23%", "model_b": "24.80% 24.80% 24.80% 24.80% 24.80% 24.80%"}, "model_tokens": {"model_a": [[40186, " which", "normal", 0.0008482365519739687]], "model_b": [[40186, " which", "normal", 0.00026276372955180705]]}, "loss": {"model_a": 21.22715359641313, "model_b": 24.796321015279055}, "topk": {"model_a": [40186, 52, 0.0008482365519739687, [[31296, 0.336947, " like", false], [32227, 0.20722, " that", false], [31198, 0.044844, " just", false], [3609, 0.043916, " AI", false], [56010, 0.042039, " discover", false], [45124, 0.040443, " agents", false], [31580, 0.035014, " ones", false], [4450, 0.019381, " by", false], [22590, 0.014692, " the", false], [4835, 0.014163, " us", false]]], "model_b": [40186, 118, 0.00026276372955180705, [[31296, 0.455174, " like", false], [32227, 0.091195, " that", false], [22590, 0.058147, " the", false], [4450, 0.028813, " by", false], [4423, 0.020843, " as", false], [56010, 0.019964, " discover", false], [4811, 0.015832, " to", false], [31198, 0.01414, " just", false], [4835, 0.013856, " us", false], [38720, 0.011784, " human", false]]]}, "raw_delta": -0.19791666666666674, "tuned_delta": -0.14382706925159117}, {"byte_start": 6722, "byte_end": 6730, "display": {"text": " contain", "kind": "normal"}, "is_word": true, "word_id": 1161, "word_key": " contain", "bytes_hex": "20 63 6f 6e 74 61 69 6e", "compression": {"model_a": "19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58%", "model_b": "24.37% 24.37% 24.37% 24.37% 24.37% 24.37% 24.37% 24.37%"}, "model_tokens": {"model_a": [[51306, " contain", "normal", 0.00016801267338450998]], "model_b": [[51306, " contain", "normal", 1.960609915840905e-05]]}, "loss": {"model_a": 19.58345807456698, "model_b": 24.373656452518617}, "topk": {"model_a": [51306, 162, 0.00016801267338450998, [[4858, 0.439659, " we", false], [21413, 0.177438, " can", false], [4706, 0.039156, " of", false], [22752, 0.037556, " way", false], [31580, 0.020576, " ones", false], [31296, 0.018933, " like", false], [39239, 0.016602, " parts", false], [21286, 0.016067, " are", false], [32448, 0.01186, " ways", false], [47539, 0.008937, " things", false]]], "model_b": [51306, 643, 1.960609915840905e-05, [[4858, 0.573315, " we", false], [31296, 0.133563, " like", false], [32232, 0.034744, " they", false], [22752, 0.018644, " way", false], [21413, 0.017571, " can", false], [4600, 0.017338, " is", false], [4706, 0.015058, " of", false], [21286, 0.014754, " are", false], [52224, 0.013452, " methods", false], [31580, 0.008656, " ones", false]]]}, "raw_delta": -0.265625, "tuned_delta": -0.21153540258492443}, {"byte_start": 6730, "byte_end": 6735, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1162, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"model_a": "10.82% 10.82% 10.82% 10.82% 10.82%", "model_b": "15.10% 15.10% 15.10% 15.10% 15.10%"}, "model_tokens": {"model_a": [[32464, " what", "normal", 0.04939144477248192]], "model_b": [[32464, " what", "normal", 0.015182634815573692]]}, "loss": {"model_a": 10.820212806667223, "model_b": 15.103213709306335}, "topk": {"model_a": [32464, 5, 0.04939144477248192, [[31296, 0.520295, " like", false], [22248, 0.096427, " our", false], [22590, 0.063157, " the", false], [59943, 0.05299, " knowledge", false], [32464, 0.049391, " what", false], [4596, 0.01953, " in", false], [38720, 0.015024, " human", false], [4835, 0.014422, " us", false], [32227, 0.011941, " that", false], [4601, 0.011006, " it", false]]], "model_b": [32464, 11, 0.015182634815573692, [[31296, 0.225525, " like", false], [22248, 0.111414, " our", false], [22590, 0.106017, " the", false], [332, 0.044817, " a", false], [32139, 0.042281, " such", false], [32074, 0.022443, " some", false], [59943, 0.020157, " knowledge", false], [32234, 0.018146, " this", false], [38720, 0.017949, " human", false], [4835, 0.015555, " us", false]]]}, "raw_delta": -0.23750000000000004, "tuned_delta": -0.18341040258492447}, {"byte_start": 6735, "byte_end": 6738, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1163, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"model_a": "1.03% 1.03% 1.03%", "model_b": "3.90% 3.90% 3.90%"}, "model_tokens": {"model_a": [[4858, " we", "normal", 0.8416891098022461]], "model_b": [[4858, " we", "normal", 0.5201384425163269]]}, "loss": {"model_a": 1.033180042303294, "model_b": 3.8979065232351546}, "topk": {"model_a": [4858, 1, 0.8416891098022461, [[4858, 0.841689, " we", false], [31296, 0.051954, " like", false], [47, 0.012044, ".", false], [4600, 0.009299, " is", false], [22248, 0.007853, " our", false], [21413, 0.006039, " can", false], [22590, 0.004134, " the", false], [46227, 0.004081, " humans", false], [45, 0.003882, ",", false], [32232, 0.003829, " they", false]]], "model_b": [4858, 1, 0.5201384425163269, [[4858, 0.520138, " we", false], [31296, 0.150877, " like", false], [47, 0.062803, ".", false], [31214, 0.023393, " kind", false], [45, 0.021114, ",", false], [4600, 0.019552, " is", false], [21286, 0.009734, " are", false], [38720, 0.006117, " human", false], [38841, 0.005754, " kinds", false], [59943, 0.005233, " knowledge", false]]]}, "raw_delta": -0.15885416666666669, "tuned_delta": -0.1047645692515911}, {"byte_start": 6738, "byte_end": 6743, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 1164, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"model_a": "9.75% 9.75% 9.75% 9.75% 9.75%", "model_b": "10.71% 10.71% 10.71% 10.71% 10.71%"}, "model_tokens": {"model_a": [[31059, " have", "normal", 0.06702268868684769]], "model_b": [[31059, " have", "normal", 0.051535069942474365]]}, "loss": {"model_a": 9.749462581007448, "model_b": 10.707502256597774}, "topk": {"model_a": [31059, 5, 0.06702268868684769, [[21413, 0.199723, " can", false], [39942, 0.152266, " think", false], [31223, 0.147158, " know", false], [4491, 0.07182, " do", false], [31059, 0.067023, " have", false], [31296, 0.04986, " like", false], [32435, 0.029523, " want", false], [50888, 0.022951, " already", false], [51025, 0.018259, " believe", false], [39021, 0.017775, " might", false]]], "model_b": [31059, 4, 0.051535069942474365, [[32435, 0.26411, " want", false], [39942, 0.219942, " think", false], [31296, 0.098017, " like", false], [31059, 0.051535, " have", false], [30858, 0.04383, " find", false], [51025, 0.025439, " believe", false], [21413, 0.021277, " can", false], [40219, 0.019873, " would", false], [31223, 0.018523, " know", false], [32486, 0.014993, " wish", false]]]}, "raw_delta": -0.05312499999999998, "tuned_delta": 0.0009645974150756104}, {"byte_start": 6743, "byte_end": 6754, "display": {"text": " discovered", "kind": "normal"}, "is_word": true, "word_id": 1165, "word_key": " discovered", "bytes_hex": "20 64 69 73 63 6f 76 65 72 65 64", "compression": {"model_a": "2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83%", "model_b": "2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27% 2.27%"}, "model_tokens": {"model_a": [[61885, " discovered", "normal", 0.17997170984745026]], "model_b": [[61885, " discovered", "normal", 0.24874432384967804]]}, "loss": {"model_a": 2.830571768789603, "model_b": 2.2670190184423515}, "topk": {"model_a": [61885, 1, 0.17997170984745026, [[61885, 0.179972, " discovered", false], [47, 0.132954, ".", false], [4596, 0.084884, " in", false], [52112, 0.081874, " learned", false], [50888, 0.064199, " already", false], [53137, 0.047147, " thought", false], [4811, 0.032717, " to", false], [38547, 0.031827, " found", false], [22339, 0.029411, " put", false], [45, 0.02099, ",", false]]], "model_b": [61885, 1, 0.24874432384967804, [[61885, 0.248744, " discovered", false], [37924, 0.084991, " built", false], [47, 0.078684, ".", false], [4596, 0.072541, " in", false], [52112, 0.069173, " learned", false], [38547, 0.04662, " found", false], [53137, 0.036707, " thought", false], [50888, 0.022666, " already", false], [4811, 0.022109, " to", false], [56492, 0.01854, " invented", false]]]}, "raw_delta": 0.03125, "tuned_delta": 0.08533959741507559}, {"byte_start": 6754, "byte_end": 6755, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "5.64%", "model_b": "5.67%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.730880081653595]], "model_b": [[47, ".", "normal", 0.7287857532501221]]}, "loss": {"model_a": 5.635527503472513, "model_b": 5.670749550369216}, "topk": {"model_a": [47, 1, 0.730880081653595, [[47, 0.73088, ".", false], [45, 0.069008, ",", false], [31296, 0.032315, " like", false], [4596, 0.023469, " in", false], [21700, 0.018851, " for", false], [21265, 0.017739, " and", false], [50888, 0.011498, " already", false], [60, 0.010665, ";", false], [5346, 0.00961, "---", false], [60112, 0.009043, " ourselves", false]]], "model_b": [47, 1, 0.7287857532501221, [[47, 0.728786, ".", false], [45, 0.101784, ",", false], [4788, 0.018202, " so", false], [4596, 0.01634, " in", false], [37598, 0.01219, " about", false], [60, 0.012096, ";", false], [21265, 0.011765, " and", false], [31296, 0.010456, " like", false], [4715, 0.008238, " or", false], [275, 0.007451, " (", false]]]}, "raw_delta": -0.001953125, "tuned_delta": 0.05213647241507559}, {"byte_start": 6755, "byte_end": 6764, "display": {"text": " Building", "kind": "normal"}, "is_word": true, "word_id": 1166, "word_key": " building", "bytes_hex": "20 42 75 69 6c 64 69 6e 67", "compression": {"model_a": "13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%", "model_b": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%"}, "model_tokens": {"model_a": [[54879, " Building", "normal", 0.0012474644463509321]], "model_b": [[54879, " Building", "normal", 0.0011506275041028857]]}, "loss": {"model_a": 13.400032063812418, "model_b": 13.52526600833403}, "topk": {"model_a": [54879, 47, 0.0012474644463509321, [[261, 0.495125, "\n\n", false], [4331, 0.064093, " We", false], [20996, 0.062812, " The", false], [29894, 0.053125, " This", false], [19417, 0.017577, " And", false], [3913, 0.017541, " In", false], [0, 0.016396, "[0]", false], [20571, 0.013531, " Our", false], [3918, 0.012535, " It", false], [37453, 0.012277, " These", false]]], "model_b": [54879, 47, 0.0011506275041028857, [[261, 0.390897, "\n\n", false], [4331, 0.105886, " We", false], [29894, 0.072985, " This", false], [20996, 0.062186, " The", false], [3913, 0.024141, " In", false], [19417, 0.019491, " And", false], [11, 0.015856, "\n", false], [267, 0.013909, "  ", false], [29889, 0.013428, " That", false], [3918, 0.011811, " It", false]]]}, "raw_delta": -0.00694444444444442, "tuned_delta": 0.04714515297063117}, {"byte_start": 6764, "byte_end": 6767, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1167, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"model_a": "4.72% 4.72% 4.72%", "model_b": "3.66% 3.66% 3.66%"}, "model_tokens": {"model_a": [[4596, " in", "normal", 0.45493388175964355]], "model_b": [[4596, " in", "normal", 0.5395276546478271]]}, "loss": {"model_a": 4.719754284158229, "model_b": 3.6630928772571334}, "topk": {"model_a": [4596, 1, 0.45493388175964355, [[4596, 0.454934, " in", false], [3609, 0.060028, " AI", false], [52224, 0.053594, " methods", false], [39936, 0.043946, " these", false], [32139, 0.038988, " such", false], [32234, 0.031919, " this", false], [22248, 0.029905, " our", false], [31162, 0.018893, " into", false], [22590, 0.018609, " the", false], [332, 0.016126, " a", false]]], "model_b": [4596, 1, 0.5395276546478271, [[4596, 0.539528, " in", false], [32139, 0.044973, " such", false], [52224, 0.038377, " methods", false], [39936, 0.030221, " these", false], [332, 0.027408, " a", false], [3609, 0.024307, " AI", false], [22590, 0.015138, " the", false], [31162, 0.014289, " into", false], [59943, 0.012318, " knowledge", false], [32229, 0.012038, " them", false]]]}, "raw_delta": 0.05859375, "tuned_delta": 0.11268334741507559}, {"byte_start": 6767, "byte_end": 6771, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1168, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"model_a": "7.36% 7.36% 7.36% 7.36%", "model_b": "12.33% 12.33% 12.33% 12.33%"}, "model_tokens": {"model_a": [[22248, " our", "normal", 0.19305700063705444]], "model_b": [[22248, " our", "normal", 0.0645064190030098]]}, "loss": {"model_a": 7.361407801410969, "model_b": 12.327716413846122}, "topk": {"model_a": [22248, 1, 0.19305700063705444, [[22248, 0.193057, " our", false], [38720, 0.152005, " human", false], [32464, 0.10019, " what", false], [22590, 0.094854, " the", false], [59943, 0.08423, " knowledge", false], [21835, 0.052755, " how", false], [332, 0.029623, " a", false], [32234, 0.019984, " this", false], [39936, 0.017865, " these", false], [32139, 0.011579, " such", false]]], "model_b": [22248, 3, 0.0645064190030098, [[59943, 0.088358, " knowledge", false], [22590, 0.07409, " the", false], [22248, 0.064506, " our", false], [32139, 0.056225, " such", false], [39936, 0.051963, " these", false], [38720, 0.051076, " human", false], [59163, 0.038897, " arbitrary", false], [52224, 0.038269, " methods", false], [32234, 0.03678, " this", false], [332, 0.033384, " a", false]]]}, "raw_delta": -0.275390625, "tuned_delta": -0.22130102758492443}, {"byte_start": 6771, "byte_end": 6783, "display": {"text": " discoveries", "kind": "normal"}, "is_word": true, "word_id": 1169, "word_key": " discoveries", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 65 73", "compression": {"model_a": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "model_b": "10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75% 10.75%"}, "model_tokens": {"model_a": [[63484, " discoveries", "normal", 0.0057210191152989864]], "model_b": [[63484, " discoveries", "normal", 0.0007805246277712286]]}, "loss": {"model_a": 7.748850317274705, "model_b": 10.75446498579338}, "topk": {"model_a": [63484, 20, 0.0057210191152989864, [[59943, 0.27628, " knowledge", false], [22251, 0.116928, " own", false], [65034, 0.054143, " understanding", false], [38720, 0.05239, " human", false], [52224, 0.035159, " methods", false], [39026, 0.02814, " minds", false], [38735, 0.025784, " ideas", false], [32448, 0.021135, " ways", false], [57422, 0.015526, " thoughts", false], [57419, 0.014949, " thinking", false]]], "model_b": [63484, 95, 0.0007805246277712286, [[52224, 0.236164, " methods", false], [22251, 0.147148, " own", false], [59943, 0.12182, " knowledge", false], [38720, 0.036992, " human", false], [31416, 0.0365, " meta", false], [65034, 0.024606, " understanding", false], [32448, 0.016313, " ways", false], [46545, 0.0132, " mental", false], [46561, 0.013088, " method", false], [31427, 0.013084, " mind", false]]]}, "raw_delta": -0.1666666666666666, "tuned_delta": -0.11257706925159101}, {"byte_start": 6783, "byte_end": 6788, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1170, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"model_a": "19.16% 19.16% 19.16% 19.16% 19.16%", "model_b": "20.29% 20.29% 20.29% 20.29% 20.29%"}, "model_tokens": {"model_a": [[31581, " only", "normal", 0.0048307329416275024]], "model_b": [[31581, " only", "normal", 0.003631850006058812]]}, "loss": {"model_a": 19.160793511806542, "model_b": 20.287899012501047}, "topk": {"model_a": [31581, 26, 0.0048307329416275024, [[4600, 0.244198, " is", false], [4706, 0.158148, " of", false], [45, 0.077005, ",", false], [37598, 0.063804, " about", false], [30659, 0.038105, " does", false], [21265, 0.033634, " and", false], [32475, 0.032491, " will", false], [4811, 0.024898, " to", false], [4596, 0.017436, " in", false], [4423, 0.016009, " as", false]]], "model_b": [31581, 27, 0.003631850006058812, [[4600, 0.331937, " is", false], [45, 0.079242, ",", false], [4811, 0.059643, " to", false], [47266, 0.050476, " should", false], [32475, 0.037996, " will", false], [21265, 0.035739, " and", false], [4706, 0.035516, " of", false], [31162, 0.029175, " into", false], [4423, 0.023905, " as", false], [275, 0.019076, " (", false]]]}, "raw_delta": -0.0625, "tuned_delta": -0.008410402584924412}, {"byte_start": 6788, "byte_end": 6794, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 1171, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"model_a": "6.15% 6.15% 6.15% 6.15% 6.15% 6.15%", "model_b": "5.68% 5.68% 5.68% 5.68% 5.68% 5.68%"}, "model_tokens": {"model_a": [[38964, " makes", "normal", 0.12994173169136047]], "model_b": [[38964, " makes", "normal", 0.1504160612821579]]}, "loss": {"model_a": 6.15211752462416, "model_b": 5.682490232668117}, "topk": {"model_a": [38964, 1, 0.12994173169136047, [[38964, 0.129942, " makes", false], [38875, 0.107182, " leads", false], [40212, 0.035878, " works", false], [30965, 0.026222, " gets", false], [39719, 0.025822, " slows", false], [46441, 0.025509, " limits", false], [30109, 0.022043, " adds", false], [47237, 0.019422, " serves", false], [45691, 0.018412, " delays", false], [38989, 0.017752, " means", false]]], "model_b": [38964, 1, 0.1504160612821579, [[38964, 0.150416, " makes", false], [38875, 0.056091, " leads", false], [4811, 0.034148, " to", false], [40212, 0.027159, " works", false], [30109, 0.025677, " adds", false], [59847, 0.025392, " increases", false], [47237, 0.023039, " serves", false], [47769, 0.022996, " wastes", false], [32465, 0.016544, " when", false], [38686, 0.01638, " helps", false]]]}, "raw_delta": 0.02604166666666663, "tuned_delta": 0.08013126408174222}, {"byte_start": 6794, "byte_end": 6797, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 1172, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"model_a": "11.04% 11.04% 11.04%", "model_b": "12.49% 12.49% 12.49%"}, "model_tokens": {"model_a": [[4601, " it", "normal", 0.15805332362651825]], "model_b": [[4601, " it", "normal", 0.12644612789154053]]}, "loss": {"model_a": 11.036241360967004, "model_b": 12.492085966030738}, "topk": {"model_a": [4601, 2, 0.15805332362651825, [[22590, 0.195645, " the", false], [4601, 0.158053, " it", false], [32229, 0.110917, " them", false], [47539, 0.109523, " things", false], [4835, 0.099885, " us", false], [22248, 0.060683, " our", false], [21700, 0.051691, " for", false], [32234, 0.032858, " this", false], [39936, 0.014263, " these", false], [39931, 0.013189, " their", false]]], "model_b": [4601, 3, 0.12644612789154053, [[32229, 0.254589, " them", false], [22590, 0.20988, " the", false], [4601, 0.126446, " it", false], [47539, 0.077772, " things", false], [22248, 0.050657, " our", false], [4835, 0.050341, " us", false], [32234, 0.030213, " this", false], [3609, 0.029523, " AI", false], [39936, 0.013351, " these", false], [52201, 0.012807, " matters", false]]]}, "raw_delta": -0.08072916666666674, "tuned_delta": -0.026639569251591153}, {"byte_start": 6797, "byte_end": 6804, "display": {"text": " harder", "kind": "normal"}, "is_word": true, "word_id": 1173, "word_key": " harder", "bytes_hex": "20 68 61 72 64 65 72", "compression": {"model_a": "1.46% 1.46% 1.46% 1.46% 1.46% 1.46% 1.46%", "model_b": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"model_a": [[46162, " harder", "normal", 0.5653967261314392]], "model_b": [[46162, " harder", "normal", 0.559077799320221]]}, "loss": {"model_a": 1.4591990857205617, "model_b": 1.4893894116320212}, "topk": {"model_a": [46162, 1, 0.5653967261314392, [[46162, 0.565397, " harder", false], [31458, 0.125876, " more", false], [45819, 0.054833, " easier", false], [31048, 0.044501, " hard", false], [59516, 0.027494, " difficult", false], [62082, 0.024767, " impossible", false], [40216, 0.015173, " worse", false], [31277, 0.013237, " less", false], [56895, 0.01245, " possible", false], [30788, 0.010421, " even", false]]], "model_b": [46162, 1, 0.559077799320221, [[46162, 0.559078, " harder", false], [31458, 0.195937, " more", false], [40216, 0.033581, " worse", false], [31048, 0.028091, " hard", false], [45819, 0.023452, " easier", false], [59516, 0.019225, " difficult", false], [31466, 0.019204, " much", false], [31277, 0.013823, " less", false], [30788, 0.013775, " even", false], [62082, 0.010114, " impossible", false]]]}, "raw_delta": -0.001674107142857137, "tuned_delta": 0.05241549027221845}, {"byte_start": 6804, "byte_end": 6807, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1174, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"model_a": "3.10% 3.10% 3.10%", "model_b": "3.57% 3.57% 3.57%"}, "model_tokens": {"model_a": [[4811, " to", "normal", 0.5958136320114136]], "model_b": [[4811, " to", "normal", 0.5526409149169922]]}, "loss": {"model_a": 3.099540126909882, "model_b": 3.5691674188659244}, "topk": {"model_a": [4811, 1, 0.5958136320114136, [[4811, 0.595814, " to", false], [21700, 0.310559, " for", false], [21265, 0.029345, " and", false], [45, 0.026034, ",", false], [47, 0.012896, ".", false], [38869, 0.005779, " later", false], [4596, 0.005435, " in", false], [4712, 0.001629, " on", false], [22187, 0.001515, " not", false], [275, 0.000943, " (", false]]], "model_b": [4811, 1, 0.5526409149169922, [[4811, 0.552641, " to", false], [45, 0.152112, ",", false], [21700, 0.116023, " for", false], [47, 0.089906, ".", false], [21265, 0.027325, " and", false], [60, 0.019381, ";", false], [32226, 0.006359, " than", false], [5346, 0.005573, "---", false], [4596, 0.004557, " in", false], [51018, 0.003318, " because", false]]]}, "raw_delta": -0.026041666666666657, "tuned_delta": 0.02804793074840893}, {"byte_start": 6807, "byte_end": 6811, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 1175, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"model_a": "20.99% 20.99% 20.99% 20.99%", "model_b": "29.16% 29.16% 29.16% 29.16%"}, "model_tokens": {"model_a": [[22449, " see", "normal", 0.009379914030432701]], "model_b": [[22449, " see", "normal", 0.0015698439674451947]]}, "loss": {"model_a": 20.99233995043511, "model_b": 29.163854830470253}, "topk": {"model_a": [22449, 11, 0.009379914030432701, [[30858, 0.344819, " find", false], [56010, 0.330564, " discover", false], [31358, 0.039878, " make", false], [37923, 0.038278, " build", false], [4491, 0.02211, " do", false], [38877, 0.017383, " learn", false], [55851, 0.013285, " continue", false], [21751, 0.012672, " get", false], [31205, 0.011139, " keep", false], [39590, 0.01102, " scale", false]]], "model_b": [22449, 35, 0.0015698439674451947, [[56010, 0.369328, " discover", false], [30858, 0.214237, " find", false], [37923, 0.093945, " build", false], [4491, 0.059129, " do", false], [38877, 0.02745, " learn", false], [31358, 0.016732, " make", false], [50848, 0.010805, " achieve", false], [21751, 0.009958, " get", false], [51133, 0.009385, " capture", false], [22681, 0.007382, " use", false]]]}, "raw_delta": -0.453125, "tuned_delta": -0.3990354025849244}, {"byte_start": 6811, "byte_end": 6815, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 1176, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"model_a": "10.99% 10.99% 10.99% 10.99%", "model_b": "10.21% 10.21% 10.21% 10.21%"}, "model_tokens": {"model_a": [[21835, " how", "normal", 0.0870790183544159]], "model_b": [[21835, " how", "normal", 0.10259241610765457]]}, "loss": {"model_a": 10.9892786317714, "model_b": 10.214393600043929}, "topk": {"model_a": [21835, 4, 0.0870790183544159, [[22590, 0.220887, " the", false], [32464, 0.159291, " what", false], [32229, 0.122784, " them", false], [21835, 0.087079, " how", false], [22168, 0.050593, " new", false], [32227, 0.028315, " that", false], [21265, 0.024995, " and", false], [22248, 0.022659, " our", false], [51816, 0.019781, " further", false], [39936, 0.018033, " these", false]]], "model_b": [21835, 3, 0.10259241610765457, [[32464, 0.273792, " what", false], [22590, 0.196324, " the", false], [21835, 0.102592, " how", false], [40185, 0.051778, " where", false], [32227, 0.049429, " that", false], [32229, 0.041989, " them", false], [21265, 0.031436, " and", false], [39931, 0.017872, " their", false], [45, 0.016357, ",", false], [4588, 0.014694, " if", false]]]}, "raw_delta": 0.04296875, "tuned_delta": 0.09705834741507559}, {"byte_start": 6815, "byte_end": 6819, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1177, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"model_a": "11.27% 11.27% 11.27% 11.27%", "model_b": "11.98% 11.98% 11.98% 11.98%"}, "model_tokens": {"model_a": [[22590, " the", "normal", 0.08182871341705322]], "model_b": [[22590, " the", "normal", 0.07069667428731918]]}, "loss": {"model_a": 11.271055006945026, "model_b": 11.97549594487909}, "topk": {"model_a": [22590, 2, 0.08182871341705322, [[4811, 0.492341, " to", false], [22590, 0.081829, " the", false], [32232, 0.076447, " they", false], [4858, 0.075743, " we", false], [22248, 0.049603, " our", false], [31466, 0.032162, " much", false], [39936, 0.016714, " these", false], [3609, 0.011668, " AI", false], [39944, 0.011616, " those", false], [21660, 0.00751, " far", false]]], "model_b": [22590, 4, 0.07069667428731918, [[4811, 0.278216, " to", false], [32232, 0.182754, " they", false], [4858, 0.087238, " we", false], [22590, 0.070697, " the", false], [22248, 0.046883, " our", false], [39936, 0.026123, " these", false], [32234, 0.017958, " this", false], [21265, 0.016927, " and", false], [31466, 0.010399, " much", false], [3609, 0.010355, " AI", false]]]}, "raw_delta": -0.0390625, "tuned_delta": 0.015027097415075588}, {"byte_start": 6819, "byte_end": 6831, "display": {"text": " discovering", "kind": "normal"}, "is_word": true, "word_id": 1178, "word_key": " discovering", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 6e 67", "compression": {"model_a": "11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18%", "model_b": "11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08% 11.08%"}, "model_tokens": {"model_a": [[63485, " discovering", "normal", 0.0005939074908383191]], "model_b": [[63485, " discovering", "normal", 0.0006235298351384699]]}, "loss": {"model_a": 11.177129548553818, "model_b": 11.083204090162607}, "topk": {"model_a": [63485, 113, 0.0005939074908383191, [[37636, 0.196601, " agent", false], [40213, 0.071975, " world", false], [45124, 0.064665, " agents", false], [3609, 0.052615, " AI", false], [52224, 0.049005, " methods", false], [63484, 0.043441, " discoveries", false], [59544, 0.038573, " discovery", false], [31427, 0.034552, " mind", false], [52391, 0.024791, " outside", false], [31835, 0.018326, " real", false]]], "model_b": [63485, 147, 0.0006235298351384699, [[63484, 0.09845, " discoveries", false], [59544, 0.089199, " discovery", false], [37636, 0.060225, " agent", false], [40213, 0.05665, " world", false], [52224, 0.045301, " methods", false], [3609, 0.03067, " AI", false], [45124, 0.028949, " agents", false], [61885, 0.027659, " discovered", false], [31416, 0.024194, " meta", false], [52391, 0.023713, " outside", false]]]}, "raw_delta": 0.005208333333333259, "tuned_delta": 0.05929793074840885}, {"byte_start": 6831, "byte_end": 6839, "display": {"text": " process", "kind": "normal"}, "is_word": true, "word_id": 1179, "word_key": " process", "bytes_hex": "20 70 72 6f 63 65 73 73", "compression": {"model_a": "7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01%", "model_b": "5.25% 5.25% 5.25% 5.25% 5.25% 5.25% 5.25% 5.25%"}, "model_tokens": {"model_a": [[52571, " process", "normal", 0.04456682130694389]], "model_b": [[52571, " process", "normal", 0.09781959652900696]]}, "loss": {"model_a": 7.009187332443938, "model_b": 5.248084987608777}, "topk": {"model_a": [52571, 4, 0.04456682130694389, [[37636, 0.17422, " agent", false], [4600, 0.127275, " is", false], [21413, 0.088979, " can", false], [52571, 0.044567, " process", false], [22748, 0.034697, " was", false], [51896, 0.031748, " happens", false], [45124, 0.030507, " agents", false], [52224, 0.027709, " methods", false], [40212, 0.026038, " works", false], [38128, 0.024057, " could", false]]], "model_b": [52571, 2, 0.09781959652900696, [[21413, 0.115633, " can", false], [52571, 0.09782, " process", false], [4600, 0.091025, " is", false], [52224, 0.075582, " methods", false], [37636, 0.070996, " agent", false], [46561, 0.045247, " method", false], [51896, 0.037193, " happens", false], [3609, 0.036474, " AI", false], [21265, 0.023193, " and", false], [40212, 0.021397, " works", false]]]}, "raw_delta": 0.09765625, "tuned_delta": 0.15174584741507557}, {"byte_start": 6839, "byte_end": 6843, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1180, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"model_a": "8.38% 8.38% 8.38% 8.38%", "model_b": "10.57% 10.57% 10.57% 10.57%"}, "model_tokens": {"model_a": [[21413, " can", "normal", 0.15695399045944214]], "model_b": [[21413, " can", "normal", 0.09757031500339508]]}, "loss": {"model_a": 8.382847161415363, "model_b": 10.566614069010962}, "topk": {"model_a": [21413, 2, 0.15695399045944214, [[40212, 0.273946, " works", false], [21413, 0.156954, " can", false], [46342, 0.129513, " itself", false], [38128, 0.071819, " could", false], [39021, 0.063477, " might", false], [4600, 0.050706, " is", false], [47266, 0.02204, " should", false], [22074, 0.016739, " may", false], [55448, 0.014839, " actually", false], [40219, 0.013969, " would", false]]], "model_b": [21413, 3, 0.09757031500339508, [[40212, 0.382169, " works", false], [4600, 0.101876, " is", false], [21413, 0.09757, " can", false], [46342, 0.073217, " itself", false], [47266, 0.054673, " should", false], [55448, 0.041218, " actually", false], [38128, 0.026932, " could", false], [39021, 0.021897, " might", false], [22074, 0.011382, " may", false], [30868, 0.010295, " fits", false]]]}, "raw_delta": -0.12109375, "tuned_delta": -0.06700415258492441}, {"byte_start": 6843, "byte_end": 6846, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1181, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"model_a": "4.72% 4.72% 4.72%", "model_b": "2.98% 2.98% 2.98%"}, "model_tokens": {"model_a": [[4435, " be", "normal", 0.45496514439582825]], "model_b": [[4435, " be", "normal", 0.6121557354927063]]}, "loss": {"model_a": 4.719754284158229, "model_b": 2.9821333039208713}, "topk": {"model_a": [4435, 1, 0.45496514439582825, [[4435, 0.454965, " be", false], [32499, 0.110847, " work", false], [55851, 0.059037, " continue", false], [52570, 0.054745, " proceed", false], [39590, 0.034829, " scale", false], [4559, 0.034412, " go", false], [46342, 0.020426, " itself", false], [46159, 0.015287, " happen", false], [30858, 0.013899, " find", false], [39166, 0.010863, " occur", false]]], "model_b": [4435, 1, 0.6121557354927063, [[4435, 0.612156, " be", false], [32499, 0.045816, " work", false], [46342, 0.01854, " itself", false], [51982, 0.018252, " improve", false], [55448, 0.016839, " actually", false], [45284, 0.016739, " become", false], [52570, 0.013729, " proceed", false], [31262, 0.0119, " lead", false], [55851, 0.010883, " continue", false], [4559, 0.010581, " go", false]]]}, "raw_delta": 0.09635416666666667, "tuned_delta": 0.15044376408174226}, {"byte_start": 6846, "byte_end": 6851, "display": {"text": " done", "kind": "normal"}, "is_word": true, "word_id": 1182, "word_key": " done", "bytes_hex": "20 64 6f 6e 65", "compression": {"model_a": "11.83% 11.83% 11.83% 11.83% 11.83%", "model_b": "8.68% 8.68% 8.68% 8.68% 8.68%"}, "model_tokens": {"model_a": [[30666, " done", "normal", 0.03751043975353241]], "model_b": [[30666, " done", "normal", 0.08892758190631866]]}, "loss": {"model_a": 11.834607757292277, "model_b": 8.67871235534767}, "topk": {"model_a": [30666, 4, 0.03751043975353241, [[59203, 0.222051, " automated", false], [31351, 0.096987, " made", false], [56418, 0.079672, " improved", false], [30666, 0.03751, " done", false], [63594, 0.037476, " generalized", false], [56189, 0.027683, " extended", false], [38547, 0.027383, " found", false], [55689, 0.023901, " captured", false], [47180, 0.017846, " scaled", false], [61885, 0.017119, " discovered", false]]], "model_b": [30666, 2, 0.08892758190631866, [[56418, 0.145395, " improved", false], [30666, 0.088928, " done", false], [31351, 0.056813, " made", false], [59203, 0.034044, " automated", false], [60101, 0.024859, " optimized", false], [47687, 0.016327, " useful", false], [63594, 0.016262, " generalized", false], [52112, 0.015924, " learned", false], [50937, 0.014213, " applied", false], [32354, 0.01412, " used", false]]]}, "raw_delta": 0.175, "tuned_delta": 0.22908959741507556}, {"byte_start": 6851, "byte_end": 6852, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"model_a": "31.56%", "model_b": "25.36%"}, "model_tokens": {"model_a": [[47, ".", "normal", 0.17631813883781433]], "model_b": [[47, ".", "normal", 0.24795278906822205]]}, "loss": {"model_a": 31.55895401944607, "model_b": 25.359873765626308}, "topk": {"model_a": [47, 1, 0.17631813883781433, [[47, 0.176318, ".", false], [4450, 0.157159, " by", false], [4596, 0.101813, " in", false], [45, 0.079992, ",", false], [45301, 0.074809, " better", false], [31458, 0.039277, " more", false], [64839, 0.029597, " automatically", false], [32458, 0.027295, " well", false], [4424, 0.026983, " at", false], [53356, 0.01883, " without", false]]], "model_b": [47, 1, 0.24795278906822205, [[47, 0.247953, ".", false], [45, 0.150302, ",", false], [4450, 0.113059, " by", false], [4596, 0.076627, " in", false], [45301, 0.047464, " better", false], [63508, 0.043576, " efficiently", false], [32458, 0.035337, " well", false], [31458, 0.03016, " more", false], [63507, 0.021408, " effectively", false], [53356, 0.02, " without", false]]]}, "raw_delta": 0.34375, "tuned_delta": 0.3978395974150756}, {"byte_start": 6852, "byte_end": 6853, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"model_a": "98.06%", "model_b": "72.70%"}, "model_tokens": {"model_a": [[11, "\n", "control", 0.0042694928124547005]], "model_b": [[11, "\n", "control", 0.017434781417250633]]}, "loss": {"model_a": 98.05817856042172, "model_b": 72.69830479479542}, "topk": {"model_a": [11, 24, 0.0042694928124547005, [[261, 0.525798, "\n\n", false], [4331, 0.055978, " We", false], [20996, 0.055397, " The", false], [3918, 0.032883, " It", false], [29894, 0.030974, " This", false], [19417, 0.021034, " And", false], [3913, 0.013748, " In", false], [20571, 0.012739, " Our", false], [0, 0.012652, "[0]", false], [3908, 0.010713, " If", false]]], "model_b": [11, 8, 0.017434781417250633, [[261, 0.397328, "\n\n", false], [4331, 0.082781, " We", false], [20996, 0.055552, " The", false], [3918, 0.044314, " It", false], [29894, 0.030437, " This", false], [19417, 0.022065, " And", false], [3913, 0.02076, " In", false], [11, 0.017435, "\n", false], [50342, 0.016884, " Instead", false], [267, 0.015407, "  ", false]]]}, "raw_delta": 1.40625, "tuned_delta": 1.4603395974150757}], "meta": {"model_a": "RWKV7-G1F-1.5B", "model_b": "RWKV7-G1D-0.4B", "avg_compression": {"model_a": 9.315505162073826, "model_b": 10.290940086503847}, "avg_delta": -0.05408959741507559, "avg_delta_compression": -0.9754349244301255}}</script>
     <script>
         const svgOverlay = document.getElementById('svg-overlay');
         const content = document.querySelector('.content');