Add fixed cross-revision inference samples

Publish deterministic r001-r004 inference references, reproduction tooling, and updated model-card and training-history links.

CHANGELOG.md

@@ -7,6 +7,7 @@ Revision numbers identify published model states independently of release names.
 - Changed the architecture from 12/14/896 to 14/13/832 while keeping nearly the same parameter count.
 - Kept the r003 tokenizer, dataset, context, effective batch, token budget, and 4e-4→4e-5 learning-rate range unchanged.
 - Improved LAMBADA and SciQ over r003; the other five reported English primary metrics declined.
+- Added a documentation-only, reproducible fixed-sampling suite for behavioral comparison of the immutable r001-r004 weights; model files are unchanged.
 
 Full record: [`training-history/r004.md`](./training-history/r004.md)
 

README.md

@@ -119,7 +119,20 @@ output = model.generate(
 print(tokenizer.decode(output[0], skip_special_tokens=True))
 ```
 
-Model używa standardowego `GPT2LMHeadModel`; `trust_remote_code=True` nie jest potrzebne. Dla r004 nie opublikowano jeszcze próbek generacji. Historyczne próbki są przypisane do poprzednich wag w historii r001.
+Model używa standardowego `GPT2LMHeadModel`; `trust_remote_code=True` nie jest potrzebne.
+
+### Stałe próbki inferencji
+
+Wspólny zestaw [`fixed-sampling-v1`](./inference-samples/README.md) pokazuje te same cztery prompty wygenerowane przez r001-r004. Każdy model jest ładowany z pełnego, niezmiennego SHA commitu, a SHA-256 pliku z wagami jest sprawdzane przed inferencją. Referencyjny protokół używa macOS 26.2 na arm64, CPU, float32, jednego wątku, Transformers 5.15.1, seed 1337 resetowanego dla każdego promptu, temperature 0.7, top-k 50 i limitu 100 nowych tokenów.
+
+| Rewizja | Wydanie | Wagi | Historia |
+|---|---|---|---|
+| **r004** | **Pollock 1.2 (aktualna)** | [`30feb81`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/30feb81e5097eef13b939e1827d98e0458bf602d) | [`r004.md`](./training-history/r004.md) |
+| r003 | Pollock 1.1 | [`698984b`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/698984b1d1b96c9b6ffaff00c7fc2e78e140e842) | [`r003.md`](./training-history/r003.md) |
+| r002 | Pollock 1.0 | [`5e571cd`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5e571cde09ef2d1124e13d1c31d0b75f8bd0e513) | [`r002.md`](./training-history/r002.md) |
+| r001 | poprzednik eksperymentalny | [`5b8f825`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5b8f82515c4e31d9a4a8a222eabdaab3ad5171b0) | [`r001.md`](./training-history/r001.md) |
+
+Pełne teksty są przeznaczone do porównywania zachowania, nie są benchmarkiem ani deklaracją poprawności. [`results.json`](./inference-samples/results.json) zapisuje także dokładne identyfikatory tokenów, a [`generate.py`](./inference-samples/generate.py) odtwarza i weryfikuje cały zestaw. Dokładny replay potwierdzono w zapisanym środowisku; inny system operacyjny lub CPU może zmienić wynik samplingu. Starsze próbki osadzone w historii r001 pozostają historycznym zapisem i nie są używane do bezpośredniego porównania, ponieważ nie przypięto całego ich środowiska wykonania.
 
 ### Ograniczenia i odpowiedzialne użycie
 
@@ -193,7 +206,20 @@ LAMBADA perplexity was 47.563341. Full metrics and protocol details are recorded
 
 ### Usage
 
-Use the Transformers example in the Polish section. The artifact uses standard `GPT2LMHeadModel`; `trust_remote_code=True` is unnecessary. No r004 generation samples have been published yet. Historical samples are explicitly attached to the predecessor weights in the r001 history.
+Use the Transformers example in the Polish section. The artifact uses standard `GPT2LMHeadModel`; `trust_remote_code=True` is unnecessary.
+
+### Fixed inference samples
+
+The shared [`fixed-sampling-v1`](./inference-samples/README.md) suite runs the same four prompts on r001-r004. Every model is loaded from a full immutable commit SHA and its weight-file SHA-256 is verified before inference. The reference protocol uses macOS 26.2 on arm64, CPU float32 with one thread, Transformers 5.15.1, seed 1337 reset for every prompt, temperature 0.7, top-k 50, and a 100-new-token limit.
+
+| Revision | Release | Weights | History |
+|---|---|---|---|
+| **r004** | **Pollock 1.2 (current)** | [`30feb81`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/30feb81e5097eef13b939e1827d98e0458bf602d) | [`r004.md`](./training-history/r004.md) |
+| r003 | Pollock 1.1 | [`698984b`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/698984b1d1b96c9b6ffaff00c7fc2e78e140e842) | [`r003.md`](./training-history/r003.md) |
+| r002 | Pollock 1.0 | [`5e571cd`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5e571cde09ef2d1124e13d1c31d0b75f8bd0e513) | [`r002.md`](./training-history/r002.md) |
+| r001 | experimental predecessor | [`5b8f825`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5b8f82515c4e31d9a4a8a222eabdaab3ad5171b0) | [`r001.md`](./training-history/r001.md) |
+
+The complete texts are behavioral examples, not benchmarks or factuality claims. [`results.json`](./inference-samples/results.json) also records exact token IDs, while [`generate.py`](./inference-samples/generate.py) reproduces and verifies the suite. Exact replay was confirmed in the recorded environment; another operating system or CPU can change sampled outputs. The older samples embedded in the r001 history remain a historical record and are excluded from direct comparison because their complete execution environment was not pinned.
 
 ### Limitations and responsible use
 

inference-samples/README.md

@@ -0,0 +1,302 @@
+# Fixed cross-revision inference samples
+
+These samples compare the published Pollock weights under one fixed inference protocol. They are behavioral examples, not benchmark scores or factuality claims. Outputs are shown without cherry-picking, including errors and repetition.
+
+## Protocol
+
+- Suite: `fixed-sampling-v1`
+- Runtime: macOS 26.2 arm64, Python 3.13.3, PyTorch 2.13.0, Transformers 5.15.1, huggingface_hub 1.28.0
+- Execution: CPU, `float32`, 1 PyTorch CPU thread
+- Sampling: seed 1337 reset before every prompt, temperature 0.7, top-k 50, top-p 1.0
+- Limit: 100 new tokens, with the prompt included in each displayed output
+
+The older samples embedded in `training-history/r001.md` remain part of the historical record. They differ from this suite because their complete execution environment was not pinned. Only the results below are used for direct cross-revision comparison.
+
+Exact token replay was verified in the recorded environment. Sampling may diverge on another operating system or CPU architecture even when package versions and seeds match.
+
+## Revisions
+
+| Revision | Release | Immutable weights | `model.safetensors` SHA-256 |
+|---|---|---|---|
+| r001 | experimental predecessor | [`5b8f825`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5b8f82515c4e31d9a4a8a222eabdaab3ad5171b0) | `acaa1531322cce78ddb919700f173d4c6ea371185bea5052a3ae4c30f57b368e` |
+| r002 | Pollock 1.0 | [`5e571cd`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5e571cde09ef2d1124e13d1c31d0b75f8bd0e513) | `2aada5b26abe9ce3b70af393d77be4ed1a799a7205b9c0dd5cfaff8bcaabce68` |
+| r003 | Pollock 1.1 | [`698984b`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/698984b1d1b96c9b6ffaff00c7fc2e78e140e842) | `3a9964a0ba5f6d20ef6061d2a7e4442c1b001209ebe80f7b7148a25573decaa9` |
+| r004 | Pollock 1.2 | [`30feb81`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/30feb81e5097eef13b939e1827d98e0458bf602d) | `3c453f22d4bb70228e5cca79e183a425e0f0221e54bd782d12027c42c943c880` |
+
+## Results
+
+### General knowledge
+
+Prompt: `The capital of France is`
+
+#### r001 - experimental predecessor
+
+````text
+The capital of France is had the first number of Americans. The first census was discovered in a 1922 census.
+
+See also
+ List of census
+
+References
+
+External links
+
+Cultural census
+Cultural census
+Central census
+Cultural census
+Cultural census
+Central census
+````
+
+Output SHA-256: `245e3580745e9a572de95b1336679d70d5c1bde379e341fffb599f10bc12c5ce`
+
+#### r002 - Pollock 1.0
+
+````text
+The capital of France is the Palais de la Borde, a place called "the Place of Funds and Stocks". Its population is estimated to be around 30,000.
+
+In the 19th century, the city was transformed into a municipality. The French government took the city up to the position of a municipality. The capital was the Palais de Valois, with its capital at the Palais des Gardes. The population was reduced to around 30,000.
+
+````
+
+Output SHA-256: `181ebd0d98d96eb3c1693cb88f6f68db6bfcfc02ff791fd5885097a0cf3722a1`
+
+#### r003 - Pollock 1.1
+
+````text
+The capital of France is the French city of Versailles, on the site of the old church that was destroyed by the French during the French Revolution.
+
+The capital of the French Republic is the capital of the Kingdom of France, situated about  from Paris.
+
+History
+
+The city of Versailles was created by the French Revolutionary government as the capital of France. The city was officially named after its founder, Jules Bourrienne, who was
+````
+
+Output SHA-256: `249a398d82bd1888d4394fc04de3baee1902cd39b864d1c1cfe0b0a3d85e20e4`
+
+#### r004 - Pollock 1.2
+
+````text
+The capital of France is the French city of Vienne.
+
+History
+
+The city was first mentioned in 1188 as Viecourt or Bézier. In 1786 it was incorporated in the city of Vendôme.
+
+In 1871 it was renamed Viecourt.
+
+In 1883 it was renamed La Tour des Poids.
+
+In 1959 it was renamed La Tour des Poids. In 19
+````
+
+Output SHA-256: `c2a3e16019cac3e07a8c0d5426c41a359e53a105fb12349f5a1f8c2fc02b8be4`
+
+### Explanation
+
+Prompt: `Photosynthesis is the process by which`
+
+#### r001 - experimental predecessor
+
+````text
+Photosynthesis is the process by which the two points of the symmetry are shown .
+
+the probability in ( [ eq : k_u] ) ) is not given to be equal due to the order of the symmetry .
+
+the average speed of the density is about 1.70 .
+
+the average velocity of the velocity is about 1.2 * .
+
+the velocity of the velocity is about 1.6 * .
+
+the velocity of the velocity is about 3.5 * .
+
+the velocity of
+````
+
+Output SHA-256: `15f8c6262d0ea4524ee5c0ec1c2fb38828e2e4c6d11bd63d6639d4e55880903b`
+
+#### r002 - Pollock 1.0
+
+````text
+Photosynthesis is the process by which plants and animals obtain energy from sunlight. When a plant produces light, it absorbs the light energy that came from the sun. The energy from the sun is absorbed by the plant and is radiated to the leaves. This energy is then used for photosynthesis and is used to produce food.
+Photosynthesis is the process by which plants obtain energy from sunlight. When a plant absorbs the light energy from the sun, it becomes a food source.
+The most common
+````
+
+Output SHA-256: `e8baa6567207b0afacc7aaf548b22b0226140171a96039a2652f8132de87d623`
+
+#### r003 - Pollock 1.1
+
+````text
+Photosynthesis is the process by which the plants, the fungi, and other organisms convert carbon dioxide and water into energy.
+The use of photosynthesis as a source of energy is called photosynthesis. The process is known as photosynthesis.
+- Photosynthesis is the process by which the plants, or some other organisms, convert carbon dioxide and water into energy.
+- Photosynthesis is the process by which the plants, or some other organisms convert carbon dioxide and water into energy.
+-
+````
+
+Output SHA-256: `6522de510566b946a17e112bd872123306d17dfb270baf39439d4dd23ab6c371`
+
+#### r004 - Pollock 1.2
+
+````text
+Photosynthesis is the process by which plants and animals obtain energy from sunlight. When a food source is present—such as a food source that humans are eating—a light source is used to create more energy. The process of photosynthesis in plants is called the light-dependent reactions.
+A plant can be a source of energy. This is because there are specialized structures needed for photosynthesis. The light-dependent reactions are called phototrophic reactions.
+There are two types of photosynthesis:
+````
+
+Output SHA-256: `2487ed5406a8bd5c0251577bac47ea13897623bda4b6955aaa0ecf675b886ef9`
+
+### Story
+
+Prompt: `In a distant future, humanity discovered`
+
+#### r001 - experimental predecessor
+
+````text
+In a distant future, humanity discovered and the first number of the data.
+
+The data of the data
+
+The data is a little better than the data.
+
+The data is more accurate than the data.
+
+The data is very different from the data, but the data is very different from the data.
+
+The data is very different from the data.
+
+The data is very different from the data.
+
+The data is more accurate than the data.
+
+The data is very different from
+````
+
+Output SHA-256: `037c1f6e8b59cb61dee53f79a801d632eba4cd5df2f4a57381c61c3e1c94086f`
+
+#### r002 - Pollock 1.0
+
+````text
+In a distant future, humanity discovered that the human genome has only been growing in size by 2026—roughly the same time that humans are starting to migrate from Africa to Asia, and that they have made a fuller crop of corn and rice.
+The human genome project, led by an international team of researchers from the University of California, Davis, is taking advantage of the human genome to allow for the first-ever genome-level analysis of genomic sequences from the genome of people
+````
+
+Output SHA-256: `c23e944af1cce79a84fcf44ec80625e93279df0d4816e664905ed1a6b3835897`
+
+#### r003 - Pollock 1.1
+
+````text
+In a distant future, humanity discovered that the human race is not only a species, it is a supernatural force that has made us all human.
+The human race has also given us a unique perspective on the world around us. This perspective is critical to understanding the human condition and the human capacity for self-sacrifice. This perspective also helps us to understand the world around us as a whole and to understand ourselves.
+In conclusion, the human race is a complex and interconnected entity that has played a
+````
+
+Output SHA-256: `4028c3120d8711b29e7caabdb58128402b66088941d4718fb53267b69bfa9bac`
+
+#### r004 - Pollock 1.2
+
+````text
+In a distant future, humanity discovered that the human race is not only a species of human beings, but a species of animals: it is human beings who are not created to be equal. The more human beings they have, the more they have to be treated just like others, and the more they are treated like human beings.
+- The First Amendment prohibits the government from impersonating humans for the purposes of defending their rights. The current law prohibits the government from impersonating anyone who is not a member
+````
+
+Output SHA-256: `bbe8eec9552d2e6cbacd8d6047cec539fbfb81b18ca3f69f1774beb909702502`
+
+### Code
+
+Prompt: `def fibonacci(n):`
+
+#### r001 - experimental predecessor
+
+````text
+def fibonacci(n): and the nth-formcurve function in the nth-formcurve .
+
+this work for nth-formcurve and octon - based - factor - based parameter - based parameter - dependent parameter - dependent parameter - dependent parameter - dependent parameter - dependent factor - dependent parameter - dependent parameter - required parameter - dependent parameter - required parameter - required item - required integer - required integers - types of -type - required integers - required values - required - type - useful item
+````
+
+Output SHA-256: `cd8fe88c64580c1496e44321bb3673980f8a6e4d630833103e617498c5c8bb8e`
+
+#### r002 - Pollock 1.0
+
+````text
+def fibonacci(n):
+    return n * fibonacci(n-1)/2
+
+
+def fibonacci_mat(n):
+    return n * fibonacci(n-1)/2
+
+
+def fibonacci_mat_lcs(n):
+    return fibonacci(n-1) * fibonacci(n-2)
+
+
+def fibonacci_mat_lcs_tuple(n):
+    return fibonacci
+````
+
+Output SHA-256: `2188bd0cdb6e8feccac9cb5817aa7c65666aba6ac163703542f6d0aaa297c9cb`
+
+#### r003 - Pollock 1.1
+
+````text
+def fibonacci(n):
+    res = 1-sum(x)
+    for i in range(n):
+        res = res + sum(x)
+    return res
+
+def fibonacci_to_sine(n):
+    res = 1-sum(x)
+    for i in range(n):
+        res = res * math.pi
+    return res
+
+def fibonacci_simple(n):
+    res = 1-sum(x)
+    for i in range(
+````
+
+Output SHA-256: `f9a84f3921790df8fe9aad6d527ce9e5e0b9b7f7bb98df1d76e6766623227756`
+
+#### r004 - Pollock 1.2
+
+````text
+def fibonacci(n):
+    """
+    :param n: The number of ways to iterate through the given list.
+    :return: The number of ways to iterate through the given list.
+    """
+    if n == 0:
+        return 1
+    n = n + 1
+    n_iters = 0
+    while n_iters < n:
+        n_iters += 1
+        if n_iters == n:
+            return 1
+        else:
+            n = n + 1
+        if n_
+````
+
+Output SHA-256: `0b82389bac561dae528eb389dbde414eb2bb7c6bff7a0868d2acd276edb2ad88`
+
+## Reproduce or verify
+
+Run from this directory. The first command downloads approximately 1.9 GB of public model artifacts if they are not already cached.
+
+```bash
+python -m venv .venv
+source .venv/bin/activate
+pip install -r requirements.txt
+python generate.py --check
+```
+
+`generate.py` rejects package-version mismatches by default, verifies each weight file against `config.json`, and compares both token IDs and rendered text through `results.json`.
+
+Machine-readable protocol and outputs: [`config.json`](./config.json) and [`results.json`](./results.json).

inference-samples/config.json

@@ -0,0 +1,75 @@
+{
+  "schema_version": 1,
+  "suite_id": "fixed-sampling-v1",
+  "model_id": "SlayerLab/pollock-mini-lm-125m",
+  "environment": {
+    "operating_system": "macOS 26.2",
+    "architecture": "arm64",
+    "python": "3.13.3",
+    "torch": "2.13.0",
+    "transformers": "5.15.1",
+    "huggingface_hub": "1.28.0"
+  },
+  "protocol": {
+    "device": "cpu",
+    "dtype": "float32",
+    "cpu_threads": 1,
+    "seed": 1337,
+    "reset_seed_before_each_prompt": true,
+    "do_sample": true,
+    "temperature": 0.7,
+    "top_k": 50,
+    "top_p": 1.0,
+    "max_new_tokens": 100,
+    "num_return_sequences": 1,
+    "skip_special_tokens": true
+  },
+  "revisions": [
+    {
+      "revision_id": "r001",
+      "release": "experimental predecessor",
+      "commit": "5b8f82515c4e31d9a4a8a222eabdaab3ad5171b0",
+      "model_sha256": "acaa1531322cce78ddb919700f173d4c6ea371185bea5052a3ae4c30f57b368e"
+    },
+    {
+      "revision_id": "r002",
+      "release": "Pollock 1.0",
+      "commit": "5e571cde09ef2d1124e13d1c31d0b75f8bd0e513",
+      "model_sha256": "2aada5b26abe9ce3b70af393d77be4ed1a799a7205b9c0dd5cfaff8bcaabce68"
+    },
+    {
+      "revision_id": "r003",
+      "release": "Pollock 1.1",
+      "commit": "698984b1d1b96c9b6ffaff00c7fc2e78e140e842",
+      "model_sha256": "3a9964a0ba5f6d20ef6061d2a7e4442c1b001209ebe80f7b7148a25573decaa9"
+    },
+    {
+      "revision_id": "r004",
+      "release": "Pollock 1.2",
+      "commit": "30feb81e5097eef13b939e1827d98e0458bf602d",
+      "model_sha256": "3c453f22d4bb70228e5cca79e183a425e0f0221e54bd782d12027c42c943c880"
+    }
+  ],
+  "prompts": [
+    {
+      "prompt_id": "general_knowledge",
+      "label": "General knowledge",
+      "text": "The capital of France is"
+    },
+    {
+      "prompt_id": "explanation",
+      "label": "Explanation",
+      "text": "Photosynthesis is the process by which"
+    },
+    {
+      "prompt_id": "story",
+      "label": "Story",
+      "text": "In a distant future, humanity discovered"
+    },
+    {
+      "prompt_id": "code",
+      "label": "Code",
+      "text": "def fibonacci(n):"
+    }
+  ]
+}

inference-samples/generate.py

@@ -0,0 +1,353 @@
+#!/usr/bin/env python3
+"""Generate or verify Pollock's fixed cross-revision inference samples."""
+
+from __future__ import annotations
+
+import argparse
+import gc
+import hashlib
+import json
+import platform
+from importlib.metadata import version
+from pathlib import Path
+from typing import Any
+
+import torch
+from huggingface_hub import hf_hub_download
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+
+HERE = Path(__file__).resolve().parent
+PACKAGE_NAMES = {
+    "torch": "torch",
+    "transformers": "transformers",
+    "huggingface_hub": "huggingface-hub",
+}
+
+
+def parse_args() -> argparse.Namespace:
+    parser = argparse.ArgumentParser(description=__doc__)
+    parser.add_argument("--config", type=Path, default=HERE / "config.json")
+    parser.add_argument("--output", type=Path, default=HERE / "results.json")
+    parser.add_argument("--markdown", type=Path, default=HERE / "README.md")
+    parser.add_argument(
+        "--check",
+        action="store_true",
+        help="Regenerate in memory and require an exact match with --output",
+    )
+    parser.add_argument(
+        "--allow-version-mismatch",
+        action="store_true",
+        help="Run even if the Python or package versions differ from config.json",
+    )
+    parser.add_argument(
+        "--render-only",
+        action="store_true",
+        help="Render --markdown from the existing --output without inference",
+    )
+    return parser.parse_args()
+
+
+def sha256_file(path: Path) -> str:
+    digest = hashlib.sha256()
+    with path.open("rb") as handle:
+        for chunk in iter(lambda: handle.read(8 * 1024 * 1024), b""):
+            digest.update(chunk)
+    return digest.hexdigest()
+
+
+def sha256_text(text: str) -> str:
+    return hashlib.sha256(text.encode("utf-8")).hexdigest()
+
+
+def runtime_environment() -> dict[str, str]:
+    operating_system = platform.system()
+    if operating_system == "Darwin":
+        operating_system = f"macOS {platform.mac_ver()[0]}"
+    return {
+        "operating_system": operating_system,
+        "architecture": platform.machine(),
+        "python": platform.python_version(),
+        **{
+            config_name: version(package_name)
+            for config_name, package_name in PACKAGE_NAMES.items()
+        },
+    }
+
+
+def validate_environment(config: dict[str, Any], allow_mismatch: bool) -> dict[str, str]:
+    actual = runtime_environment()
+    expected = config["environment"]
+    mismatches = {
+        name: {"expected": expected[name], "actual": actual[name]}
+        for name in expected
+        if actual.get(name) != expected[name]
+    }
+    if mismatches and not allow_mismatch:
+        raise RuntimeError(f"Environment mismatch: {json.dumps(mismatches)}")
+    return actual
+
+
+def generate_results(config: dict[str, Any], environment: dict[str, str]) -> dict[str, Any]:
+    protocol = config["protocol"]
+    if protocol["device"] != "cpu" or protocol["dtype"] != "float32":
+        raise ValueError("The fixed suite requires CPU float32 inference")
+
+    torch.set_num_threads(protocol["cpu_threads"])
+    torch.set_num_interop_threads(1)
+    torch.use_deterministic_algorithms(True)
+
+    revision_results = []
+    for revision in config["revisions"]:
+        print(f"Loading {revision['revision_id']} at {revision['commit']}...", flush=True)
+        weights_path = Path(
+            hf_hub_download(
+                repo_id=config["model_id"],
+                filename="model.safetensors",
+                revision=revision["commit"],
+                token=False,
+            )
+        )
+        actual_model_sha = sha256_file(weights_path)
+        if actual_model_sha != revision["model_sha256"]:
+            raise RuntimeError(
+                f"Weight hash mismatch for {revision['revision_id']}: "
+                f"{actual_model_sha} != {revision['model_sha256']}"
+            )
+
+        tokenizer = AutoTokenizer.from_pretrained(
+            config["model_id"],
+            revision=revision["commit"],
+            token=False,
+            trust_remote_code=False,
+        )
+        model = AutoModelForCausalLM.from_pretrained(
+            config["model_id"],
+            revision=revision["commit"],
+            dtype=torch.float32,
+            token=False,
+            trust_remote_code=False,
+        )
+        model.to("cpu")
+        model.eval()
+
+        prompt_results = []
+        for prompt in config["prompts"]:
+            torch.manual_seed(protocol["seed"])
+            inputs = tokenizer(prompt["text"], return_tensors="pt")
+            input_length = inputs["input_ids"].shape[1]
+            with torch.inference_mode():
+                output = model.generate(
+                    **inputs,
+                    do_sample=protocol["do_sample"],
+                    temperature=protocol["temperature"],
+                    top_k=protocol["top_k"],
+                    top_p=protocol["top_p"],
+                    max_new_tokens=protocol["max_new_tokens"],
+                    num_return_sequences=protocol["num_return_sequences"],
+                    eos_token_id=tokenizer.eos_token_id,
+                    pad_token_id=tokenizer.eos_token_id,
+                    use_cache=True,
+                )
+
+            full_token_ids = output[0].tolist()
+            completion_token_ids = full_token_ids[input_length:]
+            full_text = tokenizer.decode(
+                full_token_ids,
+                skip_special_tokens=protocol["skip_special_tokens"],
+            )
+            completion_text = tokenizer.decode(
+                completion_token_ids,
+                skip_special_tokens=protocol["skip_special_tokens"],
+            )
+            prompt_results.append(
+                {
+                    "prompt_id": prompt["prompt_id"],
+                    "prompt": prompt["text"],
+                    "prompt_token_ids": full_token_ids[:input_length],
+                    "completion_token_ids": completion_token_ids,
+                    "completion_tokens": len(completion_token_ids),
+                    "stopped_on_eos": bool(
+                        completion_token_ids
+                        and completion_token_ids[-1] == tokenizer.eos_token_id
+                    ),
+                    "completion": completion_text,
+                    "full_text": full_text,
+                    "full_text_sha256": sha256_text(full_text),
+                }
+            )
+            print(
+                f"  {prompt['prompt_id']}: {len(completion_token_ids)} tokens",
+                flush=True,
+            )
+
+        revision_results.append(
+            {
+                **revision,
+                "loaded_model_version": getattr(model.config, "model_version", None),
+                "results": prompt_results,
+            }
+        )
+        del model, tokenizer
+        gc.collect()
+
+    return {
+        "schema_version": 1,
+        "suite_id": config["suite_id"],
+        "model_id": config["model_id"],
+        "environment": environment,
+        "protocol": protocol,
+        "revisions": revision_results,
+    }
+
+
+def render_markdown(config: dict[str, Any], results: dict[str, Any]) -> str:
+    protocol = results["protocol"]
+    environment = results["environment"]
+    revisions = {item["revision_id"]: item for item in results["revisions"]}
+    lines = [
+        "# Fixed cross-revision inference samples",
+        "",
+        "These samples compare the published Pollock weights under one fixed inference "
+        "protocol. They are behavioral examples, not benchmark scores or factuality claims. "
+        "Outputs are shown without cherry-picking, including errors and repetition.",
+        "",
+        "## Protocol",
+        "",
+        f"- Suite: `{results['suite_id']}`",
+        f"- Runtime: {environment['operating_system']} "
+        f"{environment['architecture']}, Python {environment['python']}, "
+        f"PyTorch {environment['torch']}, "
+        f"Transformers {environment['transformers']}, huggingface_hub "
+        f"{environment['huggingface_hub']}",
+        f"- Execution: {protocol['device'].upper()}, `{protocol['dtype']}`, "
+        f"{protocol['cpu_threads']} PyTorch CPU thread",
+        f"- Sampling: seed {protocol['seed']} reset before every prompt, temperature "
+        f"{protocol['temperature']}, top-k {protocol['top_k']}, top-p "
+        f"{protocol['top_p']}",
+        f"- Limit: {protocol['max_new_tokens']} new tokens, with the prompt included in "
+        "each displayed output",
+        "",
+        "The older samples embedded in `training-history/r001.md` remain part of the "
+        "historical record. They differ from this suite because their complete execution "
+        "environment was not pinned. Only the results below are used for direct "
+        "cross-revision comparison.",
+        "",
+        "Exact token replay was verified in the recorded environment. Sampling may "
+        "diverge on another operating system or CPU architecture even when package "
+        "versions and seeds match.",
+        "",
+        "## Revisions",
+        "",
+        "| Revision | Release | Immutable weights | `model.safetensors` SHA-256 |",
+        "|---|---|---|---|",
+    ]
+    for revision in results["revisions"]:
+        commit = revision["commit"]
+        commit_url = (
+            f"https://huggingface.co/{results['model_id']}/commit/{commit}"
+        )
+        lines.append(
+            f"| {revision['revision_id']} | {revision['release']} | "
+            f"[`{commit[:7]}`]({commit_url}) | `{revision['model_sha256']}` |"
+        )
+
+    lines.extend(
+        [
+            "",
+            "## Results",
+            "",
+        ]
+    )
+    for prompt in config["prompts"]:
+        lines.extend(
+            [
+                f"### {prompt['label']}",
+                "",
+                f"Prompt: `{prompt['text']}`",
+                "",
+            ]
+        )
+        for revision_config in config["revisions"]:
+            revision_id = revision_config["revision_id"]
+            result = next(
+                item
+                for item in revisions[revision_id]["results"]
+                if item["prompt_id"] == prompt["prompt_id"]
+            )
+            lines.extend(
+                [
+                    f"#### {revision_id} - {revision_config['release']}",
+                    "",
+                    "````text",
+                    result["full_text"],
+                    "````",
+                    "",
+                    f"Output SHA-256: `{result['full_text_sha256']}`",
+                    "",
+                ]
+            )
+
+    lines.extend(
+        [
+            "## Reproduce or verify",
+            "",
+            "Run from this directory. The first command downloads approximately 1.9 GB "
+            "of public model artifacts if they are not already cached.",
+            "",
+            "```bash",
+            "python -m venv .venv",
+            "source .venv/bin/activate",
+            "pip install -r requirements.txt",
+            "python generate.py --check",
+            "```",
+            "",
+            "`generate.py` rejects package-version mismatches by default, verifies each "
+            "weight file against `config.json`, and compares both token IDs and rendered "
+            "text through `results.json`.",
+            "",
+            "Machine-readable protocol and outputs: [`config.json`](./config.json) and "
+            "[`results.json`](./results.json).",
+            "",
+        ]
+    )
+    return "\n".join(lines)
+
+
+def main() -> None:
+    args = parse_args()
+    config = json.loads(args.config.read_text(encoding="utf-8"))
+    if args.render_only:
+        if args.check:
+            raise ValueError("--render-only and --check cannot be combined")
+        results = json.loads(args.output.read_text(encoding="utf-8"))
+        args.markdown.write_text(
+            render_markdown(config, results),
+            encoding="utf-8",
+        )
+        print(f"Wrote {args.markdown}")
+        return
+
+    environment = validate_environment(config, args.allow_version_mismatch)
+    results = generate_results(config, environment)
+    markdown = render_markdown(config, results)
+
+    if args.check:
+        expected = json.loads(args.output.read_text(encoding="utf-8"))
+        if results != expected:
+            raise RuntimeError(f"Generated results differ from {args.output}")
+        if markdown != args.markdown.read_text(encoding="utf-8"):
+            raise RuntimeError(f"Rendered Markdown differs from {args.markdown}")
+        print(f"Exact match: {args.output} and {args.markdown}")
+        return
+
+    args.output.write_text(
+        json.dumps(results, indent=2, ensure_ascii=False) + "\n",
+        encoding="utf-8",
+    )
+    args.markdown.write_text(markdown, encoding="utf-8")
+    print(f"Wrote {args.output} and {args.markdown}")
+
+
+if __name__ == "__main__":
+    main()

inference-samples/requirements.txt

@@ -0,0 +1,3 @@
+torch==2.13.0
+transformers==5.15.1
+huggingface-hub==1.28.0

inference-samples/results.json

@@ -0,0 +1,1967 @@
+{
+  "schema_version": 1,
+  "suite_id": "fixed-sampling-v1",
+  "model_id": "SlayerLab/pollock-mini-lm-125m",
+  "environment": {
+    "operating_system": "macOS 26.2",
+    "architecture": "arm64",
+    "python": "3.13.3",
+    "torch": "2.13.0",
+    "transformers": "5.15.1",
+    "huggingface_hub": "1.28.0"
+  },
+  "protocol": {
+    "device": "cpu",
+    "dtype": "float32",
+    "cpu_threads": 1,
+    "seed": 1337,
+    "reset_seed_before_each_prompt": true,
+    "do_sample": true,
+    "temperature": 0.7,
+    "top_k": 50,
+    "top_p": 1.0,
+    "max_new_tokens": 100,
+    "num_return_sequences": 1,
+    "skip_special_tokens": true
+  },
+  "revisions": [
+    {
+      "revision_id": "r001",
+      "release": "experimental predecessor",
+      "commit": "5b8f82515c4e31d9a4a8a222eabdaab3ad5171b0",
+      "model_sha256": "acaa1531322cce78ddb919700f173d4c6ea371185bea5052a3ae4c30f57b368e",
+      "loaded_model_version": null,
+      "results": [
+        {
+          "prompt_id": "general_knowledge",
+          "prompt": "The capital of France is",
+          "prompt_token_ids": [
+            492,
+            4514,
+            286,
+            4413,
+            311
+          ],
+          "completion_token_ids": [
+            626,
+            263,
+            769,
+            981,
+            286,
+            5440,
+            46,
+            382,
+            769,
+            269,
+            7211,
+            400,
+            4850,
+            287,
+            257,
+            613,
+            1592,
+            269,
+            7211,
+            46,
+            10,
+            10,
+            4442,
+            638,
+            10,
+            4191,
+            286,
+            269,
+            7211,
+            10,
+            10,
+            3103,
+            10,
+            10,
+            4881,
+            3538,
+            10,
+            10,
+            67,
+            500,
+            1188,
+            269,
+            7211,
+            10,
+            67,
+            500,
+            1188,
+            269,
+            7211,
+            10,
+            67,
+            299,
+            1411,
+            269,
+            7211,
+            10,
+            67,
+            500,
+            1188,
+            269,
+            7211,
+            10,
+            67,
+            500,
+            1188,
+            269,
+            7211,
+            10,
+            67,
+            299,
+            1411,
+            269,
+            7211,
+            12285
+          ],
+          "completion_tokens": 74,
+          "stopped_on_eos": true,
+          "completion": " had the first number of Americans. The first census was discovered in a 1922 census.\n\nSee also\n List of census\n\nReferences\n\nExternal links\n\nCultural census\nCultural census\nCentral census\nCultural census\nCultural census\nCentral census",
+          "full_text": "The capital of France is had the first number of Americans. The first census was discovered in a 1922 census.\n\nSee also\n List of census\n\nReferences\n\nExternal links\n\nCultural census\nCultural census\nCentral census\nCultural census\nCultural census\nCentral census",
+          "full_text_sha256": "245e3580745e9a572de95b1336679d70d5c1bde379e341fffb599f10bc12c5ce"
+        },
+        {
+          "prompt_id": "explanation",
+          "prompt": "Photosynthesis is the process by which",
+          "prompt_token_ids": [
+            3712,
+            316,
+            394,
+            11580,
+            8310,
+            311,
+            263,
+            1170,
+            411,
+            506
+          ],
+          "completion_token_ids": [
+            263,
+            734,
+            2251,
+            286,
+            263,
+            9703,
+            375,
+            2595,
+            476,
+            10,
+            10,
+            614,
+            4536,
+            287,
+            350,
+            603,
+            4575,
+            889,
+            482,
+            95,
+            117,
+            93,
+            777,
+            777,
+            311,
+            434,
+            1405,
+            290,
+            327,
+            2869,
+            1981,
+            290,
+            263,
+            1419,
+            286,
+            263,
+            9703,
+            476,
+            10,
+            10,
+            614,
+            2966,
+            2895,
+            286,
+            263,
+            4272,
+            311,
+            654,
+            346,
+            46,
+            2206,
+            476,
+            10,
+            10,
+            614,
+            2966,
+            5277,
+            286,
+            263,
+            5277,
+            311,
+            654,
+            346,
+            46,
+            50,
+            1001,
+            476,
+            10,
+            10,
+            614,
+            5277,
+            286,
+            263,
+            5277,
+            311,
+            654,
+            346,
+            46,
+            54,
+            1001,
+            476,
+            10,
+            10,
+            614,
+            5277,
+            286,
+            263,
+            5277,
+            311,
+            654,
+            546,
+            46,
+            53,
+            1001,
+            476,
+            10,
+            10,
+            614,
+            5277,
+            286
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " the two points of the symmetry are shown .\n\nthe probability in ( [ eq : k_u] ) ) is not given to be equal due to the order of the symmetry .\n\nthe average speed of the density is about 1.70 .\n\nthe average velocity of the velocity is about 1.2 * .\n\nthe velocity of the velocity is about 1.6 * .\n\nthe velocity of the velocity is about 3.5 * .\n\nthe velocity of",
+          "full_text": "Photosynthesis is the process by which the two points of the symmetry are shown .\n\nthe probability in ( [ eq : k_u] ) ) is not given to be equal due to the order of the symmetry .\n\nthe average speed of the density is about 1.70 .\n\nthe average velocity of the velocity is about 1.2 * .\n\nthe velocity of the velocity is about 1.6 * .\n\nthe velocity of the velocity is about 3.5 * .\n\nthe velocity of",
+          "full_text_sha256": "15f8c6262d0ea4524ee5c0ec1c2fb38828e2e4c6d11bd63d6639d4e55880903b"
+        },
+        {
+          "prompt_id": "story",
+          "prompt": "In a distant future, humanity discovered",
+          "prompt_token_ids": [
+            750,
+            257,
+            10103,
+            2629,
+            44,
+            12187,
+            4850
+          ],
+          "completion_token_ids": [
+            292,
+            263,
+            769,
+            981,
+            286,
+            263,
+            922,
+            46,
+            10,
+            10,
+            492,
+            922,
+            286,
+            263,
+            922,
+            10,
+            10,
+            492,
+            922,
+            311,
+            257,
+            1582,
+            1655,
+            698,
+            263,
+            922,
+            46,
+            10,
+            10,
+            492,
+            922,
+            311,
+            583,
+            6712,
+            698,
+            263,
+            922,
+            46,
+            10,
+            10,
+            492,
+            922,
+            311,
+            1003,
+            966,
+            433,
+            263,
+            922,
+            44,
+            520,
+            263,
+            922,
+            311,
+            1003,
+            966,
+            433,
+            263,
+            922,
+            46,
+            10,
+            10,
+            492,
+            922,
+            311,
+            1003,
+            966,
+            433,
+            263,
+            922,
+            46,
+            10,
+            10,
+            492,
+            922,
+            311,
+            1003,
+            966,
+            433,
+            263,
+            922,
+            46,
+            10,
+            10,
+            492,
+            922,
+            311,
+            583,
+            6712,
+            698,
+            263,
+            922,
+            46,
+            10,
+            10,
+            492,
+            922,
+            311,
+            1003,
+            966,
+            433
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " and the first number of the data.\n\nThe data of the data\n\nThe data is a little better than the data.\n\nThe data is more accurate than the data.\n\nThe data is very different from the data, but the data is very different from the data.\n\nThe data is very different from the data.\n\nThe data is very different from the data.\n\nThe data is more accurate than the data.\n\nThe data is very different from",
+          "full_text": "In a distant future, humanity discovered and the first number of the data.\n\nThe data of the data\n\nThe data is a little better than the data.\n\nThe data is more accurate than the data.\n\nThe data is very different from the data, but the data is very different from the data.\n\nThe data is very different from the data.\n\nThe data is very different from the data.\n\nThe data is more accurate than the data.\n\nThe data is very different from",
+          "full_text_sha256": "037c1f6e8b59cb61dee53f79a801d632eba4cd5df2f4a57381c61c3e1c94086f"
+        },
+        {
+          "prompt_id": "code",
+          "prompt": "def fibonacci(n):",
+          "prompt_token_ids": [
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            1000
+          ],
+          "completion_token_ids": [
+            292,
+            263,
+            303,
+            374,
+            45,
+            634,
+            1838,
+            314,
+            1125,
+            287,
+            263,
+            303,
+            374,
+            45,
+            634,
+            1838,
+            314,
+            476,
+            10,
+            10,
+            2164,
+            717,
+            331,
+            303,
+            374,
+            45,
+            634,
+            1838,
+            314,
+            292,
+            267,
+            300,
+            262,
+            486,
+            1728,
+            486,
+            3466,
+            486,
+            1728,
+            4694,
+            486,
+            1728,
+            4694,
+            486,
+            7123,
+            4694,
+            486,
+            7123,
+            4694,
+            486,
+            7123,
+            4694,
+            486,
+            7123,
+            4694,
+            486,
+            7123,
+            3466,
+            486,
+            7123,
+            4694,
+            486,
+            7123,
+            4694,
+            486,
+            2575,
+            4694,
+            486,
+            7123,
+            4694,
+            486,
+            2575,
+            4694,
+            486,
+            2575,
+            4363,
+            486,
+            2575,
+            6415,
+            486,
+            2575,
+            9295,
+            486,
+            2621,
+            286,
+            486,
+            2248,
+            486,
+            2575,
+            9295,
+            486,
+            2575,
+            1940,
+            486,
+            2575,
+            486,
+            1385,
+            486,
+            3783,
+            4363
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " and the nth-formcurve function in the nth-formcurve .\n\nthis work for nth-formcurve and octon - based - factor - based parameter - based parameter - dependent parameter - dependent parameter - dependent parameter - dependent parameter - dependent factor - dependent parameter - dependent parameter - required parameter - dependent parameter - required parameter - required item - required integer - required integers - types of -type - required integers - required values - required - type - useful item",
+          "full_text": "def fibonacci(n): and the nth-formcurve function in the nth-formcurve .\n\nthis work for nth-formcurve and octon - based - factor - based parameter - based parameter - dependent parameter - dependent parameter - dependent parameter - dependent parameter - dependent factor - dependent parameter - dependent parameter - required parameter - dependent parameter - required parameter - required item - required integer - required integers - types of -type - required integers - required values - required - type - useful item",
+          "full_text_sha256": "cd8fe88c64580c1496e44321bb3673980f8a6e4d630833103e617498c5c8bb8e"
+        }
+      ]
+    },
+    {
+      "revision_id": "r002",
+      "release": "Pollock 1.0",
+      "commit": "5e571cde09ef2d1124e13d1c31d0b75f8bd0e513",
+      "model_sha256": "2aada5b26abe9ce3b70af393d77be4ed1a799a7205b9c0dd5cfaff8bcaabce68",
+      "loaded_model_version": "1.0",
+      "results": [
+        {
+          "prompt_id": "general_knowledge",
+          "prompt": "The capital of France is",
+          "prompt_token_ids": [
+            492,
+            4514,
+            286,
+            4413,
+            311
+          ],
+          "completion_token_ids": [
+            263,
+            5020,
+            8996,
+            377,
+            1748,
+            381,
+            622,
+            101,
+            44,
+            257,
+            1389,
+            1341,
+            429,
+            614,
+            10368,
+            286,
+            421,
+            339,
+            874,
+            292,
+            587,
+            4007,
+            1907,
+            5646,
+            2605,
+            311,
+            6028,
+            290,
+            327,
+            1333,
+            1990,
+            44,
+            1024,
+            46,
+            10,
+            10,
+            750,
+            263,
+            613,
+            374,
+            2836,
+            44,
+            263,
+            2329,
+            400,
+            4262,
+            281,
+            685,
+            257,
+            10715,
+            1523,
+            46,
+            382,
+            3259,
+            1975,
+            2437,
+            263,
+            2329,
+            593,
+            290,
+            263,
+            2292,
+            286,
+            257,
+            10715,
+            1523,
+            46,
+            382,
+            4514,
+            400,
+            263,
+            5020,
+            8996,
+            377,
+            3391,
+            10769,
+            44,
+            355,
+            661,
+            4514,
+            405,
+            263,
+            5020,
+            8996,
+            729,
+            450,
+            478,
+            272,
+            46,
+            382,
+            2605,
+            400,
+            5007,
+            290,
+            1333,
+            1990,
+            44,
+            1024,
+            46,
+            10
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " the Palais de la Borde, a place called \"the Place of Funds and Stocks\". Its population is estimated to be around 30,000.\n\nIn the 19th century, the city was transformed into a municipality. The French government took the city up to the position of a municipality. The capital was the Palais de Valois, with its capital at the Palais des Gardes. The population was reduced to around 30,000.\n",
+          "full_text": "The capital of France is the Palais de la Borde, a place called \"the Place of Funds and Stocks\". Its population is estimated to be around 30,000.\n\nIn the 19th century, the city was transformed into a municipality. The French government took the city up to the position of a municipality. The capital was the Palais de Valois, with its capital at the Palais des Gardes. The population was reduced to around 30,000.\n",
+          "full_text_sha256": "181ebd0d98d96eb3c1693cb88f6f68db6bfcfc02ff791fd5885097a0cf3722a1"
+        },
+        {
+          "prompt_id": "explanation",
+          "prompt": "Photosynthesis is the process by which",
+          "prompt_token_ids": [
+            3712,
+            316,
+            394,
+            11580,
+            8310,
+            311,
+            263,
+            1170,
+            411,
+            506
+          ],
+          "completion_token_ids": [
+            3335,
+            292,
+            3620,
+            2663,
+            1514,
+            433,
+            8669,
+            46,
+            1769,
+            257,
+            2903,
+            7705,
+            1433,
+            44,
+            354,
+            5085,
+            1400,
+            263,
+            1433,
+            1514,
+            342,
+            2177,
+            433,
+            263,
+            2645,
+            46,
+            382,
+            1514,
+            433,
+            263,
+            2645,
+            311,
+            5085,
+            3136,
+            411,
+            263,
+            2903,
+            292,
+            311,
+            1812,
+            6487,
+            290,
+            263,
+            4551,
+            46,
+            757,
+            1514,
+            311,
+            806,
+            850,
+            331,
+            7918,
+            11580,
+            8310,
+            292,
+            311,
+            850,
+            290,
+            3371,
+            1796,
+            46,
+            10,
+            3712,
+            316,
+            394,
+            11580,
+            8310,
+            311,
+            263,
+            1170,
+            411,
+            506,
+            3335,
+            2663,
+            1514,
+            433,
+            8669,
+            46,
+            1769,
+            257,
+            2903,
+            5085,
+            1400,
+            263,
+            1433,
+            1514,
+            433,
+            263,
+            2645,
+            44,
+            354,
+            3919,
+            257,
+            1796,
+            2343,
+            46,
+            10,
+            492,
+            854,
+            1619
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " plants and animals obtain energy from sunlight. When a plant produces light, it absorbs the light energy that came from the sun. The energy from the sun is absorbed by the plant and is radiated to the leaves. This energy is then used for photosynthesis and is used to produce food.\nPhotosynthesis is the process by which plants obtain energy from sunlight. When a plant absorbs the light energy from the sun, it becomes a food source.\nThe most common",
+          "full_text": "Photosynthesis is the process by which plants and animals obtain energy from sunlight. When a plant produces light, it absorbs the light energy that came from the sun. The energy from the sun is absorbed by the plant and is radiated to the leaves. This energy is then used for photosynthesis and is used to produce food.\nPhotosynthesis is the process by which plants obtain energy from sunlight. When a plant absorbs the light energy from the sun, it becomes a food source.\nThe most common",
+          "full_text_sha256": "e8baa6567207b0afacc7aaf548b22b0226140171a96039a2652f8132de87d623"
+        },
+        {
+          "prompt_id": "story",
+          "prompt": "In a distant future, humanity discovered",
+          "prompt_token_ids": [
+            750,
+            257,
+            10103,
+            2629,
+            44,
+            12187,
+            4850
+          ],
+          "completion_token_ids": [
+            342,
+            263,
+            1811,
+            2131,
+            477,
+            560,
+            766,
+            694,
+            4768,
+            287,
+            1896,
+            411,
+            1072,
+            2395,
+            1473,
+            812,
+            324,
+            263,
+            972,
+            671,
+            342,
+            4827,
+            375,
+            4462,
+            290,
+            288,
+            325,
+            3772,
+            433,
+            5043,
+            290,
+            6946,
+            44,
+            292,
+            342,
+            548,
+            451,
+            1071,
+            257,
+            2086,
+            264,
+            8995,
+            286,
+            9340,
+            292,
+            10394,
+            46,
+            10,
+            492,
+            1811,
+            2131,
+            477,
+            1741,
+            44,
+            3139,
+            411,
+            282,
+            4546,
+            2030,
+            286,
+            4268,
+            433,
+            263,
+            1994,
+            286,
+            4652,
+            44,
+            3785,
+            271,
+            44,
+            311,
+            3006,
+            5465,
+            286,
+            263,
+            1811,
+            2131,
+            477,
+            290,
+            1374,
+            331,
+            263,
+            769,
+            45,
+            1008,
+            2131,
+            477,
+            45,
+            4929,
+            2939,
+            286,
+            2131,
+            9519,
+            9777,
+            433,
+            263,
+            2131,
+            477,
+            286,
+            842
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " that the human genome has only been growing in size by 2026—roughly the same time that humans are starting to migrate from Africa to Asia, and that they have made a fuller crop of corn and rice.\nThe human genome project, led by an international team of researchers from the University of California, Davis, is taking advantage of the human genome to allow for the first-ever genome-level analysis of genomic sequences from the genome of people",
+          "full_text": "In a distant future, humanity discovered that the human genome has only been growing in size by 2026—roughly the same time that humans are starting to migrate from Africa to Asia, and that they have made a fuller crop of corn and rice.\nThe human genome project, led by an international team of researchers from the University of California, Davis, is taking advantage of the human genome to allow for the first-ever genome-level analysis of genomic sequences from the genome of people",
+          "full_text_sha256": "c23e944af1cce79a84fcf44ec80625e93279df0d4816e664905ed1a6b3835897"
+        },
+        {
+          "prompt_id": "code",
+          "prompt": "def fibonacci(n):",
+          "prompt_token_ids": [
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            1000
+          ],
+          "completion_token_ids": [
+            470,
+            982,
+            303,
+            1001,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            45,
+            49,
+            6396,
+            50,
+            359,
+            10,
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            95,
+            3274,
+            40,
+            110,
+            1000,
+            470,
+            982,
+            303,
+            1001,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            45,
+            49,
+            6396,
+            50,
+            359,
+            10,
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            95,
+            3274,
+            95,
+            108,
+            3801,
+            40,
+            110,
+            1000,
+            470,
+            982,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            45,
+            49,
+            41,
+            1001,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            45,
+            50,
+            41,
+            359,
+            10,
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            95,
+            3274,
+            95,
+            108,
+            3801,
+            95,
+            116,
+            10440,
+            40,
+            110,
+            1000,
+            470,
+            982,
+            7545,
+            262,
+            387,
+            1659
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": "\n    return n * fibonacci(n-1)/2\n\n\ndef fibonacci_mat(n):\n    return n * fibonacci(n-1)/2\n\n\ndef fibonacci_mat_lcs(n):\n    return fibonacci(n-1) * fibonacci(n-2)\n\n\ndef fibonacci_mat_lcs_tuple(n):\n    return fibonacci",
+          "full_text": "def fibonacci(n):\n    return n * fibonacci(n-1)/2\n\n\ndef fibonacci_mat(n):\n    return n * fibonacci(n-1)/2\n\n\ndef fibonacci_mat_lcs(n):\n    return fibonacci(n-1) * fibonacci(n-2)\n\n\ndef fibonacci_mat_lcs_tuple(n):\n    return fibonacci",
+          "full_text_sha256": "2188bd0cdb6e8feccac9cb5817aa7c65666aba6ac163703542f6d0aaa297c9cb"
+        }
+      ]
+    },
+    {
+      "revision_id": "r003",
+      "release": "Pollock 1.1",
+      "commit": "698984b1d1b96c9b6ffaff00c7fc2e78e140e842",
+      "model_sha256": "3a9964a0ba5f6d20ef6061d2a7e4442c1b001209ebe80f7b7148a25573decaa9",
+      "loaded_model_version": "1.1",
+      "results": [
+        {
+          "prompt_id": "general_knowledge",
+          "prompt": "The capital of France is",
+          "prompt_token_ids": [
+            492,
+            4514,
+            286,
+            4413,
+            311
+          ],
+          "completion_token_ids": [
+            263,
+            3259,
+            2329,
+            286,
+            643,
+            384,
+            97,
+            392,
+            272,
+            44,
+            336,
+            263,
+            2855,
+            286,
+            263,
+            1506,
+            4873,
+            342,
+            400,
+            8425,
+            411,
+            263,
+            3259,
+            1266,
+            263,
+            3259,
+            8108,
+            46,
+            10,
+            10,
+            492,
+            4514,
+            286,
+            263,
+            3259,
+            4562,
+            311,
+            263,
+            4514,
+            286,
+            263,
+            8030,
+            286,
+            4413,
+            44,
+            1640,
+            5446,
+            654,
+            32,
+            433,
+            6703,
+            46,
+            10,
+            10,
+            8413,
+            10,
+            10,
+            492,
+            2329,
+            286,
+            643,
+            384,
+            97,
+            392,
+            272,
+            400,
+            2573,
+            411,
+            263,
+            3259,
+            8108,
+            552,
+            1975,
+            353,
+            263,
+            4514,
+            286,
+            4413,
+            46,
+            382,
+            2329,
+            400,
+            3476,
+            324,
+            3618,
+            932,
+            661,
+            1052,
+            264,
+            44,
+            491,
+            2507,
+            381,
+            471,
+            371,
+            268,
+            618,
+            44,
+            656,
+            400
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " the French city of Versailles, on the site of the old church that was destroyed by the French during the French Revolution.\n\nThe capital of the French Republic is the capital of the Kingdom of France, situated about  from Paris.\n\nHistory\n\nThe city of Versailles was created by the French Revolutionary government as the capital of France. The city was officially named after its founder, Jules Bourrienne, who was",
+          "full_text": "The capital of France is the French city of Versailles, on the site of the old church that was destroyed by the French during the French Revolution.\n\nThe capital of the French Republic is the capital of the Kingdom of France, situated about  from Paris.\n\nHistory\n\nThe city of Versailles was created by the French Revolutionary government as the capital of France. The city was officially named after its founder, Jules Bourrienne, who was",
+          "full_text_sha256": "249a398d82bd1888d4394fc04de3baee1902cd39b864d1c1cfe0b0a3d85e20e4"
+        },
+        {
+          "prompt_id": "explanation",
+          "prompt": "Photosynthesis is the process by which",
+          "prompt_token_ids": [
+            3712,
+            316,
+            394,
+            11580,
+            8310,
+            311,
+            263,
+            1170,
+            411,
+            506
+          ],
+          "completion_token_ids": [
+            263,
+            3335,
+            44,
+            263,
+            782,
+            6424,
+            44,
+            292,
+            602,
+            8900,
+            5820,
+            3781,
+            8726,
+            292,
+            1134,
+            685,
+            1514,
+            46,
+            10,
+            492,
+            710,
+            286,
+            7918,
+            11580,
+            8310,
+            353,
+            257,
+            2343,
+            286,
+            1514,
+            311,
+            1341,
+            7918,
+            11580,
+            8310,
+            46,
+            382,
+            1170,
+            311,
+            1516,
+            353,
+            7918,
+            11580,
+            8310,
+            46,
+            10,
+            45,
+            12238,
+            394,
+            11580,
+            8310,
+            311,
+            263,
+            1170,
+            411,
+            506,
+            263,
+            3335,
+            44,
+            378,
+            645,
+            602,
+            8900,
+            44,
+            5820,
+            3781,
+            8726,
+            292,
+            1134,
+            685,
+            1514,
+            46,
+            10,
+            45,
+            12238,
+            394,
+            11580,
+            8310,
+            311,
+            263,
+            1170,
+            411,
+            506,
+            263,
+            3335,
+            44,
+            378,
+            645,
+            602,
+            8900,
+            5820,
+            3781,
+            8726,
+            292,
+            1134,
+            685,
+            1514,
+            46,
+            10,
+            45
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " the plants, the fungi, and other organisms convert carbon dioxide and water into energy.\nThe use of photosynthesis as a source of energy is called photosynthesis. The process is known as photosynthesis.\n- Photosynthesis is the process by which the plants, or some other organisms, convert carbon dioxide and water into energy.\n- Photosynthesis is the process by which the plants, or some other organisms convert carbon dioxide and water into energy.\n-",
+          "full_text": "Photosynthesis is the process by which the plants, the fungi, and other organisms convert carbon dioxide and water into energy.\nThe use of photosynthesis as a source of energy is called photosynthesis. The process is known as photosynthesis.\n- Photosynthesis is the process by which the plants, or some other organisms, convert carbon dioxide and water into energy.\n- Photosynthesis is the process by which the plants, or some other organisms convert carbon dioxide and water into energy.\n-",
+          "full_text_sha256": "6522de510566b946a17e112bd872123306d17dfb270baf39439d4dd23ab6c371"
+        },
+        {
+          "prompt_id": "story",
+          "prompt": "In a distant future, humanity discovered",
+          "prompt_token_ids": [
+            750,
+            257,
+            10103,
+            2629,
+            44,
+            12187,
+            4850
+          ],
+          "completion_token_ids": [
+            342,
+            263,
+            1811,
+            4909,
+            311,
+            434,
+            766,
+            257,
+            2261,
+            44,
+            354,
+            311,
+            257,
+            2231,
+            12284,
+            2559,
+            342,
+            560,
+            1071,
+            426,
+            507,
+            1811,
+            46,
+            10,
+            492,
+            1811,
+            4909,
+            560,
+            638,
+            1405,
+            426,
+            257,
+            3255,
+            7469,
+            336,
+            263,
+            1217,
+            1333,
+            426,
+            46,
+            757,
+            7469,
+            311,
+            4263,
+            290,
+            3137,
+            263,
+            1811,
+            3045,
+            292,
+            263,
+            1811,
+            5469,
+            331,
+            913,
+            45,
+            115,
+            387,
+            114,
+            351,
+            561,
+            46,
+            757,
+            7469,
+            638,
+            3993,
+            426,
+            290,
+            1510,
+            263,
+            1217,
+            1333,
+            426,
+            353,
+            257,
+            2350,
+            292,
+            290,
+            1510,
+            9327,
+            46,
+            10,
+            750,
+            6962,
+            44,
+            263,
+            1811,
+            4909,
+            311,
+            257,
+            2481,
+            292,
+            910,
+            9804,
+            1725,
+            9923,
+            342,
+            560,
+            3881,
+            257
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " that the human race is not only a species, it is a supernatural force that has made us all human.\nThe human race has also given us a unique perspective on the world around us. This perspective is critical to understanding the human condition and the human capacity for self-sacrifice. This perspective also helps us to understand the world around us as a whole and to understand ourselves.\nIn conclusion, the human race is a complex and interconnected entity that has played a",
+          "full_text": "In a distant future, humanity discovered that the human race is not only a species, it is a supernatural force that has made us all human.\nThe human race has also given us a unique perspective on the world around us. This perspective is critical to understanding the human condition and the human capacity for self-sacrifice. This perspective also helps us to understand the world around us as a whole and to understand ourselves.\nIn conclusion, the human race is a complex and interconnected entity that has played a",
+          "full_text_sha256": "4028c3120d8711b29e7caabdb58128402b66088941d4718fb53267b69bfa9bac"
+        },
+        {
+          "prompt_id": "code",
+          "prompt": "def fibonacci(n):",
+          "prompt_token_ids": [
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            1000
+          ],
+          "completion_token_ids": [
+            470,
+            538,
+            406,
+            346,
+            45,
+            3592,
+            40,
+            120,
+            41,
+            470,
+            331,
+            962,
+            287,
+            2024,
+            40,
+            110,
+            1000,
+            508,
+            538,
+            406,
+            538,
+            784,
+            1758,
+            40,
+            120,
+            41,
+            470,
+            982,
+            538,
+            10,
+            10,
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            95,
+            955,
+            95,
+            115,
+            467,
+            40,
+            110,
+            1000,
+            470,
+            538,
+            406,
+            346,
+            45,
+            3592,
+            40,
+            120,
+            41,
+            470,
+            331,
+            962,
+            287,
+            2024,
+            40,
+            110,
+            1000,
+            508,
+            538,
+            406,
+            538,
+            1001,
+            4121,
+            46,
+            3368,
+            470,
+            982,
+            538,
+            10,
+            10,
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            95,
+            6262,
+            522,
+            40,
+            110,
+            1000,
+            470,
+            538,
+            406,
+            346,
+            45,
+            3592,
+            40,
+            120,
+            41,
+            470,
+            331,
+            962,
+            287,
+            2024,
+            40
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": "\n    res = 1-sum(x)\n    for i in range(n):\n        res = res + sum(x)\n    return res\n\ndef fibonacci_to_sine(n):\n    res = 1-sum(x)\n    for i in range(n):\n        res = res * math.pi\n    return res\n\ndef fibonacci_simple(n):\n    res = 1-sum(x)\n    for i in range(",
+          "full_text": "def fibonacci(n):\n    res = 1-sum(x)\n    for i in range(n):\n        res = res + sum(x)\n    return res\n\ndef fibonacci_to_sine(n):\n    res = 1-sum(x)\n    for i in range(n):\n        res = res * math.pi\n    return res\n\ndef fibonacci_simple(n):\n    res = 1-sum(x)\n    for i in range(",
+          "full_text_sha256": "f9a84f3921790df8fe9aad6d527ce9e5e0b9b7f7bb98df1d76e6766623227756"
+        }
+      ]
+    },
+    {
+      "revision_id": "r004",
+      "release": "Pollock 1.2",
+      "commit": "30feb81e5097eef13b939e1827d98e0458bf602d",
+      "model_sha256": "3c453f22d4bb70228e5cca79e183a425e0f0221e54bd782d12027c42c943c880",
+      "loaded_model_version": "1.2",
+      "results": [
+        {
+          "prompt_id": "general_knowledge",
+          "prompt": "The capital of France is",
+          "prompt_token_ids": [
+            492,
+            4514,
+            286,
+            4413,
+            311
+          ],
+          "completion_token_ids": [
+            263,
+            3259,
+            2329,
+            286,
+            643,
+            1861,
+            618,
+            46,
+            10,
+            10,
+            8413,
+            10,
+            10,
+            492,
+            2329,
+            400,
+            769,
+            4857,
+            287,
+            346,
+            1262,
+            56,
+            353,
+            643,
+            485,
+            99,
+            471,
+            116,
+            378,
+            381,
+            1518,
+            122,
+            1285,
+            46,
+            501,
+            1430,
+            4213,
+            354,
+            400,
+            5621,
+            496,
+            287,
+            263,
+            2329,
+            286,
+            643,
+            428,
+            195,
+            180,
+            1335,
+            46,
+            10,
+            10,
+            750,
+            887,
+            4739,
+            354,
+            400,
+            4088,
+            2440,
+            643,
+            485,
+            99,
+            471,
+            116,
+            46,
+            10,
+            10,
+            750,
+            887,
+            5308,
+            354,
+            400,
+            4088,
+            2440,
+            4349,
+            318,
+            471,
+            729,
+            369,
+            9322,
+            46,
+            10,
+            10,
+            750,
+            613,
+            3890,
+            354,
+            400,
+            4088,
+            2440,
+            4349,
+            318,
+            471,
+            729,
+            369,
+            9322,
+            46,
+            501,
+            613
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " the French city of Vienne.\n\nHistory\n\nThe city was first mentioned in 1188 as Viecourt or Bézier. In 1786 it was incorporated in the city of Vendôme.\n\nIn 1871 it was renamed Viecourt.\n\nIn 1883 it was renamed La Tour des Poids.\n\nIn 1959 it was renamed La Tour des Poids. In 19",
+          "full_text": "The capital of France is the French city of Vienne.\n\nHistory\n\nThe city was first mentioned in 1188 as Viecourt or Bézier. In 1786 it was incorporated in the city of Vendôme.\n\nIn 1871 it was renamed Viecourt.\n\nIn 1883 it was renamed La Tour des Poids.\n\nIn 1959 it was renamed La Tour des Poids. In 19",
+          "full_text_sha256": "c2a3e16019cac3e07a8c0d5426c41a359e53a105fb12349f5a1f8c2fc02b8be4"
+        },
+        {
+          "prompt_id": "explanation",
+          "prompt": "Photosynthesis is the process by which",
+          "prompt_token_ids": [
+            3712,
+            316,
+            394,
+            11580,
+            8310,
+            311,
+            263,
+            1170,
+            411,
+            506
+          ],
+          "completion_token_ids": [
+            3335,
+            292,
+            3620,
+            2663,
+            1514,
+            433,
+            8669,
+            46,
+            1769,
+            257,
+            1796,
+            2343,
+            311,
+            1494,
+            1473,
+            6618,
+            353,
+            257,
+            1796,
+            2343,
+            342,
+            4827,
+            375,
+            7144,
+            1473,
+            97,
+            1433,
+            2343,
+            311,
+            850,
+            290,
+            1649,
+            583,
+            1514,
+            46,
+            382,
+            1170,
+            286,
+            7918,
+            11580,
+            8310,
+            287,
+            3335,
+            311,
+            1341,
+            263,
+            1433,
+            45,
+            100,
+            8783,
+            8941,
+            46,
+            10,
+            65,
+            2903,
+            443,
+            327,
+            257,
+            2343,
+            286,
+            1514,
+            46,
+            757,
+            311,
+            1016,
+            642,
+            375,
+            2307,
+            1116,
+            5029,
+            2810,
+            331,
+            7918,
+            11580,
+            8310,
+            46,
+            382,
+            1433,
+            45,
+            100,
+            8783,
+            8941,
+            375,
+            1341,
+            2262,
+            316,
+            5208,
+            293,
+            8941,
+            46,
+            10,
+            2244,
+            375,
+            734,
+            2621,
+            286,
+            7918,
+            11580,
+            8310,
+            58
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " plants and animals obtain energy from sunlight. When a food source is present—such as a food source that humans are eating—a light source is used to create more energy. The process of photosynthesis in plants is called the light-dependent reactions.\nA plant can be a source of energy. This is because there are specialized structures needed for photosynthesis. The light-dependent reactions are called phototrophic reactions.\nThere are two types of photosynthesis:",
+          "full_text": "Photosynthesis is the process by which plants and animals obtain energy from sunlight. When a food source is present—such as a food source that humans are eating—a light source is used to create more energy. The process of photosynthesis in plants is called the light-dependent reactions.\nA plant can be a source of energy. This is because there are specialized structures needed for photosynthesis. The light-dependent reactions are called phototrophic reactions.\nThere are two types of photosynthesis:",
+          "full_text_sha256": "2487ed5406a8bd5c0251577bac47ea13897623bda4b6955aaa0ecf675b886ef9"
+        },
+        {
+          "prompt_id": "story",
+          "prompt": "In a distant future, humanity discovered",
+          "prompt_token_ids": [
+            750,
+            257,
+            10103,
+            2629,
+            44,
+            12187,
+            4850
+          ],
+          "completion_token_ids": [
+            342,
+            263,
+            1811,
+            4909,
+            311,
+            434,
+            766,
+            257,
+            2261,
+            286,
+            1811,
+            12125,
+            44,
+            520,
+            257,
+            2261,
+            286,
+            3620,
+            58,
+            354,
+            311,
+            1811,
+            12125,
+            656,
+            375,
+            434,
+            2573,
+            290,
+            327,
+            2869,
+            46,
+            382,
+            583,
+            1811,
+            12125,
+            548,
+            451,
+            44,
+            263,
+            583,
+            548,
+            451,
+            290,
+            327,
+            5965,
+            860,
+            730,
+            2111,
+            44,
+            292,
+            263,
+            583,
+            548,
+            375,
+            5965,
+            730,
+            1811,
+            12125,
+            46,
+            10,
+            45,
+            382,
+            3786,
+            2802,
+            10509,
+            10893,
+            923,
+            263,
+            1975,
+            433,
+            1435,
+            1069,
+            836,
+            4827,
+            331,
+            263,
+            6355,
+            286,
+            788,
+            1859,
+            544,
+            3710,
+            46,
+            382,
+            1498,
+            1633,
+            10893,
+            923,
+            263,
+            1975,
+            433,
+            1435,
+            1069,
+            836,
+            4292,
+            656,
+            311,
+            434,
+            257,
+            3613
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": " that the human race is not only a species of human beings, but a species of animals: it is human beings who are not created to be equal. The more human beings they have, the more they have to be treated just like others, and the more they are treated like human beings.\n- The First Amendment prohibits the government from impersonating humans for the purposes of defending their rights. The current law prohibits the government from impersonating anyone who is not a member",
+          "full_text": "In a distant future, humanity discovered that the human race is not only a species of human beings, but a species of animals: it is human beings who are not created to be equal. The more human beings they have, the more they have to be treated just like others, and the more they are treated like human beings.\n- The First Amendment prohibits the government from impersonating humans for the purposes of defending their rights. The current law prohibits the government from impersonating anyone who is not a member",
+          "full_text_sha256": "bbe8eec9552d2e6cbacd8d6047cec539fbfb81b18ca3f69f1774beb909702502"
+        },
+        {
+          "prompt_id": "code",
+          "prompt": "def fibonacci(n):",
+          "prompt_token_ids": [
+            1830,
+            7545,
+            262,
+            387,
+            1659,
+            40,
+            110,
+            1000
+          ],
+          "completion_token_ids": [
+            470,
+            2875,
+            470,
+            889,
+            4418,
+            303,
+            58,
+            382,
+            981,
+            286,
+            2632,
+            290,
+            354,
+            4859,
+            857,
+            263,
+            1405,
+            1304,
+            46,
+            470,
+            889,
+            5035,
+            58,
+            382,
+            981,
+            286,
+            2632,
+            290,
+            354,
+            4859,
+            857,
+            263,
+            1405,
+            1304,
+            46,
+            470,
+            2875,
+            470,
+            573,
+            303,
+            1577,
+            615,
+            58,
+            508,
+            982,
+            346,
+            470,
+            303,
+            406,
+            303,
+            784,
+            346,
+            470,
+            303,
+            95,
+            273,
+            384,
+            406,
+            615,
+            470,
+            1142,
+            303,
+            95,
+            273,
+            384,
+            669,
+            303,
+            58,
+            508,
+            303,
+            95,
+            273,
+            384,
+            5642,
+            346,
+            508,
+            573,
+            303,
+            95,
+            273,
+            384,
+            1577,
+            303,
+            58,
+            718,
+            982,
+            346,
+            508,
+            1873,
+            58,
+            718,
+            303,
+            406,
+            303,
+            784,
+            346,
+            508,
+            573,
+            303,
+            95
+          ],
+          "completion_tokens": 100,
+          "stopped_on_eos": false,
+          "completion": "\n    \"\"\"\n    :param n: The number of ways to iterate through the given list.\n    :return: The number of ways to iterate through the given list.\n    \"\"\"\n    if n == 0:\n        return 1\n    n = n + 1\n    n_iters = 0\n    while n_iters < n:\n        n_iters += 1\n        if n_iters == n:\n            return 1\n        else:\n            n = n + 1\n        if n_",
+          "full_text": "def fibonacci(n):\n    \"\"\"\n    :param n: The number of ways to iterate through the given list.\n    :return: The number of ways to iterate through the given list.\n    \"\"\"\n    if n == 0:\n        return 1\n    n = n + 1\n    n_iters = 0\n    while n_iters < n:\n        n_iters += 1\n        if n_iters == n:\n            return 1\n        else:\n            n = n + 1\n        if n_",
+          "full_text_sha256": "0b82389bac561dae528eb389dbde414eb2bb7c6bff7a0868d2acd276edb2ad88"
+        }
+      ]
+    }
+  ]
+}

release_manifest.json

@@ -1,9 +1,13 @@
 {
-  "schema_version": 2,
+  "schema_version": 3,
   "revision": 4,
   "revision_id": "r004",
   "release": "Pollock 1.2",
   "model_id": "SlayerLab/pollock-mini-lm-125m",
+  "publication": {
+    "weights_commit": "30feb81e5097eef13b939e1827d98e0458bf602d",
+    "version_tag": "v1.2"
+  },
   "source_checkpoint": {
     "path_in_training_workspace": "runs/pollock-r004-shape/checkpoints/ckpt-final.pt",
     "sha256": "4e38589ca422597ff808bc93cc17ddcc441f734a4e0f671ee6d4527c545972e0",
@@ -61,6 +65,21 @@
     "truncated_benchmark_requests": 80,
     "results_file": "benchmarks/english.json"
   },
+  "fixed_inference": {
+    "suite_id": "fixed-sampling-v1",
+    "comparison_file": "inference-samples/README.md",
+    "config_file": "inference-samples/config.json",
+    "generator_file": "inference-samples/generate.py",
+    "results_file": "inference-samples/results.json",
+    "operating_system": "macOS 26.2",
+    "architecture": "arm64",
+    "device": "cpu",
+    "dtype": "float32",
+    "seed": 1337,
+    "prompt_count": 4,
+    "revision_count": 4,
+    "exact_replay_verified": true
+  },
   "conversion": {
     "target_class": "GPT2LMHeadModel",
     "transformers_version": "5.15.1",
@@ -70,10 +89,18 @@
     "max_absolute_logit_error": 0.0
   },
   "artifacts": {
-    "README.md": {"sha256": "64513cc6cf3cdc52544a02010293c97b58683c815ef952815954b44fa2b15a0f"},
-    "CHANGELOG.md": {"sha256": "5203517a875ca3f04747305a80f732aca54a05ca132a4a4b4fb1453d9d2557ea"},
-    "training-history/r004.md": {"sha256": "d9893a5a9f998cfc93e986d63eb36c9a39f519e1cb74f7a6bf6ac4d3cf6f6f12"},
+    "README.md": {"sha256": "ca447af2254e4d9f7751846c9a13847b3fc71272698defed28c1d2e86361b073"},
+    "CHANGELOG.md": {"sha256": "07a0464037aea349ad57fd757b2d8afd9e47e8ed619e93c3a9fbe448d7c20a13"},
+    "training-history/r001.md": {"sha256": "d92d4a69a6cdfd0c913fcb7178419e54c95b17cbb8ef54c05069ae445cd366e5"},
+    "training-history/r002.md": {"sha256": "020d93dfbed0c3cd0d87bbba86db36076221f5449c03002d9842bd7ea0764284"},
+    "training-history/r003.md": {"sha256": "1a7ef327b3b228fd16083aeb7f7b051e23293eba796549e13de27f85bd61febd"},
+    "training-history/r004.md": {"sha256": "6b43afa0ba8b287fedd5bfd90599c9d0befda20a0ddfadac2ec77271431c5528"},
     "benchmarks/english.json": {"sha256": "ffe1e417bef440b1e6a84e05beccb96aa191f6f22141b388cc7ed08297318a7d"},
+    "inference-samples/README.md": {"sha256": "8000957912fae5540edfcc6ecc3ab59ac2bb8c35c696652b6ff83cfc237b139c"},
+    "inference-samples/config.json": {"sha256": "297ae12cd08188b1ff32df43d48f268d949aee8750290fb7d989df8ebc439ab9"},
+    "inference-samples/generate.py": {"sha256": "bda833ecad6b0343e57a212fe801590ed757d50e3a16a909e5acd40d7da7e3cf"},
+    "inference-samples/requirements.txt": {"sha256": "584583335ffb3061aa62058aee725b0de25fed7523904fbd13fb4622f601943d"},
+    "inference-samples/results.json": {"sha256": "5c626137a7493c1f9dfce76fe1ee2f52e4f02b2ce0c08e8c6f8779962ce15f76"},
     "config.json": {"sha256": "296c495f22edddb9828ff9c9ca486cddbacff510742f4aff6a04552d2da3b8d4"},
     "generation_config.json": {"sha256": "435beb27be51f0ed054f4a011e5109d125cdadc118b8799b18b155cc798d94d2"},
     "model.safetensors": {"sha256": "3c453f22d4bb70228e5cca79e183a425e0f0221e54bd782d12027c42c943c880"},

training-history/r001.md

@@ -2,7 +2,12 @@
 
 ## Identity
 
-`r001` is the first published experimental predecessor of Pollock 1.0. All values and samples in this file describe the r001 weights, not the current r002 weights.
+`r001` is the first published experimental predecessor of Pollock 1.0. All values and samples in this file describe the r001 weights, not the current r004 weights.
+
+| Field | Value |
+|---|---|
+| Published weights | [`5b8f82515c4e31d9a4a8a222eabdaab3ad5171b0`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5b8f82515c4e31d9a4a8a222eabdaab3ad5171b0) |
+| `model.safetensors` SHA-256 | `acaa1531322cce78ddb919700f173d4c6ea371185bea5052a3ae4c30f57b368e` |
 
 ## Architecture and tokenizer
 
@@ -47,7 +52,7 @@ Evaluation used BF16. No downstream benchmark suite was run for r001. Its valida
 
 ## Historical generation samples
 
-These four samples were produced by the **r001 predecessor weights** without cherry-picking. Seed 1337 was reset for each prompt; temperature was 0.7, top-k was 50, and generation was limited to 100 new tokens. Each prompt is included in its output.
+These four samples were produced by the **r001 predecessor weights** without cherry-picking. Seed 1337 was reset for each prompt; temperature was 0.7, top-k was 50, and generation was limited to 100 new tokens. Each prompt is included in its output. The complete runtime was not pinned, so these samples are preserved as historical evidence rather than used for direct cross-revision comparison.
 
 ### General knowledge
 
@@ -94,6 +99,10 @@ Prompt: `def fibonacci(n):`
 def fibonacci(n):)) = (n - 1) + (n - 1) + ( n - 1) + ( n - 2) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n - 1) + ( n
 ```
 
+## Fixed cross-revision inference reference
+
+The later [`fixed-sampling-v1`](../inference-samples/README.md) suite reruns the same four prompts on r001-r004 using immutable model commits, verified weight hashes, CPU float32, a pinned software environment, and exact output token IDs. Use that suite, rather than the historical samples above, for direct revision-to-revision comparison.
+
 ## Limitations
 
 r001 is an unaligned English base model with limited knowledge, reasoning, long-form coherence, and code quality. It may hallucinate or produce unsafe, biased, toxic, or training-like content. It is not intended for high-risk or production use. Dataset sources have different upstream terms; see the dataset card and [`../LICENSE.md`](../LICENSE.md).

training-history/r002.md

@@ -6,8 +6,10 @@
 |---|---|
 | Revision / release | `r002` / Pollock 1.0 |
 | Model ID | `SlayerLab/pollock-mini-lm-125m` |
+| Published weights | [`5e571cde09ef2d1124e13d1c31d0b75f8bd0e513`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/5e571cde09ef2d1124e13d1c31d0b75f8bd0e513) |
 | Source checkpoint | `runs/minimal-en-125m-4ep/ckpt.pt` |
 | Checkpoint iteration / SHA-256 | 22,004 / `026f54a390036b35792aa8fb131c8b0d394efb6d933753fb0e1257e55a67374b` |
+| `model.safetensors` SHA-256 | `2aada5b26abe9ce3b70af393d77be4ed1a799a7205b9c0dd5cfaff8bcaabce68` |
 | nanoGPT commit | `3adf61e` |
 | W&B run | [`hlbpqpoe`](https://wandb.ai/dawidmajewski-ezotic/minimal-en/runs/hlbpqpoe) |
 
@@ -101,6 +103,10 @@ All tasks used complete splits with `lm-evaluation-harness` 0.4.12, zero few-sho
 
 Raw logs: [`../logs/training.log`](../logs/training.log) and [`../logs/benchmark-english.log`](../logs/benchmark-english.log). Structured results: [`../benchmarks/english.json`](../benchmarks/english.json). Release metadata: [`../release_manifest.json`](../release_manifest.json).
 
+## Fixed inference reference
+
+The shared [`fixed-sampling-v1`](../inference-samples/README.md) suite loads r002 from its immutable published commit, verifies the weight hash above, and records the exact output token IDs for the same four prompts used across r001-r004.
+
 ## Licensing and limitations
 
 This is an English, unaligned base model, not an instruction-following assistant. It may hallucinate, generate harmful or biased content, and reproduce training patterns. It is unsuitable for high-risk or production decisions without independent safeguards. The dataset combines sources with different terms; see [`../LICENSE.md`](../LICENSE.md) and the dataset card.

training-history/r003.md

@@ -6,9 +6,11 @@
 |---|---|
 | Revision / release | `r003` / Pollock 1.1 |
 | Model ID | `SlayerLab/pollock-mini-lm-125m` |
+| Published weights | [`698984b1d1b96c9b6ffaff00c7fc2e78e140e842`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/698984b1d1b96c9b6ffaff00c7fc2e78e140e842) |
 | Source run | `runs/r003-lr4e-4-v4` |
 | Source checkpoint | `checkpoints/ckpt.pt` |
 | Checkpoint iteration / SHA-256 | 22,004 / `912483b44bb177c7a62fe19a53fc6db7b333cf881c57de15daf9dd7209d90a6b` |
+| `model.safetensors` SHA-256 | `3a9964a0ba5f6d20ef6061d2a7e4442c1b001209ebe80f7b7148a25573decaa9` |
 | Benchmark adapter SHA-256 | `0f53aa6b8454e856f8c4c489c7e6cbf207b8e124fe06bbb239315c017fe16fc0` |
 | nanoGPT commit | `3adf61e154c3fe3fca428ad6bc3818b27a3b8291` (dirty workspace recorded) |
 | W&B run | [`uro1w8l1`](https://wandb.ai/dawidmajewski-ezotic/minimal-en/runs/uro1w8l1) |
@@ -120,13 +122,17 @@ All seven primary scores improved over r002. LAMBADA perplexity decreased by 5.9
 
 Structured English results: [`../benchmarks/english.json`](../benchmarks/english.json).
 
+## Fixed inference reference
+
+The shared [`fixed-sampling-v1`](../inference-samples/README.md) suite loads r003 from its immutable published commit, verifies the weight hash above, and records the exact output token IDs for the same four prompts used across r001-r004.
+
 ## Release preparation status
 
 - Native training checkpoint verified against the backup archive.
 - Benchmark adapter hash verified against the benchmark result record.
 - Dataset, tokenizer, source snapshots, and fixed evaluation offsets are present.
 - Transformers 5.15.1 conversion is complete; the `[2, 64]` deterministic parity probe produced a maximum absolute logit error of 0.0, and artifact hashes are recorded in `release_manifest.json`.
-- No files have been uploaded to Hugging Face for this revision.
+- Published and remotely verified at [`698984b1d1b96c9b6ffaff00c7fc2e78e140e842`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/698984b1d1b96c9b6ffaff00c7fc2e78e140e842).
 
 ## Licensing and limitations
 

training-history/r004.md

@@ -6,9 +6,11 @@
 |---|---|
 | Revision / release | `r004` / Pollock 1.2 |
 | Model ID | `SlayerLab/pollock-mini-lm-125m` |
+| Published weights | [`30feb81e5097eef13b939e1827d98e0458bf602d`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/30feb81e5097eef13b939e1827d98e0458bf602d) |
 | Source run | `runs/pollock-r004-shape` |
 | Final checkpoint | `checkpoints/ckpt-final.pt` |
 | Final checkpoint update / SHA-256 | 22,004 / `4e38589ca422597ff808bc93cc17ddcc441f734a4e0f671ee6d4527c545972e0` |
+| `model.safetensors` SHA-256 | `3c453f22d4bb70228e5cca79e183a425e0f0221e54bd782d12027c42c943c880` |
 | Best-validation checkpoint | update 22,000 / `181673699af41ebd9e0c2b6517a0a3a0b8eb7111d35fc2884152ca5c4d20815c` |
 | nanoGPT commit | `3adf61e154c3fe3fca428ad6bc3818b27a3b8291` (dirty workspace recorded) |
 | W&B run | [`7aa623ae`](https://wandb.ai/dawidmajewski-ezotic/minimal-en/runs/7aa623ae) |
@@ -129,13 +131,17 @@ The deeper shape improves two primary metrics and reduces five. It does not supp
 
 Structured English results: [`../benchmarks/english.json`](../benchmarks/english.json).
 
+## Fixed inference reference
+
+The shared [`fixed-sampling-v1`](../inference-samples/README.md) suite loads r004 from its immutable published commit, verifies the weight hash above, and records the exact output token IDs for the same four prompts used across r001-r004.
+
 ## Release preparation status
 
 - The Zstandard backup passed integrity testing and was extracted successfully.
 - All 11 run-manifest file hashes and all three checkpoint hashes were verified after extraction.
 - Final training status, target budget, summary metrics, and English benchmark results are present.
 - Transformers 5.15.1 conversion is complete; the `[2, 64]` deterministic parity probe produced a maximum absolute logit error of 0.0, and artifact hashes are recorded in `release_manifest.json`.
-- No files have been uploaded to Hugging Face for this revision.
+- Published and remotely verified at [`30feb81e5097eef13b939e1827d98e0458bf602d`](https://huggingface.co/SlayerLab/pollock-mini-lm-125m/commit/30feb81e5097eef13b939e1827d98e0458bf602d).
 
 ## Licensing and limitations