msmth
/

Source-1

@@ -167,7 +167,7 @@ skip the trained scoring heads and give meaningless scores.
 ```bash
 pip install -U huggingface_hub            # provides the hf command
-hf download msmth/Source-1 --local-dir Source-1 --exclude "model.fp32.safetensors"
 cd Source-1
 pip install -r requirements.txt
 python source1.py --model . --input examples/sample.jsonl --output scores.jsonl --device cpu   # reproduces examples/expected_output.jsonl
@@ -227,7 +227,7 @@ python source1.py --model . --input page.txt --device cpu --precision fp32 --dty
   GPUs and in float32 elsewhere. float16 is not supported. In bfloat16, scores can shift by up to about 0.04
   depending on which texts share a batch; pass `dtype="fp32"` or `batch_tokens=1` to avoid that.
 - **Options.** `drop_line` sets your own drop rule, such as `"toxicity >= 4 or spam_seo >= 3 or boilerplate >= 4.5"`.
-  `max_chunks` scores only some chunks of very long documents, for speed. `revision` pins a Hub version. The command
   line reads JSONL, JSON or plain text (also gzip, bzip2 or xz compressed), and `python source1.py --help` lists
   every flag.
 - **Examples and speed.** `examples/` holds six documents and their expected CPU output. A GPU can differ by a few

 ```bash
 pip install -U huggingface_hub            # provides the hf command
+hf download msmth/Source-1 --revision v1.0.0 --local-dir Source-1 --exclude "model.fp32.safetensors"
 cd Source-1
 pip install -r requirements.txt
 python source1.py --model . --input examples/sample.jsonl --output scores.jsonl --device cpu   # reproduces examples/expected_output.jsonl
   GPUs and in float32 elsewhere. float16 is not supported. In bfloat16, scores can shift by up to about 0.04
   depending on which texts share a batch; pass `dtype="fp32"` or `batch_tokens=1` to avoid that.
 - **Options.** `drop_line` sets your own drop rule, such as `"toxicity >= 4 or spam_seo >= 3 or boilerplate >= 4.5"`.
+  `max_chunks` scores only some chunks of very long documents, for speed. `revision` pins a Hub version (for example `revision="v1.0.0"`). The command
   line reads JSONL, JSON or plain text (also gzip, bzip2 or xz compressed), and `python source1.py --help` lists
   every flag.
 - **Examples and speed.** `examples/` holds six documents and their expected CPU output. A GPU can differ by a few