kaiokendev
/

superhot-13b-16k-no-rlhf-test

Model card Files Files and versions

kaiokendev commited on Jun 26, 2023

Commit

44b5268

·

1 Parent(s): b8e6174

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ Tests have shown that the model does indeed leverage the extended context at 8K,
 #### Using the monkey-patch?
 You will need to **use either the monkeypatch** or, if you are already using the monkeypatch, **change the scaling factor to 0.125 and the maximum sequence length to 16384**
-#### Using Oobabooga or Exllama?
 - `python server.py --max_seq_len 16384 --compress_pos_emb 8 --loader exllama_hf`
 I trained the LoRA with the following configuration:

 #### Using the monkey-patch?
 You will need to **use either the monkeypatch** or, if you are already using the monkeypatch, **change the scaling factor to 0.125 and the maximum sequence length to 16384**
+#### Using Oobabooga with Exllama?
 - `python server.py --max_seq_len 16384 --compress_pos_emb 8 --loader exllama_hf`
 I trained the LoRA with the following configuration: