Text Generation
Transformers
PyTorch
mistral
Not-For-All-Audiences
nsfw
text-generation-inference
Norquinal commited on
Commit
7af0c12
·
1 Parent(s): eaf593a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -10
README.md CHANGED
@@ -19,7 +19,7 @@ The dataset consists of 2800 samples, with the composition as follows:
19
  These samples were then back-filled using gpt-4/gpt-3.5-turbo-16k or otherwise converted to fit the prompt format.
20
 
21
  ## Prompt Format
22
- The model was finetuned with a prompt format similar to the original SuperHOT prototype:
23
  ```
24
  ---
25
  style: roleplay
@@ -54,12 +54,4 @@ Human: In your next reply, write at least two paragraphs. Be descriptive and imm
54
  [System note: Write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.]
55
  {{char}}:
56
  ```
57
- The third one seems to work the best. I would recommend experimenting with creating your own to best suit your needs.
58
-
59
- ## Finetuing Parameters
60
- - LoRA Rank: 64
61
- - LoRA Alpha: 16
62
- - LoRA Dropout: 0.1
63
- - BF16 Training
64
- - Cutoff Length: 2048
65
- - Training Epoch(s): 2
 
19
  These samples were then back-filled using gpt-4/gpt-3.5-turbo-16k or otherwise converted to fit the prompt format.
20
 
21
  ## Prompt Format
22
+ The model uses the following prompt format:
23
  ```
24
  ---
25
  style: roleplay
 
54
  [System note: Write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.]
55
  {{char}}:
56
  ```
57
+ The third one seems to work the best. I would recommend experimenting with creating your own to best suit your needs.