Hugging Face's logo

DeepDream2045
/
5098e4ea-3baa-466f-a147-7f46b679f708

PEFT
Safetensors
mistral
axolotl
Generated from Trainer
Model card Files
xet
 Community
DeepDream2045 commited on
Commit
9e93c36
·
verified ·
1 Parent(s): d8d1156

End of training

Browse files
Files changed (5) hide show
  1. README.md +3 -3
  2. adapter_config.json +2 -2
  3. adapter_model.bin +1 -1
  4. adapter_model.safetensors +1 -1
  5. training_args.bin +1 -1
README.md CHANGED
@@ -105,7 +105,7 @@ xformers_attention: true
105
 
106
  This model is a fine-tuned version of [Artples/L-MChat-7b](https://huggingface.co/Artples/L-MChat-7b) on the None dataset.
107
  It achieves the following results on the evaluation set:
108
- - Loss: 0.0398
109
 
110
  ## Model description
111
 
@@ -143,8 +143,8 @@ The following hyperparameters were used during training:
143
  | Training Loss | Epoch | Step | Validation Loss |
144
  |:-------------:|:------:|:----:|:---------------:|
145
  | 61.3338 | 0.0528 | 1 | 3.5628 |
146
- | 0.9758 | 1.3498 | 25 | 0.1138 |
147
- | 0.2619 | 2.6997 | 50 | 0.0398 |
148
 
149
 
150
  ### Framework versions
 
105
 
106
  This model is a fine-tuned version of [Artples/L-MChat-7b](https://huggingface.co/Artples/L-MChat-7b) on the None dataset.
107
  It achieves the following results on the evaluation set:
108
+ - Loss: 0.0373
109
 
110
  ## Model description
111
 
 
143
  | Training Loss | Epoch | Step | Validation Loss |
144
  |:-------------:|:------:|:----:|:---------------:|
145
  | 61.3338 | 0.0528 | 1 | 3.5628 |
146
+ | 0.8231 | 1.3498 | 25 | 0.0906 |
147
+ | 0.285 | 2.6997 | 50 | 0.0373 |
148
 
149
 
150
  ### Framework versions
adapter_config.json CHANGED
@@ -21,10 +21,10 @@
21
  "revision": null,
22
  "target_modules": [
23
  "k_proj",
24
- "down_proj",
25
- "gate_proj",
26
  "q_proj",
 
27
  "v_proj",
 
28
  "up_proj",
29
  "o_proj"
30
  ],
 
21
  "revision": null,
22
  "target_modules": [
23
  "k_proj",
 
 
24
  "q_proj",
25
+ "gate_proj",
26
  "v_proj",
27
+ "down_proj",
28
  "up_proj",
29
  "o_proj"
30
  ],
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ef8cf0cc5c6ef8f55312bbca3a4f5ef99a8984fd8f72267a8e2559fc1757a98b
3
  size 335706186
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8d3bf2b588a0c24356a19e37429f67fc1d3580ce7c610189c97635c043fc569
3
  size 335706186
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:020b5754070bfaf7eaf5513f8adb989bb64a52299a64a292eef6230e71963075
3
  size 335604696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3446403d2f0c7e1833fe69ae3f77b5a43536a61c7a2973ebdce45154acfcf01f
3
  size 335604696
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fce2681dc79991c6f33e2d27573b5f6d6f5cf0f1fcde8d296e5d63aeff6c313b
3
  size 6776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5dd421ee496f84b943e667379d94c279e81d013b511fd3641f3973aa3000a968
3
  size 6776