Naphula commited on
Commit
dad98ed
·
verified ·
1 Parent(s): 5d146fe

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ```yaml
2
+ merge_method: ramplus_tl
3
+ base_model: C:\mergekit-main\merged_model_BloodKrakenMuse
4
+ models:
5
+ - model: C:\mergekit-main\merged_model_BloodKrakenMuse
6
+ - model: C:\mergekit-main\merged_model_RedKFlux
7
+ parameters:
8
+ epsilon: 0.001 # Increased from 1e-5 to 1e-3 for denser SFT/DPO task vectors
9
+ r: 0.25 # Increased from 0.1 to 0.2-0.3 for better SFT behavior preservation
10
+ alpha: 0.4 # Increased from 0.2 to 0.4 for enhanced rescaling
11
+ dtype: float32
12
+ out_dtype: bfloat16
13
+ tokenizer:
14
+ source: base
15
+ name: Stage7
16
+ ```