settings?
I too really love this model I can tell it has some serious potential (in my eyes. I know there's better haha), though I'm really struggling with the settings. What do you use for yours if you're willing to share. I found that
Temp = 1 (+/- ~.50)
Min P = 0.25
Tfs = 0.95 (i don't remember if I was the one that set this)
Repetition penalty = 1.8
Mirostat = tau 2, eta 0.1
Everything else off
Work enough to at least get it going with rather impressive dedication to its character, but it lacks the creativity I know it has while experimenting with it. I just cant find that Sweet spot to keep it creative, intelligent, and sane at the same time.
Howdy! I don't recommend using Mirostat, it's kind of obsolete now that Min P is a thing. The Repetition Penalty is definitely too high too, any Yi-based models like it low. Here are my settings that I use in my SillyTavern, they've been working wonderfully for me so far! Hope they'll help!
https://files.catbox.moe/mctzx7.json
Howdy! I don't recommend using Mirostat, it's kind of obsolete now that Min P is a thing.
I'll absolutely take a look at it once I have the time thank you very much! Yes I had heard many times that Mirostat was obsolete. I rarely used it to begin with but I found that using it in conjunction with a low MinP had intresting results so I kept it on (I know most people say one or the other not both). That's the fun of messing with sliders I guess haha.