This is a fine-tuned model for a character.ai-like chatting app called OCTxT This is one v1.5 and it is: trained off 16.67~% of sfw & nsfw roleplay forums known as bluemoonroleplaying.
dataset used: rickRossie/bluemoon_roleplay_chat_data_300k_messages
I'll be updating this model with more of the dataset over time as I upgrade my system. this model is very very lightweight and the system used to train took around 40~ minutes, my specs are: GTX 1060 6GB (with CUDA), Ryzen 5 4600G
the tokenizer currently has two special tokens: "<|roleplay|>" and "<|endoftext|>"
NOTE: the model by default is extremely horny! please take this in mind when doing prompt engineering with this model
- Downloads last month
- 2
Model tree for laymglitched/octxt-llm-one
Base model
EleutherAI/pythia-1.4b