---
base_model:
- Tarek07/Dungeonmaster-V2.2-Expanded-LLaMa-70B
- ReadyArt/L3.3-The-Omega-Directive-70B-Unslop-v2.0
- BruhzWater/Serpents-Tongue-L3.3-70b-0.3
- KaraKaraWitch/Llama-3.3-MagicalGirl-2
- ReadyArt/Forgotten-Safeword-70B-v5.0
- Delta-Vector/Plesio-70B
- BruhzWater/Sapphira-L3.3-70b-0.1
- KaraKaraWitch/oiiaioiiai-B
library_name: transformers
tags:
- mergekit
- merge

---
# FindYourSwordInThisLand-Llama-3.3-72b

![image/png](https://cdn-uploads.huggingface.co/production/uploads/633e85093a17ab61de8d9073/NPrDOh8ChtQm6OMZgF4Wj.png "Music that plays when you finetune a model for ERP.")

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Context

Not much going for this model. I saw a new model (`BruhzWater/Sapphira-L3.3-70b-0.1`, congratulations by the way) that ranked higher than SteelSkull's Nevoria.  
This merge uses my best scoring model `MagicalGirl 2` as base and included `Sapphira` and `Serpents Tongue` from the 2.  
Additionally, I'm trying out Tarek's Dungeonmaster's model in as well as 2 ReadyArt models. Delta Vector (Love ya mango)'s `Plesio` is included for the additional fun factor.  
Still not giving up hope with `oiiaioiiai-B`. So in it goes into the fire ring.  

The whole thing is strung together with hopes and prayers at 3am with an SCE merge.

I might do a UGI-Benchmark check later. But I doubt it would be any better than any of it's core components.

## Model Vibes

- It's very sloppy writing. I'm not entirely sure what went wrong here but... I think I might restart from scratch for this.

## Merge Details
### Merge Method

This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge method using [KaraKaraWitch/Llama-3.3-MagicalGirl-2](https://huggingface.co/KaraKaraWitch/Llama-3.3-MagicalGirl-2) as a base.

### Models Merged

The following models were included in the merge:
* [Tarek07/Dungeonmaster-V2.2-Expanded-LLaMa-70B](https://huggingface.co/Tarek07/Dungeonmaster-V2.2-Expanded-LLaMa-70B)
* [ReadyArt/L3.3-The-Omega-Directive-70B-Unslop-v2.0](https://huggingface.co/ReadyArt/L3.3-The-Omega-Directive-70B-Unslop-v2.0)
* [BruhzWater/Serpents-Tongue-L3.3-70b-0.3](https://huggingface.co/BruhzWater/Serpents-Tongue-L3.3-70b-0.3)
* [ReadyArt/Forgotten-Safeword-70B-v5.0](https://huggingface.co/ReadyArt/Forgotten-Safeword-70B-v5.0)
* [Delta-Vector/Plesio-70B](https://huggingface.co/Delta-Vector/Plesio-70B)
* [BruhzWater/Sapphira-L3.3-70b-0.1](https://huggingface.co/BruhzWater/Sapphira-L3.3-70b-0.1)
* [KaraKaraWitch/oiiaioiiai-B](https://huggingface.co/KaraKaraWitch/oiiaioiiai-B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml

models:
  - model: KaraKaraWitch/oiiaioiiai-B
  - model: ReadyArt/L3.3-The-Omega-Directive-70B-Unslop-v2.0
  - model: ReadyArt/Forgotten-Safeword-70B-v5.0
  - model: BruhzWater/Sapphira-L3.3-70b-0.1
  - model: BruhzWater/Serpents-Tongue-L3.3-70b-0.3
  - model: Tarek07/Dungeonmaster-V2.2-Expanded-LLaMa-70B
  - model: Delta-Vector/Plesio-70B


merge_method: sce
base_model: KaraKaraWitch/Llama-3.3-MagicalGirl-2

parameters:
  normalize: true
select_topk: 0.75
dtype: bfloat16
```