--- base_model: - mattshumer/Reflection-Llama-3.1-70B library_name: transformers tags: - mergekit - merge --- # reflection_bf16 Conversion from FP32 to BF16 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the Passthrough merge method using [mattshumer/Reflection-Llama-3.1-70B](https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B) as a base. ### Models Merged The following models were included in the merge: ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: mattshumer/Reflection-Llama-3.1-70B merge_method: passthrough base_model: mattshumer/Reflection-Llama-3.1-70B parameters: normalize: false int8_mask: true rescale: false dtype: float32 out_dtype: bfloat16 chat_template: llama3 tokenizer: source: union pad_to_multiple_of: 8 ```