Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- lora
|
| 4 |
+
- comfyui
|
| 5 |
+
- music
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# MiniMax Music3 Reggae LoRA — ComfyUI-native keys (rank128, checkpoint-4000)
|
| 9 |
+
|
| 10 |
+
Key-converted version of [bghira/minimax-music-suno-reggae-rank128](https://huggingface.co/bghira/minimax-music-suno-reggae-rank128) (`checkpoint-4000/pytorch_lora_weights.safetensors`) for direct use with ComfyUI's native MiniMax Music3 LoRA loading.
|
| 11 |
+
|
| 12 |
+
The source checkpoint is a diffusers/PEFT-format LoRA with separate `to_q`/`to_k`/`to_v`/`to_out.0` projections. ComfyUI's `MiniMaxMusic3DiT` attention module (`comfy/ldm/minimax_music/dit.py`) uses a single fused `to_qkv` Linear instead, and `comfy/lora.py` has no diffusers-format key mapping or QKV-splitting logic for this architecture — so the original file's keys never match and none of the LoRA loads.
|
| 13 |
+
|
| 14 |
+
This file renames/restructures the weights to ComfyUI's native key scheme:
|
| 15 |
+
|
| 16 |
+
- `to_out.0.lora_A/B.weight` → `diffusion_model.diffusion_transformer.transformer.layers.{i}.self_attn.to_out.lora_A/B.weight` (direct copy, shapes already match)
|
| 17 |
+
- `to_q`/`to_k`/`to_v` LoRAs are fused into a single `...self_attn.to_qkv.lora_A/B.weight` pair matching the target module's combined QKV Linear (`out_features = dim * 3`). This uses a block-diagonal construction on `lora_B` (row-stacked `lora_A`, block-diagonal `lora_B`) so the merged low-rank update reproduces each of the original per-branch `B_q @ A_q`, `B_k @ A_k`, `B_v @ A_v` deltas exactly in the corresponding q/k/v output rows — verified numerically against the source weights (max abs error 0.0 in bf16).
|
| 18 |
+
|
| 19 |
+
Single flat `.safetensors` file, no diffusers-style subdirectories — drop it in `ComfyUI/models/loras/` and use it with ComfyUI's `LoraLoaderModelOnly`/`LoraLoader` node against a MiniMax Music3 model.
|