bghira commited on
Commit
e8d70f6
·
verified ·
1 Parent(s): 5bbaf1b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - lora
4
+ - comfyui
5
+ - music
6
+ ---
7
+
8
+ # MiniMax Music3 Reggae LoRA — ComfyUI-native keys (rank128, checkpoint-4000)
9
+
10
+ Key-converted version of [bghira/minimax-music-suno-reggae-rank128](https://huggingface.co/bghira/minimax-music-suno-reggae-rank128) (`checkpoint-4000/pytorch_lora_weights.safetensors`) for direct use with ComfyUI's native MiniMax Music3 LoRA loading.
11
+
12
+ The source checkpoint is a diffusers/PEFT-format LoRA with separate `to_q`/`to_k`/`to_v`/`to_out.0` projections. ComfyUI's `MiniMaxMusic3DiT` attention module (`comfy/ldm/minimax_music/dit.py`) uses a single fused `to_qkv` Linear instead, and `comfy/lora.py` has no diffusers-format key mapping or QKV-splitting logic for this architecture — so the original file's keys never match and none of the LoRA loads.
13
+
14
+ This file renames/restructures the weights to ComfyUI's native key scheme:
15
+
16
+ - `to_out.0.lora_A/B.weight` → `diffusion_model.diffusion_transformer.transformer.layers.{i}.self_attn.to_out.lora_A/B.weight` (direct copy, shapes already match)
17
+ - `to_q`/`to_k`/`to_v` LoRAs are fused into a single `...self_attn.to_qkv.lora_A/B.weight` pair matching the target module's combined QKV Linear (`out_features = dim * 3`). This uses a block-diagonal construction on `lora_B` (row-stacked `lora_A`, block-diagonal `lora_B`) so the merged low-rank update reproduces each of the original per-branch `B_q @ A_q`, `B_k @ A_k`, `B_v @ A_v` deltas exactly in the corresponding q/k/v output rows — verified numerically against the source weights (max abs error 0.0 in bf16).
18
+
19
+ Single flat `.safetensors` file, no diffusers-style subdirectories — drop it in `ComfyUI/models/loras/` and use it with ComfyUI's `LoraLoaderModelOnly`/`LoraLoader` node against a MiniMax Music3 model.