llama_print_build_info: build = 1 (62061f910) llama_print_build_info: built with GNU 13.3.0 for Linux x86_64 llama_quantize: calculating quantization size for '/root/qwen38_bf16/BF16/Qwen3.8-27B-BF16-00001-of-00002.gguf' as IQ1_M using 16 threads llama_model_loader: additional 1 GGUFs metadata loaded. llama_model_loader: loaded meta data with 50 key-value pairs and 866 tensors from /root/qwen38_bf16/BF16/Qwen3.8-27B-BF16-00001-of-00002.gguf (version GGUF V3 (latest)) llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. llama_model_loader: - kv 0: general.architecture str = qwen35 llama_model_loader: - kv 1: general.type str = model llama_model_loader: - kv 2: general.sampling.top_k i32 = 20 llama_model_loader: - kv 3: general.sampling.top_p f32 = 0.950000 llama_model_loader: - kv 4: general.sampling.temp f32 = 1.000000 llama_model_loader: - kv 5: general.name str = Qwen3.8-27B llama_model_loader: - kv 6: general.basename str = Qwen3.8-27B llama_model_loader: - kv 7: general.description str = Renewal of the beloved Qwen model, de... llama_model_loader: - kv 8: general.quantized_by str = Unsloth llama_model_loader: - kv 9: general.size_label str = 27B llama_model_loader: - kv 10: general.license str = apache-2.0 llama_model_loader: - kv 11: general.repo_url str = https://huggingface.co/unsloth llama_model_loader: - kv 12: general.base_model.count u32 = 1 llama_model_loader: - kv 13: general.base_model.0.name str = Qwen3.8 27B llama_model_loader: - kv 14: general.base_model.0.organization str = Qwen llama_model_loader: - kv 15: general.base_model.0.repo_url str = https://huggingface.co/Qwen/Qwen3.8-27B llama_model_loader: - kv 16: general.tags arr[str,1] = ["unsloth"] llama_model_loader: - kv 17: qwen35.block_count u32 = 65 llama_model_loader: - kv 18: qwen35.context_length u32 = 262144 llama_model_loader: - kv 19: qwen35.embedding_length u32 = 5120 llama_model_loader: - kv 20: qwen35.feed_forward_length u32 = 17408 llama_model_loader: - kv 21: qwen35.attention.head_count u32 = 24 llama_model_loader: - kv 22: qwen35.attention.head_count_kv u32 = 4 llama_model_loader: - kv 23: qwen35.rope.dimension_sections arr[i32,4] = [11, 11, 10, 0] llama_model_loader: - kv 24: qwen35.rope.freq_base f32 = 10000000.000000 llama_model_loader: - kv 25: qwen35.attention.layer_norm_rms_epsilon f32 = 0.000001 llama_model_loader: - kv 26: qwen35.attention.key_length u32 = 256 llama_model_loader: - kv 27: qwen35.attention.value_length u32 = 256 llama_model_loader: - kv 28: general.file_type u32 = 32 llama_model_loader: - kv 29: qwen35.nextn_predict_layers u32 = 1 llama_model_loader: - kv 30: qwen35.ssm.conv_kernel u32 = 4 llama_model_loader: - kv 31: qwen35.ssm.state_size u32 = 128 llama_model_loader: - kv 32: qwen35.ssm.group_count u32 = 16 llama_model_loader: - kv 33: qwen35.ssm.time_step_rank u32 = 48 llama_model_loader: - kv 34: qwen35.ssm.inner_size u32 = 6144 llama_model_loader: - kv 35: qwen35.full_attention_interval u32 = 4 llama_model_loader: - kv 36: qwen35.rope.dimension_count u32 = 64 llama_model_loader: - kv 37: general.quantization_version u32 = 2 llama_model_loader: - kv 38: tokenizer.ggml.model str = gpt2 llama_model_loader: - kv 39: tokenizer.ggml.pre str = qwen35 llama_model_loader: - kv 40: tokenizer.ggml.tokens arr[str,248320] = ["!", "\"", "#", "$", "%", "&", "'", ... llama_model_loader: - kv 41: tokenizer.ggml.token_type arr[i32,248320] = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ... llama_model_loader: - kv 42: tokenizer.ggml.merges arr[str,247587] = ["Ġ Ġ", "ĠĠ ĠĠ", "i n", "Ġ t",... llama_model_loader: - kv 43: tokenizer.ggml.eos_token_id u32 = 248046 llama_model_loader: - kv 44: tokenizer.ggml.padding_token_id u32 = 248055 llama_model_loader: - kv 45: tokenizer.ggml.bos_token_id u32 = 248044 llama_model_loader: - kv 46: split.no u16 = 0 llama_model_loader: - kv 47: split.count u16 = 2 llama_model_loader: - kv 48: split.tensors.count i32 = 866 llama_model_loader: - kv 49: tokenizer.chat_template str = {%- set image_count = namespace(value... llama_model_loader: - type f32: 360 tensors llama_model_loader: - type bf16: 506 tensors llama_model_quantize_impl: have importance matrix data with 496 entries llama_tensor_get_type: blk.64.attn_k.weight - applying manual override: iq1_m -> q4_K llama_tensor_get_type: blk.64.attn_output.weight - applying manual override: iq1_m -> q4_K llama_tensor_get_type: blk.64.attn_q.weight - applying manual override: iq1_m -> q4_K llama_tensor_get_type: blk.64.attn_v.weight - applying manual override: iq1_m -> q4_K llama_tensor_get_type: blk.64.ffn_down.weight - applying manual override: iq1_m -> q4_K llama_tensor_get_type: blk.64.ffn_gate.weight - applying manual override: iq1_m -> q4_K llama_tensor_get_type: blk.64.ffn_up.weight - applying manual override: iq1_m -> q4_K llama_tensor_get_type: blk.64.nextn.eh_proj.weight - applying manual override: iq1_m -> q4_K [ 1/ 866] output.weight - [ 5120, 248320, 1, 1], type = bf16, size = 2425.00 MiB -> 833.59 MiB (q5_K) [ 2/ 866] output_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 3/ 866] token_embd.weight - [ 5120, 248320, 1, 1], type = bf16, size = 2425.00 MiB -> 397.85 MiB (q2_K) [ 4/ 866] blk.0.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 5/ 866] blk.0.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 6/ 866] blk.0.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 7/ 866] blk.0.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 8/ 866] blk.0.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 9/ 866] blk.0.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 10/ 866] blk.0.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 11/ 866] blk.0.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 12/ 866] blk.0.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 13/ 866] blk.0.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 14/ 866] blk.0.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 15/ 866] blk.0.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 16/ 866] blk.0.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 17/ 866] blk.0.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 18/ 866] blk.1.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 19/ 866] blk.1.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 20/ 866] blk.1.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 21/ 866] blk.1.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 22/ 866] blk.1.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 23/ 866] blk.1.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 24/ 866] blk.1.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 25/ 866] blk.1.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 26/ 866] blk.1.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 27/ 866] blk.1.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 28/ 866] blk.1.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 29/ 866] blk.1.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 30/ 866] blk.1.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 31/ 866] blk.1.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 32/ 866] blk.2.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 33/ 866] blk.2.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 34/ 866] blk.2.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 35/ 866] blk.2.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 36/ 866] blk.2.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 37/ 866] blk.2.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 38/ 866] blk.2.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 39/ 866] blk.2.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 40/ 866] blk.2.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 41/ 866] blk.2.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 42/ 866] blk.2.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 43/ 866] blk.2.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 44/ 866] blk.2.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 45/ 866] blk.2.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 46/ 866] blk.3.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 47/ 866] blk.3.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 48/ 866] blk.3.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 49/ 866] blk.3.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 50/ 866] blk.3.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 51/ 866] blk.3.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 52/ 866] blk.3.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 53/ 866] blk.3.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 54/ 866] blk.3.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 55/ 866] blk.3.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 56/ 866] blk.3.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 57/ 866] blk.4.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 58/ 866] blk.4.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 59/ 866] blk.4.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 60/ 866] blk.4.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 61/ 866] blk.4.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 62/ 866] blk.4.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 63/ 866] blk.4.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 64/ 866] blk.4.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 65/ 866] blk.4.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 66/ 866] blk.4.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 67/ 866] blk.4.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 68/ 866] blk.4.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 69/ 866] blk.4.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 70/ 866] blk.4.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 71/ 866] blk.5.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 72/ 866] blk.5.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 73/ 866] blk.5.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 74/ 866] blk.5.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 75/ 866] blk.5.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 76/ 866] blk.5.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 77/ 866] blk.5.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 78/ 866] blk.5.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 79/ 866] blk.5.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 80/ 866] blk.5.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 81/ 866] blk.5.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 82/ 866] blk.5.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 83/ 866] blk.5.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 84/ 866] blk.5.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 85/ 866] blk.6.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 86/ 866] blk.6.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 87/ 866] blk.6.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 88/ 866] blk.6.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 89/ 866] blk.6.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 90/ 866] blk.6.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 91/ 866] blk.6.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 92/ 866] blk.6.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 93/ 866] blk.6.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 94/ 866] blk.6.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 95/ 866] blk.6.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 96/ 866] blk.6.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 97/ 866] blk.6.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 98/ 866] blk.6.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 99/ 866] blk.7.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 100/ 866] blk.7.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 101/ 866] blk.7.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 102/ 866] blk.7.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 103/ 866] blk.7.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 104/ 866] blk.7.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 105/ 866] blk.7.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 106/ 866] blk.7.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 27.89 MiB (q2_K) [ 107/ 866] blk.7.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 108/ 866] blk.7.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 109/ 866] blk.7.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 110/ 866] blk.8.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 111/ 866] blk.8.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 112/ 866] blk.8.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 113/ 866] blk.8.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 114/ 866] blk.8.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 115/ 866] blk.8.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 116/ 866] blk.8.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 117/ 866] blk.8.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 118/ 866] blk.8.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 119/ 866] blk.8.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 120/ 866] blk.8.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 121/ 866] blk.8.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 122/ 866] blk.8.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 123/ 866] blk.8.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 124/ 866] blk.9.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 125/ 866] blk.9.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 126/ 866] blk.9.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 127/ 866] blk.9.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 128/ 866] blk.9.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 129/ 866] blk.9.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 130/ 866] blk.9.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 131/ 866] blk.9.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 132/ 866] blk.9.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 133/ 866] blk.9.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 134/ 866] blk.9.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 135/ 866] blk.9.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 136/ 866] blk.9.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 137/ 866] blk.9.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 138/ 866] blk.10.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 139/ 866] blk.10.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 140/ 866] blk.10.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 141/ 866] blk.10.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 142/ 866] blk.10.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 143/ 866] blk.10.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 144/ 866] blk.10.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 145/ 866] blk.10.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 146/ 866] blk.10.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 147/ 866] blk.10.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 148/ 866] blk.10.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 149/ 866] blk.10.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 150/ 866] blk.10.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 151/ 866] blk.10.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 152/ 866] blk.11.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 153/ 866] blk.11.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 154/ 866] blk.11.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 155/ 866] blk.11.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 156/ 866] blk.11.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 157/ 866] blk.11.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 158/ 866] blk.11.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 159/ 866] blk.11.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 160/ 866] blk.11.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 161/ 866] blk.11.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 162/ 866] blk.11.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 163/ 866] blk.12.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 164/ 866] blk.12.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 165/ 866] blk.12.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 166/ 866] blk.12.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 167/ 866] blk.12.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 168/ 866] blk.12.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 169/ 866] blk.12.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 170/ 866] blk.12.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 171/ 866] blk.12.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 172/ 866] blk.12.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 173/ 866] blk.12.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 174/ 866] blk.12.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 175/ 866] blk.12.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 176/ 866] blk.12.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 177/ 866] blk.13.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 178/ 866] blk.13.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 179/ 866] blk.13.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 180/ 866] blk.13.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 181/ 866] blk.13.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 182/ 866] blk.13.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 183/ 866] blk.13.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 184/ 866] blk.13.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 185/ 866] blk.13.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 186/ 866] blk.13.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 187/ 866] blk.13.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 188/ 866] blk.13.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 189/ 866] blk.13.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 190/ 866] blk.13.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 191/ 866] blk.14.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 192/ 866] blk.14.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 193/ 866] blk.14.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 194/ 866] blk.14.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 195/ 866] blk.14.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 196/ 866] blk.14.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 197/ 866] blk.14.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 198/ 866] blk.14.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 199/ 866] blk.14.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 200/ 866] blk.14.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 201/ 866] blk.14.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 202/ 866] blk.14.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 203/ 866] blk.14.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 204/ 866] blk.14.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 205/ 866] blk.15.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 206/ 866] blk.15.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 207/ 866] blk.15.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 208/ 866] blk.15.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 209/ 866] blk.15.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 210/ 866] blk.15.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 211/ 866] blk.15.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 212/ 866] blk.15.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 213/ 866] blk.15.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 214/ 866] blk.15.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 215/ 866] blk.15.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 216/ 866] blk.16.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 217/ 866] blk.16.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 218/ 866] blk.16.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 219/ 866] blk.16.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 220/ 866] blk.16.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 221/ 866] blk.16.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 222/ 866] blk.16.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 223/ 866] blk.16.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 224/ 866] blk.16.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 225/ 866] blk.16.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 226/ 866] blk.16.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 227/ 866] blk.16.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 228/ 866] blk.16.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 229/ 866] blk.16.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 230/ 866] blk.17.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 231/ 866] blk.17.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 232/ 866] blk.17.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 233/ 866] blk.17.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 234/ 866] blk.17.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 235/ 866] blk.17.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 236/ 866] blk.17.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 237/ 866] blk.17.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 238/ 866] blk.17.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 239/ 866] blk.17.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 240/ 866] blk.17.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 241/ 866] blk.17.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 242/ 866] blk.17.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 243/ 866] blk.17.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 244/ 866] blk.18.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 245/ 866] blk.18.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 246/ 866] blk.18.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 247/ 866] blk.18.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 248/ 866] blk.18.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 249/ 866] blk.18.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 250/ 866] blk.18.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 251/ 866] blk.18.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 252/ 866] blk.18.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 253/ 866] blk.18.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 254/ 866] blk.18.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 255/ 866] blk.18.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 256/ 866] blk.18.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 257/ 866] blk.18.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 258/ 866] blk.19.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 259/ 866] blk.19.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 260/ 866] blk.19.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 261/ 866] blk.19.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 262/ 866] blk.19.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 263/ 866] blk.19.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 264/ 866] blk.19.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 265/ 866] blk.19.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 266/ 866] blk.19.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 267/ 866] blk.19.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 268/ 866] blk.19.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 269/ 866] blk.20.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 270/ 866] blk.20.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 271/ 866] blk.20.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 272/ 866] blk.20.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 273/ 866] blk.20.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 274/ 866] blk.20.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 275/ 866] blk.20.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 276/ 866] blk.20.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 277/ 866] blk.20.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 278/ 866] blk.20.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 279/ 866] blk.20.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 280/ 866] blk.20.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 281/ 866] blk.20.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 282/ 866] blk.20.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 283/ 866] blk.21.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 284/ 866] blk.21.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 285/ 866] blk.21.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 286/ 866] blk.21.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 287/ 866] blk.21.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 288/ 866] blk.21.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 289/ 866] blk.21.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 290/ 866] blk.21.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 291/ 866] blk.21.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 292/ 866] blk.21.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 293/ 866] blk.21.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 294/ 866] blk.21.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 295/ 866] blk.21.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 296/ 866] blk.21.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 297/ 866] blk.22.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 298/ 866] blk.22.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 299/ 866] blk.22.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 300/ 866] blk.22.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 301/ 866] blk.22.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 302/ 866] blk.22.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 303/ 866] blk.22.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 304/ 866] blk.22.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 305/ 866] blk.22.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 306/ 866] blk.22.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 307/ 866] blk.22.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 308/ 866] blk.22.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 309/ 866] blk.22.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 310/ 866] blk.22.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 311/ 866] blk.23.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 312/ 866] blk.23.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 313/ 866] blk.23.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 314/ 866] blk.23.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 315/ 866] blk.23.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 316/ 866] blk.23.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 317/ 866] blk.23.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 318/ 866] blk.23.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 319/ 866] blk.23.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 320/ 866] blk.23.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 321/ 866] blk.23.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 322/ 866] blk.24.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 323/ 866] blk.24.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 324/ 866] blk.24.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 325/ 866] blk.24.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 326/ 866] blk.24.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 327/ 866] blk.24.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 328/ 866] blk.24.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 329/ 866] blk.24.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 330/ 866] blk.24.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 331/ 866] blk.24.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 332/ 866] blk.24.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 333/ 866] blk.24.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 334/ 866] blk.24.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 335/ 866] blk.24.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 336/ 866] blk.25.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 337/ 866] blk.25.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 338/ 866] blk.25.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 339/ 866] blk.25.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 340/ 866] blk.25.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 341/ 866] blk.25.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 342/ 866] blk.25.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 343/ 866] blk.25.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 344/ 866] blk.25.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 345/ 866] blk.25.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 346/ 866] blk.25.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 347/ 866] blk.25.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 348/ 866] blk.25.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 349/ 866] blk.25.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 350/ 866] blk.26.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 351/ 866] blk.26.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 352/ 866] blk.26.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 353/ 866] blk.26.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 354/ 866] blk.26.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 355/ 866] blk.26.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 356/ 866] blk.26.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 357/ 866] blk.26.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 358/ 866] blk.26.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 359/ 866] blk.26.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 360/ 866] blk.26.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 361/ 866] blk.26.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 362/ 866] blk.26.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 363/ 866] blk.26.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 364/ 866] blk.27.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 365/ 866] blk.27.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 366/ 866] blk.27.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 367/ 866] blk.27.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 368/ 866] blk.27.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 369/ 866] blk.27.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 370/ 866] blk.27.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 371/ 866] blk.27.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 372/ 866] blk.27.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 373/ 866] blk.27.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 374/ 866] blk.27.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 375/ 866] blk.28.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 376/ 866] blk.28.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 377/ 866] blk.28.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 378/ 866] blk.28.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 379/ 866] blk.28.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 380/ 866] blk.28.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 381/ 866] blk.28.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 382/ 866] blk.28.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 383/ 866] blk.28.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 384/ 866] blk.28.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 385/ 866] blk.28.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 386/ 866] blk.28.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 387/ 866] blk.28.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 388/ 866] blk.28.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 389/ 866] blk.29.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 390/ 866] blk.29.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 391/ 866] blk.29.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 392/ 866] blk.29.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 393/ 866] blk.29.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 394/ 866] blk.29.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 395/ 866] blk.29.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 396/ 866] blk.29.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 397/ 866] blk.29.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 398/ 866] blk.29.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 399/ 866] blk.29.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 400/ 866] blk.29.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 401/ 866] blk.29.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 402/ 866] blk.29.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 403/ 866] blk.30.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 404/ 866] blk.30.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 405/ 866] blk.30.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 406/ 866] blk.30.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 407/ 866] blk.30.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 408/ 866] blk.30.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 409/ 866] blk.30.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 410/ 866] blk.30.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 411/ 866] blk.30.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 412/ 866] blk.30.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 413/ 866] blk.30.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 414/ 866] blk.30.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 415/ 866] blk.30.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 416/ 866] blk.30.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 417/ 866] blk.31.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 418/ 866] blk.31.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 419/ 866] blk.31.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 420/ 866] blk.31.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 421/ 866] blk.31.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 422/ 866] blk.31.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 423/ 866] blk.31.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 424/ 866] blk.31.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 425/ 866] blk.31.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 426/ 866] blk.31.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 427/ 866] blk.31.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 428/ 866] blk.32.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 429/ 866] blk.32.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 430/ 866] blk.32.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 431/ 866] blk.32.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 432/ 866] blk.32.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 433/ 866] blk.32.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 434/ 866] blk.32.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 435/ 866] blk.32.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 436/ 866] blk.32.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 437/ 866] blk.32.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 438/ 866] blk.32.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 439/ 866] blk.32.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 440/ 866] blk.32.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 441/ 866] blk.32.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 442/ 866] blk.33.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 443/ 866] blk.33.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 444/ 866] blk.33.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 445/ 866] blk.33.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 446/ 866] blk.33.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 447/ 866] blk.33.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 448/ 866] blk.33.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 449/ 866] blk.33.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 450/ 866] blk.33.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 451/ 866] blk.33.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 452/ 866] blk.33.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 453/ 866] blk.33.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 454/ 866] blk.33.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 455/ 866] blk.33.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 456/ 866] blk.34.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 457/ 866] blk.34.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 458/ 866] blk.34.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 459/ 866] blk.34.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 460/ 866] blk.34.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 461/ 866] blk.34.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 462/ 866] blk.34.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 463/ 866] blk.34.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 464/ 866] blk.34.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 465/ 866] blk.34.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 466/ 866] blk.34.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 467/ 866] blk.34.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 468/ 866] blk.34.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 469/ 866] blk.34.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 470/ 866] blk.35.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 471/ 866] blk.35.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 472/ 866] blk.35.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 473/ 866] blk.35.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 474/ 866] blk.35.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 475/ 866] blk.35.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 476/ 866] blk.35.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 477/ 866] blk.35.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 478/ 866] blk.35.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 479/ 866] blk.35.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 480/ 866] blk.35.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 481/ 866] blk.36.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 482/ 866] blk.36.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 483/ 866] blk.36.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 484/ 866] blk.36.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 485/ 866] blk.36.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 486/ 866] blk.36.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 487/ 866] blk.36.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 488/ 866] blk.36.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 489/ 866] blk.36.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 490/ 866] blk.36.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 491/ 866] blk.36.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 492/ 866] blk.36.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 493/ 866] blk.36.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 494/ 866] blk.36.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 495/ 866] blk.37.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 496/ 866] blk.37.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 497/ 866] blk.37.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 498/ 866] blk.37.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 499/ 866] blk.37.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 500/ 866] blk.37.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 501/ 866] blk.37.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 502/ 866] blk.37.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 503/ 866] blk.37.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 504/ 866] blk.37.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 505/ 866] blk.37.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 506/ 866] blk.37.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 507/ 866] blk.37.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 508/ 866] blk.37.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 509/ 866] blk.38.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 510/ 866] blk.38.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 511/ 866] blk.38.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 512/ 866] blk.38.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 513/ 866] blk.38.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 514/ 866] blk.38.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 515/ 866] blk.38.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 516/ 866] blk.38.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 517/ 866] blk.38.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 518/ 866] blk.38.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 519/ 866] blk.38.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 520/ 866] blk.38.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 521/ 866] blk.38.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 522/ 866] blk.38.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 523/ 866] blk.39.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 524/ 866] blk.39.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 525/ 866] blk.39.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 526/ 866] blk.39.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 527/ 866] blk.39.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 528/ 866] blk.39.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 529/ 866] blk.39.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 530/ 866] blk.39.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 531/ 866] blk.39.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 532/ 866] blk.39.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 533/ 866] blk.39.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 534/ 866] blk.40.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 535/ 866] blk.40.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 536/ 866] blk.40.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 537/ 866] blk.40.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 538/ 866] blk.40.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 539/ 866] blk.40.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 540/ 866] blk.40.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 541/ 866] blk.40.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 542/ 866] blk.40.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 543/ 866] blk.40.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 544/ 866] blk.40.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 545/ 866] blk.40.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 546/ 866] blk.40.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 547/ 866] blk.40.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 548/ 866] blk.41.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 549/ 866] blk.41.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 550/ 866] blk.41.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 551/ 866] blk.41.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 552/ 866] blk.41.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 553/ 866] blk.41.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 554/ 866] blk.41.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 555/ 866] blk.41.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 556/ 866] blk.41.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 557/ 866] blk.41.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 558/ 866] blk.41.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 559/ 866] blk.41.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 560/ 866] blk.41.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 561/ 866] blk.41.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 562/ 866] blk.42.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 563/ 866] blk.42.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 564/ 866] blk.42.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 565/ 866] blk.42.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 566/ 866] blk.42.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 567/ 866] blk.42.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 568/ 866] blk.42.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 569/ 866] blk.42.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 570/ 866] blk.42.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 571/ 866] blk.42.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 572/ 866] blk.42.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 573/ 866] blk.42.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 574/ 866] blk.42.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 575/ 866] blk.42.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 576/ 866] blk.43.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 577/ 866] blk.43.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 578/ 866] blk.43.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 579/ 866] blk.43.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 580/ 866] blk.43.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 581/ 866] blk.43.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 582/ 866] blk.43.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 583/ 866] blk.43.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 584/ 866] blk.43.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 585/ 866] blk.43.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 586/ 866] blk.43.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 587/ 866] blk.44.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 588/ 866] blk.44.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 589/ 866] blk.44.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 590/ 866] blk.44.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 591/ 866] blk.44.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 592/ 866] blk.44.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 593/ 866] blk.44.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 594/ 866] blk.44.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 595/ 866] blk.44.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 596/ 866] blk.44.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 597/ 866] blk.44.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 598/ 866] blk.44.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 599/ 866] blk.44.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 600/ 866] blk.44.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 601/ 866] blk.45.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 602/ 866] blk.45.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 603/ 866] blk.45.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 604/ 866] blk.45.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 605/ 866] blk.45.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 606/ 866] blk.45.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 607/ 866] blk.45.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 608/ 866] blk.45.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 609/ 866] blk.45.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 610/ 866] blk.45.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 611/ 866] blk.45.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 612/ 866] blk.45.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 613/ 866] blk.45.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 614/ 866] blk.45.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 615/ 866] blk.46.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 616/ 866] blk.46.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 617/ 866] blk.46.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 618/ 866] blk.46.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 619/ 866] blk.46.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 620/ 866] blk.46.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 621/ 866] blk.46.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 622/ 866] blk.46.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 623/ 866] blk.46.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 624/ 866] blk.46.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 625/ 866] blk.46.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 626/ 866] blk.46.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 627/ 866] blk.46.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 628/ 866] blk.46.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 629/ 866] blk.47.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 630/ 866] blk.47.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 631/ 866] blk.47.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 632/ 866] blk.47.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 633/ 866] blk.47.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 634/ 866] blk.47.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 635/ 866] blk.47.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 636/ 866] blk.47.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 637/ 866] blk.47.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 638/ 866] blk.47.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 639/ 866] blk.47.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 640/ 866] blk.48.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 641/ 866] blk.48.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 642/ 866] blk.48.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 643/ 866] blk.48.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 644/ 866] blk.48.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 645/ 866] blk.48.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 646/ 866] blk.48.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 647/ 866] blk.48.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 648/ 866] blk.48.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 649/ 866] blk.48.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 650/ 866] blk.48.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 651/ 866] blk.48.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 652/ 866] blk.48.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 653/ 866] blk.48.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 654/ 866] blk.49.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 655/ 866] blk.49.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 656/ 866] blk.49.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 657/ 866] blk.49.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 658/ 866] blk.49.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 659/ 866] blk.49.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 660/ 866] blk.49.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 661/ 866] blk.49.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 662/ 866] blk.49.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 663/ 866] blk.49.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 664/ 866] blk.49.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 665/ 866] blk.49.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 666/ 866] blk.49.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 667/ 866] blk.49.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 668/ 866] blk.50.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 669/ 866] blk.50.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 670/ 866] blk.50.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 671/ 866] blk.50.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 672/ 866] blk.50.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 673/ 866] blk.50.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 674/ 866] blk.50.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 675/ 866] blk.50.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 676/ 866] blk.50.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 677/ 866] blk.50.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 678/ 866] blk.50.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 679/ 866] blk.50.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 680/ 866] blk.50.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 681/ 866] blk.50.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 682/ 866] blk.51.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 683/ 866] blk.51.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 684/ 866] blk.51.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 685/ 866] blk.51.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 686/ 866] blk.51.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 687/ 866] blk.51.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 688/ 866] blk.51.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 689/ 866] blk.51.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 690/ 866] blk.51.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 691/ 866] blk.51.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 692/ 866] blk.51.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 693/ 866] blk.52.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 694/ 866] blk.52.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 695/ 866] blk.52.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 696/ 866] blk.52.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 697/ 866] blk.52.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 698/ 866] blk.52.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 699/ 866] blk.52.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 700/ 866] blk.52.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 701/ 866] blk.52.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 702/ 866] blk.52.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 703/ 866] blk.52.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 704/ 866] blk.52.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 705/ 866] blk.52.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 706/ 866] blk.52.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 707/ 866] blk.53.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 708/ 866] blk.53.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 709/ 866] blk.53.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 710/ 866] blk.53.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 711/ 866] blk.53.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 712/ 866] blk.53.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 713/ 866] blk.53.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 714/ 866] blk.53.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 715/ 866] blk.53.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 716/ 866] blk.53.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 717/ 866] blk.53.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 718/ 866] blk.53.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 719/ 866] blk.53.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 720/ 866] blk.53.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 721/ 866] blk.54.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 722/ 866] blk.54.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 723/ 866] blk.54.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 724/ 866] blk.54.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 725/ 866] blk.54.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 726/ 866] blk.54.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 727/ 866] blk.54.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 728/ 866] blk.54.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 729/ 866] blk.54.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 730/ 866] blk.54.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 731/ 866] blk.54.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 732/ 866] blk.54.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 733/ 866] blk.54.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 734/ 866] blk.54.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 735/ 866] blk.55.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 736/ 866] blk.55.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 737/ 866] blk.55.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 738/ 866] blk.55.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 739/ 866] blk.55.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 740/ 866] blk.55.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 741/ 866] blk.55.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 742/ 866] blk.55.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 743/ 866] blk.55.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 744/ 866] blk.55.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 745/ 866] blk.55.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 746/ 866] blk.56.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 747/ 866] blk.56.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 748/ 866] blk.56.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 749/ 866] blk.56.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 750/ 866] blk.56.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 751/ 866] blk.56.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 752/ 866] blk.56.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 753/ 866] blk.56.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 754/ 866] blk.56.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 755/ 866] blk.56.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 756/ 866] blk.56.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 757/ 866] blk.56.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 758/ 866] blk.56.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 759/ 866] blk.56.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 760/ 866] blk.57.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 761/ 866] blk.57.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 762/ 866] blk.57.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 763/ 866] blk.57.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 764/ 866] blk.57.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 765/ 866] blk.57.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 766/ 866] blk.57.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 767/ 866] blk.57.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 768/ 866] blk.57.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 769/ 866] blk.57.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 770/ 866] blk.57.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 771/ 866] blk.57.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 772/ 866] blk.57.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 773/ 866] blk.57.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 774/ 866] blk.58.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 775/ 866] blk.58.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 776/ 866] blk.58.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 777/ 866] blk.58.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 778/ 866] blk.58.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 779/ 866] blk.58.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 780/ 866] blk.58.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 781/ 866] blk.58.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 782/ 866] blk.58.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 783/ 866] blk.58.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 784/ 866] blk.58.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 785/ 866] blk.58.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 786/ 866] blk.58.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 787/ 866] blk.58.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 788/ 866] blk.59.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 789/ 866] blk.59.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 790/ 866] blk.59.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 791/ 866] blk.59.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 792/ 866] blk.59.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 793/ 866] blk.59.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 794/ 866] blk.59.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 795/ 866] blk.59.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 796/ 866] blk.59.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 797/ 866] blk.59.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 798/ 866] blk.59.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 799/ 866] blk.60.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 800/ 866] blk.60.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 801/ 866] blk.60.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 802/ 866] blk.60.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 803/ 866] blk.60.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 804/ 866] blk.60.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 805/ 866] blk.60.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 806/ 866] blk.60.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 807/ 866] blk.60.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 808/ 866] blk.60.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 809/ 866] blk.60.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 810/ 866] blk.60.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 811/ 866] blk.60.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 812/ 866] blk.60.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 813/ 866] blk.61.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 814/ 866] blk.61.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 815/ 866] blk.61.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 816/ 866] blk.61.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 817/ 866] blk.61.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 818/ 866] blk.61.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 819/ 866] blk.61.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 820/ 866] blk.61.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 821/ 866] blk.61.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 822/ 866] blk.61.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 823/ 866] blk.61.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 824/ 866] blk.61.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 825/ 866] blk.61.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 826/ 866] blk.61.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 827/ 866] blk.62.attn_gate.weight - [ 5120, 6144, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 828/ 866] blk.62.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 829/ 866] blk.62.attn_qkv.weight - [ 5120, 10240, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 830/ 866] blk.62.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 831/ 866] blk.62.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 832/ 866] blk.62.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 833/ 866] blk.62.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 834/ 866] blk.62.ssm_a - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 835/ 866] blk.62.ssm_alpha.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 836/ 866] blk.62.ssm_beta.weight - [ 5120, 48, 1, 1], type = bf16, size = 0.47 MiB -> 0.05 MiB (iq1_m) [ 837/ 866] blk.62.ssm_conv1d.weight - [ 4, 10240, 1, 1], type = f32, size = 0.156 MiB [ 838/ 866] blk.62.ssm_dt.bias - [ 48, 1, 1, 1], type = f32, size = 0.000 MiB [ 839/ 866] blk.62.ssm_norm.weight - [ 128, 1, 1, 1], type = f32, size = 0.000 MiB [ 840/ 866] blk.62.ssm_out.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 6.56 MiB (iq1_m) [ 841/ 866] blk.63.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 1.09 MiB (iq1_m) [ 842/ 866] blk.63.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 843/ 866] blk.63.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 844/ 866] blk.63.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 7.73 MiB (iq2_xxs) [ 845/ 866] blk.63.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 13.12 MiB (iq1_m) [ 846/ 866] blk.63.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 847/ 866] blk.63.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 848/ 866] blk.63.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 849/ 866] blk.63.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 850/ 866] blk.63.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 18.59 MiB (iq1_m) [ 851/ 866] blk.63.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 852/ 866] blk.64.attn_k.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 853/ 866] blk.64.attn_k_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 854/ 866] blk.64.attn_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 855/ 866] blk.64.attn_output.weight - [ 6144, 5120, 1, 1], type = bf16, size = 60.00 MiB -> 16.88 MiB (q4_K) [ 856/ 866] blk.64.attn_q.weight - [ 5120, 12288, 1, 1], type = bf16, size = 120.00 MiB -> 33.75 MiB (q4_K) [ 857/ 866] blk.64.attn_q_norm.weight - [ 256, 1, 1, 1], type = f32, size = 0.001 MiB [ 858/ 866] blk.64.attn_v.weight - [ 5120, 1024, 1, 1], type = bf16, size = 10.00 MiB -> 2.81 MiB (q4_K) [ 859/ 866] blk.64.ffn_down.weight - [ 17408, 5120, 1, 1], type = bf16, size = 170.00 MiB -> 47.81 MiB (q4_K) [ 860/ 866] blk.64.ffn_gate.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 47.81 MiB (q4_K) [ 861/ 866] blk.64.ffn_up.weight - [ 5120, 17408, 1, 1], type = bf16, size = 170.00 MiB -> 47.81 MiB (q4_K) [ 862/ 866] blk.64.nextn.eh_proj.weight - [ 10240, 5120, 1, 1], type = bf16, size = 100.00 MiB -> 28.12 MiB (q4_K) [ 863/ 866] blk.64.nextn.enorm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 864/ 866] blk.64.nextn.hnorm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 865/ 866] blk.64.nextn.shared_head_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB [ 866/ 866] blk.64.post_attention_norm.weight - [ 5120, 1, 1, 1], type = f32, size = 0.020 MiB llama_model_quantize_impl: model size = 52115.19 MiB (16.00 BPW) llama_model_quantize_impl: quant size = 7495.00 MiB (2.30 BPW) load_imatrix: imatrix datasets=['/Volumes/Lexar/aq_ds4flash/imatrix_agentic.txt'] load_imatrix: loaded 496 importance matrix entries from /mnt/geth-vol1/qwen38_assets/Qwen3.8-27B-agentic.imatrix computed on 1580 chunks prepare_imatrix: have 496 importance matrix entries llama_quantize: quantize time = 498.04 ms llama_quantize: total time = 498.04 ms