# Granite Switch Composed Model

## Base Model

- Identifier: ibm-granite/granite-4.0-350m
- Model type: granitemoehybrid
- Architectures: GraniteMoeHybridForCausalLM
- Hidden size: 1024
- Hidden layers: 28
- Attention heads: 16
- Vocab size: 100352

## Embedded Adapters

Total adapters: **3**

| # | Name | Technology | Control Token | Token ID | Rank | Alpha | Target Modules | Source |
|---|------|------------|---------------|----------|------|-------|----------------|--------|
| 1 | cti-technique-mapping | alora | `<\|cti-technique-mapping\|>` | 100352 | 32 | 64 | input_linear, k_proj, o_proj, output_linear, q_proj, v_proj | cti-technique-mapping |
| 2 | text-to-json | alora | `<\|text-to-json\|>` | 100353 | 32 | 64 | input_linear, k_proj, o_proj, output_linear, q_proj, v_proj | text-to-json |
| 3 | genai-attack-vector | alora | `<\|genai-attack-vector\|>` | 100354 | 32 | 64 | input_linear, k_proj, o_proj, output_linear, q_proj, v_proj | genai-attack-vector |

## Composition Details

- base_param_count: 352,379,904
- composed_param_count: 370,274,304
- Param delta: +5.08%
- compose_settings:
  - technology: "alora"
  - adapter_substitute_token_ids:
    - 100264
    - 100264
    - 100264
  - target_model: "granite-4.0-350m"