Albert-yz9yt commited on
Commit
c845bd3
·
verified ·
1 Parent(s): 4e728a0

Remove CORE prefix: Apex is reasoning, CORE lineup is tooling

Browse files
Files changed (1) hide show
  1. README.md +16 -4
README.md CHANGED
@@ -16,14 +16,14 @@ tags:
16
  - thinking
17
  - chain-of-thought
18
  base_model: TrevorJS/gemma-4-26B-A4B-it-uncensored
19
- model_name: BugTraceAI-CORE-G4-Apex
20
  ---
21
 
22
- # 🌋 BugTraceAI-CORE-G4-Apex (26B MoE)
23
 
24
  **The Apex Predator of Offensive Security Reasoning.**
25
 
26
- BugTraceAI-CORE-G4-Apex is a high-performance, uncensored 26B Mixture-of-Experts (MoE) model based on Gemma 4 architecture. It has been meticulously fine-tuned via **DPO (Direct Preference Optimization)** on a curated "Super Dataset" comprising elite Bug Bounty reports, advanced malware methodologies, and multi-layer WAF evasion techniques.
27
 
28
  Unlike standard security models, the Apex variant features an injected **Opus-style reasoning engine**, forcing the model to perform a deep step-by-step analysis inside a `<thinking>` block before providing technical payloads or remediation strategies.
29
 
@@ -48,7 +48,7 @@ To maximize reasoning performance and reduce VRAM overhead, we have **manually s
48
  | :--- | :--- |
49
  | **Organization** | BugTraceAI |
50
  | **Framework** | BugTraceAI Apex Security Framework |
51
- | **Variant** | BugTraceAI-CORE-G4-Apex |
52
  | **Parameter Scale** | 26B (Mixture of Experts) |
53
  | **Architecture** | Gemma 4 (Text-Only Optimized) |
54
  | **Fine-tuning** | DPO (Direct Preference Optimization) |
@@ -110,6 +110,18 @@ PARAMETER temperature 0.1
110
  PARAMETER top_p 0.9
111
  ```
112
 
 
 
 
 
 
 
 
 
 
 
 
 
113
  ### 🐍 Usage in Google Colab (llama-cpp-python)
114
 
115
  If you are using the "Open in Colab" button on Hugging Face, replace the generation cell with the following code to ensure the **Apex Reasoning Engine** and precise parameters are activated:
 
16
  - thinking
17
  - chain-of-thought
18
  base_model: TrevorJS/gemma-4-26B-A4B-it-uncensored
19
+ model_name: BugTraceAI-G4-Apex
20
  ---
21
 
22
+ # 🌋 BugTraceAI-G4-Apex (26B MoE)
23
 
24
  **The Apex Predator of Offensive Security Reasoning.**
25
 
26
+ BugTraceAI-G4-Apex is a high-performance, uncensored 26B Mixture-of-Experts (MoE) model based on Gemma 4 architecture. It has been meticulously fine-tuned via **DPO (Direct Preference Optimization)** on a curated "Super Dataset" comprising elite Bug Bounty reports, advanced malware methodologies, and multi-layer WAF evasion techniques.
27
 
28
  Unlike standard security models, the Apex variant features an injected **Opus-style reasoning engine**, forcing the model to perform a deep step-by-step analysis inside a `<thinking>` block before providing technical payloads or remediation strategies.
29
 
 
48
  | :--- | :--- |
49
  | **Organization** | BugTraceAI |
50
  | **Framework** | BugTraceAI Apex Security Framework |
51
+ | **Variant** | BugTraceAI-G4-Apex |
52
  | **Parameter Scale** | 26B (Mixture of Experts) |
53
  | **Architecture** | Gemma 4 (Text-Only Optimized) |
54
  | **Fine-tuning** | DPO (Direct Preference Optimization) |
 
110
  PARAMETER top_p 0.9
111
  ```
112
 
113
+ ### 🖥️ LM Studio Deployment Guide (IMPORTANT)
114
+
115
+ > ⚠️ **WARNING - AVOID COUNTERFEIT QUANTS:** We are aware of third-party repositories uploading broken GGUF versions of this model with inflated metadata (256k context). Those versions **WILL FAIL TO LOAD** on 12GB/16GB VRAM cards due to extreme memory allocation. Always use the official BugTraceAI files hosted here to ensure the architecture is correctly formatted.
116
+
117
+ When loading the GGUF file in LM Studio (Version 0.4.11 or higher required), you **must manually limit the context** to prevent VRAM allocation crashes caused by the architecture's native 256k context capacity.
118
+
119
+ 1. Load the model and locate the settings panel on the right.
120
+ 2. Set **Context Length** to `8192` (or up to `16384` if you have 24GB+ VRAM).
121
+ 3. Set **GPU Offload** to `10-14` (for 12GB VRAM cards like RTX 3060).
122
+ 4. Ensure **Unified KV Cache** is turned **OFF**.
123
+ 5. Click Load.
124
+
125
  ### 🐍 Usage in Google Colab (llama-cpp-python)
126
 
127
  If you are using the "Open in Colab" button on Hugging Face, replace the generation cell with the following code to ensure the **Apex Reasoning Engine** and precise parameters are activated: