muhammadtlha944 commited on
Commit
83fa83d
·
verified ·
1 Parent(s): 04437b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -3
README.md CHANGED
@@ -1,3 +1,46 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: unsloth/Qwen2.5-Coder-32B-Instruct-bnb-4bit
4
+ tags:
5
+ - code
6
+ - amd
7
+ - rocm
8
+ - hip
9
+ - cuda
10
+ - unsloth
11
+ - lablab-ai
12
+ - ghost-coder
13
+ ---
14
+
15
+ # Ghost-Coder: Qwen2.5-32B CUDA-to-HIP Translator
16
+
17
+ Ghost-Coder is a specialized LLM designed to bridge the gap between NVIDIA's proprietary CUDA and AMD's open ROCm ecosystem. This model is a fine-tuned version of **Qwen2.5-Coder-32B-Instruct**, optimized specifically for high-fidelity translation of GPU kernels.
18
+
19
+ Developed for the **Lablab.ai AMD Developer Hackathon (2026)**.
20
+
21
+ ## 🚀 Model Highlights
22
+ - **Specialization:** Maps complex CUDA logic (memory management, warp primitives, kernels) to functional AMD HIP code.
23
+ - **Hardware-Aware:** Fine-tuned specifically for execution on AMD Instinct hardware.
24
+ - **Agent-Ready:** Designed to be the "brain" of an autonomous, self-healing compiler loop.
25
+
26
+ ## 🛠️ Training Details
27
+ The model was fine-tuned using the **Unsloth** framework on a high-speed sprint configuration to maximize generalization.
28
+
29
+ - **Hardware:** AMD Instinct MI300X (192GB VRAM)
30
+ - **Base Model:** Qwen2.5-Coder-32B-Instruct (4-bit QLoRA)
31
+ - **Dataset:** Curated subset of CASS (CUDA-to-HIP mapping pairs)
32
+ - **Context Length:** 4096
33
+ - **Training Steps:** 200
34
+ - **Global Batch Size:** 64
35
+
36
+ ## 🧠 Intended Use
37
+ Ghost-Coder is intended for use in the **Ghost-Harness**, an agentic workflow that:
38
+ 1. Translates CUDA source code to HIP.
39
+ 2. Attempts compilation via `hipcc`.
40
+ 3. Self-corrects based on compiler error feedback.
41
+
42
+ ## 📝 Acknowledgements
43
+ Special thanks to **AMD** and **Lablab.ai** for providing the compute resources and the platform to build across the AI stack.
44
+
45
+ ---
46
+ *Created by Talha*