myeongjun77 commited on
Commit
b3e6f76
Β·
verified Β·
1 Parent(s): 3ff3072

Pungyo verification package

Browse files
LICENSE-LLAMACPP ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2023-2024 The ggml authors (https://github.com/ggml-org/ggml/blob/master/AUTHORS)
4
+ Copyright (c) 2023-2024 The llama.cpp authors (https://github.com/ggml-org/llama.cpp/blob/master/AUTHORS)
5
+ Copyright (c) 2024-2025 The ik_llama.cpp authors (https://github.com/ikawrakow/ik_llama.cpp/blob/main/AUTHORS)
6
+
7
+ Permission is hereby granted, free of charge, to any person obtaining a copy
8
+ of this software and associated documentation files (the "Software"), to deal
9
+ in the Software without restriction, including without limitation the rights
10
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
11
+ copies of the Software, and to permit persons to whom the Software is
12
+ furnished to do so, subject to the following conditions:
13
+
14
+ The above copyright notice and this permission notice shall be included in all
15
+ copies or substantial portions of the Software.
16
+
17
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
18
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
19
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
20
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
21
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
22
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
23
+ SOFTWARE.
NOTICE.md CHANGED
@@ -20,7 +20,9 @@ holders.
20
 
21
  ## 3. Upstream Runtime
22
 
23
- - Built with reference to llama.cpp / ik_llama.cpp (MIT License).
 
 
24
  - The Pungyo package adds an execution layer and does not relicense the
25
  upstream runtime.
26
 
 
20
 
21
  ## 3. Upstream Runtime
22
 
23
+ - This package's executable is built from llama.cpp / ik_llama.cpp (MIT License).
24
+ The full upstream MIT license and copyright notices are included as
25
+ `LICENSE-LLAMACPP` per the MIT terms.
26
  - The Pungyo package adds an execution layer and does not relicense the
27
  upstream runtime.
28
 
Pungyo-Qwen36-Single-Public-Verification-20260530.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:584555f932cd6f7b0e89ef32d2a8253e3b368348bdc38d354b5b2060ed459da3
3
+ size 597490045
README.md CHANGED
@@ -17,26 +17,25 @@ library_name: gguf
17
 
18
  # Pungyo (ν’μš”) β€” Run Qwen3.6-35B-A3B on an 8GB laptop
19
 
20
- βœ… **It works.** A 35B-A3B class model runs on consumer 8GB-class VRAM.
 
 
21
 
22
  This repository is **not a model release**.
23
  Model weights are **not included**.
24
  The internal mechanism is **not disclosed**.
25
 
26
- ## What This Shows
27
-
28
- Pungyo is a public verification package that demonstrates running a
29
- user-provided Qwen3.6 35B-A3B compatible GGUF model on a single consumer
30
- 8GB-class GPU.
31
-
32
- Reference local observation:
33
 
34
  ```text
35
- 34.5 tok/s (8GB laptop GPU, ~7.1GB VRAM, warm; peak 35.5 tok/s)
36
  ```
37
 
38
- Measured locally on Qwen3.6-35B-A3B (Q4_K_M, user-provided GGUF), 2026-05-29.
39
- The measurement is a local observation, not a universal guarantee.
 
 
 
40
 
41
  ## How does it work?
42
 
@@ -44,44 +43,40 @@ Not explained here. The mechanism is covered by patent-filed technology
44
  (application filed, KR). This release only demonstrates **that it works** β€”
45
  it does not disclose **how**.
46
 
47
- If you want the principle, it is in the inventor's patent and forthcoming
48
- paper. This package is an observable artifact, nothing more.
49
 
50
- ## Download
 
 
51
 
52
- ```text
53
- Pungyo-Qwen36-Single-Public-Verification-20260529.zip
54
  ```
55
 
56
- ## Requirements
57
-
58
- - Windows 11
59
- - NVIDIA RTX-class 8GB VRAM GPU (or compatible)
60
- - 32GB system memory recommended
61
- - a user-provided Qwen3.6 35B-A3B compatible GGUF model
62
- - local `llama-cli.exe` / `llama-server.exe`
63
 
64
- ## Quick Start
65
 
66
- ```powershell
67
- .\bin\pungyo.exe --setup --model "D:\models\Qwen3.6-35B-A3B.gguf" --llama-cli "D:\tools\llama-cli.exe"
68
- .\bin\pungyo.exe --model "D:\models\Qwen3.6-35B-A3B.gguf" --prompt "Hello"
69
- ```
70
 
71
- See `run.md` for details.
72
 
73
  ## Not Included
74
 
75
- - model weights
76
  - training data
77
  - internal mechanism / operating-point logic
78
  - private validation traces
79
- - internal build files
80
 
81
  ## License
82
 
83
  - Pungyo execution package: see `LICENSE-PUNGYO`.
84
- - Qwen base model, not included: see `LICENSE-QWEN`.
 
85
  - License scope separation: see `NOTICE.md`.
86
 
87
  ## Patent Notice
 
17
 
18
  # Pungyo (ν’μš”) β€” Run Qwen3.6-35B-A3B on an 8GB laptop
19
 
20
+ > **λž¨μ„ ν’μš”λ‘­κ²Œ β€” Run big. Keep your memory abundant.**
21
+
22
+ βœ… **It works.** Single self-contained binary. Provide a Qwen GGUF, run, done.
23
 
24
  This repository is **not a model release**.
25
  Model weights are **not included**.
26
  The internal mechanism is **not disclosed**.
27
 
28
+ ## Reference local observation (single profile)
 
 
 
 
 
 
29
 
30
  ```text
31
+ 33.27 tok/s (8GB laptop GPU, ~7GB VRAM, steady-state)
32
  ```
33
 
34
+ Measured on Qwen3.6-35B-A3B (Q4_K_M, user-provided GGUF), 2026-05-30, 245-token generation.
35
+ A local observation, not a universal guarantee.
36
+
37
+ > Want maximum memory headroom / stability? See the twin profile:
38
+ > **myeongjun77/Pungyo-Qwen36-A3B-Twin**
39
 
40
  ## How does it work?
41
 
 
43
  (application filed, KR). This release only demonstrates **that it works** β€”
44
  it does not disclose **how**.
45
 
46
+ ## Download & Run (3 steps)
 
47
 
48
+ 1. Get a compatible **Qwen3.6 35B-A3B GGUF** from https://huggingface.co/Qwen
49
+ 2. Download `Pungyo-Qwen36-Single-Public-Verification-20260530.zip` from this repo, unzip.
50
+ 3. Run:
51
 
52
+ ```powershell
53
+ .\bin\pungyo.exe "path\to\Qwen3.6-35B-A3B.gguf" "Hello, my name is"
54
  ```
55
 
56
+ That's it. No setup, no separate llama.cpp install, no flags. The binary picks
57
+ the operating point in-memory and runs in-process.
 
 
 
 
 
58
 
59
+ ## Requirements
60
 
61
+ - Windows 10/11
62
+ - NVIDIA RTX-class 8GB VRAM GPU (or compatible), CUDA driver installed
63
+ - 32 GB system memory recommended
64
+ - a user-provided Qwen3.6 35B-A3B compatible GGUF
65
 
66
+ (Bundled in the ZIP: `bin\pungyo.exe`, `bin\cublas64_13.dll`, `bin\cublasLt64_13.dll`. CUDA runtime libraries are included; you do NOT need the CUDA toolkit installed.)
67
 
68
  ## Not Included
69
 
70
+ - Qwen model weights (get from https://huggingface.co/Qwen)
71
  - training data
72
  - internal mechanism / operating-point logic
73
  - private validation traces
 
74
 
75
  ## License
76
 
77
  - Pungyo execution package: see `LICENSE-PUNGYO`.
78
+ - Built from llama.cpp / ik_llama.cpp (MIT): see `LICENSE-LLAMACPP`.
79
+ - Qwen base model (not included): see `LICENSE-QWEN`.
80
  - License scope separation: see `NOTICE.md`.
81
 
82
  ## Patent Notice
run.md CHANGED
@@ -1,40 +1,37 @@
1
- # Pungyo β€” Run Guide
2
 
3
- Pungyo runs a large Qwen3.6-35B-A3B class GGUF model on a single 8GB-class GPU.
4
- You provide the model. Pungyo provides the runner.
5
 
6
- ## 1. Get a model (not included)
7
 
8
- Download a compatible Qwen3.6 35B-A3B GGUF from the official Qwen source:
9
  https://huggingface.co/Qwen
10
 
11
  Pungyo does not ship, modify, or relicense model weights.
12
 
13
- ## 2. Unzip Pungyo
14
 
15
  ```
16
- Pungyo-Qwen36-Single-Public-Verification-20260529.zip
17
- └── bin\pungyo.exe
 
 
18
  ```
19
 
20
- ## 3. Setup (one time)
21
 
22
  ```powershell
23
- .\bin\pungyo.exe --setup `
24
- --model "D:\models\Qwen3.6-35B-A3B.gguf" `
25
- --llama-cli "D:\tools\llama-cli.exe"
26
  ```
27
 
28
- ## 4. Run
29
-
30
- ```powershell
31
- .\bin\pungyo.exe --model "D:\models\Qwen3.6-35B-A3B.gguf" --prompt "Hello"
32
- ```
33
 
34
  ## Notes
35
 
36
- - Requires Windows 11, NVIDIA 8GB-class GPU, 32GB system RAM recommended.
 
37
  - Speed is a local observation and varies by hardware.
38
- - The mechanism is not documented here by design (patent-filed). This guide
39
- covers operation only.
40
  - Issues / requests: use the repository Community tab.
 
1
+ # Pungyo β€” Run Guide (single profile)
2
 
3
+ Run a Qwen3.6 35B-A3B class GGUF on a single 8GB GPU. You provide the model.
4
+ Pungyo is a single self-contained binary.
5
 
6
+ ## 1. Get a model
7
 
8
+ Download a compatible Qwen3.6 35B-A3B GGUF from the official source:
9
  https://huggingface.co/Qwen
10
 
11
  Pungyo does not ship, modify, or relicense model weights.
12
 
13
+ ## 2. Unzip
14
 
15
  ```
16
+ Pungyo-Qwen36-Single-Public-Verification-20260530.zip
17
+ β”œβ”€β”€ bin\pungyo.exe
18
+ β”œβ”€β”€ bin\cublas64_13.dll
19
+ └── bin\cublasLt64_13.dll
20
  ```
21
 
22
+ ## 3. Run
23
 
24
  ```powershell
25
+ .\bin\pungyo.exe "D:\models\Qwen3.6-35B-A3B.gguf" "Hello, my name is"
 
 
26
  ```
27
 
28
+ That is the full invocation. The residency operating point is decided by Pungyo
29
+ in memory and never appears on the command line.
 
 
 
30
 
31
  ## Notes
32
 
33
+ - Requires Windows, NVIDIA RTX-class 8GB GPU with a recent NVIDIA driver.
34
+ - 32 GB system RAM recommended.
35
  - Speed is a local observation and varies by hardware.
36
+ - The mechanism is not documented here by design (patent-filed).
 
37
  - Issues / requests: use the repository Community tab.