hwihwalab commited on
Commit
d312116
ยท
verified ยท
1 Parent(s): 7da58e2

feat: upload README_KR.md

Browse files
Files changed (1) hide show
  1. README_KR.md +114 -114
README_KR.md CHANGED
@@ -1,114 +1,114 @@
1
- # ๐Ÿค– NEUROMOTION 3.0 // Humanoid-v5 Telemetry & RL
2
-
3
- [![Language: English](https://img.shields.io/badge/Language-English-blue)](README.md)
4
- [![Language: ํ•œ๊ตญ์–ด](https://img.shields.io/badge/Language-ํ•œ๊ตญ์–ด-green)](README_KR.md)
5
- [![Hugging Face Model Hub](https://img.shields.io/badge/๐Ÿค—%20Hugging%20Face-Model%20Hub-orange)](https://huggingface.co/hwihwalab/neuromotion-humanoid-v5-ppo)
6
- [![GitHub Repository](https://img.shields.io/badge/GitHub-Repository-181717?style=flat&logo=github)](https://github.com/Hwihwa-Lab/neuromotion-humanoid-v5-ppo)
7
- [![Gymnasium](https://img.shields.io/badge/Gymnasium-MuJoCo%20Humanoid--v5-0080FF)](https://gymnasium.farama.org/environments/mujoco/humanoid/)
8
- [![PyTorch](https://img.shields.io/badge/PyTorch-2.0+-EE4C2C?style=flat&logo=pytorch)](https://pytorch.org)
9
- [![Stable-Baselines3](https://img.shields.io/badge/Stable--Baselines3-PPO-brightgreen)](https://stable-baselines3.readthedocs.io)
10
-
11
- > **MuJoCo Humanoid-v5 PPO Continuous Control & Real-time Engineering Telemetry Dashboard**
12
- > *[ ๐ŸŒ English Documentation ](README.md) | [ ๐Ÿ‡ฐ๐Ÿ‡ท ํ•œ๊ตญ์–ด ๋งค๋‰ด์–ผ ](README_KR.md)*
13
-
14
- ์ฒœ์žฌ๋””์ž์ธ์—์ด์ „ํŠธ ๋””์ž์ธ ์‹œ์Šคํ…œ๊ณผ **์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ ๋“œ๋กญ๋‹ค์šด ๋ฉ”๋‰ด(Dropdown Menu)**๊ฐ€ ์žฅ์ฐฉ๋œ **`NEUROMOTION 3.0`** ๊ณต์‹ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ๋งค๋‰ด์–ผ์ž…๋‹ˆ๋‹ค.
15
-
16
- ---
17
-
18
- ## ๐Ÿš€ Quick Start & Launch Modes (์‹คํ–‰ ๋ฐฉ๋ฒ•)
19
-
20
- ### 1. ๐Ÿ–ฅ๏ธ ๋ฉ”์ธ GUI ๋Œ€์‹œ๋ณด๋“œ ์‹คํ–‰ (์ถ”์ฒœ)
21
- Pygame ๊ธฐ๋ฐ˜ ์‹ค์‹œ๊ฐ„ ๋‹คํฌ ์‚ฌ์ด๋ฒ„ํŽ‘ํฌ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ๋Œ€์‹œ๋ณด๋“œ๋ฅผ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค:
22
- ```powershell
23
- python run_gui.py
24
- ```
25
-
26
- ### 2. ๐Ÿค— Hugging Face ๋ชจ๋ธ ํ—ˆ๋ธŒ ๋ฐฐํฌ (`deploy_to_hf.py`)
27
- ํ•™์Šต๋œ ๋ชจ๋ธ ๊ฐ€์ค‘์น˜(`humanoid_ppo_model.zip`)์™€ ์‹คํ–‰ ์ฝ”๋“œ๋ฅผ Hugging Face์— ์›ํด๋ฆญ์œผ๋กœ ์—…๋กœ๋“œํ•ฉ๋‹ˆ๋‹ค:
28
- ```powershell
29
- # ์ „์ฒด ๋ชจ๋ธ ๋ฐ ์ฝ”๋“œ ์—…๋กœ๋“œ
30
- python deploy_to_hf.py
31
-
32
- # ํŒŒ์ผ ์—…๋กœ๋“œ ์—†์ด ๋ฆฌํฌ์ง€ํ† ๋ฆฌ(hwihwalab/neuromotion-humanoid-v5-ppo)๋งŒ ์ƒ์„ฑํ•  ๋•Œ
33
- python deploy_to_hf.py --create-only
34
- ```
35
-
36
- > ๐Ÿ’ก **ํ–ฅํ›„ ๋ชจ๋ธ ์—…๋ฐ์ดํŠธ ๋ฐฉ๋ฒ•**
37
- > ์•ž์œผ๋กœ ์ถ”๊ฐ€ ํ•™์Šต์„ ์ง„ํ–‰ํ•œ ํ›„ ๊ฐ€์ค‘์น˜๋‚˜ ์ฝ”๋“œ๋ฅผ ๋‹ค์‹œ ๋ฐฐํฌํ•˜๊ณ  ์‹ถ์œผ์‹ค ๋•Œ๋Š” ์–ธ์ œ๋“  ์•„๋ž˜ ๋ช…๋ น์–ด ํ•œ ์ค„๋งŒ ์‹คํ–‰ํ•˜์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค:
38
- > ```powershell
39
- > python deploy_to_hf.py
40
- > ```
41
-
42
- ### 3. ๐Ÿ’ป ํ„ฐ๋ฏธ๋„ ๋‹ค์ค‘ ๋ชจ๋“œ ์‹คํ–‰๊ธฐ (`mujoko_humanoid.py`)
43
- ํ„ฐ๋ฏธ๋„ ๋Œ€ํ™”ํ˜• ๋ฉ”๋‰ด ๋˜๋Š” ๋ช…๋ น์ค„ ์˜ต์…˜์„ ํ†ตํ•ด ๋‹ค์–‘ํ•œ ๋ชฉ์ ๋ณ„ ํ•™์Šต/์‹œ์—ฐ์„ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค:
44
- ```powershell
45
- # ๋Œ€ํ™”ํ˜• ๋ฒˆํ˜ธ ์„ ํƒ ๋ฉ”๋‰ด ์‹คํ–‰
46
- python mujoko_humanoid.py
47
-
48
- # ๋˜๋Š” ์›ํ•˜๋Š” ๋ชจ๋“œ๋ฅผ ์ง์ ‘ ์ง€์ •ํ•˜์—ฌ ์‹คํ–‰
49
- python mujoko_humanoid.py --mode train_live # [๋ชจ๋“œ 1] ์‹ค์‹œ๊ฐ„ 3D ์‹œ๊ฐํ™” + ๊ฐ•ํ™”ํ•™์Šต
50
- python mujoko_humanoid.py --mode train_fast # [๋ชจ๋“œ 2] ๊ณ ์† ๋ฐฑ๊ทธ๋ผ์šด๋“œ ํ•™์Šต + ์ฃผ๊ธฐ์  3D ํ‰๊ฐ€
51
- python mujoko_humanoid.py --mode play # [๋ชจ๋“œ 3] ํ•™์Šต๋œ ๋ชจ๋ธ(humanoid_ppo_model.zip) 3D ๋ณดํ–‰ ์‹œ์—ฐ
52
- python mujoko_humanoid.py --mode random # [๋ชจ๋“œ 4] ์ดˆ๊ธฐ ๋ฌด์ž‘์œ„(Random) ํ–‰๋™ ๊ด€์ฐฐ
53
- ```
54
-
55
- ---
56
-
57
- ## ๐Ÿ–ฑ๏ธ Top Control Header (์ƒ๋‹จ ์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ ๋ฒ„ํŠผ & ๋“œ๋กญ๋‹ค์šด ๋ฉ”๋‰ด)
58
-
59
- ์ƒ๋‹จ ๋ฒ„ํŠผ๋“ค์€ ๋งˆ์šฐ์Šค ํ˜ธ๋ฒ„ ์‹œ **์†๊ฐ€๋ฝ ๋ชจ์–‘ ์ปค์„œ(๐Ÿ‘†)**์™€ ์•ฐ๋น„์–ธํŠธ ํ•˜์ด๋ผ์ดํŠธ๊ฐ€ ์ ์šฉ๋˜๋ฉฐ, ๋“œ๋กญ๋‹ค์šด ๋ฉ”๋‰ด๋ฅผ ํ†ตํ•ด ์›ํ•˜๋Š” ์˜ต์…˜์„ ์ฆ‰์‹œ ์ฝ• ์ฐ์–ด ์„ ํƒํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
60
-
61
- | Button Name | Type | Options & Function Description |
62
- | :--- | :---: | :--- |
63
- | **`[ โ— PPO TRAINING ]` / `[ โธ PAUSED ]`** | **Action** | **Telemetry Pause / Resume**: AI ํ•™์Šต ๋ฐ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ผ์‹œ์ •์ง€ / ์žฌ๊ฐœ (๋‹จ์ถ•ํ‚ค: `Space`) |
64
- | **`[ SPEED: 1X โ–ผ ]`** | **Dropdown** | **ํด๋ฆญ ์‹œ ๋ฐฐ์† ์„ ํƒ ๋ฉ”๋‰ด ํŒ์—…**:<br>โ€ข `1X Normal (1x)` : ๊ธฐ๋ณธ ์„ธ๋ฐ€ ๊ด€์ฐฐ ์†๋„<br>โ€ข `2X Fast (2x)` : 2๋ฐฐ์† ํ•™์Šต<br>โ€ข `4X Hyper (4x)` : 4๋ฐฐ์† ๊ณ ์† ํ•™์Šต<br>โ€ข `8X Ultra (8x)` : 8๋ฐฐ์† ์ดˆ๊ณ ์† ์ง‘์ค‘ ํ•™์Šต (๋‹จ์ถ•ํ‚ค: `F` ๋กœ ๋น ๋ฅธ ์ˆœํ™˜ ๊ฐ€๋Šฅ) |
65
- | **`[ PUSH FORCE โ–ผ ]`** | **Dropdown** | **ํด๋ฆญ ์‹œ ์™ธ๋ž€ ์ถฉ๊ฒฉ ์„ธ๊ธฐ ์„ ํƒ ํŒ์—…**:<br>โ€ข `Light Push (15 N)` : ๊ฐ€๋ฒผ์šด ํˆญ ๋ฐ€๊ธฐ<br>โ€ข `Medium Push (30 N)` : ์ค‘๊ฐ„ ๊ท ํ˜• ํ”๋“ค๋ฆผ (๊ธฐ๋ณธ ์™ธ๋ž€)<br>โ€ข `Heavy Force (50 N)` : ๊ฐ•ํ•œ ์ถฉ๊ฒฉํŒŒ ํ…Œ์ŠคํŠธ (๋‹จ์ถ•ํ‚ค: `P` ๋กœ ๊ธฐ๋ณธ 30N ์ธ๊ฐ€) |
66
- | **`[ SAVE MODEL ]`** | **Action** | **Save Checkpoint Weights**: ํ˜„์žฌ ํ•™์Šต๋œ ์‹ ๊ฒฝ๋ง ๊ฐ€์ค‘์น˜๋ฅผ `humanoid_ppo_model.zip`์œผ๋กœ ์ €์žฅ (๋‹จ์ถ•ํ‚ค: `S`) |
67
- | **`[ LOAD MODEL ]`** | **Action** | **Load Checkpoint Weights**: ์ €์žฅ๋œ ๋ชจ๋ธ ๊ฐ€์ค‘์น˜ ์ฆ‰์‹œ ๋ถˆ๋Ÿฌ์˜ค๊ธฐ (๋‹จ์ถ•ํ‚ค: `L`) |
68
-
69
- ---
70
-
71
- ## ๐Ÿ–ฅ๏ธ Telemetry Layout & Panels (7๋Œ€ ํ•ต์‹ฌ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ํŒจ๋„)
72
-
73
- 1. **MAIN 3D SIMULATION VIEW**:
74
- * MuJoCo Humanoid-v5 ์‹ค์‹œ๊ฐ„ 3D ๋ฌผ๋ฆฌ ๋ Œ๋”๋ง ํ™”๋ฉด
75
- * ์ƒ๋‹จ ์ธํฌ๋ฐ”: `EPISODE` // `ALIVE STEPS` // `NOISE SCALE (ฯƒ)`
76
- 2. **TOP BENTO STATS CARDS**:
77
- * `EPISODE REWARD`: ์ด๋ฒˆ ์—ํ”ผ์†Œ๋“œ ์‹ค์‹œ๊ฐ„ ๋ˆ„์  ๋ณด์ƒ
78
- * `PEAK REWARD`: ์—ญ๋Œ€ ์ตœ๊ณ  ๊ธฐ๋ก ๋ณด์ƒ ์ ์ˆ˜
79
- * `20-EP MOVING AVG`: ์ตœ๊ทผ 20 ์—ํ”ผ์†Œ๋“œ ์ด๋™ ํ‰๊ท ์„ 
80
- * `TOTAL TIMESTEPS`: ํ™˜๊ฒฝ ์ƒํ˜ธ์ž‘์šฉ ๋ˆ„์  ์Šคํ…์ˆ˜
81
- 3. **LEARNING DIAGNOSTICS**:
82
- * `Policy Gradient Loss`: ์ •์ฑ… ์‹ ๊ฒฝ๋ง ์†์‹ค ์ง€ํ‘œ
83
- * `Value Function Loss`: ๊ฐ€์น˜ ํ‰๊ฐ€ ์‹ ๊ฒฝ๋ง ์†์‹ค ์ง€ํ‘œ
84
- * `Entropy`: ํƒ์ƒ‰ ๋ฌด์ž‘์œ„์„ฑ ์ฒ™๋„ ๋ฐ ํ•™์Šต ์—…๋ฐ์ดํŠธ ํšŸ์ˆ˜
85
- 4. **ACTUATOR TORQUES (17 DOF)**:
86
- * 17๊ฐœ ๊ด€์ ˆ ๋ชจํ„ฐ(๋ณต๋ถ€, ๊ณ ๊ด€์ ˆ, ๋ฌด๋ฆŽ, ์–ด๊นจ, ํŒ”๊ฟˆ์น˜ ๋“ฑ)์˜ ์‹ค์‹œ๊ฐ„ ํž˜ ๋ฐฉํ–ฅ ๋ฐ ์„ธ๊ธฐ ๋“€์–ผํ†ค ๊ฒŒ์ด์ง€
87
- 5. **REWARD TELEMETRY CURVE**:
88
- * ์ตœ๊ทผ 100๊ฐœ ์—ํ”ผ์†Œ๋“œ ๋ณด์ƒ ๊บพ์€์„  ์ฐจํŠธ (ํ•˜๋‹จ ์—์–ด๋ฆฌ์–ด ํ•„ & ๋™์  ์Šค์ผ€์ผ๋ง)
89
- 6. **SYSTEM CONSOLE LOG**:
90
- * ์—ํ”ผ์†Œ๋“œ ์™„๋ฃŒ ๋ฐ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ์ด๋ฒคํŠธ ์‹ค์‹œ๊ฐ„ ๋ชจ๋…ธ์ŠคํŽ˜์ด์Šค ๋กœ๊ทธ (100% ๋ฐ•์Šค ๋‚ด๋ถ€ ํด๋ฆฌํ•‘)
91
- 7. **FOOTER SHORTCUTS**:
92
- * ํ‚ค๋ณด๋“œ ๋‹จ์ถ•ํ‚ค ๊ฐ€์ด๋“œ ๋ฐ” (`[Space]` `[T]` `[F]` `[P]` `[S]` `[L]` `[R/E]`)
93
-
94
- ---
95
-
96
- ## โŒจ๏ธ Keyboard Shortcuts Reference
97
-
98
- | Key | Action | Description |
99
- | :---: | :--- | :--- |
100
- | **`Space`** | **Pause / Resume** | ํ•™์Šต ๋ฐ 3D ๋ฌผ๋ฆฌ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ •์ง€/์žฌ๊ฐœ |
101
- | **`F`** | **Cycle Speed** | 1X โžก๏ธ 2X โžก๏ธ 4X โžก๏ธ 8X ๋ฐฐ์† ์ˆœํ™˜ |
102
- | **`P`** | **Push Robot** | ๋กœ๋ด‡์—๊ฒŒ ์™ธ๋ž€ ์ถฉ๊ฒฉ(30.0 N) ์ธ๊ฐ€ |
103
- | **`S`** | **Save Model** | ์ตœ์‹  ๊ฐ€์ค‘์น˜๋ฅผ `humanoid_ppo_model.zip`์œผ๋กœ ์ €์žฅ |
104
- | **`L`** | **Load Model** | ์ €์žฅ๋œ ๊ฐ€์ค‘์น˜ ๋ถˆ๋Ÿฌ์˜ค๊ธฐ |
105
- | **`T`** | **Toggle 3D View** | 3D ๋ Œ๋”๋ง ON / OFF |
106
- | **`R` / `E`** | **Reset Episode** | ํ™˜๊ฒฝ ์ฆ‰์‹œ ์ดˆ๊ธฐํ™” |
107
-
108
- ---
109
-
110
- ## ๐Ÿ“Š Model Evaluation & Benchmarks
111
-
112
- 100,000 ์Šคํ… ์ถ”๊ฐ€ ํ›ˆ๋ จ ํ›„ 10๊ฐœ ์—ํ”ผ์†Œ๋“œ ์ •๋ฐ€ ํ‰๊ฐ€ ๊ฒฐ๊ณผ:
113
- * **ํ‰๊ท  ์ƒ์กด ์Šคํ…**: `88.5 steps` (์ตœ๊ณ : `109 steps`)
114
- * **ํ‰๊ท  ๋ˆ„์  ๋ณด์ƒ**: `455.52` (์ตœ๊ณ : `549.18`)
 
1
+ # ๐Ÿค– NEUROMOTION 3.0 // Humanoid-v5 Telemetry & RL
2
+
3
+ [![Language: English](https://img.shields.io/badge/Language-English-blue)](README.md)
4
+ [![Language: ํ•œ๊ตญ์–ด](https://img.shields.io/badge/Language-ํ•œ๊ตญ์–ด-green)](README_KR.md)
5
+ [![Hugging Face Model Hub](https://img.shields.io/badge/๐Ÿค—%20Hugging%20Face-Model%20Hub-orange)](https://huggingface.co/hwihwalab/neuromotion-humanoid-v5-ppo)
6
+ [![GitHub Repository](https://img.shields.io/badge/GitHub-Repository-181717?style=flat&logo=github)](https://github.com/Hwihwa-Lab/neuromotion-humanoid-v5-ppo)
7
+ [![Gymnasium](https://img.shields.io/badge/Gymnasium-MuJoCo%20Humanoid--v5-0080FF)](https://gymnasium.farama.org/environments/mujoco/humanoid/)
8
+ [![PyTorch](https://img.shields.io/badge/PyTorch-2.0+-EE4C2C?style=flat&logo=pytorch)](https://pytorch.org)
9
+ [![Stable-Baselines3](https://img.shields.io/badge/Stable--Baselines3-PPO-brightgreen)](https://stable-baselines3.readthedocs.io)
10
+
11
+ > **MuJoCo Humanoid-v5 PPO Continuous Control & Real-time Engineering Telemetry Dashboard**
12
+ > *[ ๐ŸŒ English Documentation ](README.md) | [ ๐Ÿ‡ฐ๐Ÿ‡ท ํ•œ๊ตญ์–ด ๋งค๋‰ด์–ผ ](README_KR.md)*
13
+
14
+ ์ฒœ์žฌ๋””์ž์ธ์—์ด์ „ํŠธ ๋””์ž์ธ ์‹œ์Šคํ…œ๊ณผ **์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ ๋“œ๋กญ๋‹ค์šด ๋ฉ”๋‰ด(Dropdown Menu)**๊ฐ€ ์žฅ์ฐฉ๋œ **`NEUROMOTION 3.0`** ๊ณต์‹ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ๋งค๋‰ด์–ผ์ž…๋‹ˆ๋‹ค.
15
+
16
+ ---
17
+
18
+ ## ๐Ÿš€ Quick Start & Launch Modes (์‹คํ–‰ ๋ฐฉ๋ฒ•)
19
+
20
+ ### 1. ๐Ÿ–ฅ๏ธ ๋ฉ”์ธ GUI ๋Œ€์‹œ๋ณด๋“œ ์‹คํ–‰ (์ถ”์ฒœ)
21
+ Pygame ๊ธฐ๋ฐ˜ ์‹ค์‹œ๊ฐ„ ๋‹คํฌ ์‚ฌ์ด๋ฒ„ํŽ‘ํฌ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ๋Œ€์‹œ๋ณด๋“œ๋ฅผ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค:
22
+ ```powershell
23
+ python run_gui.py
24
+ ```
25
+
26
+ ### 2. ๐Ÿค— Hugging Face ๋ชจ๋ธ ํ—ˆ๋ธŒ ๋ฐฐํฌ (`deploy_to_hf.py`)
27
+ ํ•™์Šต๋œ ๋ชจ๋ธ ๊ฐ€์ค‘์น˜(`humanoid_ppo_model.zip`)์™€ ์‹คํ–‰ ์ฝ”๋“œ๋ฅผ Hugging Face์— ์›ํด๋ฆญ์œผ๋กœ ์—…๋กœ๋“œํ•ฉ๋‹ˆ๋‹ค:
28
+ ```powershell
29
+ # ์ „์ฒด ๋ชจ๋ธ ๋ฐ ์ฝ”๋“œ ์—…๋กœ๋“œ
30
+ python deploy_to_hf.py
31
+
32
+ # ํŒŒ์ผ ์—…๋กœ๋“œ ์—†์ด ๋ฆฌํฌ์ง€ํ† ๋ฆฌ(hwihwalab/neuromotion-humanoid-v5-ppo)๋งŒ ์ƒ์„ฑํ•  ๋•Œ
33
+ python deploy_to_hf.py --create-only
34
+ ```
35
+
36
+ > ๐Ÿ’ก **ํ–ฅํ›„ ๋ชจ๋ธ ์—…๋ฐ์ดํŠธ ๋ฐฉ๋ฒ•**
37
+ > ์•ž์œผ๋กœ ์ถ”๊ฐ€ ํ•™์Šต์„ ์ง„ํ–‰ํ•œ ํ›„ ๊ฐ€์ค‘์น˜๋‚˜ ์ฝ”๋“œ๋ฅผ ๋‹ค์‹œ ๋ฐฐํฌํ•˜๊ณ  ์‹ถ์œผ์‹ค ๋•Œ๋Š” ์–ธ์ œ๋“  ์•„๋ž˜ ๋ช…๋ น์–ด ํ•œ ์ค„๋งŒ ์‹คํ–‰ํ•˜์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค:
38
+ > ```powershell
39
+ > python deploy_to_hf.py
40
+ > ```
41
+
42
+ ### 3. ๐Ÿ’ป ํ„ฐ๋ฏธ๋„ ๋‹ค์ค‘ ๋ชจ๋“œ ์‹คํ–‰๊ธฐ (`mujoko_humanoid.py`)
43
+ ํ„ฐ๋ฏธ๋„ ๋Œ€ํ™”ํ˜• ๋ฉ”๋‰ด ๋˜๋Š” ๋ช…๋ น์ค„ ์˜ต์…˜์„ ํ†ตํ•ด ๋‹ค์–‘ํ•œ ๋ชฉ์ ๋ณ„ ํ•™์Šต/์‹œ์—ฐ์„ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค:
44
+ ```powershell
45
+ # ๋Œ€ํ™”ํ˜• ๋ฒˆํ˜ธ ์„ ํƒ ๋ฉ”๋‰ด ์‹คํ–‰
46
+ python mujoko_humanoid.py
47
+
48
+ # ๋˜๋Š” ์›ํ•˜๋Š” ๋ชจ๋“œ๋ฅผ ์ง์ ‘ ์ง€์ •ํ•˜์—ฌ ์‹คํ–‰
49
+ python mujoko_humanoid.py --mode train_live # [๋ชจ๋“œ 1] ์‹ค์‹œ๊ฐ„ 3D ์‹œ๊ฐํ™” + ๊ฐ•ํ™”ํ•™์Šต
50
+ python mujoko_humanoid.py --mode train_fast # [๋ชจ๋“œ 2] ๊ณ ์† ๋ฐฑ๊ทธ๋ผ์šด๋“œ ํ•™์Šต + ์ฃผ๊ธฐ์  3D ํ‰๊ฐ€
51
+ python mujoko_humanoid.py --mode play # [๋ชจ๋“œ 3] ํ•™์Šต๋œ ๋ชจ๋ธ(humanoid_ppo_model.zip) 3D ๋ณดํ–‰ ์‹œ์—ฐ
52
+ python mujoko_humanoid.py --mode random # [๋ชจ๋“œ 4] ์ดˆ๊ธฐ ๋ฌด์ž‘์œ„(Random) ํ–‰๋™ ๊ด€์ฐฐ
53
+ ```
54
+
55
+ ---
56
+
57
+ ## ๐Ÿ–ฑ๏ธ Top Control Header (์ƒ๋‹จ ์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ ๋ฒ„ํŠผ & ๋“œ๋กญ๋‹ค์šด ๋ฉ”๋‰ด)
58
+
59
+ ์ƒ๋‹จ ๋ฒ„ํŠผ๋“ค์€ ๋งˆ์šฐ์Šค ํ˜ธ๋ฒ„ ์‹œ **์†๊ฐ€๋ฝ ๋ชจ์–‘ ์ปค์„œ(๐Ÿ‘†)**์™€ ์•ฐ๋น„์–ธํŠธ ํ•˜์ด๋ผ์ดํŠธ๊ฐ€ ์ ์šฉ๋˜๋ฉฐ, ๋“œ๋กญ๋‹ค์šด ๋ฉ”๋‰ด๋ฅผ ํ†ตํ•ด ์›ํ•˜๋Š” ์˜ต์…˜์„ ์ฆ‰์‹œ ์ฝ• ์ฐ์–ด ์„ ํƒํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
60
+
61
+ | Button Name | Type | Options & Function Description |
62
+ | :--- | :---: | :--- |
63
+ | **`[ โ— PPO TRAINING ]` / `[ โธ PAUSED ]`** | **Action** | **Telemetry Pause / Resume**: AI ํ•™์Šต ๋ฐ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ผ์‹œ์ •์ง€ / ์žฌ๊ฐœ (๋‹จ์ถ•ํ‚ค: `Space`) |
64
+ | **`[ SPEED: 1X โ–ผ ]`** | **Dropdown** | **ํด๋ฆญ ์‹œ ๋ฐฐ์† ์„ ํƒ ๋ฉ”๋‰ด ํŒ์—…**:<br>โ€ข `1X Normal (1x)` : ๊ธฐ๋ณธ ์„ธ๋ฐ€ ๊ด€์ฐฐ ์†๋„<br>โ€ข `2X Fast (2x)` : 2๋ฐฐ์† ํ•™์Šต<br>โ€ข `4X Hyper (4x)` : 4๋ฐฐ์† ๊ณ ์† ํ•™์Šต<br>โ€ข `8X Ultra (8x)` : 8๋ฐฐ์† ์ดˆ๊ณ ์† ์ง‘์ค‘ ํ•™์Šต (๋‹จ์ถ•ํ‚ค: `F` ๋กœ ๋น ๋ฅธ ์ˆœํ™˜ ๊ฐ€๋Šฅ) |
65
+ | **`[ PUSH FORCE โ–ผ ]`** | **Dropdown** | **ํด๋ฆญ ์‹œ ์™ธ๋ž€ ์ถฉ๊ฒฉ ์„ธ๊ธฐ ์„ ํƒ ํŒ์—…**:<br>โ€ข `Light Push (15 N)` : ๊ฐ€๋ฒผ์šด ํˆญ ๋ฐ€๊ธฐ<br>โ€ข `Medium Push (30 N)` : ์ค‘๊ฐ„ ๊ท ํ˜• ํ”๋“ค๋ฆผ (๊ธฐ๋ณธ ์™ธ๋ž€)<br>โ€ข `Heavy Force (50 N)` : ๊ฐ•ํ•œ ์ถฉ๊ฒฉํŒŒ ํ…Œ์ŠคํŠธ (๋‹จ์ถ•ํ‚ค: `P` ๋กœ ๊ธฐ๋ณธ 30N ์ธ๊ฐ€) |
66
+ | **`[ SAVE MODEL ]`** | **Action** | **Save Checkpoint Weights**: ํ˜„์žฌ ํ•™์Šต๋œ ์‹ ๊ฒฝ๋ง ๊ฐ€์ค‘์น˜๋ฅผ `humanoid_ppo_model.zip`์œผ๋กœ ์ €์žฅ (๋‹จ์ถ•ํ‚ค: `S`) |
67
+ | **`[ LOAD MODEL ]`** | **Action** | **Load Checkpoint Weights**: ์ €์žฅ๋œ ๋ชจ๋ธ ๊ฐ€์ค‘์น˜ ์ฆ‰์‹œ ๋ถˆ๋Ÿฌ์˜ค๊ธฐ (๋‹จ์ถ•ํ‚ค: `L`) |
68
+
69
+ ---
70
+
71
+ ## ๐Ÿ–ฅ๏ธ Telemetry Layout & Panels (7๋Œ€ ํ•ต์‹ฌ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ํŒจ๋„)
72
+
73
+ 1. **MAIN 3D SIMULATION VIEW**:
74
+ * MuJoCo Humanoid-v5 ์‹ค์‹œ๊ฐ„ 3D ๋ฌผ๋ฆฌ ๋ Œ๋”๋ง ํ™”๋ฉด
75
+ * ์ƒ๋‹จ ์ธํฌ๋ฐ”: `EPISODE` // `ALIVE STEPS` // `NOISE SCALE (ฯƒ)`
76
+ 2. **TOP BENTO STATS CARDS**:
77
+ * `EPISODE REWARD`: ์ด๋ฒˆ ์—ํ”ผ์†Œ๋“œ ์‹ค์‹œ๊ฐ„ ๋ˆ„์  ๋ณด์ƒ
78
+ * `PEAK REWARD`: ์—ญ๋Œ€ ์ตœ๊ณ  ๊ธฐ๋ก ๋ณด์ƒ ์ ์ˆ˜
79
+ * `20-EP MOVING AVG`: ์ตœ๊ทผ 20 ์—ํ”ผ์†Œ๋“œ ์ด๋™ ํ‰๊ท ์„ 
80
+ * `TOTAL TIMESTEPS`: ํ™˜๊ฒฝ ์ƒํ˜ธ์ž‘์šฉ ๋ˆ„์  ์Šคํ…์ˆ˜
81
+ 3. **LEARNING DIAGNOSTICS**:
82
+ * `Policy Gradient Loss`: ์ •์ฑ… ์‹ ๊ฒฝ๋ง ์†์‹ค ์ง€ํ‘œ
83
+ * `Value Function Loss`: ๊ฐ€์น˜ ํ‰๊ฐ€ ์‹ ๊ฒฝ๋ง ์†์‹ค ์ง€ํ‘œ
84
+ * `Entropy`: ํƒ์ƒ‰ ๋ฌด์ž‘์œ„์„ฑ ์ฒ™๋„ ๋ฐ ํ•™์Šต ์—…๋ฐ์ดํŠธ ํšŸ์ˆ˜
85
+ 4. **ACTUATOR TORQUES (17 DOF)**:
86
+ * 17๊ฐœ ๊ด€์ ˆ ๋ชจํ„ฐ(๋ณต๋ถ€, ๊ณ ๊ด€์ ˆ, ๋ฌด๋ฆŽ, ์–ด๊นจ, ํŒ”๊ฟˆ์น˜ ๋“ฑ)์˜ ์‹ค์‹œ๊ฐ„ ํž˜ ๋ฐฉํ–ฅ ๋ฐ ์„ธ๊ธฐ ๋“€์–ผํ†ค ๊ฒŒ์ด์ง€
87
+ 5. **REWARD TELEMETRY CURVE**:
88
+ * ์ตœ๊ทผ 100๊ฐœ ์—ํ”ผ์†Œ๋“œ ๋ณด์ƒ ๊บพ์€์„  ์ฐจํŠธ (ํ•˜๋‹จ ์—์–ด๋ฆฌ์–ด ํ•„ & ๋™์  ์Šค์ผ€์ผ๋ง)
89
+ 6. **SYSTEM CONSOLE LOG**:
90
+ * ์—ํ”ผ์†Œ๋“œ ์™„๋ฃŒ ๋ฐ ํ…”๋ ˆ๋ฉ”ํŠธ๋ฆฌ ์ด๋ฒคํŠธ ์‹ค์‹œ๊ฐ„ ๋ชจ๋…ธ์ŠคํŽ˜์ด์Šค ๋กœ๊ทธ (100% ๋ฐ•์Šค ๋‚ด๋ถ€ ํด๋ฆฌํ•‘)
91
+ 7. **FOOTER SHORTCUTS**:
92
+ * ํ‚ค๋ณด๋“œ ๋‹จ์ถ•ํ‚ค ๊ฐ€์ด๋“œ ๋ฐ” (`[Space]` `[T]` `[F]` `[P]` `[S]` `[L]` `[R/E]`)
93
+
94
+ ---
95
+
96
+ ## โŒจ๏ธ Keyboard Shortcuts Reference
97
+
98
+ | Key | Action | Description |
99
+ | :---: | :--- | :--- |
100
+ | **`Space`** | **Pause / Resume** | ํ•™์Šต ๋ฐ 3D ๋ฌผ๋ฆฌ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ •์ง€/์žฌ๊ฐœ |
101
+ | **`F`** | **Cycle Speed** | 1X โžก๏ธ 2X โžก๏ธ 4X โžก๏ธ 8X ๋ฐฐ์† ์ˆœํ™˜ |
102
+ | **`P`** | **Push Robot** | ๋กœ๋ด‡์—๊ฒŒ ์™ธ๋ž€ ์ถฉ๊ฒฉ(30.0 N) ์ธ๊ฐ€ |
103
+ | **`S`** | **Save Model** | ์ตœ์‹  ๊ฐ€์ค‘์น˜๋ฅผ `humanoid_ppo_model.zip`์œผ๋กœ ์ €์žฅ |
104
+ | **`L`** | **Load Model** | ์ €์žฅ๋œ ๊ฐ€์ค‘์น˜ ๋ถˆ๋Ÿฌ์˜ค๊ธฐ |
105
+ | **`T`** | **Toggle 3D View** | 3D ๋ Œ๋”๋ง ON / OFF |
106
+ | **`R` / `E`** | **Reset Episode** | ํ™˜๊ฒฝ ์ฆ‰์‹œ ์ดˆ๊ธฐํ™” |
107
+
108
+ ---
109
+
110
+ ## ๐Ÿ“Š Model Evaluation & Benchmarks
111
+
112
+ 100,000 ์Šคํ… ์ถ”๊ฐ€ ํ›ˆ๋ จ ํ›„ 10๊ฐœ ์—ํ”ผ์†Œ๋“œ ์ •๋ฐ€ ํ‰๊ฐ€ ๊ฒฐ๊ณผ:
113
+ * **ํ‰๊ท  ์ƒ์กด ์Šคํ…**: `88.5 steps` (์ตœ๊ณ : `109 steps`)
114
+ * **ํ‰๊ท  ๋ˆ„์  ๋ณด์ƒ**: `455.52` (์ตœ๊ณ : `549.18`)