Image-to-3D
Trellis
Safetensors
localmesh-engine
mesh
gltf
multi-view
3d-generation
Qtn-Cls commited on
Commit
2e1f293
·
verified ·
1 Parent(s): 6449125

Le depot porte tout le moteur, range comme le disque le lit

Browse files
Files changed (1) hide show
  1. README.md +38 -16
README.md CHANGED
@@ -30,12 +30,27 @@ upstream repositories and is listed below.
30
 
31
  ## What is in this repository
32
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  | File | Size | Source |
34
  |---|---|---|
35
- | `structure_mv_fp8.safetensors` + `.json` | 1.39 GB | fp8 conversion of `ckpts/ss_flow_img_dit_1_3B_64_bf16_mv.safetensors`, TencentARC/Pixal3D |
36
- | `forme_512_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_512_bf16_mv.safetensors`, TencentARC/Pixal3D |
37
- | `forme_1024_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_1024_bf16_mv.safetensors`, TencentARC/Pixal3D |
38
- | `champ.safetensors` | 2.7 MB | valeoai/NAF, official checkpoint, tensors unchanged |
39
 
40
  **`structure_mv_fp8`** fuses the four encoded views into a sparse volume of
41
  cells. Each view is projected onto the shared grid by its own camera.
@@ -48,8 +63,9 @@ decoder turns its latent into the mesh.
48
  fills in the detail the token map loses: the token map is sixteen times coarser
49
  than the photo.
50
 
51
- 4.28 GB in total, seven files. Keep the three `.json` descriptors next to their
52
- `.safetensors`: the engine builds each flow model on the `meta` device from that
 
53
  descriptor, then loads the tensors in place, so the weights are never held
54
  twice. The descriptors declare `dtype: float8_e4m3fn`.
55
 
@@ -74,33 +90,39 @@ Set `LOCALMESH_ROOT` to the folder that holds `models/`, then:
74
 
75
  ```bash
76
  pip install -U huggingface_hub
77
- hf download Qtn-Cls/LocalMeshEngine --local-dir "$LOCALMESH_ROOT/models/multivue"
78
  ```
79
 
80
- This repository is flat, so the seven files land exactly where the engine looks
81
- for them. There is nothing to move afterwards.
 
 
 
 
 
 
82
 
83
  The layout the engine reads:
84
 
85
  ```
86
  <LOCALMESH_ROOT>/models/
87
- TRELLIS.2-4B/ pipeline.json (or pipeline_fp8.json), ckpts_fp8/
88
- microsoft/TRELLIS-image-large/ckpts/ ss_dec_conv3d_16l8_fp16.json + .safetensors
89
- facebook/dinov3-vitl16-pretrain-lvd1689m/
90
  multivue/ this repository
91
- multivue/cameras/ DA3-BASE, model.safetensors + config.json
 
92
  hf/ Hugging Face cache (HF_HOME), where BiRefNet_HR lands
93
  ```
94
 
95
  Then, from the four sides of one subject:
96
 
97
  ```bash
98
- python -m localmesh_engine face.png --droite right.png --gauche left.png --dos back.png --vers out/
99
  ```
100
 
101
- `--palier` picks the tier: `draft`, `standard`, `high` or `max`, written
102
  Draft, Standard, Detailed and Extreme where these pages spell them out.
103
- `--graine` sets the seed, `--vers` the output folder. The command assumes the package is installed.
104
  The four view path also needs `natten`. Installation, including the three CUDA
105
  extensions that are not on PyPI, is written up in `docs/INSTALL.md` in the
106
  GitHub repository; the four tiers, frozen, are in `docs/RECIPES.md`.
 
30
 
31
  ## What is in this repository
32
 
33
+ This repository holds **the whole LocalMesh engine**, except one set Meta
34
+ gates. It is laid out exactly like the folder the engine reads, so one command
35
+ places all of it:
36
+
37
+ | Folder | Size | What it is | Whose |
38
+ |---|---|---|---|
39
+ | `TRELLIS.2-4B/` | 8.1 GB | the single photo path, in fp8 | [visualbruno](https://huggingface.co/visualbruno/TRELLIS.2-4B-FP8), MIT — rehosted unchanged |
40
+ | `microsoft/` | 148 MB | the sparse structure decoder | [Microsoft](https://huggingface.co/microsoft/TRELLIS-image-large), MIT — rehosted unchanged |
41
+ | `multivue/` | 4.8 GB | the four view path | ours, from Pixal3D — see below |
42
+
43
+ Rehosted so that one `hf download` replaces six. Taking those two from their
44
+ own repositories works exactly as well; nothing here is modified.
45
+
46
+ ### What is ours, under `multivue/`
47
+
48
  | File | Size | Source |
49
  |---|---|---|
50
+ | `multivue/structure_mv_fp8.safetensors` + `.json` | 1.39 GB | fp8 conversion of `ckpts/ss_flow_img_dit_1_3B_64_bf16_mv.safetensors`, TencentARC/Pixal3D |
51
+ | `multivue/forme_512_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_512_bf16_mv.safetensors`, TencentARC/Pixal3D |
52
+ | `multivue/forme_1024_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_1024_bf16_mv.safetensors`, TencentARC/Pixal3D |
53
+ | `multivue/champ.safetensors` | 2.7 MB | valeoai/NAF, official checkpoint, tensors unchanged |
54
 
55
  **`structure_mv_fp8`** fuses the four encoded views into a sparse volume of
56
  cells. Each view is projected onto the shared grid by its own camera.
 
63
  fills in the detail the token map loses: the token map is sixteen times coarser
64
  than the photo.
65
 
66
+ 4.28 GB, seven files, plus `multivue/cameras/` DA3-BASE and the code that
67
+ reads it, 544 MB, Apache-2.0, unchanged. Keep the three `.json` descriptors
68
+ next to their `.safetensors`: the engine builds each flow model on the `meta` device from that
69
  descriptor, then loads the tensors in place, so the weights are never held
70
  twice. The descriptors declare `dtype: float8_e4m3fn`.
71
 
 
90
 
91
  ```bash
92
  pip install -U huggingface_hub
93
+ hf download Qtn-Cls/LocalMeshEngine --local-dir "$LOCALMESH_ROOT/models"
94
  ```
95
 
96
+ 13.1 GB, and every file lands exactly where the engine looks for it. There is
97
+ nothing to move afterwards. For the single photo path alone, 8.3 GB, add
98
+ `--exclude "multivue/*"`.
99
+
100
+ **Then ask Meta for DINOv3**, the one set that is not here and cannot be: it is
101
+ gated, and a human grants access. Nothing generates without it, and approval is
102
+ not instant, so send the request before anything else —
103
+ [facebook/dinov3-vitl16-pretrain-lvd1689m](https://huggingface.co/facebook/dinov3-vitl16-pretrain-lvd1689m).
104
 
105
  The layout the engine reads:
106
 
107
  ```
108
  <LOCALMESH_ROOT>/models/
109
+ TRELLIS.2-4B/ this repository
110
+ microsoft/TRELLIS-image-large/ckpts/ this repository
 
111
  multivue/ this repository
112
+ multivue/cameras/ this repository, DA3-BASE
113
+ facebook/dinov3-vitl16-pretrain-lvd1689m/ from Meta, gated
114
  hf/ Hugging Face cache (HF_HOME), where BiRefNet_HR lands
115
  ```
116
 
117
  Then, from the four sides of one subject:
118
 
119
  ```bash
120
+ python -m localmesh_engine face.png --right right.png --left left.png --back back.png --to out/
121
  ```
122
 
123
+ `--tier` picks the tier: `draft`, `standard`, `high` or `max`, written
124
  Draft, Standard, Detailed and Extreme where these pages spell them out.
125
+ `--seed` sets the seed, `--to` the output folder. The command assumes the package is installed.
126
  The four view path also needs `natten`. Installation, including the three CUDA
127
  extensions that are not on PyPI, is written up in `docs/INSTALL.md` in the
128
  GitHub repository; the four tiers, frozen, are in `docs/RECIPES.md`.