Instructions to use Qtn-Cls/LocalMeshEngine with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Trellis
How to use Qtn-Cls/LocalMeshEngine with Trellis:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Le depot porte tout le moteur, range comme le disque le lit
Browse files
README.md
CHANGED
|
@@ -30,12 +30,27 @@ upstream repositories and is listed below.
|
|
| 30 |
|
| 31 |
## What is in this repository
|
| 32 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
| File | Size | Source |
|
| 34 |
|---|---|---|
|
| 35 |
-
| `structure_mv_fp8.safetensors` + `.json` | 1.39 GB | fp8 conversion of `ckpts/ss_flow_img_dit_1_3B_64_bf16_mv.safetensors`, TencentARC/Pixal3D |
|
| 36 |
-
| `forme_512_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_512_bf16_mv.safetensors`, TencentARC/Pixal3D |
|
| 37 |
-
| `forme_1024_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_1024_bf16_mv.safetensors`, TencentARC/Pixal3D |
|
| 38 |
-
| `champ.safetensors` | 2.7 MB | valeoai/NAF, official checkpoint, tensors unchanged |
|
| 39 |
|
| 40 |
**`structure_mv_fp8`** fuses the four encoded views into a sparse volume of
|
| 41 |
cells. Each view is projected onto the shared grid by its own camera.
|
|
@@ -48,8 +63,9 @@ decoder turns its latent into the mesh.
|
|
| 48 |
fills in the detail the token map loses: the token map is sixteen times coarser
|
| 49 |
than the photo.
|
| 50 |
|
| 51 |
-
4.28 GB
|
| 52 |
-
|
|
|
|
| 53 |
descriptor, then loads the tensors in place, so the weights are never held
|
| 54 |
twice. The descriptors declare `dtype: float8_e4m3fn`.
|
| 55 |
|
|
@@ -74,33 +90,39 @@ Set `LOCALMESH_ROOT` to the folder that holds `models/`, then:
|
|
| 74 |
|
| 75 |
```bash
|
| 76 |
pip install -U huggingface_hub
|
| 77 |
-
hf download Qtn-Cls/LocalMeshEngine --local-dir "$LOCALMESH_ROOT/models
|
| 78 |
```
|
| 79 |
|
| 80 |
-
|
| 81 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
|
| 83 |
The layout the engine reads:
|
| 84 |
|
| 85 |
```
|
| 86 |
<LOCALMESH_ROOT>/models/
|
| 87 |
-
TRELLIS.2-4B/
|
| 88 |
-
microsoft/TRELLIS-image-large/ckpts/
|
| 89 |
-
facebook/dinov3-vitl16-pretrain-lvd1689m/
|
| 90 |
multivue/ this repository
|
| 91 |
-
multivue/cameras/ DA3-BASE
|
|
|
|
| 92 |
hf/ Hugging Face cache (HF_HOME), where BiRefNet_HR lands
|
| 93 |
```
|
| 94 |
|
| 95 |
Then, from the four sides of one subject:
|
| 96 |
|
| 97 |
```bash
|
| 98 |
-
python -m localmesh_engine face.png --
|
| 99 |
```
|
| 100 |
|
| 101 |
-
`--
|
| 102 |
Draft, Standard, Detailed and Extreme where these pages spell them out.
|
| 103 |
-
`--
|
| 104 |
The four view path also needs `natten`. Installation, including the three CUDA
|
| 105 |
extensions that are not on PyPI, is written up in `docs/INSTALL.md` in the
|
| 106 |
GitHub repository; the four tiers, frozen, are in `docs/RECIPES.md`.
|
|
|
|
| 30 |
|
| 31 |
## What is in this repository
|
| 32 |
|
| 33 |
+
This repository holds **the whole LocalMesh engine**, except one set Meta
|
| 34 |
+
gates. It is laid out exactly like the folder the engine reads, so one command
|
| 35 |
+
places all of it:
|
| 36 |
+
|
| 37 |
+
| Folder | Size | What it is | Whose |
|
| 38 |
+
|---|---|---|---|
|
| 39 |
+
| `TRELLIS.2-4B/` | 8.1 GB | the single photo path, in fp8 | [visualbruno](https://huggingface.co/visualbruno/TRELLIS.2-4B-FP8), MIT — rehosted unchanged |
|
| 40 |
+
| `microsoft/` | 148 MB | the sparse structure decoder | [Microsoft](https://huggingface.co/microsoft/TRELLIS-image-large), MIT — rehosted unchanged |
|
| 41 |
+
| `multivue/` | 4.8 GB | the four view path | ours, from Pixal3D — see below |
|
| 42 |
+
|
| 43 |
+
Rehosted so that one `hf download` replaces six. Taking those two from their
|
| 44 |
+
own repositories works exactly as well; nothing here is modified.
|
| 45 |
+
|
| 46 |
+
### What is ours, under `multivue/`
|
| 47 |
+
|
| 48 |
| File | Size | Source |
|
| 49 |
|---|---|---|
|
| 50 |
+
| `multivue/structure_mv_fp8.safetensors` + `.json` | 1.39 GB | fp8 conversion of `ckpts/ss_flow_img_dit_1_3B_64_bf16_mv.safetensors`, TencentARC/Pixal3D |
|
| 51 |
+
| `multivue/forme_512_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_512_bf16_mv.safetensors`, TencentARC/Pixal3D |
|
| 52 |
+
| `multivue/forme_1024_mv_fp8.safetensors` + `.json` | 1.44 GB | fp8 conversion of `ckpts/slat_flow_img2shape_dit_1_3B_1024_bf16_mv.safetensors`, TencentARC/Pixal3D |
|
| 53 |
+
| `multivue/champ.safetensors` | 2.7 MB | valeoai/NAF, official checkpoint, tensors unchanged |
|
| 54 |
|
| 55 |
**`structure_mv_fp8`** fuses the four encoded views into a sparse volume of
|
| 56 |
cells. Each view is projected onto the shared grid by its own camera.
|
|
|
|
| 63 |
fills in the detail the token map loses: the token map is sixteen times coarser
|
| 64 |
than the photo.
|
| 65 |
|
| 66 |
+
4.28 GB, seven files, plus `multivue/cameras/` — DA3-BASE and the code that
|
| 67 |
+
reads it, 544 MB, Apache-2.0, unchanged. Keep the three `.json` descriptors
|
| 68 |
+
next to their `.safetensors`: the engine builds each flow model on the `meta` device from that
|
| 69 |
descriptor, then loads the tensors in place, so the weights are never held
|
| 70 |
twice. The descriptors declare `dtype: float8_e4m3fn`.
|
| 71 |
|
|
|
|
| 90 |
|
| 91 |
```bash
|
| 92 |
pip install -U huggingface_hub
|
| 93 |
+
hf download Qtn-Cls/LocalMeshEngine --local-dir "$LOCALMESH_ROOT/models"
|
| 94 |
```
|
| 95 |
|
| 96 |
+
13.1 GB, and every file lands exactly where the engine looks for it. There is
|
| 97 |
+
nothing to move afterwards. For the single photo path alone, 8.3 GB, add
|
| 98 |
+
`--exclude "multivue/*"`.
|
| 99 |
+
|
| 100 |
+
**Then ask Meta for DINOv3**, the one set that is not here and cannot be: it is
|
| 101 |
+
gated, and a human grants access. Nothing generates without it, and approval is
|
| 102 |
+
not instant, so send the request before anything else —
|
| 103 |
+
[facebook/dinov3-vitl16-pretrain-lvd1689m](https://huggingface.co/facebook/dinov3-vitl16-pretrain-lvd1689m).
|
| 104 |
|
| 105 |
The layout the engine reads:
|
| 106 |
|
| 107 |
```
|
| 108 |
<LOCALMESH_ROOT>/models/
|
| 109 |
+
TRELLIS.2-4B/ this repository
|
| 110 |
+
microsoft/TRELLIS-image-large/ckpts/ this repository
|
|
|
|
| 111 |
multivue/ this repository
|
| 112 |
+
multivue/cameras/ this repository, DA3-BASE
|
| 113 |
+
facebook/dinov3-vitl16-pretrain-lvd1689m/ from Meta, gated
|
| 114 |
hf/ Hugging Face cache (HF_HOME), where BiRefNet_HR lands
|
| 115 |
```
|
| 116 |
|
| 117 |
Then, from the four sides of one subject:
|
| 118 |
|
| 119 |
```bash
|
| 120 |
+
python -m localmesh_engine face.png --right right.png --left left.png --back back.png --to out/
|
| 121 |
```
|
| 122 |
|
| 123 |
+
`--tier` picks the tier: `draft`, `standard`, `high` or `max`, written
|
| 124 |
Draft, Standard, Detailed and Extreme where these pages spell them out.
|
| 125 |
+
`--seed` sets the seed, `--to` the output folder. The command assumes the package is installed.
|
| 126 |
The four view path also needs `natten`. Installation, including the three CUDA
|
| 127 |
extensions that are not on PyPI, is written up in `docs/INSTALL.md` in the
|
| 128 |
GitHub repository; the four tiers, frozen, are in `docs/RECIPES.md`.
|