ShapeSplats/Objaverse_Splats
Updated • 233 • 2
How to use shahafvl/gaussianformer-256px with GaussianFormer:
# pip install "gaussianformer @ git+https://github.com/SVLwoof/gaussianformer"
from gaussianformer import GaussianFormerRenderingPipeline, load_ply
pipeline = GaussianFormerRenderingPipeline.from_pretrained("shahafvl/gaussianformer-256px").to("cuda")
gaussians = load_ply("object.ply") # 3D Gaussian Splatting PLY -> [N, 14]The checkpoint after the two 256 px training stages (Gaussian input head, then the whole model, both from RenderFormer's weights). It is the starting point of the last two stages that produce GaussianFormer, and is published so those stages can be reproduced exactly. For rendering, use shahafvl/gaussianformer.
Code: github.com/SVLwoof/gaussianformer
BASE=shahafvl/gaussianformer-256px scripts/train.sh # stages 3 (256 px recovery) and 4 (512 px)
Architecture: RenderFormer's layout with 8 px patches and dense cross-attention; stage 3 switches on the projected 2-D RoPE, the windowed cross-attention and 4 px patches.
Trained on Objaverse_Splats, a subset of Objaverse whose terms restrict commercial use; CC-BY-NC-4.0, research and non-commercial use only.
Base model
microsoft/renderformer-v1-base