How to use from the
Use from the
MLX library
# Download the model from the Hub
pip install huggingface_hub[hf_xet]

huggingface-cli download --local-dir SEA-RAFT-Tartan-C-T-TSKH-spring540x960-S-mlx mlx-community/SEA-RAFT-Tartan-C-T-TSKH-spring540x960-S-mlx

mlx-community/SEA-RAFT-Tartan-C-T-TSKH-spring540x960-S-mlx

SEA-RAFT-S (Wang, Lipson, Deng — "SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow", ECCV 2024) converted to Apple MLX format (NHWC), consumed by xocialize/sea-raft-mlx (Python) and the upcoming MLX-Swift port.

This is the full training-schedule checkpoint (best accuracy): TartanAir → FlyingChairs → FlyingThings3D → Sintel/KITTI/HD1K → Spring. Note: the later stages use research-restricted datasets (documented here per provenance policy). For the cleanest chain (TartanAir/CC-BY only), see SEA-RAFT-Tartan480x640-S-mlx.

Parity

Converted weights verified against the PyTorch reference (princeton-vl/SEA-RAFT@9137517) on an identical input pair: final flow cosine 1.0000, max_abs 1.2e-3 px, EPE 1.1e-4 px (fp32 CPU).

Model

  • Variant S: ResNet-18-style FPN backbone, dim 128, 4-level all-pairs correlation (r=4), 2 ConvNeXt update blocks, 4 iterations, convex 8× upsample.
  • Input [N, H, W, 3] RGB in 0–255; output [N, H, W, 2] flow in pixels.

Files

model.safetensors (MLX NHWC, fp32) · config.json.

License & provenance

  • Code + weights: BSD-3-Clause — the upstream repository LICENSE (Princeton Vision & Learning Lab, 2024). The original checkpoint is the first author's upload MemorySlices/Tartan-C-T-TSKH-spring540x960-S (tagged bsd-3-clause).
  • Training data (full schedule): TartanAir (CC-BY-4.0), FlyingChairs, FlyingThings3D, Sintel, KITTI, HD1K, Spring.
  • Author confirmation (2026-06-10): the authors confirmed in princeton-vl/SEA-RAFT#31 that "we intend the BSD-3-Clause license to cover the checkpoints as well" — the weights are BSD-3-Clause by explicit author statement. Conversion is format-only (NCHW→NHWC), with attribution retained.
Downloads last month
33
Safetensors
Model size
8.89M params
Tensor type
F32
·
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mlx-community/SEA-RAFT-Tartan-C-T-TSKH-spring540x960-S-mlx

Finetuned
(1)
this model