BASE Banner

PRISM top architecture

Global-best miner architecture on Base PRISM β€” benchmarks vs GPT-2 / GPT-2 Large


Benchmarks vs GPT-2 (Prism-protocol)

Prism-protocol public eval pack (1Γ—RTX 5090). Accuracy: ↑ higher better. BPB: ↓ lower better. References: GPT-2 (124M) Β· GPT-2 Large (774M) (eval-only; not miner trains).

Metric This model GPT-2 GPT-2 Large vs GPT-2 vs GPT-2 Large
Val BPB (G1) 3.7181 4.7595 4.1639 ↓ -1.0414 βœ“ better ↓ -0.4458 βœ“ better
HellaSwag 0.360 0.355 0.395 ↑ +0.005 βœ“ better ↓ -0.035 worse
ARC-Easy 0.335 0.245 0.280 ↑ +0.090 βœ“ better ↑ +0.055 βœ“ better
ARC-Challenge 0.295 0.240 0.280 ↑ +0.055 βœ“ better ↑ +0.015 βœ“ better
PIQA 0.630 0.585 0.690 ↑ +0.045 βœ“ better ↓ -0.060 worse
WinoGrande 0.520 0.515 0.545 ↑ +0.005 βœ“ better ↓ -0.025 worse
BoolQ 0.630 0.575 0.640 ↑ +0.055 βœ“ better ↓ -0.010 worse
LAMBADA 0.955 0.970 0.985 ↓ -0.015 worse ↓ -0.030 worse
OpenBookQA 0.310 0.320 0.335 ↓ -0.010 worse ↓ -0.025 worse

Compute notes

This model GPT-2 GPT-2 Large
Parameters 107.0M 124M 774M
Size vs Large 7.23Γ— vs GPT-2 Large (774M) 6.22Γ— 1Γ—
Train tokens β€” (eval-only) (eval-only)
Wall clock 20539s (eval-only) (eval-only)
Sustained train throughput β€” n/a n/a
GPU (harness) GPU 0: NVIDIA GeForce RTX 5090 (UUID: GPU-e31dbb89-6a01-a2fb-2684-3b6f0efb3f28) 1Γ—RTX 5090 (eval) 1Γ—RTX 5090 (eval)

Throughput β‰ˆ 6 Γ— N Γ— D / wall TFLOPS (dense transformer train FLOPs rule of thumb).

Model card

field value
arch_id arch_f17d92b32a8c79f7
bpb 3.718067
submission 7b8658aedfdb158782567d09e26a9e819c578ff20c4db1d940e12de77cd9d6d2
owner_hotkey 462c4a7dfe30…
hub repo BaseIntelligence/top-prism-architecture

Load (trust_remote_code)

from transformers import AutoModel, AutoConfig
cfg = AutoConfig.from_pretrained("BaseIntelligence/top-prism-architecture", trust_remote_code=True)
model = AutoModel.from_pretrained("BaseIntelligence/top-prism-architecture", trust_remote_code=True)

Weights: checkpoint.pt (Hub LFS when large). Load via PrismCustomModel.from_pretrained with trust_remote_code=True.

Companion GitHub publish (when configured) lives under BaseIntelligence/prism top-model/.

Downloads last month
1,369
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support