Jacobian Lens for GLM-4-9B-0414
A fitted Jacobian lens for
zai-org/GLM-4-9B-0414,
from Anthropic's Verbalizable Representations Form a Global Workspace in Language
Models, fitted with the
reference implementation anthropics/jacobian-lens.
Contents
| field | value |
|---|---|
| base model | zai-org/GLM-4-9B-0414 (40 layers, d_model=4096) |
| source layers | 0–38 (all 39 layers below the final) |
| target layer | 39 (final) |
| Jacobian shape | [4096, 4096] per layer, fp16 on disk |
| file size | ~1.22 GiB |
| fitting corpus | 100 WikiText-103 prompts × 128 tokens (first 16 positions skipped as attention sinks) |
| estimator | dim_batch=8, mean over valid source positions |
| fit hardware | 1× NVIDIA H100 80GB, ~85 min, peak 24.5 GiB VRAM |
License
Apache-2.0, matching the reference implementation. The base model
zai-org/GLM-4-9B-0414 is MIT-licensed.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for andyx10/jacobian-lens-glm4-9b
Base model
zai-org/GLM-4-9B-0414