384 MB

Ctrl+K

1 contributor

Fix: lazy non-persistent RoPE buffers — HF from_pretrained's meta-init was leaving persistent rope_cos/rope_sin uninitialised, producing NaN logits. Buffers are now computed on first forward.

fa90715 verified 3 months ago

.gitattributes

1.52 kB
initial commit 4 months ago
README.md

2.01 kB
Upload folder using huggingface_hub 4 months ago
config.json

799 Bytes
Upload folder using huggingface_hub 4 months ago
configuration_yatnmn_full_gpt.py

1.78 kB
Upload folder using huggingface_hub 4 months ago
model.safetensors

384 MB
xet

Upload folder using huggingface_hub 4 months ago
modeling_yatnmn_full_gpt.py

9.14 kB
Fix: lazy non-persistent RoPE buffers — HF from_pretrained's meta-init was leaving persistent rope_cos/rope_sin uninitialised, producing NaN logits. Buffers are now computed on first forward. 3 months ago
torch_gpt.py

16.4 kB
Fix: lazy non-persistent RoPE buffers — HF from_pretrained's meta-init was leaving persistent rope_cos/rope_sin uninitialised, producing NaN logits. Buffers are now computed on first forward. 4 months ago
yatnmn_full_gpt.py

10.3 kB
Fix: lazy non-persistent RoPE buffers — HF from_pretrained's meta-init was leaving persistent rope_cos/rope_sin uninitialised, producing NaN logits. Buffers are now computed on first forward. 3 months ago
yatnmn_gpt.py

16.5 kB
Fix: lazy non-persistent RoPE buffers — HF from_pretrained's meta-init was leaving persistent rope_cos/rope_sin uninitialised, producing NaN logits. Buffers are now computed on first forward. 3 months ago