PLDR-LLMs Reason At Self-Organized Criticality - a fromthesky Collection

fromthesky 's Collections

PLDR-LLMs Reason At Self-Organized Criticality

Pretrained PLDR-LLMs with KVG cache (Pytorch/Transformers)

Finetuned PLDR-LLMs

Pretrained PLDR-LLMs (Tensorflow)

PLDR-LLMs Reason At Self-Organized Criticality

updated 5 days ago

Models pretrained for the paper titled "PLDR-LLMs Reason At Self-Organized Criticality".

PLDR-LLMs Reason At Self-Organized Criticality

Paper • 2603.23539 • Published Mar 12 • 5
Power law graph attention: exact generalization of scaled dot-product attention, empirical collapse at inference

Paper • 2608.10288 • Published 8 days ago • 7
fromthesky/PLDR-LLM-v51-SOC-110M-1

Text Generation • 0.1B • Updated Mar 26 • 38 • 1
fromthesky/PLDR-LLM-v51-SOC-110M-2

Text Generation • 0.1B • Updated Mar 26 • 13
fromthesky/PLDR-LLM-v51-SOC-110M-3

Text Generation • 0.1B • Updated Mar 26 • 13
fromthesky/PLDR-LLM-v51-SOC-110M-4

Text Generation • 0.1B • Updated Mar 26 • 15
fromthesky/PLDR-LLM-v51-SOC-110M-5

Text Generation • 0.1B • Updated Mar 26 • 19