24 GB cards and CPU offload
Collection
The big ones. Includes the 122B with its measured expert-offload recipe (about 18 GB VRAM plus 34 GB RAM). • 4 items • Updated
AI & ML interests
Deep experimentation on ablation and quanting. Goal: trim the fat on models. Question: Is all data, good data, or, is some just noise?