JackHopkinsGSL commited on
Commit
d020cb8
·
verified ·
1 Parent(s): d3558ae

Upload embed_int8.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. embed_int8.json +1 -0
embed_int8.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"vocab": 151936, "dim": 2048, "dtype": "int8", "scheme": "per_row_symmetric", "note": "dequant: f32[j]=q[j]*scale[row]; row-major little-endian; scales are float32 length V"}