harrrshall commited on
Commit
7094062
Β·
verified Β·
1 Parent(s): bb0fdaa

Add fp16 build section (optional half-size checkpoint, verified no quality loss)

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -86,6 +86,30 @@ Input conventions (important):
86
  chunk longer input on clause boundaries.
87
  - Language token is `"hi"` for Hinglish (the Hindi tokenizer carries the Latin English spans).
88
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
89
  ---
90
 
91
  ## The synthetic-data recipe (the core of this project)
 
86
  chunk longer input on clause boundaries.
87
  - Language token is `"hi"` for Hinglish (the Hindi tokenizer carries the Latin English spans).
88
 
89
+ ## Smaller download β€” fp16 build (optional, no quality loss)
90
+
91
+ `model_fp16.pth` (**~1.04 GB**, half of `model.pth`'s 2.08 GB) is an optional smaller build. The
92
+ weights are stored in fp16 but **upcast to fp32 when the model loads**, so inference math is
93
+ unchanged β€” this is *not* runtime half-precision (`model.half()`), which XTTS's vocoder can't do
94
+ safely. To use it, just swap the checkpoint path:
95
+
96
+ ```python
97
+ model.load_checkpoint(config, checkpoint_path=f"{repo}/model_fp16.pth",
98
+ vocab_path=f"{repo}/vocab.json", use_deepspeed=False)
99
+ ```
100
+
101
+ No-quality-loss was verified three independent ways (paired, with bootstrap 95% CIs):
102
+
103
+ | Test | Result |
104
+ |------|--------|
105
+ | Numerical equivalence (deterministic) | latent/speaker cosine β‰ˆ 0.999999; greedy decode **bit-identical tokens** on all voices; vocoder SNR 35-42 dB |
106
+ | Greedy-paired (isolates fp16 rounding) | UTMOS βˆ’0.010 [βˆ’0.034, +0.003]; SECS βˆ’0.0005 [βˆ’0.0016, +0.0001] |
107
+ | Sampled-paired (temp 0.7, real usage) | UTMOS +0.007 [βˆ’0.005, +0.020]; SECS βˆ’0.0009 [βˆ’0.0021, βˆ’0.0000] |
108
+
109
+ Every delta is within metric noise and an order of magnitude below the student-vs-teacher gaps
110
+ above. Method and scripts: `scripts/hinglish/fp16/` and `docs/FP16_VERIFICATION.md` in the
111
+ [repo](https://github.com/harrrshall/xtts-v2-hinglish-synthetic).
112
+
113
  ---
114
 
115
  ## The synthetic-data recipe (the core of this project)