dipta007 commited on
Commit
f0e9947
·
verified ·
1 Parent(s): 0b1fb9b

Add sentencepiece and protobuf for the T5 tokenizer

Browse files
Files changed (1) hide show
  1. requirements.txt +4 -0
requirements.txt CHANGED
@@ -11,6 +11,10 @@ peft>=0.13
11
  safetensors
12
  huggingface-hub
13
  qwen-vl-utils
 
 
 
 
14
  lpips
15
  einops
16
  pyyaml
 
11
  safetensors
12
  huggingface-hub
13
  qwen-vl-utils
14
+ # SD3's third text encoder is T5. Its fast tokenizer is built from a sentencepiece model, and
15
+ # the conversion wants protobuf. Both arrive transitively in the research env, not here.
16
+ sentencepiece
17
+ protobuf
18
  lpips
19
  einops
20
  pyyaml