150 MB

Ctrl+K

1 contributor

History: 270 commits

Ouaill

Upload latest_main.tex with huggingface_hub

0b95151 verified about 2 months ago

figures
Upload figures/external_comparison.png with huggingface_hub about 2 months ago
plots
Upload plots/external_comparison.png with huggingface_hub about 2 months ago
results
Upload results/doda_independent_results.json with huggingface_hub about 2 months ago
tokenizers
Upload tokenizers/concat_az_bbpe_55000.json with huggingface_hub about 2 months ago
transformers_tokenizers
Upload transformers_tokenizers/concat_bbpe_32000_tokenizer_az/tokenizer.json with huggingface_hub about 2 months ago
.gitattributes

3.74 kB
Upload figures/external_comparison.png with huggingface_hub about 2 months ago
README.md

9.34 kB
Upload README.md with huggingface_hub about 2 months ago
benchmark_report.md

8.47 kB
Upload benchmark_report.md with huggingface_hub about 2 months ago
bootstrap_ci.csv

3.23 kB
Upload bootstrap_ci.csv with huggingface_hub about 2 months ago
bootstrap_ci_test_set.csv

3.1 kB
Upload bootstrap_ci_test_set.csv with huggingface_hub about 2 months ago
bootstrap_test_set.py

6.66 kB
Add bootstrap_test_set.py (test-set-only consistent eval) about 2 months ago
code.md

13.6 kB
Upload code.md with huggingface_hub about 2 months ago
codeswitch_results.csv

1.43 kB
Upload codeswitch_results.csv with huggingface_hub about 2 months ago
compare_with_external.py

10.5 kB
Upload compare_with_external.py with huggingface_hub about 2 months ago
doda_independent_results.csv

1.31 kB
Upload doda_independent_results.csv with huggingface_hub about 2 months ago
eval_all_externals.py

11.9 kB
Add eval_all_externals.py (12 tokenizer comparison) about 2 months ago
eval_and_compare.py

11.5 kB
Upload eval_and_compare.py with huggingface_hub about 2 months ago
eval_codeswitch_and_new_baselines.py

14.8 kB
Add code-switching eval script and results about 2 months ago
eval_doda_independent.py

7.48 kB
Upload eval_doda_independent.py with huggingface_hub about 2 months ago
eval_morph_large.py

11.6 kB
Upload eval_morph_large.py with huggingface_hub about 2 months ago
eval_test_set.py

8.15 kB
Add eval_test_set.py (test-set-only consistent eval) about 2 months ago
external_comparison.csv

2.53 kB
Upload external_comparison.csv with huggingface_hub about 2 months ago
external_comparison.json

5.47 kB
Update external_comparison.json with all 9 external tokenizers about 2 months ago
latest_main.tex

48.9 kB
Upload latest_main.tex with huggingface_hub about 2 months ago
morph_large_vocab_results.csv

1.29 kB
Upload morph_large_vocab_results.csv with huggingface_hub about 2 months ago
script.py

81 kB
Upload script.py with huggingface_hub about 2 months ago
test_set_results.csv

11.1 kB
Upload test_set_results.csv with huggingface_hub about 2 months ago
test_set_results.json

15 kB
Add test_set_results.json (single source of truth for all tables) about 2 months ago
tokenizer_results.csv

9.19 kB
Upload tokenizer_results.csv with huggingface_hub about 2 months ago
tokenizer_results.json

20.8 kB
Upload tokenizer_results.json with huggingface_hub about 2 months ago