Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Spaces:
lucalp
/
blt-entropy-patcher
like
9
Configuration error
App
Files
Files
Community
1
Fetching metadata from the HF Docker repository...
8eea094
blt-entropy-patcher
/
bytelatent
468 kB
Ctrl+K
Ctrl+K
12 contributors
History:
58 commits
lucalp
Fixing proper UTF-8 representation
8eea094
over 1 year ago
configs
Remove byte tokenizer and add config args to switch between byte/patch packing (#68)
over 1 year ago
data
Open source weights! (#97)
over 1 year ago
model
Improve HF integration (#98)
over 1 year ago
plotting
Fixing proper UTF-8 representation
over 1 year ago
preprocess
Allow ArrowIterator to read from json (#45)
over 1 year ago
tokenizers
Remove byte tokenizer and add config args to switch between byte/patch packing (#68)
over 1 year ago
.DS_Store
Safe
6.15 kB
Initial commit
over 1 year ago
__init__.py
Safe
96 Bytes
Initial commit
over 1 year ago
args.py
Safe
12.5 kB
Fix eval mask (#93)
over 1 year ago
base_transformer.py
Safe
19.9 kB
Initialize rope embeddings properly for the entropy model (#72)
over 1 year ago
checkpoint.py
Safe
11.6 kB
Add way to call consolidate (#80)
over 1 year ago
config_parser.py
Safe
2.74 kB
When merging configs, do not merge data sources (#79)
over 1 year ago
constants.py
Safe
141 Bytes
Initial commit
over 1 year ago
distributed.py
Safe
17.9 kB
Init distributed when loading model (#94)
over 1 year ago
entropy_model.py
1.51 kB
local block causal when cuda avail
over 1 year ago
eval.py
Safe
13.4 kB
Open source weights! (#97)
over 1 year ago
float8.py
Safe
4.89 kB
Initial commit
over 1 year ago
generate.py
Safe
18.1 kB
Open source weights! (#97)
over 1 year ago
generate_blt.py
Safe
7.25 kB
Get generation working for BLT (#86)
over 1 year ago
generate_patcher.py
Safe
4.64 kB
Visualisation working on CPU via CUDA_VISIBLE_DEVICE=-1 python demo_patcher.py 'Daenerys Targaryen is in Game of Thrones, a fantasy epic by George R.R. Martin.'
over 1 year ago
iterate_data.py
Safe
1.11 kB
Update iterate_data (#81)
over 1 year ago
logger.py
Safe
4.44 kB
Update checkpointing to use fsspec (#39)
over 1 year ago
metrics.py
Safe
7.11 kB
Get evals working again. (#46)
over 1 year ago
norms.py
Safe
4.34 kB
Fix distributed all reduce grad norm (#40)
over 1 year ago
optim.py
Safe
4.61 kB
Initial commit
over 1 year ago
print_config.py
Safe
263 Bytes
Make it possible to specify multiple config files (#54)
over 1 year ago
probe.py
Safe
24 kB
Initial commit
over 1 year ago
profiling.py
Safe
4.4 kB
Initial commit
over 1 year ago
stool.py
Safe
7.41 kB
Fix rsync to not preserve original permissions, instead use destination (#76)
over 1 year ago
test_blt.py
Safe
16.3 kB
Initial codes and scripts for training entropy model (#34)
over 1 year ago
test_config_parser.py
Safe
5.36 kB
Make it possible to specify multiple config files (#54)
over 1 year ago
test_entropy_model.py
Safe
2.03 kB
Test first batch matches (#53)
over 1 year ago
train.py
Safe
31.7 kB
Get evals working again. (#46)
over 1 year ago
transformer.py
Safe
7.47 kB
Initialize rope embeddings properly for the entropy model (#72)
over 1 year ago
