Correctly reset batch iterator at each arrow create_iter call. (#74)

Pass mask in packing_iterator, correctly handle last batch, fix masking (#65)

Initialize rope embeddings properly for the entropy model (#72)

Remove byte tokenizer and add config args to switch between byte/patch packing (#68)

Add vocab and seq len abstract fields (#66)

Fix: Correct model_args usage in parallelize_model call (#69)

Update iterator inheritance, pass file format args, limit iterator (#63)

Make apex logs less noisy (#60)

Make it possible to specify multiple config files (#54)

fix(README): correct typo in quickstart instructions (#62)

using apex rmsnorm (#57)

Update README.md (#58)

Fix multiprocessing dataloader checkpointing and use it in the train script (#50)

Test first batch matches (#53)

disable reshard after forward (#56)

make sure max_encoder_seq_length matches (#55)

fix save and reload model state (#49)

Add bpb and n_bytes to metric logging (#41)

Fix init and repro (#48)

Allow ArrowIterator to read from json (#45)

Update checkpointing to use fsspec (#39)

Add rope fp32 (#43)

fix stool (#44)

Fix wandb logging (#42)

Fix distributed all reduce grad norm (#40)

This includes fixes that make checkpointing and reloading work correctly. (#35)

Initial codes and scripts for training entropy model (#34)

Use load_async flag to not start MP iterator (#33)

Update file check script to check sizes (#32)

Fix realtime entropy patching (#26)

Changes for training entropy model and correcting attention in local models (#25)

allow flex-attention to be disabled (#19)

Update preprocess_entropies script to blt inference + add fsspec support (#23)

Replace regular filesystem calls with fsspec + add s3 support (#18)

Add plotting code from paper (#17)

Package `bytelatent` as a module (#7)

docs: update README.md (#1)

Update README.md (#13)

Initial commit