disable reshard after forward (#56)

make sure max_encoder_seq_length matches (#55)

fix save and reload model state (#49)

Add bpb and n_bytes to metric logging (#41)

Fix init and repro (#48)

Allow ArrowIterator to read from json (#45)

Update checkpointing to use fsspec (#39)

Add rope fp32 (#43)

fix stool (#44)

Fix wandb logging (#42)

Fix distributed all reduce grad norm (#40)

This includes fixes that make checkpointing and reloading work correctly. (#35)

Initial codes and scripts for training entropy model (#34)

Use load_async flag to not start MP iterator (#33)

Update file check script to check sizes (#32)

Fix realtime entropy patching (#26)

Changes for training entropy model and correcting attention in local models (#25)

allow flex-attention to be disabled (#19)

Update preprocess_entropies script to blt inference + add fsspec support (#23)

Replace regular filesystem calls with fsspec + add s3 support (#18)

Add plotting code from paper (#17)

Initial commit