Key Changes

• Support Llama3 tokenizer
• JetStream Tokenizer refactor
• Disaggregation preparation work

What's Changed

• add sample_idx in InputRequest for debugging by @morgandu in #32
• Update README.md with user guides by @JoeZijunZhou in #34
• Update README.md with PT user guide by @JoeZijunZhou in #35
• Reorganize unit tests and update CICD by @JoeZijunZhou in #37
• Add badges for JetStream by @JoeZijunZhou in #38
• Bump idna from 3.6 to 3.7 by @dependabot in #39
• Reformat benchmark metrics by @yeandy in #42
• Update server host default value by @JoeZijunZhou in #43
• Refactor readme by @FanhaiLu1 in #41
• Add missing Documentation by @FanhaiLu1 in #47
• Update README.md to fix broken link by @charbull in #50
• Add np padded token support by @FanhaiLu1 in #49
• Format token utils and test by @FanhaiLu1 in #51
• Align Tokenizer in JetStream by @JoeZijunZhou in #40
• Do nothing for nd array in copy_to_host_async by @FanhaiLu1 in #52
• Add jax_padding support driver and server lib by @FanhaiLu1 in #54
• Update maxtext user guide by @JoeZijunZhou in #56
• Fix benchmark script type issue by @JoeZijunZhou in #59
• Fix requester flag default value by @JoeZijunZhou in #60
• Fix float division by zero in benchmark by @FanhaiLu1 in #62
• Register IFRT proxy backend when proxy is defined in the jax_platforms by @zhihaoshan-google in #63
• Add an abstract class for Tokenizer by @bhavya01 in #53
• refactor slice_to_num_chips to adapt to Cloud config by @zhihaoshan-google in #65
• Support llama3 tokenizer by @bhavya01 in #67
• Prerequisite work for supporting disaggregation: by @zhihaoshan-google in #68
• Create init.py in Jetstream/third_party by @bhavya01 in #69
• Add tokenize_and_pad function to backward compatible by @FanhaiLu1 in #70
• Release v0.2.1 by @JoeZijunZhou in #72
• Bump tqdm from 4.66.1 to 4.66.3 in the pip group across 1 directory by @dependabot in #73
• Release v0.2.1 with docs update by @JoeZijunZhou in #74

New Contributors

• @dependabot made their first contribution in #39
• @yeandy made their first contribution in #42
• @charbull made their first contribution in #50
• @zhihaoshan-google made their first contribution in #63
• @bhavya01 made their first contribution in #53

Full Changelog: v0.2.0...v0.2.1