This repository was archived by the owner on Sep 10, 2025. It is now read-only.
Simplify TokenizerArgs.__post_init__ with Enum Tokenizer Type
#3068
| Job | Run time |
|---|---|
| 35m 46s | |
| 32m 25s | |
| 1h 8m 11s |