[Tokenizer] Add BertTokenizerFast, support register new tokenizer#9353
Merged
DrownFish19 merged 4 commits intoPaddlePaddle:developfrom lvdongyi:dev-20241101-register-tokenizerNov 4, 2024
+522-25
Commits
Commits on Nov 1, 2024
Commits on Nov 4, 2024
- committed
- committed
- committed