Skip to content

[Tokenizer] Add BertTokenizerFast, support register new tokenizer#9353

Merged
DrownFish19 merged 4 commits intoPaddlePaddle:developfrom lvdongyi:dev-20241101-register-tokenizerNov 4, 2024

Commits

Commits on Nov 1, 2024

Commits on Nov 4, 2024