Add FasterTokenizer model in experiment#1220

Merged

ZeyuChen merged 17 commits intoPaddlePaddle:developfrom Steffy-zxf:exp-faster-tokenizer

Nov 1, 2021

+1,763-113

Commits on Oct 22, 2021

1. add FasterTokenizer model in experiment
Steffy-zxf
committed

Commits on Oct 23, 2021

add cpp deploy demo
Steffy-zxf
committed

Commits on Oct 25, 2021

add test time script
Steffy-zxf
committed

Commits on Oct 26, 2021

add example
Steffy-zxf
committed
mv python_deploy location
Steffy-zxf
committed
optimize cpp demo
Steffy-zxf
committed

Commits on Oct 27, 2021

add faster model
Steffy-zxf
committed
add faster tokenizer export model
Steffy-zxf
committed
1. rename to_string_tensor to to_tensor
Steffy-zxf
committed
1. add text cls example with FasterModelForSequenceClassification
Steffy-zxf
committed

Commits on Oct 29, 2021

update cpp deploy
Steffy-zxf
committed
1. rename text_cls with seq_cls
Steffy-zxf
committed
add experimental.model_utils.py
Steffy-zxf
committed
update seq_cls cpp demo, drop to print the label string
Steffy-zxf
committed

Commits on Nov 1, 2021

add FasterTokenizer.from_pretrained() api
Steffy-zxf
committed
use FasterTokenizer.from_pretrained() api
Steffy-zxf
committed
Merge branch 'develop' into exp-faster-tokenizer
ZeyuChen
authored