add DCU inference docs #8983
add DCU inference docs #8983
Conversation
|
Thanks for your contribution! |
llm/docs/dcu_install.md
Outdated
| ``` | ||
| 2. 参考如下命令启动容器 | ||
| ``` | ||
| ocker run -it --name paddle-dcu-dev -v `pwd`:/work \ |
llm/docs/dcu_install.md
Outdated
| -DWITH_ROCM=ON -DWITH_RCCL=ON | ||
|
|
||
| make -j128 | ||
| pip install -U paddlepaddle_rocm-0.0.0-cp310-cp310-linux_x86_64.whl |
There was a problem hiding this comment.
理论上whl包应该在python/dist/路径下？
llm/docs/dcu_install.md
Outdated
| 4. 克隆PaddleNLP仓库代码，并安装依赖 | ||
| ``` | ||
| # PaddleNLP是基于paddlepaddle『飞桨』的自然语言处理和大语言模型(LLM)开发库，存放了基于『飞桨』框架实现的各种大模型，llama2-13B模型也包含其中。为了便于您更好地使用PaddleNLP，您需要clone整个仓库。 | ||
| git clone https://github.com/PaddlePaddle/PaddleNLP.git |
There was a problem hiding this comment.
为何不能直接pip install -U git+https://github.com/PaddlePaddle/PaddleNLP.git
There was a problem hiding this comment.
直接安装的方式可能会有部分用户受限，这个命令也可以直接安装最新改动，PR级别的develop版本安装（相比合入时间稍微延后一点）。
pip install --pre --upgrade paddlenlp -f https://www.paddlepaddle.org.cn/whl/paddlenlp.htmlThere was a problem hiding this comment.
@YanhuiDua 我之前没有看到后边的内容，如果需要执行python setup.py 还是需要clone代码的
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## develop #8983 +/- ##
===========================================
- Coverage 54.86% 54.35% -0.51%
===========================================
Files 647 648 +1
Lines 103342 103818 +476
===========================================
- Hits 56699 56432 -267
- Misses 46643 47386 +743 ☔ View full report in Codecov by Sentry. |
| docker run -it --name paddle-dcu-dev -v `pwd`:/work \ | ||
| -w=/work --shm-size=128G --network=host --privileged \ | ||
| --cap-add=SYS_PTRACE --security-opt seccomp=unconfined \ | ||
| registry.baidubce.com/device/paddle-dcu:dtk24.04.1-kylinv10-gcc73-py310 /bin/bash |
There was a problem hiding this comment.
启动命令需不需要添加--group-add video选项呢，在海光gitlab中很多容器的启动命令都会添加该用户组，不添加的话在执行rocm-smi命令时，可能出现error: Open mkfd failed的提示，但不确定是共性问题还是个别问题。
There was a problem hiding this comment.
这里已经加了--privileged，就不再需要--group-add选项了
PR types
Others
PR changes
Docs
Description
Add DCU K100_AI inference docs.