Mixtral - no run.py file

[maciekpoplawski]

System Info

PC

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/mixtral

https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/mixtral/examples/run.py

Expected behavior

run.py file present

actual behavior

run.py file NOT present

additional notes

---

[aikitoria]

This one? You have examples folder twice in your path. https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/run.py

[maciekpoplawski]

This one? You have examples folder twice in your path. https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/run.py

im following official docs provided. Would be cool to fix the link for the run.py if it should point to somewhere else, hence the bug

[byshiue]

Thank you for the report. Yes, you should use https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/run.py. We will fix it in next update.