Skip to content

Issues: neuralmagic/guidellm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21 Open 9 Closed
21 Open 9 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Integrate lm-eval into GuideLLM accuracy-eval accuracy-evaluation workstream
#90 opened Mar 6, 2025 by rgreenberg1
Enable vLLM scheduler specific Metrics metrics Metrics workstream
#86 opened Mar 4, 2025 by rgreenberg1
@markurtz @rgreenberg1
[Scoping] Enable Hardware Accelerator Monitoring metrics to be captured in benchmarks metrics Metrics workstream
#85 opened Mar 3, 2025 by rgreenberg1
Community-oriented audio dataset profile creation dataset Dataset workstream
#84 opened Feb 28, 2025 by rgreenberg1
Build Community-oriented dataset profiles dataset Dataset workstream
#83 opened Feb 27, 2025 by rgreenberg1 GuideLLM v0.2.0 - CI/CD Finalization, Documentation Expansion, and Backend Support
@markurtz @rgreenberg1
Text-dataset performance profile creation dataset Dataset workstream
#82 opened Feb 27, 2025 by rgreenberg1 GuideLLM v0.2.0 - CI/CD Finalization, Documentation Expansion, and Backend Support
@markurtz @rgreenberg1
Base enablement to enable a dataset configuration file to be passed in rather than standard args, allow alias's for the folder structure dataset Dataset workstream
#81 opened Feb 27, 2025 by rgreenberg1 GuideLLM v0.2.0 - CI/CD Finalization, Documentation Expansion, and Backend Support
@markurtz @rgreenberg1
Record partially completed request metrics
#77 opened Feb 25, 2025 by sjmonson
@sjmonson
Clean up JSON output
#76 opened Feb 25, 2025 by sjmonson
@sjmonson
2
Client-side prompt token count is inaccurate
#75 opened Feb 25, 2025 by sjmonson
@sjmonson
Add flag to put guildellm into "non-interactive" mode
#74 opened Feb 25, 2025 by sjmonson
@sjmonson
How to pass additional sampling parameters to the vllm server ?
#69 opened Feb 6, 2025 by pinak-p
1
problems with sglang
#68 opened Nov 25, 2024 by eliecerecology
Get Accuracy Metrics reported
#63 opened Oct 28, 2024 by parfeniukink
1
@parfeniukink
how to call the remote api
#62 opened Sep 18, 2024 by jackqdldd
[Feature] GitHub Actions CI/CD Enablement and Expansion feature Feature addition with a set PRD for the release
#56 opened Sep 10, 2024 by markurtz
End-to-End Testing Enablement / Expansion
#55 opened Sep 9, 2024 by rgreenberg1
@parfeniukink
Integration Testing Enablement / Expansion
#54 opened Sep 9, 2024 by rgreenberg1
@parfeniukink
[Rate Type] Concurrencies enhancement New feature or request
#47 opened Sep 5, 2024 by philschmid
@markurtz
2
guidance_report.json from default flow is very large
#38 opened Aug 27, 2024 by mgoin
1
@parfeniukink
3
Default guidellm command only sends empty messages?
#34 opened Aug 27, 2024 by mgoin
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.