Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Suggestion: WASI-NN CUDA #139

Open
profitgrowinginnovator opened this issue Feb 2, 2025 · 0 comments
Open

Suggestion: WASI-NN CUDA #139

profitgrowinginnovator opened this issue Feb 2, 2025 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@profitgrowinginnovator
Copy link

A feature request;
Implement the WASI-NN interface for CUDA so any WASM32-WASI [p1, p2 and future p3] runtime which wants a neural networking CUDA host can depend on a super efficient Rust implementation without needing to download a Docker image with gigabytes of other code.

Why?
At the moment running AI code requires a Docker image with Python and CUDA which easily goes between 5GB o 15GB which for a serverless or edge use case is ridiculous.

@LegNeato LegNeato added enhancement New feature or request help wanted Extra attention is needed labels Mar 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants