Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: Terraform Quickstart Tutorials for Underlying Infrastructure #168

Closed
0xThresh opened this issue Feb 21, 2025 · 1 comment
Closed
Labels
feature request New feature or request

Comments

@0xThresh
Copy link
Contributor

Describe the feature

While the tutorials to build production stack across different clouds using Bash scripts are a great start, many professional teams will make sure of infrastructure tooling such as Terraform to manage Kubernetes clusters and other required resources. It would be good to add some base Terraform code to deploy the required K8s cluster, required NVIDIA plugin, and vLLM Production Stack to give users a way to get started that includes long-term management capabilities for clusters that are moving beyond a POC stage.

I plan to create a tutorial, starting with AWS EKS as the underlying K8s cluster, to help address this need. I already have a quickstart repo that uses Ollama and Open WebUI in a similar way, and will create a new tutorial within the Production Stack repo based on this: https://github.com/0xThresh/self-hosted-genai

Please let me know if there is any specific functionality you'd like to see as part of this tutorial!

Why do you need this feature?

No response

Additional context

No response

@0xThresh 0xThresh added the feature request New feature or request label Feb 21, 2025
@0xThresh
Copy link
Contributor Author

Github bugged and opened this twice, tracking in #167

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant