You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While the tutorials to build production stack across different clouds using Bash scripts are a great start, many professional teams will make sure of infrastructure tooling such as Terraform to manage Kubernetes clusters and other required resources. It would be good to add some base Terraform code to deploy the required K8s cluster, required NVIDIA plugin, and vLLM Production Stack to give users a way to get started that includes long-term management capabilities for clusters that are moving beyond a POC stage.
I plan to create a tutorial, starting with AWS EKS as the underlying K8s cluster, to help address this need. I already have a quickstart repo that uses Ollama and Open WebUI in a similar way, and will create a new tutorial within the Production Stack repo based on this: https://github.com/0xThresh/self-hosted-genai
Please let me know if there is any specific functionality you'd like to see as part of this tutorial!
Why do you need this feature?
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
Describe the feature
While the tutorials to build production stack across different clouds using Bash scripts are a great start, many professional teams will make sure of infrastructure tooling such as Terraform to manage Kubernetes clusters and other required resources. It would be good to add some base Terraform code to deploy the required K8s cluster, required NVIDIA plugin, and vLLM Production Stack to give users a way to get started that includes long-term management capabilities for clusters that are moving beyond a POC stage.
I plan to create a tutorial, starting with AWS EKS as the underlying K8s cluster, to help address this need. I already have a quickstart repo that uses Ollama and Open WebUI in a similar way, and will create a new tutorial within the Production Stack repo based on this: https://github.com/0xThresh/self-hosted-genai
Please let me know if there is any specific functionality you'd like to see as part of this tutorial!
Why do you need this feature?
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: