feature: Terraform Quickstart Tutorials for Underlying Infrastructure

[0xThresh]

Describe the feature

While the tutorials to build production stack across different clouds using Bash scripts are a great start, many professional teams will make sure of infrastructure tooling such as Terraform to manage Kubernetes clusters and other required resources. It would be good to add some base Terraform code to deploy the required K8s cluster, required NVIDIA plugin, and vLLM Production Stack to give users a way to get started that includes long-term management capabilities for clusters that are moving beyond a POC stage.

I plan to create a tutorial, starting with AWS EKS as the underlying K8s cluster, to help address this need. I already have a quickstart repo that uses Ollama and Open WebUI in a similar way, and will create a new tutorial within the Production Stack repo based on this: https://github.com/0xThresh/self-hosted-genai

Please let me know if there is any specific functionality you'd like to see as part of this tutorial!

Why do you need this feature?

No response

Additional context

No response

[0xThresh]

I got this started here: main...0xThresh:vllm-production-stack:tutorial-terraform-eks

There are some issues to fix in the code and I need to complete the tutorial, but hoping to get this done within the next week!

[Hanchenli]

Thanks! Looking forward to it!