Just published https://github.com/QC-Labs/orange-lab
Simplify setting up your private distributed infrastructure using nostr:nprofile1qqs8p6w3v4ljzrh7sjrysazgumzge22584jqhtcuv7y4hxwp6kasfvcpz4mhxue69uhhyetvv9ujumt0wd68ytnsw43qu0fmf8, Pulumi, K3s and Longhorn.
The cluster works even on a single laptop node but it's a great way to use spare CPU cycles and storage on other Linux machines you have available.
Once initial setup is done, you can run Ollama, Open-WebUI and stable diffusion image generation with:
pulumi config set orangelab:nvidia-gpu-operator true
pulumi config set orangelab:ollama true
pulumi config set orangelab:open-webui true
pulumi config set orangelab:automatic1111 true
pulumi up
This will create endpoints that anyone on your Tailnet can access, all wired up and ready to go.