#infra
2 posts tagged infra. · All tags
- I Left Cloudflare to Get Faster I asked whether to move the whole backend to Cloudflare. Before moving, I measured, and a page that never calls the backend and a static PNG were both the same 0.47 seconds. The free plan was killing 1 in 5 requests, and the conclusion was the exact opposite direction
- I Was Running a Model per Project, So I Merged Them into One LLM Server Standing up a vLLM server on a single DGX Spark, splitting it out instead of running a model per project, and wiring up monitoring on day one