Building an AI budget? Expect a $200k to $700k GPU cluster plus $24k a month...

https://milosinterestingcolumns.huicopper.com/how-do-i-decide-between-cloud-inference-and-on-prem-for-low-latency-use-cases

Building an AI budget? Expect a $200k to $700k GPU cluster plus $24k a month for 30 million tokens. Vendors promise big ROI but often overlook hidden costs and risks