2 hours in, vllm build is on step 113/140, still doing FA2
Got a refurb/certified HP Proliant DL580 G9 4U Server 4x E7-8870 V3 2.10ghz 72-Cores 384gb Ram 4x Trays on the way. Builds won’t take this long next week!
Seems like this DL580 G9 will be so much better than the myriad new $2000+ mini-AI boxes coming out, and at $770 it cost less than half the cheapest mini-AI boxes being marketed so hard as coming “later this year”
Thank you so, so much for the recommendation of looking at old enterprise servers! Only concern i’ll have now will be my next electricity bill, lol.