

Yes. People occasionally talk about pooling resources / creating a co-op to buy something like this. Easier to split $200K purchase (and probably $10k/month electricity costs) if 200-2000 people chip in. But then…that’s just the cloud with extra steps.
Can’t says I’ve ever seen a co-op like that work but ICBW
It’s one of those “if you have to ask, you can’t afford it” scenarios.
I’ve heard FP16 is likely to be 6TB of VRAM, when Kvcache is factored in.
Even a more sensible quant will likely be 1TB.
… most of us are not running this at home.