Buy two and never look back. 1 isn't enough to run any good models right now. If your budget only allows 1 then you should get 2 rtx 3090 instead imo
Login to reply
Replies (1)
So go for the 200B or Bust? I Figured Qwen 3 72B would be good. I don't thing the 3090 is a good trade due to power efficiency etc. With a cluster of GB10 a 200B is in reach, slower by a good margin but still within acceptable rates for tokens/s. No? I mean heck a 405B should be doable with somewhat acceptable lag on a cluster.