OK Folks, I figure I probably have the geek market covered her. Who has a GB10 system? I would love to have a chat with you because I am considering one currently. Let's go fellow Nostriches. #AskNostr
Login to reply
Replies (4)
Buy two and never look back. 1 isn't enough to run any good models right now. If your budget only allows 1 then you should get 2 rtx 3090 instead imo
So go for the 200B or Bust? I Figured Qwen 3 72B would be good. I don't thing the 3090 is a good trade due to power efficiency etc. With a cluster of GB10 a 200B is in reach, slower by a good margin but still within acceptable rates for tokens/s. No? I mean heck a 405B should be doable with somewhat acceptable lag on a cluster.