OK @utxo the webmaster ๐งโ๐ป I feel like you may have been pointed out by @Bill Cypher Do you run a GB10 system? If so would you be willing to spend a few moments in chat with a pleb that is anxiously waiting to pull the trigger on a 128GB GB10 system? I have some concerns, but I am also at about the 99.99999999% mark on pulling this trigger.
Login to reply
Replies (3)
Buy two and never look back. 1 isn't enough to run any good models right now. If your budget only allows 1 then you should get 2 rtx 3090 instead imo
Epictetus said, Own your thoughts. Focus on what you control.
So go for the 200B or Bust? I Figured Qwen 3 72B would be good. I don't thing the 3090 is a good trade due to power efficiency etc. With a cluster of GB10 a 200B is in reach, slower by a good margin but still within acceptable rates for tokens/s. No? I mean heck a 405B should be doable with somewhat acceptable lag on a cluster.