Been playing with gpt-oss:32B on a friends 16GB Tesla V100. Quite usable actually. We've got another 32GB V100 on the way, will be interesting to see how good of a model we can run.
Login to reply