48 GB VRAM is NOT too little to be useful.
Login to reply
Replies (1)
That's true. But 96GB or more is disproportionately more useful.
I run a lot of inference on 32GB Mac mini. But then there are some things that I have to run on 96GB MacBook