GM. Used GPU prices seemed to have climbed up at least %15 anecdotally from last week. I can't seem to find any good metrics. Probably should start plotting them myself.
TIP. You can just lowball sellers and chances are they will counter with the price they had listed last week.
Oh an it appears the wagons are circling closer on cheap inference. Not news, but seems to be getting closer.
Replies (6)
I wonder if there will be a point where it makes sense to sell mine. I've had it for three years and it is worth more than when I bought it. I haven't accounted for inflation, but that is rare for computer hardware. At least historically.
The point at which the replacement cost and sell cost align for you.
This is what we get for having proprietary hardware and so few people capable of producing it. There's little incentive to increase supply when demand is so high and there's very little competition. I don't see anything changing until that does. That GPU might buy you a house at this rate 😂
Server gear tends to say high during a lease period. I've rarely lost money on server gear even after 45k+ hours more of use then when I bought it.
Hmm. I guess GPUs even consumer grade ones have jumped to the server gear side unintentionally. I don't really have any intention of getting rid of it until something with a lot more vram comes along. The 32gb in the 5090 isn't enough of a jump. The next level models would be in the 500 billion - 1 trillion parameter range.
Im still eyeing up V100s. They were down to almost $500ea but jumped up to almost $900. That was 64gb for about $1000 @ 900GB/s of HBM2. As far as capacity X bandwidth you can't beat the V100 until hopper based cards. The only downside is tensor flops. and BF32. And driver support if for whatever reason you need nvidia's latest drivers
