@Guy Swann what GPU are you running in your AI rig? I am trying to fine tune a model and the lack of adequate VRAM is really making this difficult.
Login to reply
Replies (2)
Might help. Idk shit about fuck tho 😶
What local LLM models are you using that actually seem to be useful? Please describe a successful use case you've had with it!
View quoted note →
Awesome. And yes I'm scraping by with a 1660. I actually just successfully tuned a small 3B model but I had to get real creative with the script. There is probably a easier way instead of reinventing the wheel but I wanted to use my own data set and model set. I really need to upgrade