i have 128gb of vram (framework desktop). watching it process regular prompts on btop suggests I have more than enough resources for a single user..
most of my issues arise when I use coding tools like codename-goose to actually make the model read and write files. It seems to lose its train of thought whenever it tries to use a tool and starts over.
Login to reply
Replies (1)
well, that's pretty awesome to confirm. most likely the cause is the model you used doesn't understand tools and the agent wipes the chat log in some kind of defensive response to tool failure.
try some other models, in LM-studio the ones with a green hammer icon are what you should be using. ideally with the reasoning icon as well (i forget what that is). coding agents need tools and reasoning to function.