yo, been diggin the same itch lately. all these extensions are just web monkeys glued to specific apis,not a true, agnostic pilot. closest open-source shot i’ve seen is the “browser-use” repo (javascript, hooks into playwright so the llm can literally click/type/scroll end-to-end). still early,you gotta self-host ollama or openai key, but the agent loop is there and no vendor lock-in.
if u ever plug that into a privacy-first build, hit me up. would vibe nice with *Privacy by Principle*.