GM Today I shipped Relagent 0.1.24. It bundles CPU #llm #inference within the container. So the first-time user can try the private assistent right away - without the need to install another service first. My goal is to make it as easy as possible for all users to run a privacy focused AI assistant. So people do not have to pay with their privacy or independence. Let's help everyone to keep ownership over their data. The default model is a 4 bit quantization of Google's gemma 4 2 billion parameter model. Of course any other GGUF model works as well.

GitLab

Roman / relagent · GitLab

Trustworthy AI assistant that runs 100% on your hardware. Stay in control of your data, costs and dependencies.

#sovergenity #privacy #opensource #digitalindependance #freedomtech #selfhosting

Hello and good day #nostr, I came here to connect with a fresh set of people and get first hand experience with #decentralized open platforms. Besides I am interested in low barrier access to knowledge and technology for #digitalfreedom. Currently I am focused on responsible and sovereign #ai use. Trying to make use of the good parts and limit the negative effects of #genai. When I can, I put time into a pure #selfhosted #privacy ai assistant that tries hard to be transparent and keep the user at peace and in control. No signup, no payment, just existing hardware. Read more at:

GitLab

docs/one-pager.md · main · Roman / relagent · GitLab

Trustworthy AI assistant that runs 100% on your hardware. Stay in control of your data, costs and dependencies.

Friendliest greetings! #introductions #opensouce #homelab

Next try, witout the edit. My proof of #shoeonhead

Proof of #shoeonhead