@shroominic made an app called Local++ that downloads a local llm on the offline tab plus a Routstr connection on the online side that I have used quite a bit.

GitHub

Release v0.1.3a · Routstr/local-plus-plus

v0.1.3 - Local++ added chat history feature improved model downloads fix ui bug with reasoning messages auto load the last selected model few tiny ...