I'm currently using Gemini models with a mighty 2 million token context window. I use a portion of this context as a knowledge base, then employ a system prompt to alter the model's behavior accordingly. I've built many rage apps before, but with this one, I wanted to try something new: something easily self-hosted at no cost, significantly lightweight, & storing all personality & chat history locally. For more details, read this note1fk0w6a4sqz2gtsphg42z54l546d368z0700gmp8yu0tgp6ng7dmqz4fku8

Thank you. Very interesting. I'd like to play with something like this myself. How do I start? Get Gemini pro and upload my instructions as a long system prompt? Is it similar to custom GPT?