I have been using open AIs new gpt-oss-20b model locally and it’s impressive how fast it runs from my laptop. It will never stop being amazing that I can have a conversation with an LLM about any topic I can think of just by downloading an 11gb file.
It even has a good understanding of what nostr is, how it works and why it is important.
Anyone playing with local LLMs should give this model a try.

openai/gpt-oss-20b · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.