envisioning a future of a Signal-grade private social network, where you have local llms privately translating, summarizing, and building algos of your feed. It’s not far off, we have the technology today. damn this is cool and cyberpunk af.
Login to reply
Replies (30)
💯 🔥
wen beta?
LLM translation is still far off but would be great… the quality of translations still are suboptimal with the big clouds, so on device, especially for some languages, will need time to mature
also, I feel like finetuned models designed for content curation and summarization will be the way. the more specific the tool the more accurate it is for a task.
💥
😁🤫🤐
Yeah, I never thought of having my own personal LLM to be my own “algorithm” - that really rocks!
☀️🚀
What would make it "Signal grade"? Some sort of encryption?
When I first heard about Nostr ~1.5yrs ago, I heard Guy Swann talk about how you could build a Signal using Nostr. Is that accurate?
One things they are really good at today, even in the 2gb 6b param models, is summarization. I want to put together a demo on notedeck where it downloads the model and uses it to summarize threads when you open a large one.
prompt injection is still a big deal sadly… there’s actually dedicated models for summarization out there.
you could fine tune existing summarization models to take additional context input like reply chains via tokens
I think that an advanced search module is already a great step to start with.
Penis af
It’s being actively researched and worked on. There are some promising proposals. You can even apply this tech to arbitrary nostr notes, so you could build a private and secure social network this way.
definitely. going to have that soom™️ for damus local search
🔥🔥🔥
If that comes into the damus android version I am definitively gonna switch over.
yes its in android, I put all the hard stuff in nostrdb so I can use it on both platforms
Let’s go!!!
I think LLM are the stupiest thing ever and will destroy more then they help create over the long run
we'd appreciate an invite
Have you seen the LLM Farm app? I’ve got Phi-3-Mini & Llama-3-8B running locally on my iPhone
Listened to your rip with Odell on the trip to BTC++ in Austin today - so good! What a life changing journey Nostr appears to be for you. Stoked you are still fired up.
Bullish AF 👌🏼
Espero muito que as IAs façam isso, que traduzam e organizem localmente os conteúdos, inclusive no Nostr, já que a maioria dos clientes ainda traduzem muito mal e quebram formatações como links e a sintaxe markdown...
envisioning a future of a Signal-grade private social network, where you have local llms privately translating, summarizing, and building algos of your feed. It’s not far off, we have the technology today. damn this is cool and cyberpunk af.
View quoted note →
Vexl is free and open source, totally private, end to end encrypted and scales on a real web of trust. It’s built for Bitcoin but it’s essentially a private social network that enables p2p without any 3rd parties.
What's the use case of a social network then?
Got a link?