Replies (27)
Damn fediverse bridge doing work.
The mostr is skewed, because that is fediverse
There are probably a lot of reasons behind that. First, people aren't necessarily using the same relays they used a few years ago. I know I'm not. When they switch, they rarely export their notes from their old relays and import them to their new ones.
Relays also don't necessarily keep notes for that long. Popular relays may have automatic deletion of old notes, or then theres the Damus relay, which gets fully nuked from time to time.
If the note does still exist somewhere, it might be on a relay that is currently offline, or that the client is having trouble connecting to, or that doesn't support search, or that has rate-limited requests, or... You can see where this is going.
So long as notes can live on various different relays that aren't all following exactly the same policies, it's going to be unpredictable whether you can find a specific note.
That is AWESOME. I'm sure searching is one of the least praised feature that takes some of the most work for this sort of system, just bast on my experience even doing joins on large CENTRALIZED datasets. You're a rockstar
@Vitor Pamplona
I'm saying, I can type the text of a note word for words into the chat. One day I'll find it. Another I won't. A few days later I'll find it again. Search on amethyst is very inconsistent.
Yeah, exactly. The reason being that it is inconsistent what relays can be connected to at a given time and the note doesn't exist on Amethyst, it exists on some relay or another.
TIL nostr is a sidechain for the fediverse
You are dead on as far as i can tell. Im not nearly as credentialled as either of you, but ive been working on what im sure is a comparatively primitive search and the asynchronicity of it all makes it so hard to get the best results at the top quickly.
I'm sure you're beyond me. I've usually just done bare manual SQL searching on a good size data lake and performance can really care about exactly how you do things. I do have a very little good abstract knowledge from the first few lectures of the old MIT 6.001 using the wizard book. GREAT comp sci intro.
@Vitor Pamplona you know what the asymptotic growth is? I'd assume no matter what you're doing this has gotta be complex. The lecture on tree recursion comes to mind when enumerating Fibonacci numbers and the number of Nostr relays dizzies me..
More like we have a few bridges. BSky too.
We'd have X if it weren't closed.
The question is, how do we get Usenet too?
The relays Amethyst can successfully connect to do factor in, though. It would be doing text search via your search relays. If the note isn't on the ones Amethyst was able to connect to, and is only on a search relay it could not connect to, then it won't find it.
It's complex but not that much... It just takes a few relays as inputs, downloads all events from them, collects all references to other relays and keeps growing the list of relays to check. Then it just dedupes by ID. Takes about 1hr to generate the report with about 2.5M events.
They must have it only on testflight or something
Unfortunately many Nostr relays index fediverse stuff, while fediverse doesn't give a fuck about Nostr. Very dumb imo
divine?
I feel really out of the loop, I’ve never heard of Mostr haha
Bridge from ActivityPub/Mastodon
There are all sorts of reasons that a client may not be able to connect to a relay besides it just being down.
I won't say that it couldn't be a client performance issue, but most of the time inconsistencies on Nostr in general are due to not being connected to the same relays for one reason or another. No one's fault. Just the nature of working with multiple relays rather than a centralized server.
Hmm probably is O(n) then. Guess no need to do any elaborate cross indexing.
Of course, with all the zaps on comments on likes on zaps on commments on likes...it could still get silly.
BCHNostr pulling WEIGHT.
I’m an idiot
nostr is NOT ARCHIVE DB
NOT EVEN needed also
nobody cares who posted 2 years ago
easy to do fake screenshot of old post also
Hey man, I found this note while using search on a client I'm building. Trying to do things the right way and using kind 10007 to configure search relays. I only have search.nostrarchives.com right now. Do you know of any other good ones?
I don't know about good ones. These are the current default search relays in Amethyst, which are the ones I have been using.

Don't mind the slow ping numbers. That's just because I have Tor turned on.
The main thing is the relay needs to support NIP-50, and it should ideally be aggregating notes that you would be interested in. Unfortunately, finding relays on the basis of the NIPs they support isn't an easy task.
Thanks! I’ll check em out. TIL
@npub1nxy4...avr7 also supports NIP-50
That's my new favorite relay