You're talking about notes that, for whatever reason, don't appear on any of the user's current outbox relay list, right? Yeah, those definitely slip through.
I actually thought about trying to catch those too, but decided it’d be better to start with a simpler version first.
Along with what you mentioned below, that’s definitely something I should try implementing next. If that works, it might as well be called Nostr archaeology.