I was thinking about a way this could work. If the relay already handles NIP-09 deletions, it should keep the kind 5 notes around and use them as a filter just in case one of those notes happens to be sent to that relay in the future.
So, a relay also has an npub. So it should accept any kind-5 published by the relay’s npub regardless of the author of the offending note.