The relay is accountable in this case, if i broadcast a note that censors a legitimate user there could be a public investigation and people would no longer trust my ip ban lists. Still tied to trust and reputation.

Total transparency of relay filters helps address this because everyone involved has access to the same information. Relay operators are not trying to suppress information without others knowing.