This is why clients all need to implement lists so you can select which of your people lists you want to look at. The kind:3 "contact" list is such a blunt instrument.