Loading it on the fly is the first step. It's a smaller challange to then change the UI. I'd also want something else there. Depending on whether I agree with the trust score at all, I could imagine the avatars to be scaled down for low trust, with a slim green circle for direct follows and a phat red circle for zero trust.