to get an accurate follower count you would need to download the contact list of everyone who follows you. let's say you had 20,000 followers, that would be 800MB, assuming 50kB contact list size which is typical.
we could in theory do this, but would be a waste of bandwidth, and there are bots that spam follows.
there is no such thing as follow counts on a decentralized protocol