Other apps might use your phone book entries but nostr is cryptographically secure. I bet that nostr will gain most of its growth from this social graph being leveraged by all kinds of apps.