It's the same set of compromises and tradeoffs that govern how you secure your private key on a hardware device in the real world. You are only sovereign over that key insofar as you can physically defend it. And that's never a sure thing even if you're the king of the world.