The main issue is having a currency backed by debt where the money supply is controlled by bad actors.
This was even the case under "The Gold Standard", whenever there was a national bank with a monopoly on issuing paper certificates, while utilizing fractional reserve banking.
Once the bankers can offload their default risk onto the tax payer, we are all worse off.