explained to someone that the only rule you need for AGI is to never put it in charge of designing the incentive system (taxes, gvt etc) and their reply was “but wait that’s all that these people really want to do with it”
and it’s like well yes. of course that’s their goal. but if they’re serious about AGI Safety whatever whatever they should not do that. it is an unwise idea.
of course they will do it anyway because hubris is a bitch