Removing taxes would simply hit the low-income earners the most as they rely on public benefits the most. I think the core issue in the US is how the private sector compete with the public sector in areas such as school, healthcare, and infrastructure.

They rely on those public benefits because of the most insidious tax of all, inflation. It makes their salaries lose value faster than their raises roll in, and encourages the larger earners to bid up prices of things like real estate in an effort to escape its effects. No problem is so big that more government can't make it bigger.

Actually it's the opposite. It's well known and studied that richer people lives longer that the poor people, so they get to enjoy the public benefits longer. Also poor people starts to work full time and pay taxes earlier (often as yearly as 16 years of age) than rich people (who often starts working full time only after 27 years of age after schools partially financed by the public). So rich starts paying taxes later than poor and gets to enjoy the benefits longer. If you care about the poor, then you would oppose taxes and public spending.