is it free, though?

Depends which individuals freedom. When all square meters to live in are distributed to the highest bidder, there is no insurance everyone gets a roof under which he/she can live. So the freedom to rent and sell to the highest bidder fails to serve human rights. With this I do not vote against free market. But free markets needs social boundaries. Since we all know: Your liberty to swing your fist ends just where my nose begins. So when we all want to enjoy liberty, we need to set boundaries to the free market.