At some point the taxes would be so high that nobody could afford to rent and the owners would lose money forcing them to sell. Which is fine. Just gotta make the taxes higher for more than x houses.