“If there is not enough market-rate housing in one neighborhood, people start pushing into the more affordable neighborhoods and displace the residents already there,” said Jerilyn Perine, executive director of the Citizens Housing and Planning Council, a group that works to improve housing conditions.