“But if rates come down because the labor market is weaker and people are worried about their jobs, those lower mortgage rates won’t be able to bring as many homebuyers into the market.