If you don't pay your mortgage based on its phrases, your lender could: charge you late charges, ship your account to a collection company, report your data to a consumer reporting company which can negatively affect your credit score score, provide to renew, extend or refinance your mortgage, which may trigger you to incur extra fees, fees and curiosity.