Ironically, anyone taking out a 40-year mortgage for affordability purposes are themselves responsible for prices being driven up -- their mere presence in the market adds to the pool of buyers able to pay a given price. ... These can include settlement costs, discount points, and other fees. There may also be a penalty charged for paying off your original loan early, although some states prohibit this.