Does it make sense to sell mutual funds to prepay a home-equity loan? This is also perhaps why brokers charge high for closing fees. A percentage of the closing fee you pay on a mortgage goes to the mortgage broker's personal funds. This, along with a few more fees, stands as their salary.