You are just renting money from the bank. Like anything else you rent, of course you have to pay for it until you return it. And compare to most things you rent, the cost of renting money is quite low. It's only that people usually rent so much of it at a time that the cost adds up.