You sound like you're trying your best, and no a slip up doesn't make you a bad husband.

However, get a grip of your finances. Know your budgets and spendings and plan ahead. If you know what you can and cannot spend, and choose wisely, you can save a lot of money. Money that I think that would really help the both of you do some extra, fun things occasionally and to start saving some money. Even if it's a littlebit each month, money saved is money saved. You'll thank yourself in the long run.

My sister and her boyfriend have been poor for 5 years or so due to circumstances, but they didn't have to be. They just continue to spend unwisely and don't have a grip of their finances at all. My gf and I have less income (for now) but are able to do a lot more with it.