Not just thermic effect, glyconeogensis is also is a notable impact.

Carbohydrates can be directly digested directly into glucose, if you do not have enough carbohydrates in your diet, your body can synthesize it.

We're not talking a massive expense, but it's still there.