I'm fine with wonky aesthetics if it suits the theme or narrative of the book in some way, or is otherwise just part of the author's vision. I may not always personally like it, but I will respect it.

However, if it's wonky just because of lazy publishing/editing, then i'll be a bit put off. Quality writing can and will make it tolerable, as long as the work is still legible, but a certain degree of presentation is important to avoid making the act of reading unnecessary unpleasant.