I'm similar, although to a lesser degree, probably mostly because I'm more bored or annoyed by fiction - it either uses the tropes I already know, or is poorly written, so I see through what writer was trying to do but failed to.

Part of the problem is that better written books are often quite sad with downtrodden or tortured characters, and when I read, I want to escape from my automatic mode of thinking "what if something bad happens" which paints already difficult life in a darker light. I don't need to add to that.

So I read memoirs due to verisimilitude, or pop science/science books because there's lots of wonderment and new information there