If my mother were to judge books based on the author's skin color, I might hate reading too.

If you are mainly concerned about something like book lice, you can basically bake your books at a low temperature for a few hours. Libraries do this with special ovens, but in theory you should be able to do it at home.

There has been this post on this subreddit a few weeks ago where some comments explained how to do it (also there was a wild discussion about book scorpions, but that's something else...)