My understanding is that factory records, home of New Order and Joy division, would release singles that wouldn’t appear on albums. That is why the compilations “substance” were released. Each band has a “substance” album worth checking out.

Jimmy buffet’s “songs you know by heart” fits what you’re looking for as well.