I think what I want here, before forming an opinion on it, is a better idea of what “information” means in this context. I get the impression it’s more closely related to entropy than to “this collection of bits is a cat GIF” but I’d like more clarity.