For fantasy books, I don't even try to do it. After reading 100+ books I don't even try to remember them. Usually I remember the most enjoyable moments and my emotions - this is enough for me.

As for non-fiction, sometimes I copy quotes that are interesting to me and reread them once in a while.