No, it doesn't really bother me. If it's been a while (e.g. The Dragon Prince's 4th season) there's always some useful video or forum post to get your caught up to speed without a rewatch. Sometimes the network provides their own recap for you (e.g. also the Dragon Prince).