You could pack a picnic and do one of the trails up East Rock, get tickets to a show at one of the theaters (Yale rep or at the Shubert), go through the Yale art gallery, hit up any of the state parks for a hike, there's quite a bit to do