With toddlers and babies I definitely recommend Ocean City. It has a beautiful boardwalk with 2 ride areas and clean beaches (you do have to purchase beach tags for the adults, but the money goes towards keeping the beaches clean and I personally think it's worth it). It's also a relatively narrow island so you're always going to have easy beach access.