I used to have this happen. Shaving isn't a good idea down there for a couple reasons. This is one of them. But, now that it's already happened, harsh soaps aren't really going to help. When you shower, use a clean washcloth to exfoliate so you don't get ingrown hairs. Once you're out of the shower, witch hazel toner then aloe.