That's up to you. I'm in an open marriage and that is something that my wife and I are both into but that sort of thing requires both people to be onboard and desiring it. If you don't want to do it, don't. It's really as simple as that.

If you decide it is something you'd like to do, make sure you have some long conversations about boundaries. Hopefully he's not using it as a way to get to sleep with other women as well.

Tread carefully and only do what you want to do.