You did nothing wrong and if he wants to think you’re a coward he can. You know you aren’t.

You can’t control how he reacts, you can’t make him think something he doesn’t. All you can do is leave. His loss!

He is manipulating you. What you describe sounds terrible for you and it’s going to damage you and break you down. Please for your own sake, leave him. Trust me, this is not what a good relationship looks like.