You did nothing wrong and if he wants to think you’re a coward he can. You know you aren’t.

You can’t control how he reacts, you can’t make him think something he doesn’t. All you can do is leave. His loss!