It's a break up.

He never once suggested just moving to a bigger place, did he?

Well, if that's a rent issue, I get it. But the fact that he didn't bring it up raises alarm bells for me.

He may be afraid of hurting your feelings, or of being alone, but going from living together to living apart?

That's gotta be a break-up, even if not directly called that.