I have a similar commute, and I find the trumbull/orange area isn't bad either way. I hike up rt 8 to 84 and hubby leaves from the Bridgeport station. We used to be in Norwalk, but it was a just no commute.

If you like driving and he is OK with the trains you will be OK.