Trains are cost effective in and between densely populated cities. Not as a massive grid through less populated areas.

Not every one can live in cities, you still need farming and manufacturing which are more cost effective away from cities.

This is why we see trains in some areas of the world and not in other places, as well as other economic factors.