That would make sense as it has nothing to connect to once you leave WiFi range

Often it can mean you're out of your coverage area. If you're in your coverage area, toggle airplane mode. If that doesn't work, close all open apps, all tabs open on your browser, and then clear the browsing history, and try again