Rutland is the biggest town near Killington. It has a rough reputation but honestly it's a great town with a lot to offer.

As others have said, Vermont is very white and sadly racism and classism is prevalent, but I know many Vermonters who are actively trying to fight that, so at least there's that...