It's hard to answer broad "is X area safe" in Worcester cause it often varies street to street, but overall I'd say Vernon Hill is mostly pretty okay. It's loud, parking sucks if you don't have a driveway spot, and boy does it get windy...but I don't think I'd say it's 'unsafe.'