My husband is from there, so I'm extremely familiar with the area! I'd suggest what's considered the West End, or Union Terrace which has smaller more affordable houses. The west end is BEAUTIFUL with massive mature trees, good sidewalks, very quiet, and good access to downtown (and Yoccos!). Union Terrace is a bit tighter since the houses are smaller, but still has a cute neighborhood feel.

Both places are very safe, and I would buy a house there if we ever moved up to the area!