Depending on your age and what you think is fun, you either want Federal Hill (10 min walk from inner harbor, college-y bars), Fells Point, Canton (similar, maybe skews a little older), or maybe Mt Vernon for either gay nightlife or just an older crowd.