It's not just the privileged groups and governments we need to be concerned about. Think about the level of cyberterrorism and misinformation these tools could be used for in the wrong hands. Imagine if someone gets pissed off at you and uploads a deepfake of you doing something heinous and it only takes a few minutes of effort. Even if you have the ability to disprove it (which isn't a given) it could cost your job or reputation. Think about the ability to manipulate markets. The ability to sway your emotions. Social media is one thing, but once these tools truly become full-fledged assistants/companions/partners, they could be turned on us.

I'm merely playing devil's advocate here, but I think we can all agree that humans are capable of deplorable things and some will act on them if motivated. We need to prepare for the worst, not only in an alignment sense but in a user capability sense.