Submitted by Darustc4 t3_126lncd in singularity
huskysoul t1_je9moic wrote
Fear not the scythe but the reaper.
It isn’t AI that creates bad outcomes, but the system that enculcates and wields it. We fear AI because we already know how it will be utilized - to eliminate livelihoods, further marginalize vulnerable groups, and reinforce structural power and inequity.
Placing control of AI in the hands of privileged groups and individuals is what we should be concerned about, not whether or not it exists.
Veleric t1_je9u7n4 wrote
It's not just the privileged groups and governments we need to be concerned about. Think about the level of cyberterrorism and misinformation these tools could be used for in the wrong hands. Imagine if someone gets pissed off at you and uploads a deepfake of you doing something heinous and it only takes a few minutes of effort. Even if you have the ability to disprove it (which isn't a given) it could cost your job or reputation. Think about the ability to manipulate markets. The ability to sway your emotions. Social media is one thing, but once these tools truly become full-fledged assistants/companions/partners, they could be turned on us.
I'm merely playing devil's advocate here, but I think we can all agree that humans are capable of deplorable things and some will act on them if motivated. We need to prepare for the worst, not only in an alignment sense but in a user capability sense.
huskysoul t1_je9zc03 wrote
I get where you’re coming from, but I think we have arrived at a point where if you believe anything on the internet is legitimate, you are probably mistaken.
EchoingSimplicity t1_jeb9jyv wrote
That isn't the concern. The concern is of an autonomous, sentient program deciding to do whatever it pleases, and of it self-improving at an uncontrollable rate.
Darustc4 OP t1_je9ntit wrote
And how do you propose one does that? Making SOTA LLMs (or AGIS for that matter) requires an absolute fuckload of money, and only top elites and goverments have access to that kind of money and influence.
huskysoul t1_je9ruuo wrote
Hmmm. Now I think we’re getting somewhere.
johnlawrenceaspden t1_jeahoe7 wrote
Should probably fear both.
Viewing a single comment thread. View all comments