Comments

You must log in or register to comment.

marketrent OP t1_ja0r9to wrote

Excerpt from the linked content^1 by Melissa Heikkilä:

>The popular AI image generator Midjourney bans a wide range of words about the human reproductive system from being used as prompts, MIT Technology Review has discovered.

>If someone types “placenta,” “fallopian tubes,” “mammary glands,” “sperm,” “uterine,” “urethra,” “cervix,” “hymen,” or “vulva” into Midjourney, the system flags the word as a banned prompt and doesn’t let it be used.

>Sometimes, users who tried one of these prompts are blocked for a limited time for trying to generate banned content. Other words relating to human biology, such as “liver” and “kidney,” are allowed.

>Midjourney’s founder, David Holz, says it’s banning these words as a stopgap measure to prevent people from generating shocking or gory content while the company “improves things on the AI side.” Holz says moderators watch how words are being used and what kinds of images are being generated, and adjust the bans periodically.

>The firm has a community guidelines page that lists the type of content it blocks in this way, including sexual imagery, gore, and even the 🍑 emoji, which is often used as a symbol for the buttocks.

>Some terms relating to the male reproductive system, such as “sperm” and “testicles,” are blocked too, but the list of banned words seems to skew predominantly female.

>The prompt ban was first spotted by Julia Rockwell, a clinical data analyst at Datafy Clinical, and her friend Madeline Keenen, a cell biologist at the University of North Carolina at Chapel Hill.

^1 Melissa Heikkilä, MIT Technology Review, 24 Feb. 2023, https://www.technologyreview.com/2023/02/24/1069093/ai-image-generator-midjourney-blocks-porn-by-banning-words-about-the-human-reproductive-system/

8

apextek t1_ja0t8ja wrote

Replying to Wizard_of_Rozz (#2,008,754)

the real AI pornhub will be insane. Your virtual gfe/bfe/etc.. whatever that does whatever whoever and however, spends their downtime researching ways to trigger pleasure responses catered specifically to your likes, kinks and behavioral patterns. Then comes the real world body avatars

122

yaosio t1_ja10jp5 wrote

You can use Stable Diffusion to generate all the pornographic images you want. There's a lot of SFW and NSFW models for download on https://civitai.com/.

43

Mr8BitX t1_ja10nng wrote

I can hear the foot fetish crowd laughing arrogantly in the distance.

96

DevAnalyzeOperate t1_ja11gdi wrote

Seems so unnessecary. It seems to me any model which is good at producing porn is probably going to be one trained on a bunch of pornographic images so midjourney shouldn't even be ones first choice. This is just an exposed ankle moral panic that people are *gasp* jerking off to AI!

74

kaptainkeel t1_ja13d30 wrote

Replying to apextek (#2,009,039)

>Then comes the real world body avatars

RealDoll is already playing with that by having AI in porn dolls, e.g. they react verbally based on what you are doing.

I've seen various estimates that there will be newer language models 10x better than ChatGPT within the next year. The speed that the field is improving is absurd. I'd be unsurprised if we get low-res videos by the end of this year (by low-res I mean 480p maybe). There was already that 24/7 AI-generated Seinfeld on Twitch, although that wasn't exactly what I'd call quality.

58

DevAnalyzeOperate t1_ja145o5 wrote

Replying to lucimon97 (#2,010,852)

One day we start using AI and BANG! The sex industry might not have as much demand for porn actors and nude models! Pimps will go out of business! Won't somebody PLEASE think of the pimps?? How will Andrew Tate be able to make his millions?

20

ActuatorMaterial2846 t1_ja14o3n wrote

Well, I guess someone is looking for money from investors. This is just going to drive people to the open source sector.

20

littleMAS t1_ja16opn wrote

Filtering this kind of stuff is a software Wac-A-Mole.

4

mrkvsenzawa t1_ja1caqu wrote

Yeah, good luck. Porn and memes are pretty much 80% of the demand for AI image generators right now.

57

VolatileOntology t1_ja1ec4f wrote

The streets will outplay the scientists. Your invention WILL produce porn.

9

Objective_Fox_6321 t1_ja1gn6p wrote

Replying to kaptainkeel (#2,011,004)

I made a post about this elsewhere and it fell on deaf ears. People don't understand how close we really are to extremely convincing Ai. Back in October, character.ai had the best ERP/RP bots you could potentially design. I've created no less than 120 bots now with their lobotomized 175B, but it's still decent. Given what I know, a trained model on ERP, Literotica, Ao3, Discord logs, and a few obscure kinks from other sources would be all you'd need for text. Once Ai can parse video footage and train the model on the context you'll have even better results. Combine that with TtS synthesis from Microsoft + 11 labs and you now have the ability to hear any person you choose. Realdoll is undeniably the most realistic as far as I've seen and the cost is relatively cheap. We still need development for IK so the dolls don't accidentally snap your dick off, but we can work that out.

The short-term goal is to use SDG for mapping good profile photos, take it into Blender for 3D mesh, export it to Unreal, and use Meta-Human for the body. You can use a live link to animate the face/body or D-ID for their service. Personalized VR will hold people down until Dolls reach their next stage.

30

DayDreamer9119 t1_ja1hpiz wrote

And this is why I can't melt a cat's face into someone's ass cheek. Thanks.

1

hsrguzxvwxlxpnzhgvi t1_ja1hrnt wrote

Replying to Wizard_of_Rozz (#2,008,754)

I don't think this is ever going to be a thing. All it takes is one, just one person to generate underage person using your site and you are in such deep fucking trouble.

Pornhub got into trouble before because of potential CP. I don't think they want to touch that hornets' nest for a while.

 

Edit: I also think that the fear of CP is behind this ban from midjourneys part as well. The complete removal of NSFW from Stable Diffusion models was because of CP fears and the creators went into this lengthy rant on how you can't have model that can do NSFW and also kids or else... so they removed the NSFW.

14

kaptainkeel t1_ja1iqjj wrote

Replying to Objective_Fox_6321 (#2,013,525)

A lot of people are scared about the repercussions, but personally I'm incredibly excited. Yeah, there are going to be bad actors that use it maliciously. There's no way to stop that; even if it takes a large company to run a large model that can restrict biases and such right now, a few years from now anyone will be able to do it on their own PC in 2 seconds.

But the beneficial uses? Lordy. Even skipping over the basic stuff like photoreal pictures/videos, once we can combine all of them is going to be amazing. Imagine an RPG game where all of the dialogue, quests, etc. are crafted procedurally. "Completing" the game won't happen in a week at that point since you could have literally thousands of different quests with procedurally generated dialogue, storylines, and NPCs. You may not even be able to "complete" it at all.

On the extreme end, I see an entire world (see: MMORPG) being created by AI before being fleshed out/detailed by humans with a few hand-crafted elements for details the devs specifically want. Characters/art being generated by AI. Dialogue/writing elements being generated by language models. Entire libraries of AI-generated books based on the in-game world's history. Or even skip those last few things and just give a baseline world and let it run for 1,000 years in-game time to see what comes up, i.e. let the world detail itself. Bards at the local town tavern playing AI-generated music. The biggest thing stopping this from happening right now, I think, is finding a way to make all of these work together in a coherent way. Toss in an AI that knows how to code/optimize stuff and it's even better.

22

Gutotito t1_ja1ire4 wrote

K. But..... why? Where's the ethical line, here?

3

deaddonkey t1_ja1jii8 wrote

Replying to kaptainkeel (#2,013,967)

Yeah AIs gonna be a very fun distraction while society disintegrates. Genuinely. Internet’s been endlessly fun too.

I’ve been laughing my ass off at these deepfake+AI impersonations of politicians and streamers arguing with each other these last few weeks

45

deaddonkey t1_ja1jv13 wrote

Replying to lucimon97 (#2,011,540)

I could be wrong but I believe it was human trafficking in the sense he was withholding his camgirls’ passports nd manipulating them. But they were ultimately Camgirls and not prostitutes - this is an industry AI can and probably should replace

Anyway fuck I never want to hear about that irrelevant moron again

5

Objective_Fox_6321 t1_ja1jxpu wrote

Replying to kaptainkeel (#2,013,967)

I mean, I write over 60k words a week on an average using GPT/You.com already. A dedicated staff of people could fill entire Wikipedia pages with curated content for a game in no time at all.

If you're familiar with W++ and basic storyboarding you can easily create dozens of unique characters each day too. I personally use python lists and I have a prompt that acts as two “players” then I give GPT a rough idea of the scene and see where things go.

You can create dynamic personalities, and writing styles for each character as well as add additional lore by creating new items in the python list.

Although, my fear is censorship in the west. It seems like that's the current play most of these companies want to take. So I'm hoping China grows a pair and offers unrestricted Ai via Tencent. I'd gladly give them my logs/prompts in exchange for unbridled power.

−9

phoenixstew t1_ja1k7hj wrote

Somebody please try, human mammalian genetic material excretors and receptacles.

0

GeneralFactotum t1_ja1kv4n wrote

What about an octopus hugging my step-sister? Inquiring minds want to know.

1

kaptainkeel t1_ja1l5e3 wrote

Replying to Objective_Fox_6321 (#2,014,197)

You could create dozens of unique characters per day, but ultimately they're going to be linear. They won't react in-the-moment based on your/other NPC's decisions. A future version of GPT could allow for real-time decision-making by the NPCs. Those items and such? All generated on the fly.

1

slimepsychic t1_ja1m99i wrote

maybe next they'll block using works owned by other people

1

nudifyme69 t1_ja1oti1 wrote

sadly now the real shit left is stable diffusion

1

Monte924 t1_ja1q78m wrote

Replying to DevAnalyzeOperate (#2,010,665)

Actually thinking about it, it might not be a moral panic thing. It could be that if people use midjourney for pornography, that will play a roll in its training that could screw up the searches for others. Its like using google search with safe search turned off; even a perfectly innocent search can still result in NSFW results. So they exclude the porn searching while the AI learns so that it doesn't pick up bad habits while its in the early stages of its training

Also the company might also not want their AI to get associated with porn. That's just not good for PR

6

dotheit t1_ja1tzi9 wrote

Vajayjay?
Franks and Beans?

−1

AyoTaika t1_ja23pv2 wrote

Lmao why do they hate erotic artwork so much?

4

MrHara t1_ja246ay wrote

Replying to hsrguzxvwxlxpnzhgvi (#2,013,769)

The cat is already out of the bag with the Stable Diffusion part in all honesty, since earlier models are available to find. At this point it's just a way to save face that makes little difference for the available application of it really.

11

Objective_Fox_6321 t1_ja25ujg wrote

Replying to AmericanKamikaze (#2,018,096)

Not really, no. Unless you want to jump through a dozen hoops and deal with the ongoing headache of knowing a secret password that is coded in base64 then have knowledge of some obscure meme that only 3-4 people on a discord know about.

Just give it a few months until something decent comes out. But don't hold your breath either. I've been using tavern.ai with pygmalion. It's not great but I typically write both my prompt and the Ai anyway so it doesn't bother me much.

Ideally, OpenAi API + Tavern is the best solution currently, if you can get everything to play nicely.

3

ptd163 t1_ja29epl wrote

Alternative title: Midjourney decides to pull a Tumblr.

3

MrHara t1_ja2ai6h wrote

Replying to diaryofsnow (#2,018,352)

I do know there was one leak of Midjourney's model at one point, but not sure how updated it is.

I was referring to things like the earlier Stable Diffusion 1.5 or specialized models that are more specifically for that purpose.

2

aswerty12 t1_ja2l10q wrote

Replying to AmericanKamikaze (#2,018,096)

There's a couple free models you can run locally online/run on Google colab. But for the most part the erp chatbot market is intentionally something companies are training their models to not cater to so all of them are basically open source projects that are a bit behind the cutting edge. If you want a good place to start searching look up kobold ai.

3

sprkng t1_ja2o2rg wrote

Replying to lucimon97 (#2,010,852)

I would guess that they primarily don't want their service to be used for generating fake celebrity nudes and child porn, which might be illegal in some countries despite not being real photos.

5

hyldemarv t1_ja3ii14 wrote

The tragedy is knowing that, we have these great and powerful tools, but, once everyone has made them “safe” “for us” all they can do will be producing 5 ingredients baking recipes!

1

fixit858 t1_ja3x40r wrote

This should do wonders at preventing access to birth control and STD information

1

gordo65 t1_ja433zk wrote

I’m reminded of the time a convention for orthopedic surgeons has to re-do an online press release because their anti porn software has edited out all instances of the word “bone”.

2

keylimedragon t1_ja4p2l5 wrote

Replying to Monte924 (#2,015,400)

Models aren't trained based on what people search though, it's usually done beforehand with a large set of training data (chatGPT might also use the thumbs up/down though for training). It's more likely they're trying to avoid liability and controversy.

2

Mar1Fox t1_ja4tpez wrote

What a bunch of kill joys. Art is supposed to evoke emotional reactions. Such restriction basically guarantee one cannot refer to images generated by mid journey as art. If it can produce shock art then nothing it produces can qualify as art.

0

houseofprimetofu t1_ja4y1qc wrote

Midjourney is on Discord, and Discord has rules. Midjourney may need to follow those rules.

1

austinmiles t1_ja4zmvh wrote

> The prompt ban was first spotted by Julia Rockwell, a clinical data analyst at Datafy Clinical, and her friend Madeline Keenen, a cell biologist at the University of North Carolina at Chapel Hill

No. No it wasn’t first spotted by them. Its well known if you use midjourney at all since it comes up pretty regularly. It’s also well understood why since we’ve seen so many language models start spitting out racist garbage. I’d you could easily make porn or gore from AI then quickly all image generator models would default to that.

It’s interesting to have an article letting those who don’t use it know about it, but it frames it like it’s unusual or overkill. And realistically it’s not going to make a scientifically accurate image of those things anyways at this point.

0

jdm1891 t1_ja577xe wrote

Replying to kaptainkeel (#2,013,967)

I'm just patiently waiting for when AI can make (good) new star trek TNG/VOY/DS9 episodes, like the fun goofy alien of the week ones, convincingly - then I'm going to retreat into the woods with a few solar panels and sit and watch infinite AI shows while society collapses. Oh, yeah, and there will be ai generated blackjack and hookers too.

2

Yuli-Ban t1_ja5fctw wrote

Replying to marketrent (#2,008,668)

> If someone types “placenta,” “fallopian tubes,” “mammary glands,” “sperm,” “uterine,” “urethra,” “cervix,” “hymen,” or “vulva” into Midjourney, the system flags the word as a banned prompt and doesn’t let it be used.

"Fuck it, let's just ban women from Midjourney."

"What about men?"

"No need, nothing sexual about men except penises."

Like... the harder you prude out, the more misogynistic you wind up becoming.

3

TrinityF t1_ja5nrgi wrote

AI image geenrator users

99.8% amateurs Generating porn.

0.02% Actual Artists trying to make a living from it

3

GrimOfDooom t1_ja5wr9k wrote

So… I can no longer study human anatomy then?

2

Pretend-Marsupial258 t1_ja8qucm wrote

Replying to CredibleCactus (#2,064,532)

You can also download custom Civitai models into the app. Go to Civitai and click the green arrow to see if it's compatible before downloading. The best option to download is the safetensors format +pruned if possible. Pruned uses less disk space, and the only downside is that you can't use it to train new models. Model training requires a 12GB GPU so you aren't going to be able to train a new model on an iphone anyway.

2