yaosio

yaosio t1_iuz4uo0 wrote

There is an argument that co-pilot outputting open source code without credit or the license breaks the license. It will output stuff from open source projects verbatim (I can't find the link, maybe it was in Twitter? I can't back this up.), so this isn't a case where the code is inspired by the code, it really is the code and has to abide by the license.

One solution without messing with co-pilot training or output is to have a second program look at code being generated to see if it's coming from any of the open source projects on gitbub and let the user know so they can abide by the license.

36

yaosio t1_iuz1rof wrote

When all you have is a hammer then everything's a nail. Somebody that knows a lot about 3D printing decided that it will work for everything. I'd like to know how it compares to a factory built house, or a factory built 3D printed house

1

yaosio t1_iuz19se wrote

My cat claims she's never eaten food before but she's still fat. An independent third party needs to calculate total costs, not the company selling it that swear it's cheaper and you just have to believe them.

2

yaosio t1_iuz0kq7 wrote

Houses need to last a very long time. The plumbing system could last 75+ years, the house could last 100+ years if you keep up with maintence. This means switching to a new technology that turns out to not work as advertised can be a disaster.

There used to be a copper water pipe replacement called polybutylene. It was cheaper and easier to install than copper, but it turned out to have a short lifespan with leaks happening early in it's life. You might not be able to get homeowners insurance if you have these pipes requiring them to be replaced. They started being installed in the 70's but it wasn't until the 90's the problem was discovered. That's 20+ years of what was thought to be a proven technology.

So construction companies, the reputable ones at least, don't want to leap into something new only to find out many years later there's some horrible problem that could not be forseen.

Then there's the "we've always done it that way" people. Even when something is proven they refuse to use it because they have always done something a different way. These are also the people that shake hands with danger because they think it's manly to breath in rock dust and get lung cancer. When you are near a construction site and hear a guitar riff that's somebody that doesn't know what they're doing. https://youtu.be/Mmrs9GYkbqg

2

yaosio t1_iu2za10 wrote

Diffusion for language models provides more coherent output according to various studies I've found. I'm surprised nobody's talking about it considering all the hype about diffusion for image generators. I guess it's not as cool as it sounds. The paper doesn't compare it to GPT models which should have told me something.

https://arxiv.org/abs/2205.14217

https://github.com/xiangli1999/diffusion-lm

There's also a new method that's even faster than diffusion.

https://www.assemblyai.com/blog/an-introduction-to-poisson-flow-generative-models/

I hope you have good luck on your text generating endeavors!

7

yaosio t1_iu2ylrs wrote

NovelAI does it as well and it doesn't really work that well. Many times it completely ignores entries. However both NovelAI and AI Dungeon have a limited output. This study is on generating 2000+ words without human intervention. I made plenty of stories with both NovelAI and AI Dungeon to know that neither stay on topic and quickly go off the rails. It doesn't matter what model is used, they all go off the rails.

9

yaosio t1_irkebzs wrote

There is no reason to copy the human brain to create AI. There's a lot of extra stuff in there that's not needed. Creativity is being done just fine without copying the brain with stuff like Stable Diffusion. This is yet another "humans are special" article from somebody that can't comprehend humans are not special and the way our brain works is not the only way for intelligence to function.

Given how fast AI can work, once it can create software on it's own without human help we can expect things to move very fast. Think of Copilot but instead of needing a human to hand hold it, you can just tell it what you want and it can code the entire thing from scratch.

1

yaosio t1_iqvqslz wrote

Unless the code is available there's no guarantee it can be replicated. Plenty of people in /r/machinelearning complain about papers that can't be replicated. Sometimes the people writing the paper promise the code and then never provide it and refuse to respond to anybody asking for it.

5

yaosio t1_iqu95ip wrote

They mean is there a way for a third party to prove it. They could be cherry picking or just fabricate their results and with no way to reproduce it we wouldn't know.

2