starstruckmon

starstruckmon t1_j3gxjtj wrote

There is a lot of research on reinforcement learning for code generation via language models happening right now. So depends on how that turns out since what you're asking for isn't possible without RL. The context window issue also needs to be fully solved and the solutions on the horizon currently don't cut it. But we could have a breakthrough any day. So who knows 🤷

2

starstruckmon t1_j3c8cop wrote

>It automates the final phase of RLHF (reinforcement learning from human feedback) by generating its own training examples from a bunch of rules, an "AI Constitution" so to speak.

I wish they'd just say this instead of all that "constitutional" , "three rules" nonsense.

Makes sense. Should be a lot more easier than RHLF through reward function. That's well known to be finicky as hell.

4

starstruckmon t1_j1y6eon wrote

I dont think that method is fullproof, but yeah, if I took it again or gave each more time, Im sure I'd get better results. I think the ones I got most wrong are

  • Some of really bad smudgy stuff that was apparently done by humans.

  • Some of the really good ones that were done by Midjourney. Though I do think I can spot these much easier now. They're kind of uncannily good. Like a bit too photoreal while not actually being photoreal. The paper thing also seems to work on these ones.

3

starstruckmon t1_iticzam wrote

Reply to comment by Shelfrock77 in captured with LUMA AI by Shelfrock77

Google Street View doesn't use it either. That's just a 360° panorama shot. What you're seeing is a fully 3d scene where you can move around any way you want creates from just a few images. That's where the AI comes in.

(Btw, I'm not the one downvoting you)

6

starstruckmon t1_iti69qd wrote

Reply to comment by Shelfrock77 in captured with LUMA AI by Shelfrock77

Not really. Google doesn't use NeRF anywhere yet. It's still new technology. I was just wondering how many images it took to train the NeRF shown here. Probably a video with a bunch of frames? 🤷

4