Viewing a single comment thread. View all comments

xEdwin23x t1_irv8zfs wrote

These question the "progress" or rather the illusion of progress in the field:
Are GANs Created Equal? A Large-Scale Studyhttps://arxiv.org/abs/1711.10337

Do Transformer Modifications Transfer Across Implementations and Applications?

https://arxiv.org/abs/2102.11972

21

SleekEagle t1_irx747e wrote

Is progress really a question? It seems very obvious that we have made progress in the last 5 years, and just looking at GANs seems ridiculous when Diffusion Models are sitting right there. Not trying to be a jerk, genuinely curious if anyone actually thinks that progress as a whole is not being made?

I definitely sympathize with the "incremental progress" that comes down to 0.1% better performance on some imperfect metric which occurs between big developments (GANs, transformers, diffusion models), but ignoring those papers and looking at bigger trends it seems obvious that really incredible progress has been made.

8