Viewing a single comment thread. View all comments

bloc97 t1_j2pz7r6 wrote

Reply to comment by Agreeable-Run-9152 in [R] On Time Embeddings in Diffusion models by Agreeable-Run-9152

FNO? Are you referring to Fourier Neural Operator?

1

Agreeable-Run-9152 OP t1_j2pz999 wrote

Yep

1

bloc97 t1_j2q0aio wrote

I'm not too familiar with FNOs, but I guess you could start experimenting by adding the time embeddings to the "DC component" of the fourier transform, it would be at least equivalent to adding the time embeddings to the entire feature in a ResNet.

2