veb101
veb101 t1_j27k7f9 wrote
Math behind diffusion, I don't even remember the math.
veb101 t1_j17yqh7 wrote
Reply to Backprop, beginners question by Matthyou200
Shameful plug, but I didn't want copy and format links on mobile.
https://github.com/veb-101/Neural-Networks-from-scratch/tree/master/Multi-Layer-Perceptron
In the readme I've listed the links that I used for learning and implementing neural networks from scratch.
veb101 t1_j0atf1m wrote
Reply to comment by MrFlufypants in [D] Tensorflow vs. PyTorch Memory Usage by Oceanboi
I think this can be solved using:
tf.config.experimental.set_memory_growth(gpu_device, True)
veb101 t1_iqzmeka wrote
What if Flash attention was also integrated with these updates? A couple of days ago Labml.ai posted this: Speed Up Stable Diffusion by ~50% Using Flash Attention
I'm just curious.
veb101 t1_j5xjuy0 wrote
Reply to [P] Diffusion models best practices by debrises
I'm also starting a similar project, but it just involves writing DDPM from scratch. In the past few days I saw some papers regarding diffusion in the medical domain, maybe you can skim through that and see how they are used in that domain.