Viewing a single comment thread. View all comments

veb101 t1_iqzmeka wrote on October 4, 2022 at 7:21 AM

What if Flash attention was also integrated with these updates? A couple of days ago Labml.ai posted this: Speed Up Stable Diffusion by ~50% Using Flash Attention

I'm just curious.

Norlax_42 OP t1_iqztpkp wrote on October 4, 2022 at 9:11 AM

Great idea! Definitely possible, will try it out soon and share an update