[D] What's the Time and Space Complexity of Transformer Models Inference? Submitted by Smooth-Earth-9897 t3_11nzinb on March 10, 2023 at 8:13 PM in MachineLearning 8 comments 13
fnbr t1_jd6jsb6 wrote on March 22, 2023 at 4:51 AM The best analysis on this is from this blog: https://kipp.ly/blog/transformer-inference-arithmetic/ Permalink 1
Viewing a single comment thread. View all comments