_learn_faster_ OP t1_j9nuqe3 wrote on February 23, 2023 at 8:35 AM

Reply to comment by guillaumekln in [D] Faster Flan-T5 inference by _learn_faster_

For flan-t5 does this only work for a Translation task?

guillaumekln t1_j9nv5n0 wrote on February 23, 2023 at 8:41 AM

No. Even though the high-level class is named Translator, it can be used to run any tasks that would work using T5ForConditionalGeneration in the transformers library.