Submitted by jaqws t3_10dljs6 in MachineLearning
Zondartul t1_j4mb6rm wrote
Reply to comment by Acceptable-Cress-374 in [D] Fine-tuning open source models on specific tasks to compete with ChatGPT? by jaqws
So using a big network to teach a small network? That's a thing people do. See teacher-student learning, and distillation.
Acceptable-Cress-374 t1_j4pacws wrote
> See teacher-student learning, and distillation.
Thanks, I'll check it out.
Viewing a single comment thread. View all comments