aaaasd12 t1_j3i3ea8 wrote 2 years ago Reply to [D] Have you ever used Knowledge Distillation in practice? by fredlafrite It's like transfer learning? In the company that I'm work only use the normal things like classification tasks/ segmentation with clusters. Maybe the use case that i see is in NLP with topic modeling using bertopic and tuning the hyperparameters. But in general simple models are perfect for the tasks that se have. Permalink 0
aaaasd12 t1_j3i3ea8 wrote
Reply to [D] Have you ever used Knowledge Distillation in practice? by fredlafrite
It's like transfer learning?
In the company that I'm work only use the normal things like classification tasks/ segmentation with clusters.
Maybe the use case that i see is in NLP with topic modeling using bertopic and tuning the hyperparameters.
But in general simple models are perfect for the tasks that se have.