Submitted by starstruckmon t3_1027geh in MachineLearning
starstruckmon OP t1_j501y7y wrote
Reply to comment by johnrachwan in [R] Massive Language Models Can Be Accurately Pruned in One-Shot by starstruckmon
From the paper
>One natural avenue for future work would be to investigate fine-tuning mechanisms for such large-scale models, which would allow further accuracy recovery. We conjecture that this should be possible, and that probably at least 80-90% sparsity can be achieved with progressive pruning and fine-tuning.
So, that comes next. Though I doubt the 80-90% guesstimate.
Viewing a single comment thread. View all comments