Viewing a single comment thread. View all comments

Borrowedshorts t1_j9kcmhm wrote

Reply to comment by turnip_burrito in What. The. ***k. [less than 1B parameter model outperforms GPT 3.5 in science multiple choice questions] by Destiny_Knight

Humans finetune to the test as well.

3

dwarfarchist9001 t1_j9kpzs8 wrote

Humans don't suffer from overfitting if they train on the same data too much.

2

skob17 t1_j9kt3k1 wrote

Oh they absolutely do. If the test questions have a slightly different approach, many of the hard memory learning students fail.

7