sonudofsilence OP t1_irwah22 wrote on October 11, 2022 at 2:58 PM

Reply to Bert - word embeddings from a text by sonudofsilence

Thankss

sonudofsilence OP t1_irw765w wrote on October 11, 2022 at 2:35 PM

Reply to comment by neuralbeans in Bert - word embeddings from a text by sonudofsilence

Yes, i know but in this way the embedding of a word will be created according only to the tokens of the sentence in which it is found, right?

sonudofsilence OP t1_irw4bmr wrote on October 11, 2022 at 2:15 PM

Reply to comment by neuralbeans in Bert - word embeddings from a text by sonudofsilence

Yes, that's why i want to pass "all the text" into bert, because for example a word in a sentence has to have similar vector with the same word (with same meaning) in another sentence. How can i accomplish that, as the max tokens number of bert is 512?