Viewing a single comment thread. View all comments

Fenzik t1_j0ytx7v wrote

If you’re worried about the dimensionality of the embeddings, why not do some dimensional reduction on them?

5

Business-Ad6451 OP t1_j0ywfde wrote

Because if I use SVD, the matrix I would get would have a rank ≤ min{m, n}, assuming I had a m×n embedding matrix. But I want to reduce the 26000×768 matrix to 10000×768, which can't be done using SVD.

2