Viewing a single comment thread. View all comments

zzzthelastuser t1_izx8k9l wrote

> I've seen discussion on whether they use some kind of summarization to be able to fit more context into the same

They could unironically use ChatGPT for this task.

3

master3243 t1_izxkwzt wrote

True, using the embedding from an LLM as a summary of the past for the same LLM is a technique I've seen done before.

1