Viewing a single comment thread. View all comments

MysteryInc152 t1_j50pkxw wrote on January 19, 2023 at 4:21 PM

With embeddings, it should theoritically not have a hard limit at all. But experiments here suggest a sliding context window of 8096