[2408.14906] Writing in the Margins: Better Inference Pattern for Long Context Retrieval - discu.eu

Reddit

"Writing in the Margins (WiM)" - a better inference pattern for long context LLMs that solves the Lost-in-the-Middle problem https://arxiv.org/abs/2408.14906 16 comments 28/8/2024 machinelearning

Linking pages

GitHub - codelion/optillm: Optimizing inference proxy for LLMs https://github.com/codelion/optillm 3 comments
How to Run a Paper Club (also: LIVE at NeurIPS 2024!) https://www.latent.space/p/paperclub 0 comments

Would you like to stay up to date with Computer science? Checkout Computer science Weekly.

Related searches:

Search whole site: site:arxiv.org

Search title: [2408.14906] Writing in the Margins: Better Inference Pattern for Long Context Retrieval

See how to search.

Submit link to: