April 5, 2024
My cold take (which would have been a hot take a month ago) is that long context windows *increase* the need for good RAG.
Among other things, long context enables more powerful (multi-turn) agent workflows. Agent workflows often (usually) need to leverage information retrieval of some (multiple) kind(s).
Commoditize your complements! (Long context being a natural complement to RAG).