Tag: recursive-language-models
All the articles with the tag "recursive-language-models".
Recursive Language Models: The Prompt as an Environment
Updated:A recursive language model never reads its long input: the input sits in a Python REPL as a variable, and the model writes code to inspect it and calls itself on the pieces. How the idea works, why its three design choices matter, what the paper measured, and a miniature built and run on this blog's whole archive with a 3B model, against direct reading and a fixed map-over-chunks program.