The biggest issue with RLM is the loss of context as you descend the call graph. Adjacent stack frames generally don't have any issues. It's the transitive loss of context that begins to get messy. When you have more than two stack frames on top of each other you will start to see this effect. The model loses track of the original goal and has a tendency to drill into a stack overflow.
I've never seen an RLM harness work very well beyond a recursive depth of 1, which is precisely what this paper is constrained to as well.
killerstorm · · focus · HN ↗
bob1029 · · focus · HN ↗
I've never seen an RLM harness work very well beyond a recursive depth of 1, which is precisely what this paper is constrained to as well.