The Claim
- Researchers posted RECAP (REdundancy-aware Credit Assignment via Propagation) to arXiv CS.CL, describing a method to cut unnecessary steps from large reasoning models' outputs without hurting correctness (arXiv). It assigns step-level credit using two signals: structural responsibility, which measures how much later steps depend on an earlier one via an LLM-annotated semantic dependency graph, and step efficacy, which tracks changes in gold-answer log-likelihood as each step is added (arXiv). These reshape rollout-level GRPO advantages into step-specific updates (arXiv). Notably, the method requires no separately trained process reward model and no preconstructed concise reasoning traces (arXiv). [1]
Reported Results and Caveats
- On two 7B models across four math reasoning benchmarks, the authors report RECAP improves the accuracy-efficiency trade-off (arXiv). On Qwen2.5-Math-7B, they claim pass@1 gains of 2.0–3.7 percentage points alongside an 8%–31% reduction in reasoning tokens versus GRPO across all four benchmarks (arXiv). The paper's own analysis suggests the savings come from fewer reasoning operations and less dead-end reasoning, not just more compact phrasing (arXiv). These are the authors' reported results; independent replication is not part of the evidence. [1]
Sources
- Giving Credit Where It's Due: Redundancy-Aware Learning for Efficient Reasoning
ArXiv CS.CL (Computation and Language) · Reporting ·