Unlocking Working Memory of LLMs for Latent Reasoning

arXiv·high signal

Introduces Reasoning in Latent Space, where LLMs use internal working memory to manipulate information without externalizing chain-of-thought tokens. Decouples reasoning computation from autoregressive generation, inspired by human cognitive architecture. Could significantly reduce token costs for reasoning tasks while maintaining or improving accuracy.