Converting GUI Trajectories Into Replayable MCP-Style Calls Instead of Unstructured Memories
EchoPath (arXiv 2609.16635, submitted 15 Sep 2026) is a model-agnostic harness that turns artifact-validated GUI trajectories into standardized, parameter-controlled callable memories shaped like MCP tool calls rather than experience records. Each memory carries task-intent keys, application and state preconditions, flexible input parameters, GUI evidence, validation provenance, and lifecycle state, so the host agent invokes a stored procedure only when it can be deterministically replayed in the current runtime. The enabling mechanism is an image-based target-reaiming algorithm that treats stored coordinates as visual evidence rather than fixed positions, aimed at enterprise loops that repeatedly update records, process forms, and export reports.
↳ Follow the thread