SAGE, an academic GUI-agent framework, explores an app to build a deduplicated graph of interface states, creates task trajectories without manual annotation, and trains a model to decide whether stored priors should be followed, used partially or ignored after an interface changes. Across 20 Android apps, the authors report about 148 deduplicated screens and 28 activities in 600 exploration steps, versus roughly 101 screens and 10 activities for LLM-Explorer in 1,500 steps. On 144 online tasks, the reliability gate improved success by 2.78 to 13.90 percentage points over supervised fine-tuning, depending on the setting. It did not erase the problem: imperfect priors still reduced completion on AndroidWorld.
A question for designCould an agent expose when prior knowledge is being followed, partially used or ignored before touching a changing interface?*3