GUI agent (graphical user interface agent)

An agent that interacts with software by reading the screen (screenshots) and sending inputs: taps, swipes, typing. Instead of calling APIs, the agent uses the interface the way a human would — typically via Android accessibility services or desktop automation. It is the path to agents that can use apps that expose no API.