githubnext/ace2Public

Ace: a collaborative coding environment on the team's own machines

Inspect Chrome windows with Accessibility when the page title changes

IA

iamnbutler opened ·

While smoke-testing a timeline fix in channel streaming-message-overlap, `desktop_inspect` in accessibility mode failed repeatedly on a Google Chrome window (window 474, title "Ace") that pixels mode captured fine:

``` DESKTOP_ERROR: The desktop observation provider returned inconsistent response evidence: window-context window title.. ```

At the time (before #156), without an action snapshot the agent could not click into the app, so the smoke test moved to a Playwright-driven Chrome for Testing outside Ace's tools.

## Status (Oct 6)

The Accessibility-mode title mismatch is not fixed; it reproduced again on Oct 6 ([details](https://github.com/githubnext/ace2/issues/113#issuecomment-6024262264)). #156 mitigates it for pointer input: pixel inspection now returns a single-use snapshot that authorizes exact-window point clicks, scrolls and drags. Element-based actions, text selection and insertion still need a working Accessibility snapshot.

Part of #8.

  1. iamnbutlerreferenced this in fix(app): stream the reply draft inside the timeline instead of over it #114last month on GitHub

  2. iamnbutlerreferenced this in feat(host): show GitHub avatars for participants #116last month on GitHub

  3. iamnbutlerreferenced this in fix(ui): align timeline avatars with the sender's byline #127last month on GitHub

  4. IA
    iamnbutler
    Author

    Reproduced while smoke-checking #149 in Google Chrome PID 62587, window 8673 (a standalone Ace window at the isolated source host on port 4342). Two accessibility inspections returned inconsistent response evidence: window-context window title. Pixel inspection succeeded and showed the loaded app, but could not provide action authority. No input was dispatched.

  5. iamnbutlerreferenced this in Add All Projects channel view #149last month on GitHub

  6. iamnbutlerreferenced this in [Meta] Dogfood Ace end to end #5last month on GitHub

  7. iamnbutlerreferenced this in Explain native inspection failure when the desktop or target window becomes unavailable #64last month on GitHub

  8. iamnbutlerreferenced this in [Meta] Complete native computer use in Ace #8last month on GitHub

  9. iamnbutlerparent-issue-addedlast month on GitHub