githubnext/ace2Public

Ace: a collaborative coding environment on the team's own machines

Add native targeted scrolling #70

Mergediamnbutlermerged 6 commits intofeat/github-cachefromrefs/pull/70/head
  1. IA
    iamnbutler

    Adds `desktop_scroll` for an observed element or normalized screenshot point, with up/down/left/right direction and 1–20 native scroll units. It reuses exact snapshot/window authority, background delivery, and pi's unsafe-tool outcome handling. The request retains the snapshot's original focus evidence so a successfully delivered scroll's signed receipt verifies correctly.

    Part of #68 and #8. This focused diff preserves the landed click, app-search, and window-management tools. Drag work remains on `codex/desktop-drag` for a separate PR.

    Validation:

    - The signed `d9b0c869` candidate passed five real AppKit scrolls: element down, point down revealing initially offscreen content, element up, point right, and element left. - Real pi/Anthropic then performed inspect → element up1 → inspect. The receiver moved from 2063 to 1834; horizontal position and unrelated pointer state were unchanged. Exact tool text/images and usage survived reopening the same pi store without repeated input. - Final extracted head `f1682d028a9f810c93c103286949c1ad69c8ef13` passed type checks, formatting/lint, Swift parsing, diff checks, and independent source review. The scroll implementation is unchanged from the signed candidate; no new signed build was made for the extraction/base integration.

    Hosted workspace execution, worker-crash replay, self-Ace scrolling, multi-display/Retina/second-machine behavior, and the later invalid/moved-window checks remain unverified. Pixels-only observations do not provide reusable pointer authority. #68 stays open for those checks and the remaining drag scope.

    ### Built in Ace

    Git/GitHub operations, checks, signed candidate/fixture builds, and committed-range review ran in a dedicated Ace terminal. The extraction was also reviewed through Ace's changes/patch APIs. Native and real-provider checks used Ace's signed bridge, actual tool schema/host adapter, and real receiver state.

    Codex's external file/command tools handled source edits, log/receipt inspection, temporary helper preparation, and review coordination because Ace lacks external harness integration (#9) and a file-editing surface (#22).

  2. iamnbutlerreferenced this in Finish native pointer delivery and validation #68last month on GitHub

  3. iamnbutlerreferenced this in [Meta] Complete native computer use in Ace #8last month on GitHub

  4. iamnbutlerreferenced this in Explain native inspection failure when the desktop or target window becomes unavailable #64last month on GitHub

  5. iamnbutlerreferenced this in Preserve literal newlines when inserting text into web composers #76last month on GitHub

  6. iamnbutlerreferenced this in Add literal desktop insertion with reserved clipboard ownership #67last month on GitHub

  7. IAfeat(desktop): add native clicks, scrolling, and drags0029579

  8. iamnbutlerhead-ref-force-pushed 0029579a4037last month on GitHub

  9. iamnbutlerbase-ref-changedlast month on GitHub

  10. IAchore(desktop): preserve merged native inspection tools1d8e874
  11. IAfix(desktop): retain snapshot focus in scroll receipts3be7ef1
  12. IAchore: merge landed click tools into pointer workd9b0c86

  13. iamnbutlerrenamed Add native pointer clicks, scrolling, and atomic drags to Add native scrolling and atomic dragslast month on GitHub

  14. IAfeat(desktop): focus pointer delivery on validated scrolling9e42957
  15. IAchore: integrate app search and window management into scroll toolsf1682d0

  16. iamnbutlerrenamed Add native scrolling and atomic drags to Add native targeted scrollinglast month on GitHub

  17. iamnbutlerready-for-reviewlast month on GitHub

  18. iamnbutlermerged 44312423ce66last month on GitHub

  19. iamnbutlerclosedlast month on GitHub

  20. iamnbutlerreferenced this in Land desktop inspection/actions and tab API from feat/github-cache #89last month on GitHub