ciregenz
3ac55520d6
[eric] browser: the upload tool also finds inputs inside shadow roots and embedded frames, and a refused path names the exact staging copy that unblocks it (ENG-47)
2026-08-11 20:22:10 -07:00
ciregenz
ba97d141ee
[eric] browser: agents can attach a file to an upload field without the OS picker; the path is allow-listed backend-side so a hostile page cannot turn it into exfiltration (ENG-47)
2026-08-11 20:10:36 -07:00
ciregenz
2d5f35ad6e
[eric] browser: agent commands restore the user's typing focus, so a running browser agent stops yanking the cursor out of the composer
2026-08-10 08:27:12 -07:00
ciregenz
43e1028123
[eric] browser: agent screenshots stop yanking the user's camera, an offscreen card degrades to reading tools
2026-08-04 16:43:14 -07:00
ciregenz
21aa26fa15
[eric] browser: click the box for real before typing, so a strict editor has a cursor
2026-08-02 16:09:48 -07:00
ciregenz
fc99c11f05
[eric] browser: fill a strict editor over CDP, since sendInputEvent never once landed
2026-08-02 07:59:06 -07:00
ciregenz
f9dfe0c164
[eric] browser: keep an agent's browser on screen, or Chromium draws no frame to screenshot
2026-07-31 22:01:46 -07:00
ciregenz
d365f73744
[eric] browser: bound capturePage so a wedged screenshot fails honestly instead of hanging the command
2026-07-31 19:52:56 -07:00
ciregenz
c826d2b614
[eric] browser: a slow command reports whether the wait was before its handler or inside it
2026-07-31 18:43:20 -07:00
ciregenz
b4dd37ea21
[eric] browser: one source for the field flash, so intent and outcome cannot drift
2026-07-31 15:54:04 -07:00
ciregenz
99642c3be6
[eric] browser: flash a field green when its value is verified, red when it never landed
2026-07-31 15:34:29 -07:00
ciregenz
d542b1814b
[eric] browser: fill a custom editor with real keystrokes when synthetic input is ignored
2026-07-31 13:03:58 -07:00
ciregenz
4f4d5e8d55
[eric] browser: the read script asks for the whole page, not the model loop's smaller default
2026-07-31 00:02:57 -07:00
ciregenz
3d5c287139
[eric] merge: bring eric/browser onto eric/dev (30 conflicts resolved, gates green)
2026-07-30 13:18:11 -07:00
ciregenz
8b9eff4104
[eric] browser: lazy-load background tabs (only the active tab loads; agent/activation wakes deferred tabs)
2026-07-19 17:58:44 -07:00
ciregenz
46b67adab7
[eric] browser: agent key presses dispatch via CDP, scoped to the webview not the user's cursor
2026-07-19 15:27:57 -07:00
ciregenz
3652ad567d
[eric] browser: unwedge stuck-loading webviews (executeJavaScript queues until load stops; recaptcha/tracker stragglers held isLoading for minutes = every command timed out); guarded eval stops stragglers only after dom-ready
...
(cherry picked from commit 46c300e4ee
2026-07-15 23:31:11 -07:00
ciregenz
c04a663996
[eric] browser-bridge: /api/browser-session/action + renderer perform_action + shim client
2026-06-30 17:19:58 -07:00
ciregenz
63c32554ae
[eric] mcp: reddit session-borrow MCP (free, full human action set; WIP)
2026-06-29 23:05:15 -07:00
ciregenz
8eb48dfc42
[eric] app-use: strip pierre's transient [app-agent] trace scaffolding + write-only controls cache (no speculative scaffolding)
2026-06-29 23:03:45 -07:00
SirKentut
75df12a1b7
[pierre] feat: merge app-use (OPENSWARM_APP bridge + AppAgent) onto eric/dev, convention-clean
...
Brings the app-use feature (OPENSWARM_APP bridge, AppAgent delegation tool,
BrowserClickPoint, autopilot supervision) onto the linted eric/dev base.
- Resolved 9 conflicts favoring eric's refactored structure; renamed all of
pierre's _-prefixed names to p_/P_, kept eric's prior_messages resume guard.
- Made the 4 test-exercised bridge helpers public (p-private rule).
- Wired AppAgent into browser_delegation_tools + BuiltinTool registry and
threaded selected_app_output_ids -> OPENSWARM_SELECTED_APP_IDS (eric had
forward-ported the prompt but not the tool, so it was unreachable).
- Linter clean (underscore/p-private/ruff/cycles 0); 301 backend tests pass.
2026-06-26 02:44:10 -07:00
ciregenz
52464e66ee
[eric] frontend: one-line every // comment + collapse 3+ blank runs across frontend/src (161 files, -1652 lines, TS-AST-verified code-identical)
2026-06-25 04:20:41 -07:00
SirKentut
edd018cb4c
[pierre] feat: handle click_point via native CDP mouse event in browser command handler
2026-06-18 02:35:25 -07:00
SirKentut
b498ed3097
implemented app-describe for agent use: exposing the command tree of an app
2026-06-13 01:01:11 -07:00
Aidan and GitHub
3f4d91d8b4
[aidan] bug: cross-origin iframe perception + spawned card end UX ( #78 )
...
Browser sub-agents can now drive Google Drive’s share-doc flow end to end: same-process cross-origin iframes (the share dialog) are visible through a frame-tree-aware AX walk, and combobox autocomplete fields fill in one click_index call via DOM.focus + Input.insertText. When a spawned browser card’s agent finishes, the card now fades through a “Task done” pill with a Keep button for ~3s instead of snapping out, so the user sees what happened.
2026-06-13 00:58:44 -07:00
ciregenz
b8a0c0814c
[eric] dashboard: suspend offscreen browser webviews to a snapshot, cuts RAM/CPU at scale
2026-06-09 14:06:18 -07:00
ciregenz
1480fddf51
[eric] browser: replay clicks scroll-and-retry when off-screen, long names resolve by stable prefix
2026-06-05 17:21:50 -07:00
ciregenz
0992e25bf2
[eric] browser: numbered index overlays on screenshots, vision and clicks share one index language
2026-06-05 11:03:20 -07:00
ciregenz
059185dd4b
[eric] browser: kill the double-fill, textbox rows show live value, typing echoes verified read-back, expect demands literal page text
2026-06-05 10:29:12 -07:00
ciregenz
c0ff256afd
[eric] browser: ctx-tagged twin rows + stable indices across looks in list_interactives
2026-06-05 00:46:24 -07:00
ciregenz
05fa871b24
[eric] browser: occlusion filter + containment dedup + new-element markers, click flash, request-id dedupe
2026-06-04 23:03:20 -07:00
ciregenz
b02aecbb58
[eric] browser: hit-test clicks before dispatch and verify typed text, honest fallbacks for both
2026-06-04 19:04:38 -07:00
ciregenz
53ffe92c14
[eric] browser: return navigate on dom-ready so heavy SPAs stop hanging the 20s cap
2026-06-04 18:40:06 -07:00
ciregenz
f7ac55660a
[eric] browser: bound AX perception and cap the tracker-iframe walk so a busy page fails clearly, not silently
2026-06-04 17:15:29 -07:00
ciregenz
f03dde7e0c
[eric] browser: focus text boxes by node and insert text directly, reaches compose iframes clicks miss
2026-06-04 16:38:56 -07:00
ciregenz
f0144690af
[eric] browser: end the wait on the target or DOM-settle, not network-idle, so it stops waiting blind
2026-06-04 14:57:38 -07:00
ciregenz
2640930380
[eric] browser: add BrowserGetConsole so a stuck agent can read the page's console errors
2026-06-04 13:20:39 -07:00
ciregenz
5dcdc88005
[eric] browser: abort a batch on the first failed sub-action, not just on navigation
2026-06-04 12:10:09 -07:00
ciregenz
27686e270b
[eric] browser: settle-aware in-batch wait and a terminal read sub-action
2026-06-04 04:04:44 -07:00
ciregenz
a562a5c3c3
[eric] browser: prune stale screenshots + capture downscaled JPEG to cut agent context cost
2026-06-03 22:17:05 -07:00
ciregenz
f121fa442c
[eric] browser: surface a redacted concrete route example so the agent can compose replay_route with {{value}}
2026-06-03 13:17:57 -07:00
ciregenz
50230c88c5
[eric] browser: also sample route count on evaluate (the agent's real read path), not just get_text
2026-06-03 02:11:11 -07:00
ciregenz
7175f4b27b
[eric] browser: sample captured-route count on read, not navigate, so the network nudge actually fires
2026-06-03 02:05:11 -07:00
ciregenz
21b225ded4
[eric] browser: nudge the agent toward the fast captured-API tier once per host
2026-06-03 00:50:23 -07:00
ciregenz
e911898387
[eric] browser: add robust click_by_name and share enumerate/click helpers
2026-06-02 12:43:21 -07:00
ciregenz
54249bc015
[eric] browser: retry cold screenshot capture to dodge the turn-0 viz race
2026-06-02 12:27:28 -07:00
ciregenz
15781d2a3b
[eric] browser: list captured routes and replay safe GETs to skip the UI (tier 2)
2026-06-02 04:11:50 -07:00
ciregenz
6e006dd472
[eric] browser: detect a page's declared WebMCP tools (tier 1)
2026-06-02 04:03:10 -07:00
ciregenz
21360cd2ea
[eric] browser: rank/cap/goal-boost the element list and click into cross-origin iframes
2026-06-02 03:55:58 -07:00
eric
6a2b55f23b
[eric] browser: wait briefly for webview re-register before card-not-found to absorb the remount race
2026-06-01 11:55:17 -07:00
ciregenz