ciregenz
4f4d5e8d55
[eric] browser: the read script asks for the whole page, not the model loop's smaller default
2026-07-31 00:02:57 -07:00
ciregenz
3d5c287139
[eric] merge: bring eric/browser onto eric/dev (30 conflicts resolved, gates green)
2026-07-30 13:18:11 -07:00
ciregenz
8b9eff4104
[eric] browser: lazy-load background tabs (only the active tab loads; agent/activation wakes deferred tabs)
2026-07-19 17:58:44 -07:00
ciregenz
46b67adab7
[eric] browser: agent key presses dispatch via CDP, scoped to the webview not the user's cursor
2026-07-19 15:27:57 -07:00
ciregenz
3652ad567d
[eric] browser: unwedge stuck-loading webviews (executeJavaScript queues until load stops; recaptcha/tracker stragglers held isLoading for minutes = every command timed out); guarded eval stops stragglers only after dom-ready
...
(cherry picked from commit 46c300e4ee
2026-07-15 23:31:11 -07:00
ciregenz
c04a663996
[eric] browser-bridge: /api/browser-session/action + renderer perform_action + shim client
2026-06-30 17:19:58 -07:00
ciregenz
63c32554ae
[eric] mcp: reddit session-borrow MCP (free, full human action set; WIP)
2026-06-29 23:05:15 -07:00
ciregenz
8eb48dfc42
[eric] app-use: strip pierre's transient [app-agent] trace scaffolding + write-only controls cache (no speculative scaffolding)
2026-06-29 23:03:45 -07:00
SirKentut
75df12a1b7
[pierre] feat: merge app-use (OPENSWARM_APP bridge + AppAgent) onto eric/dev, convention-clean
...
Brings the app-use feature (OPENSWARM_APP bridge, AppAgent delegation tool,
BrowserClickPoint, autopilot supervision) onto the linted eric/dev base.
- Resolved 9 conflicts favoring eric's refactored structure; renamed all of
pierre's _-prefixed names to p_/P_, kept eric's prior_messages resume guard.
- Made the 4 test-exercised bridge helpers public (p-private rule).
- Wired AppAgent into browser_delegation_tools + BuiltinTool registry and
threaded selected_app_output_ids -> OPENSWARM_SELECTED_APP_IDS (eric had
forward-ported the prompt but not the tool, so it was unreachable).
- Linter clean (underscore/p-private/ruff/cycles 0); 301 backend tests pass.
2026-06-26 02:44:10 -07:00
ciregenz
52464e66ee
[eric] frontend: one-line every // comment + collapse 3+ blank runs across frontend/src (161 files, -1652 lines, TS-AST-verified code-identical)
2026-06-25 04:20:41 -07:00
SirKentut
edd018cb4c
[pierre] feat: handle click_point via native CDP mouse event in browser command handler
2026-06-18 02:35:25 -07:00
SirKentut
b498ed3097
implemented app-describe for agent use: exposing the command tree of an app
2026-06-13 01:01:11 -07:00
Aidan and GitHub
3f4d91d8b4
[aidan] bug: cross-origin iframe perception + spawned card end UX ( #78 )
...
Browser sub-agents can now drive Google Drive’s share-doc flow end to end: same-process cross-origin iframes (the share dialog) are visible through a frame-tree-aware AX walk, and combobox autocomplete fields fill in one click_index call via DOM.focus + Input.insertText. When a spawned browser card’s agent finishes, the card now fades through a “Task done” pill with a Keep button for ~3s instead of snapping out, so the user sees what happened.
2026-06-13 00:58:44 -07:00
ciregenz
b8a0c0814c
[eric] dashboard: suspend offscreen browser webviews to a snapshot, cuts RAM/CPU at scale
2026-06-09 14:06:18 -07:00
ciregenz
1480fddf51
[eric] browser: replay clicks scroll-and-retry when off-screen, long names resolve by stable prefix
2026-06-05 17:21:50 -07:00
ciregenz
0992e25bf2
[eric] browser: numbered index overlays on screenshots, vision and clicks share one index language
2026-06-05 11:03:20 -07:00
ciregenz
059185dd4b
[eric] browser: kill the double-fill, textbox rows show live value, typing echoes verified read-back, expect demands literal page text
2026-06-05 10:29:12 -07:00
ciregenz
c0ff256afd
[eric] browser: ctx-tagged twin rows + stable indices across looks in list_interactives
2026-06-05 00:46:24 -07:00
ciregenz
05fa871b24
[eric] browser: occlusion filter + containment dedup + new-element markers, click flash, request-id dedupe
2026-06-04 23:03:20 -07:00
ciregenz
b02aecbb58
[eric] browser: hit-test clicks before dispatch and verify typed text, honest fallbacks for both
2026-06-04 19:04:38 -07:00
ciregenz
53ffe92c14
[eric] browser: return navigate on dom-ready so heavy SPAs stop hanging the 20s cap
2026-06-04 18:40:06 -07:00
ciregenz
f7ac55660a
[eric] browser: bound AX perception and cap the tracker-iframe walk so a busy page fails clearly, not silently
2026-06-04 17:15:29 -07:00
ciregenz
f03dde7e0c
[eric] browser: focus text boxes by node and insert text directly, reaches compose iframes clicks miss
2026-06-04 16:38:56 -07:00
ciregenz
f0144690af
[eric] browser: end the wait on the target or DOM-settle, not network-idle, so it stops waiting blind
2026-06-04 14:57:38 -07:00
ciregenz
2640930380
[eric] browser: add BrowserGetConsole so a stuck agent can read the page's console errors
2026-06-04 13:20:39 -07:00
ciregenz
5dcdc88005
[eric] browser: abort a batch on the first failed sub-action, not just on navigation
2026-06-04 12:10:09 -07:00
ciregenz
27686e270b
[eric] browser: settle-aware in-batch wait and a terminal read sub-action
2026-06-04 04:04:44 -07:00
ciregenz
a562a5c3c3
[eric] browser: prune stale screenshots + capture downscaled JPEG to cut agent context cost
2026-06-03 22:17:05 -07:00
ciregenz
f121fa442c
[eric] browser: surface a redacted concrete route example so the agent can compose replay_route with {{value}}
2026-06-03 13:17:57 -07:00
ciregenz
50230c88c5
[eric] browser: also sample route count on evaluate (the agent's real read path), not just get_text
2026-06-03 02:11:11 -07:00
ciregenz
7175f4b27b
[eric] browser: sample captured-route count on read, not navigate, so the network nudge actually fires
2026-06-03 02:05:11 -07:00
ciregenz
21b225ded4
[eric] browser: nudge the agent toward the fast captured-API tier once per host
2026-06-03 00:50:23 -07:00
ciregenz
e911898387
[eric] browser: add robust click_by_name and share enumerate/click helpers
2026-06-02 12:43:21 -07:00
ciregenz
54249bc015
[eric] browser: retry cold screenshot capture to dodge the turn-0 viz race
2026-06-02 12:27:28 -07:00
ciregenz
15781d2a3b
[eric] browser: list captured routes and replay safe GETs to skip the UI (tier 2)
2026-06-02 04:11:50 -07:00
ciregenz
6e006dd472
[eric] browser: detect a page's declared WebMCP tools (tier 1)
2026-06-02 04:03:10 -07:00
ciregenz
21360cd2ea
[eric] browser: rank/cap/goal-boost the element list and click into cross-origin iframes
2026-06-02 03:55:58 -07:00
eric
6a2b55f23b
[eric] browser: wait briefly for webview re-register before card-not-found to absorb the remount race
2026-06-01 11:55:17 -07:00
ciregenz
f59bf0db9b
defluff (frontend + backend): strip em-dashes + shorten docstrings + drop dead UI files (cosmetic only, no schedule code)
2026-05-20 05:36:17 -07:00
ciregenz
1dad8a57fc
[eric] browser sub-agent: loop detection, ReportProgress, CDP ax tree, batching, compaction, hide-don't-unmount Dashboard so browser cards survive route navigation
2026-04-07 20:00:32 -07:00
haikdc
9943ccafd5
[Haik]: (Agent browser render size matches that of user browser spawn) (queing messages) (chat loading bubble fix) (tethers to sub agents and branches are now permament and inputs are swapped to a continue chat button) (auto focus for everything) (history card position fix when redeployed) (dashboard persistance fixed) (non browser link clicks open in the in app browser now) (chat message tooltips for copy, branching, and editing / swapping between edited messages)
2026-03-18 23:45:54 -07:00
haikdc
6e1fc1dee2
[Haik]: ckpt (Round 1 of fixing mcp server issues in prod - still has bugs) (Fixed some browser related issues like popup windows rendering out of app and weird js framework related errors when u open sites like spotify) (Added option in settings to toggle item selection to be on by default when selecting a new chat) (Browser agent actions now show up in chat output) (Browser agent actions each have their own custom icon)
2026-03-17 23:52:20 -07:00
haikdc
1717d456cf
[Haik]: (Now u can rename the dashboards via the sidebar) (Default system prompt - and a button to reset to the default if u ever modify it) (Completely revamped dashboard icon, when clicked it expands to show all active items in the dashboard, when u click an item, it jumps to it auto focussing) (this auto focus jump also has a custom animation and highlighting)
2026-03-16 03:56:18 -07:00
haikdc
e6f1e18054
[Haik]: ckpt, this is a big one babayyy (dashboards now show screenshot previews of their contents like Apps) (Views are now called Apps) (Tools are called Actions) (Auto layout now preserves sizing and just works much better) (Browsers and Apps have larger spawn in size) (Tutorial info for how to get an anthropic key to help users - in the settings) (Added Descriptions to all 3 Main Pages in Navbar) (Also reorganized navbar and made it resizable) (Browsers now support multiple tabs) (Move the Commands page to settings - also beefed up settings a bit to encapsulate more) (Added inner glow on browser) (Added inputs in header of browser to act like normal google search)
2026-03-16 03:08:58 -07:00
haikdc
08cab727a1
[Haik]: ckpt (shld have fixed tool mcp discovery in prod - but untested) (Added browser control animations) (Made browser top input function as search) (swapped run.sh to not open up site locally in addition to the electron app)
2026-03-16 00:27:34 -07:00
haikdc
87ef21919f
[Haik]: Browser control
2026-03-15 19:54:23 -07:00
ciregenz