Commit Graph
146 Commits
Author SHA1 Message Date
ciregenz b61a653180 [eric] updater: name the failures a user can fix instead of telling them to try again later 2026-07-31 15:59:34 -07:00
ciregenz bce7e1f072 [eric] voice: Settings model picker with verified downloads; report fast whisper exits 2026-07-31 00:03:27 -07:00
ciregenz 664608b4a8 [eric] voice: warm whisper at boot, unload when idle, and stop guessing the server port 2026-07-30 21:49:16 -07:00
ciregenz fe29551d74 [eric] voice: native trackpad haptics addon (NSHapticFeedbackManager, mouseclamp pattern) taps on dictation start/stop 2026-07-28 15:01:59 -07:00
ciregenz 85828f5854 [eric] voice: native uiohook key tap gives keyboard true hold-to-talk on mac and windows, toggle fallback preserved 2026-07-26 21:11:07 -07:00
ciregenz c1edad623c [eric] help: full panel (Discord, what's new, attachments) + local diagnostics bundle revealed for the GitHub issue 2026-07-24 13:04:16 -07:00
ciregenz e7084cc085 [eric] voice: F5 mic key as the simple hotkey, remove the activation sounds 2026-07-24 12:53:53 -07:00
ciregenz 1441c52b3a [eric] voice: hotkey press-to-start/stop via main input relay (mac hides key releases; buttons keep true hold), drop status bubbles, hide built-in skills from flyout 2026-07-24 12:49:07 -07:00
ciregenz f212534ccf [eric] voice: hold-to-talk (setting + buttons + in-app hotkey), insert-at-focus, aurora + sound cues 2026-07-23 18:39:38 -07:00
ciregenz 237e8f90b2 [eric] voice: wire both mics (help pill + spawn composer) to one shared recorder + first-run model download 2026-07-21 23:35:20 -07:00
ciregenz 7baba619cf [eric] voice: local whisper.cpp dictation engine (warm whisper-server + transcribe/inject/hotkey IPC) 2026-07-21 23:06:58 -07:00
ciregenz 70545a3fa3 [eric] electron: native right-click menu for the app renderer (copy/cut/paste/select-all, copy-link, spelling) 2026-07-21 22:33:24 -07:00
ciregenz 0b19797f7f [eric] desktop: traffic lights everywhere (browser green+tiling, pill hover chips, arc app lights), fullscreen dark+full+dock-switcher, knob drag, dock glyphs, rest composer removed 2026-07-20 21:42:24 -07:00
ciregenz 9362e0fe3e [eric] desktop: dock gains the og toolbar actions (chat/browser/workflow/note/history); Applications no longer kills the app (getFileIcon native throw SIGTRAPped main; icons now decode via defaults+sips children) 2026-07-20 18:36:00 -07:00
ciregenz 96c6c8e2aa [eric] dashboard: revert to the og eric/onboarding canvas background (gradient wash + grain + dot grid); wallpaper layer and its IPC removed 2026-07-20 17:48:07 -07:00
ciregenz 355c07a7dc [eric] desktop: per-card dock glyphs and hues; real OS wallpaper read at runtime (SVG fallback) 2026-07-20 14:18:58 -07:00
ciregenz 01e73caef7 Merge branch 'eric/dev' into eric/redesign
# Conflicts:
#	backend/apps/agents/manager/run/RunOptions.py
#	electron/main.js
#	frontend/src/app/pages/Dashboard/canvas/DashboardCanvas.tsx
#	frontend/src/app/pages/Dashboard/cards/BrowserCard.tsx
#	frontend/src/app/pages/Dashboard/cards/DashboardViewCard.tsx
#	frontend/src/app/pages/Dashboard/hooks/lifecycle/useDashboardLifecycle.ts
2026-07-19 21:40:18 -07:00
ciregenz 043ed3ff64 [eric] dashboard: Applications launcher window (real /Applications via scan, electron icons+launch, category chips) + dock tile 2026-07-19 21:13:02 -07:00
ciregenz 56db0394a7 [eric] dev: OPENSWARM_DEV_PORT overrides the dev webpack port so parallel worktrees don't collide on :3000 2026-07-19 18:52:46 -07:00
ciregenz 0c473e995c [eric] electron: OPENSWARM_DEV_URL override so a worktree stack can run its own dev Electron 2026-07-19 13:49:02 -07:00
ciregenz 735c7eedae [eric] updater: idle-install waits out imminent scheduled workflows + fires an analytics breadcrumb 2026-07-19 12:21:20 -07:00
ciregenz 2d499f8316 [eric] onboarding: offscreen real-browser harvest with injected cookies (beats Cloudflare, unifies providers) 2026-07-16 00:33:28 -07:00
ciregenz 2e3de37a54 [eric] onboarding: harvest subscription history silently offscreen (no card, no extra login step) 2026-07-15 18:40:40 -07:00
ciregenz 91a603ce96 [eric] conventions: strip em-dashes from app runtime contract; de-prefix cross-file affiliate exports 2026-07-12 18:39:18 -07:00
ciregenz 026d491722 [eric] merge #124: bind installs from stamped installer filenames; unify install id (aidan) 2026-07-12 18:37:57 -07:00
abccodes fb89324462 [aidan] chore/affiliate-attribution: align private names and trim comments 2026-07-10 19:31:35 -07:00
abccodes c7004c9878 [aidan] feat/affiliate-ids: unify install identity across electron and python backend
Electron resolves ONE install id before spawning the backend (install.json
app_install_id -> python settings installation_id -> fresh uuid) and exports
it as OPENSWARM_INSTALLATION_ID; the backend adopts it when settings has no
installation_id yet. The affiliate app_install_id and the analytics
install_id are now the same value, so affiliate refs join directly to
telemetry with no sign-in required. Drops the frontend app_install_id
forwarding through sign-in flows; the desktop auth router forwards
settings.installation_id as install_id instead.
2026-07-10 18:09:26 -07:00
ciregenz 161c65cdcd [eric] browser: Chrome-style suspend capsules (sessionStorage+scroll survive), last-visible-frame snapshots, 20s working grace 2026-07-07 22:52:28 -07:00
ciregenz 0c74183600 [eric] web: offscreen-browser fetch/search tier (renders JS pages httpx can't; real fingerprint dodges the DDG throttle) 2026-07-07 15:04:31 -07:00
ciregenz 3d62a3c4cd [eric] merge origin/eric/dev into eric/mcp (1.5.4 line + Sonnet 5 under the social MCPs) 2026-07-02 16:07:51 -07:00
ciregenz 169eb0db8a [eric] browser-bridge: serve cookie reads from Electron main (fixes backgrounded timeouts) 2026-07-01 23:50:17 -07:00
ciregenz 7f48d07bf4 [eric] app-use: scope OPENSWARM_APP bridge to app webviews, drop per-page console.warn
Was injected into every browser card (a window.OPENSWARM_APP bot tell) and went win32-only after the passkey commit; now app-webviews-only on all platforms.
2026-06-30 02:12:49 -07:00
ciregenz 63c32554ae [eric] mcp: reddit session-borrow MCP (free, full human action set; WIP) 2026-06-29 23:05:15 -07:00
ciregenz e1639468a5 [eric] cleanup: convention fixes for merged #113/#107 (p-private rename, dead code, scratch files, em-dash, lint exceptions) 2026-06-29 21:52:53 -07:00
ciregenz 1b6d747326 [eric] merge #107 (pierre): app-use OPENSWARM_APP bridge + AppAgent
# Conflicts:
#	electron/main.js
#	frontend/src/app/pages/Views/ViewPreview.tsx
2026-06-29 21:34:11 -07:00
ciregenz dc2e9378e8 [eric] browser: stub window.chrome to match real Chrome (closes the empty-window.chrome bot tell) 2026-06-29 17:00:55 -07:00
ciregenz cfaddf1126 [eric] passkey: enable macOS Touch ID WebAuthn (electron 42.0.0->42.3.3 for the localizedReason crash fix + Developer ID provisioning profile + keychain entitlement; reject-shim now Windows-only) 2026-06-28 15:10:59 -07:00
ciregenz fc62986603 [eric] analytics: point packaged builds at analytics.openswarm.com (own public edge, bypasses the cloud billing core; old builds keep the api.openswarm.com relay) 2026-06-27 19:00:26 -07:00
ciregenz ffbbecc1dc [eric] browser: native right-click menu + spellcheck for browser webviews 2026-06-26 09:36:23 -07:00
ciregenz a76c44aeb7 [eric] browser: Ctrl/Cmd+Shift+T reopens the last closed card (browser/tab/agent/note/app/workflow) 2026-06-26 09:04:42 -07:00
ciregenz 4167a8c930 [eric] browser: zoom focused browser + Ctrl+F find + Ctrl+Tab cycle + middle-click bg tab 2026-06-26 08:25:00 -07:00
ciregenz b11f0cd58b [eric] browser: force the guest page-world to always report visible/foregrounded (main-world inject) so an off-screen kept-alive Discord doesn't background + drop its session = logout 2026-06-26 07:31:06 -07:00
ciregenz d0dd6ee32b [eric] browser: present webview as Google Chrome in client hints + headers, not bare Chromium (anti-bot tell) 2026-06-26 03:47:26 -07:00
SirKentut 75df12a1b7 [pierre] feat: merge app-use (OPENSWARM_APP bridge + AppAgent) onto eric/dev, convention-clean
Brings the app-use feature (OPENSWARM_APP bridge, AppAgent delegation tool,
BrowserClickPoint, autopilot supervision) onto the linted eric/dev base.

- Resolved 9 conflicts favoring eric's refactored structure; renamed all of
  pierre's _-prefixed names to p_/P_, kept eric's prior_messages resume guard.
- Made the 4 test-exercised bridge helpers public (p-private rule).
- Wired AppAgent into browser_delegation_tools + BuiltinTool registry and
  threaded selected_app_output_ids -> OPENSWARM_SELECTED_APP_IDS (eric had
  forward-ported the prompt but not the tool, so it was unreachable).
- Linter clean (underscore/p-private/ruff/cycles 0); 301 backend tests pass.
2026-06-26 02:44:10 -07:00
ciregenz ccd0bc3971 [eric] browser: Ctrl/Cmd+R reloads the last-interacted browser, else the app 2026-06-25 20:45:18 -07:00
SirKentut 42ad32ee6c [pierre] testing: frames show if autopilot is succesfully working 2026-06-25 19:53:25 -07:00
ciregenz 97a859e504 [eric] browser: Settings "Clear browsing data" wipes the browser partition only 2026-06-25 19:50:33 -07:00
ciregenz e5b69bfa00 [eric] browser: give cards a persistent partition so logins survive reload + quit 2026-06-25 19:33:49 -07:00
SirKentut a10617526a [pierre] feat: add __autopilot__ self-play bridge with slow-cadence agent supervision
Two-loop design for fast-twitch apps (Flappy, Doodle Jump) the agent cannot
react to frame-by-frame over the network: the bridge runs policy() at frame
rate as the reflex (inner loop), while the supervisor steers on a slow cadence
via getState and __autopilot__ knobs (outer loop). Wires this through the
webapp_template bridge, the shell-injected bridge in main.js, and the APP
system prompt. Also deny the 'fullscreen' permission so a preview webview's
HTML5 fullscreen no longer hijacks the whole OpenSwarm window.
2026-06-25 19:32:17 -07:00
3008f083ca [aidan] feat: scheduled tasks (#105)
* [eric] ci: gitleaks-ignore the known historical secrets so our branch stops failing on leaks it didnt add

* [eric] workflows: restore scheduled-tasks on the workflow line (revert removal, keep windows fixes + 1.1.69)

* [eric] workflows: re-apply uncommitted scheduling wip (schedule pill, calendar view, slice)

* [eric] ops: gitignore dev-team local state files

* [eric] ops: backlog item for download-tracking visibility

* [eric] ci: allowlist the cdp-routes redaction-test token in gitleaks

* [aidan] feat/scheduled-tasks: keep step labels in sync on edit and show chevron on every step

* [aidan] fix: schedule time in chat

* [aidan] ux/workflows: add workflow step removal (#91)

* [aidan] feat/scheduled-tasks: remember workflow tool permissions across runs

* [aidan] feat/task-scheduling: add hourly and minute (15-min minimum) schedule intervals (#93)

* [aidan] feat/scheduled-tasks: calendar, rename, and edit workflows (#94)

* [aidan] bug: fix schedule button

* [aidan] fix/agent-errors: surface provider rate limits

* [aidan] ux/cards: click-to-rename for chat and workflow titles

Single-click a card's title to enter edit mode inline. Commit on Enter/blur,
cancel on Escape. Rename persists via PATCH for workflows and sessions.

* [aidan] feat/workflows: seed build prompt for zero-step workflows

When a new workflow has no steps, seed the agent with a prompt asking
the user to describe what the workflow should do, rather than starting blank.

* [aidan] feat/workflows: add-to-schedule popover for unscheduled workflows

Clicking the "+" on an unscheduled workflow row opens a popover with two options:
- Keep this schedule: enables the workflow's existing cadence and moves it to Scheduled
- Change schedule: opens the scheduling editor to pick a different time

* [aidan] ux/workflows: wire add-to-schedule popover and simplify New button

- Made the "+" icon on unscheduled workflow rows clickable, opening a popover
  to keep or change the schedule
- Removed AddIcon from toolbar "New" button (now reads "New" instead of "+ New")

* [aidan] fix/scheduled-tasks: open schedule calendar when Schedule pill clicked

Fixed the Schedule pill click being swallowed by the toolbar's dismiss handler.
Exempted the toolbar pills via data-toolbar-pills so their click handlers fire.

* [aidan] ux/workflows: open New workflow in agent build chat instead of empty card

When creating a new workflow from the hub, open it in edit_agent view (with the
agent builder chat) instead of a preview card. The workflow is created on the
backend first so the embedded session has a real ID.

* [aidan] feat/workflow-edit: add draft testing save flow

* [aidan] ux/chat: remove continue chat button

* [aidan] ux/workflows: polish workflow card interactions

* [aidan] fix/workflow-scheduling: save unscheduled workflows as drafts

* aidan ui: schedule naming changes

* [aidan] ui: tool calling desc/naming

* [aidan] ui: calendar sidebar naming

* [aidan] ui: fix stop viewing closing chat

* [aidan] feat/workflows: auto-name workflows and polish the build flow (#95)

* [aidan] feat/workflow-auto-naming: auto-generate workflow titles from steps

Generate a title + description from a workflow's steps (one aux call,
reused for step labels) whenever it is still auto_named, so a workflow
built in the Edit Agent names itself on commit instead of staying
"New workflow". A manual rename sets auto_named=False and is never
overwritten. Stream the aux call (non-streaming drops content on some
9router lanes) and fall back to a step-derived title when the model is
unavailable.

* [aidan] feat/workflows: hide unsaved new workflows until first save

A brand-new "+ New" workflow is created with unsaved=true and kept out
of the hub's scheduled/unscheduled lists while the user is still building
it in the Edit Agent. The first commit (Save) clears the flag and the
workflow appears. Every other create path stays visible immediately.

* [aidan] ux/workflows: remove redundant save workflow button

The Edit Agent already has Discard/Save controls in its strip, so the
header "Save Workflow" button was a duplicate save path. Remove it and
its pulse/edit-session-id wiring; the model/time subtitle stays.

* [aidan] ux/workflows: animate title on auto-rename

Wrap the workflow card title in the same Typewriter the chat card uses,
so when the auto-generated name replaces the placeholder after Save it
retypes letter-by-letter. Gated on a real (non-placeholder) title so it
never animates on mount or for already-named workflows.

* [aidan] ux/workflows: animate sidebar title on auto-rename

Wrap the calendar hub's sidebar row title in the same Typewriter the
workflow card uses, so a title that auto-renames retypes letter-by-letter
in the sidebar too. Extract the placeholder/isRealTitle guard into the
shared workflowVisuals so the card and sidebar stay in sync.

* [aidan] fix/workflows: connect watch tether, keep watched chat open, wire draft run/history

* [aidan] ui: grey out chat pill when not selected

* [aidan] ui: fix running agent display

* [aidan] feat/history-popover: add chat history and scheduled tasks run log tabs (#96)

* [aidan] ux/schedule: toast when calendar view already open on expand

* [aidan] ui: fix popover descs

* [aidan] feat/workflow-runs: add pause, resume, and stop controls for live runs

* [aidan] feat/schedule-calendar: add calendar occurrences endpoint and concrete timezones

* [aidan] feat/workflows: require at least one step to save a workflow

* [aidan] ux/edit-agent: hide Discard for an unsaved new workflow

* [aidan] ux/edit-agent: move fix-prefix card below the step list

* [aidan] feat/workflows: toast when an unattended scheduled run starts

* [aidan] fix/dashboard-tethers: anchor workflow-sidecar tethers to measured card rects

* [aidan] feat/workflows: validate steps before scheduling and keep chat tool memory

* [aidan] feat/mcp-suggestions: dismissable integration banner with per-session cooldown

* [aidan] feat/workflows: add scheduled-run "running now" toast with click-to-view (#97)

* [aidan] ux/workflows: surface paused state on card, sidebar, and calendar; tidy run history

* [aidan] feat/mcp-suggestions: suggest both Google and Microsoft when provider is ambiguous

* [aidan] fix/agent-tokens: friendly out-of-tokens card across all agent surfaces

* [aidan] feat/workflow-model: persist edit-agent model on save with switch notice and fresh drafts

* [aidan] fix/workflow-chat: force stop on watched run mirrors workflow card stop

* [aidan] fix/workflow-cards: keep watched run tethered on finish to avoid duplicate chat

* [aidan] feat/schedule-calendar: mark current time with a now line in week view

* [aidan] refactor/private-names: rename error and schedule classifiers from _ to p_

* [aidan] feat/scheduled-tasks: agent workflow scheduling and in-chat convert (#98)

* [aidan] feat/workflow-suggest: nudge user to convert repeatable chat to workflow

Add SuggestConvertToWorkflow MCP tool that agents call at the end of a task
when they've completed something worth repeating (daily report, weekly check,
recurring data pull). Frontend detects the tool call and glows the "Convert to
workflow" button 3 times to draw the eye. When user clicks it, the suggested
cadence (e.g. "every weekday at 9am") is stored in the draft and seeded into
the scheduling agent's first prompt, so the agent can act on the suggestion
rather than asking the user again.

Tool is never auto-called — agents decide when a task is genuinely repeatable
(not debugging, creative work, one-off lookup). Tool description emphasizes
sparse, high-confidence use only (once per session max).

Files changed:
- backend/apps/agents/schedule_mcp_server.py: add SuggestConvertToWorkflow tool
- frontend/src/shared/mcpToolMeta.ts: add label for new tool
- frontend/src/app/pages/Dashboard/cards/AgentCard.tsx: detect suggestion in
  session messages, show+glow "Convert to workflow" button, pass cadence to draft
- frontend/src/shared/state/workflowsSlice.ts: add suggested_cadence field to
  Workflow interface
- frontend/src/app/pages/Workflows/SchedulingView.tsx: seed scheduling agent
  prompt with suggested cadence hint

* [aidan] feat/agent-scheduling: route recurring asks through native workflows, deny claude cron skill

* [aidan] feat/workflow-convert: in-chat convert popup and auto-open scheduled workflow card

* [aidan] ux/calendar-page: schedule calendar restyle + popover fixes (#99)

* [aidan] fix/dashboard-delete: remove workflows calendar panel on delete key

* [aidan] ux/workflows-calendar: restyle hub, fix today highlight, add toolbar toggle

* [aidan] ux/schedule-popover: compact density, fix sticky header bleed, add header spacing

* [aidan] ux/schedule-calendar: hollow ring dot for past fires in month view

* [aidan] ux/schedule-calendar: clickable +N more opens day's full run list

* [aidan] feat/run-log-filters: add success and skipped pills to scheduled task history

* [aidan] fix/convert-button: stop drag capture so convert-to-workflow click fires

* [aidan] ux/calendar-card: match border color and radius to chat and workflow cards

* [aidan] fix/minimap: render missed-runs card on the minimap

* [aidan] ux/run-sparkline: simplify tooltip to plain run tally

* [aidan] ux/run-history: collapse expanded run view to one clickable line

* [aidan] ux/calendar-card: match corner radius to browser cards

* [aidan] feat/workflows: launch-time scheduling UX and workflow-card polish (#101)

* [aidan] feat/schedule-list: lazy-load list view via scroll sentinel

* [aidan] feat/missed-runs: launch toast with per-workflow counts and pan-to-card

* [aidan] fix/dashboard-tethers: keep watching line anchored on canvas zoom

* [aidan] feat/scheduled-tasks: review missed runs at launch instead of auto-firing on_missed

* [aidan] refactor/workflow-cards: use radius and status design tokens, polish card chrome

* [aidan] ux/agent-card: keep convert-to-workflow visible during runs with mid-turn toast

* [aidan] ux/mcp-bubble: drop redundant verb label when a workflow label is shown

* [aidan] chore/backend: remove stale explanatory comments

* [aidan] fix/workflows-hub: load workflows on hub mount so calendar fills at launch

* [aidan] feat/workflows: generate title, description, step labels at convert time

* [aidan] fix/tidy-layout: include workflows hub in tidy and fit-to-view

* [aidan] feat/schedule-list: window long list via measured-height virtualizer

* [aidan] ux/workflows-hub: remove time-saved badge from calendar header

* [aidan] fix/types: add missing semantic-type labels and drop stray fade arg

* [aidan] feat/schedule: pin monthly day-of-month and honor repeat-every intervals

* [aidan] feat/schedule: inherit source-session tool surface for scheduled runs

* [aidan] ux/calendar: restack hour-cell events as bars with overflow affordance

* [aidan] feat/calendar: open the run card when clicking a scheduled occurrence

* [aidan] ux/missed-runs: add per-group select-all toggle and rename skip action

* [aidan] feat: new scheduled task design ported

* [aidan] ui: sidebar reorder, repeat controls on schedule card

* [aidan] ui: sidebar, scheduling time

* [aidan] feat/schedule: pin monthly last-day-of-month

* [aidan] feat/steps: per-step enable toggle

* [aidan] feat/workflows: per-workflow color swatch

* [aidan] feat/trash: soft-delete workflows with restore and purge

* [aidan] feat/run-monitor: live run monitor card on the canvas

* [aidan] feat/run-context: attach a run as removable chat context

* [aidan] feat/compose: new-workflow landing page and auto-commit build flow

* [aidan] ui/workflows: dark mode and design-system cohesion

* [aidan] ui/calendar: overflow popover, condensed week view, scroll fix

* [aidan] feat/home: ongoing runs, missed review, and accurate Coming-up counts

* [aidan] fix/run-status: sync ongoing runs and heal stuck/interrupted runs

* [aidan] ux/schedule: last-day-of-month UI, Run-at time typing, interval input

* [aidan] ux/workflows: default window size and toolbar icon

* [aidan] fix/schedule: measure ran_late from start and anchor recurrences to created_at

* [aidan] feat/calendar: render fire times from backend, drop JS recurrence reimpl

* [aidan] chore/dashboard: drop dead configure/missed-run cards, refetch on reconnect

* [aidan] chore/agent-card: remove unreachable convert-to-workflow action

* [aidan] fix/workflows: don't bump updated_at on a no-op draft commit so viewing a workflow doesn't reorder the sidebar

* [aidan] feat/schedule: warn when scheduling a workflow that has no steps

* [aidan] fix/selection-tool: never select the workflows app, and exit the tool on Escape without dropping selections

* [aidan] ux/compose: diversify new-workflow starter prompts across personas

* [aidan] ux/run-monitor: spawn the run card a bit farther right of the workflows app

* [aidan] fix/schedule: harden run recovery and storage writes against crashes

* [aidan] ux/compose: restyle new-workflow starters as a clean pill cluster with rich prompts

* [aidan] fix/workflows: optimistically apply edits so the schedule banner updates instantly

* [aidan] ui/workflows: three-tone surface depth so the window lifts off the canvas in both themes

* [aidan] ui/workflows: close buttons turn red on hover, matching the chat card

* [aidan] test/schedule: cover executor pipeline, storage durability, and recurrence gaps

* [aidan] fix: remove package-lock json

* [aidan] fix/workflows-compose: keep compose view until edit agent replies

* [aidan] feat/workflows: auto-generate workflow + step titles with typewriter animation

* [eric] deps: restore frontend/package-lock.json (PR #105 deletion broke npm ci)

---------

Co-authored-by: Eric <ciregenz@berkeley.edu>
Co-authored-by: cire <134991075+ciregenz@users.noreply.github.com>
2026-06-24 18:58:43 -07:00