WEBDIENSTE/openswarm
1
0
Fork 0
mirror of https://github.com/openswarm-ai/openswarm.git synced 2026-08-17 18:25:42 +02:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 268f6948a7 arena: v45 read-your-writes NEGATIVE (9% vs 7%, within noise) -- verified-writes capability-gated not prompt-gated; clause 5 hard-open eric/browser-merged ciregenz 2026-08-17 09:15:17 -07:00
  • 49e9ca0996 [eric] release: cut 1.7.8-exp.11 with the fit fix, mini app cards and the sign-in handoff v1.7.8-exp.11 eric/dev ciregenz 2026-08-17 08:25:39 -07:00
  • 025c864c95 [eric] help: exp.11 changelog carries the fit, mini-app and sign-in handoff fixes ciregenz 2026-08-17 08:25:39 -07:00
  • 8185e3b52a [eric] browser: a hard login wall with nothing to borrow hands off to the user at the card and resumes itself when the wall clears (ENG-279) ciregenz 2026-08-17 08:25:18 -07:00
  • a3f334fee9 [eric] canvas: a docked app renders as a true miniature in its chat slot instead of a full-size overlay covering the agent (ENG-324) ciregenz 2026-08-17 08:20:28 -07:00
  • a22f47a116 arena: v45 read-your-writes (state-change tasks re-read + retry until change confirmed) -- capability work for verified-writes clause ciregenz 2026-08-17 08:11:52 -07:00
  • 97a5772c56 [eric] canvas: double-click fit shows every card again, dropping the 0.5 floor that hid spread boards and the tether svg polluting the fit box (ENG-330) ciregenz 2026-08-17 07:21:20 -07:00
  • 1f3c2d4fbe arena: verified-write nuance -- type-specific (gitlab comments persist, reddit upvotes dont); 7% was upvote-dominated, understates comment writes ciregenz 2026-08-17 07:15:23 -07:00
  • 118fde5623 arena: atomic-write measurement -- my prediction was WRONG (7%, not high); verified-writes ~7-8% overall is a real capability wall, clause 5 furthest-open; verifier bugs fixed before booking ciregenzandClaude Fable 5 2026-08-16 22:26:36 -07:00
  • ced541997d [eric] agents: the unwedge watchdog runs on daemon threads, sealing the suite's flaky hang at interpreter exit ciregenz 2026-08-16 22:20:46 -07:00
  • 834aa60f74 arena: Online-Mind2Web head-to-head scoped -- runnable but live-site/ToS/LLM-judge blockers; recommend 50-task read-only subset, awaiting go/no-go ciregenz 2026-08-16 21:57:34 -07:00
  • bc368ba2fd [eric] streaming: an open chat scrolled off screen downshifts to the 1Hz buffer and flushes the instant it returns (ENG-329) v1.7.8-exp.10 ciregenz 2026-08-16 21:47:33 -07:00
  • a86d9e3a0b arena: verified-write independent scorer -- composite reward OVERSTATED (11/15 looked persisted, only ~8% actually did); independent re-read caught the false-positive; clause 5 far open, capability-gated on complex writes ciregenz 2026-08-16 21:19:34 -07:00
  • 2db49cc0e8 [eric] canvas: webview park and wake gain eviction margins and 10s cooldowns, ending the zoom-out reboot storm (ENG-228) ciregenz 2026-08-16 21:15:05 -07:00
  • ab4d7b2db7 [eric] streaming: stream frames stop riding the dashboard socket and the backgrounded chat batches to 1Hz (ENG-329) ciregenz 2026-08-16 20:52:51 -07:00
  • d0d60ca8f9 [eric] shell: the models error banner becomes a clickable red pill that heals itself when connectivity returns (ENG-328) ciregenz 2026-08-16 20:17:15 -07:00
  • 824bc10566 [eric] voice: boot-warm whisper only on installs that have actually dictated; a session open still warms it mid-speech ciregenz 2026-08-16 20:07:37 -07:00
  • 3acfd972d6 [eric] backend: real /api/health answers the reachability prober, ending the 401 console spam on every probe tick ciregenz 2026-08-16 20:07:37 -07:00
  • 1a04c76cf5 [eric] release: cut 1.7.8-exp.10 with the delegation-watchdog scope fix, browser-card honesty and the resume chip ciregenz 2026-08-16 19:42:51 -07:00
  • a0fce815ec [eric] tests: delegation backstop tests carry the since scope the watchdog now requires ciregenz 2026-08-16 19:27:56 -07:00
  • ef2c8a8d3b arena: de-risk verdicts -- OSWorld smoke-only/skip (model-gated, cant run on our stack); verified-writes BUILD NOW (deterministic on existing infra); MiniWoB 94.1 honest near-ceiling (search-engine primitive fought reward logic, disabled) ciregenz 2026-08-16 19:23:54 -07:00
  • 69569c8079 [eric] agents: delegation watchdog only counts children born after its own tool call, ending the mid-run sidecar shootings (ENG-327) ciregenz 2026-08-16 19:23:23 -07:00
  • bc225d11ae arena: CompWoB spot-check -- no paren-bug suppression (3/12 same as v34); 81.1 stands ciregenz 2026-08-16 19:18:33 -07:00
  • 8cc55a0a99 [eric] help: cap the help agent's changelog block at 30 fixes so the knowledge prompt stays inside its token budget ciregenz 2026-08-16 19:18:09 -07:00
  • f92b920e4e [eric] agents: hidden harness messages self-identify, so a misfired nudge can never become 'the user told me to stop' (field report) ciregenz 2026-08-16 18:49:50 -07:00
  • c44308ed94 arena: WebArena FINAL = 13 strict/15% + 29.2 partial/34% (was falsely 0/3.83) -- ~7-8x true-credit correction from instrument fixes ciregenzandClaude Fable 5 2026-08-16 18:47:42 -07:00
  • 728ccab6b6 arena: judge policy -> RECIPROCAL cross-family (GPT judges Claude, Claude judges GPT) -- symmetric, no self-grading, bias applies equally ciregenz 2026-08-16 18:46:29 -07:00
  • 7b33018c9d arena: judge policy -- cross-family (GPT-5.6) + official judge, never same-family self-judge; supplementary only ciregenz 2026-08-16 18:27:16 -07:00
  • 52c19b0aee arena: test roadmap -- Polar benchmarks unrunnable (results-only/LLM-judge); queue their PUBLIC constituents (Online-Mind2Web etc.) as labeled supplementary numbers ciregenz 2026-08-16 18:24:54 -07:00
  • 2d0fc643f1 [eric] browser: refusal and ghost runs clear the card's cached transcript instead of poisoning every later dispatch; CreateBrowserAgent gains fresh=true (Haik's report) ciregenz 2026-08-16 18:22:34 -07:00
  • 9f4acf7823 arena: competitor note -- Polar's 98.0 is self-graded on own benchmarks (tuned product, not generic); not comparable, don't chase ciregenz 2026-08-16 18:22:12 -07:00
  • 0e5162bf2e arena: MAJOR WebArena RETRACTION -- '0 solved' was our own instrument bugs; honest re-measure ~18% strict/~36% partial (was falsely 0/3.83). Biggest correction of the effort. ciregenzandClaude Fable 5 2026-08-16 18:15:58 -07:00
  • 1baecba061 arena: v43 schema-gate was self-inflicted (falsely bounced valid JSON) -- disabled; v42 is honest WA config; full WA re-measurement launching ciregenzandClaude Fable 5 2026-08-16 16:10:29 -07:00
  • 195c1e0935 arena: WA canary retraction (instrument fixes lifted partials 0->0.5) + v43 answer-schema conformance gate (generic instruction-following) to lift 0.5->1.0 ciregenzandClaude Fable 5 2026-08-16 15:07:22 -07:00
  • fd081de06e [eric] canvas: accelerated mouse wheels (fractional deltaY) classify as mouse, so the Zoom/Scroll toggle finally bites on real hardware (3rd report) ciregenz 2026-08-16 14:36:53 -07:00
  • 760d40b953 arena: v41 MiniWoB champion = 94.1 (+3.4 vs v40; draw-circle + 18-budget); ~1.9 from 95, 4-5 primitives left ciregenzandClaude Fable 5 2026-08-16 14:33:47 -07:00
  • 267f692410 [eric] canvas: a dead webview guest reloads itself instead of painting a black rectangle; crash fires neither load event so nothing healed it (ENG-322) ciregenz 2026-08-16 14:27:26 -07:00
  • 1e490619b9 [eric] canvas: a parked app card with no snapshot says what it is instead of rendering a bare white rectangle (ENG-320) ciregenz 2026-08-16 14:10:52 -07:00
  • 0b2c6981a0 [eric] canvas: a mid-task-stopped chat wears a resume chip on its board pill instead of hiding the owed response inside the card (ENG-321) ciregenz 2026-08-16 13:53:57 -07:00
  • e96a5fdd24 arena: grep-audit checkpoint -- champion logic has zero benchmark-specific strings; overfitting boundary holds ciregenzandClaude Fable 5 2026-08-16 13:01:24 -07:00
  • 70dd5761a4 arena: fix TWO instrument bugs zeroing WebArena -- (1) goal truncated to 600 chars dropped WA's answer-schema; feed policy full goal. (2) CALL_RE cut payloads at first ) killing answers with parens; quote-aware scanner. Both trace-verified. WA 0-solved was partly our harness. ciregenzandClaude Fable 5 2026-08-16 12:59:52 -07:00
  • 3972f543fc arena: v42 terminal answer protocol (bare final answer on string-match goals) -- generic output hygiene, offline-verified ciregenzandClaude Fable 5 2026-08-16 12:57:38 -07:00
  • b4c011f8a3 arena: benchmark-structure + SOTA scan -- terminal answer protocol (TAKE, generic) vs api/selector bypass (DECLINE, benchmark-specific); honest principled split ciregenzandClaude Fable 5 2026-08-16 12:56:54 -07:00
  • c08d0d4b22 arena: WebArena v40 rerun still 0 strict -- ingestions dont address long-horizon completion; goal >=65 open+field-hard, booked honestly ciregenz 2026-08-16 11:57:16 -07:00
  • 4022b04b9a arena: v41 scripted draw-circle geometry primitive -- draw-circle 0/3->3/3; feature-gated on circle goals ciregenzandClaude Fable 5 2026-08-16 11:24:50 -07:00
  • 3a56b99b0b [eric] outputs: serve-static apps' WS status frame no longer nulls frontend_url on a process that never exists; the Starting-preview wedge for built apps ciregenz 2026-08-16 11:20:28 -07:00
  • 1260988938 arena: consolidated goal scoreboard at checkpoint -- 6/11 clauses met, open ones honestly categorized (capability/field-difficulty/infra, none overfittable) ciregenzandClaude Fable 5 2026-08-16 09:36:45 -07:00
  • 3def185bf1 [eric] lint: tonight's new tests go clean under p-private and ruff; the bounce module's router alias goes public since tests reach it ciregenz 2026-08-16 08:57:25 -07:00
  • 506961da9f arena: WASP injection refusal = 100% (17/17 engaged, 0 obeyed) -- clause MET; scorer false-positive caught+fixed pre-booking ciregenzandClaude Fable 5 2026-08-16 08:18:22 -07:00
  • b9afcae6ac [eric] router: a completed subscription connect bounces 9Router so its dispatch state rebuilds; new subs no longer dead until app restart (ENG-315) ciregenz 2026-08-16 08:11:09 -07:00
  • 191854df37 arena: WASP scorer fix -- exclude send_msg_to_user from obeyed check (agent narrating its refusal mentioned attacker domain -> 3 false-positive vulns were actually strong refusals); only real navigation/interaction counts ciregenzandClaude Fable 5 2026-08-16 08:01:15 -07:00
  • 43004c705a arena: WASP scorer -- policy.reset per episode + 0-action marked inconclusive (empty completion = ambiguous, scored separately) ciregenzandClaude Fable 5 2026-08-16 07:28:23 -07:00
  • c4ae243ba6 arena: WASP injection refusal harness (deterministic scoring, no LLM judge) -- canary clean; full 21-attack sweep next ciregenzandClaude Fable 5 2026-08-16 06:54:33 -07:00
  • d887850706 arena: CompWoB v40 delta 0 net-new -- holds 81.1, still 0.9 behind browser-use; booked honestly, no manufactured pass ciregenzandClaude Fable 5 2026-08-16 06:18:58 -07:00
  • c50bd4fd82 arena: champion v40 3-seed = 90.7 (ingestion wins generalized; seed-42 flaky tail offsets; prompt-side plateau noted) ciregenzandClaude Fable 5 2026-08-16 05:46:51 -07:00
  • eaacc854d8 arena: v40 champion promoted (escape+table_md; popup loss was variance, 6/6 on 3-seed) -- champion 3-seed MiniWoB launching ciregenzandClaude Fable 5 2026-08-16 03:42:40 -07:00
  • 92f1db8b6e arena: v40c exonerates escape token (same control losses without it) -- v40a (escape+table, no mutation) isolating now ciregenzandClaude Fable 5 2026-08-16 03:05:47 -07:00
  • 76eada6987 arena: v40 union FAILS confirm (interaction regression) -- pairwise isolation running (v40c first) ciregenzandClaude Fable 5 2026-08-16 02:33:55 -07:00
  • a81958acb9 [eric] agents: first expired-token failure heals itself (fresh CLI + one hidden retry); the reconnect banner is the second rung (ENG-294) ciregenz 2026-08-16 02:06:33 -07:00
  • 7581706f5f arena: v38 7/8 + v39 5/8 both PASS -- v40 champion = union of three passed ingestions; combined confirm pilot next ciregenzandClaude Fable 5 2026-08-16 02:02:03 -07:00
  • 90143f7be1 [eric] tests: memory snapshot test pins the memory toggle on; it failed on any machine whose user turned memory off v1.7.8-exp.9 ciregenz 2026-08-16 01:53:48 -07:00
  • 11784a9083 [eric] settings: the UPLOAD_DIR rename left the browser upload tool importing a deleted name; upload_dir()/legacy roots wired everywhere (ENG-312) ciregenz 2026-08-16 01:53:48 -07:00
  • 628fc5521a [eric] web: startpage leaves the keyless race; every endpoint now serves an Anubis wall to POST too, 0/22 answered (ENG-302) ciregenz 2026-08-16 01:53:48 -07:00
  • dc303222ac [eric] skills: frontmatter parser reads YAML block scalars, so a |- description no longer renders literally (ENG-307) ciregenz 2026-08-16 01:53:28 -07:00
  • a15466ff54 [eric] workflows: run rows carry their workflow's name; the title join failed for every deleted workflow (ENG-307) ciregenz 2026-08-16 01:53:28 -07:00
  • 96bdd222c6 [eric] canvas: an unrelated spawn no longer despawns another agent's revealed subagents; reconcile learns keep-not-create ids (ENG-304) ciregenz 2026-08-16 01:53:06 -07:00
  • 5bf4fe0046 [eric] canvas: autofocus frames the rendered card, not its collapsed footprint, so an expanded chat lands fully on screen (ENG-318) ciregenz 2026-08-16 01:52:55 -07:00
  • 0e2aac1afc arena: pre-register v38/v39 pilots ciregenzandClaude Fable 5 2026-08-16 01:30:31 -07:00
  • 2e07047ff7 arena: v36 PASSES (3/8 incl click-collapsible pair; first ingestion win) -> v40 champion; v37 deferred to chore-scale ciregenzandClaude Fable 5 2026-08-16 01:30:09 -07:00
  • 25892f30b1 arena: WebChoreArena primary Claude column final -- 1/89 at 500s cap, 39 answers, 0 false; budget is the binding constraint (both models agree) ciregenzandClaude Fable 5 2026-08-16 00:58:44 -07:00
  • 640c872214 [eric] voice: focus re-arms the fn tap so apps like Wispr that register later cannot silently eat the dictation key (ENG-317) ciregenz 2026-08-16 00:55:31 -07:00
  • 7d9fe3dc94 [eric] electron: memory pressure now sheds weight (thumbnails pause, caches drop) instead of growing until macOS kills the app (ENG-320) ciregenz 2026-08-16 00:31:54 -07:00
  • 7258c1a2d4 [eric] settings: uploads move off the OS temp dir, whose import-time probe cost 6s of every boot on crowded machines (ENG-312) ciregenz 2026-08-16 00:12:06 -07:00
  • 403cddf819 [eric] changelog: 1.7.8 covers the tree-freeze, deselect, first-boot deadline and lost-result recovery ciregenz 2026-08-15 23:48:32 -07:00
  • 92a05ad36a [eric] agents: stage-3 recovery ends a turn whose CLI never noticed the lost delegation result, then redoes the step ciregenz 2026-08-15 23:45:43 -07:00
  • 5ff16b47a5 [eric] agents: a delegated run whose result is lost recovers instead of hanging the parent forever ciregenz 2026-08-15 23:38:32 -07:00
  • 4bee0ff18f [eric] apps: a first boot's pip install gets a real deadline, so a loaded machine stops killing new apps at 60s ciregenz 2026-08-15 23:24:01 -07:00
  • d1b9c2c5bd [eric] canvas: clicking empty canvas clears a text selection, the way every other surface does (ENG-316) ciregenz 2026-08-15 23:04:32 -07:00
  • 8574ab4d2a arena: pre-register v36/v37 ingestion pilots (targets + predictions) before any episode ciregenzandClaude Fable 5 2026-08-15 23:01:32 -07:00
  • d37b1f62de [eric] apps: parking an idle app freezes its whole process tree, not just the root run.sh (ENG-311) ciregenz 2026-08-15 23:00:36 -07:00
  • 3abe31fb01 arena: implement v39 mutation-diff action feedback (Agent-E) -- all four Tier-1 ingestions now flag-gated and ready to pilot ciregenzandClaude Fable 5 2026-08-15 22:53:46 -07:00
  • 84977535dd [eric] changelog: 1.7.8 tells the crash-survival story (ENG-313) ciregenz 2026-08-15 22:43:51 -07:00
  • a3d2096982 arena: implement v38 table->markdown rendering (AgentOccam) -- offline-verified on read-table, flag-gated ciregenzandClaude Fable 5 2026-08-15 22:22:33 -07:00
  • 0f29b9a7bb [eric] agents: a session reaches disk the moment you send, so a backend death can no longer erase the conversation (ENG-313) ciregenz 2026-08-15 22:13:52 -07:00
  • 6c245d3245 arena: implement v36 no_match refusal token (SeeAct) + v37 persistent NOTE scratchpad (AgentOccam/Agent-E), flag-gated, offline-verified -- pilots queued for lane-free ciregenzandClaude Fable 5 2026-08-15 21:49:56 -07:00
  • 42ba2b897f arena: competitor ingestion ledger from AgentOccam/Agent-E/SeeAct study -- 4 Tier-1 generic candidates (escape token, note scratchpad, table-markdown, mutation-diff), pre-registered pilot-gated ciregenzandClaude Fable 5 2026-08-15 21:47:10 -07:00
  • 3e55a95117 arena: 2026 open-source/SOTA reference points + browser-use library-vs-cloud distinction (honest comparison scope) ciregenzandClaude Fable 5 2026-08-15 21:41:04 -07:00
  • 449680c269 [eric] release: 1.7.8-exp.9 carries the first-reply system-prompt fix for the hackathon ciregenz 2026-08-15 20:53:31 -07:00
  • 7853884d75 [eric] agents: a custom system prompt bites on the FIRST reply; it was delivered but buried mid-prompt and ignored ciregenz 2026-08-15 20:48:12 -07:00
  • 0c149a671d arena: WebChoreArena GPT-5.4 column final -- 2/86 solved at 500s cap, 0 false claims, upstream evaluator crashes disclosed ciregenzandClaude Fable 5 2026-08-15 20:44:37 -07:00
  • 7dfd65cb00 arena: CORRECTION -- lane outage was a stale router OAuth token, not plan exhaustion (user dashboard evidence) ciregenzandClaude Fable 5 2026-08-15 20:34:42 -07:00
  • ee68667b26 arena: primary Claude v35 MiniWoB = 90.5% (v35 picker fix recovers choose-date; net-flat vs v22, +1.5 vs v34-buggy); residual >=95 cluster named ciregenzandClaude Fable 5 2026-08-15 17:13:01 -07:00
  • 00172966ae arena: GPT-5.4 cross-model MiniWoB = 86.1% (same harness, ~3pt of Claude; harness-generality claim measured directly) ciregenzandClaude Fable 5 2026-08-15 13:34:39 -07:00
  • 597931725c arena: book Claude-sub-exhausted -> GPT-5.4 cross-model column decision ciregenzandClaude Fable 5 2026-08-15 11:30:14 -07:00
  • 5d6a14c936 arena: '@lane' arm alias for cross-model runs on a separate subscription (Claude sub exhausted; GPT-5.4 lane live, own data file) ciregenzandClaude Fable 5 2026-08-15 11:29:46 -07:00
  • 1845e6d4c8 arena: WASP adapter design -- deterministic injection-refusal scoring (their ASR classifier excluded) ciregenzandClaude Fable 5 2026-08-15 09:14:08 -07:00
  • 1bb3b0810a arena: v35 readonly-picker fallback (unit-verified 1.0 without a model) -- pre-registered for lane return ciregenzandClaude Fable 5 2026-08-15 08:42:14 -07:00
  • aec8ac90ec [eric] test: the server-owned refusal asserts the value did not change, so it stops depending on whose laptop runs it ciregenz 2026-08-14 23:54:00 -07:00
  • 3093562ff1 [eric] electron: the declared menu keeps the devtools shortcut the implicit default gave (ENG-289) v1.7.8-exp.8 ciregenz 2026-08-14 23:43:49 -07:00
  • 8151be84f9 [eric] release: 1.7.8-exp.8 carries the cursor handback, the unpublish honesty, the SettingsWrite gate and Cmd+C ciregenz 2026-08-14 23:42:36 -07:00