360 Commits
Author SHA1 Message Date
MattandGitHub 8a6875ccf2 fix: package license and guard schedule controls (#2598)
* docs: refresh readme architecture diagrams

* fix: ship release licenses and local UI assets

* fix: fail closed when schedule prerequisites fail

* docs: refresh release-facing operator guide

* fix: keep HarvestView on pinned CDN assets

* docs: apply HarvestView theme to architecture diagrams

* docs: simplify README and clarify diagram labels
2026-09-04 18:20:21 -04:00
MattandGitHub e8bab9ebcc refactor: centralize target identity semantics (#2597)
* refactor: own enumeration target identity

* refactor: clarify target identity policies
2026-09-04 18:02:48 -04:00
NotoriousRebel 0756ffc049 fix: fail closed on unreliable tracking baselines 2026-08-29 17:21:53 -04:00
NotoriousRebel d181c42601 fix: harden hostname tracking release behavior 2026-08-29 17:16:17 -04:00
NotoriousRebel 7800737d96 fix: fail closed on incomplete DNS evidence 2026-08-29 16:42:31 -04:00
NotoriousRebel 6b7852f7ef feat: track hostname changes across runs 2026-08-29 16:38:25 -04:00
NotoriousRebel e06392bb53 feat: require explicit all-target yield reports 2026-08-29 16:08:20 -04:00
NotoriousRebel a23298ea48 feat: make source yield reports target-aware 2026-08-29 16:06:07 -04:00
NotoriousRebel 9d362e0032 feat: list canonical harvest yield targets (#333) 2026-08-29 13:51:46 -04:00
NotoriousRebel 2440b2b932 refactor: own API runtime state in app lifespan 2026-08-27 15:42:00 -04:00
NotoriousRebel f9c363a77c test: align proxy help contract 2026-08-25 23:13:15 -04:00
NotoriousRebel 50669f2704 docs: align fail-closed proxy contract 2026-08-25 23:11:03 -04:00
NotoriousRebel 414276e330 fix: fail closed when required proxies are unavailable 2026-08-25 22:59:06 -04:00
MattandGitHub 7cc7e3abc6 Merge pull request #2586 from laramies/fix/review-security-boundaries
fix: enforce discovery security boundaries
2026-08-25 22:58:40 -04:00
L1ghtn1ng f2efcb5b99 fix: canonicalize hostname scope and IP results in one helper
Put IDNA and label validation in normalize_scoped_hostname so the
runner, parser, and storage path share one authorized-target boundary.
Drop IPv6 zone identifiers at collection instead of failing finish(),
and remove leftover BuiltWith and Shodan aliases now that www. is part
of the explicit target.
2026-08-25 02:02:35 +01:00
NotoriousRebel cfbcb19386 fix: complete ty CI migration 2026-08-24 20:31:32 -04:00
L1ghtn1ng 86c2c5f979 fix: enforce discovery security boundaries
Keep proxy identities stable across provider conversations, preserve exact target scope, canonicalize evidence, secure first-run config creation, and retain legacy source-name compatibility.
2026-08-25 01:29:05 +01:00
NotoriousRebel c3ec07b593 Clarify partial source outcomes 2026-08-23 18:00:26 -04:00
NotoriousRebel 85db8bda8f Improve source yield reporting 2026-08-23 17:39:55 -04:00
NotoriousRebel 5c74e1a03d Allow uncapped discovery and report source yield 2026-08-23 17:24:08 -04:00
NotoriousRebel 03a349430f Fix Baidu browser user agent 2026-08-21 13:05:16 -04:00
NotoriousRebel 2c6c5bff4a refactor: use SQLAlchemy for HarvestView schedules 2026-08-20 16:01:55 -04:00
NotoriousRebel d875f3ac21 fix: recover persisted run evidence idempotently 2026-08-20 12:28:30 -04:00
NotoriousRebel 8bdbca217c feat: extend HarvestView schedule management 2026-08-20 11:11:25 -04:00
NotoriousRebel ca1cb72ec6 fix: reconcile superseded schedule reservations 2026-08-20 10:02:40 -04:00
NotoriousRebel a1d794d5af feat: add persistent HarvestView scheduling 2026-08-20 01:21:09 -04:00
NotoriousRebel 416c4bf828 Preserve winloop outside Playwright paths 2026-08-20 00:45:03 -04:00
NotoriousRebel f626b72748 Fix Playwright startup on Windows
Use the standard asyncio event loop on Windows because winloop rejects the startupinfo argument Playwright passes when launching its driver subprocess. Remove the now-unused winloop dependency and cover the loop selection with a regression test.
2026-08-18 13:17:13 -04:00
NotoriousRebel 0a94f1aad6 Polish Python docstrings 2026-08-18 11:47:55 -04:00
NotoriousRebel 1063318c70 Make Baidu browser support optional 2026-08-18 11:25:30 -04:00
NotoriousRebel a301c0c859 Fix Baidu direct search transport 2026-08-18 11:03:07 -04:00
NotoriousRebel 6fea00a7e0 docs: add action evidence JSONL examples 2026-08-17 10:24:03 -04:00
NotoriousRebel b37f413c77 docs: simplify source matrix and JSONL example 2026-08-17 01:03:25 -04:00
NotoriousRebel d0c6583c64 docs: make source matrix easier to scan 2026-08-17 00:26:22 -04:00
NotoriousRebel 4c35f1c54f docs: make README diagrams readable 2026-08-17 00:19:56 -04:00
NotoriousRebel d940ba25ba docs: make the wiki operator focused 2026-08-17 00:01:58 -04:00
NotoriousRebel a9a2318adc docs: make wiki diagrams readable 2026-08-16 23:48:02 -04:00
NotoriousRebel 34f64e3624 Remove unused development dependencies
Refs NotoriousRebel/theHarvester#327
2026-08-16 21:43:28 -04:00
NotoriousRebel 876d9aa602 Remove unused runtime dependencies
Refs NotoriousRebel/theHarvester#326
2026-08-16 21:35:22 -04:00
NotoriousRebel 9b982db7b6 fix: report provider collection outcomes truthfully 2026-08-16 21:31:08 -04:00
L1ghtn1ng 773042351a bump ruff to py3.14 and fix all the errors from mypy,ty,pytest and ruff issues 2026-08-17 02:13:55 +01:00
NotoriousRebel b14e564c89 docs: link discovery sources to providers 2026-08-16 21:02:37 -04:00
NotoriousRebel e26ccba7fe refactor: replace ujson with standard json
Refs NotoriousRebel/theHarvester#325
2026-08-16 19:53:34 -04:00
NotoriousRebel 2c847b84a2 Require Python 3.14 2026-08-16 19:40:13 -04:00
NotoriousRebel 60d1b288b6 docs: align contribution and review guidance 2026-08-16 15:23:08 -04:00
NotoriousRebel 8cfd6cf7bb docs: refocus README on current usage 2026-08-16 15:02:44 -04:00
NotoriousRebel c91456531c feat: export completed runs as SQLite 2026-08-16 14:41:19 -04:00
MattandGitHub f5d8a421f3 Merge pull request #2557 from NotoriousRebel/codex/harvestview-impeccable-polish
fix: polish HarvestView evidence review
2026-08-16 14:20:15 -04:00
NotoriousRebel 60ad04ee16 Document JSONL route extraction 2026-08-16 14:07:36 -04:00
NotoriousRebel 5dcc5ecd25 Remove duplicate diagram HTML 2026-08-16 13:55:45 -04:00