4840 Commits
Author SHA1 Message Date
MattandGitHub fc25924dd5 Merge pull request #2593 from NotoriousRebel/codex/own-api-runtime-state
Refactor API background state into app lifespan
2026-08-27 20:16:11 -04:00
NotoriousRebel 2440b2b932 refactor: own API runtime state in app lifespan 2026-08-27 15:42:00 -04:00
MattandGitHub 51bc40dd20 Merge pull request #2588 from NotoriousRebel/codex/pr-2586-followup
fix: fail closed when required proxies are unavailable
2026-08-25 23:16:27 -04:00
NotoriousRebel f9c363a77c test: align proxy help contract 2026-08-25 23:13:15 -04:00
NotoriousRebel 50669f2704 docs: align fail-closed proxy contract 2026-08-25 23:11:03 -04:00
NotoriousRebel 414276e330 fix: fail closed when required proxies are unavailable 2026-08-25 22:59:06 -04:00
MattandGitHub 7cc7e3abc6 Merge pull request #2586 from laramies/fix/review-security-boundaries
fix: enforce discovery security boundaries
2026-08-25 22:58:40 -04:00
MattandGitHub 52aa1b6597 Merge pull request #2587 from NotoriousRebel/codex/complete-ty-ci-migration
Complete mypy-to-ty CI migration
2026-08-24 22:10:17 -04:00
L1ghtn1ng f2efcb5b99 fix: canonicalize hostname scope and IP results in one helper
Put IDNA and label validation in normalize_scoped_hostname so the
runner, parser, and storage path share one authorized-target boundary.
Drop IPv6 zone identifiers at collection instead of failing finish(),
and remove leftover BuiltWith and Shodan aliases now that www. is part
of the explicit target.
2026-08-25 02:02:35 +01:00
NotoriousRebel d9c755113d docs: clarify ty changelog entry 2026-08-24 20:36:33 -04:00
NotoriousRebel cfbcb19386 fix: complete ty CI migration 2026-08-24 20:31:32 -04:00
L1ghtn1ngandNotoriousRebel 144e8645a6 remove mypy and move to ty 2026-08-24 20:31:32 -04:00
L1ghtn1ng 86c2c5f979 fix: enforce discovery security boundaries
Keep proxy identities stable across provider conversations, preserve exact target scope, canonicalize evidence, secure first-run config creation, and retain legacy source-name compatibility.
2026-08-25 01:29:05 +01:00
MattandGitHub 54834f991e Merge pull request #2583 from NotoriousRebel/codex/humanize-source-yield-docs
Polish source yield documentation
2026-08-24 16:09:09 -04:00
NotoriousRebel 240e56efe5 Polish source yield documentation 2026-08-24 16:06:57 -04:00
MattandGitHub e0e8c67ea6 Merge pull request #2581 from NotoriousRebel/codex/source-yield-benchmark
Allow uncapped discovery and report source yield
2026-08-23 22:20:49 -04:00
NotoriousRebel c3ec07b593 Clarify partial source outcomes 2026-08-23 18:00:26 -04:00
NotoriousRebel 85db8bda8f Improve source yield reporting 2026-08-23 17:39:55 -04:00
NotoriousRebel 5c74e1a03d Allow uncapped discovery and report source yield 2026-08-23 17:24:08 -04:00
MattandGitHub 0806a92482 Merge pull request #2579 from NotoriousRebel/codex/fix-baidu-browser-user-agent
Fix Baidu browser user agent
2026-08-21 13:44:25 -04:00
NotoriousRebel 03a349430f Fix Baidu browser user agent 2026-08-21 13:05:16 -04:00
MattandGitHub 2f51440708 Merge pull request #2577 from NotoriousRebel/codex/harvestview-scheduling
Add persistent HarvestView scheduling
2026-08-20 16:05:08 -04:00
NotoriousRebel 2c6c5bff4a refactor: use SQLAlchemy for HarvestView schedules 2026-08-20 16:01:55 -04:00
NotoriousRebel d875f3ac21 fix: recover persisted run evidence idempotently 2026-08-20 12:28:30 -04:00
NotoriousRebel 8bdbca217c feat: extend HarvestView schedule management 2026-08-20 11:11:25 -04:00
NotoriousRebel ca1cb72ec6 fix: reconcile superseded schedule reservations 2026-08-20 10:02:40 -04:00
NotoriousRebel a1d794d5af feat: add persistent HarvestView scheduling 2026-08-20 01:21:09 -04:00
MattandGitHub 04b94cf996 Merge pull request #2575 from NotoriousRebel/codex/fix-windows-playwright-loop
Fix Playwright startup on Windows
2026-08-20 00:50:58 -04:00
NotoriousRebel 416c4bf828 Preserve winloop outside Playwright paths 2026-08-20 00:45:03 -04:00
NotoriousRebel f626b72748 Fix Playwright startup on Windows
Use the standard asyncio event loop on Windows because winloop rejects the startupinfo argument Playwright passes when launching its driver subprocess. Remove the now-unused winloop dependency and cover the loop selection with a regression test.
2026-08-18 13:17:13 -04:00
MattandGitHub 1105b18536 Merge pull request #2573 from NotoriousRebel/codex/search-transport-benchmark
Fix Baidu direct search transport
2026-08-18 12:52:30 -04:00
NotoriousRebel a670661c6a Keep 5.0.0 changes unreleased 2026-08-18 11:53:38 -04:00
NotoriousRebel 0a94f1aad6 Polish Python docstrings 2026-08-18 11:47:55 -04:00
NotoriousRebel 4d17128929 Clarify source catalog docstrings 2026-08-18 11:31:45 -04:00
NotoriousRebel 1063318c70 Make Baidu browser support optional 2026-08-18 11:25:30 -04:00
NotoriousRebel a301c0c859 Fix Baidu direct search transport 2026-08-18 11:03:07 -04:00
MattandGitHub de70efdeb9 Merge pull request #2571 from NotoriousRebel/codex/wiki-action-evidence
docs: add action evidence JSONL examples
2026-08-17 13:44:52 -04:00
NotoriousRebel 6fea00a7e0 docs: add action evidence JSONL examples 2026-08-17 10:24:03 -04:00
MattandGitHub 2777ba9c72 Merge pull request #2570 from NotoriousRebel/codex/readme-source-jsonl-polish
docs: simplify source matrix and JSONL example
2026-08-17 01:05:28 -04:00
NotoriousRebel b37f413c77 docs: simplify source matrix and JSONL example 2026-08-17 01:03:25 -04:00
MattandGitHub 638d6855b0 Merge pull request #2568 from NotoriousRebel/codex/wiki-diagram-readability
docs: make the README and wiki operator focused
2026-08-17 00:43:49 -04:00
NotoriousRebel d0c6583c64 docs: make source matrix easier to scan 2026-08-17 00:26:22 -04:00
NotoriousRebel 4c35f1c54f docs: make README diagrams readable 2026-08-17 00:19:56 -04:00
NotoriousRebel d940ba25ba docs: make the wiki operator focused 2026-08-17 00:01:58 -04:00
NotoriousRebel a9a2318adc docs: make wiki diagrams readable 2026-08-16 23:48:02 -04:00
MattandGitHub bc78a98a08 Merge pull request #2567 from NotoriousRebel/codex/release-final-doc-fixes
docs: correct 5.0.0 release notes
2026-08-16 22:54:58 -04:00
NotoriousRebel b7537f7d81 docs: correct 5.0.0 release notes 2026-08-16 22:43:15 -04:00
MattandGitHub 69214fa4f8 Merge pull request #2566 from NotoriousRebel/codex/dev-dependency-cleanup
Remove unused development dependencies
2026-08-16 21:49:37 -04:00
NotoriousRebel 34f64e3624 Remove unused development dependencies
Refs NotoriousRebel/theHarvester#327
2026-08-16 21:43:28 -04:00
MattandGitHub a528d3fba0 Merge pull request #2565 from NotoriousRebel/codex/runtime-dependency-cleanup
Remove unused runtime dependencies
2026-08-16 21:43:02 -04:00