NotoriousRebel
ea5db87915
Merge master into dev to resolve PR #2607 conflicts
...
Preserve provider outcome release notes alongside the HTTP proxy wording. Keep the dev domain glossary and carry the master HTTP-only proxy policy into its relocated architecture guide. Retain RocketReach cancellation coverage while removing the obsolete global dependency stub.
Align provider lifecycle regressions with the master session-construction boundary: construction ValueError is normalized to transport-error, while cancellation, lifecycle RuntimeError, and teardown ValueError still propagate.
2026-09-09 21:41:46 -04:00
Matt and GitHub
b2db23a89b
fix: preserve provider outcomes and session state for 5.0 ( #2604 )
...
* fix: preserve provider failures and decode POST evidence
Keep failed, rate-limited, malformed, and partial outcomes visible across ten provider adapters so saved hostname comparisons do not infer reliable absence. Restore DeHashed and Leak-Lookup JSON response decoding.
Refs #358 , #359
* docs: document released 4.11 automation migrations
Address #361 with launcher, route, request, response, source, and DNS resolver migrations verified against the 4.11.1 tag.
* fix: own provider sessions across related requests
2026-09-09 15:51:58 -04:00
Matt and GitHub
1e9efc6118
feat: add JSMON passive subdomain discovery ( #2605 )
...
* Add JSMON passive subdomain discovery source
* docs: complete JSMON setup and credential readiness
* fix: read JSMON credentials only from api-keys.yaml
2026-09-09 14:12:07 -04:00
Matt and GitHub
3b01d7f172
feat: clarify saved-run reporting before 5.0 ( #2599 )
...
Provide harvest-report targets, contributions, and hostname-changes with consistent saved-evidence terminology across the CLI, REST API, and HarvestView. Preserve target scope, source-outcome handling, JSONL, and the stored evidence schema.
Update onboarding and operator documentation, keep the domain glossary in CONTEXT.md, record behavior rules in docs/architecture.md, and consolidate release preparation in CONTRIBUTING.md.
Validation: all eight GitHub checks passed at ed54542a; focused reporting and documentation checks passed. Tracks https://github.com/NotoriousRebel/theHarvester/issues/349 .
2026-09-07 16:48:20 -04:00
Matt and GitHub
8a6875ccf2
fix: package license and guard schedule controls ( #2598 )
...
* docs: refresh readme architecture diagrams
* fix: ship release licenses and local UI assets
* fix: fail closed when schedule prerequisites fail
* docs: refresh release-facing operator guide
* fix: keep HarvestView on pinned CDN assets
* docs: apply HarvestView theme to architecture diagrams
* docs: simplify README and clarify diagram labels
2026-09-04 18:20:21 -04:00
NotoriousRebel
edd6d575b6
docs: explain hostname comparison workflow
2026-08-29 23:36:20 -04:00
NotoriousRebel
0756ffc049
fix: fail closed on unreliable tracking baselines
2026-08-29 17:21:53 -04:00
NotoriousRebel
7800737d96
fix: fail closed on incomplete DNS evidence
2026-08-29 16:42:31 -04:00
NotoriousRebel
6b7852f7ef
feat: track hostname changes across runs
2026-08-29 16:38:25 -04:00
NotoriousRebel
e06392bb53
feat: require explicit all-target yield reports
2026-08-29 16:08:20 -04:00
NotoriousRebel
a23298ea48
feat: make source yield reports target-aware
2026-08-29 16:06:07 -04:00
NotoriousRebel
9d362e0032
feat: list canonical harvest yield targets ( #333 )
2026-08-29 13:51:46 -04:00
NotoriousRebel
2440b2b932
refactor: own API runtime state in app lifespan
2026-08-27 15:42:00 -04:00
NotoriousRebel
8ead90f7a9
fix: scope proxy mode to HTTP transport
2026-08-26 22:53:21 -04:00
NotoriousRebel
ad28a87111
fix: reject direct DNS in proxy mode
2026-08-26 16:17:51 -04:00
NotoriousRebel
786c3b015a
fix: reject missing proxy configuration at startup
2026-08-26 00:58:54 -04:00
NotoriousRebel
8889ddca9c
fix: pin proxy identity per execution
2026-08-26 00:38:46 -04:00
NotoriousRebel
50669f2704
docs: align fail-closed proxy contract
2026-08-25 23:11:03 -04:00
NotoriousRebel
414276e330
fix: fail closed when required proxies are unavailable
2026-08-25 22:59:06 -04:00
NotoriousRebel
240e56efe5
Polish source yield documentation
2026-08-24 16:06:57 -04:00
NotoriousRebel
c3ec07b593
Clarify partial source outcomes
2026-08-23 18:00:26 -04:00
NotoriousRebel
85db8bda8f
Improve source yield reporting
2026-08-23 17:39:55 -04:00
NotoriousRebel
5c74e1a03d
Allow uncapped discovery and report source yield
2026-08-23 17:24:08 -04:00
NotoriousRebel
2c6c5bff4a
refactor: use SQLAlchemy for HarvestView schedules
2026-08-20 16:01:55 -04:00
NotoriousRebel
8bdbca217c
feat: extend HarvestView schedule management
2026-08-20 11:11:25 -04:00
NotoriousRebel
a1d794d5af
feat: add persistent HarvestView scheduling
2026-08-20 01:21:09 -04:00
NotoriousRebel
1063318c70
Make Baidu browser support optional
2026-08-18 11:25:30 -04:00
NotoriousRebel
a301c0c859
Fix Baidu direct search transport
2026-08-18 11:03:07 -04:00
NotoriousRebel
6fea00a7e0
docs: add action evidence JSONL examples
2026-08-17 10:24:03 -04:00
NotoriousRebel
4c35f1c54f
docs: make README diagrams readable
2026-08-17 00:19:56 -04:00
NotoriousRebel
d940ba25ba
docs: make the wiki operator focused
2026-08-17 00:01:58 -04:00
NotoriousRebel
a9a2318adc
docs: make wiki diagrams readable
2026-08-16 23:48:02 -04:00
NotoriousRebel
b14e564c89
docs: link discovery sources to providers
2026-08-16 21:02:37 -04:00
NotoriousRebel
2c847b84a2
Require Python 3.14
2026-08-16 19:40:13 -04:00
NotoriousRebel
098f12b6a4
docs: keep wiki focused on current behavior
2026-08-16 15:12:19 -04:00
NotoriousRebel
1d94fdae7f
docs: define upcoming release contract
2026-08-16 14:51:19 -04:00
NotoriousRebel
c91456531c
feat: export completed runs as SQLite
2026-08-16 14:41:19 -04:00
NotoriousRebel
5dcc5ecd25
Remove duplicate diagram HTML
2026-08-16 13:55:45 -04:00
NotoriousRebel
edeb440f6b
Expand README architecture diagrams
2026-08-16 13:38:19 -04:00
NotoriousRebel
bc30f6b82d
Restore live package version table
2026-08-16 13:22:47 -04:00
NotoriousRebel
ab931d1da5
docs: correct evidence architecture diagram
2026-08-16 12:53:03 -04:00
NotoriousRebel
03bb10abfc
docs: make JSONL the primary workflow
2026-08-16 11:50:38 -04:00
NotoriousRebel
de60af1f17
fix: reject removed adapter lifecycle state
2026-08-16 00:49:16 -04:00
NotoriousRebel
2ac59f3a38
refactor: centralize source execution lifecycle
2026-08-16 00:32:22 -04:00
NotoriousRebel
df1933b345
fix: preserve provider sessions across pagination
2026-08-15 13:20:26 -04:00
NotoriousRebel
4bcf2ceae9
fix: restore conservative source-worker default
2026-08-15 11:41:06 -04:00
Matt and GitHub
f44807a046
refactor: run discovery sources with TaskGroup ( #2544 )
...
* refactor: run discovery sources with TaskGroup
* fix: preserve source runner compatibility diagnostics
* feat: add configurable source workers
2026-08-15 01:48:33 -04:00
Matt and GitHub
1a9b114a5d
fix: complete DNS enumeration by default ( #2542 )
...
* fix: complete DNS enumeration by default
* test: avoid URL substring sanitizer alert
2026-08-14 22:54:25 -04:00
Matt and GitHub
bb77613a05
fix: call Censys Platform API directly ( #2537 )
...
* fix: call Censys Platform API directly (#295 )
(cherry picked from commit 7ce361413ad35471ab0b6878382f3548b0918dbe)
* docs: clarify Censys global search entitlement
2026-08-14 22:44:45 -04:00
Matt and GitHub
624066a3e8
Add RouteViews enrichment and sourced ASN organization attribution ( #2528 )
...
* Add RouteViews network enrichment
* Add authenticated RouteViews API access
* Restrict RouteViews to explicit network pivots
* Restore discovered ASN RouteViews enrichment
* Retain sourced ASN organization attribution
* Avoid dangling and repeated ASN attributions
* Keep automatic RouteViews evidence target-relevant
* Complete target-relevant RouteViews enrichment
* Clarify automatic RouteViews IP pivots
2026-08-13 10:46:54 -04:00
NotoriousRebel