WEBDIENSTE/theHarvester
1
0
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2026-08-17 19:35:40 +02:00
Code Issues Packages Projects Releases Wiki Activity
4,805 Commits 3 Branches 38 Tags
master
Commit Graph
44 Commits
Author SHA1 Message Date
NotoriousRebel b37f413c77 docs: simplify source matrix and JSONL example 2026-08-17 01:03:25 -04:00
NotoriousRebel d0c6583c64 docs: make source matrix easier to scan 2026-08-17 00:26:22 -04:00
NotoriousRebel 4c35f1c54f docs: make README diagrams readable 2026-08-17 00:19:56 -04:00
NotoriousRebel d940ba25ba docs: make the wiki operator focused 2026-08-17 00:01:58 -04:00
NotoriousRebel a9a2318adc docs: make wiki diagrams readable 2026-08-16 23:48:02 -04:00
NotoriousRebel b14e564c89 docs: link discovery sources to providers 2026-08-16 21:02:37 -04:00
NotoriousRebel 8cfd6cf7bb docs: refocus README on current usage 2026-08-16 15:02:44 -04:00
NotoriousRebel c91456531c feat: export completed runs as SQLite 2026-08-16 14:41:19 -04:00
NotoriousRebel 60ad04ee16 Document JSONL route extraction 2026-08-16 14:07:36 -04:00
NotoriousRebel 5dcc5ecd25 Remove duplicate diagram HTML 2026-08-16 13:55:45 -04:00
NotoriousRebel edeb440f6b Expand README architecture diagrams 2026-08-16 13:38:19 -04:00
NotoriousRebel bc30f6b82d Restore live package version table 2026-08-16 13:22:47 -04:00
NotoriousRebel ab931d1da5 docs: correct evidence architecture diagram 2026-08-16 12:53:03 -04:00
NotoriousRebel 03bb10abfc docs: make JSONL the primary workflow 2026-08-16 11:50:38 -04:00
NotoriousRebel ea9dab4b87 feat: replace takeover fingerprints with typed evidence 2026-08-15 03:30:33 -04:00
MattandGitHub b8a8f7c7ca fix: move Shodan discovery into adapter (#2535) 
* fix: move Shodan discovery into adapter (#283)

* docs: clarify Shodan transport and persistence

* fix: query every Shodan-resolved IPv4

* fix: call Shodan Host API directly

* fix: serve HarvestView assets locally

* Revert "fix: serve HarvestView assets locally"

This reverts commit 413e8b25ab.

* docs: clarify Shodan proxy transport

* docs: clarify Shodan changelog entry

* feat: persist structured Shodan host evidence

* feat: expand Shodan discovery with TLS search
 2026-08-14 21:11:12 -04:00
MattandGitHub 624066a3e8 Add RouteViews enrichment and sourced ASN organization attribution (#2528) 
* Add RouteViews network enrichment

* Add authenticated RouteViews API access

* Restrict RouteViews to explicit network pivots

* Restore discovered ASN RouteViews enrichment

* Retain sourced ASN organization attribution

* Avoid dangling and repeated ASN attributions

* Keep automatic RouteViews evidence target-relevant

* Complete target-relevant RouteViews enrichment

* Clarify automatic RouteViews IP pivots
 2026-08-13 10:46:54 -04:00
MattandGitHub 1db27309dd Remove duplicate Chaos discovery source (#2533) 2026-08-12 18:47:34 -04:00
MattandGitHub aed50e0b0d Add crt.name composite hostname discovery (#2531) 2026-08-12 17:05:12 -04:00
MattandGitHub 38524ab674 Add Sourcegraph hostname candidates from indexed code (#2524) 
* feat: add bounded Sourcegraph discovery

Use the documented anonymous streaming API with explicit keyword, result, timeout, and line-match bounds; retain only scoped hostname and email evidence with truthful source outcomes.

* Harden Sourcegraph hostname discovery

* Raise Sourcegraph recall budget to 5000

* docs: clarify Sourcegraph candidate semantics

* test: account for combined source catalog
 2026-08-12 12:14:02 -04:00
MattandGitHub 91ed6c1d9f Add APIs.guru hostname, email, and URL discovery (#2525) 
* feat: add bounded APIs.guru discovery

* docs: clarify APIs.guru result boundaries
 2026-08-12 12:06:04 -04:00
MattandGitHub fa8afa5e46 Add bounded virtual-host discovery (#2517) 
* Add bounded virtual-host discovery

* Document virtual host probe boundary
 2026-08-11 00:43:04 -04:00
MattandGitHub 1fd5749e52 Add an authenticated durable run API v1 (#2511) 
* Model active evidence in result persistence

* Expose active action diagnostics

* Persist truthful DNS action evidence

* Persist direct action evidence

* feat: add authenticated durable run API v1

* Make API file interchange JSONL-only

* Harden API evidence boundaries

* Remove API rate limiter

* Unify API runs with result persistence

* Support target action runs

* Keep DNS resolver selection action-neutral

* Add action-neutral CLI resolver selection

* Preserve API evidence across JSONL round trips

* Complete HarvestView API run parity

* Harden HarvestView run API contracts

* Remove obsolete bundled network snapshots

Delete the unused bundled AWS IP-range and resolver snapshots while preserving operator-supplied resolver file input.

* refactor: canonicalize URL results

* docs: define a bounded test budget

* Standardize hostname and IP result names

* fix(api): avoid duplicate evidence conflicts
 2026-08-10 00:08:04 -04:00
MattandGitHub e4d37b05a8 Persist per-source run provenance (#2516) 
* Persist per-source run provenance

* Keep the first JSONL contract unversioned

* Explain source yield counts
 2026-08-09 11:50:08 -04:00
MattandGitHub 6b02dbddc9 Share safe enumeration execution across transports (#2507) 
* feat: share safe enumeration execution across transports

* fix: clarify safe scan contracts

* fix: preserve public screenshot redirects

* fix: restore operator-controlled active requests

* fix: allow operator-selected API scan targets
 2026-08-07 16:02:16 -04:00
MattandGitHub 7a854eda95 Contract DeHashed and LeakIX evidence (#2506) 
* Contract DeHashed evidence handling

* Align LeakIX with its documented API

* Update provider capability selection

* Require REST auth for DeHashed results
 2026-08-07 00:25:54 -04:00
MattandGitHub 30ac342d9d Remove unavailable Venacus source (#2505) 2026-08-07 00:04:47 -04:00
MattandGitHub d60afe12e1 Retain GitLab evidence URLs (#2492) 2026-08-06 15:39:26 -04:00
MattandGitHub 61d39dda3a feat: add Arquivo.pt passive source (#2490) 2026-08-06 14:47:33 -04:00
MattandGitHub a7f883e45c feat: add HIBP verified-domain source (#2488) 2026-08-06 14:47:33 -04:00
MattandGitHub 873f649902 feat: add Shodan CT passive source (#2482) 2026-08-06 09:50:49 -04:00
NotoriousRebel 35b368b705 fix: retain HIBP breach names in completed results 2026-08-05 23:02:36 -04:00
NotoriousRebel e063c42a08 fix: remove invalid Bitbucket domain source (#100) 2026-08-05 21:45:08 -04:00
NotoriousRebel 7af23e4382 fix: remove nonfunctional ThreatCrowd source (#98) 2026-08-05 20:48:35 -04:00
NotoriousRebel c56c20a57d refactor: model subdomain result routes explicitly 2026-08-01 13:33:54 -04:00
NotoriousRebel 3bc9cfb296 refactor: derive source capabilities from result routes 2026-07-30 19:47:52 -04:00
NotoriousRebel 4a69697451 feat: select sources by result capability 2026-07-30 19:47:51 -04:00
NotoriousRebel 9b41b78e86 feat: add DNSDB passive discovery source 2026-07-29 21:47:04 -04:00
NotoriousRebel ef6150c019 docs: simplify operator guidance 2026-07-29 11:55:06 -04:00
NotoriousRebel 82457b3faa docs: restore project social links 2026-07-29 00:08:13 -04:00
NotoriousRebel 031df90032 Draft operator wiki overhaul 2026-07-21 01:05:01 -04:00
NotoriousRebel 241ee23e06 Clarify source credentials and report output 2026-07-21 00:55:26 -04:00
NotoriousRebel c7707c29bb test: verify README source output contracts 2026-07-20 23:53:14 -04:00
NotoriousRebel 1e0e1027c9 docs: correct source output matrix 2026-07-20 23:53:14 -04:00