WEBDIENSTE/theHarvester
1
0
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2026-08-17 19:35:40 +02:00
Code Issues Packages Projects Releases Wiki Activity
4,805 Commits 3 Branches 38 Tags
master
Commit Graph
71 Commits
Author SHA1 Message Date
NotoriousRebel b7537f7d81 docs: correct 5.0.0 release notes 2026-08-16 22:43:15 -04:00
NotoriousRebel e26ccba7fe refactor: replace ujson with standard json 
Refs NotoriousRebel/theHarvester#325
 2026-08-16 19:53:34 -04:00
NotoriousRebel 2c847b84a2 Require Python 3.14 2026-08-16 19:40:13 -04:00
NotoriousRebel c91456531c feat: export completed runs as SQLite 2026-08-16 14:41:19 -04:00
NotoriousRebel de60af1f17 fix: reject removed adapter lifecycle state 2026-08-16 00:49:16 -04:00
NotoriousRebel 2ac59f3a38 refactor: centralize source execution lifecycle 2026-08-16 00:32:22 -04:00
NotoriousRebel c1101ca73a test: harden provider contracts and offline coverage 2026-08-15 21:26:35 -04:00
NotoriousRebel df1933b345 fix: preserve provider sessions across pagination 2026-08-15 13:20:26 -04:00
NotoriousRebel ef212e135f Merge remote-tracking branch 'upstream/dev' into codex/upstream-harvestview-impeccable 
# Conflicts:
#	CHANGELOG.md
 2026-08-15 11:56:04 -04:00
MattandGitHub 01f5561284 Merge pull request #2545 from NotoriousRebel/codex/upstream-takeover-evidence 
Replace takeover fingerprints with typed DNS-first evidence
 2026-08-15 11:52:11 -04:00
NotoriousRebel bbc7832c8f fix: reuse bounded takeover transport 2026-08-15 11:44:18 -04:00
NotoriousRebel 2691f0d258 fix: make HarvestView source readiness actionable 2026-08-15 11:43:32 -04:00
NotoriousRebel 4bcf2ceae9 fix: restore conservative source-worker default 2026-08-15 11:41:06 -04:00
NotoriousRebel aad754456a feat: improve HarvestView operator triage 2026-08-15 04:00:01 -04:00
NotoriousRebel ea9dab4b87 feat: replace takeover fingerprints with typed evidence 2026-08-15 03:30:33 -04:00
MattandGitHub f44807a046 refactor: run discovery sources with TaskGroup (#2544) 
* refactor: run discovery sources with TaskGroup

* fix: preserve source runner compatibility diagnostics

* feat: add configurable source workers
 2026-08-15 01:48:33 -04:00
MattandGitHub 4fef2c5e3b refactor: bound screenshot lifecycle ownership (#2543) 
* refactor: bound screenshot lifecycle ownership (#293)

* fix: retain HTTP error screenshots (#293)
 2026-08-14 23:10:34 -04:00
MattandGitHub 38e32de023 fix: complete API endpoint scans by default (#2539) 
* fix: complete API endpoint scans by default

* refactor: reuse shared cancellation cleanup
 2026-08-14 23:03:28 -04:00
MattandGitHub bb77613a05 fix: call Censys Platform API directly (#2537) 
* fix: call Censys Platform API directly (#295)

(cherry picked from commit 7ce361413ad35471ab0b6878382f3548b0918dbe)

* docs: clarify Censys global search entitlement
 2026-08-14 22:44:45 -04:00
MattandGitHub 3e864d3984 fix: update BuiltWith to current Domain API (#2536) 
* fix: update BuiltWith to current Domain API (#281)

* refactor: move hostname normalization to shared module
 2026-08-14 22:04:02 -04:00
MattandGitHub b8a8f7c7ca fix: move Shodan discovery into adapter (#2535) 
* fix: move Shodan discovery into adapter (#283)

* docs: clarify Shodan transport and persistence

* fix: query every Shodan-resolved IPv4

* fix: call Shodan Host API directly

* fix: serve HarvestView assets locally

* Revert "fix: serve HarvestView assets locally"

This reverts commit 413e8b25ab.

* docs: clarify Shodan proxy transport

* docs: clarify Shodan changelog entry

* feat: persist structured Shodan host evidence

* feat: expand Shodan discovery with TLS search
 2026-08-14 21:11:12 -04:00
MattandGitHub 259455f1c1 fix: remove Windvane DNS guessing fallback (#2541) 2026-08-14 15:14:53 -04:00
MattandGitHub 7c4420150d Add route-aware no-host result filtering (#2534) 2026-08-13 11:14:55 -04:00
MattandGitHub 624066a3e8 Add RouteViews enrichment and sourced ASN organization attribution (#2528) 
* Add RouteViews network enrichment

* Add authenticated RouteViews API access

* Restrict RouteViews to explicit network pivots

* Restore discovered ASN RouteViews enrichment

* Retain sourced ASN organization attribution

* Avoid dangling and repeated ASN attributions

* Keep automatic RouteViews evidence target-relevant

* Complete target-relevant RouteViews enrichment

* Clarify automatic RouteViews IP pivots
 2026-08-13 10:46:54 -04:00
MattandGitHub 1db27309dd Remove duplicate Chaos discovery source (#2533) 2026-08-12 18:47:34 -04:00
MattandGitHub aed50e0b0d Add crt.name composite hostname discovery (#2531) 2026-08-12 17:05:12 -04:00
MattandGitHub 4643f6f0f9 fix: use explicit provider and browser user agents (#2530) 2026-08-12 17:01:57 -04:00
MattandGitHub 38524ab674 Add Sourcegraph hostname candidates from indexed code (#2524) 
* feat: add bounded Sourcegraph discovery

Use the documented anonymous streaming API with explicit keyword, result, timeout, and line-match bounds; retain only scoped hostname and email evidence with truthful source outcomes.

* Harden Sourcegraph hostname discovery

* Raise Sourcegraph recall budget to 5000

* docs: clarify Sourcegraph candidate semantics

* test: account for combined source catalog
 2026-08-12 12:14:02 -04:00
MattandGitHub 91ed6c1d9f Add APIs.guru hostname, email, and URL discovery (#2525) 
* feat: add bounded APIs.guru discovery

* docs: clarify APIs.guru result boundaries
 2026-08-12 12:06:04 -04:00
MattandGitHub 801460f835 Fix passive provider failure attribution and parsing (#2518) 
* fix: harden passive provider reliability

* fix: restore HackerTarget reverse DNS coverage
 2026-08-11 17:04:11 -04:00
MattandGitHub fa8afa5e46 Add bounded virtual-host discovery (#2517) 
* Add bounded virtual-host discovery

* Document virtual host probe boundary
 2026-08-11 00:43:04 -04:00
MattandGitHub d766c7c59a Package HarvestView for local deployment (#2513) 
* feat: package HarvestView for local deployment

* Align container smoke with JSONL API

* Align container smoke with unversioned JSONL

* refactor: rename web launcher to harvestview
 2026-08-10 00:19:00 -04:00
MattandGitHub 1fd5749e52 Add an authenticated durable run API v1 (#2511) 
* Model active evidence in result persistence

* Expose active action diagnostics

* Persist truthful DNS action evidence

* Persist direct action evidence

* feat: add authenticated durable run API v1

* Make API file interchange JSONL-only

* Harden API evidence boundaries

* Remove API rate limiter

* Unify API runs with result persistence

* Support target action runs

* Keep DNS resolver selection action-neutral

* Add action-neutral CLI resolver selection

* Preserve API evidence across JSONL round trips

* Complete HarvestView API run parity

* Harden HarvestView run API contracts

* Remove obsolete bundled network snapshots

Delete the unused bundled AWS IP-range and resolver snapshots while preserving operator-supplied resolver file input.

* refactor: canonicalize URL results

* docs: define a bounded test budget

* Standardize hostname and IP result names

* fix(api): avoid duplicate evidence conflicts
 2026-08-10 00:08:04 -04:00
MattandGitHub 7a854eda95 Contract DeHashed and LeakIX evidence (#2506) 
* Contract DeHashed evidence handling

* Align LeakIX with its documented API

* Update provider capability selection

* Require REST auth for DeHashed results
 2026-08-07 00:25:54 -04:00
MattandGitHub eb7583227a Expose authenticated recursive DNS through REST (#2502) 
* Expose recursive DNS through REST

* Align REST recursive DNS limits and evidence

* Document hard recursive DNS query limits

* Reject non-finite recursive DNS REST runtimes

* Require operator authentication for REST recursion
 2026-08-06 22:53:02 -04:00
MattandGitHub 8d8bbdc060 Preserve POST semantics through proxies (#2498) 2026-08-06 21:32:02 -04:00
MattandGitHub 9ff9115dcf Migrate Pentest-Tools discovery to API v2 (#2497) 
* Migrate Pentest-Tools discovery to API v2

* Send Pentest scan payload as JSON
 2026-08-06 21:27:30 -04:00
MattandGitHub 4f76b93513 Preserve direct DNS source result contracts (#2494) 
* Harden explicit DNS direct source contracts

* Reject mismatched Shodan InternetDB evidence

* Preserve valid direct-source IP evidence

* Avoid ambiguous hostname output assertions

* Reference current Pentest-Tools scan documentation
 2026-08-06 20:16:23 -04:00
MattandGitHub d60afe12e1 Retain GitLab evidence URLs (#2492) 2026-08-06 15:39:26 -04:00
MattandGitHub 61d39dda3a feat: add Arquivo.pt passive source (#2490) 2026-08-06 14:47:33 -04:00
MattandGitHub 16c4866b49 fix: drive all from passive source catalog (#2489) 2026-08-06 14:47:33 -04:00
MattandGitHub a7f883e45c feat: add HIBP verified-domain source (#2488) 2026-08-06 14:47:33 -04:00
MattandGitHub ffd03b13ba fix: make FullHunt outcomes explicit (#2486) 2026-08-06 12:01:17 -04:00
MattandGitHub 41b9a2e28b Make Fofa provider outcomes explicit (#2485) 
* fix: make Fofa outcomes explicit

* fix: classify Fofa provider errors
 2026-08-06 11:59:07 -04:00
MattandGitHub 4ab4e88121 fix: make Chaos outcomes explicit (#2484) 2026-08-06 11:56:41 -04:00
MattandGitHub c8afaeefea feat: expose completed run history over REST (#2483) 2026-08-06 11:09:01 -04:00
MattandGitHub 873f649902 feat: add Shodan CT passive source (#2482) 2026-08-06 09:50:49 -04:00
MattandGitHub e1d2236685 fix: persist terminal evidence for REST queries (#2481) 2026-08-06 09:50:15 -04:00
MattandGitHub ab314b0274 feat: support REST source capability selectors (#2480) 2026-08-06 09:44:47 -04:00
NotoriousRebel 1b4268888e fix: retain Hudson Rock stealer results 2026-08-05 23:56:40 -04:00