WEBDIENSTE/theHarvester
1
0
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2026-08-17 19:35:40 +02:00
Code Issues Packages Projects Releases Wiki Activity
4,754 Commits 3 Branches 38 Tags
5e99ef34e6fbb1aeed78366f685eec43c4146c0a
Commit Graph
4754 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
NotoriousRebel 5e99ef34e6 Merge upstream master into dev 2026-08-16 02:13:14 -04:00
MattandGitHub 219a7c568b Merge pull request #2552 from NotoriousRebel/codex/deepen-source-execution-lifecycle 
Centralize passive-source execution lifecycle
 2026-08-16 00:54:08 -04:00
NotoriousRebel de60af1f17 fix: reject removed adapter lifecycle state 2026-08-16 00:49:16 -04:00
NotoriousRebel 02deafa6f1 fix: reject malformed ZoomEye URL fields 2026-08-16 00:36:14 -04:00
NotoriousRebel 2ac59f3a38 refactor: centralize source execution lifecycle 2026-08-16 00:32:22 -04:00
MattandGitHub f3dc2eb7ab Merge pull request #2550 from NotoriousRebel/codex/provider-contract-release-gate 
Harden provider contracts and enforce offline coverage
 2026-08-16 00:32:00 -04:00
NotoriousRebel 7f946d61f7 fix: align C99 provider failure classification 2026-08-15 23:13:24 -04:00
MattandGitHub 70991a625b Merge pull request #2551 from NotoriousRebel/codex/upstream-gh-cli-host-auth 
Clarify GitHub CLI authentication diagnostics
 2026-08-15 22:36:06 -04:00
NotoriousRebel 8bee09c815 docs: distinguish GitHub connectivity from auth failures 2026-08-15 22:28:22 -04:00
NotoriousRebel 6e0e761661 fix: close provider contract review gaps 2026-08-15 22:28:14 -04:00
NotoriousRebel cab5717126 test: assert complete URLScan pagination output 2026-08-15 21:38:59 -04:00
NotoriousRebel 3e9058a44b docs: clarify GitHub CLI auth diagnostics 2026-08-15 21:34:16 -04:00
NotoriousRebel c1101ca73a test: harden provider contracts and offline coverage 2026-08-15 21:26:35 -04:00
MattandGitHub 4c35f8c28d Merge pull request #2549 from NotoriousRebel/codex/upstream-provider-session-lifecycle 
fix: preserve provider sessions across pagination
 2026-08-15 14:48:28 -04:00
NotoriousRebel df1933b345 fix: preserve provider sessions across pagination 2026-08-15 13:20:26 -04:00
MattandGitHub 6f1e33e896 Merge pull request #2547 from NotoriousRebel/codex/upstream-harvestview-impeccable 
Improve HarvestView run triage and mobile evidence
 2026-08-15 11:58:30 -04:00
NotoriousRebel ef212e135f Merge remote-tracking branch 'upstream/dev' into codex/upstream-harvestview-impeccable 
# Conflicts:
#	CHANGELOG.md
 2026-08-15 11:56:04 -04:00
MattandGitHub 01f5561284 Merge pull request #2545 from NotoriousRebel/codex/upstream-takeover-evidence 
Replace takeover fingerprints with typed DNS-first evidence
 2026-08-15 11:52:11 -04:00
MattandGitHub fad5485de5 Merge pull request #2548 from NotoriousRebel/codex/upstream-source-workers-default 
fix: restore conservative source-worker default
 2026-08-15 11:51:57 -04:00
NotoriousRebel bbc7832c8f fix: reuse bounded takeover transport 2026-08-15 11:44:18 -04:00
NotoriousRebel 2691f0d258 fix: make HarvestView source readiness actionable 2026-08-15 11:43:32 -04:00
NotoriousRebel 4bcf2ceae9 fix: restore conservative source-worker default 2026-08-15 11:41:06 -04:00
NotoriousRebel aad754456a feat: improve HarvestView operator triage 2026-08-15 04:00:01 -04:00
NotoriousRebel ea9dab4b87 feat: replace takeover fingerprints with typed evidence 2026-08-15 03:30:33 -04:00
MattandGitHub f44807a046 refactor: run discovery sources with TaskGroup (#2544) 
* refactor: run discovery sources with TaskGroup

* fix: preserve source runner compatibility diagnostics

* feat: add configurable source workers
 2026-08-15 01:48:33 -04:00
MattandGitHub 4c5e2df9a7 refactor: modernize event-loop bootstrap (#296) (#2538) 2026-08-14 23:16:47 -04:00
MattandGitHub 4fef2c5e3b refactor: bound screenshot lifecycle ownership (#2543) 
* refactor: bound screenshot lifecycle ownership (#293)

* fix: retain HTTP error screenshots (#293)
 2026-08-14 23:10:34 -04:00
MattandGitHub 38e32de023 fix: complete API endpoint scans by default (#2539) 
* fix: complete API endpoint scans by default

* refactor: reuse shared cancellation cleanup
 2026-08-14 23:03:28 -04:00
MattandGitHub 1a9b114a5d fix: complete DNS enumeration by default (#2542) 
* fix: complete DNS enumeration by default

* test: avoid URL substring sanitizer alert
 2026-08-14 22:54:25 -04:00
MattandGitHub bb77613a05 fix: call Censys Platform API directly (#2537) 
* fix: call Censys Platform API directly (#295)

(cherry picked from commit 7ce361413ad35471ab0b6878382f3548b0918dbe)

* docs: clarify Censys global search entitlement
 2026-08-14 22:44:45 -04:00
MattandGitHub 3e864d3984 fix: update BuiltWith to current Domain API (#2536) 
* fix: update BuiltWith to current Domain API (#281)

* refactor: move hostname normalization to shared module
 2026-08-14 22:04:02 -04:00
MattandGitHub b8a8f7c7ca fix: move Shodan discovery into adapter (#2535) 
* fix: move Shodan discovery into adapter (#283)

* docs: clarify Shodan transport and persistence

* fix: query every Shodan-resolved IPv4

* fix: call Shodan Host API directly

* fix: serve HarvestView assets locally

* Revert "fix: serve HarvestView assets locally"

This reverts commit 413e8b25ab.

* docs: clarify Shodan proxy transport

* docs: clarify Shodan changelog entry

* feat: persist structured Shodan host evidence

* feat: expand Shodan discovery with TLS search
 2026-08-14 21:11:12 -04:00
MattandGitHub 259455f1c1 fix: remove Windvane DNS guessing fallback (#2541) 2026-08-14 15:14:53 -04:00
MattandGitHub 7c4420150d Add route-aware no-host result filtering (#2534) 2026-08-13 11:14:55 -04:00
MattandGitHub 624066a3e8 Add RouteViews enrichment and sourced ASN organization attribution (#2528) 
* Add RouteViews network enrichment

* Add authenticated RouteViews API access

* Restrict RouteViews to explicit network pivots

* Restore discovered ASN RouteViews enrichment

* Retain sourced ASN organization attribution

* Avoid dangling and repeated ASN attributions

* Keep automatic RouteViews evidence target-relevant

* Complete target-relevant RouteViews enrichment

* Clarify automatic RouteViews IP pivots
 2026-08-13 10:46:54 -04:00
MattandGitHub 1db27309dd Remove duplicate Chaos discovery source (#2533) 2026-08-12 18:47:34 -04:00
MattandGitHub aed50e0b0d Add crt.name composite hostname discovery (#2531) 2026-08-12 17:05:12 -04:00
MattandGitHub 4643f6f0f9 fix: use explicit provider and browser user agents (#2530) 2026-08-12 17:01:57 -04:00
MattandGitHub 38524ab674 Add Sourcegraph hostname candidates from indexed code (#2524) 
* feat: add bounded Sourcegraph discovery

Use the documented anonymous streaming API with explicit keyword, result, timeout, and line-match bounds; retain only scoped hostname and email evidence with truthful source outcomes.

* Harden Sourcegraph hostname discovery

* Raise Sourcegraph recall budget to 5000

* docs: clarify Sourcegraph candidate semantics

* test: account for combined source catalog
 2026-08-12 12:14:02 -04:00
MattandGitHub 91ed6c1d9f Add APIs.guru hostname, email, and URL discovery (#2525) 
* feat: add bounded APIs.guru discovery

* docs: clarify APIs.guru result boundaries
 2026-08-12 12:06:04 -04:00
MattandGitHub f13280ddad Add typed ASN-prefix routing evidence (#2527) 
* Add typed network evidence foundation

* Deepen network evidence accumulation

* Bound network evidence accumulator limits

* Make nested JSON rejection test version tolerant

* Keep network evidence in unreleased schema v8

* Clarify structured result persistence dispatch
 2026-08-12 10:49:16 -04:00
MattandGitHub ac3c543768 Add bounded provider response streaming (#2526) 
* Add bounded provider response streaming

* Add bounded provider JSON fetching
 2026-08-12 09:41:13 -04:00
MattandGitHub dd93a0e63d fix: persist missing credential outcomes (#2523) 2026-08-12 09:40:37 -04:00
J.TownsendandGitHub 6c5f3a3884 Merge pull request #2521 from laramies/dependabot/master/all_dependencies-d52db68a4b 2026-08-11 22:41:41 +01:00
dependabot[bot]andGitHub 39620025e1 build(deps): Bump the all-dependencies group with 6 updates 
Bumps the all-dependencies group with 6 updates:

| Package | From | To |
| --- | --- | --- |
| [step-security/harden-runner](https://github.com/step-security/harden-runner) | `2.20.0` | `2.20.1` |
| [github/codeql-action/init](https://github.com/github/codeql-action) | `4.37.3` | `4.37.6` |
| [github/codeql-action/autobuild](https://github.com/github/codeql-action) | `4.37.3` | `4.37.6` |
| [github/codeql-action/analyze](https://github.com/github/codeql-action) | `4.37.3` | `4.37.6` |
| [docker/login-action](https://github.com/docker/login-action) | `4.5.2` | `4.6.0` |
| [github/codeql-action/upload-sarif](https://github.com/github/codeql-action) | `4.37.3` | `4.37.6` |


Updates `step-security/harden-runner` from 2.20.0 to 2.20.1
- [Release notes](https://github.com/step-security/harden-runner/releases)
- [Commits](https://github.com/step-security/harden-runner/compare/bf7454d06d71f1098171f2acdf0cd4708d7b5920...b09bb98e06d4d774595224525879c09bc6e98c40)

Updates `github/codeql-action/init` from 4.37.3 to 4.37.6
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/e4fba868fa4b1b91e1fdab776edc8cfbe6e9fb81...5595ccaf912efad79be6eef63a5619ff05969be3)

Updates `github/codeql-action/autobuild` from 4.37.3 to 4.37.6
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/e4fba868fa4b1b91e1fdab776edc8cfbe6e9fb81...5595ccaf912efad79be6eef63a5619ff05969be3)

Updates `github/codeql-action/analyze` from 4.37.3 to 4.37.6
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/e4fba868fa4b1b91e1fdab776edc8cfbe6e9fb81...5595ccaf912efad79be6eef63a5619ff05969be3)

Updates `docker/login-action` from 4.5.2 to 4.6.0
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](https://github.com/docker/login-action/compare/371161bbe7024a29a25c5e19bfcbc0804fe9ad2c...dbcb813823bdd20940b903addbd779551569679f)

Updates `github/codeql-action/upload-sarif` from 4.37.3 to 4.37.6
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/e4fba868fa4b1b91e1fdab776edc8cfbe6e9fb81...5595ccaf912efad79be6eef63a5619ff05969be3)

---
updated-dependencies:
- dependency-name: step-security/harden-runner
  dependency-version: 2.20.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: all-dependencies
- dependency-name: github/codeql-action/init
  dependency-version: 4.37.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: all-dependencies
- dependency-name: github/codeql-action/autobuild
  dependency-version: 4.37.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: all-dependencies
- dependency-name: github/codeql-action/analyze
  dependency-version: 4.37.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: all-dependencies
- dependency-name: docker/login-action
  dependency-version: 4.6.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: all-dependencies
- dependency-name: github/codeql-action/upload-sarif
  dependency-version: 4.37.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: all-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-08-11 21:20:54 +00:00
MattandGitHub 801460f835 Fix passive provider failure attribution and parsing (#2518) 
* fix: harden passive provider reliability

* fix: restore HackerTarget reverse DNS coverage
 2026-08-11 17:04:11 -04:00
MattandGitHub fa8afa5e46 Add bounded virtual-host discovery (#2517) 
* Add bounded virtual-host discovery

* Document virtual host probe boundary
 2026-08-11 00:43:04 -04:00
L1ghtn1ng 6af1351e36 fix new ruff and ty issues 2026-08-10 20:40:58 +01:00
L1ghtn1ng be2c0556e2 Update deps 2026-08-10 20:31:56 +01:00
MattandGitHub d766c7c59a Package HarvestView for local deployment (#2513) 
* feat: package HarvestView for local deployment

* Align container smoke with JSONL API

* Align container smoke with unversioned JSONL

* refactor: rename web launcher to harvestview
 2026-08-10 00:19:00 -04:00