WEBDIENSTE/theHarvester
1
0
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2026-08-17 19:35:40 +02:00
Code Issues Packages Projects Releases Wiki Activity
4,805 Commits 3 Branches 38 Tags
master
Commit Graph
292 Commits
Author SHA1 Message Date
NotoriousRebel 34f64e3624 Remove unused development dependencies 
Refs NotoriousRebel/theHarvester#327
 2026-08-16 21:43:28 -04:00
NotoriousRebel 876d9aa602 Remove unused runtime dependencies 
Refs NotoriousRebel/theHarvester#326
 2026-08-16 21:35:22 -04:00
L1ghtn1ng 773042351a bump ruff to py3.14 and fix all the errors from mypy,ty,pytest and ruff issues 2026-08-17 02:13:55 +01:00
NotoriousRebel e26ccba7fe refactor: replace ujson with standard json 
Refs NotoriousRebel/theHarvester#325
 2026-08-16 19:53:34 -04:00
NotoriousRebel 2c847b84a2 Require Python 3.14 2026-08-16 19:40:13 -04:00
NotoriousRebel 5e99ef34e6 Merge upstream master into dev 2026-08-16 02:13:14 -04:00
NotoriousRebel c1101ca73a test: harden provider contracts and offline coverage 2026-08-15 21:26:35 -04:00
MattandGitHub 4fef2c5e3b refactor: bound screenshot lifecycle ownership (#2543) 
* refactor: bound screenshot lifecycle ownership (#293)

* fix: retain HTTP error screenshots (#293)
 2026-08-14 23:10:34 -04:00
MattandGitHub bb77613a05 fix: call Censys Platform API directly (#2537) 
* fix: call Censys Platform API directly (#295)

(cherry picked from commit 7ce361413ad35471ab0b6878382f3548b0918dbe)

* docs: clarify Censys global search entitlement
 2026-08-14 22:44:45 -04:00
MattandGitHub b8a8f7c7ca fix: move Shodan discovery into adapter (#2535) 
* fix: move Shodan discovery into adapter (#283)

* docs: clarify Shodan transport and persistence

* fix: query every Shodan-resolved IPv4

* fix: call Shodan Host API directly

* fix: serve HarvestView assets locally

* Revert "fix: serve HarvestView assets locally"

This reverts commit 413e8b25ab.

* docs: clarify Shodan proxy transport

* docs: clarify Shodan changelog entry

* feat: persist structured Shodan host evidence

* feat: expand Shodan discovery with TLS search
 2026-08-14 21:11:12 -04:00
L1ghtn1ng be2c0556e2 Update deps 2026-08-10 20:31:56 +01:00
MattandGitHub d766c7c59a Package HarvestView for local deployment (#2513) 
* feat: package HarvestView for local deployment

* Align container smoke with JSONL API

* Align container smoke with unversioned JSONL

* refactor: rename web launcher to harvestview
 2026-08-10 00:19:00 -04:00
MattandGitHub 0d2ab5a0b3 Add the HarvestView web application (#2512) 
* feat: add HarvestView operator UI

* Use JSONL-only HarvestView file flows

* Drive HarvestView activities from the API catalog

* Add result action controls

* Render shared DNS resolver defaults

* Clarify resolver cardinality in HarvestView

* Load Tabulator from CDNjs

* Fix HarvestView wiki link

* Align HarvestView with execution status contract

* Add HarvestView import and action controls

* Harden HarvestView browser assertions

* Simplify HarvestView run selection

* Show truthful HarvestView execution outcomes

* refactor: show canonical URL results in HarvestView

* Show canonical hostname results in HarvestView

* test(harvestview): remove browser error race
 2026-08-10 00:08:05 -04:00
MattandGitHub 1fd5749e52 Add an authenticated durable run API v1 (#2511) 
* Model active evidence in result persistence

* Expose active action diagnostics

* Persist truthful DNS action evidence

* Persist direct action evidence

* feat: add authenticated durable run API v1

* Make API file interchange JSONL-only

* Harden API evidence boundaries

* Remove API rate limiter

* Unify API runs with result persistence

* Support target action runs

* Keep DNS resolver selection action-neutral

* Add action-neutral CLI resolver selection

* Preserve API evidence across JSONL round trips

* Complete HarvestView API run parity

* Harden HarvestView run API contracts

* Remove obsolete bundled network snapshots

Delete the unused bundled AWS IP-range and resolver snapshots while preserving operator-supplied resolver file input.

* refactor: canonicalize URL results

* docs: define a bounded test budget

* Standardize hostname and IP result names

* fix(api): avoid duplicate evidence conflicts
 2026-08-10 00:08:04 -04:00
MattandGitHub c4af833da0 Use SQLAlchemy for async result persistence (#2515) 
* Use SQLAlchemy for async result persistence

* Explain persistence ORM records

* Clarify persisted run schema

* Clarify legacy schema migration

* Consolidate result persistence

* Preserve incomplete legacy observations
 2026-08-09 00:50:39 -04:00
dependabot[bot]andGitHub ada296dd73 build(deps): Bump aiohttp from 3.14.1 to 3.14.3 
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.14.1 to 3.14.3.
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.14.1...v3.14.3)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-version: 3.14.3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-08-04 21:02:25 +00:00
L1ghtn1ng 52a79cdbc7 Add recommend uv param 2026-07-30 22:08:49 +01:00
NotoriousRebel 30cf310952 test: make routine CI offline by default 2026-07-28 20:26:41 -04:00
J.TownsendandGitHub 8a7b8b71d6 Merge pull request #2406 from NotoriousRebel/codex/upstream-dev-verbose-logging 2026-07-29 00:04:21 +01:00
L1ghtn1ng 7476559468 Add recommend uv param 2026-07-26 17:45:24 +01:00
NotoriousRebel 241ee23e06 Clarify source credentials and report output 2026-07-21 00:55:26 -04:00
NotoriousRebel 90bbd9ddd6 refactor: route operator output through logging 2026-07-20 23:37:09 -04:00
J.TownsendandGitHub b5495a4739 Merge pull request #2385 from laramies/dependabot/uv/master/pytest-9.1.1 2026-06-27 21:01:06 +01:00
dependabot[bot]andGitHub b528696dbc build(deps-dev): Bump pytest from 9.1.0 to 9.1.1 
Bumps [pytest](https://github.com/pytest-dev/pytest) from 9.1.0 to 9.1.1.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/9.1.0...9.1.1)

---
updated-dependencies:
- dependency-name: pytest
  dependency-version: 9.1.1
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-27 20:00:13 +00:00
dependabot[bot]andGitHub 8f518c0371 build(deps): Bump certifi from 2026.5.20 to 2026.6.17 
Bumps [certifi](https://github.com/certifi/python-certifi) from 2026.5.20 to 2026.6.17.
- [Commits](https://github.com/certifi/python-certifi/compare/2026.05.20...2026.06.17)

---
updated-dependencies:
- dependency-name: certifi
  dependency-version: 2026.6.17
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-27 20:00:01 +00:00
J.TownsendandGitHub 434e428572 Merge pull request #2394 from laramies/dependabot/uv/master/ruff-0.15.20 2026-06-27 20:57:43 +01:00
dependabot[bot]andGitHub 10441a48d4 build(deps-dev): Bump ruff from 0.15.17 to 0.15.20 
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.17 to 0.15.20.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.15.17...0.15.20)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.20
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-27 19:56:48 +00:00
J.TownsendandGitHub d760ad05aa Merge pull request #2395 from laramies/dependabot/uv/master/fastapi-0.138.1 2026-06-27 20:56:25 +01:00
dependabot[bot]andGitHub 27c1437b10 build(deps-dev): Bump ty from 0.0.49 to 0.0.54 
Bumps [ty](https://github.com/astral-sh/ty) from 0.0.49 to 0.0.54.
- [Release notes](https://github.com/astral-sh/ty/releases)
- [Changelog](https://github.com/astral-sh/ty/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ty/compare/0.0.49...0.0.54)

---
updated-dependencies:
- dependency-name: ty
  dependency-version: 0.0.54
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-25 21:14:06 +00:00
dependabot[bot]andGitHub 79b2a48534 build(deps): Bump fastapi from 0.137.1 to 0.138.1 
Bumps [fastapi](https://github.com/fastapi/fastapi) from 0.137.1 to 0.138.1.
- [Release notes](https://github.com/fastapi/fastapi/releases)
- [Commits](https://github.com/fastapi/fastapi/compare/0.137.1...0.138.1)

---
updated-dependencies:
- dependency-name: fastapi
  dependency-version: 0.138.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-25 21:13:52 +00:00
J.TownsendandGitHub e636600c2d Merge pull request #2371 from laramies/dependabot/uv/master/ujson-5.13.0 
build(deps): Bump ujson from 5.12.1 to 5.13.0
 2026-06-17 01:30:29 +01:00
J.TownsendandGitHub 3f01813a6a Merge pull request #2367 from laramies/dependabot/uv/master/ruff-0.15.17 
build(deps-dev): Bump ruff from 0.15.16 to 0.15.17
 2026-06-17 01:29:59 +01:00
dependabot[bot]andGitHub c23e4e3a4e build(deps): Bump ujson from 5.12.1 to 5.13.0 
Bumps [ujson](https://github.com/ultrajson/ultrajson) from 5.12.1 to 5.13.0.
- [Release notes](https://github.com/ultrajson/ultrajson/releases)
- [Commits](https://github.com/ultrajson/ultrajson/compare/5.12.1...5.13.0)

---
updated-dependencies:
- dependency-name: ujson
  dependency-version: 5.13.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-17 00:28:56 +00:00
J.TownsendandGitHub 84a0d9cac0 Merge pull request #2376 from laramies/dependabot/uv/aiohttp-3.14.1 
build(deps): Bump aiohttp from 3.14.0 to 3.14.1
 2026-06-17 01:28:33 +01:00
J.TownsendandGitHub 64a7c9dae7 Merge pull request #2372 from laramies/dependabot/uv/master/slowapi-0.1.10 
build(deps): Bump slowapi from 0.1.9 to 0.1.10
 2026-06-17 01:26:53 +01:00
dependabot[bot]andGitHub e65d0d59e0 build(deps): Bump aiohttp from 3.14.0 to 3.14.1 
---
updated-dependencies:
- dependency-name: aiohttp
  dependency-version: 3.14.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-17 00:22:35 +00:00
dependabot[bot]andGitHub 6207ea3ae9 build(deps-dev): Bump ruff from 0.15.16 to 0.15.17 
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.16 to 0.15.17.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.15.16...0.15.17)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.17
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-17 00:18:10 +00:00
J.TownsendandGitHub a73be1567c Merge pull request #2369 from laramies/dependabot/uv/master/ty-0.0.49 
build(deps-dev): Bump ty from 0.0.46 to 0.0.49
 2026-06-17 01:16:00 +01:00
J.TownsendandGitHub 76de07aed2 Merge pull request #2373 from laramies/dependabot/uv/master/pytest-9.1.0 
build(deps-dev): Bump pytest from 9.0.3 to 9.1.0
 2026-06-17 01:15:41 +01:00
J.TownsendandGitHub 5e76760359 Merge pull request #2360 from laramies/dependabot/uv/master/beautifulsoup4-4.15.0 
build(deps): Bump beautifulsoup4 from 4.14.3 to 4.15.0
 2026-06-17 01:14:28 +01:00
dependabot[bot]andGitHub dd40d680a7 build(deps): Bump fastapi from 0.136.3 to 0.137.1 
Bumps [fastapi](https://github.com/fastapi/fastapi) from 0.136.3 to 0.137.1.
- [Release notes](https://github.com/fastapi/fastapi/releases)
- [Commits](https://github.com/fastapi/fastapi/compare/0.136.3...0.137.1)

---
updated-dependencies:
- dependency-name: fastapi
  dependency-version: 0.137.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-15 21:15:26 +00:00
dependabot[bot]andGitHub d663dcabd3 build(deps-dev): Bump pytest from 9.0.3 to 9.1.0 
Bumps [pytest](https://github.com/pytest-dev/pytest) from 9.0.3 to 9.1.0.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/9.0.3...9.1.0)

---
updated-dependencies:
- dependency-name: pytest
  dependency-version: 9.1.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-15 21:15:05 +00:00
dependabot[bot]andGitHub e5cedb79c8 build(deps): Bump slowapi from 0.1.9 to 0.1.10 
Bumps [slowapi](https://github.com/laurents/slowapi) from 0.1.9 to 0.1.10.
- [Release notes](https://github.com/laurents/slowapi/releases)
- [Changelog](https://github.com/laurentS/slowapi/blob/master/CHANGELOG.md)
- [Commits](https://github.com/laurents/slowapi/compare/v0.1.9...v0.1.10)

---
updated-dependencies:
- dependency-name: slowapi
  dependency-version: 0.1.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-15 21:14:52 +00:00
dependabot[bot]andGitHub 0a3af71467 build(deps-dev): Bump ty from 0.0.46 to 0.0.49 
Bumps [ty](https://github.com/astral-sh/ty) from 0.0.46 to 0.0.49.
- [Release notes](https://github.com/astral-sh/ty/releases)
- [Changelog](https://github.com/astral-sh/ty/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ty/compare/0.0.46...0.0.49)

---
updated-dependencies:
- dependency-name: ty
  dependency-version: 0.0.49
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-12 21:13:52 +00:00
dependabot[bot]andGitHub 85df3c7299 build(deps-dev): Bump ty from 0.0.42 to 0.0.46 
Bumps [ty](https://github.com/astral-sh/ty) from 0.0.42 to 0.0.46.
- [Release notes](https://github.com/astral-sh/ty/releases)
- [Changelog](https://github.com/astral-sh/ty/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ty/compare/0.0.42...0.0.46)

---
updated-dependencies:
- dependency-name: ty
  dependency-version: 0.0.46
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-10 01:21:21 +00:00
J.TownsendandGitHub 180cf052fb Merge pull request #2354 from laramies/dependabot/uv/master/uvicorn-0.49.0 2026-06-10 02:19:09 +01:00
dependabot[bot]andGitHub 09f8f28d53 build(deps): Bump beautifulsoup4 from 4.14.3 to 4.15.0 
Bumps [beautifulsoup4](https://www.crummy.com/software/BeautifulSoup/bs4/) from 4.14.3 to 4.15.0.

---
updated-dependencies:
- dependency-name: beautifulsoup4
  dependency-version: 4.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-08 21:14:39 +00:00
dependabot[bot]andGitHub f7cba8fdf9 build(deps-dev): Bump ruff from 0.15.15 to 0.15.16 
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.15 to 0.15.16.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.15.15...0.15.16)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.16
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-04 21:14:08 +00:00
dependabot[bot]andGitHub 947db25f58 build(deps): Bump uvicorn from 0.48.0 to 0.49.0 
Bumps [uvicorn](https://github.com/Kludex/uvicorn) from 0.48.0 to 0.49.0.
- [Release notes](https://github.com/Kludex/uvicorn/releases)
- [Changelog](https://github.com/Kludex/uvicorn/blob/main/docs/release-notes.md)
- [Commits](https://github.com/Kludex/uvicorn/compare/0.48.0...0.49.0)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-version: 0.49.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-06-04 03:07:01 +00:00
J.TownsendandGitHub 21d389b9a4 Merge pull request #2344 from laramies/dependabot/uv/master/pytest-asyncio-1.4.0 
build(deps-dev): Bump pytest-asyncio from 1.3.0 to 1.4.0
 2026-06-03 23:20:32 +01:00