WEBDIENSTE/theHarvester
1
0
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2026-09-12 04:37:40 +02:00
Code Issues Packages Projects Releases Wiki Activity
4,375 Commits 2 Branches 38 Tags
cc840cd36b49b73cdddb07ec2cdf1bd2e5318d91
Commit Graph
4375 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
dependabot[bot]andGitHub cc840cd36b build(deps): Bump step-security/harden-runner from 2.19.1 to 2.19.4 
Bumps [step-security/harden-runner](https://github.com/step-security/harden-runner) from 2.19.1 to 2.19.4.
- [Release notes](https://github.com/step-security/harden-runner/releases)
- [Commits](https://github.com/step-security/harden-runner/compare/a5ad31d6a139d249332a2605b85202e8c0b78450...9af89fc71515a100421586dfdb3dc9c984fbf411)

---
updated-dependencies:
- dependency-name: step-security/harden-runner
  dependency-version: 2.19.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-21 21:17:59 +00:00
J.TownsendandGitHub b030082a23 Merge pull request #2316 from leebaird/master 2026-05-12 20:49:48 +01:00
Lee BairdandGitHub 6370063fbd Remove 'qwant' from service list. 
Removed 'qwant' from the list of services.
 2026-05-12 09:01:11 -05:00
J.TownsendandGitHub 2d13852889 Merge pull request #2312 from laramies/dependabot/uv/urllib3-2.7.0 2026-05-11 18:45:39 +01:00
dependabot[bot]andGitHub da862703f9 build(deps): Bump urllib3 from 2.6.3 to 2.7.0 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.6.3 to 2.7.0.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.3...2.7.0)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-version: 2.7.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-11 17:33:17 +00:00
L1ghtn1ng 98dbda9af7 Harden API auth and fix type lint issues 2026-05-10 05:04:06 +01:00
github-actions 31f9c932cf Apply ruff fixes and formatting 2026-05-10 03:19:45 +00:00
J.TownsendandGitHub 22fc56385d Merge pull request #2298 from mohamedsolaiman/feature/shodan-internetdb 
Add Shodan InternetDB data source module
 2026-05-10 04:19:25 +01:00
J.TownsendandGitHub a7ebe62714 Merge pull request #2295 from laramies/dependabot/docker/python-5b3879b 
build(deps): Bump python from `3989a23` to `5b3879b`
 2026-05-10 03:47:08 +01:00
github-actions 40933a4f17 Apply ruff fixes and formatting 2026-05-10 02:46:53 +00:00
J.TownsendandGitHub aff0e652a1 Merge pull request #2304 from ChrisJr404/surface-work-item-errors 
fix(worker): surface the underlying exception when a work item fails (#2227)
 2026-05-10 03:46:35 +01:00
J.TownsendandGitHub e2e85902ff Merge pull request #2306 from ChrisJr404/feat/dymo-api-source-2300 
feat(discovery): add Dymo API data verifier source (closes #2300)
 2026-05-10 03:36:48 +01:00
J.TownsendandGitHub 255cd8b563 Fix package version layout in the README 2026-05-10 03:25:12 +01:00
J.TownsendandGitHub 4c6d2a7c7e Merge pull request #2310 from laramies/dependabot/github_actions/actions/dependency-review-action-5.0.0 
build(deps): Bump actions/dependency-review-action from 4.9.0 to 5.0.0
 2026-05-10 03:02:47 +01:00
J.TownsendandGitHub 95ff535c3c Merge pull request #2311 from laramies/dependabot/uv/master/types-python-dateutil-2.9.0.20260508 
build(deps-dev): Bump types-python-dateutil from 2.9.0.20260408 to 2.9.0.20260508
 2026-05-10 03:02:28 +01:00
github-actions f334c489f0 Apply ruff fixes and formatting 2026-05-10 02:02:00 +00:00
L1ghtn1ng ba0fd5df88 Add more ruff linting rules and fix the issues identified by said new rules 2026-05-10 03:01:34 +01:00
dependabot[bot]andGitHub dea628c6ec build(deps-dev): Bump types-python-dateutil 
Bumps [types-python-dateutil](https://github.com/python/typeshed) from 2.9.0.20260408 to 2.9.0.20260508.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-python-dateutil
  dependency-version: 2.9.0.20260508
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-08 21:15:40 +00:00
dependabot[bot]andGitHub 92629c6d81 build(deps): Bump actions/dependency-review-action from 4.9.0 to 5.0.0 
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 4.9.0 to 5.0.0.
- [Release notes](https://github.com/actions/dependency-review-action/releases)
- [Commits](https://github.com/actions/dependency-review-action/compare/2031cfc080254a8a887f58cffee85186f0e49e48...a1d282b36b6f3519aa1f3fc636f609c47dddb294)

---
updated-dependencies:
- dependency-name: actions/dependency-review-action
  dependency-version: 5.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-08 21:12:04 +00:00
J.TownsendandGitHub 780252cc1c Merge pull request #2294 from laramies/dependabot/uv/master/winloop-0.6.3 
build(deps): Bump winloop from 0.6.2 to 0.6.3
 2026-05-08 21:33:11 +01:00
J.TownsendandGitHub a94068df8c Merge pull request #2308 from laramies/dependabot/uv/master/ujson-5.12.1 
build(deps): Bump ujson from 5.12.0 to 5.12.1
 2026-05-08 21:32:58 +01:00
J.TownsendandGitHub 9b0b615562 Merge pull request #2301 from laramies/dependabot/uv/master/playwright-1.59.0 
build(deps): Bump playwright from 1.58.0 to 1.59.0
 2026-05-08 21:32:18 +01:00
J.TownsendandGitHub bfde850269 Merge pull request #2303 from laramies/dependabot/uv/master/ty-0.0.34 
build(deps-dev): Bump ty from 0.0.32 to 0.0.34
 2026-05-08 21:31:54 +01:00
dependabot[bot]andGitHub 190cdc533f build(deps-dev): Bump ty from 0.0.32 to 0.0.34 
Bumps [ty](https://github.com/astral-sh/ty) from 0.0.32 to 0.0.34.
- [Release notes](https://github.com/astral-sh/ty/releases)
- [Changelog](https://github.com/astral-sh/ty/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ty/compare/0.0.32...0.0.34)

---
updated-dependencies:
- dependency-name: ty
  dependency-version: 0.0.34
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-08 20:31:17 +00:00
J.TownsendandGitHub d4cfe21bdf Merge pull request #2307 from laramies/dependabot/uv/master/mypy-2.0.0 
build(deps-dev): Bump mypy from 1.20.2 to 2.0.0
 2026-05-08 21:29:46 +01:00
J.TownsendandGitHub e8999199cb Merge pull request #2309 from laramies/dependabot/github_actions/github/codeql-action-4.35.4 
build(deps): Bump github/codeql-action from 4.35.2 to 4.35.4
 2026-05-08 21:28:53 +01:00
J.TownsendandGitHub e10ecc336e Merge pull request #2305 from laramies/dependabot/github_actions/step-security/harden-runner-2.19.1 
build(deps): Bump step-security/harden-runner from 2.19.0 to 2.19.1
 2026-05-08 21:28:10 +01:00
dependabot[bot]andGitHub 56b37d0c5e build(deps): Bump github/codeql-action from 4.35.2 to 4.35.4 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 4.35.2 to 4.35.4.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/95e58e9a2cdfd71adc6e0353d5c52f41a045d225...68bde559dea0fdcac2102bfdf6230c5f70eb485e)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-version: 4.35.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-07 21:15:26 +00:00
dependabot[bot]andGitHub e2909c3dba build(deps): Bump ujson from 5.12.0 to 5.12.1 
Bumps [ujson](https://github.com/ultrajson/ultrajson) from 5.12.0 to 5.12.1.
- [Release notes](https://github.com/ultrajson/ultrajson/releases)
- [Commits](https://github.com/ultrajson/ultrajson/compare/5.12.0...5.12.1)

---
updated-dependencies:
- dependency-name: ujson
  dependency-version: 5.12.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-06 21:16:09 +00:00
dependabot[bot]andGitHub 6c8bbc39fc build(deps-dev): Bump mypy from 1.20.2 to 2.0.0 
Bumps [mypy](https://github.com/python/mypy) from 1.20.2 to 2.0.0.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/v1.20.2...v2.0.0)

---
updated-dependencies:
- dependency-name: mypy
  dependency-version: 2.0.0
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-06 21:15:55 +00:00
Chris (ChrisJr404) 131e23813a feat(discovery): add Dymo API data verifier source (#2300) 
Adds a new passive source that calls the Dymo data verifier endpoint
(https://api.tpeoficial.com/v1/private/secure/verify) with the target
domain. The response is stored on the source for downstream inspection
and any matching canonical domain or didYouMean suggestion is added to
the host set so the rest of the pipeline can resolve it.

The source follows the existing plugin shape: SearchDymo lives in
theHarvester/discovery/dymosearch.py, the API key is read from the
``dymo`` block in api-keys.yaml via Core.dymo_key(), and the engine is
registered in get_supportedengines() and the -b/--source dispatcher.

Tests cover the missing-key path, header/payload shape, the empty,
unrelated-suggestion and non-dict-response branches, and the
get_supportedengines() registration. Closes #2300.
 2026-05-06 11:04:34 -04:00
dependabot[bot]andGitHub 89d24fa365 build(deps): Bump step-security/harden-runner from 2.19.0 to 2.19.1 
Bumps [step-security/harden-runner](https://github.com/step-security/harden-runner) from 2.19.0 to 2.19.1.
- [Release notes](https://github.com/step-security/harden-runner/releases)
- [Commits](https://github.com/step-security/harden-runner/compare/8d3c67de8e2fe68ef647c8db1e6a09f647780f40...a5ad31d6a139d249332a2605b85202e8c0b78450)

---
updated-dependencies:
- dependency-name: step-security/harden-runner
  dependency-version: 2.19.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-05-05 00:52:50 +00:00
Chris (ChrisJr404) 4fb1ad7ef3 fix(worker): surface the underlying exception when a work item fails (#2227) 
The async worker that drains the engine queue catches `Exception` with
no `as` binding and prints the bare line

    "A error occurred while processing a 'work item'."

That message both swallows the actual error class+text (so users
report bugs like #2227 with no actionable detail and the maintainer
has to ask them to repro under more verbosity) and reads "A error"
instead of the grammatical "An error".

Bind the exception, print its type and message, and fix the article.
The shodan integration test (`tests/discovery/test_shodan_engine.py`)
already asserts the message is not in output on the happy path; the
assertion is updated to match the new string.

Closes #2227.
 2026-05-03 11:35:54 -04:00
dependabot[bot]andGitHub ea68bb1717 build(deps): Bump playwright from 1.58.0 to 1.59.0 
Bumps [playwright](https://github.com/microsoft/playwright-python) from 1.58.0 to 1.59.0.
- [Release notes](https://github.com/microsoft/playwright-python/releases)
- [Commits](https://github.com/microsoft/playwright-python/compare/v1.58.0...v1.59.0)

---
updated-dependencies:
- dependency-name: playwright
  dependency-version: 1.59.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-29 21:15:07 +00:00
Mohamed Solaiman a379d54da4 Add Shodan InternetDB data source module 
Adds a new OSINT data source: Shodan InternetDB (internetdb.shodan.io).

Shodan InternetDB is a free, no-API-key-required service that provides
basic intelligence about IP addresses including:
- Open ports
- Associated hostnames (subdomains)
- Known vulnerabilities (CVEs)
- Tags and CPEs

The module resolves the target domain to its IP addresses, then queries
InternetDB for each IP to discover associated hostnames and other
intelligence data.

Changes:
- New module: theHarvester/discovery/shodan_internetdb.py
- Registered in theHarvester/__main__.py (import + engine handler)
- Added to supported engines list in theHarvester/lib/core.py
- Added to CLI --source help text

This module is distinct from the existing 'shodan' source which requires
a paid API key. Shodan InternetDB is free and provides complementary
data, making it accessible to all users.
 2026-04-28 16:55:37 +00:00
dependabot[bot]andGitHub 6c5af3d15c build(deps): Bump python from 3989a23 to 5b3879b 
Bumps python from `3989a23` to `5b3879b`.

---
updated-dependencies:
- dependency-name: python
  dependency-version: 3.14-slim-trixie
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-28 01:13:44 +00:00
dependabot[bot]andGitHub 814b00b689 build(deps): Bump winloop from 0.6.2 to 0.6.3 
Bumps [winloop](https://github.com/Vizonex/Winloop) from 0.6.2 to 0.6.3.
- [Release notes](https://github.com/Vizonex/Winloop/releases)
- [Commits](https://github.com/Vizonex/Winloop/compare/v0.6.2...v0.6.3)

---
updated-dependencies:
- dependency-name: winloop
  dependency-version: 0.6.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-28 00:26:22 +00:00
J.TownsendandGitHub cfc546ae89 Merge pull request #2290 from laramies/dependabot/docker/python-3989a23 2026-04-25 13:50:21 +01:00
J.TownsendandGitHub d12dda0f59 Merge pull request #2289 from laramies/dependabot/uv/master/wheel-0.47.0 2026-04-25 13:49:33 +01:00
J.TownsendandGitHub ef2ac1cbe3 Merge pull request #2286 from laramies/dependabot/uv/master/mypy-1.20.2 2026-04-25 13:49:14 +01:00
J.TownsendandGitHub 1eed9c89f3 Merge pull request #2288 from laramies/dependabot/uv/master/certifi-2026.4.22 2026-04-25 13:48:46 +01:00
dependabot[bot]andGitHub 7ca4ef97b8 Bump mypy from 1.20.1 to 1.20.2 
Bumps [mypy](https://github.com/python/mypy) from 1.20.1 to 1.20.2.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/v1.20.1...v1.20.2)

---
updated-dependencies:
- dependency-name: mypy
  dependency-version: 1.20.2
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-25 12:48:43 +00:00
dependabot[bot]andGitHub 369acbd9ea Bump wheel from 0.46.3 to 0.47.0 
Bumps [wheel](https://github.com/pypa/wheel) from 0.46.3 to 0.47.0.
- [Release notes](https://github.com/pypa/wheel/releases)
- [Changelog](https://github.com/pypa/wheel/blob/main/docs/news.rst)
- [Commits](https://github.com/pypa/wheel/compare/0.46.3...0.47.0)

---
updated-dependencies:
- dependency-name: wheel
  dependency-version: 0.47.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-25 12:48:41 +00:00
dependabot[bot]andGitHub d0022c3ddd Bump certifi from 2026.2.25 to 2026.4.22 
Bumps [certifi](https://github.com/certifi/python-certifi) from 2026.2.25 to 2026.4.22.
- [Commits](https://github.com/certifi/python-certifi/compare/2026.02.25...2026.04.22)

---
updated-dependencies:
- dependency-name: certifi
  dependency-version: 2026.4.22
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-25 12:48:34 +00:00
J.TownsendandGitHub 0bcc301815 Merge pull request #2291 from laramies/dependabot/uv/master/fastapi-0.136.1 2026-04-25 13:48:17 +01:00
J.TownsendandGitHub ab31ef7a07 Merge pull request #2281 from laramies/dependabot/github_actions/astral-sh/setup-uv-8.1.0 2026-04-25 13:47:58 +01:00
J.TownsendandGitHub 330af16ac3 Merge pull request #2292 from laramies/dependabot/uv/master/uvicorn-0.46.0 2026-04-25 13:47:20 +01:00
J.TownsendandGitHub b2082be7e7 Merge pull request #2293 from laramies/dependabot/uv/master/ruff-0.15.12 2026-04-25 13:47:02 +01:00
dependabot[bot]andGitHub 49d35a9f6f Bump ruff from 0.15.11 to 0.15.12 
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.11 to 0.15.12.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.15.11...0.15.12)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.12
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-24 21:14:50 +00:00
dependabot[bot]andGitHub 5b68147474 Bump uvicorn from 0.44.0 to 0.46.0 
Bumps [uvicorn](https://github.com/Kludex/uvicorn) from 0.44.0 to 0.46.0.
- [Release notes](https://github.com/Kludex/uvicorn/releases)
- [Changelog](https://github.com/Kludex/uvicorn/blob/main/docs/release-notes.md)
- [Commits](https://github.com/Kludex/uvicorn/compare/0.44.0...0.46.0)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-version: 0.46.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-04-23 21:15:16 +00:00