Commit Graph
529 Commits
Author SHA1 Message Date
s0lrayandPaperclip dd672b1fa9 Mark Threads-Scraper as degraded (THE-53)
Last commit July 2023; likely broken due to Threads frontend changes since.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:15:15 -04:00
s0lrayandPaperclip db6bb9bd4d Fix TikTok and Unfurl tool accuracy (THE-53)
- TikTok-OSINT (T): marked status=degraded (last updated Oct 2022)
- Unfurl: set localInstall=true (Python package available via pip)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:14:46 -04:00
s0lrayandPaperclip 5a28d0ce51 Fix Fediverse tool accuracy: Fedifinder down, Fediverse_OSINT URL corrected (THE-53)
- Fedifinder: marked status=down, deprecated=true (HTTP 410, Twitter API restrictions)
- Fediverse_OSINT: corrected URL from anantshri to cyfinoid/fediverse_osint,
  marked status=degraded (last updated Nov 2022)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:13:30 -04:00
s0lrayandPaperclip 973d756e3b Enrich TikTok, Fediverse/Mastodon, and Threads tools with metadata (THE-53)
Populate enrichment fields (description, status, pricing, bestFor, input,
output, opsec, opsecNote, and badge flags) for 12 social network tools:

- TikTok: TikTok (M), TikTok-OSINT (T), Unfurl, yt-dlp (T)
- Fediverse/Mastodon: Fedifinder, Fediverse Observer, Fediverse_OSINT (T), Masto (T)
- Threads (new category): Bellingcat Meta Content Library, Threads Dashboard,
  Threads-Scraper (T), ThreadsRecon (T)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:11:30 -04:00
s0lrayandPaperclip a1d8f619b6 Merge Terrorism into Threat Intelligence (THE-51)
Remove redundant top-level Terrorism category. All content is already
present under Threat Intelligence > Terrorism & Extremism (added via
THE-41), with updated URLs from the research expansion. No data is lost.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 08:57:17 -04:00
s0lrayandPaperclip 526b728b97 Enrich Username tools with descriptions, badges, and OPSEC data (THE-113)
Populate enrichment fields for all 17 tools in the Username category
(Username Search Engines + Specific Sites). Each tool now includes
description, status, pricing, bestFor, input/output, opsec rating,
and badge flags (localInstall, googleDork, registration, editUrl,
api, invitationOnly, deprecated).

All URLs verified as live on 2026-03-26.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 00:49:24 -04:00
s0lrayandGitHub 7ecf95b21a Merge pull request #585 from lockfale/feature/THE-106-wrangler-kv-namespace-id
Add badge metadata fields to enriched tools in arf.json (THE-108)
2026-03-26 00:37:55 -04:00
dbd8f00043 Add badge metadata fields to enriched tools in arf.json (THE-108)
Added 7 badge fields (localInstall, googleDork, registration, editUrl,
api, invitationOnly, deprecated) to all 13 enriched tool entries.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-26 00:29:04 -04:00
s0lrayandGitHub 690b5068c1 Merge pull request #584 from lockfale/feature/THE-106-wrangler-kv-namespace-id
Feature/the 106 wrangler kv namespace
2026-03-25 23:55:00 -04:00
s0lrayandPaperclip 30ff7dc51b Enrich top 10 tools in arf.json with metadata fields (THE-108)
Add description, status, pricing, bestFor, input/output, opsec, and
opsecNote fields for: Maltego, theHarvester, SpiderFoot, Recon-ng,
Censys, BuiltWith, Have I Been Pwned, VirusTotal, and Wayback Machine.
Shodan was already enriched in THE-107. Tools appearing in multiple
categories are enriched at each location (13 entries total).

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 23:31:36 -04:00
s0lrayandPaperclip 9600931365 Add enrichment badge rendering and panel data fields (THE-107)
- Status (live/down/degraded/unknown) and pricing (free/freemium/paid/unknown)
  pill badges always shown in panel badges row with semantic colors
- OPSEC section now renders colored badge (passive/active/unknown) + opsecNote text
- Description section always visible; shows italic placeholder when no data
- Usage context renders bestFor and input→output mapping; hidden when all empty
- CTA button label now shows "Open [Tool Name] ↗" with actual tool name
- Added badge pill CSS (.badge-live, .badge-down, etc.) to panel.css
- Seeded Shodan (Discovery subcategory) with all new enrichment fields as demo

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 23:05:55 -04:00
s0lrayandPaperclip ae27a0f14a Add Disinformation & Media Verification category (THE-55)
- New top-level category with 4 subcategories: Deepfake Detection,
  Fact-checking Tools, Reverse Media Search, Source Verification
- Added 8 deepfake detection tools (DeepSafe, InVID-WeVerify,
  FaceForensics++, DeepfakeDetector, DeepFake-Detect,
  DeepFake-Image-Detection, DeepfakeBench, TruthScan)
- Migrated fact-checking resources (Duke Reporters' Lab, Hoaxy,
  PolitiFact, SciCheck, Snopes, Stop Fake Tools)
- Migrated reverse media search tools (ImgOps, TinEye)
- Migrated source verification tools (FotoForensics, Verification
  Handbook, Verification Junkie)
- Removed duplicate Search Engines > Fact Checking subcategory

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 21:29:30 -04:00
s0lrayandPaperclip 4cb4231d3e Add Mixer Tracking subcategory and sort Blockchain & Cryptocurrency (THE-57)
- Add Mixer Tracking subcategory with 5 tools: Arkham Intelligence,
  Breadcrumbs.app, MetaSleuth, MistTrack, OFAC Sanctions List Search
- Add Monero Blocks to Monero subcategory
- Sort all subcategories alphabetically within Blockchain & Cryptocurrency
- Fix BitRef capitalization consistency (Chain Analysis Platforms)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 18:40:41 -04:00
s0lrayandGitHub 127f7015c2 Merge pull request #579 from lockfale/feature/THE-58-online-communities
Rename Forums/Blogs/IRC to Online Communities (THE-58)
2026-03-25 18:16:50 -04:00
s0lrayandPaperclip aaddecf7c8 Rename Forums/Blogs/IRC to Online Communities with new subcategories (THE-58)
- Renamed top-level category from "Forums / Blogs / IRC" to "Online Communities"
- Preserved existing subcategories: Blog Search Engines, Forum Search Engines, IRC Search
- Added new subcategories: Discord Servers, Reddit Communities
- Removed Topix from Blog Search Engines (site shut down 2018, URL redirects to unrelated page)
- Excluded Dark Web Forums subcategory (tools already covered in dedicated Dark Web category)
- Excluded Telegram subcategory (tools already covered in Instant Messaging > Telegram)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 18:14:31 -04:00
s0lrayandGitHub 2686062d65 Merge pull request #578 from lockfale/feature/THE-97-github-issues-v2
Curate GitHub issue tool suggestions (THE-97)
2026-03-25 16:28:51 -04:00
s0lrayandPaperclip c82aba741c Curate GitHub issue tool suggestions (THE-97)
Added vetted tools from GitHub issue review and skipped duplicates already present in arf.json.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 16:25:23 -04:00
s0lrayandGitHub 2401409ef3 Merge pull request #577 from lockfale/feature/THE-60-cloud-infrastructure
Promote Cloud Infrastructure to top-level category (THE-60)
2026-03-25 16:14:19 -04:00
s0lrayandPaperclip 4b592ef4f2 Promote Cloud Infrastructure to top-level category (THE-60)
- Remove Cloud Resources subcategory from Domain Name
- Add Cloud Infrastructure as top-level category with 5 subcategories:
  - AWS Enumeration: cloud_enum, AWSBucketDump, Subfinder
  - Azure/GCP Discovery: GCPBucketBrute, AADInternals, ROADtools, MicroBurst, Stormspotter
  - S3/Blob Storage: Public Buckets (GrayhatWarfare), goblob, S3Scanner, BucketLoot, lazys3
  - Cloud Configuration Analysis: Prowler, ScoutSuite, Cloud Custodian, Checkov, Steampipe
  - SaaS Footprinting: Amass, Sublist3r, theHarvester, SpiderFoot, dnsrecon
- Migrated Public Buckets (GrayhatWarfare) from Domain Name > Cloud Resources
- Dropped CloudScraper (7yr stale), upcheck.online, portscanner.online (not cloud-specific)
- 23 total tools: 18 new additions + 1 migrated from Domain Name

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 16:12:08 -04:00
s0lrayandPaperclip 7d8b228527 Update redirected URLs to final destinations (THE-8)
Apply remaining redirect URL updates in arf.json where the destination
is stable and safe. Skips redirects to login pages, parked domains,
and cross-domain redirects that need manual review.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 16:09:09 -04:00
s0lrayandPaperclip eb76bdfa11 Remove deprecated phone lookup entries for issue #415 (THE-86)
Removed 411 and ThatsThem - Reverse Phone Lookup from Telephone Numbers. Verified Annual Reports URLs already use HTTPS on master for issue #425.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 15:35:17 -04:00
s0lrayandGitHub 9d267eb45b Merge pull request #572 from lockfale/feature/THE-86-github-issue-curation
GitHub issue curation
2026-03-25 15:20:06 -04:00
s0lrayandPaperclip 2e7028b2fa Add IDCrawl to People Search Engines (THE-86)
Added IDCrawl under People Search Engines > General People Search after board-confirmed availability.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 15:15:55 -04:00
s0lrayandPaperclip 9337761f64 Add verified OSINT tools from GitHub issue review (THE-86)
Added GitFive, Lenso.ai, CeWL, and Cupp to existing categories in public/arf.json based on verified researcher findings.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 15:15:39 -04:00
s0lrayandGitHub 648d34bd8e Merge pull request #570 from lockfale/feature/THE-79-pan-zoom
Fixing pan zoom weirdness
2026-03-25 14:30:21 -04:00
s0lrayandPaperclip e2f6e13206 Add verified OSINT tools from GitHub issue review (THE-86)
Added GitFive, Lenso.ai, CeWL, and Cupp to existing categories in public/arf.json based on verified researcher findings.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 14:27:39 -04:00
s0lrayandGitHub 6dd5515671 Merge pull request #566 from lockfale/feature/THE-57-blockchain-cryptocurrency
Rename Digital Currency to Blockchain & Cryptocurrency
2026-03-25 00:33:06 -04:00
s0lrayandGitHub 6dbc229f7d Merge pull request #565 from lockfale/feat/the-52-merge-metadata-category
Merge top-level Metadata into Images/Metadata (THE-52)
2026-03-25 00:31:01 -04:00
s0lrayandGitHub 9da645c168 Merge pull request #562 from lockfale/feature/THE-77-overpass-turbo-geolocation
Add Overpass Turbo to Geolocation Tools / Maps
2026-03-24 23:44:24 -04:00
s0lrayandPaperclip 8af97d3779 feat(data): add Overpass Turbo to Geolocation Tools / Maps (THE-77)
Adds overpass-turbo.eu as a geolocation resource. This is a clean
cherry-pick of the valid data change from PR#535 — the CSS changes
from that PR were dropped as obsolete (superseded by THE-32/THE-72).
The duplicate Twitter > Location / Mapping entry was also excluded
per board direction.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-24 23:41:48 -04:00
s0lrayandGitHub db929bc722 Merge branch 'master' into feature/THE-50-instant-messaging-overhaul 2026-03-24 22:08:33 -04:00
s0lrayandGitHub f7dddacaa9 Merge pull request #556 from thumpersecure/Fix-Opt-Out-Guide-Incorrect-Link
Update arf.json
2026-03-24 22:06:55 -04:00
s0lrayandPaperclip 6b5a4e1a59 feat(data): rename Digital Currency to Blockchain & Cryptocurrency, add 6 new subcategories with tools (THE-57)
- Renamed top-level category from 'Digital Currency' to 'Blockchain & Cryptocurrency'
- Added Chain Analysis Platforms (8 tools)
- Added DeFi & DEX Tracing (2 tools)
- Added Multi-Chain Explorers (2 tools)
- Added NFT Provenance (2 tools)
- Added Privacy Coin Analysis (2 tools)
- Added Wallet Clustering & Address Analysis (2 tools)
- Kept existing Bitcoin, Ethereum, Monero subcategories

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-24 19:35:17 -04:00
s0lrayandPaperclip 2008133e64 feat(data): merge top-level Metadata into Images/Metadata (THE-52)
Removed the redundant top-level Metadata category (12 tools) and
redistributed all tools to their logical homes:
- 9 tools → Images / Videos / Docs/Images/Metadata (general metadata
  viewers and file parsers: FOCA, Exiv2, MediaInfo, Apache Tika,
  oletools, Hachoir, C2PA Verify, Metadata2Go, Get-Metadata)
- 1 tool  → Images / Videos / Docs/Images/Forensics (Forensically)
- 1 tool  → OpSec/Metadata / Style (MAT2 — metadata anonymization)
- ExifTool (T) skipped — already present in Images/Metadata

Images/Metadata grows from 10 → 19 tools.
No broken references; JSON validates cleanly.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-24 19:31:52 -04:00
s0lrayandGitHub 2435807c29 Merge pull request #557 from lockfale/feature/THE-41-expand-terrorism-category
feat(data): expand Terrorism category with 9 new vetted resources

Adds subcategories and resources from legitimate government, academic,
NGO, and think tank sources identified in THE-41 research:

- Academic Research: GTD (existing), START Consortium Portal
- Sanctions & Watchlists: OFAC, UN SC Consolidated List, OpenSanctions
- Research Centers: ISD, CSIS Terrorism Program, RAND
- Terrorist Financing: U.S. Treasury TFTP

All resources verified live and from authoritative institutions.
2026-03-24 18:12:03 -04:00
s0lrayandPaperclip c769ec2751 feat(data): overhaul Instant Messaging category with modern platforms
Replace outdated IM subcategories (Skype, Snapchat, Kik, YikYak) with
modern platform coverage: Telegram (5 tools), Discord (2), WhatsApp (2),
Signal/Phone Lookup (1), Slack (3), WeChat/LINE (6), Chat Archive
Analysis (1), and Resources (1). Total: 21 tools across 8 subcategories.

Closes THE-50. Research from THE-42 and THE-62.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-24 17:48:22 -04:00
thumpersecureandGitHub 66b742e2d3 Update arf.json
Fixed link to opt out guide 2025
2026-03-24 16:19:37 -04:00
s0lrayandPaperclip 880d542c56 feat(data): expand Terrorism category with 9 new vetted resources
Adds subcategories and resources from legitimate government, academic,
NGO, and think tank sources identified in THE-41 research:

- Academic Research: GTD (existing), START Consortium Portal
- Sanctions & Watchlists: OFAC, UN SC Consolidated List, OpenSanctions
- Research Centers: ISD, CSIS Terrorism Program, RAND
- Terrorist Financing: U.S. Treasury TFTP

All resources verified live and from authoritative institutions.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-24 07:23:37 -04:00
s0lrayandGitHub ec3c707f31 Merge pull request #552 from lockfale/feature/vehicle-osint-updates
Add vehicle OSINT tools, remove paid-only Berla entry
2026-03-23 23:26:30 -04:00
0e83fdc121 Fix D3 tree not rendering: remove null entry in arf.json
d3.hierarchy() in D3 v7 does not tolerate null entries in children
arrays (v3 was lenient). A null element at Username.children[1] caused
the entire tree to fail silently.

- Remove the null entry from arf.json
- Add a defensive children filter in d3.hierarchy() call so future
  null entries degrade gracefully instead of breaking the tree

Co-Authored-By: Paperclip <noreply@paperclip.ing>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-23 18:21:53 -04:00
s0lrayandPaperclip a3df232dd3 Add vehicle OSINT tools, remove paid-only Berla entry
Adds 7 new free/freemium vehicle lookup tools to Transportation > Vehicle
Records: FindByPlate, carVertical VIN Decoder, autoDNA, VinDecodr, AutoRef
(EU), Carnet.ai, and Finnik (NL). Removes Berla Vehicle Lookup which is a
paid-only tool incompatible with the framework's free/freemium policy.

Refs: THE-24, THE-29

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-23 17:22:58 -04:00
s0lrayandPaperclip 26142302ec Apply approved Category 2 GitHub tool additions to arf.json
Added 12 approved tools from GitHub issues:
- #543 Beholder (Geolocation Tools / Maps > Map Reporting Tools)
- #534 MIDINS TITAN (Tools > Graph Visualization - new subfolder)
- #533 Awesome Opt-Out Guide 2026 (OpSec > Privacy / Clean Up)
- #530 usa-people-search.com (People Search Engines > General People Search)
- #526 Kleinanzeigen.de (Classifieds)
- #501 ImmuniWeb tools (Threat Intelligence > Attack Surface / Security Testing - new subfolder)
- #476 OpenSanctions (Public Records > Sanctions / PEP - new subfolder)
- #473 LiveUaMap (Geolocation Tools / Maps > Map Reporting Tools)
- #443 dorksearch.com + dorkgenerator.pages.dev + dorksearch.netlify.app (Search Engines > Search Tools)
- #442 ZoomEye.ai (Domain Name > Discovery)
- #441 DeepSeek (AI Tools)
- #435 GeoSpy (Geolocation Tools / Maps > Geolocation Tools)

Also created 3 new subfolders for better organization:
- Tools > Graph Visualization (for graph visualization tools)
- Threat Intelligence > Attack Surface / Security Testing (for security testing tools)
- Public Records > Sanctions / PEP (for sanctions and PEP databases)

Implements THE-19 recommendations for GitHub issue review and categorization.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-22 06:39:46 -04:00
s0lrayandPaperclip 2f29379d3f Remove dead link and empty folder: ThatsThem VIN Search, Base64
- Remove That's Them VIN Search (thatsthem.com/vin-search) - reported
  dead in GH #490; the VIN search feature was removed by the site owner
- Remove empty Base64 folder (children: []) - caused the folder to
  appear clickable but do nothing, reported in GH #489

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-22 03:38:15 -04:00
s0lrayandPaperclip ec3ae681fa Accept PRs #518, #508: add wayparam and Surfface
- #518: wayparam (URL parameter security tool) added to Search Tools
- #508: Surfface Face & People Search Engine added to Image Search

PR #542 (FootprintIQ) rejected — confirmed dead link by board and browser check.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-22 00:02:04 -04:00
s0lrayandPaperclip bf2168c687 Accept PRs #496, #515, #516, #540, #544, #545: add 7 new OSINT resources
- #496: Add OpenCelliD and beaconDB to Geolocation/Mobile Coverage
- #515: Add CertKit CT Log Search to Certificate Search (near crt.sh)
- #516: Add Global Fishing Watch to Marine Records (near Vessel Finder)
- #540: Add Epstein Exposed to Court/Criminal Records
- #544: Add WDES - Web Data Exposure Scanner to Domain Name/Vulnerabilities/Scanners
- #545: Add Lullar to Username Search Engines

All URLs verified alive during Phase 1 review. Applied as direct
arf.json edits (PR branches had large divergence from current master).

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-21 23:25:18 -04:00
s0lrayandPaperclip 8c2de4d242 Phase 1: CI/CD pipeline, dead link cleanup, and URL normalization
Rebased cleanly onto current master (resolving conflicts from
community PRs #240-#471 merged while this branch was in flight).

Changes:
- Add GitHub Actions CI workflow (JSON lint, link check, smoke tests)
- Remove 176 confirmed dead links from arf.json
- Normalize 393 URLs from http:// to https://
- Fix invalid JSON (missing commas/braces from old format)
- Remove Bower dependency; lock D3 to npm
- Add link audit tooling (tools/)
- Cherry-pick alive tools from community PR #391:
  FaceCheckID, Cisco Talos, VerifyEmail, YouTube Geofind, Whitepages,
  Hiya, Berla Vehicle Lookup, OpenAIP, Valkyrie File Analysis
- Fix OpenInfrastructureMap URL (missing https://)

Community PR #359 (Risk Toolbox / fraudfightersalliance.com):
DNS does not resolve — all 27 proposed additions are dead, not merged.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-21 23:00:15 -04:00
s0lrayandGitHub fd93e5a059 Merge branch 'master' into master 2026-03-14 18:48:22 -04:00
s0lrayandGitHub 638aa757dd Merge branch 'master' into patch-1 2026-03-14 18:45:18 -04:00
s0lrayandGitHub a1a53bad4f Merge pull request #298 from theahmadov/patch-2
Update arf.json
2026-03-14 18:41:55 -04:00
s0lrayandGitHub d2535a1ebc Update arf.json 2026-03-14 18:41:40 -04:00