Commit Graph
560 Commits
Author SHA1 Message Date
s0lrayandGitHub fdedd84efd Merge pull request #633 from lockfale/feature/THE-135-enrich-images-batch1
Enrich Images/Videos/Docs batch 1 metadata (THE-135)
2026-03-27 23:00:02 -04:00
s0lrayandGitHub 00302be23c Merge pull request #611 from lockfale/feature/THE-139-fonts-enrichment
Enrich What Font Is with OSINT metadata (THE-139)
2026-03-27 22:55:25 -04:00
s0lrayandGitHub 97c3a270c3 Merge branch 'master' into feature/THE-33-disposable-email-domains 2026-03-27 22:50:11 -04:00
s0lrayandGitHub 3f4e00c5ca Merge branch 'master' into feature/THE-132-domain-batch6-curation 2026-03-27 22:42:23 -04:00
s0lrayandGitHub 4b847952d7 Merge pull request #635 from lockfale/feature/THE-131-domain-batch5-enrichment
Enrich Domain Name tools batch 5/6 metadata (THE-131)
2026-03-27 22:32:12 -04:00
s0lrayandGitHub 009bb877bb Merge branch 'master' into feature/THE-128-domain-enrichment-batch2 2026-03-27 22:29:23 -04:00
s0lrayandGitHub 02d50dc126 Merge pull request #610 from lockfale/feature/THE-130-domain-batch4-enrichment
Enrich Domain Name tools batch 4/6 with OSINT metadata (THE-130)
2026-03-27 22:26:34 -04:00
s0lrayandGitHub d2610d44cd Merge branch 'master' into feature/THE-129-domain-batch3-enrichment 2026-03-27 22:17:39 -04:00
s0lrayandGitHub 121fd7dc71 Merge pull request #608 from lockfale/feature/THE-127-enrich-domain-names
Enrich 25 Domain Name tools batch 1/6 with OSINT metadata (THE-127)
2026-03-27 22:14:12 -04:00
s0lrayandGitHub a05564bd6d Merge pull request #607 from lockfale/feature/THE-134-enrich-ip-mac
Enrich 56 IP & MAC Address tools with OSINT metadata (THE-134)
2026-03-27 22:13:33 -04:00
s0lrayandGitHub 27621ca69b Merge pull request #606 from lockfale/feature/THE-126-enrich-email-address
Enrich Email Address tools with OSINT metadata (THE-126)
2026-03-27 22:10:40 -04:00
s0lrayandGitHub 502e7e36d0 Merge branch 'master' into feature/THE-61-compliance-risk-intelligence 2026-03-27 22:07:42 -04:00
s0lrayandGitHub 39ebb0ac7e Update arf.json 2026-03-27 21:59:18 -04:00
s0lrayandPaperclip 7abc9a025f Apply enrichment fields for all 21 Domain Name batch 6 tools (THE-132)
Populate description, status, pricing, bestFor, input, output, opsec,
opsecNote, and badge fields for Change Detection, Social Analysis, DNSSEC,
Vulnerabilities, Tools, and Report Malicious Sites subcategories.

Key decisions:
- UPcheck (formerly Check site availability Online): marked deprecated=true
  as the service is currently down
- Sn1per, Burp Suite, Online Nikto, WDES, EyeWitness: opsec=active due to
  active scanning behavior
- Urlwatch, RobotsDisallowed: localInstall=true (CLI/open-source tools)
- DNSSEC Analyzer uses Verisign URL; DNSViz uses dnsviz.net (distinct tools)
- Both Online Nikto scanner entries enriched (Discovery and Tools sections)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 21:58:15 -04:00
s0lrayandPaperclip 557a2380aa Apply approved Domain batch 6 naming and URL clarifications (THE-132)
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 20:47:39 -04:00
s0lrayandPaperclip 879374fb28 Enrich Domain Name tools batch 5 metadata (THE-131)
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 19:21:33 -04:00
s0lrayandPaperclip c69e18e519 Fix PimEyes invitationOnly flag (THE-135)
PimEyes is a publicly accessible commercial service (subscription required
for full features), not invitation-only. Corrects the badge value from
true to false.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 13:53:48 -04:00
s0lrayandPaperclip 8ebd8b16d7 Enrich Images/Videos/Docs batch 1 metadata (THE-135)
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 13:47:34 -04:00
s0lrayandPaperclip a2e25099bf Populate Domain Name enrichment fields for batch 2 (THE-128)
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 09:57:27 -04:00
s0lrayandPaperclip 6cd1ee6ef3 Add disposable email domain detection tools to Email Verification (THE-33)
Add 3 community-maintained disposable email blocklists to Email Address >
Email Verification:
- Disposable Email Domains (GitHub) - 5000+ domain blocklist used by PyPI
- Disposable Emails Registry - searchable registry with bulk download
- Burner Email Providers - curated list with multi-language integrations

Excludes WhoisXML API (premium/paid service) per board guidance.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 09:22:25 -04:00
s0lrayandPaperclip dff616f8c4 Enrich Online Communities metadata (THE-155)
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 04:16:36 -04:00
s0lrayandPaperclip 6466eb0f92 Enrich What Font Is tool with OSINT metadata (THE-139)
Populated enrichment fields for What Font Is:
- description: AI-powered font identification tool
- status: live
- pricing: freemium (free tier with ads + paid PRO)
- bestFor: Identifying fonts from screenshots/images
- input/output: Image upload → font matches with links
- opsec: passive (uploads to remote servers)
- Features: API available, no registration required (optional)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 02:30:43 -04:00
s0lrayandPaperclip 6e1fca451e Enrich Images/Videos/Docs batch 2 metadata (THE-136)
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 02:26:39 -04:00
s0lrayandPaperclip e20fdcd9dd Enrich 56 IP & MAC Address tools with OSINT metadata
- Added comprehensive enrichment fields for all tools in IP & MAC Address category
- Populated: description, status, pricing, bestFor, input, output, opsec, opsecNote
- Added badges: localInstall, googleDork, registration, editUrl, api, invitationOnly, deprecated
- Coverage includes: Geolocation, Host/Port Discovery, IPv4, IPv6, BGP, Reputation, Blacklists, Neighbor Domains, Cloud Services, Wireless, Network Analysis, IP Loggers

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 02:11:39 -04:00
s0lrayandPaperclip 0905218daa Enrich Domain Name tools batch 4 (25 tools) with OSINT metadata
Add comprehensive enrichment fields for the following 25 Domain Name tools:
- Threatexpert.com Malicious URLs
- Zeus C2 Tracker
- Malware Domains Blacklist
- Blackweb
- Critical Stack Intel (R)
- DNS Sinkhole
- DNS-BH Malware Domain Blocklist
- Malware Domain List
- MalwareURL (R)
- scumware.org
- ZeuS Tracker
- Shadowserver Foundation
- Email Domain Validation
- vURL Online
- AlienVault Open Threat Exchange
- Web Inspector Online Scan
- Google Safe Browsing API
- Cisco Talos
- DNS Twist (T)
- URLCrazy (T)
- dnstwister
- Catphish (T)
- BuiltWith
- SiteSleuth

Populated fields for each tool:
- description: 1-2 sentence summary
- status: live/down/degraded
- pricing: free/freemium/paid
- bestFor: primary use-case
- input/output: data format
- opsec: passive/active/Unknown
- opsecNote: OPSEC implications
- Badges: localInstall, googleDork, registration, editUrl, api, invitationOnly, deprecated

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 01:49:55 -04:00
s0lrayandPaperclip c0fbb9a7d3 Enrich Domain Name tools batch 3 with OSINT metadata (25 tools)
Populated enrichment fields for 25 Domain Name tools across Certificate Search,
PassiveDNS, Reputation, and Discovery subsections:
- Certificate Search: Google's CT, Spyse, crt.sh, CertKit, certgraph, Netlas.io
- PassiveDNS: Mnemonic, DNS Dumpster, Deteque
- Reputation: UrlQuery, URL Void, FortiGuard, Trend Micro, WatchGuard, Sucuri,
  ThreatMiner, BlueCoat WebPulse, Zscaler Zulu, Joe Sandbox, Deepviz, AVG
  Threat Labs, Webroot BrightCloud
- Discovery: ZoomEye.ai

Each tool now includes description, status, pricing, bestFor, input/output,
opsec classification, and feature badges.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 01:45:34 -04:00
s0lrayandPaperclip b746e2f38e Fix trailing newline and Videos array formatting (THE-126)
CTO cleanup: restore trailing newline removed by json serialization,
and revert spurious whitespace change to Videos empty children array.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 01:42:01 -04:00
s0lrayandPaperclip fff2ac1aa9 Enrich 25 Domain Name tools with OSINT enrichment fields
Populate enrichment metadata for all 25 tools in the Domain Name category:

Whois Records (18 tools):
- Domain Dossier, domainIQ, DomainTools Whois, SWITCH Internet Domains Whois (.ch)
- Whoisology, Whois ARIN, DNSstuff, Robtex (R)
- Domaincrawler.com, MarkMonitor Whois Search, easyWhois, Website Informer
- Who.is, Whois AMPed, ViewDNS.info, Daily DNS Changes, IP2WHOIS, Netlas.io

Subdomains (7 tools):
- SynapsInt, Aquatone (T), FindSubDomains, Google Subdomains (D)
- Recon-ng (T), XRay, DNS Recon (T)

Each tool now includes:
- description (1-2 sentence summary)
- status (live/down/degraded)
- pricing (free/freemium/paid)
- bestFor (use case phrase)
- input/output (what you feed and what it returns)
- opsec (passive/active/Unknown)
- opsecNote (OPSEC implications)
- badges: localInstall, googleDork, registration, editUrl, api, invitationOnly, deprecated

Research verified tool functionality, access, and current status as of 2026-03-27.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 01:39:48 -04:00
s0lrayandPaperclip 1d96de849d Enrich 25 Email Address tools with OSINT enrichment fields
Populate enrichment metadata for Sylva Identity Discovery, ThatsThem, Hunter, VoilaNorbert, GHunt, OSINT Industries, Infoga, Skymem, Epieos, breach.vip, Holehe, Email Format, Email Permutator, Reacher (GitHub and Demo), MailScrap, Read Notify, Email Reputation, MailboxValidator, VerifyEmail, Hudson Rock, DeHashed, Vigilante.pw, and MxToolbox.

Each tool now includes: description, status, pricing tier, best use case, input/output, OPSEC classification, local install availability, API support, registration requirements, and more.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-27 01:35:11 -04:00
s0lrayandPaperclip 73ad7cb884 Enrich Compliance & Risk Intelligence tools with metadata (THE-61)
Add description, status badges, pricing, bestFor, input/output,
opsec details, and all badge fields for 13 tools across Sanctions
Screening, KYC/AML, Beneficial Ownership, and PEP Databases.

Notable findings:
- Ukraine PEP Register marked (D) — site now redirects to wartime advocacy page
- EU Sanctions Tool marked (D) — DNS resolution degraded
- PepChecker and OCCRP Aleph marked (R) — require registration

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:20:12 -04:00
s0lrayandPaperclip dd672b1fa9 Mark Threads-Scraper as degraded (THE-53)
Last commit July 2023; likely broken due to Threads frontend changes since.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:15:15 -04:00
s0lrayandPaperclip db6bb9bd4d Fix TikTok and Unfurl tool accuracy (THE-53)
- TikTok-OSINT (T): marked status=degraded (last updated Oct 2022)
- Unfurl: set localInstall=true (Python package available via pip)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:14:46 -04:00
s0lrayandPaperclip 5a28d0ce51 Fix Fediverse tool accuracy: Fedifinder down, Fediverse_OSINT URL corrected (THE-53)
- Fedifinder: marked status=down, deprecated=true (HTTP 410, Twitter API restrictions)
- Fediverse_OSINT: corrected URL from anantshri to cyfinoid/fediverse_osint,
  marked status=degraded (last updated Nov 2022)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:13:30 -04:00
s0lrayandPaperclip 973d756e3b Enrich TikTok, Fediverse/Mastodon, and Threads tools with metadata (THE-53)
Populate enrichment fields (description, status, pricing, bestFor, input,
output, opsec, opsecNote, and badge flags) for 12 social network tools:

- TikTok: TikTok (M), TikTok-OSINT (T), Unfurl, yt-dlp (T)
- Fediverse/Mastodon: Fedifinder, Fediverse Observer, Fediverse_OSINT (T), Masto (T)
- Threads (new category): Bellingcat Meta Content Library, Threads Dashboard,
  Threads-Scraper (T), ThreadsRecon (T)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:11:30 -04:00
s0lrayandPaperclip 8fba2d0b65 Add Compliance & Risk Intelligence category (THE-61)
- Added new top-level category with 4 subcategories and 13 tools:
  - Sanctions Screening: OpenSanctions, OFAC, EU Sanctions Tool, dilisense
  - KYC / AML Tools: NameScan, OpenScreening, Companies House
  - Beneficial Ownership Lookup: OpenOwnership, ICIJ Offshore Leaks, OCCRP Aleph
  - PEP Databases: PepChecker, Ukraine PEP Register, EveryPolitician
- Removed orphaned Public Records > Sanctions / PEP node (OpenSanctions already
  listed under Threat Intelligence > Terrorism & Extremism > Sanctions & Watchlists)
- Category positioned after Public Records in the tree

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 12:09:27 -04:00
s0lrayandPaperclip a1d8f619b6 Merge Terrorism into Threat Intelligence (THE-51)
Remove redundant top-level Terrorism category. All content is already
present under Threat Intelligence > Terrorism & Extremism (added via
THE-41), with updated URLs from the research expansion. No data is lost.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 08:57:17 -04:00
s0lrayandPaperclip 526b728b97 Enrich Username tools with descriptions, badges, and OPSEC data (THE-113)
Populate enrichment fields for all 17 tools in the Username category
(Username Search Engines + Specific Sites). Each tool now includes
description, status, pricing, bestFor, input/output, opsec rating,
and badge flags (localInstall, googleDork, registration, editUrl,
api, invitationOnly, deprecated).

All URLs verified as live on 2026-03-26.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-26 00:49:24 -04:00
s0lrayandGitHub 7ecf95b21a Merge pull request #585 from lockfale/feature/THE-106-wrangler-kv-namespace-id
Add badge metadata fields to enriched tools in arf.json (THE-108)
2026-03-26 00:37:55 -04:00
dbd8f00043 Add badge metadata fields to enriched tools in arf.json (THE-108)
Added 7 badge fields (localInstall, googleDork, registration, editUrl,
api, invitationOnly, deprecated) to all 13 enriched tool entries.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-26 00:29:04 -04:00
s0lrayandGitHub 690b5068c1 Merge pull request #584 from lockfale/feature/THE-106-wrangler-kv-namespace-id
Feature/the 106 wrangler kv namespace
2026-03-25 23:55:00 -04:00
s0lrayandPaperclip 30ff7dc51b Enrich top 10 tools in arf.json with metadata fields (THE-108)
Add description, status, pricing, bestFor, input/output, opsec, and
opsecNote fields for: Maltego, theHarvester, SpiderFoot, Recon-ng,
Censys, BuiltWith, Have I Been Pwned, VirusTotal, and Wayback Machine.
Shodan was already enriched in THE-107. Tools appearing in multiple
categories are enriched at each location (13 entries total).

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 23:31:36 -04:00
s0lrayandPaperclip 9600931365 Add enrichment badge rendering and panel data fields (THE-107)
- Status (live/down/degraded/unknown) and pricing (free/freemium/paid/unknown)
  pill badges always shown in panel badges row with semantic colors
- OPSEC section now renders colored badge (passive/active/unknown) + opsecNote text
- Description section always visible; shows italic placeholder when no data
- Usage context renders bestFor and input→output mapping; hidden when all empty
- CTA button label now shows "Open [Tool Name] ↗" with actual tool name
- Added badge pill CSS (.badge-live, .badge-down, etc.) to panel.css
- Seeded Shodan (Discovery subcategory) with all new enrichment fields as demo

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 23:05:55 -04:00
s0lrayandPaperclip ae27a0f14a Add Disinformation & Media Verification category (THE-55)
- New top-level category with 4 subcategories: Deepfake Detection,
  Fact-checking Tools, Reverse Media Search, Source Verification
- Added 8 deepfake detection tools (DeepSafe, InVID-WeVerify,
  FaceForensics++, DeepfakeDetector, DeepFake-Detect,
  DeepFake-Image-Detection, DeepfakeBench, TruthScan)
- Migrated fact-checking resources (Duke Reporters' Lab, Hoaxy,
  PolitiFact, SciCheck, Snopes, Stop Fake Tools)
- Migrated reverse media search tools (ImgOps, TinEye)
- Migrated source verification tools (FotoForensics, Verification
  Handbook, Verification Junkie)
- Removed duplicate Search Engines > Fact Checking subcategory

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 21:29:30 -04:00
s0lrayandPaperclip 4cb4231d3e Add Mixer Tracking subcategory and sort Blockchain & Cryptocurrency (THE-57)
- Add Mixer Tracking subcategory with 5 tools: Arkham Intelligence,
  Breadcrumbs.app, MetaSleuth, MistTrack, OFAC Sanctions List Search
- Add Monero Blocks to Monero subcategory
- Sort all subcategories alphabetically within Blockchain & Cryptocurrency
- Fix BitRef capitalization consistency (Chain Analysis Platforms)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 18:40:41 -04:00
s0lrayandGitHub 127f7015c2 Merge pull request #579 from lockfale/feature/THE-58-online-communities
Rename Forums/Blogs/IRC to Online Communities (THE-58)
2026-03-25 18:16:50 -04:00
s0lrayandPaperclip aaddecf7c8 Rename Forums/Blogs/IRC to Online Communities with new subcategories (THE-58)
- Renamed top-level category from "Forums / Blogs / IRC" to "Online Communities"
- Preserved existing subcategories: Blog Search Engines, Forum Search Engines, IRC Search
- Added new subcategories: Discord Servers, Reddit Communities
- Removed Topix from Blog Search Engines (site shut down 2018, URL redirects to unrelated page)
- Excluded Dark Web Forums subcategory (tools already covered in dedicated Dark Web category)
- Excluded Telegram subcategory (tools already covered in Instant Messaging > Telegram)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 18:14:31 -04:00
s0lrayandGitHub 2686062d65 Merge pull request #578 from lockfale/feature/THE-97-github-issues-v2
Curate GitHub issue tool suggestions (THE-97)
2026-03-25 16:28:51 -04:00
s0lrayandPaperclip c82aba741c Curate GitHub issue tool suggestions (THE-97)
Added vetted tools from GitHub issue review and skipped duplicates already present in arf.json.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 16:25:23 -04:00
s0lrayandGitHub 2401409ef3 Merge pull request #577 from lockfale/feature/THE-60-cloud-infrastructure
Promote Cloud Infrastructure to top-level category (THE-60)
2026-03-25 16:14:19 -04:00
s0lrayandPaperclip 4b592ef4f2 Promote Cloud Infrastructure to top-level category (THE-60)
- Remove Cloud Resources subcategory from Domain Name
- Add Cloud Infrastructure as top-level category with 5 subcategories:
  - AWS Enumeration: cloud_enum, AWSBucketDump, Subfinder
  - Azure/GCP Discovery: GCPBucketBrute, AADInternals, ROADtools, MicroBurst, Stormspotter
  - S3/Blob Storage: Public Buckets (GrayhatWarfare), goblob, S3Scanner, BucketLoot, lazys3
  - Cloud Configuration Analysis: Prowler, ScoutSuite, Cloud Custodian, Checkov, Steampipe
  - SaaS Footprinting: Amass, Sublist3r, theHarvester, SpiderFoot, dnsrecon
- Migrated Public Buckets (GrayhatWarfare) from Domain Name > Cloud Resources
- Dropped CloudScraper (7yr stale), upcheck.online, portscanner.online (not cloud-specific)
- 23 total tools: 18 new additions + 1 migrated from Domain Name

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 16:12:08 -04:00