Commit Graph
3 Commits
Author SHA1 Message Date
s0lrayandPaperclip 290f323bfd Remove stale files and update .gitignore (THE-96)
- Delete .bowerrc: Bower was deprecated years ago; project uses npm.
  The rule was already in .gitignore but the file was still committed.
- Untrack tools/link_audit_report.json: generated CI artifact should
  not be in source control; add to .gitignore so reruns don't re-add it.
- Add .agents/ to .gitignore: Paperclip runtime dir, not project source.
- Fix package.json repo/bugs/homepage URLs: still pointed to old ARF
  repo name instead of OSINT-Framework.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 16:07:18 -04:00
s0lrayandPaperclip a3bb071be2 Fix URL schemes and update link audit report
- Upgrade ~215 URLs from http:// to https://
- Update link_audit_report.json after re-audit (dead links: 283 -> 169)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-21 22:19:37 -04:00
s0lrayandPaperclip 74f037bd30 Remove 113 confirmed dead links from arf.json
Ran comprehensive link audit across all 1,113 URLs in arf.json.
Removed nodes where the URL has definitively failed (DNS resolution
failure, connection refused, or HTTP 404). Left in place: .onion
Tor hidden services, 403 bot-blocked sites (site still exists),
5xx server errors (transient), and timeouts.

Audit summary:
- Total URLs checked: 1,113
- OK: 829
- Dead (removed): 113  (DNS failure: 61, connection refused: 8, HTTP 404: 49, minus 5 already deduplicated)
- Redirected (kept, flagged in report): 374
- Slow >10s (kept): 1

Also adds tooling:
- tools/link_checker.py  -- async URL checker, writes JSON report
- tools/remove_dead_links.py  -- removes confirmed dead nodes from arf.json
- tools/link_audit_report.json  -- full audit results

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-21 18:29:19 -04:00