Commit Graph
3 Commits
Author SHA1 Message Date
s0lrayandPaperclip 7d8b228527 Update redirected URLs to final destinations (THE-8)
Apply remaining redirect URL updates in arf.json where the destination
is stable and safe. Skips redirects to login pages, parked domains,
and cross-domain redirects that need manual review.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-25 16:09:09 -04:00
s0lrayandPaperclip a3bb071be2 Fix URL schemes and update link audit report
- Upgrade ~215 URLs from http:// to https://
- Update link_audit_report.json after re-audit (dead links: 283 -> 169)

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-21 22:19:37 -04:00
s0lrayandPaperclip 74f037bd30 Remove 113 confirmed dead links from arf.json
Ran comprehensive link audit across all 1,113 URLs in arf.json.
Removed nodes where the URL has definitively failed (DNS resolution
failure, connection refused, or HTTP 404). Left in place: .onion
Tor hidden services, 403 bot-blocked sites (site still exists),
5xx server errors (transient), and timeouts.

Audit summary:
- Total URLs checked: 1,113
- OK: 829
- Dead (removed): 113  (DNS failure: 61, connection refused: 8, HTTP 404: 49, minus 5 already deduplicated)
- Redirected (kept, flagged in report): 374
- Slow >10s (kept): 1

Also adds tooling:
- tools/link_checker.py  -- async URL checker, writes JSON report
- tools/remove_dead_links.py  -- removes confirmed dead nodes from arf.json
- tools/link_audit_report.json  -- full audit results

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-03-21 18:29:19 -04:00