copilot-swe-agent[bot]
b59179b4d5
Rebase: squash branch onto main with single Virgool data.json change
2026-03-24 22:01:31 +00:00
copilot-swe-agent[bot]
a2142634e1
fix(virgool): enable virgool.io via POST user-existence API
...
Use existing POST support from main to enable virgool.io:
- checkType: message with presenseStrs for user_exist:true
- urlProbe: POST /api/v1.4/auth/user-existence
- requestMethod: POST with requestPayload for username lookup
- Content-Type: application/json header
- absenceStrs with Persian user not found message
- disabled flag removed — POST API bypasses JS cookie protection
2026-03-24 22:01:18 +00:00
copilot-swe-agent[bot]
ab01dfce92
Merge remote-tracking branch 'origin/copilot/fix-broken-site-virgool' into copilot/fix-broken-site-virgool
2026-03-24 21:33:35 +00:00
copilot-swe-agent[bot] and soxoj
64cca25b12
fix(virgool): use existing POST support from main to enable virgool.io via user-existence API
...
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/e4d95115-25eb-44aa-b144-14d4bdc905c6
2026-03-24 21:32:45 +00:00
copilot-swe-agent[bot] and soxoj
7ba2fd31ea
refactor: move json import to module level and address review comments
...
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/e7f4ab84-917a-49fc-bfbd-9bbaf76027f8
2026-03-24 21:21:32 +00:00
copilot-swe-agent[bot] and soxoj
4d70f0f7c9
feat(virgool): add POST support and use user-existence API to bypass JS cookies
...
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/e7f4ab84-917a-49fc-bfbd-9bbaf76027f8
2026-03-24 21:20:03 +00:00
5aae2ee005
Fix update-site-data workflow race condition on branch push ( #2366 )
...
* Initial plan
* Fix update-site-data workflow race condition on branch push
- Add concurrency control to cancel in-progress runs on new pushes to main
- Delete existing PR branch before creating new one to avoid stale ref conflicts
- Upgrade peter-evans/create-pull-request from v5 to v7 (Node.js 20 deprecation)
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/a095d3d3-0093-43e8-9cc5-82797bd52453
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-24 22:10:03 +01:00
abd9aa57fe
Fix domain substring matching and NoneType crash in submit dialog ( #2367 )
...
* Initial plan
* Fix domain matching and NoneType error in submit.py
- Use regex with domain boundary matching instead of substring matching
to prevent x.com from matching 500px.com, mix.com, etc.
- Handle None old_site gracefully when user enters a site name not in
the matched list, fixing AttributeError crash.
- Add tests for both fixes.
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/7eabc755-47fd-4b80-a38c-9d6c056c2ce9
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-24 22:04:10 +01:00
2e430e5039
feat: add tag blacklisting via --exclude-tags ( #2352 )
...
* Initial plan
* feat: add tag blacklisting support (--exclude-tags CLI flag, web UI, docs, tests)
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/1a656af2-36bf-494f-9f03-1b5340f0357c
* fix: correct tag cloud label to match click-cycle interaction
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/1a656af2-36bf-494f-9f03-1b5340f0357c
* feat: add all country tags to web interface tag cloud
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/7e184b24-ff26-48fd-8a93-aea12b0a8d7b
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-24 22:00:59 +01:00
3e56c95e16
Fix SoundCloud false-positive: switch to message-based check ( #2355 )
...
* Initial plan
* Fix SoundCloud false-positive: switch from status_code to message checkType
SoundCloud returns HTTP 200 for non-existent user profiles (soft 404),
causing status_code check to report CLAIMED for random usernames.
Switch to message checkType with:
- presenseStrs: hydratable user marker in server-rendered HTML
- absenceStrs: generic page title for non-existent users
Markers sourced from WhatsMyName project's verified SoundCloud entry.
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/8aa10eef-78bf-4251-bf42-473cd94c7ef4
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-24 15:12:56 +01:00
28f35f9a4f
Fix club.cnews.ru false positive: switch from status_code to message checkType ( #2342 )
...
* Initial plan
* Fix club.cnews.ru false positive: switch from status_code to message checkType with absence strings
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/af131d2f-c7b5-4798-8ad1-86bab2673fe4
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-24 10:52:23 +01:00
eb541dcf51
Disable MirTesen site check (false positive) ( #2350 )
...
* Initial plan
* Disable MirTesen site check to fix false-positive probe
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/61c86064-423d-4f1b-8277-2838f747dd89
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-24 09:51:31 +01:00
4c97025a32
Disable Librusec site check (false positive) ( #2349 )
...
* Initial plan
* Disable Librusec site check to fix false-positive probe
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
2026-03-24 09:51:16 +01:00
d3f13ac295
Fix false-positive site probe: Re-enable Taplink with message checkType ( #2326 )
...
* Initial plan
* Disable Taplink site check to fix false-positive detections
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/ef9281f4-ba67-4760-a6e2-57564ac4ea94
* Re-enable Taplink with message checkType and absenceStrs
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/db3e572e-b79b-4cec-ac7f-062e76144660
* Improve Taplink absenceStrs: add Russian variant and presenseStrs
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/28e24317-e8b9-45f6-bad5-0e549b891313
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-23 21:36:36 +01:00
00a9249229
[WIP] Fix invalid link on forums.imore.com ( #2337 )
...
* Initial plan
* Remove dead forums.imore.com site from database
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/c83530d0-d24f-45fc-aca3-ae1e46ece33c
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-23 20:20:28 +01:00
005863c2e0
Fix Setlist site check: switch to message checkType with proper markers ( #2333 )
...
* Initial plan
* Disable Setlist site check due to false positives (soft 404)
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/8c552ca6-51e5-4e79-a791-ddd6f27d2461
* Fix Setlist check: switch to message checkType with proper markers
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/3c387df6-1dfe-451f-96d8-b4b6455f7857
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-23 20:18:33 +01:00
e3aada6aef
Fix RoyalCams site check using BongaCams white-label pattern ( #2334 )
...
* Initial plan
* Disable RoyalCams site check to fix false-positive probe
The Telegram Maigret bot auto-probe reported CLAIMED for three random
usernames. The status_code checkType is unreliable as the site returns
200 for non-existent user profiles (soft 404). Disabling the site check
until a reliable detection method can be established.
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/05b3d513-fe15-477d-a455-0c9ddf0b8b51
* Fix RoyalCams: switch to message checkType using BongaCams white-label pattern
RoyalCams runs on the BongaCams platform. Applied the same fix pattern:
- Switch from status_code to message checkType
- Use Portuguese locale (pt.royalcams.com) as urlProbe
- absenceStrs matches generic title on non-existent profiles
- presenseStrs matches Portuguese profile title for existing users
- Add browser-like headers matching BongaCams config
- Remove disabled flag
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/2f6a9523-278a-4992-ba7c-c320de14bfa4
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-23 20:16:45 +01:00
9b35fc1ab0
[WIP] Fix false-positive probe for vegalab site ( #2336 )
...
* Initial plan
* Disable vegalab site check: domain is dead (DNS does not resolve), causing false positives
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/98430e81-5dcb-4cb3-9aaa-f8c5ce86d026
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-23 20:09:46 +01:00
146bc0481b
Disable forums.stevehoffman.tv due to false positives ( #2331 )
...
* Initial plan
* Disable forums.stevehoffman.tv to fix false-positive site probe
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/39fea4a9-ec6d-4a12-b34b-1a3486d647e4
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-23 20:08:15 +01:00
5930a3022e
Disable false-positive site probe: amateurvoyeurforum.com ( #2332 )
...
* Initial plan
* Disable amateurvoyeurforum.com site check to fix false positives
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/e7fcad2b-4511-4e6d-b186-411951170e0a
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-23 20:07:42 +01:00
b960acec10
Pin requests-toolbelt>=1.0.0 to fix urllib3 v2 incompatibility ( #2316 )
...
* Initial plan
* Add requests-toolbelt ^1.0.0 as explicit dependency to fix urllib3 v2 appengine ImportError
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/458d41b2-c135-4b51-b0b1-b1832490c808
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-22 23:53:20 +01:00
b1a211c3cd
Disable forums.developer.nvidia.com (auth-gated user profiles) ( #2305 )
...
* Initial plan
* disable forums.developer.nvidia.com due to auth-locked user pages
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/b8f41f15-8588-4aac-a443-af5e2aaa1918
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-22 22:43:51 +01:00
56d0c9f2f1
Remove dead site xxxforum.org ( #2310 )
...
* Initial plan
* Remove broken site xxxforum.org from data.json and sites.md
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/bfbd3aa8-bfb1-480a-b2e7-a2c40fc69def
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-22 22:43:21 +01:00
01049b730d
Fix Love.Mail.ru: update to numeric-only identifiers and new profile URL ( #2307 )
...
* Initial plan
* fix: update Love.Mail.ru to use numeric-only identifiers (#1264 )
- Add regexCheck to enforce numeric-only IDs (^\d+$)
- Update usernameClaimed/usernameUnclaimed to numeric values
- Site remains disabled pending live verification
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/6de16097-6bc1-424a-beb1-1d2ec6b99944
* fix: update Love.Mail.ru URL to /profile/ path, enable check with verified ID
Use maintainer-provided working link https://love.mail.ru/profile/1838153357 .
- Change URL pattern from /ru/{username} to /profile/{username}
- Set usernameClaimed to 1838153357
- Remove disabled flag to enable the check
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/ac07d38e-46e2-42d3-9e93-eda3e5cfbcc3
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-22 22:42:59 +01:00
4f397fed1c
Re-enable taplink.cc with browser User-Agent to bypass Cloudflare ( #2308 )
...
* Initial plan
* fix(taplink): re-enable taplink.cc with browser User-Agent header to bypass Cloudflare
Remove disabled flag and add a Chrome User-Agent header to help
bypass Cloudflare bot detection for taplink.cc profile checks.
If Cloudflare still blocks requests, maigret's built-in error
detection will gracefully mark results as UNKNOWN.
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/271904b6-e358-4aeb-b503-21c9b91186d9
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
2026-03-22 22:10:44 +01:00
copilot-swe-agent[bot] and soxoj
2def9a2014
fix(virgool): switch from status_code to message check type with errors for JS cookies
...
The virgool.io site uses JS-generated cookies for anti-bot protection,
causing HTTP 200 for all URLs regardless of user existence. The
status_code check type always produced false positives.
Changes:
- Switch checkType from status_code to message so presence/absence
strings are actually used for detection
- Add presenseStrs with profile-specific markers that won't match
the JS cookie challenge page
- Add errors field to detect the JS cookie challenge page and report
a meaningful error message
- Keep disabled: true as the site requires JS execution
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com >
Agent-Logs-Url: https://github.com/soxoj/maigret/sessions/2df41b87-39e2-47c7-934a-f03106cef094
2026-03-22 21:00:40 +00:00
copilot-swe-agent[bot]
0615deab8b
Initial plan
2026-03-22 20:36:33 +00:00
copilot-swe-agent[bot]