WEBDIENSTE/openswarm
1
0
Fork 0
mirror of https://github.com/openswarm-ai/openswarm.git synced 2026-08-17 18:25:42 +02:00
Code Issues Packages Projects Releases Wiki Activity

[eric] web: startpage's proof-of-work wall now covers POST too; name it a refusal so the breaker benches the dead engine honestly

Browse Source
This commit is contained in:
ciregenz
2026-08-10 13:01:38 -07:00
parent 785ee1301c
commit d506cf1896
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
backend/apps/agents/tools/search/search_startpage.py
+3
View File
@@ -92,6 +92,9 @@ async def search_startpage(query: str, num_results: int) -> StartpageAnswer:
results = parse_startpage_results(reply.text, num_results) results = parse_startpage_results(reply.text, num_results)
if results: if results:
return StartpageAnswer(results=results) return StartpageAnswer(results=results)
# Since ~2026-08 the POST gets the same ~10KB proof-of-work interstitial as GET (measured: 10,349 bytes, zero result anchors, 'challenge' markers); name it a refusal so the breaker benches the engine instead of treating the wall as a mystery empty page.
if "challenge" in reply.text and len(reply.text) < 40_000:
return StartpageAnswer(refused=True)
# Measured once in 14 tight-loop requests: Startpage serves its own no-results page for a query that answered 10 results a second later, so an empty page is only trustworthy when it says so. # Measured once in 14 tight-loop requests: Startpage serves its own no-results page for a query that answered 10 results a second later, so an empty page is only trustworthy when it says so.
if P_NO_RESULTS_MARKER in reply.text: if P_NO_RESULTS_MARKER in reply.text:
return StartpageAnswer() return StartpageAnswer()