mirror of
https://github.com/suitenumerique/drive.git
synced 2026-09-13 05:07:55 +02:00
robots.txt blocked all crawling, so crawlers could never fetch the pages and never saw the noindex meta tag: URLs discovered through external links could still end up listed in search results. Allow crawling in robots.txt and add a X-Robots-Tag noindex header on frontend pages and media files so every response carries the directive.