mirror of
https://github.com/suitenumerique/drive.git
synced 2026-08-17 20:15:40 +02:00
robots.txt blocked all crawling, so crawlers could never fetch the pages and never saw the noindex meta tag: URLs discovered through external links could still end up listed in search results. Allow crawling in robots.txt and add a X-Robots-Tag noindex header on frontend pages and media files so every response carries the directive.