Skip to content

GitLab

Merged
Created by Administrator@rootOwner

disallow irrelevant pages by defaults in robots

  1. 18 Aug, 2015 1 commit
    • Ben Bodenmiller's avatar
      disallow irrelevant pages by default in robots · 595a93ee
      Ben Bodenmiller authored 
      Update default robots.txt rules to disallow irrelevant pages that search
engines should not care about. This will still allow important pages
like the files, commit details, merge requests, issues, comments, etc.
to be crawled.
      595a93ee

Menu

Help