allow crawling of commit page but not patch/diffs
Created by: bbodenmiller
Commit page has valuable information that search engines should be allowed to crawl however the .patch and .diff pages have no new information that is not on commit page
Created by: bbodenmiller
Commit page has valuable information that search engines should be allowed to crawl however the .patch and .diff pages have no new information that is not on commit page