On Mar 5, 2012, at 2:31 PM, Mike Naberezny wrote: > Hi Jim, > > On 3/5/12 2:15 PM, Jim Brain wrote: >> I should have looked there, but I honestly did perform a search and nothing >> came up. My Google-fu must be weak. > > http://bombjack.org/robots.txt > > Bombjack is not likely to appear in search results because it has a robots.txt file that asks robots to not crawl the site. I'd recommend only disallowing the path that contains the .pdf files but leaving everything else open. Google also has a checker for robots.txt if you want to test it. http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449 -Nate Message was sent through the cbm-hackers mailing listReceived on 2012-03-05 23:00:29
Archive generated by hypermail 2.2.0.