Answer using your Joblagao account

Leave your answer

or answer with facebook account
Ram Singh answered| Apr 29, 2014

When Bot visit your website first it check robot file, it use for security reason as you want to hide some web pages from bot, you mention in robot to not crawl.