Notifications
 
Answer using your Joblagao account
 
Close

Leave your answer

 
or answer with facebook account
 
Ram Singh answered| Apr 29, 2014

When Bot visit your website first it check robot file, it use for security reason as you want to hide some web pages from bot, you mention in robot to not crawl.