View Single Post
Old 15th October 2019, 03:34 AM   #2
jeffscott
VIP Contributor
 
jeffscott's Avatar
 

Join Date: Oct 2014
Location: Singapore
Posts: 918
Default

Robot.txt is a tag that tells the search engine bots not to crawl the specific page.

__________________
Worldwide trusted website for Free Bet365 Football Tips!
jeffscott is offline   Reply With Quote