cosmetology research paper | good quotes for essays | | colleges for writers What is Robots.txt? - Page 2
Page 2 of 2 FirstFirst 12
Results 11 to 12 of 12

Thread: What is Robots.txt?

  1. #11


    It is a text file that tells web robots which pages on your site to crawl. It also tells web robots which pages not to crawl.

  2. #12
    Join Date
    Jan 2018


    Robots.txt file help to control your website indexing from search engines.

Similar Threads

  1. What is Robots.txt File?
    By stuartspindlow2 in forum Web Design Solutions
    Replies: 15
    Last Post: 09-29-2017, 07:10 AM
  2. Why we use Robots.txt File?
    By riprook7 in forum Business Tools
    Replies: 3
    Last Post: 03-21-2017, 07:33 AM
  3. What is the use of robots.txt?
    By artijain1900 in forum Web Design Solutions
    Replies: 5
    Last Post: 10-06-2016, 09:35 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts