the importance of being earnest essay | paper on greenhouse effect | http://forums.thewebhostbiz.com/index.php/help-i-didn-do-my-homework/ What is Robots.txt? - Page 2
Page 2 of 2 FirstFirst 12
Results 11 to 12 of 12

Thread: What is Robots.txt?

  1. #11

    Default

    It is a text file that tells web robots which pages on your site to crawl. It also tells web robots which pages not to crawl.

  2. #12
    Join Date
    Jan 2018
    Posts
    157

    Default

    Robots.txt file help to control your website indexing from search engines.

Similar Threads

  1. What is Robots.txt File?
    By stuartspindlow2 in forum Web Design Solutions
    Replies: 15
    Last Post: 09-29-2017, 07:10 AM
  2. Why we use Robots.txt File?
    By riprook7 in forum Business Tools
    Replies: 3
    Last Post: 03-21-2017, 07:33 AM
  3. What is the use of robots.txt?
    By artijain1900 in forum Web Design Solutions
    Replies: 5
    Last Post: 10-06-2016, 09:35 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •