Results 1 to 4 of 4

Thread: What is the limit of a robot.txt file?

  1. 03-28-2018, 07:01 AM #1
    artijain1900
    artijain1900 is offline Member
    Join Date
    Mar 2016
    Location
    India
    Posts
    74

    Default What is the limit of a robot.txt file?

    Hello friends,

    What is the limit of a robot.txt file?
    Husband wife problem solution | Witchcraft Specialist | Acquire online Astrology Predictions in India | Intercast love marriage problem solution | Love marriage problem solution by astrology advice | Vedic astrologers for Love spell | Astrology consultancy services in India
    Reply With Quote Reply With Quote
  2. 03-29-2018, 04:48 AM #2
    sinelogixtech
    sinelogixtech is offline Senior Member
    Join Date
    Apr 2017
    Posts
    885

    Default

    Google has a limit of only being able to process up to 500KB of your robots.txt file.
    website development company in india | website designer in bangalore | Website company in India | Magento expert in california | Wordpress developer in california | Woocommerce developer in california | Website designer in california | Laravel developer in USA | Shopify developer in USA | website agency in USA |
    Reply With Quote Reply With Quote
  3. 04-04-2018, 06:31 PM #3
    RH-Calvin
    RH-Calvin is offline Senior Member
    Join Date
    Jun 2013
    Location
    Forum
    Posts
    2,096

    Default

    Googlebot reads the first 500 KB present in the robots.txt file.
    █ Cheap VPS Hosting | $1 VPS Hosting
    █ Windows VPS Hosting | Windows with Remote Desktop Access
    █ Cheap Dedicated Servers | Linux Dedicated Server Hosting
    Reply With Quote Reply With Quote
  4. 04-09-2018, 11:33 AM #4
    acmastechnologi
    acmastechnologi is offline Junior Member
    Join Date
    Nov 2017
    Location
    Delhi, India
    Posts
    26

    Default

    Yes, there is a limit to robots.txt file in terms of filesize 500 KB as Vipin points out. A maximum file size may be enforced per crawler.
    CO2 Incubator Manufacturer & Suppliers | incubator shaker manufacturers | Vacuum Oven Rectangular | mortuary chamber manufacturers
    Reply With Quote Reply With Quote
« Previous Thread | Next Thread »

Similar Threads

  1. Meta Title Character Limit?
    By acmastechnologi in forum Business Tools
    Replies: 5
    Last Post: 04-19-2018, 06:26 AM
  2. What is the character limit for AdWords ad?
    By ninadordev in forum Business Tools
    Replies: 2
    Last Post: 03-31-2018, 09:13 AM
  3. Character limit of h1 and h2 in SEO?
    By acmastechnologi in forum Business Tools
    Replies: 1
    Last Post: 03-26-2018, 06:01 AM
  4. What is the limit of a robot.txt file?
    By ninadordev in forum Business Tools
    Replies: 4
    Last Post: 02-25-2018, 08:09 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules