View Full Version : What are the different ways to keep a site out of Google’s index? Which do you use an
HeavenlyBorn
07-29-2019, 04:25 AM
What are the different ways to keep a site out of Google’s index? Which do you use and when?
sinelogixtech
07-29-2019, 04:29 AM
Hi Friends,
We can keep your site out of Google's index by 2 easy methods which we followed for our pay stub generator website.
Disallow in robots.txt file
Adding No follow No index to the specific/all pages
So If you want to keep the whole website out of crawling and indexing, you can go with the robots.txt option. it will be done in a few minutes. we prefer 2nd while adding a new page or modifying an existing page when the site is live.
RH-Calvin
07-29-2019, 09:59 AM
You can list all your sites URLs in the disallow section of your website's robots.txt file. These disallowed URLs will never be crawled by search engine spiders.
BangkokDinning
07-29-2019, 12:28 PM
1. Errors in the robots.txt file of your website will keep Google away. ...
2. Use the meta robots noindex tag and Google will go away. ...
3. The wrong HTTP status code will send Google away. ...
4. Google won't index password protected pages. ...
5. If your pages require cookies or JavaScript, Google might not be able to index your pages.
Powered by vBulletin® Version 4.2.2 Copyright © 2025 vBulletin Solutions, Inc. All rights reserved.