Robots.txt is better compared to meta robots tag. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and...