How Robots.txt affect Seo?
Robot.txt file also called as the robot exclusion protocol or standard, it is a text file that explains web robots which pages has not to crawl. The robot.txt file (REP) also contains directives like Meta robots. Along with page, sub-directory which instruct the search engine how should treat links. The REP also indicates specified agents […]
