How to hide a website from search engines?
I have a site that has been indexed with 115 pages, and 3/4 are with the Old links.
The new project is under development, so the idea is to remove the current site from search engines, and after the end of the same, add it again.
I have already read here on the website the article How to remove a Google website, but the tool used within the platform for Webmasters has already been updated.
What I did so far was delete all the contents of the site, leaving only one file robots.txt as follows:
User-agent: *
Disallow: /
I also just created a file called index.php , with a basic HTML structure:
<!DOCTYPE html>
<html lang="pt-br">
<head>
<meta name="robots" content="noindex">
</head>
<body>
</body>
</html>
1 answers
Man, at first you did it right. Although you started with user-agent for all search engines, right below you disabled it. I see that if the problem persists in appearing in search engines, I would put the exact path, for example: disallow: meusite / or www / or public_html /
I will attach a link, which helps me a lot with SEO of the sites.