txt file. In the same way, if you want to block some internet pages from Google altogether, blocking the Googlebot consumer agent will even block all Google's other user agents. But if you want additional fantastic-grained Command, you can obtain additional precise. For instance, you might want all your internet pages to appear in Google Lookup, bu