Control Crawling and Indexing
in this article, today we will describe how you can control Google's ability to Crawling and Indexing your content to show it in Search and additional Google properties, as well as how to stop Google from crawling specific content on your website.Here's a quick explanation of each page. To obtain an outline of crawling and indexing,
 |
| Control Crawling and Indexing |
Source :https://developers.google.com/search/docs/advanced/crawling/overview