They Use modest pieces of courses (named crawlers or bots) to adhere to many of the hyperlinks and find out new pages (together with updates to your webpages they discovered right before). It is also a great report to use when analyzing the organic and natural website traffic from Google https://easyfaq.io