Google as a largest search engine in the world crawls all the URLs from your site more effectively. It crawls millions of other webpages each and every day. In fact it crawls and indexes all the possible URLs from your website such as duplicate URLs, bad meaningless pages etc. For example take a look at