Crawl Budget

Crawl budget refers to the number of pages Google or other search engines will crawl on your website within a specific period. It's determined by crawl rate limit (how fast Google can crawl without overwhelming your server) and crawl demand (how much Google wants to crawl based on popularity, freshness, and site quality). For large websites with thousands or millions of pages, optimizing crawl budget is crucial to ensure important pages get crawled and indexed regularly. Poor site structure, duplicate content, or broken links can waste crawl budget on low-value pages.