Crawl budget

Crawl budget is the number of pages a search engine will fetch from your site within a given period, based on your site's size, speed, and authority.

New or slow sites get a smaller budget, so crawlers may take longer to discover every page.

Why it matters: It's why large programmatic sites and brand-new sites can struggle to get fully indexed — and why fast pages and clean sitemaps help.