Technical Term Back

HTTP status

Crawling

The server response code that indicates whether a URL loads correctly, redirects, fails or does not exist. It helps confirm whether important pages can be discovered without obstacles or contradictory signals.

HTTP status
It matters because a website that cannot be crawled properly starts losing before it competes. If bots receive confusing signals, they may ignore important pages, waste crawl resources on low-value URLs or misread the real state of the site.
  • Check the real server response, not only the visual appearance.
  • Review robots.txt, HTTP status codes, sitemap and indexation rules.
  • Prioritize important URLs and reduce low-value paths.
  • Validate changes after migrations, redirects or template updates.