Mysitemapgenerator / Help center / Website Crawling

How does the crawler process intrahost server redirects?


Crawler identifies the following standard HTTP status codes:
  • 301 Moved Permanently
  • 302 Found
  • 303 See Other
  • 307
If the page of your website will contain redirect on the same domain name, then crawler will index the page, specified in this redirect address.

Help center:

General
General Questions
Indexing
Website Crawling
Sync
Sync and Import
Sitemaps
Creating Sitemaps
Product feeds
Creating Product Feeds
RSS feeds
Creating RSS Feeds
Podcasts
Creating Podcasts
Billing
Billing