Crawler: Sitemaps

Type: string[]

Parameter syntax

sitemaps: [
  'http://www.example.com',
  ...
]

About this parameter

URLs found in sitemaps are treated as startUrls for the crawler: they are used as starting points for the crawl.

Copy
{
  sitemaps: ['https://www.algolia.com/sitemap.xml'],
}

Did you find this page helpful?