Crawler: ExtraUrls

About this parameter

URLs found in extraUrls are treated as startUrls for your crawler: they are used as starting points for the crawl.

Crawler saves URLs added through the Add a URL field of the Admin’s Settings tab to the extraUrls array.

Internally extraUrls is treated like startUrls. The separate parameter identifies which URLs are added through the configuration file, and which are added through the Admin.

Examples

1
2
3
{
  extraUrls: ['https://www.algolia.com/blog/'],
}