Crawl Mode

Top  Previous  Next

Crawl Mode defines boundaries for Picture Ripper crawlers.

 

Crawler Mode combo box

Crawler Mode combo box

How to choose Crawl Mode?

 

You can use two strategies. One is to use Anywhere Mode AND employ Keyword Filtering and Crawl Depth features of Picture Ripper. This is a preferred strategy. Another strategy is to examine structure of site and select the mode that suits best for this structure.

 

There are 5 Crawl Modes to choose from:

 

Anywhere

Crawlers will follow any discovered link, no matter what site or domain it belongs to.

Current Domain

Crawlers will follow links inside domain of starting address only. For example, if we provide URL some-site.domain-one.com then all links that belong to domain-one.com will be followed.

Current Site

Crawlers will follow links inside host name of starting address only. For example, if we provide URL some-site.domain-one.com then all links that belong to some-site.domain-one.com will be followed. Links to some-other-site.domain-one.com will be ignored and not followed.

Not Current Domain

Not Current Site

 

 

Select Current Domain mode for:

 

Large scale sites that span over many servers;

Sites that host pages on main server, and serve media files from different host names;

Select Current Site mode for:

 

Small sites;

Personal home pages;