Maximum Connections

Top  Previous  Next

Maximum number of crawler threads to use. The maximum number cannot be greater than 50 threads.


Important Notice: Usage of too many crawler threads can do more harm than good. The remote server administrator can threat your requests as a Denial-Of-Service attack and take appropriate actions against you. The reasonable number - 3 to 8 crawlers per host name.


Why 50 Threads Then And Not Just 8?


Please read this topic for an explanation.