|
Maximum Connections Per Host Name |
Top Previous Next |
|
If your project works with several host names at the same time, for example you are downloading media files from TGP galleries, then you can limit number of connections to 5 crawler per host name and maximum of 50 crawler threads total. This will result in 10 galleries being downloaded at once from 10 different host names. |