Maximum Connections Per Host Name

Top  Previous  Next

If your project works with several host names at the same time, for example you are downloading media files from TGP galleries, then you can limit number of connections to 5 crawler per host name and maximum of 50 crawler threads total. This will result in 10 galleries being downloaded at once from 10 different host names.