Question:
Hi, I developed a multi threading crawler in Delphi using ActiveX, with the TSpider class, which process works fine until stops suddenly without any exception, that terminates my thread. My code was divided in a few blocks, each them referencing a different URL in a single domain and his own TSpider instance (Ex: block1 www.domain.com, block 2 www.domain.com/folder, etc...). Have someone already found this problem? Am I doing something wrong?
Thanks