Archived Forum Post

Index of archived forum posts

Question:

problem in intialization in web crawling.

Dec 13 '12 at 17:17

id i write this code spider.Initialize("www.imdb.com/find?q=don&s=all/");

        //  Add the 1st URL:

spider.AddUnspidered("http://www.imdb.com/find?q=don&s=all/"); then at line bool success; success = spider.CrawlNext(); it gives me false

but when i write this spider.Initialize("www.imdb.com");

        //  Add the 1st URL:

spider.AddUnspidered("http://www.imdb.com/find?q=don&s=all/"); it gives true and return the links of www.imdb.com this link rather then this http://www.imdb.com/find?q=don&s=all/ so what i want is to get the links of this page http://www.imdb.com/find?q=don&s=all/

---

Answer

i got it the problem is i should write url in spider.initialize("http://www.imdb.com/find?q=don&s=all/"); rather then the above