Hi All,

I have a question regarding the compatibility/reliability of Djuggler Builder, I have to look a web site for 24 hour, if there are any updates then I need to retrive some updated information, as time is very important factor in this case and it is quite time consuming to test the script, as I need at least 24 hour and if any bug encounter then I need another 24 hour.


So I have a simple question-

1. Is a script in Djuggler builder able to run a long period of time i.e 24 hour or time may be increase according to condition ?

2. Sometimes system and script get hang due to a long period (time taking script I already faces some problem may be due to heavy downloading).

Please suggest.

Thanks,
Umesh

oops...


May be it could be a silly question...

But after posting this question I also created 4 scripts which are still running in a very effective way.

As far as Djuggler tool is concerned it seems to be really good.


Cheers,
Umesh

Hi Umesh,

Djuggler scripts can run as long as you like. Sometimes scraping speed is of the essence, in that case it's best to use the action Get Web page by source instead of the Get Web page action. Getting the source only means, it won't download style sheets, pictures, etc. This will increase the download speed. However typically DOM actions as Click Form Element won't work with source only.

Also when using a Data Grid for storage of results, means a memory table will be used for the web data your web scraper has copied. When you have lot's of records in your memory table you can reach the max of your computer memory and Windows and Djuggler will hang. You can prevent this by writing your results to a text file or XML without using a Data Grid.

Hope this helps.
Tijn

Hi Tijn,

Thanks for your kind support.

Regards,
Umesh :)