Hi all. I have a relatively simple script extracting some elements from a series of pages of which this is an example.

http://www.house.mo.gov/print.aspx?...jrn040.htm

I am having a problem in that the Get Web Page (whether I do DOM or IE) takes minutes or freezes entirely on each and every page. It eventually (most of the time) gets to my find and copy text actions but I can't get through even a few dozen pages.

I've rebooted, saved, updated, and fiddled and it just keeps happening. The website is a little sluggish in regular browsing but not bad and my Internet connection is solid.

Any ideas appreciated.
Thanks

Hi,

I looked at the page you mention and it has very long lines in the source. It's also a very big page source. I think that is the problem for the IE engine. I also noticed notepad ++ and some other editors can't handle the file.

As a workaround I have attached a script that used the Download File action to download the page source. Once it's successfully downloaded it will open the file as a Text File source and you can use the Text Manipulation actions to extract any content you need.

Hope this helps.
Tijn

Thanks. I've been experimenting with a similar technique of downloading the file with a spider and then running the script on it locally which works OK. Looks like you have a more efficient version of same general idea. Thanks