i need to go to a website and input some data in a specific input field, and run the query which opens a new page, i need to download and save it as an html page on my unix box. there are several blockages i am not able to figure out.
1. authentication is happening via another website, auth attempt is redirected to another website, which authenticates and stores some cookies on local PC, and loads back the page which called auth-site. 2. website needs internet explorer to operate properly. 3. this then presents menu from which i choose my choice and then that opens a form. 4. website uses javascript to build menus etc. 5. i fill some fields in the form and run it. (ok button) 6. returns result link on same page. 7. clicking the link opens the details in new page in which i am interested. websites of interest: http://xyz.abc.com/xyz/ and few more sites within same domain=> abc.com authentication website: https://www.myauth.abc.com/login/?retURL=http%3A%2F%2Fxyz.abc.com%2Fxyz%2Faction.login pl advice out of sooo many modules which will help me best here? I want to learn and use just one module for my all such "webpage-scraping/handling" . thanks in advance. Rajeev