I need the web data crawler that can go to particular URL and performed various operations. The program needs to extract unique data and store information in Excel or MS Access.
For Example
1. Go to [login to view URL]
2. Press Search button
3. Save records for search results
a. Unique courses
b. All unique instructors names
For each course URL extract the following.
c. Course URL.
(The course url is [login to view URL];snum=1F90).
It’s defined by [login to view URL]
+javascriptobject(ABST, 1F90)
d. Course Title ( from link URL)
e. Course Description ( from link URL)
The program needs to be easy configurable. I need source and execution files. This is very small task that can be competed in few hours. I will reject all the bits more then $30