Has anyone else ever done one of these projects to scrape data from the GE?
I have an idea to make a BETTER version of the GE site than the one Jagex Presents that is more useful to people trying to track trends in the market so they can predict what to merchant successfully alot more often.
I wrote a program that can datascrape the GE when you enter and item id number. It will return all relevant information on that item.
This program is the basis of what I am trying to do. I have another program that can generate a complete list of all item ids that are currently in use that I wrote. In conjunction with a modified version of this program that I am posting here I hope to start making daily database dumps and collecting data, and then designing an interface people can use over the web to analyze it the way they want.
Would you consider such a site useful?
I know that various fansites track prices, but their updates are done manually and are sometimes several days old.
Here is a link to my scraper if you want to try it out:
http://getracker.co.cc/gedump.exe
Its very basic right now but should turn into something much more complex and useful.
