ryanboyd Forum Addict Joined May 28, 2016 Sythe Gold 16 Messages 463 Feb 14, 2018 #1 Deleted Thanks Last edited: Oct 20, 2018
SuperNovae Newcomer Joined Feb 7, 2018 Sythe Gold 3 Messages 4 Age 36 Feb 17, 2018 #2 You can scrape it easily with an HTML scraper. If it's just a single use for this I'd recommend using an existing piece of software. I've used: Import.io | Extract data from the web and Extract data from any websites into a spreadsheet Easy to use but not much functionality.
You can scrape it easily with an HTML scraper. If it's just a single use for this I'd recommend using an existing piece of software. I've used: Import.io | Extract data from the web and Extract data from any websites into a spreadsheet Easy to use but not much functionality.
kmjt -.- The nocturnal life chose me -.- Joined Aug 21, 2009 Sythe Gold 449 Messages 14,450 Location Canada Feb 24, 2018 #3 don't scrape government sites dude, use public API if it's offered
I iJava .Previously known as RSGoldRush Joined Nov 21, 2011 Sythe Gold 491 Messages 1,204 Feb 24, 2018 #4 kmjt said: don't scrape government sites dude, use public API if it's offered Click to expand... Why?
kmjt said: don't scrape government sites dude, use public API if it's offered Click to expand... Why?
kmjt -.- The nocturnal life chose me -.- Joined Aug 21, 2009 Sythe Gold 449 Messages 14,450 Location Canada Feb 24, 2018 #5 RSGoldRush said: Why? Click to expand... why would you if it's in their TOS not to? I scraped a transit site for bus times one time and got a warning to use the API
RSGoldRush said: Why? Click to expand... why would you if it's in their TOS not to? I scraped a transit site for bus times one time and got a warning to use the API
USG Member Joined Feb 16, 2018 Sythe Gold 111 Messages 62 Age 38 Location Canada Feb 24, 2018 #6 HTML Scraper works the best IMO.
I iJava .Previously known as RSGoldRush Joined Nov 21, 2011 Sythe Gold 491 Messages 1,204 Feb 25, 2018 #7 kmjt said: why would you if it's in their TOS not to? I scraped a transit site for bus times one time and got a warning to use the API Click to expand... Don't think all government sites will have it in their terms
kmjt said: why would you if it's in their TOS not to? I scraped a transit site for bus times one time and got a warning to use the API Click to expand... Don't think all government sites will have it in their terms