Adblock breaks this site

Pulling data

Discussion in 'Technology' started by ryanboyd, Feb 14, 2018.

  1. ryanboyd

    ryanboyd Forum Addict
    $25 USD Donor New

    Joined:
    May 28, 2016
    Posts:
    463
    Referrals:
    0
    Sythe Gold:
    16
    Discord Unique ID:
    203906109067493377
    Rust Player Dragon Claws Easter 2017 Extreme Homosex Potamus
    Pulling data

    Deleted Thanks
     
    Last edited: Oct 20, 2018
  2. SuperNovae

    SuperNovae Newcomer

    Joined:
    Feb 7, 2018
    Posts:
    4
    Referrals:
    0
    Sythe Gold:
    3
    Pulling data

  3. kmjt

    kmjt -.- The nocturnal life chose me -.-
    Banned

    Joined:
    Aug 21, 2009
    Posts:
    14,450
    Referrals:
    8
    Sythe Gold:
    449
    Pulling data

    don't scrape government sites dude, use public API if it's offered
     
    StickTalk likes this.
  4. iJava

    iJava .Previously known as RSGoldRush
    $200 USD Donor New

    Joined:
    Nov 21, 2011
    Posts:
    1,197
    Referrals:
    11
    Sythe Gold:
    485
    Discord Unique ID:
    220055593568829441
    Pulling data

    Why?
     
  5. kmjt

    kmjt -.- The nocturnal life chose me -.-
    Banned

    Joined:
    Aug 21, 2009
    Posts:
    14,450
    Referrals:
    8
    Sythe Gold:
    449
    Pulling data

    why would you if it's in their TOS not to? I scraped a transit site for bus times one time and got a warning to use the API
     
  6. USG

    USG Member

    Joined:
    Feb 16, 2018
    Posts:
    62
    Referrals:
    0
    Sythe Gold:
    111
    Pulling data

    HTML Scraper works the best IMO.
     
  7. iJava

    iJava .Previously known as RSGoldRush
    $200 USD Donor New

    Joined:
    Nov 21, 2011
    Posts:
    1,197
    Referrals:
    11
    Sythe Gold:
    485
    Discord Unique ID:
    220055593568829441
    Pulling data

    Don't think all government sites will have it in their terms :D
     
    USG and kmjt like this.
< Most comfortable over ear headphones $100+ | Gaming PC >


 
 
Adblock breaks this site