Web Crawler - Help!

Discussion in 'Programming General' started by Noble Shane, Jul 30, 2010.

Web Crawler - Help!
  1. Unread #1 - Jul 30, 2010 at 4:52 AM
  2. Noble Shane
    Joined:
    Feb 19, 2010
    Posts:
    371
    Referrals:
    0
    Sythe Gold:
    0

    Noble Shane Forum Addict
    Banned

    Web Crawler - Help!

    Hey guys, I just wanted to know if its possible to make a Web Crawler that sends email to people like a bot. Eks. send mail to everyone in Berlin. And if it does works, what program do I use?
     
  3. Unread #2 - Jul 30, 2010 at 6:17 AM
  4. cp
    Joined:
    Jan 30, 2007
    Posts:
    3,278
    Referrals:
    6
    Sythe Gold:
    0

    cp an cat
    Banned

    Web Crawler - Help!

    Write one in PHP. I wrote one in 8th grade that worked pretty well. ^^

    The concept is simple. Using regex, you first harvest a list of webpages, then you visit each webpage and with more regex, harvest emails. Then harvest more links, then emails, etc. Just remember to a limit so you don't get trapped in a cycle, hehehe
     
  5. Unread #3 - Jul 30, 2010 at 6:27 AM
  6. Noble Shane
    Joined:
    Feb 19, 2010
    Posts:
    371
    Referrals:
    0
    Sythe Gold:
    0

    Noble Shane Forum Addict
    Banned

    Web Crawler - Help!

    Hehe, thanks for replying. Greatly appreciated. :
     
< SCLib - SytheClient's functions in a handy DLL | Some fix-ups for java conventions posted >

Users viewing this thread
1 guest


 
 
Adblock breaks this site