Register now to get rid of these ads!

who or what is "YAHOO SLURP SPIDER?

Discussion in 'Questions & Suggestions' started by choprods, Jan 26, 2006.

  1. Was checkin who's online and when I reached the Guest end of the list I noticed a"Yahoo Slurp Spider" in that section listed several times and watching various different threads like more than one at a time?any idea who that might be?:confused:
     
  2. lik2writ
    Joined: Feb 12, 2004
    Posts: 434

    lik2writ
    Member
    from NY

    It's a "bot" index tool for search engines.
     
  3. 97
    Joined: May 18, 2005
    Posts: 1,983

    97
    Member

    A blood ****ing ,nosey spam list builder scanning the whole HAMB for email addys so the owners( in this case it would appear to be Yahoo) can sell lists of otherwise unconnected names and addresses to spammers, so they in turn can offer you stuff you never heard of before and never want to hear of again.
    That's how you get all the junk email , virus, scams and other junk in your inbox.
     
  4. bwiencek
    Joined: Aug 30, 2005
    Posts: 325

    bwiencek
    Member

    All your questions answered here:

    http://help.yahoo.com/help/us/ysearch/slurp/

    Note that in any good web site you should be using the "robot exclusion standards" for pages which are not to be indexed, as well as directives to slow down the crawling (Ryan take note as this may explain occasional slowdowns - check the logfiles for heavy bot activity)

    PS - 97 - this spider is merely indexing the pages - it's not harvesting e-mail addresses.... those spiders are ususally by m***-mailing companies...
     
  5. thanks for the info . i saw it too , but i figured ryan must have seen it ...and do something about it if it was harmful
     

Share This Page

Register now to get rid of these ads!

Archive

Copyright © 1995-2021 The Jalopy Journal: Steal our stuff, we'll kick your teeth in. Terms of Service. Privacy Policy.

Atomic Industry
Forum software by XenForo™ ©2010-2014 XenForo Ltd.