About Spambots

Spambots are programs which crawl the web and scour newsgroups to harvest email addresses.

• Spambots Described
• Robot User Agents
• Spambot Demos

Related

• Spam Prevention for Users

Spambots Described

Spambot Beware - www.turnstep.com/Spambot/
Blocking the Spambots - fantomaster.com/faantispamtip4.html
Robots, Spiders, Crawlers and Wanderers - www.elsop.com/wrc/robot.htm
Spam and web-visible email addresses - www.dslreports.com/shownews/15234
The Harvester Project - www.spywareinfo.com/harvest_project/
Robots.txt - www.robotstxt.org/robotstxt.html - the robots.txt protocol
Spam Proofing Your Web Site - www.michaelroebuck.com/nospam.htm
Email Address Harvesting and the Effectiveness of Anti-Spam Filters - www.ftc.gov/opa/2005/11/spamharvest.pdf

Robot User Agents and Databases

Bad Agents - www.neilgunton.com/spambot_trap/bad_agents.txt
Protect Your Webserver From Spam Harvesters - www.leekillough.com/antispam.html
E-Mail Collectors List - www.siteware.ch/webresources/useragents/collectors/
SpiderHunter.com - www.spiderhunter.com/
List of User-Agents - www.psychedelix.com/agents/index.shtml
Database of Web Robots - www.robotstxt.org/db.html
Search Engine Agents - www.jafsoft.com/searchengines/webbots.html
Robots, spiders and other user agents: a resource for WebMasters - joseluis.pellicer.org/ua/
List of Robot Agent Strings - www.pgts.com.au/pgtsj/pgtsj0208d.html
User Agent Database - www.tnl.net/ua/
Bots vs Browsers - www.botsvsbrowsers.com/
Searchable Directory of User Agents - www.the-art-of-web.com/system/agents/
Top Spam Harvester User Agents - www.projecthoneypot.org/harvester_useragents.php
Web Robots - web-robot-abuse.blogspot.com/

Spambot “Demos”

These websites can either run over your webpages and will let you know if they can read any addresses from the pages, or show some method that an email address harvester could use to extract email addresses.

Encoded email address harvester - www.dreamweaverfever.com/experiments/spam/