Robust featureful multi-threaded CLI web spider using apache commons httpclient v3.0 written in java. ASpider downloads any files matching your given mime-types from a website. Tries to reg.exp. match emails by default, logging all results using log4j.

Project Activity

See All Activity >

Categories

Browsers, Search Engines, Link Checking, Web Scrapers

License

BSD License

Follow ASpider

ASpider Web Site

Other Useful Business Software
AI-powered service management for IT and enterprise teams Icon
AI-powered service management for IT and enterprise teams

Enterprise-grade ITSM, for every business

Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity. Maximize operational efficiency with refreshingly simple, AI-powered Freshservice.
Try it Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of ASpider!

Additional Project Details

Languages

English

Intended Audience

End Users/Desktop

User Interface

Command-line

Programming Language

Java

Database Environment

Flat-file

Related Categories

Java Browsers, Java Search Engines, Java Link Checking Software, Java Web Scrapers

Registered

2004-12-15
Report inappropriate content