Retriever: a light, extensible crawler download

Retriever is a simple crawler packed as a Java library that allows developers to collect and manipulate documents reachable by a variety of protocols (e.g. http, smb). You'll easily crawl documents shared in a LAN, on the Web, and many other sources.

Project Activity

See All Activity >

License

Apache License V2.0

Follow Retriever: a light, extensible crawler

Retriever: a light, extensible crawler Web Site

Other Useful Business Software

Auth0 for AI Agents now in GA

Ready to implement AI with confidence (without sacrificing security)?

Connect your AI agents to apps and data more securely, give users control over the actions AI agents can perform and the data they can access, and enable human confirmation for critical agent actions.

Start building today

Rate This Project

User Reviews

Be the first to post a review of Retriever: a light, extensible crawler!

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Other toolkit

Programming Language

Java

Related Categories

Java Search Engines

Registered

2007-12-03

Similar Business Software

Perplexity

Where knowledge begins. Perplexity is an AI search engine that gives you quick answers. Available for free at as a web app, desktop app, or on the go on iPhone or Android. Perplexity AI is an advanced search and question-answering tool that leverages large language models to provide...

See Software
Google

Our mission is to organize the world's information so that everyone can access and use it. Every time you search, there are thousands, sometimes millions, of webpages with helpful information. How Google figures out which results to show starts long before you even type, and is guided by a...

See Software
DuckDuckGo

Get free, continuous protection for your privacy in the browser with one download. Browse as usual and we take care of the rest. We offer you search engine, tracker blocker and encryption enhancement all in one Chrome extension. Search privately with our app or extension, add private web search...

See Software
Luxxle

Luxxle is a next-generation search engine that prioritizes privacy, quality, and real-time results without tracking users or storing their data. It uses real-time crawling and indexing, ensuring the most up-to-date and relevant results, unlike search engines relying on outdated databases. Luxxle...

See Software
Ecosia

Ecosia is a search engine and browser experience built to turn everyday web activity into meaningful climate action. Every search helps fund global reforestation efforts, resulting in millions of trees planted across biodiversity hotspots. The company reinvests 100% of its profits into climate...

See Software
Swisscows

Since we never collect your data, we never track your data! We respect your privacy! It is in our DNA to protect every user! With Swisscows you are 100% anonymous! Have our own servers and do not work with a cloud or third party! Family is the most important cell of our society! If morality and...

See Software