crwlr Files

Library for Rapid (Web) Crawler and Scraper Development

This is an exact mirror of the crwlr project, hosted at https://github.com/crwlrsoft/crawler. SourceForge is not affiliated with crwlr. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-06-10	230 Bytes	0
v3.5.3 source code.tar.gz	2025-06-10	87.2 kB	0
v3.5.3 source code.zip	2025-06-10	153.8 kB	0
Totals: 3 Items		241.2 kB	0

Fixed

Issues with passing cookies from the cookie jar to the headless browser when using the useBrowser() method on Http steps, in cases where the loader wasn’t globally configured to use the browser for all requests.

Source: README.md, updated 2025-06-10

Other Useful Business Software

Zenflow- The AI Workflow Engine for Software Devs

Parallel agents. Multi-agent orchestration. Specs that turn into shipped code. Zenflow automates planning, coding, testing, and verification.

Zenflow is the AI workflow engine built for real teams. Parallel agents plan, code, test, and verify in one workflow. With spec-driven development and deep context, Zenflow turns requirements into production-ready output so teams ship faster and stay in flow.

Try free now

Auth0 for AI Agents now in GA

Ready to implement AI with confidence (without sacrificing security)?

Connect your AI agents to apps and data more securely, give users control over the actions AI agents can perform and the data they can access, and enable human confirmation for critical agent actions.

Start building today

Recommended Projects

Image Crawler
The image crawler application is used to collect a multitude of images from websites. The images can be viewed as thumbnails or saved to a given folder for enhanced processing. (Html and XML report are generated)
SEO MACROSCOPE
SEO Macroscope is a website scanning tool, to check your website
Crawler Detect
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders
xsysinfo: X11 resource monitor
xsysinfo is an X Windows application that displays certain kernel operating values such as CPU load and load averages, memory usage, and swap usage.
TubeKit
TubeKit is a toolkit for creating YouTube crawlers. It allows one to build one's own crawler that can crawl YouTube based on a set of seed queries and collect up to 17 different attributes.

crwlr Files

Library for Rapid (Web) Crawler and Scraper Development

Get an email when there's a new version of crwlr

Fixed