X-RAY Files

The next web scraper, see through the <html> noise

This is an exact mirror of the X-RAY project, hosted at https://github.com/matthewmueller/x-ray. SourceForge is not affiliated with X-RAY. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
Housekeeping edition.tar.gz	2019-07-07	20.5 kB	0
Housekeeping edition.zip	2019-07-07	30.9 kB	0
README.md	2019-07-07	212 Bytes	0
Totals: 3 Items		51.6 kB	0

Most of this is housekeeping to bump dependency versions, fix testability due to dependency changes, etc.

Now requires Node 6+.

Also, updates to add better async/await support and handling of empty streams.

Source: README.md, updated 2019-07-07

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Context for your AI agents

Crawl websites, sync to vector databases, and power RAG applications. Pre-built integrations for LLM pipelines and AI assistants.

Build data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.

Try for free

Recommended Projects

AutoScraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
PhantomJS-Node
PhantomJS integration module for NodeJS
Till
DataHen Till is a companion tool to your existing web scraper
crawlee
A web scraping and browser automation library for Node.js
Linkedin Scraper
A library that scrapes Linkedin for user data

X-RAY Files

The next web scraper, see through the <html> noise

Get an email when there's a new version of X-RAY