Simple and efficient proxy pool, providing the following functions. Regularly crawl free proxy websites, easy and scalable. Use Redis to store brokers and sort broker availability. Regular testing and screening to eliminate unavailable proxies and leave available proxies. Provides a proxy API to randomly select available proxies that pass the test. The principle analysis of the proxy pool can be seen in " How to Build an Efficient Proxy Pool ". It is recommended to read it before using it. There are two ways to run the proxy pool, one is using Docker (recommended), and the other is the normal way.

Features

  • Requires Docker
  • You can search for the installation method by yourself
  • The conventional method requires a Python environment and a Redis environment
  • If you have Docker and Docker-Compose installed, you only need one command to run
  • If you do not use Docker to run, you can also run it after configuring the Python and Redis environments
  • Install and configure Redis

Project Samples

ProxyPool Screenshot 1

Project Activity

See All Activity >

Categories

Frameworks, Web Development

License

MIT License

Follow ProxyPool

ProxyPool Web Site

Other Useful Business Software
Zenflow- The AI Workflow Engine for Software Devs Icon
Zenflow- The AI Workflow Engine for Software Devs

Parallel agents. Multi-agent orchestration. Specs that turn into shipped code. Zenflow automates planning, coding, testing, and verification.

Zenflow is the AI workflow engine built for real teams. Parallel agents plan, code, test, and verify in one workflow. With spec-driven development and deep context, Zenflow turns requirements into production-ready output so teams ship faster and stay in flow.
Try free now
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of ProxyPool!

Additional Project Details

Programming Language

Python

Related Categories

Python Frameworks, Python Web Development Software

Registered

2022-11-08
Report inappropriate content