A Python library for automating interaction with websites. MechanicalSoup automatically stores and sends cookies, follows redirects, and can follow links and submit forms. It doesn't do JavaScript. MechanicalSoup was created by M Hickford, who was a fond user of the Mechanize library. Unfortunately, Mechanize was incompatible with Python 3 until 2019 and its development stalled for several years. MechanicalSoup provides a similar API, built on Python giants Requests (for HTTP sessions) and BeautifulSoup (for document navigation). Since 2017 it is a project actively maintained by a small team.

Features

  • PyPy3 is also supported (and tested against)
  • Full documentation is available
  • Instructions for building, testing and contributing to MechanicalSoup
  • Many examples
  • Python library for automating interaction with websites
  • Customize the way to build a browser

Project Samples

MechanicalSoup Screenshot 1

Project Activity

See All Activity >

Categories

Web Scrapers

License

MIT License

Follow MechanicalSoup

MechanicalSoup Web Site

Other Useful Business Software
Push Code. Get a Production URL. Done. Icon
Push Code. Get a Production URL. Done.

Cloud Run deploys any language instantly. Scales to zero. Pay only when code runs.

Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
Try Cloud Run Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of MechanicalSoup!

Additional Project Details

Programming Language

Python

Related Categories

Python Web Scrapers

Registered

2023-04-10
Report inappropriate content