├── .github ├── FUNDING.yml ├── ISSUE_TEMPLATE │ ├── add-new-library-to-this-list.md │ └── add-xxx.md └── PULL_REQUEST_TEMPLATE.md ├── .gitignore ├── .travis.yml ├── CONTRIBUTING.md ├── LICENSE ├── Makefile ├── README.md ├── docs ├── CNAME └── css │ └── extra.css ├── mkdocs.yml ├── requirements.txt └── sort.py /.github/FUNDING.yml: -------------------------------------------------------------------------------- 1 | # These are supported funding model platforms 2 | open_collective: awesome-python 3 | -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/add-new-library-to-this-list.md: -------------------------------------------------------------------------------- 1 | --- 2 | name: Add new library to this list 3 | about: '' 4 | title: '' 5 | labels: '' 6 | assignees: '' 7 | 8 | --- 9 | 10 | **Please open a Pull Request instead.** 11 | -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/add-xxx.md: -------------------------------------------------------------------------------- 1 | --- 2 | name: Add XXX 3 | about: Add new item to the list 4 | title: '' 5 | labels: '' 6 | assignees: '' 7 | 8 | --- 9 | 10 | **Please open a Pull Request instead.** 11 | -------------------------------------------------------------------------------- /.github/PULL_REQUEST_TEMPLATE.md: -------------------------------------------------------------------------------- 1 | ## What is this Python project? 2 | 3 | Describe features. 4 | 5 | ## What's the difference between this Python project and similar ones? 6 | 7 | Enumerate comparisons. 8 | 9 | -- 10 | 11 | Anyone who agrees with this pull request could submit an *Approve* review to it. 12 | -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | .DS_Store 2 | 3 | *.py[co] 4 | 5 | docs/index.md 6 | site/ 7 | 8 | # PyCharm IDE 9 | .idea 10 | -------------------------------------------------------------------------------- /.travis.yml: -------------------------------------------------------------------------------- 1 | language: python 2 | 3 | python: 4 | - "3.6" 5 | 6 | script: 7 | - python sort.py 8 | - cp README.md docs/index.md 9 | - mkdocs build 10 | 11 | deploy: 12 | provider: pages 13 | local-dir: site 14 | skip-cleanup: true 15 | keep-history: true 16 | github-token: $GITHUB_TOKEN 17 | on: 18 | branch: master 19 | -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- 1 | # Contributing 2 | 3 | Your contributions are always welcome! 4 | 5 | ## Guidelines 6 | 7 | * Add one link per Pull Request. 8 | * Make sure the PR title is in the format of `Add project-name`. 9 | * Write down the reason why the library is awesome. 10 | * Add the link: `* [project-name](http://example.com/) - A short description ends with a period.` 11 | * Keep descriptions concise and **short**. 12 | * Add a section if needed. 13 | * Add the section description. 14 | * Add the section title to Table of Contents. 15 | * Search previous Pull Requests or Issues before making a new one, as yours may be a duplicate. 16 | * Don't mention `Python` in the description as it's implied. 17 | * Check your spelling and grammar. 18 | * Remove any trailing whitespace. 19 | 20 | Just a gentle reminder: **Try not to submit your own project. Instead, wait for someone finds it useful and submits it for you.** 21 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- 1 | Creative Commons Attribution 4.0 International License (CC BY 4.0) 2 | 3 | http://creativecommons.org/licenses/by/4.0/ 4 | -------------------------------------------------------------------------------- /Makefile: -------------------------------------------------------------------------------- 1 | site_install: 2 | pip install -r requirements.txt 3 | 4 | site_link: 5 | ln -sf $(CURDIR)/README.md $(CURDIR)/docs/index.md 6 | 7 | site_preview: site_link 8 | mkdocs serve 9 | 10 | site_build: site_link 11 | mkdocs build 12 | 13 | site_deploy: site_link 14 | mkdocs gh-deploy --clean 15 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Awesome Python [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome) 2 | 3 | A curated list of awesome Python frameworks, libraries, software and resources. 4 | 5 | Inspired by [awesome-php](https://github.com/ziadoz/awesome-php). 6 | 7 | - [Awesome Python](#awesome-python) 8 | - [Admin Panels](#admin-panels) 9 | - [Algorithms and Design Patterns](#algorithms-and-design-patterns) 10 | - [ASGI Servers](#asgi-servers) 11 | - [Asynchronous Programming](#asynchronous-programming) 12 | - [Audio](#audio) 13 | - [Authentication](#authentication) 14 | - [Build Tools](#build-tools) 15 | - [Built-in Classes Enhancement](#built-in-classes-enhancement) 16 | - [Caching](#caching) 17 | - [ChatOps Tools](#chatops-tools) 18 | - [CMS](#cms) 19 | - [Code Analysis](#code-analysis) 20 | - [Command-line Interface Development](#command-line-interface-development) 21 | - [Command-line Tools](#command-line-tools) 22 | - [Compatibility](#compatibility) 23 | - [Computer Vision](#computer-vision) 24 | - [Concurrency and Parallelism](#concurrency-and-parallelism) 25 | - [Configuration](#configuration) 26 | - [Cryptography](#cryptography) 27 | - [Data Analysis](#data-analysis) 28 | - [Data Validation](#data-validation) 29 | - [Data Visualization](#data-visualization) 30 | - [Database Drivers](#database-drivers) 31 | - [Database](#database) 32 | - [Date and Time](#date-and-time) 33 | - [Debugging Tools](#debugging-tools) 34 | - [Deep Learning](#deep-learning) 35 | - [DevOps Tools](#devops-tools) 36 | - [Distributed Computing](#distributed-computing) 37 | - [Distribution](#distribution) 38 | - [Documentation](#documentation) 39 | - [Downloader](#downloader) 40 | - [E-commerce](#e-commerce) 41 | - [Editor Plugins and IDEs](#editor-plugins-and-ides) 42 | - [Email](#email) 43 | - [Enterprise Application Integrations](#enterprise-application-integrations) 44 | - [Environment Management](#environment-management) 45 | - [Files](#file) 46 | - [Foreign Function Interface](#foreign-function-interface) 47 | - [Forms](#forms) 48 | - [Functional Programming](#functional-programming) 49 | - [Game Development](#game-development) 50 | - [Geolocation](#geolocation) 51 | - [GUI Development](#gui-development) 52 | - [Hardware](#hardware) 53 | - [HTML Manipulation](#html-manipulation) 54 | - [HTTP Clients](#http-clients) 55 | - [Image Processing](#image-processing) 56 | - [Implementations](#implementations) 57 | - [Interactive Interpreter](#interactive-interpreter) 58 | - [Internationalization](#internationalization) 59 | - [Job Scheduler](#job-scheduler) 60 | - [Logging](#logging) 61 | - [Machine Learning](#machine-learning) 62 | - [Miscellaneous](#miscellaneous) 63 | - [Natural Language Processing](#natural-language-processing) 64 | - [Network Virtualization](#network-virtualization) 65 | - [News Feed](#news-feed) 66 | - [ORM](#orm) 67 | - [Package Management](#package-management) 68 | - [Package Repositories](#package-repositories) 69 | - [Penetration testing](#penetration-testing) 70 | - [Permissions](#permissions) 71 | - [Processes](#processes) 72 | - [Recommender Systems](#recommender-systems) 73 | - [Refactoring](#refactoring) 74 | - [RESTful API](#restful-api) 75 | - [Robotics](#robotics) 76 | - [RPC Servers](#rpc-servers) 77 | - [Science](#science) 78 | - [Search](#search) 79 | - [Serialization](#serialization) 80 | - [Serverless Frameworks](#serverless-frameworks) 81 | - [Shell](#shell) 82 | - [Specific Formats Processing](#specific-formats-processing) 83 | - [Static Site Generator](#static-site-generator) 84 | - [Tagging](#tagging) 85 | - [Task Queues](#task-queues) 86 | - [Template Engine](#template-engine) 87 | - [Testing](#testing) 88 | - [Text Processing](#text-processing) 89 | - [Third-party APIs](#third-party-apis) 90 | - [URL Manipulation](#url-manipulation) 91 | - [Video](#video) 92 | - [Web Asset Management](#web-asset-management) 93 | - [Web Content Extracting](#web-content-extracting) 94 | - [Web Crawling](#web-crawling) 95 | - [Web Frameworks](#web-frameworks) 96 | - [WebSocket](#websocket) 97 | - [WSGI Servers](#wsgi-servers) 98 | - [Resources](#resources) 99 | - [Books](#books) 100 | - [Newsletters](#newsletters) 101 | - [Podcasts](#podcasts) 102 | - [Websites](#websites) 103 | - [Contributing](#contributing) 104 | 105 | --- 106 | 107 | ## Admin Panels 108 | 109 | *Libraries for administrative interfaces.* 110 | 111 | * [ajenti](https://github.com/ajenti/ajenti) - The admin panel your servers deserve. 112 | * [django-grappelli](https://grappelliproject.com/) - A jazzy skin for the Django Admin-Interface. 113 | * [django-jet](https://github.com/geex-arts/django-jet) - Modern responsive template for the Django admin interface with improved functionality. 114 | * [django-suit](https://djangosuit.com/) - Alternative Django Admin-Interface (free only for Non-commercial use). 115 | * [django-xadmin](https://github.com/sshwsfc/xadmin) - Drop-in replacement of Django admin comes with lots of goodies. 116 | * [flask-admin](https://github.com/flask-admin/flask-admin) - Simple and extensible administrative interface framework for Flask. 117 | * [flower](https://github.com/mher/flower) - Real-time monitor and web admin for Celery. 118 | * [jet-bridge](https://github.com/jet-admin/jet-bridge) - Admin panel framework for any application with nice UI (ex Jet Django). 119 | * [wooey](https://github.com/wooey/wooey) - A Django app which creates automatic web UIs for Python scripts. 120 | 121 | ## Algorithms and Design Patterns 122 | 123 | *Python implementation of data structures, algorithms and design patterns. Also see [awesome-algorithms](https://github.com/tayllan/awesome-algorithms).* 124 | 125 | * Algorithms 126 | * [algorithms](https://github.com/keon/algorithms) - Minimal examples of data structures and algorithms. 127 | * [python-ds](https://github.com/prabhupant/python-ds) - A collection of data structure and algorithms for coding interviews. 128 | * [sortedcontainers](https://github.com/grantjenks/python-sortedcontainers) - Fast and pure-Python implementation of sorted collections. 129 | * [TheAlgorithms](https://github.com/TheAlgorithms/Python) - All Algorithms implemented in Python. 130 | * Design Patterns 131 | * [PyPattyrn](https://github.com/tylerlaberge/PyPattyrn) - A simple yet effective library for implementing common design patterns. 132 | * [python-patterns](https://github.com/faif/python-patterns) - A collection of design patterns in Python. 133 | * [transitions](https://github.com/pytransitions/transitions) - A lightweight, object-oriented finite state machine implementation. 134 | 135 | ## ASGI Servers 136 | 137 | *[ASGI](https://asgi.readthedocs.io/en/latest/)-compatible web servers.* 138 | 139 | * [daphne](https://github.com/django/daphne) - A HTTP, HTTP2 and WebSocket protocol server for ASGI and ASGI-HTTP. 140 | * [uvicorn](https://github.com/encode/uvicorn) - A lightning-fast ASGI server implementation, using uvloop and httptools. 141 | 142 | ## Asynchronous Programming 143 | 144 | * [asyncio](https://docs.python.org/3/library/asyncio.html) - (Python standard library) Asynchronous I/O, event loop, coroutines and tasks. 145 | - [awesome-asyncio](https://github.com/timofurrer/awesome-asyncio) 146 | * [trio](https://github.com/python-trio/trio) - A friendly library for async concurrency and I/O. 147 | * [Twisted](https://twistedmatrix.com/trac/) - An event-driven networking engine. 148 | * [uvloop](https://github.com/MagicStack/uvloop) - Ultra fast asyncio event loop. 149 | 150 | ## Audio 151 | 152 | *Libraries for manipulating audio and its metadata.* 153 | 154 | * Audio 155 | * [audioread](https://github.com/beetbox/audioread) - Cross-library (GStreamer + Core Audio + MAD + FFmpeg) audio decoding. 156 | * [audioFlux](https://github.com/libAudioFlux/audioFlux) - A library for audio and music analysis, feature extraction. 157 | * [dejavu](https://github.com/worldveil/dejavu) - Audio fingerprinting and recognition. 158 | * [kapre](https://github.com/keunwoochoi/kapre) - Keras Audio Preprocessors. 159 | * [librosa](https://github.com/librosa/librosa) - Python library for audio and music analysis. 160 | * [matchering](https://github.com/sergree/matchering) - A library for automated reference audio mastering. 161 | * [mingus](http://bspaans.github.io/python-mingus/) - An advanced music theory and notation package with MIDI file and playback support. 162 | * [pyAudioAnalysis](https://github.com/tyiannak/pyAudioAnalysis) - Audio feature extraction, classification, segmentation and applications. 163 | * [pydub](https://github.com/jiaaro/pydub) - Manipulate audio with a simple and easy high level interface. 164 | * [TimeSide](https://github.com/Parisson/TimeSide) - Open web audio processing framework. 165 | * Metadata 166 | * [beets](https://github.com/beetbox/beets) - A music library manager and [MusicBrainz](https://musicbrainz.org/) tagger. 167 | * [eyeD3](https://github.com/nicfit/eyeD3) - A tool for working with audio files, specifically MP3 files containing ID3 metadata. 168 | * [mutagen](https://github.com/quodlibet/mutagen) - A Python module to handle audio metadata. 169 | * [tinytag](https://github.com/devsnd/tinytag) - A library for reading music meta data of MP3, OGG, FLAC and Wave files. 170 | 171 | ## Authentication 172 | 173 | *Libraries for implementing authentications schemes.* 174 | 175 | * OAuth 176 | * [authlib](https://github.com/lepture/authlib) - JavaScript Object Signing and Encryption draft implementation. 177 | * [django-allauth](https://github.com/pennersr/django-allauth) - Authentication app for Django that "just works." 178 | * [django-oauth-toolkit](https://github.com/evonove/django-oauth-toolkit) - OAuth 2 goodies for Django. 179 | * [oauthlib](https://github.com/idan/oauthlib) - A generic and thorough implementation of the OAuth request-signing logic. 180 | * [python-oauth2](https://github.com/joestump/python-oauth2) - A fully tested, abstract interface to creating OAuth clients and servers. 181 | * [python-social-auth](https://github.com/omab/python-social-auth) - An easy-to-setup social authentication mechanism. 182 | * JWT 183 | * [pyjwt](https://github.com/jpadilla/pyjwt) - JSON Web Token implementation in Python. 184 | * [python-jose](https://github.com/mpdavis/python-jose/) - A JOSE implementation in Python. 185 | * [python-jwt](https://github.com/davedoesdev/python-jwt) - A module for generating and verifying JSON Web Tokens. 186 | 187 | ## Build Tools 188 | 189 | *Compile software from source code.* 190 | 191 | * [BitBake](http://www.yoctoproject.org/docs/1.6/bitbake-user-manual/bitbake-user-manual.html) - A make-like build tool for embedded Linux. 192 | * [buildout](http://www.buildout.org/en/latest/) - A build system for creating, assembling and deploying applications from multiple parts. 193 | * [PlatformIO](https://github.com/platformio/platformio-core) - A console tool to build code with different development platforms. 194 | * [pybuilder](https://github.com/pybuilder/pybuilder) - A continuous build tool written in pure Python. 195 | * [SCons](http://www.scons.org/) - A software construction tool. 196 | 197 | ## Built-in Classes Enhancement 198 | 199 | *Libraries for enhancing Python built-in classes.* 200 | 201 | * [attrs](https://github.com/python-attrs/attrs) - Replacement for `__init__`, `__eq__`, `__repr__`, etc. boilerplate in class definitions. 202 | * [bidict](https://github.com/jab/bidict) - Efficient, Pythonic bidirectional map data structures and related functionality.. 203 | * [Box](https://github.com/cdgriffith/Box) - Python dictionaries with advanced dot notation access. 204 | * [dataclasses](https://docs.python.org/3/library/dataclasses.html) - (Python standard library) Data classes. 205 | * [DottedDict](https://github.com/carlosescri/DottedDict) - A library that provides a method of accessing lists and dicts with a dotted path notation. 206 | 207 | ## CMS 208 | 209 | *Content Management Systems.* 210 | 211 | * [django-cms](https://www.django-cms.org/en/) - An Open source enterprise CMS based on the Django. 212 | * [feincms](https://github.com/feincms/feincms) - One of the most advanced Content Management Systems built on Django. 213 | * [indico](https://github.com/indico/indico) - A feature-rich event management system, made @ [CERN](https://en.wikipedia.org/wiki/CERN). 214 | * [Kotti](https://github.com/Kotti/Kotti) - A high-level, Pythonic web application framework built on Pyramid. 215 | * [mezzanine](https://github.com/stephenmcd/mezzanine) - A powerful, consistent, and flexible content management platform. 216 | * [plone](https://plone.org/) - A CMS built on top of the open source application server Zope. 217 | * [quokka](https://github.com/rochacbruno/quokka) - Flexible, extensible, small CMS powered by Flask and MongoDB. 218 | * [wagtail](https://wagtail.io/) - A Django content management system. 219 | 220 | ## Caching 221 | 222 | *Libraries for caching data.* 223 | 224 | * [beaker](https://github.com/bbangert/beaker) - A WSGI middleware for sessions and caching. 225 | * [django-cache-machine](https://github.com/django-cache-machine/django-cache-machine) - Automatic caching and invalidation for Django models. 226 | * [django-cacheops](https://github.com/Suor/django-cacheops) - A slick ORM cache with automatic granular event-driven invalidation. 227 | * [dogpile.cache](http://dogpilecache.readthedocs.io/en/latest/) - dogpile.cache is a next generation replacement for Beaker made by the same authors. 228 | * [HermesCache](https://pypi.org/project/HermesCache/) - Python caching library with tag-based invalidation and dogpile effect prevention. 229 | * [pylibmc](https://github.com/lericson/pylibmc) - A Python wrapper around the [libmemcached](https://libmemcached.org/libMemcached.html) interface. 230 | * [python-diskcache](http://www.grantjenks.com/docs/diskcache/) - SQLite and file backed cache backend with faster lookups than memcached and redis. 231 | 232 | ## ChatOps Tools 233 | 234 | *Libraries for chatbot development.* 235 | 236 | * [errbot](https://github.com/errbotio/errbot/) - The easiest and most popular chatbot to implement ChatOps. 237 | 238 | ## Code Analysis 239 | 240 | *Tools of static analysis, linters and code quality checkers. Also see [awesome-static-analysis](https://github.com/mre/awesome-static-analysis).* 241 | 242 | * Code Analysis 243 | * [coala](https://github.com/coala/coala/) - Language independent and easily extendable code analysis application. 244 | * [code2flow](https://github.com/scottrogowski/code2flow) - Turn your Python and JavaScript code into DOT flowcharts. 245 | * [prospector](https://github.com/PyCQA/prospector) - A tool to analyse Python code. 246 | * [pycallgraph](https://github.com/gak/pycallgraph) - A library that visualises the flow (call graph) of your Python application. 247 | * [vulture](https://github.com/jendrikseipp/vulture) - A tool for finding and analysing dead Python code. 248 | * Code Linters 249 | * [flake8](https://pypi.org/project/flake8/) - A wrapper around `pycodestyle`, `pyflakes` and McCabe. 250 | * [awesome-flake8-extensions](https://github.com/DmytroLitvinov/awesome-flake8-extensions) 251 | * [pylama](https://github.com/klen/pylama) - A code audit tool for Python and JavaScript. 252 | * [pylint](https://www.pylint.org/) - A fully customizable source code analyzer. 253 | * [wemake-python-styleguide](https://github.com/wemake-services/wemake-python-styleguide) - The strictest and most opinionated python linter ever. 254 | * Code Formatters 255 | * [black](https://github.com/python/black) - The uncompromising Python code formatter. 256 | * [isort](https://github.com/timothycrosley/isort) - A Python utility / library to sort imports. 257 | * [yapf](https://github.com/google/yapf) - Yet another Python code formatter from Google. 258 | * Static Type Checkers, also see [awesome-python-typing](https://github.com/typeddjango/awesome-python-typing) 259 | * [mypy](http://mypy-lang.org/) - Check variable types during compile time. 260 | * [pyre-check](https://github.com/facebook/pyre-check) - Performant type checking. 261 | * [typeshed](https://github.com/python/typeshed) - Collection of library stubs for Python, with static types. 262 | * Static Type Annotations Generators 263 | * [MonkeyType](https://github.com/Instagram/MonkeyType) - A system for Python that generates static type annotations by collecting runtime types. 264 | * [pytype](https://github.com/google/pytype) - Pytype checks and infers types for Python code - without requiring type annotations. 265 | 266 | ## Command-line Interface Development 267 | 268 | *Libraries for building command-line applications.* 269 | 270 | * Command-line Application Development 271 | * [cement](http://builtoncement.com/) - CLI Application Framework for Python. 272 | * [click](http://click.pocoo.org/dev/) - A package for creating beautiful command line interfaces in a composable way. 273 | * [cliff](https://docs.openstack.org/developer/cliff/) - A framework for creating command-line programs with multi-level commands. 274 | * [docopt](http://docopt.org/) - Pythonic command line arguments parser. 275 | * [python-fire](https://github.com/google/python-fire) - A library for creating command line interfaces from absolutely any Python object. 276 | * [python-prompt-toolkit](https://github.com/jonathanslenders/python-prompt-toolkit) - A library for building powerful interactive command lines. 277 | * Terminal Rendering 278 | * [alive-progress](https://github.com/rsalmei/alive-progress) - A new kind of Progress Bar, with real-time throughput, eta and very cool animations. 279 | * [asciimatics](https://github.com/peterbrittain/asciimatics) - A package to create full-screen text UIs (from interactive forms to ASCII animations). 280 | * [bashplotlib](https://github.com/glamp/bashplotlib) - Making basic plots in the terminal. 281 | * [colorama](https://pypi.org/project/colorama/) - Cross-platform colored terminal text. 282 | * [rich](https://github.com/willmcgugan/rich) - Python library for rich text and beautiful formatting in the terminal. Also provides a great `RichHandler` log handler. 283 | * [tqdm](https://github.com/tqdm/tqdm) - Fast, extensible progress bar for loops and CLI. 284 | 285 | ## Command-line Tools 286 | 287 | *Useful CLI-based tools for productivity.* 288 | 289 | * Productivity Tools 290 | * [copier](https://github.com/pykong/copier) - A library and command-line utility for rendering projects templates. 291 | * [cookiecutter](https://github.com/audreyr/cookiecutter) - A command-line utility that creates projects from cookiecutters (project templates). 292 | * [doitlive](https://github.com/sloria/doitlive) - A tool for live presentations in the terminal. 293 | * [howdoi](https://github.com/gleitz/howdoi) - Instant coding answers via the command line. 294 | * [Invoke](https://github.com/pyinvoke/invoke#readme) - A tool for managing shell-oriented subprocesses and organizing executable Python code into CLI-invokable tasks. 295 | * [PathPicker](https://github.com/facebook/PathPicker) - Select files out of bash output. 296 | * [percol](https://github.com/mooz/percol) - Adds flavor of interactive selection to the traditional pipe concept on UNIX. 297 | * [thefuck](https://github.com/nvbn/thefuck) - Correcting your previous console command. 298 | * [tmuxp](https://github.com/tony/tmuxp) - A [tmux](https://github.com/tmux/tmux) session manager. 299 | * [try](https://github.com/timofurrer/try) - A dead simple CLI to try out python packages - it's never been easier. 300 | * CLI Enhancements 301 | * [httpie](https://github.com/jakubroztocil/httpie) - A command line HTTP client, a user-friendly cURL replacement. 302 | * [iredis](https://github.com/laixintao/iredis) - Redis CLI with autocompletion and syntax highlighting. 303 | * [kube-shell](https://github.com/cloudnativelabs/kube-shell) - An integrated shell for working with the Kubernetes CLI. 304 | * [litecli](https://github.com/dbcli/litecli) - SQLite CLI with autocompletion and syntax highlighting. 305 | * [mycli](https://github.com/dbcli/mycli) - MySQL CLI with autocompletion and syntax highlighting. 306 | * [pgcli](https://github.com/dbcli/pgcli) - PostgreSQL CLI with autocompletion and syntax highlighting. 307 | * [saws](https://github.com/donnemartin/saws) - A Supercharged [aws-cli](https://github.com/aws/aws-cli). 308 | 309 | ## Compatibility 310 | 311 | *Libraries for migrating from Python 2 to 3.* 312 | 313 | * [python-future](http://python-future.org/index.html) - The missing compatibility layer between Python 2 and Python 3. 314 | * [modernize](https://github.com/PyCQA/modernize) - Modernizes Python code for eventual Python 3 migration. 315 | * [six](https://pypi.org/project/six/) - Python 2 and 3 compatibility utilities. 316 | 317 | ## Computer Vision 318 | 319 | *Libraries for Computer Vision.* 320 | 321 | * [EasyOCR](https://github.com/JaidedAI/EasyOCR) - Ready-to-use OCR with 40+ languages supported. 322 | * [Face Recognition](https://github.com/ageitgey/face_recognition) - Simple facial recognition library. 323 | * [Kornia](https://github.com/kornia/kornia/) - Open Source Differentiable Computer Vision Library for PyTorch. 324 | * [OpenCV](https://opencv.org/) - Open Source Computer Vision Library. 325 | * [pytesseract](https://github.com/madmaze/pytesseract) - A wrapper for [Google Tesseract OCR](https://github.com/tesseract-ocr). 326 | * [SimpleCV](https://github.com/sightmachine/SimpleCV) - An open source framework for building computer vision applications. 327 | * [tesserocr](https://github.com/sirfz/tesserocr) - Another simple, Pillow-friendly, wrapper around the `tesseract-ocr` API for OCR. 328 | 329 | ## Concurrency and Parallelism 330 | 331 | *Libraries for concurrent and parallel execution. Also see [awesome-asyncio](https://github.com/timofurrer/awesome-asyncio).* 332 | 333 | * [concurrent.futures](https://docs.python.org/3/library/concurrent.futures.html) - (Python standard library) A high-level interface for asynchronously executing callables. 334 | * [eventlet](http://eventlet.net/) - Asynchronous framework with WSGI support. 335 | * [gevent](http://www.gevent.org/) - A coroutine-based Python networking library that uses [greenlet](https://github.com/python-greenlet/greenlet). 336 | * [multiprocessing](https://docs.python.org/3/library/multiprocessing.html) - (Python standard library) Process-based parallelism. 337 | * [scoop](https://github.com/soravux/scoop) - Scalable Concurrent Operations in Python. 338 | * [uvloop](https://github.com/MagicStack/uvloop) - Ultra fast implementation of `asyncio` event loop on top of `libuv`. 339 | 340 | ## Configuration 341 | 342 | *Libraries for storing and parsing configuration options.* 343 | 344 | * [configobj](https://github.com/DiffSK/configobj) - INI file parser with validation. 345 | * [configparser](https://docs.python.org/3/library/configparser.html) - (Python standard library) INI file parser. 346 | * [hydra](https://github.com/facebookresearch/hydra) - Hydra is a framework for elegantly configuring complex applications. 347 | * [profig](https://profig.readthedocs.io/en/latest/) - Config from multiple formats with value conversion. 348 | * [python-decouple](https://github.com/henriquebastos/python-decouple) - Strict separation of settings from code. 349 | 350 | ## Cryptography 351 | 352 | * [cryptography](https://cryptography.io/en/latest/) - A package designed to expose cryptographic primitives and recipes to Python developers. 353 | * [paramiko](https://github.com/paramiko/paramiko) - The leading native Python SSHv2 protocol library. 354 | * [passlib](https://passlib.readthedocs.io/en/stable/) - Secure password storage/hashing library, very high level. 355 | * [pynacl](https://github.com/pyca/pynacl) - Python binding to the Networking and Cryptography (NaCl) library. 356 | 357 | ## Data Analysis 358 | 359 | *Libraries for data analyzing.* 360 | 361 | * [AWS Data Wrangler](https://github.com/awslabs/aws-data-wrangler) - Pandas on AWS. 362 | * [Blaze](https://github.com/blaze/blaze) - NumPy and Pandas interface to Big Data. 363 | * [Open Mining](https://github.com/mining/mining) - Business Intelligence (BI) in Pandas interface. 364 | * [Optimus](https://github.com/ironmussa/Optimus) - Agile Data Science Workflows made easy with PySpark. 365 | * [Orange](https://orange.biolab.si/) - Data mining, data visualization, analysis and machine learning through visual programming or scripts. 366 | * [Pandas](http://pandas.pydata.org/) - A library providing high-performance, easy-to-use data structures and data analysis tools. 367 | 368 | ## Data Validation 369 | 370 | *Libraries for validating data. Used for forms in many cases.* 371 | 372 | * [Cerberus](https://github.com/pyeve/cerberus) - A lightweight and extensible data validation library. 373 | * [colander](https://docs.pylonsproject.org/projects/colander/en/latest/) - Validating and deserializing data obtained via XML, JSON, an HTML form post. 374 | * [jsonschema](https://github.com/Julian/jsonschema) - An implementation of [JSON Schema](http://json-schema.org/) for Python. 375 | * [schema](https://github.com/keleshev/schema) - A library for validating Python data structures. 376 | * [Schematics](https://github.com/schematics/schematics) - Data Structure Validation. 377 | * [valideer](https://github.com/podio/valideer) - Lightweight extensible data validation and adaptation library. 378 | * [voluptuous](https://github.com/alecthomas/voluptuous) - A Python data validation library. 379 | 380 | ## Data Visualization 381 | 382 | *Libraries for visualizing data. Also see [awesome-javascript](https://github.com/sorrycc/awesome-javascript#data-visualization).* 383 | 384 | * [Altair](https://github.com/altair-viz/altair) - Declarative statistical visualization library for Python. 385 | * [Bokeh](https://github.com/bokeh/bokeh) - Interactive Web Plotting for Python. 386 | * [bqplot](https://github.com/bloomberg/bqplot) - Interactive Plotting Library for the Jupyter Notebook. 387 | * [Cartopy](https://github.com/SciTools/cartopy) - A cartographic python library with matplotlib support. 388 | * [Dash](https://plot.ly/products/dash/) - Built on top of Flask, React and Plotly aimed at analytical web applications. 389 | * [awesome-dash](https://github.com/Acrotrend/awesome-dash) 390 | * [diagrams](https://github.com/mingrammer/diagrams) - Diagram as Code. 391 | * [Matplotlib](http://matplotlib.org/) - A Python 2D plotting library. 392 | * [plotnine](https://github.com/has2k1/plotnine) - A grammar of graphics for Python based on ggplot2. 393 | * [Pygal](http://www.pygal.org/en/latest/) - A Python SVG Charts Creator. 394 | * [PyGraphviz](https://pypi.org/project/pygraphviz/) - Python interface to [Graphviz](http://www.graphviz.org/). 395 | * [PyQtGraph](http://www.pyqtgraph.org/) - Interactive and realtime 2D/3D/Image plotting and science/engineering widgets. 396 | * [Seaborn](https://github.com/mwaskom/seaborn) - Statistical data visualization using Matplotlib. 397 | * [VisPy](https://github.com/vispy/vispy) - High-performance scientific visualization based on OpenGL. 398 | 399 | ## Database 400 | 401 | *Databases implemented in Python.* 402 | 403 | * [pickleDB](https://github.com/patx/pickledb) - A simple and lightweight key-value store for Python. 404 | * [tinydb](https://github.com/msiemens/tinydb) - A tiny, document-oriented database. 405 | * [ZODB](https://github.com/zopefoundation/ZODB) - A native object database for Python. A key-value and object graph database. 406 | 407 | ## Database Drivers 408 | 409 | *Libraries for connecting and operating databases.* 410 | 411 | * MySQL - [awesome-mysql](http://shlomi-noach.github.io/awesome-mysql/) 412 | * [mysqlclient](https://github.com/PyMySQL/mysqlclient-python) - MySQL connector with Python 3 support ([mysql-python](https://sourceforge.net/projects/mysql-python/) fork). 413 | * [PyMySQL](https://github.com/PyMySQL/PyMySQL) - A pure Python MySQL driver compatible to mysql-python. 414 | * PostgreSQL - [awesome-postgres](https://github.com/dhamaniasad/awesome-postgres) 415 | * [psycopg2](http://initd.org/psycopg/) - The most popular PostgreSQL adapter for Python. 416 | * [queries](https://github.com/gmr/queries) - A wrapper of the psycopg2 library for interacting with PostgreSQL. 417 | * SQlite - [awesome-sqlite](https://github.com/planetopendata/awesome-sqlite) 418 | * [sqlite3](https://docs.python.org/3/library/sqlite3.html) - (Python standard library) SQlite interface compliant with DB-API 2.0 419 | * [SuperSQLite](https://github.com/plasticityai/supersqlite) - A supercharged SQLite library built on top of [apsw](https://github.com/rogerbinns/apsw). 420 | * Other Relational Databases 421 | * [pymssql](https://pymssql.readthedocs.io/en/latest/) - A simple database interface to Microsoft SQL Server. 422 | * [clickhouse-driver](https://github.com/mymarilyn/clickhouse-driver) - Python driver with native interface for ClickHouse. 423 | * NoSQL Databases 424 | * [cassandra-driver](https://github.com/datastax/python-driver) - The Python Driver for Apache Cassandra. 425 | * [happybase](https://github.com/wbolster/happybase) - A developer-friendly library for Apache HBase. 426 | * [kafka-python](https://github.com/dpkp/kafka-python) - The Python client for Apache Kafka. 427 | * [py2neo](https://py2neo.org/) - A client library and toolkit for working with Neo4j. 428 | * [pymongo](https://github.com/mongodb/mongo-python-driver) - The official Python client for MongoDB. 429 | * [redis-py](https://github.com/andymccurdy/redis-py) - The Python client for Redis. 430 | * Asynchronous Clients 431 | * [motor](https://github.com/mongodb/motor) - The async Python driver for MongoDB. 432 | 433 | ## Date and Time 434 | 435 | *Libraries for working with dates and times.* 436 | 437 | * [Arrow](https://arrow.readthedocs.io/en/latest/) - A Python library that offers a sensible and human-friendly approach to creating, manipulating, formatting and converting dates, times and timestamps. 438 | * [Chronyk](https://github.com/KoffeinFlummi/Chronyk) - A Python 3 library for parsing human-written times and dates. 439 | * [dateutil](https://github.com/dateutil/dateutil) - Extensions to the standard Python [datetime](https://docs.python.org/3/library/datetime.html) module. 440 | * [delorean](https://github.com/myusuf3/delorean/) - A library for clearing up the inconvenient truths that arise dealing with datetimes. 441 | * [maya](https://github.com/timofurrer/maya) - Datetimes for Humans. 442 | * [moment](https://github.com/zachwill/moment) - A Python library for dealing with dates/times. Inspired by [Moment.js](http://momentjs.com/). 443 | * [Pendulum](https://github.com/sdispater/pendulum) - Python datetimes made easy. 444 | * [PyTime](https://github.com/shinux/PyTime) - An easy-to-use Python module which aims to operate date/time/datetime by string. 445 | * [pytz](https://launchpad.net/pytz) - World timezone definitions, modern and historical. Brings the [tz database](https://en.wikipedia.org/wiki/Tz_database) into Python. 446 | * [when.py](https://github.com/dirn/When.py) - Providing user-friendly functions to help perform common date and time actions. 447 | 448 | ## Debugging Tools 449 | 450 | *Libraries for debugging code.* 451 | 452 | * pdb-like Debugger 453 | * [ipdb](https://github.com/gotcha/ipdb) - IPython-enabled [pdb](https://docs.python.org/3/library/pdb.html). 454 | * [pdb++](https://github.com/antocuni/pdb) - Another drop-in replacement for pdb. 455 | * [pudb](https://github.com/inducer/pudb) - A full-screen, console-based Python debugger. 456 | * [wdb](https://github.com/Kozea/wdb) - An improbable web debugger through WebSockets. 457 | * Tracing 458 | * [lptrace](https://github.com/khamidou/lptrace) - [strace](http://man7.org/linux/man-pages/man1/strace.1.html) for Python programs. 459 | * [manhole](https://github.com/ionelmc/python-manhole) - Debugging UNIX socket connections and present the stacktraces for all threads and an interactive prompt. 460 | * [pyringe](https://github.com/google/pyringe) - Debugger capable of attaching to and injecting code into Python processes. 461 | * [python-hunter](https://github.com/ionelmc/python-hunter) - A flexible code tracing toolkit. 462 | * Profiler 463 | * [line_profiler](https://github.com/rkern/line_profiler) - Line-by-line profiling. 464 | * [memory_profiler](https://github.com/fabianp/memory_profiler) - Monitor Memory usage of Python code. 465 | * [py-spy](https://github.com/benfred/py-spy) - A sampling profiler for Python programs. Written in Rust. 466 | * [pyflame](https://github.com/uber/pyflame) - A ptracing profiler For Python. 467 | * [vprof](https://github.com/nvdv/vprof) - Visual Python profiler. 468 | * Others 469 | * [django-debug-toolbar](https://github.com/jazzband/django-debug-toolbar) - Display various debug information for Django. 470 | * [django-devserver](https://github.com/dcramer/django-devserver) - A drop-in replacement for Django's runserver. 471 | * [flask-debugtoolbar](https://github.com/mgood/flask-debugtoolbar) - A port of the django-debug-toolbar to flask. 472 | * [icecream](https://github.com/gruns/icecream) - Inspect variables, expressions, and program execution with a single, simple function call. 473 | * [pyelftools](https://github.com/eliben/pyelftools) - Parsing and analyzing ELF files and DWARF debugging information. 474 | 475 | ## Deep Learning 476 | 477 | *Frameworks for Neural Networks and Deep Learning. Also see [awesome-deep-learning](https://github.com/ChristosChristofidis/awesome-deep-learning).* 478 | 479 | * [caffe](https://github.com/BVLC/caffe) - A fast open framework for deep learning.. 480 | * [keras](https://github.com/keras-team/keras) - A high-level neural networks library and capable of running on top of either TensorFlow or Theano. 481 | * [mxnet](https://github.com/dmlc/mxnet) - A deep learning framework designed for both efficiency and flexibility. 482 | * [pytorch](https://github.com/pytorch/pytorch) - Tensors and Dynamic neural networks in Python with strong GPU acceleration. 483 | * [SerpentAI](https://github.com/SerpentAI/SerpentAI) - Game agent framework. Use any video game as a deep learning sandbox. 484 | * [tensorflow](https://github.com/tensorflow/tensorflow) - The most popular Deep Learning framework created by Google. 485 | * [Theano](https://github.com/Theano/Theano) - A library for fast numerical computation. 486 | * [lightning](https://github.com/Lightning-AI/lightning) - Deep learning framework to train, deploy, and ship AI products Lightning fast. 487 | 488 | ## DevOps Tools 489 | 490 | *Software and libraries for DevOps.* 491 | 492 | * Configuration Management 493 | * [ansible](https://github.com/ansible/ansible) - A radically simple IT automation platform. 494 | * [cloudinit](https://cloudinit.readthedocs.io/en/latest/) - A multi-distribution package that handles early initialization of a cloud instance. 495 | * [OpenStack](https://www.openstack.org/) - Open source software for building private and public clouds. 496 | * [pyinfra](https://github.com/Fizzadar/pyinfra) - A versatile CLI tools and python libraries to automate infrastructure. 497 | * [saltstack](https://github.com/saltstack/salt) - Infrastructure automation and management system. 498 | * SSH-style Deployment 499 | * [cuisine](https://github.com/sebastien/cuisine) - Chef-like functionality for Fabric. 500 | * [fabric](https://github.com/fabric/fabric) - A simple, Pythonic tool for remote execution and deployment. 501 | * [fabtools](https://github.com/fabtools/fabtools) - Tools for writing awesome Fabric files. 502 | * Process Management 503 | * [honcho](https://github.com/nickstenning/honcho) - A Python clone of [Foreman](https://github.com/ddollar/foreman), for managing Procfile-based applications. 504 | * [supervisor](https://github.com/Supervisor/supervisor) - Supervisor process control system for UNIX. 505 | * Monitoring 506 | * [psutil](https://github.com/giampaolo/psutil) - A cross-platform process and system utilities module. 507 | * Backup 508 | * [BorgBackup](https://www.borgbackup.org/) - A deduplicating archiver with compression and encryption. 509 | * Others 510 | * [docker-compose](https://docs.docker.com/compose/) - Fast, isolated development environments using [Docker](https://www.docker.com/). 511 | 512 | ## Distributed Computing 513 | 514 | *Frameworks and libraries for Distributed Computing.* 515 | 516 | * Batch Processing 517 | * [dask](https://github.com/dask/dask) - A flexible parallel computing library for analytic computing. 518 | * [luigi](https://github.com/spotify/luigi) - A module that helps you build complex pipelines of batch jobs. 519 | * [mrjob](https://github.com/Yelp/mrjob) - Run MapReduce jobs on Hadoop or Amazon Web Services. 520 | * [PySpark](https://pypi.org/project/pyspark/) - [Apache Spark](https://spark.apache.org/) Python API. 521 | * [Ray](https://github.com/ray-project/ray/) - A system for parallel and distributed Python that unifies the machine learning ecosystem. 522 | * Stream Processing 523 | * [faust](https://github.com/robinhood/faust) - A stream processing library, porting the ideas from [Kafka Streams](https://kafka.apache.org/documentation/streams/) to Python. 524 | * [streamparse](https://github.com/Parsely/streamparse) - Run Python code against real-time streams of data via [Apache Storm](http://storm.apache.org/). 525 | 526 | ## Distribution 527 | 528 | *Libraries to create packaged executables for release distribution.* 529 | 530 | * [dh-virtualenv](https://github.com/spotify/dh-virtualenv) - Build and distribute a virtualenv as a Debian package. 531 | * [Nuitka](http://nuitka.net/) - Compile scripts, modules, packages to an executable or extension module. 532 | * [py2app](http://pythonhosted.org/py2app/) - Freezes Python scripts (Mac OS X). 533 | * [py2exe](http://www.py2exe.org/) - Freezes Python scripts (Windows). 534 | * [pyarmor](https://github.com/dashingsoft/pyarmor) - A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts. 535 | * [PyInstaller](https://github.com/pyinstaller/pyinstaller) - Converts Python programs into stand-alone executables (cross-platform). 536 | * [pynsist](http://pynsist.readthedocs.io/en/latest/) - A tool to build Windows installers, installers bundle Python itself. 537 | * [shiv](https://github.com/linkedin/shiv) - A command line utility for building fully self-contained zipapps (PEP 441), but with all their dependencies included. 538 | 539 | ## Documentation 540 | 541 | *Libraries for generating project documentation.* 542 | 543 | * [sphinx](https://github.com/sphinx-doc/sphinx/) - Python Documentation generator. 544 | * [awesome-sphinxdoc](https://github.com/yoloseem/awesome-sphinxdoc) 545 | * [pdoc](https://github.com/mitmproxy/pdoc) - Epydoc replacement to auto generate API documentation for Python libraries. 546 | * [pycco](https://github.com/pycco-docs/pycco) - The literate-programming-style documentation generator. 547 | 548 | ## Downloader 549 | 550 | *Libraries for downloading.* 551 | 552 | * [akshare](https://github.com/jindaxiang/akshare) - A financial data interface library, built for human beings! 553 | * [s3cmd](https://github.com/s3tools/s3cmd) - A command line tool for managing Amazon S3 and CloudFront. 554 | * [s4cmd](https://github.com/bloomreach/s4cmd) - Super S3 command line tool, good for higher performance. 555 | * [you-get](https://you-get.org/) - A YouTube/Youku/Niconico video downloader written in Python 3. 556 | * [youtube-dl](https://rg3.github.io/youtube-dl/) - A small command-line program to download videos from YouTube. 557 | 558 | ## E-commerce 559 | 560 | *Frameworks and libraries for e-commerce and payments.* 561 | 562 | * [alipay](https://github.com/lxneng/alipay) - Unofficial Alipay API for Python. 563 | * [Cartridge](https://github.com/stephenmcd/cartridge) - A shopping cart app built using the Mezzanine. 564 | * [django-oscar](http://oscarcommerce.com/) - An open-source e-commerce framework for Django. 565 | * [django-shop](https://github.com/awesto/django-shop) - A Django based shop system. 566 | * [forex-python](https://github.com/MicroPyramid/forex-python) - Foreign exchange rates, Bitcoin price index and currency conversion. 567 | * [merchant](https://github.com/agiliq/merchant) - A Django app to accept payments from various payment processors. 568 | * [money](https://github.com/carlospalol/money) - `Money` class with optional CLDR-backed locale-aware formatting and an extensible currency exchange. 569 | * [python-currencies](https://github.com/Alir3z4/python-currencies) - Display money format and its filthy currencies. 570 | * [saleor](https://saleor.io/) - Headless open-source e-commerce platform. 571 | * [shoop](https://www.shuup.com/en/) - An open source E-Commerce platform based on Django. 572 | 573 | ## Editor Plugins and IDEs 574 | 575 | * Emacs 576 | * [elpy](https://github.com/jorgenschaefer/elpy) - Emacs Python Development Environment. 577 | * Sublime Text 578 | * [anaconda](https://github.com/DamnWidget/anaconda) - Anaconda turns your Sublime Text 3 in a full featured Python development IDE. 579 | * [SublimeJEDI](https://github.com/srusskih/SublimeJEDI) - A Sublime Text plugin to the awesome auto-complete library Jedi. 580 | * Vim 581 | * [jedi-vim](https://github.com/davidhalter/jedi-vim) - Vim bindings for the Jedi auto-completion library for Python. 582 | * [python-mode](https://github.com/python-mode/python-mode) - An all in one plugin for turning Vim into a Python IDE. 583 | * [YouCompleteMe](https://github.com/Valloric/YouCompleteMe) - Includes [Jedi](https://github.com/davidhalter/jedi)-based completion engine for Python. 584 | * Visual Studio 585 | * [PTVS](https://github.com/Microsoft/PTVS) - Python Tools for Visual Studio. 586 | * Visual Studio Code 587 | * [Python](https://marketplace.visualstudio.com/items?itemName=ms-python.python) - The official VSCode extension with rich support for Python. 588 | * IDE 589 | * [PyCharm](https://www.jetbrains.com/pycharm/) - Commercial Python IDE by JetBrains. Has free community edition available. 590 | * [spyder](https://github.com/spyder-ide/spyder) - Open Source Python IDE. 591 | 592 | ## Email 593 | 594 | *Libraries for sending and parsing email.* 595 | 596 | * Mail Servers 597 | * [modoboa](https://github.com/modoboa/modoboa) - A mail hosting and management platform including a modern Web UI. 598 | * [salmon](https://github.com/moggers87/salmon) - A Python Mail Server. 599 | * Clients 600 | * [imbox](https://github.com/martinrusev/imbox) - Python IMAP for Humans. 601 | * [yagmail](https://github.com/kootenpv/yagmail) - Yet another Gmail/SMTP client. 602 | * Others 603 | * [flanker](https://github.com/mailgun/flanker) - An email address and Mime parsing library. 604 | * [mailer](https://github.com/marrow/mailer) - High-performance extensible mail delivery framework. 605 | 606 | ## Enterprise Application Integrations 607 | 608 | *Platforms and tools for systems integrations in enterprise environments* 609 | 610 | * [Zato](https://zato.io) - ESB, SOA, REST, APIs and Cloud Integrations in Python. 611 | 612 | ## Environment Management 613 | 614 | *Libraries for Python version and virtual environment management.* 615 | 616 | * [pyenv](https://github.com/pyenv/pyenv) - Simple Python version management. 617 | * [virtualenv](https://github.com/pypa/virtualenv) - A tool to create isolated Python environments. 618 | 619 | ## File 620 | 621 | *Libraries for file manipulation and MIME type detection.* 622 | 623 | * [mimetypes](https://docs.python.org/3/library/mimetypes.html) - (Python standard library) Map filenames to MIME types. 624 | * [path.py](https://github.com/jaraco/path.py) - A module wrapper for [os.path](https://docs.python.org/3/library/os.path.html). 625 | * [pathlib](https://docs.python.org/3/library/pathlib.html) - (Python standard library) An cross-platform, object-oriented path library. 626 | * [PyFilesystem2](https://github.com/pyfilesystem/pyfilesystem2) - Python's filesystem abstraction layer. 627 | * [python-magic](https://github.com/ahupp/python-magic) - A Python interface to the libmagic file type identification library. 628 | * [Unipath](https://github.com/mikeorr/Unipath) - An object-oriented approach to file/directory operations. 629 | * [watchdog](https://github.com/gorakhargosh/watchdog) - API and shell utilities to monitor file system events. 630 | 631 | ## Foreign Function Interface 632 | 633 | *Libraries for providing foreign function interface.* 634 | 635 | * [cffi](https://pypi.org/project/cffi/) - Foreign Function Interface for Python calling C code. 636 | * [ctypes](https://docs.python.org/3/library/ctypes.html) - (Python standard library) Foreign Function Interface for Python calling C code. 637 | * [PyCUDA](https://mathema.tician.de/software/pycuda/) - A Python wrapper for Nvidia's CUDA API. 638 | * [SWIG](http://www.swig.org/Doc1.3/Python.html) - Simplified Wrapper and Interface Generator. 639 | 640 | ## Forms 641 | 642 | *Libraries for working with forms.* 643 | 644 | * [Deform](https://github.com/Pylons/deform) - Python HTML form generation library influenced by the formish form generation library. 645 | * [django-bootstrap3](https://github.com/dyve/django-bootstrap3) - Bootstrap 3 integration with Django. 646 | * [django-bootstrap4](https://github.com/zostera/django-bootstrap4) - Bootstrap 4 integration with Django. 647 | * [django-crispy-forms](https://github.com/django-crispy-forms/django-crispy-forms) - A Django app which lets you create beautiful forms in a very elegant and DRY way. 648 | * [django-remote-forms](https://github.com/WiserTogether/django-remote-forms) - A platform independent Django form serializer. 649 | * [WTForms](https://github.com/wtforms/wtforms) - A flexible forms validation and rendering library. 650 | 651 | ## Functional Programming 652 | 653 | *Functional Programming with Python.* 654 | 655 | * [Coconut](https://github.com/evhub/coconut) - A variant of Python built for simple, elegant, Pythonic functional programming. 656 | * [CyToolz](https://github.com/pytoolz/cytoolz/) - Cython implementation of `Toolz`: High performance functional utilities. 657 | * [fn.py](https://github.com/kachayev/fn.py) - Functional programming in Python: implementation of missing features to enjoy FP. 658 | * [funcy](https://github.com/Suor/funcy) - A fancy and practical functional tools. 659 | * [more-itertools](https://github.com/erikrose/more-itertools) - More routines for operating on iterables, beyond `itertools`. 660 | * [returns](https://github.com/dry-python/returns) - A set of type-safe monads, transformers, and composition utilities. 661 | * [Toolz](https://github.com/pytoolz/toolz) - A collection of functional utilities for iterators, functions, and dictionaries. 662 | 663 | ## GUI Development 664 | 665 | *Libraries for working with graphical user interface applications.* 666 | 667 | * [curses](https://docs.python.org/3/library/curses.html) - Built-in wrapper for [ncurses](http://www.gnu.org/software/ncurses/) used to create terminal GUI applications. 668 | * [Eel](https://github.com/ChrisKnott/Eel) - A library for making simple Electron-like offline HTML/JS GUI apps. 669 | * [enaml](https://github.com/nucleic/enaml) - Creating beautiful user-interfaces with Declarative Syntax like QML. 670 | * [Flexx](https://github.com/zoofIO/flexx) - Flexx is a pure Python toolkit for creating GUI's, that uses web technology for its rendering. 671 | * [Gooey](https://github.com/chriskiehl/Gooey) - Turn command line programs into a full GUI application with one line. 672 | * [kivy](https://kivy.org/) - A library for creating NUI applications, running on Windows, Linux, Mac OS X, Android and iOS. 673 | * [pyglet](https://github.com/pyglet/pyglet) - A cross-platform windowing and multimedia library for Python. 674 | * [PyGObject](https://wiki.gnome.org/Projects/PyGObject) - Python Bindings for GLib/GObject/GIO/GTK+ (GTK+3). 675 | * [PyQt](https://doc.qt.io/qtforpython/) - Python bindings for the [Qt](https://www.qt.io/) cross-platform application and UI framework. 676 | * [PySimpleGUI](https://github.com/PySimpleGUI/PySimpleGUI) - Wrapper for tkinter, Qt, WxPython and Remi. 677 | * [pywebview](https://github.com/r0x0r/pywebview/) - A lightweight cross-platform native wrapper around a webview component. 678 | * [Tkinter](https://wiki.python.org/moin/TkInter) - Tkinter is Python's de-facto standard GUI package. 679 | * [Toga](https://github.com/pybee/toga) - A Python native, OS native GUI toolkit. 680 | * [urwid](http://urwid.org/) - A library for creating terminal GUI applications with strong support for widgets, events, rich colors, etc. 681 | * [wxPython](https://wxpython.org/) - A blending of the wxWidgets C++ class library with the Python. 682 | * [DearPyGui](https://github.com/RaylockLLC/DearPyGui/) - A Simple GPU accelerated Python GUI framework 683 | 684 | ## GraphQL 685 | 686 | *Libraries for working with GraphQL.* 687 | 688 | * [graphene](https://github.com/graphql-python/graphene/) - GraphQL framework for Python. 689 | * [tartiflette-aiohttp](https://github.com/tartiflette/tartiflette-aiohttp/) - An `aiohttp`-based wrapper for Tartiflette to expose GraphQL APIs over HTTP. 690 | * [tartiflette-asgi](https://github.com/tartiflette/tartiflette-asgi/) - ASGI support for the Tartiflette GraphQL engine. 691 | * [tartiflette](https://tartiflette.io) - SDL-first GraphQL engine implementation for Python 3.6+ and asyncio. 692 | 693 | ## Game Development 694 | 695 | *Awesome game development libraries.* 696 | 697 | * [Arcade](https://api.arcade.academy/en/latest/) - Arcade is a modern Python framework for crafting games with compelling graphics and sound. 698 | * [Cocos2d](http://cocos2d.org/) - cocos2d is a framework for building 2D games, demos, and other graphical/interactive applications. 699 | * [Harfang3D](http://www.harfang3d.com) - Python framework for 3D, VR and game development. 700 | * [Panda3D](https://www.panda3d.org/) - 3D game engine developed by Disney. 701 | * [Pygame](http://www.pygame.org/news.html) - Pygame is a set of Python modules designed for writing games. 702 | * [PyOgre](http://www.ogre3d.org/tikiwiki/PyOgre) - Python bindings for the Ogre 3D render engine, can be used for games, simulations, anything 3D. 703 | * [PyOpenGL](http://pyopengl.sourceforge.net/) - Python ctypes bindings for OpenGL and it's related APIs. 704 | * [PySDL2](https://pysdl2.readthedocs.io) - A ctypes based wrapper for the SDL2 library. 705 | * [RenPy](https://www.renpy.org/) - A Visual Novel engine. 706 | 707 | ## Geolocation 708 | 709 | *Libraries for geocoding addresses and working with latitudes and longitudes.* 710 | 711 | * [django-countries](https://github.com/SmileyChris/django-countries) - A Django app that provides a country field for models and forms. 712 | * [GeoDjango](https://docs.djangoproject.com/en/dev/ref/contrib/gis/) - A world-class geographic web framework. 713 | * [GeoIP](https://github.com/maxmind/geoip-api-python) - Python API for MaxMind GeoIP Legacy Database. 714 | * [geojson](https://github.com/frewsxcv/python-geojson) - Python bindings and utilities for GeoJSON. 715 | * [geopy](https://github.com/geopy/geopy) - Python Geocoding Toolbox. 716 | 717 | ## HTML Manipulation 718 | 719 | *Libraries for working with HTML and XML.* 720 | 721 | * [BeautifulSoup](https://www.crummy.com/software/BeautifulSoup/bs4/doc/) - Providing Pythonic idioms for iterating, searching, and modifying HTML or XML. 722 | * [bleach](https://github.com/mozilla/bleach) - A whitelist-based HTML sanitization and text linkification library. 723 | * [cssutils](https://pypi.org/project/cssutils/) - A CSS library for Python. 724 | * [html5lib](https://github.com/html5lib/html5lib-python) - A standards-compliant library for parsing and serializing HTML documents and fragments. 725 | * [lxml](http://lxml.de/) - A very fast, easy-to-use and versatile library for handling HTML and XML. 726 | * [MarkupSafe](https://github.com/pallets/markupsafe) - Implements a XML/HTML/XHTML Markup safe string for Python. 727 | * [pyquery](https://github.com/gawel/pyquery) - A jQuery-like library for parsing HTML. 728 | * [untangle](https://github.com/stchris/untangle) - Converts XML documents to Python objects for easy access. 729 | * [WeasyPrint](http://weasyprint.org) - A visual rendering engine for HTML and CSS that can export to PDF. 730 | * [xmldataset](https://xmldataset.readthedocs.io/en/latest/) - Simple XML Parsing. 731 | * [xmltodict](https://github.com/martinblech/xmltodict) - Working with XML feel like you are working with JSON. 732 | 733 | ## HTTP Clients 734 | 735 | *Libraries for working with HTTP.* 736 | 737 | * [grequests](https://github.com/spyoungtech/grequests) - requests + gevent for asynchronous HTTP requests. 738 | * [httplib2](https://github.com/httplib2/httplib2) - Comprehensive HTTP client library. 739 | * [httpx](https://github.com/encode/httpx) - A next generation HTTP client for Python. 740 | * [requests](https://github.com/psf/requests) - HTTP Requests for Humans. 741 | * [treq](https://github.com/twisted/treq) - Python requests like API built on top of Twisted's HTTP client. 742 | * [urllib3](https://github.com/shazow/urllib3) - A HTTP library with thread-safe connection pooling, file post support, sanity friendly. 743 | 744 | ## Hardware 745 | 746 | *Libraries for programming with hardware.* 747 | 748 | * [ino](http://inotool.org/) - Command line toolkit for working with [Arduino](https://www.arduino.cc/). 749 | * [keyboard](https://github.com/boppreh/keyboard) - Hook and simulate global keyboard events on Windows and Linux. 750 | * [mouse](https://github.com/boppreh/mouse) - Hook and simulate global mouse events on Windows and Linux. 751 | * [Pingo](http://www.pingo.io/) - Pingo provides a uniform API to program devices like the Raspberry Pi, pcDuino, Intel Galileo, etc. 752 | * [PyUserInput](https://github.com/SavinaRoja/PyUserInput) - A module for cross-platform control of the mouse and keyboard. 753 | * [scapy](https://github.com/secdev/scapy) - A brilliant packet manipulation library. 754 | 755 | ## Image Processing 756 | 757 | *Libraries for manipulating images.* 758 | 759 | * [hmap](https://github.com/rossgoodwin/hmap) - Image histogram remapping. 760 | * [imgSeek](https://sourceforge.net/projects/imgseek/) - A project for searching a collection of images using visual similarity. 761 | * [nude.py](https://github.com/hhatto/nude.py) - Nudity detection. 762 | * [pagan](https://github.com/daboth/pagan) - Retro identicon (Avatar) generation based on input string and hash. 763 | * [pillow](https://github.com/python-pillow/Pillow) - Pillow is the friendly [PIL](http://www.pythonware.com/products/pil/) fork. 764 | * [python-barcode](https://github.com/WhyNotHugo/python-barcode) - Create barcodes in Python with no extra dependencies. 765 | * [pygram](https://github.com/ajkumar25/pygram) - Instagram-like image filters. 766 | * [PyMatting](http://github.com/pymatting/pymatting) - A library for alpha matting. 767 | * [python-qrcode](https://github.com/lincolnloop/python-qrcode) - A pure Python QR Code generator. 768 | * [pywal](https://github.com/dylanaraps/pywal) - A tool that generates color schemes from images. 769 | * [pyvips](https://github.com/libvips/pyvips) - A fast image processing library with low memory needs. 770 | * [Quads](https://github.com/fogleman/Quads) - Computer art based on quadtrees. 771 | * [scikit-image](http://scikit-image.org/) - A Python library for (scientific) image processing. 772 | * [thumbor](https://github.com/thumbor/thumbor) - A smart imaging service. It enables on-demand crop, re-sizing and flipping of images. 773 | * [wand](https://github.com/dahlia/wand) - Python bindings for [MagickWand](http://www.imagemagick.org/script/magick-wand.php), C API for ImageMagick. 774 | 775 | ## Implementations 776 | 777 | *Implementations of Python.* 778 | 779 | * [CLPython](https://github.com/metawilm/cl-python) - Implementation of the Python programming language written in Common Lisp. 780 | * [CPython](https://github.com/python/cpython) - **Default, most widely used implementation of the Python programming language written in C.** 781 | * [Cython](http://cython.org/) - Optimizing Static Compiler for Python. 782 | * [Grumpy](https://github.com/google/grumpy) - More compiler than interpreter as more powerful CPython2.7 replacement (alpha). 783 | * [IronPython](https://github.com/IronLanguages/ironpython3) - Implementation of the Python programming language written in C#. 784 | * [Jython](https://hg.python.org/jython) - Implementation of Python programming language written in Java for the JVM. 785 | * [MicroPython](https://github.com/micropython/micropython) - A lean and efficient Python programming language implementation. 786 | * [Numba](http://numba.pydata.org/) - Python JIT compiler to LLVM aimed at scientific Python. 787 | * [PeachPy](https://github.com/Maratyszcza/PeachPy) - x86-64 assembler embedded in Python. 788 | * [Pyjion](https://github.com/Microsoft/Pyjion) - A JIT for Python based upon CoreCLR. 789 | * [PyPy](https://foss.heptapod.net/pypy/pypy) - A very fast and compliant implementation of the Python language. 790 | * [Pyston](https://github.com/pyston/pyston/) - A Python implementation using JIT techniques. 791 | * [Stackless Python](https://github.com/stackless-dev/stackless) - An enhanced version of the Python programming language. 792 | 793 | ## Interactive Interpreter 794 | 795 | *Interactive Python interpreters (REPL).* 796 | 797 | * [bpython](https://github.com/bpython/bpython) - A fancy interface to the Python interpreter. 798 | * [Jupyter Notebook (IPython)](https://jupyter.org) - A rich toolkit to help you make the most out of using Python interactively. 799 | * [awesome-jupyter](https://github.com/markusschanta/awesome-jupyter) 800 | * [ptpython](https://github.com/jonathanslenders/ptpython) - Advanced Python REPL built on top of the [python-prompt-toolkit](https://github.com/jonathanslenders/python-prompt-toolkit). 801 | 802 | ## Internationalization 803 | 804 | *Libraries for working with i18n.* 805 | 806 | * [Babel](http://babel.pocoo.org/en/latest/) - An internationalization library for Python. 807 | * [PyICU](https://github.com/ovalhub/pyicu) - A wrapper of International Components for Unicode C++ library ([ICU](http://site.icu-project.org/)). 808 | 809 | ## Job Scheduler 810 | 811 | *Libraries for scheduling jobs.* 812 | 813 | * [Airflow](https://airflow.apache.org/) - Airflow is a platform to programmatically author, schedule and monitor workflows. 814 | * [APScheduler](http://apscheduler.readthedocs.io/en/latest/) - A light but powerful in-process task scheduler that lets you schedule functions. 815 | * [django-schedule](https://github.com/thauber/django-schedule) - A calendaring app for Django. 816 | * [doit](http://pydoit.org/) - A task runner and build tool. 817 | * [gunnery](https://github.com/gunnery/gunnery) - Multipurpose task execution tool for distributed systems with web-based interface. 818 | * [Joblib](https://joblib.readthedocs.io/) - A set of tools to provide lightweight pipelining in Python. 819 | * [Plan](https://github.com/fengsp/plan) - Writing crontab file in Python like a charm. 820 | * [Prefect](https://github.com/PrefectHQ/prefect) - A modern workflow orchestration framework that makes it easy to build, schedule and monitor robust data pipelines. 821 | * [schedule](https://github.com/dbader/schedule) - Python job scheduling for humans. 822 | * [Spiff](https://github.com/knipknap/SpiffWorkflow) - A powerful workflow engine implemented in pure Python. 823 | * [TaskFlow](https://docs.openstack.org/developer/taskflow/) - A Python library that helps to make task execution easy, consistent and reliable. 824 | 825 | ## Logging 826 | 827 | *Libraries for generating and working with logs.* 828 | 829 | * [logbook](http://logbook.readthedocs.io/en/stable/) - Logging replacement for Python. 830 | * [logging](https://docs.python.org/3/library/logging.html) - (Python standard library) Logging facility for Python. 831 | * [loguru](https://github.com/Delgan/loguru) - Library which aims to bring enjoyable logging in Python. 832 | * [sentry-python](https://github.com/getsentry/sentry-python) - Sentry SDK for Python. 833 | * [structlog](https://www.structlog.org/en/stable/) - Structured logging made easy. 834 | 835 | ## Machine Learning 836 | 837 | *Libraries for Machine Learning. Also see [awesome-machine-learning](https://github.com/josephmisiti/awesome-machine-learning#python).* 838 | 839 | * [gym](https://github.com/openai/gym) - A toolkit for developing and comparing reinforcement learning algorithms. 840 | * [H2O](https://github.com/h2oai/h2o-3) - Open Source Fast Scalable Machine Learning Platform. 841 | * [Metrics](https://github.com/benhamner/Metrics) - Machine learning evaluation metrics. 842 | * [NuPIC](https://github.com/numenta/nupic) - Numenta Platform for Intelligent Computing. 843 | * [scikit-learn](http://scikit-learn.org/) - The most popular Python library for Machine Learning. 844 | * [Spark ML](http://spark.apache.org/docs/latest/ml-guide.html) - [Apache Spark](http://spark.apache.org/)'s scalable Machine Learning library. 845 | * [vowpal_porpoise](https://github.com/josephreisinger/vowpal_porpoise) - A lightweight Python wrapper for [Vowpal Wabbit](https://github.com/JohnLangford/vowpal_wabbit/). 846 | * [xgboost](https://github.com/dmlc/xgboost) - A scalable, portable, and distributed gradient boosting library. 847 | * [MindsDB](https://github.com/mindsdb/mindsdb) - MindsDB is an open source AI layer for existing databases that allows you to effortlessly develop, train and deploy state-of-the-art machine learning models using standard queries. 848 | 849 | ## Microsoft Windows 850 | 851 | *Python programming on Microsoft Windows.* 852 | 853 | * [Python(x,y)](http://python-xy.github.io/) - Scientific-applications-oriented Python Distribution based on Qt and Spyder. 854 | * [pythonlibs](http://www.lfd.uci.edu/~gohlke/pythonlibs/) - Unofficial Windows binaries for Python extension packages. 855 | * [PythonNet](https://github.com/pythonnet/pythonnet) - Python Integration with the .NET Common Language Runtime (CLR). 856 | * [PyWin32](https://github.com/mhammond/pywin32) - Python Extensions for Windows. 857 | * [WinPython](https://winpython.github.io/) - Portable development environment for Windows 7/8. 858 | 859 | ## Miscellaneous 860 | 861 | *Useful libraries or tools that don't fit in the categories above.* 862 | 863 | * [blinker](https://github.com/jek/blinker) - A fast Python in-process signal/event dispatching system. 864 | * [boltons](https://github.com/mahmoud/boltons) - A set of pure-Python utilities. 865 | * [itsdangerous](https://github.com/pallets/itsdangerous) - Various helpers to pass trusted data to untrusted environments. 866 | * [magenta](https://github.com/magenta/magenta) - A tool to generate music and art using artificial intelligence. 867 | * [pluginbase](https://github.com/mitsuhiko/pluginbase) - A simple but flexible plugin system for Python. 868 | * [tryton](http://www.tryton.org/) - A general purpose business framework. 869 | 870 | ## Natural Language Processing 871 | 872 | *Libraries for working with human languages.* 873 | 874 | - General 875 | * [gensim](https://github.com/RaRe-Technologies/gensim) - Topic Modeling for Humans. 876 | * [langid.py](https://github.com/saffsd/langid.py) - Stand-alone language identification system. 877 | * [nltk](http://www.nltk.org/) - A leading platform for building Python programs to work with human language data. 878 | * [pattern](https://github.com/clips/pattern) - A web mining module. 879 | * [polyglot](https://github.com/aboSamoor/polyglot) - Natural language pipeline supporting hundreds of languages. 880 | * [pytext](https://github.com/facebookresearch/pytext) - A natural language modeling framework based on PyTorch. 881 | * [PyTorch-NLP](https://github.com/PetrochukM/PyTorch-NLP) - A toolkit enabling rapid deep learning NLP prototyping for research. 882 | * [spacy](https://spacy.io/) - A library for industrial-strength natural language processing in Python and Cython. 883 | * [Stanza](https://github.com/stanfordnlp/stanza) - The Stanford NLP Group's official Python library, supporting 60+ languages. 884 | - Chinese 885 | * [funNLP](https://github.com/fighting41love/funNLP) - A collection of tools and datasets for Chinese NLP. 886 | * [jieba](https://github.com/fxsjy/jieba) - The most popular Chinese text segmentation library. 887 | * [pkuseg-python](https://github.com/lancopku/pkuseg-python) - A toolkit for Chinese word segmentation in various domains. 888 | * [snownlp](https://github.com/isnowfy/snownlp) - A library for processing Chinese text. 889 | 890 | ## Network Virtualization 891 | 892 | *Tools and libraries for Virtual Networking and SDN (Software Defined Networking).* 893 | 894 | * [mininet](https://github.com/mininet/mininet) - A popular network emulator and API written in Python. 895 | * [napalm](https://github.com/napalm-automation/napalm) - Cross-vendor API to manipulate network devices. 896 | * [pox](https://github.com/noxrepo/pox) - A Python-based SDN control applications, such as OpenFlow SDN controllers. 897 | 898 | ## News Feed 899 | 900 | *Libraries for building user's activities.* 901 | 902 | * [django-activity-stream](https://github.com/justquick/django-activity-stream) - Generating generic activity streams from the actions on your site. 903 | * [Stream Framework](https://github.com/tschellenbach/Stream-Framework) - Building news feed and notification systems using Cassandra and Redis. 904 | 905 | ## ORM 906 | 907 | *Libraries that implement Object-Relational Mapping or data mapping techniques.* 908 | 909 | * Relational Databases 910 | * [Django Models](https://docs.djangoproject.com/en/dev/topics/db/models/) - The Django ORM. 911 | * [SQLAlchemy](https://www.sqlalchemy.org/) - The Python SQL Toolkit and Object Relational Mapper. 912 | * [awesome-sqlalchemy](https://github.com/dahlia/awesome-sqlalchemy) 913 | * [dataset](https://github.com/pudo/dataset) - Store Python dicts in a database - works with SQLite, MySQL, and PostgreSQL. 914 | * [orator](https://github.com/sdispater/orator) - The Orator ORM provides a simple yet beautiful ActiveRecord implementation. 915 | * [orm](https://github.com/encode/orm) - An async ORM. 916 | * [peewee](https://github.com/coleifer/peewee) - A small, expressive ORM. 917 | * [pony](https://github.com/ponyorm/pony/) - ORM that provides a generator-oriented interface to SQL. 918 | * [pydal](https://github.com/web2py/pydal/) - A pure Python Database Abstraction Layer. 919 | * NoSQL Databases 920 | * [hot-redis](https://github.com/stephenmcd/hot-redis) - Rich Python data types for Redis. 921 | * [mongoengine](https://github.com/MongoEngine/mongoengine) - A Python Object-Document-Mapper for working with MongoDB. 922 | * [PynamoDB](https://github.com/pynamodb/PynamoDB) - A Pythonic interface for [Amazon DynamoDB](https://aws.amazon.com/dynamodb/). 923 | * [redisco](https://github.com/kiddouk/redisco) - A Python Library for Simple Models and Containers Persisted in Redis. 924 | 925 | ## Package Management 926 | 927 | *Libraries for package and dependency management.* 928 | 929 | * [pip](https://pip.pypa.io/en/stable/) - The package installer for Python. 930 | * [pip-tools](https://github.com/jazzband/pip-tools) - A set of tools to keep your pinned Python dependencies fresh. 931 | * [PyPI](https://pypi.org/) 932 | * [conda](https://github.com/conda/conda/) - Cross-platform, Python-agnostic binary package manager. 933 | * [poetry](https://github.com/sdispater/poetry) - Python dependency management and packaging made easy. 934 | 935 | ## Package Repositories 936 | 937 | *Local PyPI repository server and proxies.* 938 | 939 | * [bandersnatch](https://github.com/pypa/bandersnatch/) - PyPI mirroring tool provided by Python Packaging Authority (PyPA). 940 | * [devpi](https://github.com/devpi/devpi) - PyPI server and packaging/testing/release tool. 941 | * [localshop](https://github.com/jazzband/localshop) - Local PyPI server (custom packages and auto-mirroring of pypi). 942 | * [warehouse](https://github.com/pypa/warehouse) - Next generation Python Package Repository (PyPI). 943 | 944 | ## Penetration Testing 945 | 946 | *Frameworks and tools for penetration testing.* 947 | 948 | * [fsociety](https://github.com/Manisso/fsociety) - A Penetration testing framework. 949 | * [setoolkit](https://github.com/trustedsec/social-engineer-toolkit) - A toolkit for social engineering. 950 | * [sqlmap](https://github.com/sqlmapproject/sqlmap) - Automatic SQL injection and database takeover tool. 951 | 952 | ## Permissions 953 | 954 | *Libraries that allow or deny users access to data or functionality.* 955 | 956 | * [django-guardian](https://github.com/django-guardian/django-guardian) - Implementation of per object permissions for Django 1.2+ 957 | * [django-rules](https://github.com/dfunckt/django-rules) - A tiny but powerful app providing object-level permissions to Django, without requiring a database. 958 | 959 | ## Processes 960 | 961 | *Libraries for starting and communicating with OS processes.* 962 | 963 | * [delegator.py](https://github.com/amitt001/delegator.py) - [Subprocesses](https://docs.python.org/3/library/subprocess.html) for Humans 2.0. 964 | * [sarge](https://sarge.readthedocs.io/en/latest/) - Yet another wrapper for subprocess. 965 | * [sh](https://github.com/amoffat/sh) - A full-fledged subprocess replacement for Python. 966 | 967 | ## Recommender Systems 968 | 969 | *Libraries for building recommender systems.* 970 | 971 | * [annoy](https://github.com/spotify/annoy) - Approximate Nearest Neighbors in C++/Python optimized for memory usage. 972 | * [fastFM](https://github.com/ibayer/fastFM) - A library for Factorization Machines. 973 | * [implicit](https://github.com/benfred/implicit) - A fast Python implementation of collaborative filtering for implicit datasets. 974 | * [libffm](https://github.com/guestwalk/libffm) - A library for Field-aware Factorization Machine (FFM). 975 | * [lightfm](https://github.com/lyst/lightfm) - A Python implementation of a number of popular recommendation algorithms. 976 | * [spotlight](https://github.com/maciejkula/spotlight) - Deep recommender models using PyTorch. 977 | * [Surprise](https://github.com/NicolasHug/Surprise) - A scikit for building and analyzing recommender systems. 978 | * [tensorrec](https://github.com/jfkirk/tensorrec) - A Recommendation Engine Framework in TensorFlow. 979 | 980 | ## Refactoring 981 | 982 | *Refactoring tools and libraries for Python* 983 | 984 | * [Bicycle Repair Man](http://bicyclerepair.sourceforge.net/) - Bicycle Repair Man, a refactoring tool for Python. 985 | * [Bowler](https://pybowler.io/) - Safe code refactoring for modern Python. 986 | * [Rope](https://github.com/python-rope/rope) - Rope is a python refactoring library. 987 | 988 | ## RESTful API 989 | 990 | *Libraries for building RESTful APIs.* 991 | 992 | * Django 993 | * [django-rest-framework](http://www.django-rest-framework.org/) - A powerful and flexible toolkit to build web APIs. 994 | * [django-tastypie](http://tastypieapi.org/) - Creating delicious APIs for Django apps. 995 | * Flask 996 | * [eve](https://github.com/pyeve/eve) - REST API framework powered by Flask, MongoDB and good intentions. 997 | * [flask-api](https://github.com/flask-api/flask-api) - Browsable Web APIs for Flask. 998 | * [flask-restful](https://github.com/flask-restful/flask-restful) - Quickly building REST APIs for Flask. 999 | * Pyramid 1000 | * [cornice](https://github.com/Cornices/cornice) - A RESTful framework for Pyramid. 1001 | * Framework agnostic 1002 | * [apistar](https://github.com/encode/apistar) - A smart Web API framework, designed for Python 3. 1003 | * [falcon](https://github.com/falconry/falcon) - A high-performance framework for building cloud APIs and web app backends. 1004 | * [fastapi](https://github.com/tiangolo/fastapi) - A modern, fast, web framework for building APIs with Python 3.6+ based on standard Python type hints. 1005 | * [hug](https://github.com/hugapi/hug) - A Python 3 framework for cleanly exposing APIs. 1006 | * [sandman2](https://github.com/jeffknupp/sandman2) - Automated REST APIs for existing database-driven systems. 1007 | * [sanic](https://github.com/huge-success/sanic) - A Python 3.6+ web server and web framework that's written to go fast. 1008 | * [vibora](https://vibora.io/) - Fast, efficient and asynchronous Web framework inspired by Flask. 1009 | 1010 | ## Robotics 1011 | 1012 | *Libraries for robotics.* 1013 | 1014 | * [PythonRobotics](https://github.com/AtsushiSakai/PythonRobotics) - This is a compilation of various robotics algorithms with visualizations. 1015 | * [rospy](http://wiki.ros.org/rospy) - This is a library for ROS (Robot Operating System). 1016 | 1017 | ## RPC Servers 1018 | 1019 | *RPC-compatible servers.* 1020 | 1021 | * [RPyC](https://github.com/tomerfiliba/rpyc) (Remote Python Call) - A transparent and symmetric RPC library for Python 1022 | * [zeroRPC](https://github.com/0rpc/zerorpc-python) - zerorpc is a flexible RPC implementation based on [ZeroMQ](http://zeromq.org/) and [MessagePack](http://msgpack.org/). 1023 | 1024 | ## Science 1025 | 1026 | *Libraries for scientific computing. Also see [Python-for-Scientists](https://github.com/TomNicholas/Python-for-Scientists).* 1027 | 1028 | * [astropy](http://www.astropy.org/) - A community Python library for Astronomy. 1029 | * [bcbio-nextgen](https://github.com/chapmanb/bcbio-nextgen) - Providing best-practice pipelines for fully automated high throughput sequencing analysis. 1030 | * [bccb](https://github.com/chapmanb/bcbb) - Collection of useful code related to biological analysis. 1031 | * [Biopython](http://biopython.org/wiki/Main_Page) - Biopython is a set of freely available tools for biological computation. 1032 | * [cclib](http://cclib.github.io/) - A library for parsing and interpreting the results of computational chemistry packages. 1033 | * [Colour](http://colour-science.org/) - Implementing a comprehensive number of colour theory transformations and algorithms. 1034 | * [Karate Club](https://github.com/benedekrozemberczki/karateclub) - Unsupervised machine learning toolbox for graph structured data. 1035 | * [NetworkX](https://networkx.github.io/) - A high-productivity software for complex networks. 1036 | * [NIPY](http://nipy.org) - A collection of neuroimaging toolkits. 1037 | * [NumPy](http://www.numpy.org/) - A fundamental package for scientific computing with Python. 1038 | * [ObsPy](https://github.com/obspy/obspy/wiki/) - A Python toolbox for seismology. 1039 | * [Open Babel](http://openbabel.org/wiki/Main_Page) - A chemical toolbox designed to speak the many languages of chemical data. 1040 | * [PyDy](http://www.pydy.org/) - Short for Python Dynamics, used to assist with workflow in the modeling of dynamic motion. 1041 | * [PyMC](https://github.com/pymc-devs/pymc3) - Markov Chain Monte Carlo sampling toolkit. 1042 | * [QuTiP](http://qutip.org/) - Quantum Toolbox in Python. 1043 | * [RDKit](http://www.rdkit.org/) - Cheminformatics and Machine Learning Software. 1044 | * [SciPy](https://www.scipy.org/) - A Python-based ecosystem of open-source software for mathematics, science, and engineering. 1045 | * [SimPy](https://gitlab.com/team-simpy/simpy) - A process-based discrete-event simulation framework. 1046 | * [statsmodels](https://github.com/statsmodels/statsmodels) - Statistical modeling and econometrics in Python. 1047 | * [SymPy](https://github.com/sympy/sympy) - A Python library for symbolic mathematics. 1048 | * [Zipline](https://github.com/quantopian/zipline) - A Pythonic algorithmic trading library. 1049 | 1050 | ## Search 1051 | 1052 | *Libraries and software for indexing and performing search queries on data.* 1053 | 1054 | * [django-haystack](https://github.com/django-haystack/django-haystack) - Modular search for Django. 1055 | * [elasticsearch-dsl-py](https://github.com/elastic/elasticsearch-dsl-py) - The official high-level Python client for Elasticsearch. 1056 | * [elasticsearch-py](https://www.elastic.co/guide/en/elasticsearch/client/python-api/current/index.html) - The official low-level Python client for [Elasticsearch](https://www.elastic.co/products/elasticsearch). 1057 | * [pysolr](https://github.com/django-haystack/pysolr) - A lightweight Python wrapper for [Apache Solr](https://lucene.apache.org/solr/). 1058 | * [whoosh](http://whoosh.readthedocs.io/en/latest/) - A fast, pure Python search engine library. 1059 | 1060 | ## Serialization 1061 | 1062 | *Libraries for serializing complex data types* 1063 | 1064 | * [marshmallow](https://github.com/marshmallow-code/marshmallow) - A lightweight library for converting complex objects to and from simple Python datatypes. 1065 | * [pysimdjson](https://github.com/TkTech/pysimdjson) - A Python bindings for [simdjson](https://github.com/lemire/simdjson). 1066 | * [python-rapidjson](https://github.com/python-rapidjson/python-rapidjson) - A Python wrapper around [RapidJSON](https://github.com/Tencent/rapidjson). 1067 | * [ultrajson](https://github.com/esnme/ultrajson) - A fast JSON decoder and encoder written in C with Python bindings. 1068 | 1069 | ## Serverless Frameworks 1070 | 1071 | *Frameworks for developing serverless Python code.* 1072 | 1073 | * [python-lambda](https://github.com/nficano/python-lambda) - A toolkit for developing and deploying Python code in AWS Lambda. 1074 | * [Zappa](https://github.com/zappa/Zappa) - A tool for deploying WSGI applications on AWS Lambda and API Gateway. 1075 | 1076 | ## Shell 1077 | 1078 | *Shells based on Python.* 1079 | 1080 | * [xonsh](https://github.com/xonsh/xonsh/) - A Python-powered, cross-platform, Unix-gazing shell language and command prompt. 1081 | 1082 | ## Specific Formats Processing 1083 | 1084 | *Libraries for parsing and manipulating specific text formats.* 1085 | 1086 | * General 1087 | * [tablib](https://github.com/jazzband/tablib) - A module for Tabular Datasets in XLS, CSV, JSON, YAML. 1088 | * Office 1089 | * [docxtpl](https://github.com/elapouya/python-docx-template) - Editing a docx document by jinja2 template 1090 | * [openpyxl](https://openpyxl.readthedocs.io/en/stable/) - A library for reading and writing Excel 2010 xlsx/xlsm/xltx/xltm files. 1091 | * [pyexcel](https://github.com/pyexcel/pyexcel) - Providing one API for reading, manipulating and writing csv, ods, xls, xlsx and xlsm files. 1092 | * [python-docx](https://github.com/python-openxml/python-docx) - Reads, queries and modifies Microsoft Word 2007/2008 docx files. 1093 | * [python-pptx](https://github.com/scanny/python-pptx) - Python library for creating and updating PowerPoint (.pptx) files. 1094 | * [unoconv](https://github.com/unoconv/unoconv) - Convert between any document format supported by LibreOffice/OpenOffice. 1095 | * [XlsxWriter](https://github.com/jmcnamara/XlsxWriter) - A Python module for creating Excel .xlsx files. 1096 | * [xlwings](https://github.com/ZoomerAnalytics/xlwings) - A BSD-licensed library that makes it easy to call Python from Excel and vice versa. 1097 | * [xlwt](https://github.com/python-excel/xlwt) / [xlrd](https://github.com/python-excel/xlrd) - Writing and reading data and formatting information from Excel files. 1098 | * PDF 1099 | * [PDFMiner](https://github.com/euske/pdfminer) - A tool for extracting information from PDF documents. 1100 | * [PyPDF2](https://github.com/mstamy2/PyPDF2) - A library capable of splitting, merging and transforming PDF pages. 1101 | * [ReportLab](https://www.reportlab.com/opensource/) - Allowing Rapid creation of rich PDF documents. 1102 | * Markdown 1103 | * [Mistune](https://github.com/lepture/mistune) - Fastest and full featured pure Python parsers of Markdown. 1104 | * [Python-Markdown](https://github.com/waylan/Python-Markdown) - A Python implementation of John Gruber’s Markdown. 1105 | * YAML 1106 | * [PyYAML](http://pyyaml.org/) - YAML implementations for Python. 1107 | * CSV 1108 | * [csvkit](https://github.com/wireservice/csvkit) - Utilities for converting to and working with CSV. 1109 | * Archive 1110 | * [unp](https://github.com/mitsuhiko/unp) - A command line tool that can unpack archives easily. 1111 | 1112 | ## Static Site Generator 1113 | 1114 | *Static site generator is a software that takes some text + templates as input and produces HTML files on the output.* 1115 | 1116 | * [lektor](https://github.com/lektor/lektor) - An easy to use static CMS and blog engine. 1117 | * [mkdocs](https://github.com/mkdocs/mkdocs/) - Markdown friendly documentation generator. 1118 | * [makesite](https://github.com/sunainapai/makesite) - Simple, lightweight, and magic-free static site/blog generator (< 130 lines). 1119 | * [nikola](https://github.com/getnikola/nikola) - A static website and blog generator. 1120 | * [pelican](https://github.com/getpelican/pelican) - Static site generator that supports Markdown and reST syntax. 1121 | 1122 | ## Tagging 1123 | 1124 | *Libraries for tagging items.* 1125 | 1126 | * [django-taggit](https://github.com/jazzband/django-taggit) - Simple tagging for Django. 1127 | 1128 | ## Task Queues 1129 | 1130 | *Libraries for working with task queues.* 1131 | 1132 | * [celery](https://docs.celeryproject.org/en/stable/) - An asynchronous task queue/job queue based on distributed message passing. 1133 | * [dramatiq](https://github.com/Bogdanp/dramatiq) - A fast and reliable background task processing library for Python 3. 1134 | * [huey](https://github.com/coleifer/huey) - Little multi-threaded task queue. 1135 | * [mrq](https://github.com/pricingassistant/mrq) - A distributed worker task queue in Python using Redis & gevent. 1136 | * [rq](https://github.com/rq/rq) - Simple job queues for Python. 1137 | 1138 | ## Template Engine 1139 | 1140 | *Libraries and tools for templating and lexing.* 1141 | 1142 | * [Genshi](https://genshi.edgewall.org/) - Python templating toolkit for generation of web-aware output. 1143 | * [Jinja2](https://github.com/pallets/jinja) - A modern and designer friendly templating language. 1144 | * [Mako](http://www.makotemplates.org/) - Hyperfast and lightweight templating for the Python platform. 1145 | 1146 | ## Testing 1147 | 1148 | *Libraries for testing codebases and generating test data.* 1149 | 1150 | * Testing Frameworks 1151 | * [hypothesis](https://github.com/HypothesisWorks/hypothesis) - Hypothesis is an advanced Quickcheck style property based testing library. 1152 | * [nose2](https://github.com/nose-devs/nose2) - The successor to `nose`, based on `unittest2. 1153 | * [pytest](https://docs.pytest.org/en/latest/) - A mature full-featured Python testing tool. 1154 | * [Robot Framework](https://github.com/robotframework/robotframework) - A generic test automation framework. 1155 | * [unittest](https://docs.python.org/3/library/unittest.html) - (Python standard library) Unit testing framework. 1156 | * Test Runners 1157 | * [green](https://github.com/CleanCut/green) - A clean, colorful test runner. 1158 | * [mamba](http://nestorsalceda.github.io/mamba/) - The definitive testing tool for Python. Born under the banner of BDD. 1159 | * [tox](https://tox.readthedocs.io/en/latest/) - Auto builds and tests distributions in multiple Python versions 1160 | * GUI / Web Testing 1161 | * [locust](https://github.com/locustio/locust) - Scalable user load testing tool written in Python. 1162 | * [PyAutoGUI](https://github.com/asweigart/pyautogui) - PyAutoGUI is a cross-platform GUI automation Python module for human beings. 1163 | * [Schemathesis](https://github.com/kiwicom/schemathesis) - A tool for automatic property-based testing of web applications built with Open API / Swagger specifications. 1164 | * [Selenium](https://pypi.org/project/selenium/) - Python bindings for [Selenium](http://www.seleniumhq.org/) WebDriver. 1165 | * [sixpack](https://github.com/seatgeek/sixpack) - A language-agnostic A/B Testing framework. 1166 | * [splinter](https://github.com/cobrateam/splinter) - Open source tool for testing web applications. 1167 | * Mock 1168 | * [doublex](https://pypi.org/project/doublex/) - Powerful test doubles framework for Python. 1169 | * [freezegun](https://github.com/spulec/freezegun) - Travel through time by mocking the datetime module. 1170 | * [httmock](https://github.com/patrys/httmock) - A mocking library for requests for Python 2.6+ and 3.2+. 1171 | * [httpretty](https://github.com/gabrielfalcao/HTTPretty) - HTTP request mock tool for Python. 1172 | * [mock](https://docs.python.org/3/library/unittest.mock.html) - (Python standard library) A mocking and patching library. 1173 | * [mocket](https://github.com/mindflayer/python-mocket) - A socket mock framework with gevent/asyncio/SSL support. 1174 | * [responses](https://github.com/getsentry/responses) - A utility library for mocking out the requests Python library. 1175 | * [VCR.py](https://github.com/kevin1024/vcrpy) - Record and replay HTTP interactions on your tests. 1176 | * Object Factories 1177 | * [factory_boy](https://github.com/FactoryBoy/factory_boy) - A test fixtures replacement for Python. 1178 | * [mixer](https://github.com/klen/mixer) - Another fixtures replacement. Supports Django, Flask, SQLAlchemy, Peewee and etc. 1179 | * [model_mommy](https://github.com/vandersonmota/model_mommy) - Creating random fixtures for testing in Django. 1180 | * Code Coverage 1181 | * [coverage](https://pypi.org/project/coverage/) - Code coverage measurement. 1182 | * Fake Data 1183 | * [fake2db](https://github.com/emirozer/fake2db) - Fake database generator. 1184 | * [faker](https://github.com/joke2k/faker) - A Python package that generates fake data. 1185 | * [mimesis](https://github.com/lk-geimfari/mimesis) - is a Python library that help you generate fake data. 1186 | * [radar](https://pypi.org/project/radar/) - Generate random datetime / time. 1187 | 1188 | ## Text Processing 1189 | 1190 | *Libraries for parsing and manipulating plain texts.* 1191 | 1192 | * General 1193 | * [chardet](https://github.com/chardet/chardet) - Python 2/3 compatible character encoding detector. 1194 | * [difflib](https://docs.python.org/3/library/difflib.html) - (Python standard library) Helpers for computing deltas. 1195 | * [ftfy](https://github.com/LuminosoInsight/python-ftfy) - Makes Unicode text less broken and more consistent automagically. 1196 | * [fuzzywuzzy](https://github.com/seatgeek/fuzzywuzzy) - Fuzzy String Matching. 1197 | * [Levenshtein](https://github.com/ztane/python-Levenshtein/) - Fast computation of Levenshtein distance and string similarity. 1198 | * [pangu.py](https://github.com/vinta/pangu.py) - Paranoid text spacing. 1199 | * [pyfiglet](https://github.com/pwaller/pyfiglet) - An implementation of figlet written in Python. 1200 | * [pypinyin](https://github.com/mozillazg/python-pinyin) - Convert Chinese hanzi (漢字) to pinyin (拼音). 1201 | * [textdistance](https://github.com/orsinium/textdistance) - Compute distance between sequences with 30+ algorithms. 1202 | * [unidecode](https://pypi.org/project/Unidecode/) - ASCII transliterations of Unicode text. 1203 | * Slugify 1204 | * [awesome-slugify](https://github.com/dimka665/awesome-slugify) - A Python slugify library that can preserve unicode. 1205 | * [python-slugify](https://github.com/un33k/python-slugify) - A Python slugify library that translates unicode to ASCII. 1206 | * [unicode-slugify](https://github.com/mozilla/unicode-slugify) - A slugifier that generates unicode slugs with Django as a dependency. 1207 | * Unique identifiers 1208 | * [hashids](https://github.com/davidaurelio/hashids-python) - Implementation of [hashids](http://hashids.org) in Python. 1209 | * [shortuuid](https://github.com/skorokithakis/shortuuid) - A generator library for concise, unambiguous and URL-safe UUIDs. 1210 | * Parser 1211 | * [ply](https://github.com/dabeaz/ply) - Implementation of lex and yacc parsing tools for Python. 1212 | * [pygments](http://pygments.org/) - A generic syntax highlighter. 1213 | * [pyparsing](https://github.com/pyparsing/pyparsing) - A general purpose framework for generating parsers. 1214 | * [python-nameparser](https://github.com/derek73/python-nameparser) - Parsing human names into their individual components. 1215 | * [python-phonenumbers](https://github.com/daviddrysdale/python-phonenumbers) - Parsing, formatting, storing and validating international phone numbers. 1216 | * [python-user-agents](https://github.com/selwin/python-user-agents) - Browser user agent parser. 1217 | * [sqlparse](https://github.com/andialbrecht/sqlparse) - A non-validating SQL parser. 1218 | 1219 | ## Third-party APIs 1220 | 1221 | *Libraries for accessing third party services APIs. Also see [List of Python API Wrappers and Libraries](https://github.com/realpython/list-of-python-api-wrappers).* 1222 | 1223 | * [apache-libcloud](https://libcloud.apache.org/) - One Python library for all clouds. 1224 | * [boto3](https://github.com/boto/boto3) - Python interface to Amazon Web Services. 1225 | * [django-wordpress](https://github.com/istrategylabs/django-wordpress) - WordPress models and views for Django. 1226 | * [facebook-sdk](https://github.com/mobolic/facebook-sdk) - Facebook Platform Python SDK. 1227 | * [google-api-python-client](https://github.com/google/google-api-python-client) - Google APIs Client Library for Python. 1228 | * [gspread](https://github.com/burnash/gspread) - Google Spreadsheets Python API. 1229 | * [twython](https://github.com/ryanmcgrath/twython) - A Python wrapper for the Twitter API. 1230 | 1231 | ## URL Manipulation 1232 | 1233 | *Libraries for parsing URLs.* 1234 | 1235 | * [furl](https://github.com/gruns/furl) - A small Python library that makes parsing and manipulating URLs easy. 1236 | * [purl](https://github.com/codeinthehole/purl) - A simple, immutable URL class with a clean API for interrogation and manipulation. 1237 | * [pyshorteners](https://github.com/ellisonleao/pyshorteners) - A pure Python URL shortening lib. 1238 | * [webargs](https://github.com/marshmallow-code/webargs) - A friendly library for parsing HTTP request arguments with built-in support for popular web frameworks. 1239 | 1240 | ## Video 1241 | 1242 | *Libraries for manipulating video and GIFs.* 1243 | 1244 | * [moviepy](https://zulko.github.io/moviepy/) - A module for script-based movie editing with many formats, including animated GIFs. 1245 | * [scikit-video](https://github.com/aizvorski/scikit-video) - Video processing routines for SciPy. 1246 | * [vidgear](https://github.com/abhiTronix/vidgear) - Most Powerful multi-threaded Video Processing framework. 1247 | 1248 | ## Web Asset Management 1249 | 1250 | *Tools for managing, compressing and minifying website assets.* 1251 | 1252 | * [django-compressor](https://github.com/django-compressor/django-compressor) - Compresses linked and inline JavaScript or CSS into a single cached file. 1253 | * [django-pipeline](https://github.com/jazzband/django-pipeline) - An asset packaging library for Django. 1254 | * [django-storages](https://github.com/jschneier/django-storages) - A collection of custom storage back ends for Django. 1255 | * [fanstatic](http://www.fanstatic.org/en/latest/) - Packages, optimizes, and serves static file dependencies as Python packages. 1256 | * [fileconveyor](http://wimleers.com/fileconveyor) - A daemon to detect and sync files to CDNs, S3 and FTP. 1257 | * [flask-assets](https://github.com/miracle2k/flask-assets) - Helps you integrate webassets into your Flask app. 1258 | * [webassets](https://github.com/miracle2k/webassets) - Bundles, optimizes, and manages unique cache-busting URLs for static resources. 1259 | 1260 | ## Web Content Extracting 1261 | 1262 | *Libraries for extracting web contents.* 1263 | 1264 | * [html2text](https://github.com/Alir3z4/html2text) - Convert HTML to Markdown-formatted text. 1265 | * [lassie](https://github.com/michaelhelmick/lassie) - Web Content Retrieval for Humans. 1266 | * [micawber](https://github.com/coleifer/micawber) - A small library for extracting rich content from URLs. 1267 | * [newspaper](https://github.com/codelucas/newspaper) - News extraction, article extraction and content curation in Python. 1268 | * [python-readability](https://github.com/buriy/python-readability) - Fast Python port of arc90's readability tool. 1269 | * [requests-html](https://github.com/psf/requests-html) - Pythonic HTML Parsing for Humans. 1270 | * [sumy](https://github.com/miso-belica/sumy) - A module for automatic summarization of text documents and HTML pages. 1271 | * [textract](https://github.com/deanmalmgren/textract) - Extract text from any document, Word, PowerPoint, PDFs, etc. 1272 | * [toapi](https://github.com/gaojiuli/toapi) - Every web site provides APIs. 1273 | 1274 | ## Web Crawling 1275 | 1276 | *Libraries to automate web scraping.* 1277 | 1278 | * [cola](https://github.com/chineking/cola) - A distributed crawling framework. 1279 | * [feedparser](https://pythonhosted.org/feedparser/) - Universal feed parser. 1280 | * [grab](https://github.com/lorien/grab) - Site scraping framework. 1281 | * [MechanicalSoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites. 1282 | * [portia](https://github.com/scrapinghub/portia) - Visual scraping for Scrapy. 1283 | * [pyspider](https://github.com/binux/pyspider) - A powerful spider system. 1284 | * [robobrowser](https://github.com/jmcarp/robobrowser) - A simple, Pythonic library for browsing the web without a standalone web browser. 1285 | * [scrapy](https://scrapy.org/) - A fast high-level screen scraping and web crawling framework. 1286 | 1287 | ## Web Frameworks 1288 | 1289 | *Traditional full stack web frameworks. Also see [RESTful API](https://github.com/vinta/awesome-python#restful-api).* 1290 | 1291 | * Synchronous 1292 | * [Django](https://www.djangoproject.com/) - The most popular web framework in Python. 1293 | * [awesome-django](https://github.com/shahraizali/awesome-django) 1294 | * [awesome-django](https://github.com/wsvincent/awesome-django) 1295 | * [Flask](http://flask.pocoo.org/) - A microframework for Python. 1296 | * [awesome-flask](https://github.com/humiaozuzu/awesome-flask) 1297 | * [Pyramid](https://pylonsproject.org/) - A small, fast, down-to-earth, open source Python web framework. 1298 | * [awesome-pyramid](https://github.com/uralbash/awesome-pyramid) 1299 | * [Masonite](https://github.com/MasoniteFramework/masonite) - The modern and developer centric Python web framework. 1300 | * Asynchronous 1301 | * [Tornado](http://www.tornadoweb.org/en/latest/) - A web framework and asynchronous networking library. 1302 | 1303 | ## WebSocket 1304 | 1305 | *Libraries for working with WebSocket.* 1306 | 1307 | * [autobahn-python](https://github.com/crossbario/autobahn-python) - WebSocket & WAMP for Python on Twisted and [asyncio](https://docs.python.org/3/library/asyncio.html). 1308 | * [channels](https://github.com/django/channels) - Developer-friendly asynchrony for Django. 1309 | * [websockets](https://github.com/aaugustin/websockets) - A library for building WebSocket servers and clients with a focus on correctness and simplicity. 1310 | 1311 | ## WSGI Servers 1312 | 1313 | *WSGI-compatible web servers.* 1314 | 1315 | * [bjoern](https://github.com/jonashaag/bjoern) - Asynchronous, very fast and written in C. 1316 | * [gunicorn](https://github.com/benoitc/gunicorn) - Pre-forked, ported from Ruby's Unicorn project. 1317 | * [uWSGI](https://uwsgi-docs.readthedocs.io/en/latest/) - A project aims at developing a full stack for building hosting services, written in C. 1318 | * [waitress](https://github.com/Pylons/waitress) - Multi-threaded, powers Pyramid. 1319 | * [werkzeug](https://github.com/pallets/werkzeug) - A WSGI utility library for Python that powers Flask and can easily be embedded into your own projects. 1320 | 1321 | # Resources 1322 | 1323 | Where to discover learning resources or new Python libraries. 1324 | 1325 | ## Books 1326 | 1327 | - [Fluent Python](https://www.oreilly.com/library/view/fluent-python/9781491946237/) 1328 | - [Think Python](https://greenteapress.com/wp/think-python-2e/) 1329 | 1330 | ## Websites 1331 | 1332 | * Tutorials 1333 | * [Full Stack Python](https://www.fullstackpython.com/) 1334 | * [Python Cheatsheet](https://www.pythoncheatsheet.org/) 1335 | * [Real Python](https://realpython.com) 1336 | * [The Hitchhiker’s Guide to Python](https://docs.python-guide.org/) 1337 | * [Ultimate Python study guide](https://github.com/huangsam/ultimate-python) 1338 | * Libraries 1339 | * [Awesome Python @LibHunt](https://python.libhunt.com/) 1340 | * Others 1341 | * [Python ZEEF](https://python.zeef.com/alan.richmond) 1342 | * [Pythonic News](https://news.python.sc/) 1343 | * [What the f*ck Python!](https://github.com/satwikkansal/wtfpython) 1344 | 1345 | ## Newsletters 1346 | 1347 | * [Awesome Python Newsletter](http://python.libhunt.com/newsletter) 1348 | * [Pycoder's Weekly](http://pycoders.com/) 1349 | * [Python Tricks](https://realpython.com/python-tricks/) 1350 | * [Python Weekly](http://www.pythonweekly.com/) 1351 | 1352 | ## Podcasts 1353 | 1354 | * [Django Chat](https://djangochat.com/) 1355 | * [Podcast.\_\_init__](https://podcastinit.com/) 1356 | * [Python Bytes](https://pythonbytes.fm) 1357 | * [Running in Production](https://runninginproduction.com/) 1358 | * [Talk Python To Me](https://talkpython.fm/) 1359 | * [Test and Code](https://testandcode.com/) 1360 | * [The Real Python Podcast](https://realpython.com/podcasts/rpp/) 1361 | 1362 | # Contributing 1363 | 1364 | Your contributions are always welcome! Please take a look at the [contribution guidelines](https://github.com/vinta/awesome-python/blob/master/CONTRIBUTING.md) first. 1365 | 1366 | I will keep some pull requests open if I'm not sure whether those libraries are awesome, you could [vote for them](https://github.com/vinta/awesome-python/pulls) by adding :+1: to them. Pull requests will be merged when their votes reach **20**. 1367 | 1368 | - - - 1369 | 1370 | If you have any question about this opinionated list, do not hesitate to contact me [@VintaChen](https://twitter.com/VintaChen) on Twitter or open an issue on GitHub. 1371 | 1372 | -------------------------------------------------------------------------------- /docs/CNAME: -------------------------------------------------------------------------------- 1 | awesome-python.com -------------------------------------------------------------------------------- /docs/css/extra.css: -------------------------------------------------------------------------------- 1 | @media (min-width: 960px) { 2 | html { 3 | scroll-behavior: smooth; 4 | } 5 | 6 | .md-content__inner > ul:nth-child(5) { 7 | display: none; 8 | } 9 | } 10 | -------------------------------------------------------------------------------- /mkdocs.yml: -------------------------------------------------------------------------------- 1 | site_name: Awesome Python 2 | site_url: https://awesome-python.com 3 | site_description: A curated list of awesome Python frameworks, libraries and software 4 | site_author: Vinta Chen 5 | repo_name: vinta/awesome-python 6 | repo_url: https://github.com/vinta/awesome-python 7 | theme: 8 | name: material 9 | palette: 10 | primary: red 11 | accent: pink 12 | extra: 13 | social: 14 | - type: github 15 | link: https://github.com/vinta 16 | - type: twitter 17 | link: https://twitter.com/vinta 18 | - type: linkedin 19 | link: https://www.linkedin.com/in/vinta 20 | google_analytics: 21 | - UA-510626-7 22 | - auto 23 | extra_css: 24 | - css/extra.css 25 | nav: 26 | - "Life is short, you need Python.": "index.md" 27 | -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | mkdocs==1.0.4 2 | mkdocs-material==4.0.2 3 | -------------------------------------------------------------------------------- /sort.py: -------------------------------------------------------------------------------- 1 | #!/usr/bin/env python 2 | # coding: utf-8 3 | 4 | """ 5 | The approach taken is explained below. I decided to do it simply. 6 | Initially I was considering parsing the data into some sort of 7 | structure and then generating an appropriate README. I am still 8 | considering doing it - but for now this should work. The only issue 9 | I see is that it only sorts the entries at the lowest level, and that 10 | the order of the top-level contents do not match the order of the actual 11 | entries. 12 | 13 | This could be extended by having nested blocks, sorting them recursively 14 | and flattening the end structure into a list of lines. Revision 2 maybe ^.^. 15 | """ 16 | 17 | def sort_blocks(): 18 | # First, we load the current README into memory 19 | with open('README.md', 'r') as read_me_file: 20 | read_me = read_me_file.read() 21 | 22 | # Separating the 'table of contents' from the contents (blocks) 23 | table_of_contents = ''.join(read_me.split('- - -')[0]) 24 | blocks = ''.join(read_me.split('- - -')[1]).split('\n# ') 25 | for i in range(len(blocks)): 26 | if i == 0: 27 | blocks[i] = blocks[i] + '\n' 28 | else: 29 | blocks[i] = '# ' + blocks[i] + '\n' 30 | 31 | # Sorting the libraries 32 | inner_blocks = sorted(blocks[0].split('##')) 33 | for i in range(1, len(inner_blocks)): 34 | if inner_blocks[i][0] != '#': 35 | inner_blocks[i] = '##' + inner_blocks[i] 36 | inner_blocks = ''.join(inner_blocks) 37 | 38 | # Replacing the non-sorted libraries by the sorted ones and gathering all at the final_README file 39 | blocks[0] = inner_blocks 40 | final_README = table_of_contents + '- - -' + ''.join(blocks) 41 | 42 | with open('README.md', 'w+') as sorted_file: 43 | sorted_file.write(final_README) 44 | 45 | def main(): 46 | # First, we load the current README into memory as an array of lines 47 | with open('README.md', 'r') as read_me_file: 48 | read_me = read_me_file.readlines() 49 | 50 | # Then we cluster the lines together as blocks 51 | # Each block represents a collection of lines that should be sorted 52 | # This was done by assuming only links ([...](...)) are meant to be sorted 53 | # Clustering is done by indentation 54 | blocks = [] 55 | last_indent = None 56 | for line in read_me: 57 | s_line = line.lstrip() 58 | indent = len(line) - len(s_line) 59 | 60 | if any([s_line.startswith(s) for s in ['* [', '- [']]): 61 | if indent == last_indent: 62 | blocks[-1].append(line) 63 | else: 64 | blocks.append([line]) 65 | last_indent = indent 66 | else: 67 | blocks.append([line]) 68 | last_indent = None 69 | 70 | with open('README.md', 'w+') as sorted_file: 71 | # Then all of the blocks are sorted individually 72 | blocks = [ 73 | ''.join(sorted(block, key=str.lower)) for block in blocks 74 | ] 75 | # And the result is written back to README.md 76 | sorted_file.write(''.join(blocks)) 77 | 78 | # Then we call the sorting method 79 | sort_blocks() 80 | 81 | 82 | if __name__ == "__main__": 83 | main() 84 | --------------------------------------------------------------------------------