├── .gitignore ├── README.md ├── requirements.txt ├── scrapers ├── __init__.py └── scraper.py ├── script.py ├── script_asyncio.py ├── script_concurrent.py ├── script_parallel_1.py ├── script_parallel_2.py └── test ├── __init__.py ├── test.html ├── test_scraper.py └── test_scraper_mock.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/README.md -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/requirements.txt -------------------------------------------------------------------------------- /scrapers/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /scrapers/scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/scrapers/scraper.py -------------------------------------------------------------------------------- /script.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/script.py -------------------------------------------------------------------------------- /script_asyncio.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/script_asyncio.py -------------------------------------------------------------------------------- /script_concurrent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/script_concurrent.py -------------------------------------------------------------------------------- /script_parallel_1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/script_parallel_1.py -------------------------------------------------------------------------------- /script_parallel_2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/script_parallel_2.py -------------------------------------------------------------------------------- /test/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /test/test.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/test/test.html -------------------------------------------------------------------------------- /test/test_scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/test/test_scraper.py -------------------------------------------------------------------------------- /test/test_scraper_mock.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/testdrivenio/concurrent-web-scraping/HEAD/test/test_scraper_mock.py --------------------------------------------------------------------------------