├── .DS_Store ├── .gitignore ├── .venv ├── man │ └── man1 │ │ └── nosetests.1 ├── pip-selfcheck.json └── pyvenv.cfg ├── .vscode ├── launch.json └── settings.json ├── LICENSE.md ├── MANIFEST.in ├── Makefile ├── README.md ├── aspider ├── .DS_Store ├── __init__.py ├── __main__.py ├── aspider.py ├── crawling.py ├── outputing.py ├── reporting.py ├── routeing.py └── util.py ├── docs ├── Makefile ├── aspider_lesson.md ├── aspider_lesson.pdf ├── make.bat └── source │ ├── conf.py │ └── index.rst ├── example ├── douban_250_scores.py ├── douban_aspider.py ├── douban_requests.py └── prog.py ├── requirements.txt ├── setup.cfg ├── setup.py ├── tests ├── __init__.py ├── conftest.py ├── test_aspider.py ├── test_routing.py ├── test_sample.py └── test_util.py └── update_docs.sh /.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/.DS_Store -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/.gitignore -------------------------------------------------------------------------------- /.venv/man/man1/nosetests.1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/.venv/man/man1/nosetests.1 -------------------------------------------------------------------------------- /.venv/pip-selfcheck.json: -------------------------------------------------------------------------------- 1 | {"last_check":"2019-07-16T13:25:40Z","pypi_version":"19.1.1"} -------------------------------------------------------------------------------- /.venv/pyvenv.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/.venv/pyvenv.cfg -------------------------------------------------------------------------------- /.vscode/launch.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/.vscode/launch.json -------------------------------------------------------------------------------- /.vscode/settings.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/.vscode/settings.json -------------------------------------------------------------------------------- /LICENSE.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/LICENSE.md -------------------------------------------------------------------------------- /MANIFEST.in: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/MANIFEST.in -------------------------------------------------------------------------------- /Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/Makefile -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/README.md -------------------------------------------------------------------------------- /aspider/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/.DS_Store -------------------------------------------------------------------------------- /aspider/__init__.py: -------------------------------------------------------------------------------- 1 | __version__ = "0.1.2" 2 | -------------------------------------------------------------------------------- /aspider/__main__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/__main__.py -------------------------------------------------------------------------------- /aspider/aspider.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/aspider.py -------------------------------------------------------------------------------- /aspider/crawling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/crawling.py -------------------------------------------------------------------------------- /aspider/outputing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/outputing.py -------------------------------------------------------------------------------- /aspider/reporting.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/reporting.py -------------------------------------------------------------------------------- /aspider/routeing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/routeing.py -------------------------------------------------------------------------------- /aspider/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/aspider/util.py -------------------------------------------------------------------------------- /docs/Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/docs/Makefile -------------------------------------------------------------------------------- /docs/aspider_lesson.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/docs/aspider_lesson.md -------------------------------------------------------------------------------- /docs/aspider_lesson.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/docs/aspider_lesson.pdf -------------------------------------------------------------------------------- /docs/make.bat: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/docs/make.bat -------------------------------------------------------------------------------- /docs/source/conf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/docs/source/conf.py -------------------------------------------------------------------------------- /docs/source/index.rst: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/docs/source/index.rst -------------------------------------------------------------------------------- /example/douban_250_scores.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/example/douban_250_scores.py -------------------------------------------------------------------------------- /example/douban_aspider.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/example/douban_aspider.py -------------------------------------------------------------------------------- /example/douban_requests.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/example/douban_requests.py -------------------------------------------------------------------------------- /example/prog.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/example/prog.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/requirements.txt -------------------------------------------------------------------------------- /setup.cfg: -------------------------------------------------------------------------------- 1 | [bdist_wheel] 2 | universal=1 3 | 4 | [metadata] 5 | description-file=README.md -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/setup.py -------------------------------------------------------------------------------- /tests/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tests/conftest.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/tests/conftest.py -------------------------------------------------------------------------------- /tests/test_aspider.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/tests/test_aspider.py -------------------------------------------------------------------------------- /tests/test_routing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/tests/test_routing.py -------------------------------------------------------------------------------- /tests/test_sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/tests/test_sample.py -------------------------------------------------------------------------------- /tests/test_util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/tests/test_util.py -------------------------------------------------------------------------------- /update_docs.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gxtrobot/aspider/HEAD/update_docs.sh --------------------------------------------------------------------------------