├── README.md ├── WeiboSearch ├── __init__.py ├── __pycache__ │ ├── __init__.cpython-36.pyc │ ├── items.cpython-36.pyc │ ├── middlewares.cpython-36.pyc │ ├── pipelines.cpython-36.pyc │ └── settings.cpython-36.pyc ├── account_build │ ├── __init__.py │ ├── account.txt │ ├── account_sample.txt │ └── login.py ├── items.py ├── middlewares.py ├── pipelines.py ├── run.py ├── settings.py └── spiders │ ├── __init__.py │ ├── __pycache__ │ ├── __init__.cpython-36.pyc │ └── weibo_spider.cpython-36.pyc │ └── weibo_spider.py └── scrapy.cfg /README.md: -------------------------------------------------------------------------------- 1 | ### WeiboSearch 2 | --- 3 | [Scrapy 新浪微博搜索爬虫](https://zhuanlan.zhihu.com/p/70153413) 4 | -------------------------------------------------------------------------------- /WeiboSearch/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /WeiboSearch/__pycache__/__init__.cpython-36.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/__pycache__/__init__.cpython-36.pyc -------------------------------------------------------------------------------- /WeiboSearch/__pycache__/items.cpython-36.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/__pycache__/items.cpython-36.pyc -------------------------------------------------------------------------------- /WeiboSearch/__pycache__/middlewares.cpython-36.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/__pycache__/middlewares.cpython-36.pyc -------------------------------------------------------------------------------- /WeiboSearch/__pycache__/pipelines.cpython-36.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/__pycache__/pipelines.cpython-36.pyc -------------------------------------------------------------------------------- /WeiboSearch/__pycache__/settings.cpython-36.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/__pycache__/settings.cpython-36.pyc -------------------------------------------------------------------------------- /WeiboSearch/account_build/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/account_build/__init__.py -------------------------------------------------------------------------------- /WeiboSearch/account_build/account.txt: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /WeiboSearch/account_build/account_sample.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/account_build/account_sample.txt -------------------------------------------------------------------------------- /WeiboSearch/account_build/login.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/account_build/login.py -------------------------------------------------------------------------------- /WeiboSearch/items.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/items.py -------------------------------------------------------------------------------- /WeiboSearch/middlewares.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/middlewares.py -------------------------------------------------------------------------------- /WeiboSearch/pipelines.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/pipelines.py -------------------------------------------------------------------------------- /WeiboSearch/run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/run.py -------------------------------------------------------------------------------- /WeiboSearch/settings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/settings.py -------------------------------------------------------------------------------- /WeiboSearch/spiders/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/spiders/__init__.py -------------------------------------------------------------------------------- /WeiboSearch/spiders/__pycache__/__init__.cpython-36.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/spiders/__pycache__/__init__.cpython-36.pyc -------------------------------------------------------------------------------- /WeiboSearch/spiders/__pycache__/weibo_spider.cpython-36.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/spiders/__pycache__/weibo_spider.cpython-36.pyc -------------------------------------------------------------------------------- /WeiboSearch/spiders/weibo_spider.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/WeiboSearch/spiders/weibo_spider.py -------------------------------------------------------------------------------- /scrapy.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Ingram7/WeiboSearch/HEAD/scrapy.cfg --------------------------------------------------------------------------------