├── .gitattributes ├── .gitignore ├── 01-URL.py ├── 02-BFS.py ├── 03-Chrome.py ├── 04-Login.py ├── 05-tieba.py ├── 06-JDprice.py ├── 07-BaiduLenovo.py ├── 08-IdentifyingCode.py ├── 09-downPicture.py ├── 10-zhihuLogin.py ├── 11-CSDNBlogList.py ├── 12-ChromeCookie1.py ├── 12-ChromeCookie2.py ├── 13-CookieDeciphering.py ├── 14-ChromePassword.py ├── 15-ZhihuAnswerList.py ├── 16-selenium.py ├── 17-Phantomjs.py ├── 18-WeiboAnalbum.py ├── 19-BeautifulSoup.py ├── 20-DoubanMovieTop250.py ├── 21-DoubanMovieTypeTop.py ├── 22-PyQuery.py ├── 23-C315Check.py ├── 24-FilesDownload.py ├── ChromeCookies.py ├── README.md ├── Scrapy ├── 00-Scrapy安装.txt ├── 01-Scrapy安装失败解决方案.txt ├── 02-Scrapy创建项目.txt └── tutorial │ ├── scrapy.cfg │ └── tutorial │ ├── __init__.py │ ├── items.py.tmpl │ ├── pipelines.py.tmpl │ ├── settings.py.tmpl │ └── spiders │ └── __init__.py └── __pycache__ └── ChromeCookies.cpython-34.pyc /.gitattributes: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/.gitattributes -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/.gitignore -------------------------------------------------------------------------------- /01-URL.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/01-URL.py -------------------------------------------------------------------------------- /02-BFS.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/02-BFS.py -------------------------------------------------------------------------------- /03-Chrome.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/03-Chrome.py -------------------------------------------------------------------------------- /04-Login.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/04-Login.py -------------------------------------------------------------------------------- /05-tieba.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/05-tieba.py -------------------------------------------------------------------------------- /06-JDprice.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/06-JDprice.py -------------------------------------------------------------------------------- /07-BaiduLenovo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/07-BaiduLenovo.py -------------------------------------------------------------------------------- /08-IdentifyingCode.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/08-IdentifyingCode.py -------------------------------------------------------------------------------- /09-downPicture.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/09-downPicture.py -------------------------------------------------------------------------------- /10-zhihuLogin.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/10-zhihuLogin.py -------------------------------------------------------------------------------- /11-CSDNBlogList.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/11-CSDNBlogList.py -------------------------------------------------------------------------------- /12-ChromeCookie1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/12-ChromeCookie1.py -------------------------------------------------------------------------------- /12-ChromeCookie2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/12-ChromeCookie2.py -------------------------------------------------------------------------------- /13-CookieDeciphering.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/13-CookieDeciphering.py -------------------------------------------------------------------------------- /14-ChromePassword.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/14-ChromePassword.py -------------------------------------------------------------------------------- /15-ZhihuAnswerList.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/15-ZhihuAnswerList.py -------------------------------------------------------------------------------- /16-selenium.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/16-selenium.py -------------------------------------------------------------------------------- /17-Phantomjs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/17-Phantomjs.py -------------------------------------------------------------------------------- /18-WeiboAnalbum.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/18-WeiboAnalbum.py -------------------------------------------------------------------------------- /19-BeautifulSoup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/19-BeautifulSoup.py -------------------------------------------------------------------------------- /20-DoubanMovieTop250.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/20-DoubanMovieTop250.py -------------------------------------------------------------------------------- /21-DoubanMovieTypeTop.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/21-DoubanMovieTypeTop.py -------------------------------------------------------------------------------- /22-PyQuery.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/22-PyQuery.py -------------------------------------------------------------------------------- /23-C315Check.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/23-C315Check.py -------------------------------------------------------------------------------- /24-FilesDownload.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/24-FilesDownload.py -------------------------------------------------------------------------------- /ChromeCookies.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/ChromeCookies.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/README.md -------------------------------------------------------------------------------- /Scrapy/00-Scrapy安装.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/00-Scrapy安装.txt -------------------------------------------------------------------------------- /Scrapy/01-Scrapy安装失败解决方案.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/01-Scrapy安装失败解决方案.txt -------------------------------------------------------------------------------- /Scrapy/02-Scrapy创建项目.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/02-Scrapy创建项目.txt -------------------------------------------------------------------------------- /Scrapy/tutorial/scrapy.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/tutorial/scrapy.cfg -------------------------------------------------------------------------------- /Scrapy/tutorial/tutorial/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Scrapy/tutorial/tutorial/items.py.tmpl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/tutorial/tutorial/items.py.tmpl -------------------------------------------------------------------------------- /Scrapy/tutorial/tutorial/pipelines.py.tmpl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/tutorial/tutorial/pipelines.py.tmpl -------------------------------------------------------------------------------- /Scrapy/tutorial/tutorial/settings.py.tmpl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/tutorial/tutorial/settings.py.tmpl -------------------------------------------------------------------------------- /Scrapy/tutorial/tutorial/spiders/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/Scrapy/tutorial/tutorial/spiders/__init__.py -------------------------------------------------------------------------------- /__pycache__/ChromeCookies.cpython-34.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jueee/PythonWebCrawlers/HEAD/__pycache__/ChromeCookies.cpython-34.pyc --------------------------------------------------------------------------------