├── .gitignore ├── LICENSE ├── README.md ├── data └── 郑州新房数据 2020-6-1.csv ├── fangSpider ├── items.py ├── middlewares.py ├── mylogger.py ├── mysqlcfg.py ├── pipelines.py ├── settings.py └── spiders │ └── fangIndex.py ├── logScrapy.log ├── requirements.txt ├── res ├── demo1.png ├── demo2.png ├── demo3.png ├── demo4.png ├── demo5.png └── demo6.png ├── scrapy.cfg ├── sql └── loupanindex.sql └── start.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/README.md -------------------------------------------------------------------------------- /data/郑州新房数据 2020-6-1.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/data/郑州新房数据 2020-6-1.csv -------------------------------------------------------------------------------- /fangSpider/items.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/fangSpider/items.py -------------------------------------------------------------------------------- /fangSpider/middlewares.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/fangSpider/middlewares.py -------------------------------------------------------------------------------- /fangSpider/mylogger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/fangSpider/mylogger.py -------------------------------------------------------------------------------- /fangSpider/mysqlcfg.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/fangSpider/mysqlcfg.py -------------------------------------------------------------------------------- /fangSpider/pipelines.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/fangSpider/pipelines.py -------------------------------------------------------------------------------- /fangSpider/settings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/fangSpider/settings.py -------------------------------------------------------------------------------- /fangSpider/spiders/fangIndex.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/fangSpider/spiders/fangIndex.py -------------------------------------------------------------------------------- /logScrapy.log: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/logScrapy.log -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | Scrapy==2.0.0 2 | beautifulsoup4==4.9.1 3 | mysql_connector_repackaged==0.3.1 4 | -------------------------------------------------------------------------------- /res/demo1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/res/demo1.png -------------------------------------------------------------------------------- /res/demo2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/res/demo2.png -------------------------------------------------------------------------------- /res/demo3.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/res/demo3.png -------------------------------------------------------------------------------- /res/demo4.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/res/demo4.png -------------------------------------------------------------------------------- /res/demo5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/res/demo5.png -------------------------------------------------------------------------------- /res/demo6.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/res/demo6.png -------------------------------------------------------------------------------- /scrapy.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/scrapy.cfg -------------------------------------------------------------------------------- /sql/loupanindex.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/sql/loupanindex.sql -------------------------------------------------------------------------------- /start.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/veveup/fangSpider/HEAD/start.py --------------------------------------------------------------------------------