├── .gitignore ├── LICENSE ├── README.md ├── genREADME.py ├── jkcrawler ├── __init__.py ├── items.py ├── middlewares.py ├── pipelines.py ├── settings.py └── spiders │ ├── __init__.py │ ├── api_vc_bilibili.py │ ├── instagram.py │ ├── m_weibo.py │ ├── makooooon_tumblr.py │ └── ryoryo_chan_tumblr.py ├── requirements.txt ├── scrapy.cfg └── update.md /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/README.md -------------------------------------------------------------------------------- /genREADME.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/genREADME.py -------------------------------------------------------------------------------- /jkcrawler/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /jkcrawler/items.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/items.py -------------------------------------------------------------------------------- /jkcrawler/middlewares.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/middlewares.py -------------------------------------------------------------------------------- /jkcrawler/pipelines.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/pipelines.py -------------------------------------------------------------------------------- /jkcrawler/settings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/settings.py -------------------------------------------------------------------------------- /jkcrawler/spiders/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/spiders/__init__.py -------------------------------------------------------------------------------- /jkcrawler/spiders/api_vc_bilibili.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/spiders/api_vc_bilibili.py -------------------------------------------------------------------------------- /jkcrawler/spiders/instagram.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/spiders/instagram.py -------------------------------------------------------------------------------- /jkcrawler/spiders/m_weibo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/spiders/m_weibo.py -------------------------------------------------------------------------------- /jkcrawler/spiders/makooooon_tumblr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/spiders/makooooon_tumblr.py -------------------------------------------------------------------------------- /jkcrawler/spiders/ryoryo_chan_tumblr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/jkcrawler/spiders/ryoryo_chan_tumblr.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | beautifulsoup4 2 | scrapy 3 | Pillow 4 | -------------------------------------------------------------------------------- /scrapy.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/scrapy.cfg -------------------------------------------------------------------------------- /update.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/topiccrawler/jkcrawler/HEAD/update.md --------------------------------------------------------------------------------