├── README.rst ├── db └── mysql.sql ├── dirbot ├── __init__.py ├── items.py ├── pipelines.py ├── settings.py └── spiders │ ├── __init__.py │ └── dmoz.py ├── scrapy.cfg └── setup.py /README.rst: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/README.rst -------------------------------------------------------------------------------- /db/mysql.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/db/mysql.sql -------------------------------------------------------------------------------- /dirbot/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /dirbot/items.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/dirbot/items.py -------------------------------------------------------------------------------- /dirbot/pipelines.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/dirbot/pipelines.py -------------------------------------------------------------------------------- /dirbot/settings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/dirbot/settings.py -------------------------------------------------------------------------------- /dirbot/spiders/__init__.py: -------------------------------------------------------------------------------- 1 | # Place here all your scrapy spiders 2 | -------------------------------------------------------------------------------- /dirbot/spiders/dmoz.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/dirbot/spiders/dmoz.py -------------------------------------------------------------------------------- /scrapy.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/scrapy.cfg -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/rmax/dirbot-mysql/HEAD/setup.py --------------------------------------------------------------------------------