├── .gitignore ├── README.md ├── requirements.txt ├── scrapy_redis_bloomfilter ├── __init__.py ├── __version__.py ├── bloomfilter.py ├── defaults.py ├── dupefilter.py └── scheduler.py ├── setup.py └── tests ├── scrapy.cfg └── tests ├── __init__.py ├── items.py ├── middlewares.py ├── pipelines.py ├── settings.py └── spiders ├── __init__.py └── test.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/README.md -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | scrapy-redis>=0.6.8 -------------------------------------------------------------------------------- /scrapy_redis_bloomfilter/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/scrapy_redis_bloomfilter/__init__.py -------------------------------------------------------------------------------- /scrapy_redis_bloomfilter/__version__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/scrapy_redis_bloomfilter/__version__.py -------------------------------------------------------------------------------- /scrapy_redis_bloomfilter/bloomfilter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/scrapy_redis_bloomfilter/bloomfilter.py -------------------------------------------------------------------------------- /scrapy_redis_bloomfilter/defaults.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/scrapy_redis_bloomfilter/defaults.py -------------------------------------------------------------------------------- /scrapy_redis_bloomfilter/dupefilter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/scrapy_redis_bloomfilter/dupefilter.py -------------------------------------------------------------------------------- /scrapy_redis_bloomfilter/scheduler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/scrapy_redis_bloomfilter/scheduler.py -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/setup.py -------------------------------------------------------------------------------- /tests/scrapy.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/tests/scrapy.cfg -------------------------------------------------------------------------------- /tests/tests/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tests/tests/items.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/tests/tests/items.py -------------------------------------------------------------------------------- /tests/tests/middlewares.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/tests/tests/middlewares.py -------------------------------------------------------------------------------- /tests/tests/pipelines.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/tests/tests/pipelines.py -------------------------------------------------------------------------------- /tests/tests/settings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/tests/tests/settings.py -------------------------------------------------------------------------------- /tests/tests/spiders/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/tests/tests/spiders/__init__.py -------------------------------------------------------------------------------- /tests/tests/spiders/test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Python3WebSpider/ScrapyRedisBloomFilter/HEAD/tests/tests/spiders/test.py --------------------------------------------------------------------------------