├── .gitignore ├── README.md ├── data ├── diplomacy_petitions_20181031.tsv ├── diplomacy_petitions_20181031.zip ├── diplomacy_petitions_20181031_long.tsv ├── diplomacy_petitions_20181031_monthly_count.txt ├── diplomacy_petitions_20181031_top100.tsv └── petition_links.csv ├── output_sample ├── 424016.json ├── 424025.json ├── 424033.json ├── 424048.json ├── 424049.json ├── 424057.json ├── 424062.json ├── 424066.json ├── 424073.json └── 424098.json ├── petitions_scraper ├── __init__.py ├── parser.py ├── scraper.py └── utils.py ├── scraping_petitions.py └── scripts ├── categories.json ├── create_petition_table_from_json.py ├── getting_petitions_from_indexfile.py └── getting_petitions_links.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/README.md -------------------------------------------------------------------------------- /data/diplomacy_petitions_20181031.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/data/diplomacy_petitions_20181031.tsv -------------------------------------------------------------------------------- /data/diplomacy_petitions_20181031.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/data/diplomacy_petitions_20181031.zip -------------------------------------------------------------------------------- /data/diplomacy_petitions_20181031_long.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/data/diplomacy_petitions_20181031_long.tsv -------------------------------------------------------------------------------- /data/diplomacy_petitions_20181031_monthly_count.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/data/diplomacy_petitions_20181031_monthly_count.txt -------------------------------------------------------------------------------- /data/diplomacy_petitions_20181031_top100.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/data/diplomacy_petitions_20181031_top100.tsv -------------------------------------------------------------------------------- /data/petition_links.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/data/petition_links.csv -------------------------------------------------------------------------------- /output_sample/424016.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424016.json -------------------------------------------------------------------------------- /output_sample/424025.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424025.json -------------------------------------------------------------------------------- /output_sample/424033.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424033.json -------------------------------------------------------------------------------- /output_sample/424048.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424048.json -------------------------------------------------------------------------------- /output_sample/424049.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424049.json -------------------------------------------------------------------------------- /output_sample/424057.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424057.json -------------------------------------------------------------------------------- /output_sample/424062.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424062.json -------------------------------------------------------------------------------- /output_sample/424066.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424066.json -------------------------------------------------------------------------------- /output_sample/424073.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424073.json -------------------------------------------------------------------------------- /output_sample/424098.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/output_sample/424098.json -------------------------------------------------------------------------------- /petitions_scraper/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/petitions_scraper/__init__.py -------------------------------------------------------------------------------- /petitions_scraper/parser.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/petitions_scraper/parser.py -------------------------------------------------------------------------------- /petitions_scraper/scraper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/petitions_scraper/scraper.py -------------------------------------------------------------------------------- /petitions_scraper/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/petitions_scraper/utils.py -------------------------------------------------------------------------------- /scraping_petitions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/scraping_petitions.py -------------------------------------------------------------------------------- /scripts/categories.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/scripts/categories.json -------------------------------------------------------------------------------- /scripts/create_petition_table_from_json.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/scripts/create_petition_table_from_json.py -------------------------------------------------------------------------------- /scripts/getting_petitions_from_indexfile.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/scripts/getting_petitions_from_indexfile.py -------------------------------------------------------------------------------- /scripts/getting_petitions_links.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lovit/petitions_scraper/HEAD/scripts/getting_petitions_links.py --------------------------------------------------------------------------------