├── .gitignore ├── LICENSE ├── README.md ├── botguide.md ├── community-guide.md ├── congress ├── congress │ ├── __init__.py │ ├── items.py │ ├── pipelines.py │ ├── settings.py │ └── spiders │ │ ├── __init__.py │ │ ├── congress.py │ │ └── example.py └── scrapy.cfg ├── data ├── congressional-record.md ├── discursive.md ├── how_to_submit_dataset.md ├── info_source.md └── oathkeepers.md ├── design_doc.png ├── domain-extractor-2.py ├── eventador ├── README.md └── pipelines │ └── sentiment_analysis.md ├── exploratory_notebooks ├── 4_chan.ipynb ├── 4chan_Link_Extraction.ipynb ├── 4chan_sample_thread_exploration.ipynb ├── 8ch.Rmd ├── Aggregating_bidaily_4chan_scrapes.ipynb ├── BreitbartEDA.ipynb ├── CleanText.ipynb ├── D4D DBPedia.ipynb ├── Daily Stormer Exploratory Preprocessing.ipynb ├── Daily_Stormer_sqlite_to_postgres.ipynb ├── Hashtag Analysis.ipynb ├── IceRaids.ipynb ├── README.md ├── breitbart.Rmd ├── comm_detect │ ├── comm_detect_nmf.ipynb │ ├── maps │ │ ├── L.TileLayer.Zoomify.js │ │ ├── README.md │ │ ├── example.html │ │ ├── mapping_communities.ipynb │ │ └── maputils.jl │ ├── method_compare.ipynb │ ├── parse_py.ipynb │ ├── pre_process.ipynb │ ├── prelim_analysis.ipynb │ ├── pymoji │ │ ├── __init__.py │ │ └── codes.py │ └── readme.MD ├── eventador_demo.ipynb ├── eventador_simplegraph.ipynb ├── mexico_wall_part_1.ipynb ├── muslim-ban.ipynb ├── presidency_project.Rmd ├── tweets_nlp_experiment.ipynb ├── twitter-word2vec.ipynb ├── womens-march-tweets.ipynb ├── word2vecTrainingAttempt1 │ ├── pymoji │ │ ├── __init__.py │ │ └── codes.py │ └── tweetWord2VecTraini.py └── youtube_video_id_extraction.ipynb ├── issue-labels-explained.md ├── roles ├── project_ambassador.md ├── project_lead.md ├── project_librarian.md └── project_maintainer.md └── url-domain-extractor.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/README.md -------------------------------------------------------------------------------- /botguide.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/botguide.md -------------------------------------------------------------------------------- /community-guide.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/community-guide.md -------------------------------------------------------------------------------- /congress/congress/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /congress/congress/items.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/congress/congress/items.py -------------------------------------------------------------------------------- /congress/congress/pipelines.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/congress/congress/pipelines.py -------------------------------------------------------------------------------- /congress/congress/settings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/congress/congress/settings.py -------------------------------------------------------------------------------- /congress/congress/spiders/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/congress/congress/spiders/__init__.py -------------------------------------------------------------------------------- /congress/congress/spiders/congress.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/congress/congress/spiders/congress.py -------------------------------------------------------------------------------- /congress/congress/spiders/example.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/congress/congress/spiders/example.py -------------------------------------------------------------------------------- /congress/scrapy.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/congress/scrapy.cfg -------------------------------------------------------------------------------- /data/congressional-record.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/data/congressional-record.md -------------------------------------------------------------------------------- /data/discursive.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/data/discursive.md -------------------------------------------------------------------------------- /data/how_to_submit_dataset.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/data/how_to_submit_dataset.md -------------------------------------------------------------------------------- /data/info_source.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/data/info_source.md -------------------------------------------------------------------------------- /data/oathkeepers.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/data/oathkeepers.md -------------------------------------------------------------------------------- /design_doc.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/design_doc.png -------------------------------------------------------------------------------- /domain-extractor-2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/domain-extractor-2.py -------------------------------------------------------------------------------- /eventador/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/eventador/README.md -------------------------------------------------------------------------------- /eventador/pipelines/sentiment_analysis.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/eventador/pipelines/sentiment_analysis.md -------------------------------------------------------------------------------- /exploratory_notebooks/4_chan.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/4_chan.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/4chan_Link_Extraction.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/4chan_Link_Extraction.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/4chan_sample_thread_exploration.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/4chan_sample_thread_exploration.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/8ch.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/8ch.Rmd -------------------------------------------------------------------------------- /exploratory_notebooks/Aggregating_bidaily_4chan_scrapes.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/Aggregating_bidaily_4chan_scrapes.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/BreitbartEDA.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/BreitbartEDA.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/CleanText.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/CleanText.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/D4D DBPedia.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/D4D DBPedia.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/Daily Stormer Exploratory Preprocessing.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/Daily Stormer Exploratory Preprocessing.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/Daily_Stormer_sqlite_to_postgres.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/Daily_Stormer_sqlite_to_postgres.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/Hashtag Analysis.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/Hashtag Analysis.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/IceRaids.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/IceRaids.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/README.md -------------------------------------------------------------------------------- /exploratory_notebooks/breitbart.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/breitbart.Rmd -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/comm_detect_nmf.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/comm_detect_nmf.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/maps/L.TileLayer.Zoomify.js: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/maps/L.TileLayer.Zoomify.js -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/maps/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/maps/README.md -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/maps/example.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/maps/example.html -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/maps/mapping_communities.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/maps/mapping_communities.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/maps/maputils.jl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/maps/maputils.jl -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/method_compare.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/method_compare.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/parse_py.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/parse_py.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/pre_process.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/pre_process.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/prelim_analysis.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/prelim_analysis.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/pymoji/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/pymoji/__init__.py -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/pymoji/codes.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/pymoji/codes.py -------------------------------------------------------------------------------- /exploratory_notebooks/comm_detect/readme.MD: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/comm_detect/readme.MD -------------------------------------------------------------------------------- /exploratory_notebooks/eventador_demo.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/eventador_demo.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/eventador_simplegraph.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/eventador_simplegraph.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/mexico_wall_part_1.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/mexico_wall_part_1.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/muslim-ban.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/muslim-ban.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/presidency_project.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/presidency_project.Rmd -------------------------------------------------------------------------------- /exploratory_notebooks/tweets_nlp_experiment.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/tweets_nlp_experiment.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/twitter-word2vec.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/twitter-word2vec.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/womens-march-tweets.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/womens-march-tweets.ipynb -------------------------------------------------------------------------------- /exploratory_notebooks/word2vecTrainingAttempt1/pymoji/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/word2vecTrainingAttempt1/pymoji/__init__.py -------------------------------------------------------------------------------- /exploratory_notebooks/word2vecTrainingAttempt1/pymoji/codes.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/word2vecTrainingAttempt1/pymoji/codes.py -------------------------------------------------------------------------------- /exploratory_notebooks/word2vecTrainingAttempt1/tweetWord2VecTraini.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/word2vecTrainingAttempt1/tweetWord2VecTraini.py -------------------------------------------------------------------------------- /exploratory_notebooks/youtube_video_id_extraction.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/exploratory_notebooks/youtube_video_id_extraction.ipynb -------------------------------------------------------------------------------- /issue-labels-explained.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/issue-labels-explained.md -------------------------------------------------------------------------------- /roles/project_ambassador.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/roles/project_ambassador.md -------------------------------------------------------------------------------- /roles/project_lead.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/roles/project_lead.md -------------------------------------------------------------------------------- /roles/project_librarian.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/roles/project_librarian.md -------------------------------------------------------------------------------- /roles/project_maintainer.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/roles/project_maintainer.md -------------------------------------------------------------------------------- /url-domain-extractor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Data4Democracy/assemble/HEAD/url-domain-extractor.py --------------------------------------------------------------------------------