├── .gitattributes ├── .gitignore ├── LICENSE.md ├── README.md ├── code_parts ├── .RData ├── bash_scan_ftp.sh ├── calc_ftp_dirs_size.R ├── curl_scan_ftp.R ├── dates_test.R ├── debug_find_xml_file_and_apply_path.R ├── ltpp.sh ├── parsed_data_checks.R ├── parser_ftp_contracts_part.R ├── run_bash_from_R.R ├── svg_to_png.R ├── temp_data_codebook.R └── write_scan_bash.R ├── data ├── README.txt ├── parser_html_URL_params.csv └── reference │ ├── df_OKPD2_2dig.csv │ ├── df_all_OKPD2.csv │ ├── df_all_orgs.csv │ ├── df_all_orgs_long_lat.csv │ ├── df_regions_codes.csv │ ├── df_xml_patterns.csv │ ├── dt_all_post_addr_participants.csv │ ├── dt_procedure_types.csv │ ├── dt_responsibleRoleEPType.csv │ ├── dt_restrictions.csv │ ├── regions_list.txt │ ├── Все+справочники+по+ЭП_v42+(10.3)+(Добавлен+ЭОК).xlsx │ ├── Все+справочники+по+ЭП_v42.5+(10.3).xlsx │ ├── КООРДИНАТЫ_КОМПАНИЙ.xlsx │ └── Справочники по ЭП.xlsx ├── doc ├── CodeBook.Rmd ├── README.md ├── parser-ftp-fz44_Load-Data-Manual.Rmd ├── parser-ftp-fz44_Load-Data-Manual.md ├── pic │ ├── rep_folders_p1.png │ ├── rep_folders_p1.svg │ ├── rep_folders_p2.png │ └── rep_folders_p2.svg ├── preamble.tex └── word_styles.docx ├── filenames_description.md ├── functions ├── uf_convert_char_to_date.R ├── uf_count_nas_in_table.R ├── uf_format_address_for_OSM.R ├── uf_get_coords_Yandex.R ├── uf_get_os.R ├── uf_make_colnames_from_xpath.R ├── uf_make_file_index_for_proc.R ├── uf_make_regex_from_year_mon.R ├── uf_nominatim_OSM.R ├── uf_normalise_table.R ├── uf_parse_xmls_with_prefix.R ├── uf_process_addresses_to_coords.R ├── uf_process_large_table_normalising.R ├── uf_read_table_with_metadata.R ├── uf_write_table_with_metadata.R └── uf_write_to_log.R ├── index_page_app ├── index_page_app.R └── setup_namespace.R ├── parser-ftp-01_Setup-fz44.R ├── parser-ftp-02_Load-Unzip-and-Index-fz44.R ├── parser-ftp-03_Parse-Loaded-XML-fz44.R ├── parser-ftp-04_Prepare-Data-for-Models.R ├── parser-ftp-04_Prepare-Data-for-Models_2.R ├── parser-ftp-04_Prepare-Data-for-Models_old.R ├── scanner_app ├── bash_scan_ftp.sh ├── du.txt ├── server.R └── ui.R ├── steps_of_analysis.R └── tables_decription.Rmd /.gitattributes: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/.gitattributes -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/LICENSE.md -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/README.md -------------------------------------------------------------------------------- /code_parts/.RData: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/.RData -------------------------------------------------------------------------------- /code_parts/bash_scan_ftp.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/bash_scan_ftp.sh -------------------------------------------------------------------------------- /code_parts/calc_ftp_dirs_size.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/calc_ftp_dirs_size.R -------------------------------------------------------------------------------- /code_parts/curl_scan_ftp.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/curl_scan_ftp.R -------------------------------------------------------------------------------- /code_parts/dates_test.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/dates_test.R -------------------------------------------------------------------------------- /code_parts/debug_find_xml_file_and_apply_path.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/debug_find_xml_file_and_apply_path.R -------------------------------------------------------------------------------- /code_parts/ltpp.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/ltpp.sh -------------------------------------------------------------------------------- /code_parts/parsed_data_checks.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/parsed_data_checks.R -------------------------------------------------------------------------------- /code_parts/parser_ftp_contracts_part.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/parser_ftp_contracts_part.R -------------------------------------------------------------------------------- /code_parts/run_bash_from_R.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/run_bash_from_R.R -------------------------------------------------------------------------------- /code_parts/svg_to_png.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/svg_to_png.R -------------------------------------------------------------------------------- /code_parts/temp_data_codebook.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/temp_data_codebook.R -------------------------------------------------------------------------------- /code_parts/write_scan_bash.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/code_parts/write_scan_bash.R -------------------------------------------------------------------------------- /data/README.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/README.txt -------------------------------------------------------------------------------- /data/parser_html_URL_params.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/parser_html_URL_params.csv -------------------------------------------------------------------------------- /data/reference/df_OKPD2_2dig.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/df_OKPD2_2dig.csv -------------------------------------------------------------------------------- /data/reference/df_all_OKPD2.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/df_all_OKPD2.csv -------------------------------------------------------------------------------- /data/reference/df_all_orgs.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/df_all_orgs.csv -------------------------------------------------------------------------------- /data/reference/df_all_orgs_long_lat.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/df_all_orgs_long_lat.csv -------------------------------------------------------------------------------- /data/reference/df_regions_codes.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/df_regions_codes.csv -------------------------------------------------------------------------------- /data/reference/df_xml_patterns.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/df_xml_patterns.csv -------------------------------------------------------------------------------- /data/reference/dt_all_post_addr_participants.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/dt_all_post_addr_participants.csv -------------------------------------------------------------------------------- /data/reference/dt_procedure_types.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/dt_procedure_types.csv -------------------------------------------------------------------------------- /data/reference/dt_responsibleRoleEPType.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/dt_responsibleRoleEPType.csv -------------------------------------------------------------------------------- /data/reference/dt_restrictions.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/dt_restrictions.csv -------------------------------------------------------------------------------- /data/reference/regions_list.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/regions_list.txt -------------------------------------------------------------------------------- /data/reference/Все+справочники+по+ЭП_v42+(10.3)+(Добавлен+ЭОК).xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/Все+справочники+по+ЭП_v42+(10.3)+(Добавлен+ЭОК).xlsx -------------------------------------------------------------------------------- /data/reference/Все+справочники+по+ЭП_v42.5+(10.3).xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/Все+справочники+по+ЭП_v42.5+(10.3).xlsx -------------------------------------------------------------------------------- /data/reference/КООРДИНАТЫ_КОМПАНИЙ.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/КООРДИНАТЫ_КОМПАНИЙ.xlsx -------------------------------------------------------------------------------- /data/reference/Справочники по ЭП.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/data/reference/Справочники по ЭП.xlsx -------------------------------------------------------------------------------- /doc/CodeBook.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/CodeBook.Rmd -------------------------------------------------------------------------------- /doc/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/README.md -------------------------------------------------------------------------------- /doc/parser-ftp-fz44_Load-Data-Manual.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/parser-ftp-fz44_Load-Data-Manual.Rmd -------------------------------------------------------------------------------- /doc/parser-ftp-fz44_Load-Data-Manual.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/parser-ftp-fz44_Load-Data-Manual.md -------------------------------------------------------------------------------- /doc/pic/rep_folders_p1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/pic/rep_folders_p1.png -------------------------------------------------------------------------------- /doc/pic/rep_folders_p1.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/pic/rep_folders_p1.svg -------------------------------------------------------------------------------- /doc/pic/rep_folders_p2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/pic/rep_folders_p2.png -------------------------------------------------------------------------------- /doc/pic/rep_folders_p2.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/pic/rep_folders_p2.svg -------------------------------------------------------------------------------- /doc/preamble.tex: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/preamble.tex -------------------------------------------------------------------------------- /doc/word_styles.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/doc/word_styles.docx -------------------------------------------------------------------------------- /filenames_description.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/filenames_description.md -------------------------------------------------------------------------------- /functions/uf_convert_char_to_date.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_convert_char_to_date.R -------------------------------------------------------------------------------- /functions/uf_count_nas_in_table.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_count_nas_in_table.R -------------------------------------------------------------------------------- /functions/uf_format_address_for_OSM.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_format_address_for_OSM.R -------------------------------------------------------------------------------- /functions/uf_get_coords_Yandex.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_get_coords_Yandex.R -------------------------------------------------------------------------------- /functions/uf_get_os.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_get_os.R -------------------------------------------------------------------------------- /functions/uf_make_colnames_from_xpath.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_make_colnames_from_xpath.R -------------------------------------------------------------------------------- /functions/uf_make_file_index_for_proc.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_make_file_index_for_proc.R -------------------------------------------------------------------------------- /functions/uf_make_regex_from_year_mon.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_make_regex_from_year_mon.R -------------------------------------------------------------------------------- /functions/uf_nominatim_OSM.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_nominatim_OSM.R -------------------------------------------------------------------------------- /functions/uf_normalise_table.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_normalise_table.R -------------------------------------------------------------------------------- /functions/uf_parse_xmls_with_prefix.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_parse_xmls_with_prefix.R -------------------------------------------------------------------------------- /functions/uf_process_addresses_to_coords.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_process_addresses_to_coords.R -------------------------------------------------------------------------------- /functions/uf_process_large_table_normalising.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_process_large_table_normalising.R -------------------------------------------------------------------------------- /functions/uf_read_table_with_metadata.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_read_table_with_metadata.R -------------------------------------------------------------------------------- /functions/uf_write_table_with_metadata.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_write_table_with_metadata.R -------------------------------------------------------------------------------- /functions/uf_write_to_log.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/functions/uf_write_to_log.R -------------------------------------------------------------------------------- /index_page_app/index_page_app.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/index_page_app/index_page_app.R -------------------------------------------------------------------------------- /index_page_app/setup_namespace.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/index_page_app/setup_namespace.R -------------------------------------------------------------------------------- /parser-ftp-01_Setup-fz44.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/parser-ftp-01_Setup-fz44.R -------------------------------------------------------------------------------- /parser-ftp-02_Load-Unzip-and-Index-fz44.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/parser-ftp-02_Load-Unzip-and-Index-fz44.R -------------------------------------------------------------------------------- /parser-ftp-03_Parse-Loaded-XML-fz44.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/parser-ftp-03_Parse-Loaded-XML-fz44.R -------------------------------------------------------------------------------- /parser-ftp-04_Prepare-Data-for-Models.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/parser-ftp-04_Prepare-Data-for-Models.R -------------------------------------------------------------------------------- /parser-ftp-04_Prepare-Data-for-Models_2.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/parser-ftp-04_Prepare-Data-for-Models_2.R -------------------------------------------------------------------------------- /parser-ftp-04_Prepare-Data-for-Models_old.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/parser-ftp-04_Prepare-Data-for-Models_old.R -------------------------------------------------------------------------------- /scanner_app/bash_scan_ftp.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/scanner_app/bash_scan_ftp.sh -------------------------------------------------------------------------------- /scanner_app/du.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/scanner_app/du.txt -------------------------------------------------------------------------------- /scanner_app/server.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/scanner_app/server.R -------------------------------------------------------------------------------- /scanner_app/ui.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/scanner_app/ui.R -------------------------------------------------------------------------------- /steps_of_analysis.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/steps_of_analysis.R -------------------------------------------------------------------------------- /tables_decription.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aksyuk/zakupki_gov_ru/HEAD/tables_decription.Rmd --------------------------------------------------------------------------------