├── Data ├── Data Sources.csv ├── census.csv └── state open datasets - Sheet1.tsv └── README.md /Data/Data Sources.csv: -------------------------------------------------------------------------------- 1 | ,Companies,Incarceration,State-Owned Real Estate,Checkbook,Address Points,Legislative Data,Restaurant Inspections,Population Projections,Vehicle Crashes 2 | Alabama,,,,http://open.alabama.gov/spending_checkbook.aspx,,,,, 3 | Alaska,,,,http://doa.alaska.gov/dof/reports/ckbkonline.html,,,,, 4 | Arizona,http://www.azcc.gov/Divisions/Corporations/faq.asp#computer5,https://corrections.az.gov/reports-documents/statistics,no,http://www.azcheckbook.com/,no,no,no,https://population.az.gov/,http://azdot.gov/mvd/Statistics/arizona-motor-vehicle-crash-facts 5 | Arkansas,https://www.commerce.state.ak.us/CBP/Main/,,,http://transparency.arkansas.gov/Pages/default.aspx,http://gis.arkansas.gov/?product=situs-address-points,,,, 6 | California,http://kepler.sos.ca.gov/,http://www.cdcr.ca.gov/Reports_Research/Offender_Information_Services_Branch/Offender_Information_Reports.html,http://www.spi.dgs.ca.gov/wscripts/spi.asp?action=Main,no,no,no,http://www.ca.gov/OnlineServices/OS_Consumers_inspections.html,http://www.dof.ca.gov/research/demographic/reports/projections/,http://www.ots.ca.gov/Media_and_Research/Data_and_Statistics.asp 7 | Colorado,,,,https://www.colorado.gov/apps/oit/transparency/index.html,,,,, 8 | Connecticut,,,,,,,,, 9 | Delaware,,,,http://checkbook.delaware.gov/,,,,, 10 | District of Columbia,,,,,https://github.com/openaddresses/openaddresses/blob/master/sources/us-dc.json,,,, 11 | Florida,http://www.sunbiz.org/,http://www.dc.state.fl.us/pub/,http://www.dms.myflorida.com/business_operations/real_estate_development_and_management/facilities_management/florida_state_owned_lands_and_records_information_system_fl_solaris,http://flair.dbf.state.fl.us/dispub2/newvpymt4.shtml,no,no,http://www.floridahealth.gov///statistics-and-data/eh-tracking-and-reporting/food-hygiene.html,http://edr.state.fl.us/Content/population-demographics/data/,http://www.flhsmv.gov/resource-center/crash-citation-reports/ 12 | Georgia,http://gta.georgia.gov/bulk-corporations-data,no,http://gspc.georgia.gov/,http://www.open.georgia.gov/psa/poSearch.aud,no,no,https://dph.georgia.gov/environmental-health-inspections,https://opb.georgia.gov/population-projections,http://www.gahighwaysafety.org/research/ 13 | Guam,,,,,,,,, 14 | Hawaii,,,,,,,,, 15 | Idaho,,,,,,,,, 16 | Illinois,http://www.cyberdriveillinois.com/departments/business_services/home.html,http://www2.illinois.gov/idoc/reportsandstatistics/Pages/default.aspx,no,http://ledger.illinoiscomptroller.com/,no,no,no,https://data.illinois.gov/Economics/DCEO-County-Population-Projections/h3bx-hbbh,http://www.idot.illinois.gov/transportation-system/safety/Illinois-Roadway-Crash-Data 17 | Indiana,http://www.in.gov/sos/business/2439.htm,,,,http://maps.indiana.edu/metadata/Infrastructure/Streets_Address_Points_IDHS.html,,,, 18 | Iowa,,,,http://checkbook.iowa.gov/,,,,, 19 | Kansas,,,,http://www.kansas.gov/KanView/,,,,, 20 | Kentucky,http://www.sos.ky.gov/bus/Pages/Bulk-Data-Service.aspx,,,,,,,, 21 | Louisiana,,,,http://doa.louisiana.gov/latrac/home.cfm,,,,, 22 | Maine,http://www.maine.gov/sos/cec/corp/miscellaneous.html,,,http://opencheckbook.maine.gov/transparency/,https://github.com/openaddresses/openaddresses/blob/master/sources/us-me.json,,,, 23 | Maryland,,,,,https://www.arcgis.com/home/item.html?id=20878dd2c20949a8a14a5a282ab98807,,,, 24 | Massachusetts,,,,http://www.mass.gov/opencheckbook,,,,, 25 | Michigan,http://www.dleg.state.mi.us/bcs_corp/sr_corp.asp,"https://www.michigan.gov/corrections/0,4551,7-119-1441---,00.html",no,http://media.state.mi.us/MiTransparency,no,no,no,"http://www.michigan.gov/cgi/0,4548,7-158-54534_51713_51716---,00.html",http://www.michigantrafficcrashfacts.org/ 26 | Minnesota,,,,http://warehouse.swift.state.mn.us/analytics/saw.dll?dashboard&PortalPath=%2Fshared%2FCitizens%20Portal%2F_portal%2FPaymentsCitizensPortalPublicEntry,,,,, 27 | Mississippi,,,,,,,,, 28 | Missouri,,,,http://mapyourtaxes.mo.gov/MAP/Download/Default.aspx,,,,, 29 | Montana,,,,http://checkbook.mt.gov/,http://geoinfo.msl.mt.gov/home/msdi/structures_and_addresses.aspx,,,, 30 | Nebraska,,,,http://www.statespending.nebraska.gov/,,,,, 31 | Nevada,,,,,,,,, 32 | New Hampshire,,,,,,,,, 33 | New Jersey,https://www.njportal.com/dor/businessrecords/,http://www.state.nj.us/corrections/pages/offender_stats.html,no,http://www.yourmoney.nj.gov/transparency/expenditures/,no,http://www.njleg.state.nj.us/downloads.asp,no,http://lwd.dol.state.nj.us/labor/lpa/dmograph/lfproj/lfproj_index.html,http://www.state.nj.us/transportation/refdata/accident/ 34 | New Mexico,,,,http://www.sunshineportalnm.com/sample/#section=Purchases,,,,, 35 | New York,http://www.dos.ny.gov/corps/bus_entity_search.html,http://www.criminaljustice.ny.gov/opca/statistics.htm,http://www.tax.ny.gov/research/property/valuation/sol/index.htm,http://www.openbooknewyork.com/,http://gisservices.dhses.ny.gov/arcgis/rest/services/SAM_Address_Points/MapServer/1,http://www.nysenate.gov/open,https://health.data.ny.gov/Health/Food-Service-Establishment-Last-Inspection/cnih-y5dw,http://labor.ny.gov/stats/nys/statewide-population-data.shtm,http://dmv.ny.gov/org/about-dmv/statistical-summaries 36 | North Carolina,http://www.secretary.state.nc.us/corporations/,http://webapps6.doc.state.nc.us/apps/asqExt/ASQ,http://www.ncspo.com/fis/,http://www.ncopenbook.gov/,http://data.nconemap.com/geoportal/catalog/search/resource/details.page?uuid=%7B9E039D56-5202-43E7-8D36-D09414C0DBD6%7D,no,no,http://www.osbm.state.nc.us/ncosbm/facts_and_figures/socioeconomic_data/population_estimates.shtm,http://nccrashdata.hsrc.unc.edu/ 37 | North Dakota,,,,,,,,, 38 | Ohio,http://www.sos.state.oh.us/SOS/Businesses.aspx,http://www.drc.ohio.gov/web/reports/reports.htm,no,http://tos.ohio.gov/transparency/ohios-online-checkbook,no,http://gis3.oit.ohio.gov/geodatadownload/lbrs.aspx,no,http://development.ohio.gov/reports/reports_pop_proj_map.htm,https://ext.dps.state.oh.us/crashstatistics/crashreports.aspx 39 | Oklahoma,,,,https://okreporting.ok.gov/analytics/saw.dll?Dashboard&PortalPath=/shared/Treasurer/_portal/Checkbook&Page=Checkbook&NQUser=HR83Ty4j&NQPassword=9OmY3m!q,,,,, 40 | Oregon,,,,,,,,, 41 | Pennsylvania,http://www.dos.pa.gov/BusinessCharities/Business/Pages/default.aspx,http://www.portal.state.pa.us/portal/server.pt/community/statistics/5393/corrections_statistics/494658,https://www.portal.state.pa.us/portal/server.pt/community/real_estate/1346,http://www.pennwatch.pa.gov/spending/,no,can’t find; OS says yes,http://www.agriculture.state.pa.us/portal/server.pt/gateway/PTARGS_0_2_75292_10297_0_43/AgWebsite/ProgramDetail.aspx?name=Food-Safety-Inspection-Results&navid=12&parentnavid=0&palid=54&,http://pasdc.hbg.psu.edu/Data/Projections/tabid/1013/Default.aspx,http://www.dot.state.pa.us/Internet/Bureaus/pdBHSTE.nsf/InfoFbListing?OpenForm 42 | Puerto Rico,,,,,,,,, 43 | Rhode Island,,,,http://www.ri.gov/opengovernment/,http://www.edc.uri.edu/rigis/data/data.aspx?ISO=structure,,,, 44 | South Carolina,,,,https://ssl.sc.gov/SpendingTransparency/MonthlyExpenditureMain.aspx,,,,, 45 | South Dakota,,,,http://www.open.sd.gov/,http://arcgis.sd.gov/arcgis/rest/services/BIT/AddressViewer/MapServer/0,,,, 46 | Tennessee,,,,https://og.edison.tn.gov/,,,,, 47 | Texas,https://direct.sos.state.tx.us/help/help-corp.asp?pg=bulk,no,http://www.glo.texas.gov/,http://www.texastransparency.org/State_Finance/Spending/,no,http://www.legis.state.tx.us/billlookup/filedownloads.aspx,no,http://txsdc.utsa.edu/data/TPEPP/Projections/Index.aspx,http://www.txdot.gov/government/enforcement/annual-summary.html 48 | Utah,,,,http://www.utah.gov/transparency/,https://github.com/openaddresses/openaddresses/blob/master/sources/us-ut.json,,,, 49 | Vermont,,,,http://spotlight.vermont.gov/expenditures,http://vcgi.vermont.gov/warehouse/theme_index,,,, 50 | Virginia,http://www.scc.virginia.gov/clk/purch.aspx,http://vadoc.virginia.gov/about/facts/,http://dgs.virginia.gov/DivisionofRealEstateServices/StateOwnedRealEstate/tabid/1524/Default.aspx,http://datapoint.apa.virginia.gov/exp/exp_checkbook.cfm,http://vgin.maps.arcgis.com/home/item.html?id=100e5e12ddc14748a5ec3b8b997af13a,http://lis.virginia.gov/SiteInformation/ftp.html,http://www.healthspace.com/Clients/VDH/VDH_Website.nsf,http://www.coopercenter.org/demographics/virginia-population-projections,http://www.dmv.virginia.gov/safety/crash_data/ 51 | Washington,https://www.sos.wa.gov/corps/AllData.aspx,http://www.doc.wa.gov/aboutdoc/statistics.asp,http://www.ofm.wa.gov/budget/facilities/fis.asp,http://fiscal.wa.gov/Checkbook.aspx,no,http://wslwebservices.leg.wa.gov/,no,http://www.ofm.wa.gov/Pop/stfc/default.asp,http://wtsc.wa.gov/research-data/crash-data/ 52 | West Virginia,https://apps.wv.gov/SOS/BusinessEntity/,,,http://www.transparencywv.org/,,,,, 53 | Wisconsin,,,,http://www.openbook.wi.gov/,,,,, 54 | Wyoming,,,,http://sao.state.wy.us/EFT_PAYMTS/EFT_Search_Page.aspx,,,,, -------------------------------------------------------------------------------- /Data/census.csv: -------------------------------------------------------------------------------- 1 | State,Dataset,URL,exist,exist comments,digital,digital comments,public,public comments,free,free comments,online,online comments,machine-readable,machine-readable comments,bulk,bulk comments,license,license comments,up-to-date,up-to-date comments,in repo,in repo comments,verifiable,verifiable comments,complete,complete comments,comments 2 | Arizona,Companies,http://www.azcc.gov/Divisions/Corporations/faq.asp#computer5,1,,1,,1,,0,"HTML version is free. Actual data costs $1,000. http://www.azcc.gov/Divisions/Corporations/faq.asp#computer5",1,,1,"Only machine-readable if you pay $1,000. http://www.azcc.gov/Divisions/Corporations/faq.asp#computer5",1,"Bulk data exists, but it costs $1,000. http://www.azcc.gov/Divisions/Corporations/faq.asp#computer5",0,"No license is provided, but there’s not copyright statement in the footer.",1,,0,AZ has no repo.,0,,0,, 3 | Arizona,Incarceration,https://corrections.az.gov/reports-documents/statistics,,,,,,,,,,,,,,,,,,,0,AZ has no repo.,0,,,, 4 | Arizona,State-Owned Real Estate,no,0,,,,,,,,,,,,,,,,,,0,AZ has no repo.,0,,,, 5 | Arizona,Checkbook,http://www.azcheckbook.com/,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,AZ has no repo.,0,,0,, 6 | Arizona,Address Points,no,0,,,,,,,,,,,,,,,,,,0,AZ has no repo.,0,,,, 7 | Arizona,Legislative Data,,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,AZ has no repo.,0,,1,, 8 | Arizona,Restaurant Inspections,no,0,,,,,,,,,,,,,,,,,,0,AZ has no repo.,0,,,, 9 | Arizona,Population Projections,https://population.az.gov/,1,,1,,1,,1,,1,,1,Excel files.,1,,0,,1,,0,AZ has no repo.,0,,0,No GNIS IDs., 10 | Arizona,Vehicle Crashes,http://azdot.gov/mvd/Statistics/arizona-motor-vehicle-crash-facts,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,AZ has no repo.,0,,0,"These are statistics, not data.", 11 | California,Companies,http://kepler.sos.ca.gov/,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,1,,0,,0,Doesn’t list shares or officers., 12 | California,Incarceration,http://www.cdcr.ca.gov/Reports_Research/Offender_Information_Services_Branch/Offender_Information_Reports.html,,,,,,,,,,,,,,,0,Copyright statement in footer.,1,Last updated 32 days ago.,0,,0,,1,, 13 | California,State-Owned Real Estate,http://www.spi.dgs.ca.gov/wscripts/spi.asp?action=Main,1,,1,,1,,1,,1,,0,,0,,,,,,,,,,,, 14 | California,Checkbook,no,0,,,,,,,,,,,,,,,,,,,,,,,, 15 | California,Address Points,no,0,,,,,,,,,,,,,,,,,,,,,,,, 16 | California,Legislative Data,ftp://www.leginfo.ca.gov/pub/,1,,1,,1,,1,,1,,1,As SQL dumps and as TSV. See ftp://www.leginfo.ca.gov/pub/bill/pubinfo_Readme.pdf,1,,0,“Conditions of Use Policy” says that “some information may be protected by copyright.”,1,,0,,0,,1,, 17 | California,Restaurant Inspections,http://www.ca.gov/OnlineServices/OS_Consumers_inspections.html,0,They just link to some counties’ websites.,,,,,,,,,,,,,,,,,,,,,,, 18 | California,Population Projections,http://www.dof.ca.gov/research/demographic/reports/projections/,1,,1,,1,,1,,1,,1,Excel files,1,,0,Copyright statement in footer.,1,,0,,0,,1,, 19 | California,Vehicle Crashes,http://www.ots.ca.gov/Media_and_Research/Data_and_Statistics.asp,1,,1,,1,,1,,1,,1,Excel files,1,,0,Copyright statement in footer.,0,Most recent data is from 2012.,1,,0,,0,"These are statistics, not data.", 20 | Florida,Companies,http://www.sunbiz.org/,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,FL has no repo.,0,,1,, 21 | Florida,Incarceration,http://www.dc.state.fl.us/pub/,,,,,,,,,,,,,,,,,,,0,FL has no repo.,,,,, 22 | Florida,State-Owned Real Estate,http://www.dms.myflorida.com/business_operations/real_estate_development_and_management/facilities_management/florida_state_owned_lands_and_records_information_system_fl_solaris,1,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,0,"Data is from 2013, while other data on the site is updated constantly.",0,FL has no repo.,0,,1,, 23 | Florida,Checkbook,http://flair.dbf.state.fl.us/dispub2/newvpymt4.shtml,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,FL has no repo.,0,,0,No expense category., 24 | Florida,Address Points,no,0,,,,,,,,,,,,,,,,,,0,FL has no repo.,,,,, 25 | Florida,Legislative Data,http://www.leg.state.fl.us/,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,FL has no repo.,0,,1,, 26 | Florida,Restaurant Inspections,http://www.floridahealth.gov///statistics-and-data/eh-tracking-and-reporting/food-hygiene.html,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,FL has no repo.,0,,1,, 27 | Florida,Population Projections,http://edr.state.fl.us/Content/population-demographics/data/,1,,1,,1,,1,,1,,0,PDF.,0,,0,Copyright statement in footer.,1,,0,FL has no repo.,0,,0,No GNIS IDs., 28 | Florida,Vehicle Crashes,http://www.flhsmv.gov/resource-center/crash-citation-reports/,1,,1,,1,,1,,1,,0,PDF,0,,0,"Copyright statement in footer says the data is owned by “Appriss, Inc.”",0,,0,FL has no repo.,0,,0,"These are statistics, not data.", 29 | Georgia,Companies,http://gta.georgia.gov/bulk-corporations-data,1,,1,,1,,0,"Viewing information in HTML is free, but the data is sold for $1,000.",1,,1,"Pipe-delimited text is available, but the data must be bought in bulk for $1,000.",1,"Bulk data is sold for $1,000.",0,Site is silent on copyright and license.,1,,0,GA has no repo.,1,Site uses SSL.,1,, 30 | Georgia,Incarceration,no,0,,,,,,,,,,,,,,,,,,0,GA has no repo.,,,,, 31 | Georgia,State-Owned Real Estate,http://gspc.georgia.gov/,1,,1,,1,,1,,1,,0,"Core data as HTML, detailed data as PDFs.",0,,0,Site is silent on copyright and license.,1,,0,GA has no repo.,1,Site uses SSL.,0,No consistent location identifiers., 32 | Georgia,Checkbook,http://www.open.georgia.gov/psa/poSearch.aud,1,,1,,1,,1,,1,,1,Query results can be exported as CSV.,0,,0,Footer says data is copyright “DOAA.”,0,"Transactions have no date, so it’s impossible to know.",0,GA has no repo.,0,,0,"Lacks date, check number, and expense category.", 33 | Georgia,Address Points,no,0,,,,,,,,,,,,,,,,,,0,GA has no repo.,,,,, 34 | Georgia,Legislative Data,http://www.legis.ga.gov/,1,,1,,1,,1,,1,,0,,0,,0,Site is silent on copyright and license.,1,,0,GA has no repo.,0,,1,, 35 | Georgia,Restaurant Inspections,https://dph.georgia.gov/environmental-health-inspections,1,,1,,1,,1,,1,,0,,0,,0,Site is silent on copyright and license.,1,,0,GA has no repo.,0,,0,Not all counties’ data is available., 36 | Georgia,Population Projections,https://opb.georgia.gov/population-projections,1,,1,,1,,1,,0,Data is obtained by e-mailing a PDF request form. I have not attempted to request it.,,,0,,0,Site is silent on copyright and license.,1,,0,GA has no repo.,0,"Site uses SSL, but the data is provided by e-mail.",,, 37 | Georgia,Vehicle Crashes,http://www.gahighwaysafety.org/research/,1,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,1,,0,GA has no repo.,0,,0,"These are statistics, not data.", 38 | Illinois,Companies,http://www.cyberdriveillinois.com/departments/business_services/home.html,1,,1,,1,,1,,1,,0,,0,,0,Contains an explicit prohibition on “copying or downloading of the database information.”,1,,0,,0,,1,, 39 | Illinois,Incarceration,http://www2.illinois.gov/idoc/reportsandstatistics/Pages/default.aspx,1,,1,,1,,1,,1,,0,"PDF, containing screenshots from Excel.",0,,0,Site is silent on copyright and license.,0,Most recent data is from 2013.,0,,0,,0,Does not indicate facilities’ capacity or population change over time., 40 | Illinois,State-Owned Real Estate,no,0,,,,,,,,,,,,,,,,,,,,,,,, 41 | Illinois,Checkbook,http://www.accountability.illinois.gov/,1,"Confusing, there are two Illinois checkbook sites. The other one is at http://ledger.illinoiscomptroller.com/. We evaluated the “accountability” site, because it is better.",1,,1,,1,,0,,0,,0,,0,Copyright statement in footer.,,1,0,,0,,0,"Doesn't provide payment dates, check numbers, transaction dates, or a transaction description.", 42 | Illinois,Address Points,no,0,,,,,,,,,,,,,,,,,,,,,,,, 43 | Illinois,Legislative Data,no,1,,1,,1,,1,,1,,0,,0,,0,Site is silent on copyright and license.,1,,0,,0,,1,, 44 | Illinois,Restaurant Inspections,no,0,,,,,,,,,,,,,,,,,,,,,,,, 45 | Illinois,Population Projections,http://www2.illinoisbiz.biz/popProj/,1,,1,,1,,1,,1,,1,,1,,0,Site is silent on copyright and license.,0,Appears to be more than a decade old.,0,"There appears to be an entry for this in the repo, but it’s password-protected.",0,,0,No GNIS IDs., 46 | Illinois,Vehicle Crashes,http://www.idot.illinois.gov/transportation-system/safety/Illinois-Roadway-Crash-Data,1,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,1,,0,,0,,0,"These are statistics, not data.", 47 | Michigan,Companies,http://www.dleg.state.mi.us/bcs_corp/sr_corp.asp,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,,0,,1,, 48 | Michigan,Incarceration,"https://www.michigan.gov/corrections/0,4551,7-119-1441---,00.html",,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,1,,0,,1,Site uses SSL.,,Does not provide per-facility records., 49 | Michigan,State-Owned Real Estate,no,0,,,,,,,,,,,,,,,,,,,,,,,, 50 | Michigan,Checkbook,http://media.state.mi.us/MiTransparency,1,,1,,1,,1,,1,,0,Flash application.,0,,0,Copyright statement in footer.,0,Data is more than a month old.,0,,0,,0,Does not provide transaction-level data., 51 | Michigan,Address Points,no,0,,,,,,,,,,,,,,,,,,,,,,,, 52 | Michigan,Legislative Data,no,1,,1,,1,,1,,1,,0,,0,,0,AUP says that “users must respect the legal protection provided by copyright…to…data made available by The Services.”,1,,0,,0,,1,, 53 | Michigan,Restaurant Inspections,no,0,,,,,,,,,,,,,,,,,,,,,,,, 54 | Michigan,Population Projections,"http://www.michigan.gov/cgi/0,4548,7-158-54534_51713_51716-116118--,00.html",1,,1,,1,,1,,1,,1,Excel files.,1,,0,Copyright statement in footer.,0,Does not appear to have been updated for perhaps a decade.,0,,0,,0,Does not provide GNIS IDs., 55 | Michigan,Vehicle Crashes,http://www.michigantrafficcrashfacts.org/,1,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,1,,1,Maybe? See https://data.michigan.gov/dataset/MIAccidents/efay-8wge,,,,, 56 | New Jersey,Companies,https://www.njportal.com/dor/businessrecords/,1,,1,,1,,0,Records are $6.25 each.,1,,1,,0,Each record must be selected individually to be downloaded.,0,,1,,0,,1,Site uses SSL.,,Have not purchased data to verify., 57 | New Jersey,Incarceration,http://www.state.nj.us/corrections/pages/offender_stats.html,1,,1,,1,,1,,1,,0,PDF generated from Excel.,0,,0,Copyright statement in footer.,1,,0,,0,,0,Does not indicate facilities’ capacity or population change over time., 58 | New Jersey,State-Owned Real Estate,no,0,,,,,,,,,,,,,,,,,,,,,,,, 59 | New Jersey,Checkbook,http://www.yourmoney.nj.gov/transparency/expenditures/,1,,1,,1,,1,,1,,1,,1,If exported from portal.,0,Copyright statement in footer.,,,1,,1,Repo uses SSL.,1,, 60 | New Jersey,Address Points,no,0,,,,,,,,,,,,,,,,,,,,,,,, 61 | New Jersey,Legislative Data,http://www.njleg.state.nj.us/downloads.asp,1,,1,,1,,1,,1,,1,As a Microsoft Access database.,1,,0,Copyright statement in footer.,1,,0,,0,,1,, 62 | New Jersey,Restaurant Inspections,no,0,,,,,,,,,,,,,,,,,,,,,,,, 63 | New Jersey,Population Projections,http://lwd.dol.state.nj.us/labor/lpa/dmograph/lfproj/lfproj_index.html,1,,1,,1,,1,,1,,1,Excel files.,1,,0,Copyright statement in footer.,0,Last updated perhaps five years ago.,,repo down at the moment,0,,0,Does not provide GNIS IDs., 64 | New Jersey,Vehicle Crashes,http://www.state.nj.us/transportation/refdata/accident/,1,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,0,Last updated two years ago.,,repo down at the moment,0,,0,"These are statistics, not data.", 65 | New York,Companies,https://data.ny.gov/Economic-Development/Active-Corporations-Beginning-1800/n9v6-gdp6,1,,1,,1,,1,,1,,1,,1,If exported from portal.,0,"Complicated, restrictive TOS.",0,,1,,1,Repo uses SSL.,0,"Corporation status, state formed, officers, and shares are not provided. Because this includes corporate records back to 1800, the lack of a status is especially problematic.", 66 | New York,Incarceration,https://data.ny.gov/Public-Safety/Inmates-Under-Custody-Beginning-2008/55zc-sp6m,1,,1,,1,,1,,1,,1,,1,If exported from portal.,0,"Complicated, restrictive TOS.",0,Last updated four months ago.,1,,1,Repo uses SSL.,0,"This is raw data, not aggregated in any way. It would be challenging to generate conformant records from this data.", 67 | New York,State-Owned Real Estate,http://www.tax.ny.gov/research/property/valuation/sol/index.htm,1,,0,,,,,,,,,,,,,,,,,,,,,, 68 | New York,Checkbook,http://www.openbooknewyork.com/,1,,1,,1,,1,,1,,1,,1,If exported.,0,Copyright statement in footer.,1,,1,,0,,0,Does not provide transaction-level data., 69 | New York,Address Points,http://gisservices.dhses.ny.gov/arcgis/rest/services/SAM_Address_Points/MapServer/1,1,,1,,1,,1,,1,,1,,1,https://data.cityofnewyork.us/City-Government/NYC-Address-Points/4iq4-tuhq,0,Not specified.,1,,1,,1,Repo uses SSL.,1,, 70 | New York,Legislative Data,http://www.nysenate.gov/open,,,,,,,,,,,,,,,,,,,,,,,,,There is no one legislative site. Not sure how to handle this. 71 | New York,Restaurant Inspections,https://health.data.ny.gov/Health/Food-Service-Establishment-Last-Inspection/cnih-y5dw,1,,1,,1,,1,,1,,1,,1,If exported.,0,"Complicated, restrictive TOS.",0,Most recent data is from two months ago.,1,,1,Repo uses SSL.,1,, 72 | New York,Population Projections,http://pad.human.cornell.edu/counties/projections.cfm,1,,1,,1,,1,,1,,1,,1,,0,Not specified.,0,Appears to be about five years out of date (contains projections for the current year).,0,,0,,0,Does not provide GNIS IDs., 73 | New York,Vehicle Crashes,http://dmv.ny.gov/org/about-dmv/statistical-summaries,1,,1,,1,,1,,1,,1,,1,,0,"Complicated, restrictive TOS.",0,Most recent data is from 2012.,1,,1,,0,"It looks like it’s possible to assemble complete data, by downloading and combining multiple tables.", 74 | North Carolina,Companies,http://www.secretary.state.nc.us/corporations/,1,,1,,1,,1,,1,,0,,0,,0,Not specified.,1,,0,NC has no repo.,0,,0,, 75 | North Carolina,Incarceration,http://webapps6.doc.state.nc.us/apps/asqExt/ASQ,1,,1,,1,,1,,1,,0,,0,,0,Not specified.,1,,0,NC has no repo.,0,,0,Doesn't appear to provide per-facility data., 76 | North Carolina,State-Owned Real Estate,http://www.ncspo.com/fis/,1,,1,,1,,1,,1,,0,,0,,0,Not specified.,1,,0,NC has no repo.,0,,1,, 77 | North Carolina,Checkbook,http://www.ncopenbook.gov/,0,,,,,,,,,,,,,,,,,,0,NC has no repo.,,,,, 78 | North Carolina,Address Points,http://data.nconemap.com/geoportal/catalog/search/resource/details.page?uuid=%7B9E039D56-5202-43E7-8D36-D09414C0DBD6%7D,1,,1,,1,,1,,1,,1,,1,,0,Not specified.,1,,0,NC has no repo.,0,,1,, 79 | North Carolina,Legislative Data,no,0,,,,,,,,,,,,,,,,,,0,NC has no repo.,,,,, 80 | North Carolina,Restaurant Inspections,no,0,,,,,,,,,,,,,,,,,,0,NC has no repo.,,,,, 81 | North Carolina,Population Projections,http://www.osbm.state.nc.us/ncosbm/facts_and_figures/socioeconomic_data/population_estimates.shtm,1,,1,,1,,1,,1,,1,,1,,0,Not specified.,1,,0,NC has no repo.,0,,0,No GNIS IDs., 82 | North Carolina,Vehicle Crashes,http://nccrashdata.hsrc.unc.edu/,1,,1,,1,,1,,1,,1,,1,,0,Not specified.,1,,0,NC has no repo.,0,,0,"Uses a report-generation system to generate statistics, rather than publishing data.", 83 | Pennsylvania,Companies,http://www.dos.pa.gov/BusinessCharities/Business/Pages/default.aspx,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,PA has no repo.,0,,1,, 84 | Pennsylvania,Incarceration,http://www.portal.state.pa.us/portal/server.pt/community/statistics/5393/corrections_statistics/494658,,,,,,,,,,,,,,,,,,,0,PA has no repo.,,,,,Page was password-protected at the time of the census. 85 | Pennsylvania,State-Owned Real Estate,https://www.portal.state.pa.us/portal/server.pt/community/real_estate/1346,1,,1,,1,,1,,1,,0,Inventory is one big PDF file.,0,,0,Copyright statement in footer.,1,,0,PA has no repo.,0,,1,, 86 | Pennsylvania,Checkbook,http://www.pennwatch.pa.gov/spending/,1,,1,,1,,1,,1,,0,Data is within an iframe-nested Java applet.,0,,0,Copyright statement in footer.,1,1,0,PA has no repo.,0,,0,There is no check/voucher number or description., 87 | Pennsylvania,Address Points,no,0,,,,,,,,,,,,,,,,,,0,PA has no repo.,,,,, 88 | Pennsylvania,Legislative Data,can’t find; OS says yes,,,,,,,,,,,,,,,,,,,0,PA has no repo.,,,,, 89 | Pennsylvania,Restaurant Inspections,http://www.eatsafepa.com/,0,,,,,,,,,,,,,,,,,,0,PA has no repo.,,,,,A 2010 law requires that a central database of inspections be created. It has not been. 90 | Pennsylvania,Population Projections,http://pasdc.hbg.psu.edu/Data/Projections/tabid/1013/Default.aspx,1,,1,,1,,1,,1,,1,,1,,0,Copyright statement in footer.,0,"More than a decade out of date. Based on 2000 census data, and contains projections for 2010.",0,PA has no repo.,0,,0,Lacks GNIS IDs., 91 | Pennsylvania,Vehicle Crashes,http://www.dot.state.pa.us/Internet/Bureaus/pdBHSTE.nsf/InfoFbListing?OpenForm,1,,1,,1,,1,,1,,0,,0,,0,Not specified.,0,Most recent data is from 2013.,0,PA has no repo.,0,,0,"These are statistics, not data.", 92 | Texas,Companies,http://www.sos.state.tx.us/corp/sosda/index.shtml,1,,1,,1,,0,"$1/search, then fees for each document.",1,,0,,0,,0,Not specified.,,Unknown—the cost of running enough searches to find out could be prohibitive.,0,,0,,,Unknown., 93 | Texas,Incarceration,no,0,,,,,,,,,,,,,,,,,,,,,,,, 94 | Texas,State-Owned Real Estate,http://www.glo.texas.gov/what-we-do/state-lands/state-land-reports/index.html,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,,0,,1,, 95 | Texas,Checkbook,http://www.texastransparency.org/State_Finance/Spending/,1,,1,,1,,1,,1,,0,,0,,0,Not specified.,1,,0,"There is data in the repository up through 2013, but it appears to have been abandoned since.",0,,0,This is not transaction-level data.,This whole system is extraordinarily bad—it’s possible that it has additional functionality that I could not identify. 96 | Texas,Address Points,no,0,,,,,,,,,,,,,,,,,,,,,,,, 97 | Texas,Legislative Data,http://www.legis.state.tx.us/billlookup/filedownloads.aspx,1,,1,,1,,1,,1,,1,,1,"Bulk records includes legislation, but not legislators.",0,Not specified.,1,,0,,0,,1,, 98 | Texas,Restaurant Inspections,no,0,,,,,,,,,,,,,,,,,,,,,,,, 99 | Texas,Population Projections,http://txsdc.utsa.edu/data/TPEPP/Projections/Index.aspx,1,,1,,1,,1,,1,,1,,1,,0,Not specified.,1,,0,,0,,1,, 100 | Texas,Vehicle Crashes,https://cris.txdot.gov/,1,,1,,1,,1,,1,Registration required.,1,,1,,0,Copyright statement in footer.,,,0,,1,Site uses SSL.,,I did not register to find out., 101 | Virginia,Companies,http://www.scc.virginia.gov/clk/purch.aspx,1,,1,,1,,0,Bulk (and complete) data costs $150/month.,1,,1,,1,,0,Not specified.,1,,0,,0,,1,,"Viewing much of the data is free, but getting machine-readable data requires payment." 102 | Virginia,Incarceration,http://vadoc.virginia.gov/about/facts/,1,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,1,,0,,0,,0,Doesn't include facility capacity data., 103 | Virginia,State-Owned Real Estate,http://dgs.virginia.gov/DivisionofRealEstateServices/StateOwnedRealEstate/tabid/1524/Default.aspx,1,,1,,1,,1,,1,,1,,1,,0,Copyright statement in footer.,1,"Updated annually, apparently.",0,,0,,1,, 104 | Virginia,Checkbook,http://datapoint.apa.virginia.gov/exp/exp_checkbook.cfm,1,,1,,1,,1,,1,,0,"The site claims to offer Excel files, but they’re actually HTML tables.",1,"Only limited bulk data is available, and bizarrely, only as HTML, tables, but it is, in fact, bulk data.",0,Not specified.,1,,1,,0,,0,Lacks expense categories., 105 | Virginia,Address Points,http://vgin.maps.arcgis.com/home/item.html?id=100e5e12ddc14748a5ec3b8b997af13a,1,,1,,1,,1,,1,,1,,1,,1,It’s affirmatively placed into the public domain.,1,,0,,0,,1,, 106 | Virginia,Legislative Data,http://lis.virginia.gov/SiteInformation/ftp.html,1,,1,,1,,1,Requires registration and approval for access.,1,,1,,1,,0,Not specified.,1,,0,,0,,1,, 107 | Virginia,Restaurant Inspections,http://www.healthspace.com/Clients/VDH/VDH_Website.nsf,1,,1,,1,,1,,1,,0,,0,,0,Not specified.,1,,0,,0,,1,, 108 | Virginia,Population Projections,http://www.coopercenter.org/demographics/virginia-population-projections,1,,1,,1,,1,,1,,1,,1,,0,Not specified.,1,,0,,0,,1,, 109 | Virginia,Vehicle Crashes,http://www.dmv.virginia.gov/safety/crash_data/,1,,1,,1,,1,,1,,0,,0,,0,Copyright statement in footer.,1,,0,,1,Site uses SSL.,0,"Uses a report-generation system to generate statistics, rather than publishing data.", 110 | Washington,Companies,https://www.sos.wa.gov/corps/AllData.aspx,1,,1,,1,,1,,1,,1,,1,,0,Not specified.,1,,0,,1,Site uses SSL.,1,, 111 | Washington,Incarceration,http://www.doc.wa.gov/aboutdoc/statistics.asp,1,,1,,1,,1,,1,,0,PDFs.,0,,0,Copyright statement in footer.,1,,0,,0,,1,, 112 | Washington,State-Owned Real Estate,http://www.ofm.wa.gov/budget/facilities/fis.asp,1,,1,,1,,1,,1,,1,,1,,0,Copyright statement in footer.,1,,0,,0,,1,, 113 | Washington,Checkbook,http://fiscal.wa.gov/Checkbook.aspx,1,,1,,1,,1,,1,,1,,1,If exported.,0,Not specified.,1,,0,,1,,0,No description of the expense and no check number., 114 | Washington,Address Points,no,0,,,,,,,,,,,,,,,,,,,,,,,, 115 | Washington,Legislative Data,http://wslwebservices.leg.wa.gov/,1,,1,,1,,1,,1,,1,,0,API only.,0,Not specified.,1,,0,,0,,1,, 116 | Washington,Restaurant Inspections,no,0,,,,,,,,,,,,,,,,,,,,,,,, 117 | Washington,Population Projections,http://www.ofm.wa.gov/Pop/stfc/default.asp,1,,1,,1,,1,,1,,1,,1,,0,Copyright statement in footer.,1,,0,,0,,0,"Only contains statewide forecasts, not per-locality forecasts.", 118 | Washington,Vehicle Crashes,http://wtsc.wa.gov/research-data/crash-data/,1,,1,,1,,1,,1,,1,,1,,0,Copyright statement in footer.,1,,0,,0,,0,"These are statistics, not data.", -------------------------------------------------------------------------------- /Data/state open datasets - Sheet1.tsv: -------------------------------------------------------------------------------- 1 | Companies Crime and Justice Earth observation Education Energy and Environment Finance and contracts Geospatial Economic Development Government Accountability and Democracy Health Science and Research Statistics Social mobility and welfare Transport and Infrastructure 2 | Registered corporations Crime statistics Meteorological/weather List of schools Ground and water pollution reports Expenditure transactions address points Land use maps legislation and legislators Hospitals and health centers public research grants demographics Housing asset locations (road geometries, sidewalks, bike lanes, roadway signage, bridges) 3 | Enforcement actions against businesses precinct boundaries agriculture standardized test data Energy consumption contracts Topography Subsidies laws and regulations hospital performance data state-funded research data economic projections unemployment benefits asset conditions (pavement conditions/inspections, bridge conditions/inspections, surface conditions, weather, air quality) 4 | Businesses with liens against them complaints Forestry free and reduced lunch rates permits (applications and granted) procurement processes postcodes Local planning and zoning meetings notices campaign finance medical censure data STEM education opportunities and initiatives studies not located elsewhere safety net programs: statistics, guidelines, contacts asset features (evacuation routes, striping, guardrail, tolling, ramp metering, dynamic pricing etc.) 5 | Registered securities for sale enforcement decisions hunting seasons, per species state subsidy formulas public notices tax revenue, state and local local maps real estate holdings Government contact points public health notices food banks off-system data (land use, aerial photography) 6 | Registered trade names prison rape elimination act (PREA) reports species found within the state, with unique identifiers educational standards by grade air quality fee revenue, state and local parcel maps surplus real estate and property Election results public health statistics homeless shelters traffic volumes (e.g., average annual daily traffic) both historical and projected 7 | Registered trademarks and service marks court caseload/dockets public lands where hunting and fishing is permitted school boards: lists, contacts, and meeting information enforcement actions unclaimed property township boundaries salaries births eldercare services road conditions (e.g. congestion, speed) both historical and near real-time 8 | local police budgets public boat launches cleanup sites agency checkbooks state legislative districts lobbying/gifts deaths daycare facilities safety statistics (fatal incidents, non-fatal incidents, enforcement) 9 | registered kills dams, including inspection data RFPs congressional districts asset disclosure restaurant inspections dynamic messages 10 | invasive species deterrent actions tracked species data (e.g., native vs. invasive) tax rates: sales, property, income public school districts public meeting notices group homes parking facilities (location, availability, pricing, rules - including truck parking) 11 | parks orthophotographs public meeting agendas licensed mental health providers bike sharing facilities (sharing infrastructure, parking, availability) 12 | trails list of agencies mental health facility bed availability ride/car sharing facilities (locations, rates/incentives, availability, ratings) 13 | conservation easements agency org charts taxi (stations, reservations, fares, wait times/availability) 14 | land enrolled in a land bank AG opinions construction projects and other special events 15 | water availability and useage FOIA tracking and response realtime snowplow geolocation, sweeping operations 16 | crop yields transit data (stop locations and features (ADA access), elevators/escalators, schedules, arrival times, service alerts) 17 | land rental prices financial data (revenues, expenditures, budget, cash flow) 18 | inspections of regulated private facilities project data (long-term improvement plans, short-term improvement plans, cost/schedule performance) 19 | livestock data -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | State-Open-Data-Census 2 | ====================== 3 | Working towards a US State Open Data Census. Would you like to help? Right now we're asking people with subject-matter expertise in different state-level datasets to comment here: http://goo.gl/forms/aOa1Q8DWPd. 4 | 5 | You can help us identify key state-level datasets in the following categories: 6 | * Companies 7 | * Crime and Justice 8 | * Earth observation, forestry, wildlife management, and agriculture 9 | * Education 10 | * Energy and Environment 11 | * Finance and contracts 12 | * Geospatial 13 | * Economic Development 14 | * Government Accountability and Democracy 15 | * Health 16 | * Science and Research 17 | * Statistics 18 | * Social mobility and welfare 19 | * Transport and Infrastructure 20 | 21 | If you've worked with a state-level dataset in any of those categories, please help us by providing more information about what are the most important specific datasets, and what attributes they should have. Again, the Google Form is here- http://goo.gl/forms/aOa1Q8DWPd - and we'll post results as we collect them. 22 | --------------------------------------------------------------------------------