I use web scraping methods to process and visualize crime data based on the NCVS and NIBRS data.
I share code I use to obtain all of the police shooting data sets that I am aware of.
This is my first attempt at extracting web content using 3 R packages. I try to extract an article title from a publisher's homepage, a link to a JSTOR abstract, and a link to the JSTOR open-access e-book.
This is a set of csv files including a number of variables including fatal police shootings and other crime and socioeconomic covariates at different levels of geographical aggregation from 2013-2016. Five of the files use only the Washington Post data covering years 2015 and 2016, whereas the other five files utilize fatal police shootings of civilians for years 2013-2016, combining the Lott & Moody (2016) data for years 2013-2015 and Washington Post data for 2016. Other variables are included from the American Community Survey (ACS), the FBI's Uniform Crime Reports (UCR), the Law Enforcement Management and Administrative Statistics (LEMAS), Stanford Education Data Archive (SEDA), the US Census, and the Local Area Unemployment Statistics (LAUS) provided by the Bureau of Labor Statistics (BLS).