California Coronavirus Scrapers Save

The open-source web scrapers that feed the Los Angeles Times' California coronavirus tracker.

Processed data ready for analysis is available at datadesk/california-coronavirus-data.

Scrapers

The scrapers are written using Python and Jupyter notebooks, scheduled and run via GitHub Actions and then archived using git.

module	status	maintainer
bed-surges	Retired	Iris Lee
cases-deaths-demographics	Retired	Iris Lee
cases-deaths-tests		Sean Greene
cdc-community-levels	Retired	Sean Greene
demographics-age	Retired	Sean Greene
demographics-race-by-county	Retired	Rahul Mukherjee
demographics-race-statewide	Retired	Aida Ylanan
federal-prisons	Retired	Iris Lee
homeless-impact	Retired	Jennifer Lu
hopkins	Retired	Iris Lee
hospital-patients		Iris Lee
hospital-capacity	Retired	Iris Lee
hospital-locations	Retired	Iris Lee
ice-detainees	Retired	Iris Lee
icu-capacity	Retired	Sean Greene
local-adult-detention-facilities	Retired	Iris Lee
local-juvenile-detention-facilities	Retired	Iris Lee
places	Retired	Et al.
probable-cases	Retired	Iris Lee
reopening-tiers	Retired	Iris Lee
school-reopenings	Retired	Iris Lee
skilled-nursing-facilities	Retired	Iris Lee
skilled-nursing-totals	Retired	Iris Lee
state-prisons	Retired	Iris Lee
vaccine-breakthrough-cases	Retired	Sean Greene
vaccine-cdc-state-totals	Retired	Iris Lee
vaccine-doses-on-hand	Retired	Sean Greene
vaccine-progress		Sean Greene
vaccine-hpi	Retired	Sean Greene
vaccine-demographics-by-county	Retired	Sean Greene
vaccine-demographics-statewide	Retired	Sean Greene
vaccine-shipped-delivered	Retired	Sean Greene
variant-proportions-states	Retired	Matt Stiles
variant-toplines-ca		Matt Stiles
vaccine-zip-codes	Retired	Sean Greene, Matt Stiles

Installation

Clone the repository and install the Python dependencies.

pipenv install

Run all of the scraper commands.

make

Run one of the scraper commands.

make -f vaccine-hpi/Makefile