An open database of international sanctions data, persons of interest and politically exposed persons
OpenSanctions aggregates and provides a comprehensive open-source database of sanctions data, politically exposed persons, and related entities. Key functionalities in this codebase include:
We build on top of the Follow the Money framework, a JSON-focused anti-corruption data model, as the schema for all our crawlers. FtM data is then optionally exposed to simplified formats like CSV.
At the heart of our project is a crawler framework dubbed zavod
. To activate the project, you have the option to employ either docker-compose.yml
or the Makefile
.
For an enriched experience backed by extensive documentation, we recommend opting for the Makefile
. More details can be found in the zavod documentation.
zavod
can use a database in order to cache information from the data sources. Launch a terminal and set up your database with:
docker compose up -d db
Next, commence the build process with:
make build
# Alternatively, for direct execution:
docker-compose build --pull
Kickstart the crawling process with:
# This zeroes in on the dataset located in the datasets directory
docker compose run --rm app zavod crawl datasets/de/abgeordnetenwatch/de_abgeordnetenwatch.yml
nomenklatura
provides a framework for storing data statements with full data lineage, and for integrating entity data from multiple sources. It also handles the data enrichment function that links OpenSanctions to external databases like OpenCorporates.The code within this repository is licensed under the MIT License. For content and data, we adhere to CC 4.0 Attribution-NonCommercial.