:blue_book: Making Data, the DataMade Way
This is DataMade's guide to extracting, transforming and loading (ETL) data using Make, a common command line utility.
This guide is part of a body of technical and process documentation maintained by DataMade. Head over to datamade/how-to
for other guides on topics ranging from AWS to work practices!
ETL refers to the general process of:
Having a standard ETL workflow helps us make sure that our work is clean, consistent, and easy to reproduce. By following these guidelines you'll be able to keep your work up to date and share it with the world in a standard format - all with as few headaches as possible.
These five principles inform all of our data work:
Unsure how to follow these principles? Read on!