A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
commands.sql.CopyIncrementally
class constructor takes an additional argument, use_explicit_upsert
, that, when set to True
, will use 2 explicit queries (UPDATE + INSERT) instead of using just INSERT ... ON CONFLICT DO UPDATE
. Useful when upserting into partitioned tables.