Datajob Versions Save

upgrade cdk: ttps://github.com/vincentclaes/datajob/pull/133

https://github.com/vincentclaes/datajob/milestone/8?closed=1

release notes:

• bugfix updating workflow

https://github.com/vincentclaes/datajob/milestone/7?closed=1

release notes:

• add support for sagemaker
• add examples for sagemaker
• improve stepfunctions build of workflow

https://github.com/vincentclaes/datajob/milestone/6?closed=1

release notes:

• upgrade step functions version
• use was cdk stepfunctions to include the workflow instead of using cloudformation-include

https://github.com/vincentclaes/datajob/milestone/5?closed=1

release notes:

• construct more complex pipelines. Handle parallel pipelines better
• implement notification on error/succes
• update cdk libs

https://github.com/vincentclaes/datajob/milestone/4?closed=1

release notes:

• orchestrate 1 job with task1 >> ...
• add pyspark example
• fix some bugs related to steps to follow in readme
• update readme

https://github.com/vincentclaes/datajob/milestone/3?closed=1

release notes:

• better handling of AWS region for stepfunctions workflow
• fix stage values that can be set via cli, on init of datajob stack or none at all
• update readme

https://github.com/vincentclaes/datajob/milestone/2?closed=1

release notes:

• add --package poetry / --package setuppy so that we can specify what tool to use to package the code
• shell out commands more securely

milestones: https://github.com/vincentclaes/datajob/milestone/1?closed=1

• use python 3.6
• make stage optional
• easy access data bucket

make it work on python 3.6