Schedulis Versions Save

Schedulis is a high performance workflow task scheduling system that supports high availability and multi-tenant financial level features, Linkis computing middleware, and has been integrated into data application development portal DataSphere Studio

release-0.8.0

9 months ago

The newly released 0.8.0 version, compared to the previous version 0.7.1, mainly adapts DSS 1.1.2 and Apache Linkis 1.4.0, it also contains bug fixes for some user-reported issues, and optimization of deployment documentation. The new features of Schedulis 0.8.0 can be obtained blow:

  • New Features
    • Adapt DSS 1.1.2 and Apache Linkis 1.4.0.
  • Bugs Fix
    • Bug fix for email alerting issue. #101
    • Bug fix for inverted status of sub-workflows as “failed_skiped”.
    • Bug fix for error flipping to success when killing sub-workflows.
    • Bug fix for unrecognized yaml flow issue.

release-0.7.1

1 year ago

Schedulis 0.7.1 is released to solve issues from users. The new features of Schedulis 0.7.1 can be obtained blow:

  • New Features

    • Project version management. #108
    • Super kill the flow with "KILLING" status.
  • Bugs Fix

    • Unrecognized job type 'flow' #105
    • Occasional interruption of cycle execution under high load conditions.

release-0.7.0

1 year ago

Schedulis 0.7.0 is released to adapt DSS 1.1.0 and Linkis Apache 1.1.1, and this version solves some problems at previous versions. The new features of Schedulis 0.7.0 can be obtained blow:

  • New Features

    • Adapt DSS 1.1.0 and Linkis Apache 1.1.1.
  • Bugs Fix

    • Missing pentaho-aggdesigner-algorithm while compiling.
    • Too short session live time.

release-0.6.2

2 years ago

Schedulis 0.6.2 is released to adapt DSS 1.0.1 and Linkis Apache 1.0.3, and this version solves some problems at previous versions. The new features of Schedulis 0.6.2 can be obtained blow:

  • New Features
    • Adapt DSS 1.0.1 and Linkis Apache 1.0.3.
    • Add LDAP switch.
    • Optimize start and end time calculation rules of workflow after the task failure reruns or skips.
    • Optimize HA mode.
  • Bugs Fix
    • Fix opendj dependencies missing while compiling.
    • Fix the work flow with the status of "KILLING" for a long time.
    • Fix null proxy user while the user log from DSS.
  • Performance improve

release-0.6.0

3 years ago

Schedulis 0.6.0 version focuses on solving the imperfections of the existing version in the workflow scheduling strategy. It provides two scheduling strategies of historical rerun and cyclic execution. At the same time, it is more convenient and flexible in parameter definition display and scheduling functions, and optimized The existing UI in the workflow is more crowded; in subsequent versions, we will provide advanced features such as event-driven and dynamic task fragmentation. At the same time, the existing system is optimized in terms of architecture. Ease of use, failover, elastic scaling and other capabilities have introduced more containerization features to enrich cloud-native scenarios. I hope that we can work together with community students and contribute to Schedulis.

Enhancement

Scheduling Strategy Expansion

  1. Added a new workflow cycle execution scheduling strategy, which supports the serial cycle execution of the workflow, and supports a wealth of failure and alarm strategies, which is suitable for the workflow that needs to run batches continuously.
  2. Added a new scheduling strategy for historical batch re-running, supporting workflow re-running based on historical dates or a certain period of time in history, while providing rich time configuration methods, efficient concurrency capabilities, and alarm methods.
  3. Add multiple dimensions of scheduling switches, system-level switches can turn off the scheduling function of the entire system, and workflow-level scheduling switches can turn off scheduling for a certain workflow.

Workflow Parameters

  1. Support to display a certain runtime parameter in the execution history table on the page when the workflow is running, so that it is convenient to distinguish different batches of the workflow with the same name.
  2. The system built-in variable definition method supports definition and use in properties.

UI Interaction Optimization

  1. Support quick retrieval of LinkisJobId and YARNId in user logs.
  2. Support one-click zoom in the workflow structure diagram, optimize the layout of the workflow, and display time information.

Bug Fix

  1. Fix the problem that the page configuration alarm mailbox does not take effect when using email alarms.
  2. Fix the problem that opendj related packages cannot be included in dependencies when packaging.

Cloud Resource

Schedulis Jobtype Packages

URL: https://pan.baidu.com/s/1pKOjY6tgNkRD5rVmvU0RXg Password: wy7r


Schedulis0.6.0版本,重点解决了现有版本在工作流调度策略上的不完善,提供了历史重跑,循环执行两种调度策略,同时在参数定义展示上、调度功能上更加方便灵活,优化了现有UI在工作流中作业比较多的情况比较拥挤的情况;在后续的版本中,我们将会提供事件驱动,动态任务分片等高级特性,同时在架构上对现有系统进行优化,在易用性,故障转移,弹性伸缩等能力上推出更多的容器化特性,丰富云原生场景,希望可以和社区同学们一道共同努力,共同为Schedulis贡献。

特性增强

调度策略/功能扩展

  1. 新增工作流循环执行调度策略,支持工作流串行循环执行,同时支持丰富的失败和告警策略,适用于需要一直不间断跑批的工作流。
  2. 新增历史批次重跑的调度策略,支持工作流基于历史日期或者历史的某一时间段进行重跑,同时提供了丰富的时间配置方式,高效的并发能力,以及告警方式。
  3. 新增多个维度的调度开关,系统级别的开关可关闭整个系统的调度功能,工作流级别的调度开关可对某一个工作流关闭调度。

工作流参数

  1. 支持在工作流运行时将某一个运行时的参数展示在页面上的执行历史表格内,方便区分同名工作流的不同批次。
  2. 系统内置变量定义方式支持在properties中定义和使用。

UI交互优化

  1. 支持快速检索用户日志中的LinkisJobId和YARNId。
  2. 支持对工作流结构图进行一键放大,优化对工作流进行编排,显示时间信息。

云资源

Schedulis Jobtype插件的依赖和配置(放入azkaban-jobtype的根目录下编译,详见部署文档)

链接: https://pan.baidu.com/s/1pKOjY6tgNkRD5rVmvU0RXg 提取码: wy7r

release-0.6.1

3 years ago

Schedulis 0.6.1 version is mainly a small version, and the main adaptation points are as follows:

  1. DataSphereStudio 1.0 version adaptation.
  2. Linkis 1.0 version adaptation.