DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
DataSphereStudio1.1.2 has undergone significant optimization at the system level, such as merging and multi activity transformation of microservices. Simultaneously providing some new features.
DSS-1.1.2 includes all of Project DSS-1.1.2.
The main features of DSS-1.1.2 are as flollows:
Abbreviations:
The release of DSS 1.1.2 is inseparable from the contributors of the DSS community. Thanks to their active participation in the community, DSS 1.1.2 was released smoothly.
DSS1.1.2&Linkis1.4.0 Compiled package
DataSphereStudio 1.1.1 is an update to version 1.1.0, which mainly involves support for creating workflows without scheduling system integration, fixing the ability to publish scripts as RESTFUL APIs, fixing Schedulis, Qualitis, and DolphinScheduler password-free jump exceptions, fixing Qualitis node publishing to DolphinScheduler exceptions, fixing workspace management user list interface exceptions, and Fix the exception of workflow editing for publishing to DolphinScheduler.
DSS-1.1.1 includes all of Project DSS-1.1.1.
The main features of DSS-1.1.1 are as flollows:
Abbreviations:
The release of DSS 1.1.1 is inseparable from the contributors of the DSS community. Thanks to all the community contributors, Including but not limited to the following contributors:ichenfeiyang、jacktao007、LMQ0023、utopianet、coombe。
Tencent Cloud:
DSS-1.1.1&Linkis-1.1.1 Compiled package (.tar.gz) DSS-1.1.1 Compiled package (.tar.gz)
DataSphereStudio 1.1.0 is a milestone in the practice of data application development and management framework. It integrates all the open source ecological components of WeDataSphere, and brings a series of powerful new features, as well as a more streamlined and easy-to-connect data application development integration architecture design and implementation .
DSS-1.1.0 includes all of Project DSS-1.1.0.
The main features of DSS-1.1.0 are as follows:
Abbreviations:
The release of DSS 1.1.0 is inseparable from the contributors of the DSS community. Thanks to all the community contributors, Including but not limited to the following contributors: rootljw, teenwolf0910, njnu-seafish, luban08, HanTang1, det101, KidUncle, mingfengwang.
Tencent Cloud:
DSS-1.0.1 includes all of Project DSS-1.0.1.
DSS-1.0.1 mainly contains three improvements and enhancements:
Abbreviations: DSS: DataSphereStudio
The release of DSS 1.0.1 is inseparable from the contributors of the DSS community. Thanks to all the community contributors!
DSS-1.0.0 includes all of Project DSS-1.0.0.
DataSphereStudio 1.0.0 is a major release marking the start of data application development and management framework, which brings both a variety of powerful new features and strong archetecture designation and implemenation of data application.
The following key features are added:
Abbreviations:
DSS: DataSphereStudio
The release of DSS 1.0.0 is inseparable from the contributors of the DSS community. Thanks to all the community contributors!
DSS 0.9.1 is a version led by ChinaTelecom Ctyun Big Data Platform Team with the help of WeBank.
This is the next release based on DSS 0.9.0 . This version aims to reduce the operation and maintenance costs of WeDataSphere components such as DSS, Linkis, and Schedulis for community users through the new feature of "new user initialization", so that DSS can use "new user initialization" to automatically initialize the execution environment of new created users.
Since 0.9.0, this version contains 7 improvements and enhancements.
[DataSphereStudio-274] Adding account creation function. Support users to customize configuration according to their own environment,currently available to create include(LDAP,management node account,HDFS&Linux directory ,scheduling account,hive database,keytab), because the environments of community users are quite different, users can also add new implementations or modify scripts to adapt to their own environment.
[DataSphereStudio - 288] Support creating users on the master machine
[DataSphereStudio - 289] Support creating workspace for the newly added user(support Linux and HDFS) and HDFS
[DataSphereStudio - 290] Support adding users to the Schedulis configuration and immediately overriding.
[DataSphereStudio - 291] Support initializing the environment needed by Hive for newly added users.
[DataSphereStudio - 292] Support for creating and distributing keytab files in Kerberos clusters for new users.
[DataSphereStudio - 293] Support adding users to the LDAP based system
The release of DSS 0.9.1 is inseparable from the contributors from the WeDataSphere community. They selflessly contribute their code and actively communicate with community partners. Without their help, DSS 0.9.1 cannot be successfully released. Thanks to all the community contributors! Rank in no particular order:
luxl : Basic code and workspace module, scheduling authorization, and part of the front-end development of account creation. HanTang:LDAP module and Hadoop master node account creation function. lvjw: Documentation contribution. schumiyi : Fix the problem that the application prompts that it is not open source after the initial installation. tomshy1 : Front-end development of account creation . JsonLiuUp: Keytab creation and distribution, hive database activation and authorization. ldtong:Scheduling authorization.
This version involves adjustments to some JARs. If DSS is running in your production environment, you only need to simply replace some of DSS Jars to upgrade. For details, please refer to: DSS 0.9 .1 Upgrade Guide. Please note: This version provides a new feature called "new user initialization" . In order to use this feature properly, please keep notice of DSS0.9.1 New User Initialization Usage Document.
DSS + Linkis + Qualitis + Visualis + Azkaban one-click installation package URL:dss_linkis.zip
DSS 0.9.1 是在微众银行的倾力帮助下,由 天翼云 主导完成的一个版本。
这是基于 DSS 0.9.0 的下一个发行版本。该版本旨在通过新增“新用户初始化”特性,为社区用户降低运维DSS、Linkis和Schedulis等WeDataSphere组件的运维成本,让DSS在新增新登录用户时,可以使用“新用户初始化”功能自动完成新用户的所有环境初始化操作。
本次版本包含了7个改进和增强。
DSS 0.9.1 的发布,离不开WeDataSphere社区的贡献者,他们无私地贡献自己的代码,积极地与社区伙伴进行技术交流,有了他们的助力,DSS 0.9.1 才能顺利地发布,在此感谢各位社区的贡献者! 排名不分先后:
luxl:本次版本的社区主导者。基础代码和工作空间模块,调度授权,以及创建账号部分前端开发。 HanTang:LDAP模块和hadoop主节点账号创建功能。 lvjw:贡献文档。 schumiyi:修复初始化安装后进入应用提示未开源的问题。 tomshy1:创建账号前端开发。 JsonLiuUp:keytab创建和分发,hive库开通和授权。 ldtong:调度授权。
本次版本涉及对一部分JAR包进行了调整,如果您已经在生产环境使用了DSS,并且不想重新安装DSS的话,只需要对其中的几个Jar进行简单替换即可,具体请参考:DSS 0.9.1升级指南。
请注意:本次版本提供了新用户初始化的大特性,为了使您能正常使用该特性,请在安装和升级前,先阅读 DSS0.9.1新用户初始化使用文档。
DSS + Linkis + Qualitis + Visualis + Azkaban一键安装包 链接:dss_linkis.zip
0.9.0 is an important version led by ChinaTelecom Ctyun Big Data Platform Team with the help of WeBank. This is the next release based on DataSphere Studio 0.8.0 line. This version aims to build a one-stop big data application development and management platform by introducing the concepts of "DSS Integration Standard" and "Workspace", which greatly enhances the user's big data development experience. DSS Integration Standard (DSS Integration Standard): It is the unified access specification of the application system composed of SecurityService from the AppJoint specification of DSS, so that enterprises can connect related big data products to DSS very easily One-stop big data application system portal display and management capabilities (DSS application access specifications will continue to be supplemented and improved in subsequent versions of DSS). Workspace specification: enables different types of data applications (such as workflow offline applications, real-time applications, data API services, etc.) to be organized and managed from a unified perspective, enhancing application organization and management capabilities. It contains 23 bug fixes, improvements and enhancements.
The release of DataSphere Studio 0.9.0 is inseparable from the contributors of the WeDataSphere community. They selflessly contribute their codes and actively carry out technical exchanges with community partners. With their help, DataSphere Studio 0.9.0 can be successfully released. Thank you all Contributors to the community! Rank in no particular order: det101: contributed front-end codes for workspace homepage, optimized local debugging configuration of front-end, and solved the bug that footer-channel in iframe didn't work. yuchenyao: contributed front-end codes for DSS homepage, and optimized the process of creating project and workflow. schumiyi: contributed back-end codes for DSS homepage and workspace homepage. ryanqin01: contributed database related codes。 AdamWang: contributed back-end codes for workspace homepage, and reconstructed part of remaining problems.
Due to the addition of the concept of user workspace (Workspace) in this version of DSS-0.9.0, if you are upgrading from DSS0.7 or DSS0.8 to DSS0.9.0, after completing the platform deployment, you need to make some adjustments to the database tables , Please visit: DSS 0.9.0 Upgrade Guide
0.9.0是在微众银行的倾力帮助下,由天翼云大数据平台团队主导完成的一个重要版本。 这是基于DataSphere Studio 0.8.0的下一个发行版本。该版本旨在通过引入“DSS应用接入规范”,“工作空间”等概念,构建一站式大数据应用开发与管理平台,极大提升了用户的大数据开发体验。 DSS应用接入规范(DSS Integration Standard): 是从DSS的AppJoint规范中,抽出SecurityService组成的应用系统统一接入规范,使企业可以非常简单地将相关大数据产品接入到DSS之中,快速具备一站式的大数据应用系统门户展示和管理能力(DSS应用接入规范将会在DSS的后续版本之中继续补充完善)。 工作空间规范:使不同类型的数据应用(如:工作流离线应用、实时应用、数据API服务等)能够以统一的视角进行组织管理,提升应用的组织和管理能力。 本次版本包含了23个Bug修复,改进和增强。
DataSphere Studio 0.9.0的发布,离不开WeDataSphere社区的贡献者,他们无私地贡献自己的代码,积极地与社区伙伴进行技术交流,有了他们的助力,DataSphere Studio 0.9.0才能顺利地发布,在此感谢各位社区的贡献者! 排名不分先后: luxl :贡献工作空间功能的前端代码,优化前端本地调试配置,修复任务管理器入口在iframe下拖动不正常的问题 yuchenyao:贡献了首页的前端代码,优化了创建工程及工作流的流程。 schumiyi: 贡献了首页和用户工作空间相关后端代码。 ryanqin01: 贡献了数据库相关代码。 AdamWang:贡献了用户工作空间相关后端代码,以及部分历史代码遗留问题重构。
由于本次DSS-0.9.0版本新增了用户工作空间(workspace)概念,如果您是从 DSS0.7 或 DSS0.8 升级到 DSS0.9.0,在完成平台部署后,需对数据库表做一些调整,具体请访问: DSS 0.9.0 升级指南
The release of DataSphereStudio0.9.4 is inseparable from the contributors of the WeDataSphere community. They selflessly contribute their codes and actively carry out technical exchanges with community partners. With their help, DataSphereStudio0.9.4 can be successfully released. Thank you all Contributors to the community! Rank in no particular order: 5herhom: Fixed bug with multiple IP addresses on the server that would cause installation and startup to fail. xing.huang: Contributed error using 'UTF-8' as content of the Content-Encoding. SelfImpr001:Contribute to the optimized message consumption code of eventcheck node.
DataSphereStudio 0.8.0的发布,离不开WeDataSphere社区的贡献者,他们无私地贡献自己的代码,积极地与社区伙伴进行技术交流,有了他们的助力,DataSphereStudio 0.8.0才能顺利地发布,在此感谢各位社区的贡献者! 排名不分先后: 5herhom: 修复了服务器存在多个IP会导致安装启动失败的BUG。 xing.huang: 贡献了错误使用'utf-8'作为Content-Encoding内容的修复代码。 SelfImpr001: 贡献了EventCheck优化消息消费方式的代码。
我们提供了DSS + Linkis + Qualitis + Visualis + Azkaban【全家桶一键部署安装包】,由于安装包过大(1.7GB),Github下载缓慢,请通过以下方式获取:
URL: https://pan.baidu.com/s/1Jhq1vQB_gkYfbU-LMaUJJA
Password: 3hvj
以下为DSS后端安装包资源:
URL: https://pan.baidu.com/s/1cbmd4rcjCYh4agZ26lsr2A
Password: 3l1r
以下为DSS前端安装包资源:
URL: https://share.weiyun.com/dJjSOAzE
Password: ur580z
Tencent Cloud:
URL:https://share.weiyun.com/58yxh3n
我们提供了DSS + Linkis + Qualitis + Visualis + Azkaban【全家桶一键部署安装包】,由于安装包过大(1.3GB),Github下载缓慢,请通过以下方式获取:
URL: https://pan.baidu.com/s/1hmxuJtyY72D5X_dZoQIE5g
Password: p82h
URL: https://share.weiyun.com/5vpLr9t
Password: upqgib
以下为DSS安装包资源:
URL: https://share.weiyun.com/5n2GD0h
Password: p8f4ug
URL: https://pan.baidu.com/s/18H8P75Y-cSEsW-doVRyAJQ
Password: pnnj
Tencent Cloud:
URL:https://share.weiyun.com/58yxh3n
链接:https://pan.baidu.com/s/1srn-V7WJDLy2QAPs5qGyHA
提取码:iyya