Bitsail Versions Save

BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.

release-0.1.0

1 year ago

BitSail initial release

What's Changed

[BitSail] Add github action CICD by @garyli1019 in https://github.com/bytedance/bitsail/pull/2
[BitSail]fixed failed unit test cases. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/3
[BitSail]Add license file. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/4
[BitSail]Fixed Bitsail unit tests. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/5
[BitSail]Support windows platform. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/7
[BitSail-Hudi] Support Hudi async compaction job by @garyli1019 in https://github.com/bytedance/bitsail/pull/1
Fix elastcisearch writer by @BlockLiu in https://github.com/bytedance/bitsail/pull/8
[BitSail-Hudi] Support Hudi batch source by @garyli1019 in https://github.com/bytedance/bitsail/pull/10
[BitSail-Hudi] Add doc for Hudi related connectors by @garyli1019 in https://github.com/bytedance/bitsail/pull/11
[BitSail]Add license state. by @lujg in https://github.com/bytedance/bitsail/pull/12
[BitSail]use maridb replace mysql. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/14
[BitSail][hudi]hudi artifact typo#1. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/15
Feature: support kerberos by @BlockLiu in https://github.com/bytedance/bitsail/pull/9
[MINOR] fix hudi source parallelism by @garyli1019 in https://github.com/bytedance/bitsail/pull/16
add three types of issue templates by @BlockLiu in https://github.com/bytedance/bitsail/pull/19
Refactor bitsail-components-security by @BlockLiu in https://github.com/bytedance/bitsail/pull/20
[MINOR] Tune hudi sink IT case config by @garyli1019 in https://github.com/bytedance/bitsail/pull/23
Update pom.xml by @BlockLiu in https://github.com/bytedance/bitsail/pull/21
[BitSail]Add license state according scan result. by @lujg in https://github.com/bytedance/bitsail/pull/22
[BitSail][runtime]add logback.xml by @hk-lrzy in https://github.com/bytedance/bitsail/pull/18
[BitSail] Adapt hudi into bitsail type system by @garyli1019 in https://github.com/bytedance/bitsail/pull/26
Add legacy connector redis by @BlockLiu in https://github.com/bytedance/bitsail/pull/29
[BitSail][connector]remove guava from dependency by @hk-lrzy in https://github.com/bytedance/bitsail/pull/32
[BitSail] tune hudi connector dependency by @garyli1019 in https://github.com/bytedance/bitsail/pull/33
[BitSail] Improve quickstart documentation by @garyli1019 in https://github.com/bytedance/bitsail/pull/34
Refactor issue template. by @BlockLiu in https://github.com/bytedance/bitsail/pull/36
[BitSail] Hudi Compaction support auto parallelism calculation by @garyli1019 in https://github.com/bytedance/bitsail/pull/37
Add connector doris by @BlockLiu in https://github.com/bytedance/bitsail/pull/31
Add legacy connector oracle by @ysamchu in https://github.com/bytedance/bitsail/pull/25
Create CODE_OF_CONDUCT.md by @lichang-bd in https://github.com/bytedance/bitsail/pull/39
Optimize doc quickstart deployment by @BlockLiu in https://github.com/bytedance/bitsail/pull/41
WIP:[Doc] Reorg README and contributor guide by @garyli1019 in https://github.com/bytedance/bitsail/pull/42
[BitSail] Change version to 0.1.0-SNAPSHOT by @garyli1019 in https://github.com/bytedance/bitsail/pull/45
[BitSail] Add legacy oracle Source connector integration test and cor… by @ysamchu in https://github.com/bytedance/bitsail/pull/44
[BitSail][runtime]remove legacy transform api. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/46
[BitSail][runtime]remove useless file. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/48
Add the introduction of bitsails by @lichang-bd in https://github.com/bytedance/bitsail/pull/47
[MINOR] Add wechat QR code and some cosmetic fixes by @garyli1019 in https://github.com/bytedance/bitsail/pull/49
Refactor pr template by @BlockLiu in https://github.com/bytedance/bitsail/pull/52
Add legacy connector HBase by @BlockLiu in https://github.com/bytedance/bitsail/pull/27
Add legacy connector larksheet by @BlockLiu in https://github.com/bytedance/bitsail/pull/24
Add legacy connector rocketmq by @BlockLiu in https://github.com/bytedance/bitsail/pull/35
Add legacy connector mongodb by @BlockLiu in https://github.com/bytedance/bitsail/pull/30
Add docs for rocketmq writer. by @BlockLiu in https://github.com/bytedance/bitsail/pull/53
modify the introduction of bitsail by @lichang-bd in https://github.com/bytedance/bitsail/pull/54
[BitSail]Support unified source inteface. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/28
[Doc] Update wechat group QR code by @garyli1019 in https://github.com/bytedance/bitsail/pull/55
Support flink local submit by @BlockLiu in https://github.com/bytedance/bitsail/pull/56
revising typo by @ZhaoXinlong in https://github.com/bytedance/bitsail/pull/59
Move pr template to .github/ by @BlockLiu in https://github.com/bytedance/bitsail/pull/61
[BitSail][Doc]fix typo of Readme (#62) by @ayonel in https://github.com/bytedance/bitsail/pull/63
[doc] Remove connector duplicate declaration but not supported in Readme by @laglangyue in https://github.com/bytedance/bitsail/pull/67
[BitSail][docs]Add contributors in readme file. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/68
[BitSail]Refactor Typesystem. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/43
Add legacy FTP/SFTP connector by @jliao07 in https://github.com/bytedance/bitsail/pull/73
add comment to StreamingFile by @BlockLiu in https://github.com/bytedance/bitsail/pull/87
Fix ftp compile and test issues by @jliao07 in https://github.com/bytedance/bitsail/pull/88
Remove setFetchSize in getStatement. by @BlockLiu in https://github.com/bytedance/bitsail/pull/85
[BitSail]remove useless gitignore. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/92
[Bitsail] Refactor Oracle connector and add unit tests on util classes by @ysamchu in https://github.com/bytedance/bitsail/pull/82
[BitSail][Connector]Support RocketMQ Source by @hk-lrzy in https://github.com/bytedance/bitsail/pull/90
[BitSail][connector]add to dist. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/96
[BitSail][connector]rename connector register file. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/97
[fix-94][connector-hbase] resolve KerberosAuthenticator#getUgi invalid by @yanghuaiGit in https://github.com/bytedance/bitsail/pull/95
[BitSail][connector]fixed type property shared in same type definition. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/99
[BitSail][connector]fixed hbase issue for the deserialization format. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/101
[MINOR] fix flaky hudi test by @garyli1019 in https://github.com/bytedance/bitsail/pull/79
[BitSail] Add connector kudu by @BlockLiu in https://github.com/bytedance/bitsail/pull/89
[BitSail] Migrate redis sink to v1 interface by @love-star in https://github.com/bytedance/bitsail/pull/98
[BitSail] Doc improvements by @garyli1019 in https://github.com/bytedance/bitsail/pull/152
[BitSail] Pref regex pattern by @NiuXiangQian in https://github.com/bytedance/bitsail/pull/150
[BitSail] Include cdc flag on source and deprecate Column by @garyli1019 in https://github.com/bytedance/bitsail/pull/102
[BitSail][Connector-Hive]Support tinyint type. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/163
[BitSail][docs]fixed parameter error in examples. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/166
This PR just adds comments to some code and changes some code style. by @aozeyu in https://github.com/bytedance/bitsail/pull/165
In this PR, I removed some redundant code under common and adjusted some formats. by @aozeyu in https://github.com/bytedance/bitsail/pull/167
Add jm example in local deployment. by @BlockLiu in https://github.com/bytedance/bitsail/pull/172
Add Clickhouse connector by @BlockLiu in https://github.com/bytedance/bitsail/pull/161
[BitSail][Connector] Support more send method in Kafka writer by @zeliu in https://github.com/bytedance/bitsail/pull/164
[BitSail][core]Support messenger in source reader. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/173
[BitSail]Supprt bitsail table catalog. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/181
This PR modifies some code formatting by @aozeyu in https://github.com/bytedance/bitsail/pull/182
[BitSail][core]refactor plugin manager. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/189
[BitSail] Add Druid sink connector by @ysamchu in https://github.com/bytedance/bitsail/pull/187
[BitSail][core]fixed row utils high cpu usage issue. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/202
[Doc] Fix typo by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/204
[bitsail-dist]unify connectors mapping file name by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/206
[BitSail][Core]Add more SPI for the core entry by @hk-lrzy in https://github.com/bytedance/bitsail/pull/207
[BitSail][Connector] Support INSERT IGNORE INTO in mysql connector. by @john8628 in https://github.com/bytedance/bitsail/pull/190
[BitSail][Connector] Support hive 2.3.x by @garyli1019 in https://github.com/bytedance/bitsail/pull/208
[DOC] DOC for INSERT IGNORE INTO in mysql connector by @john8628 in https://github.com/bytedance/bitsail/pull/214
Support alias for options. by @BlockLiu in https://github.com/bytedance/bitsail/pull/216
[Bitsail][Docs]Support bitsail website by @BlockLiu in https://github.com/bytedance/bitsail/pull/215
Optimize website by @BlockLiu in https://github.com/bytedance/bitsail/pull/217
[Bitsail][docs]Update wechat QR code. by @BlockLiu in https://github.com/bytedance/bitsail/pull/221
[Bitsail][Docs]Optimize website document structure. by @BlockLiu in https://github.com/bytedance/bitsail/pull/222
doc: add footer by @Klaus1995 in https://github.com/bytedance/bitsail/pull/223
[Bitsail][Docs] Update wechat qr code. by @BlockLiu in https://github.com/bytedance/bitsail/pull/224
[Bitsail][Docs]Update website. by @BlockLiu in https://github.com/bytedance/bitsail/pull/225
[Bitsail][Docs]Fix Slack URL & Add Official website to README.md. by @love-star in https://github.com/bytedance/bitsail/pull/227
[BitSail][Test] Add Hbase test container in bitsail-test by @zeliu in https://github.com/bytedance/bitsail/pull/230
[BitSail] support compile with java11 by @garyli1019 in https://github.com/bytedance/bitsail/pull/231
[BitSail][Connectors] Support template in RowBuilder. by @BlockLiu in https://github.com/bytedance/bitsail/pull/233
[BitSail][Docs] Add guides for contributing documents. by @BlockLiu in https://github.com/bytedance/bitsail/pull/240
[BitSail][Connector] Migrate ftp legacy connector to V1 interface by @zeliu in https://github.com/bytedance/bitsail/pull/211
[BitSail][Docs] Update License. by @BlockLiu in https://github.com/bytedance/bitsail/pull/239
Update build.sh by @BlockLiu in https://github.com/bytedance/bitsail/pull/260
Update blog.md by @yucongcong654 in https://github.com/bytedance/bitsail/pull/259
[BitSail][Docs]Add FAQ document and footer to website. by @love-star in https://github.com/bytedance/bitsail/pull/234
[BitSail][Test] Add Hadoop minicluster util in bitsail-test. by @love-star in https://github.com/bytedance/bitsail/pull/237
[BitSail][Connector] Redis writer supports HMSET command. by @liugddx in https://github.com/bytedance/bitsail/pull/261
doc: Documentation typo fixes by @aozeyu in https://github.com/bytedance/bitsail/pull/264
[BitSail][Doc] Show faq document in sidebar. by @BlockLiu in https://github.com/bytedance/bitsail/pull/270
[BitSail][core]remove useless dependencies in core-enrty module. by @hk-lrzy in https://github.com/bytedance/bitsail/pull/271
[BitSail-272][Doc] Add document for ClickHouse connector by @healchow in https://github.com/bytedance/bitsail/pull/273
[BitSail-269][Doc] Adjust the directory structure of documents by @healchow in https://github.com/bytedance/bitsail/pull/276
[BitSail][Connector]Support int128, int256 in ClickhouseSourceReader by @LeeeeLiu in https://github.com/bytedance/bitsail/pull/274
[BitSail][Docs] correct the jump link in documents. by @ayonel in https://github.com/bytedance/bitsail/pull/284
Bitsail plugin finder update by @hk-lrzy in https://github.com/bytedance/bitsail/pull/286
[BitSail][Connector] Support Assert sink connector by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/282
Fix null statistics. by @BlockLiu in https://github.com/bytedance/bitsail/pull/287
[BitSail][Docs] fix code highlight by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/285
[BitSail][connector]Doris Connector add 2pc stream load by @DongLiang-0 in https://github.com/bytedance/bitsail/pull/289
[BitSail-300][Docs] Add Docs for Assert Sink Connector by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/301
[BitSail-296][Pom] Remove the duplicated dependency of logback by @healchow in https://github.com/bytedance/bitsail/pull/297
[BitSail][Connector] Support more charset in FtpInputFormat by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/304
Bitsail package conversion by @hk-lrzy in https://github.com/bytedance/bitsail/pull/291
[BitSail][Docs] Fix website favicon by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/314
[BitSail][Connector] Support auto get column schema in JdbcInputFormat by @liuxiaocs7 in https://github.com/bytedance/bitsail/pull/315
fix issue #263:Add docs for Connectors missing from the doc (Fake/Print) by @kyle-hawk in https://github.com/bytedance/bitsail/pull/303
[BitSail][Improve]Add compile plugin. by @BlockLiu in https://github.com/bytedance/bitsail/pull/318

New Contributors

@garyli1019 made their first contribution in https://github.com/bytedance/bitsail/pull/2
@BlockLiu made their first contribution in https://github.com/bytedance/bitsail/pull/8
@lujg made their first contribution in https://github.com/bytedance/bitsail/pull/12
@ysamchu made their first contribution in https://github.com/bytedance/bitsail/pull/25
@lichang-bd made their first contribution in https://github.com/bytedance/bitsail/pull/39
@ZhaoXinlong made their first contribution in https://github.com/bytedance/bitsail/pull/59
@ayonel made their first contribution in https://github.com/bytedance/bitsail/pull/63
@laglangyue made their first contribution in https://github.com/bytedance/bitsail/pull/67
@jliao07 made their first contribution in https://github.com/bytedance/bitsail/pull/73
@yanghuaiGit made their first contribution in https://github.com/bytedance/bitsail/pull/95
@love-star made their first contribution in https://github.com/bytedance/bitsail/pull/98
@NiuXiangQian made their first contribution in https://github.com/bytedance/bitsail/pull/150
@aozeyu made their first contribution in https://github.com/bytedance/bitsail/pull/165
@zeliu made their first contribution in https://github.com/bytedance/bitsail/pull/164
@liuxiaocs7 made their first contribution in https://github.com/bytedance/bitsail/pull/204
@john8628 made their first contribution in https://github.com/bytedance/bitsail/pull/190
@Klaus1995 made their first contribution in https://github.com/bytedance/bitsail/pull/223
@yucongcong654 made their first contribution in https://github.com/bytedance/bitsail/pull/259
@liugddx made their first contribution in https://github.com/bytedance/bitsail/pull/261
@healchow made their first contribution in https://github.com/bytedance/bitsail/pull/273
@LeeeeLiu made their first contribution in https://github.com/bytedance/bitsail/pull/274
@DongLiang-0 made their first contribution in https://github.com/bytedance/bitsail/pull/289
@kyle-hawk made their first contribution in https://github.com/bytedance/bitsail/pull/303

Full Changelog: https://github.com/bytedance/bitsail/commits/release-0.1.0