Tispark Versions Save

What's Changed

• delete trove4j (#2732) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2737
• Fix TiFlash overflow (#2740) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2744
• OWNERS: Auto Sync OWNERS files from community membership (#2723) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2755
• fix doc by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2763
• Expose preferred locations config by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2762
• Fix escape for StringRegExpression (#2775) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2776
• Retry for range exceed error by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2774
• 3.2.3 by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2778

Full Changelog: https://github.com/pingcap/tispark/compare/v3.2.2...v3.2.3

What's Changed

• Fix TiFlash overflow with unsigned bigint (#2740) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2743
• Relealse 3.1.5 by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2749

Full Changelog: https://github.com/pingcap/tispark/compare/v3.1.4...v3.1.5

What's Changed

• Update expired cert (#2675) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2680
• Disable jackson FAIL_ON_UNKNOWN_PROPERTIES (#2690) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2693
• Set daemon thread to fix jvm not exit (#2698) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2699
• release-3.1.4 by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2739

Full Changelog: https://github.com/pingcap/tispark/compare/v3.1.3...v3.1.4

What's Changed

• Set daemon thread to fix JVM not exiting (#2698) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2700
• Add health check timeout (#2703) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2706
• Retry when the store is down in TiSpark layer (#2710) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2714
• uprade client-java version to 3.3.5 to fix fail to query from TiFlash in (#2715) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2716
• release-3.2.2 by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2717

Full Changelog: https://github.com/pingcap/tispark/compare/v3.2.1...v3.2.2

What's Changed

• Support follower read fallback tikv/client-java #724
• Set default value of spark.tispark.telemetry.enable as false (#2621) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2625
• service_safe_point (#2642) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2646
• Probe tiflash (#2640) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2648
• Expose forward and set it to false in default (#2641) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2647
• Fix read from range column partition table error (#2639) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2654
• Fix the bug jvm not exit when enableAuth (#2653) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2664
• fix mutil_uniq (#2650) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2666
• optimize ttl (#2669) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2673
• Update expired cert (#2675) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2681
• Disable jackson FAIL_ON_UNKNOWN_PROPERTIES (#2690) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2694
• Do not reload table schema when update catalog cache (#2667) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2677
• update client-java version to 3.3.4 (#2695) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2696
• update version to 3.2.1 by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2697

Full Changelog: https://github.com/pingcap/tispark/compare/v3.2.0...v3.2.1

What's Changed

• Fix StatisticsManagerSuite by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2612
• Set default value of spark.tispark.telemetry.enable as false (#2621) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2624
• Support probe tiflash status by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2619
• Support service safe point by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2634
• Fix read from range column partition table error (#2639) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2658
• Support fallback when resolveLockAsync by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2651
• Fix the bug jvm not exit when enableAuth (#2653) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2663
• fix mutil_uniq (#2650) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2665
• optimize ttl (#2669) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2672
• Do not reload table schema when update catalog cache (#2667) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2676
• update version to 3.1.3 by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2685

Full Changelog: https://github.com/pingcap/tispark/compare/v3.1.2...v3.1.3

What's Changed

• change relase-3.0 version to 3.0.3-snapshot by @qidi1 in https://github.com/pingcap/tispark/pull/2535
• Enhancement CBO (#2563) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2567
• Select tiflash with RR strategy (#2576) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2583
• fix statistics (#2578) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2588
• Optimize region not find (#2575) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2597
• Compatible with TiDB mater (v6.5.0) (#2598) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2605
• Avoid plan be truncated in test (#2613) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2614
• Fix StatisticsManagerSuite (#2612) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2618
• Fix cacheInvalidateCallback does not work by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2626
• Set default value of spark.tispark.telemetry.enable as false (#2621) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2623
• Support probe tiflash status (#2619) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2635
• Support service safe point (#2634) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2645
• Fix read from range column partition table error (#2639) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2657
• Fix the bug jvm not exit when enableAuth (#2653) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2662
• optimize ttl (#2669) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2671
• Do not reload table schema when update catalog cache (#2667) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2678
• update version to 3.0.3 by @shiyuhang0 in https://github.com/pingcap/tispark/pull/2686

Full Changelog: https://github.com/pingcap/tispark/compare/v3.0.2...v3.0.3

What's Changed

• Set default value of spark.tispark.telemetry.enable as false (#2621) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2625
• service_safe_point (#2642) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2646
• Probe tiflash (#2640) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2648
• Expose forward and set it to false in default (#2641) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2647
• Fix read from range column partition table error (#2639) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2654
• Fix the bug jvm not exit when enableAuth (#2653) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2664
• fix mutil_uniq (#2650) by @ti-chi-bot in https://github.com/pingcap/tispark/pull/2666

Full Changelog: https://github.com/pingcap/tispark/compare/v3.2.0...v3.2.1-RC1

New Features

• Normalize the Java client in TiSpark and use the official client-java #2491
• Compatible with TiDB v6.5.0 #2598
• Support writing into the table with auto random primary key #2545
• Support follower read #2546
• Support writing into partition table with new collations #2565
• Support partition pruning with to_days function when read from TiKV/TiFlash #2593
• Support reading TiFlash load balancing with Round-Robin strategy client-java #662

Fixes

• Bump Spark version from 3.0.2 to 3.0.3, from 3.1.1 to 3.1.3, from 3.2.1 to 3.2.3, from 3.3.0 to 3.3.1 #2544 #2607
• Fix break change in partition read. For example, to_days is not supported #2552
• Fix exception will be thrown when we insert into a table partitioned by year and the first col of the table is not date type #2554
• Fix the bug that cluster index can not be used if the clustered index is not the Integer type #2560
• Fix the bug that CBO may not choose min cost between TiKV table scan, TiKV index scan, and TiFlash scan #2563
• Fix the bug that statistics are not collected which may affect the choice of the plan #2578
• Fix the bug that partition pruning fails with the uppercase column #2593

Documents

• Optimize user guide and dev guide #2533

New Features

• Support write into partition table with new collations #2570
• Support read TiFlash load balancing with Round-Robin strategy #2576
• Support partition pruning with to_days function when read from TiKV/TiFlash #2594 #2600

Fixes

• Fix CBO to let TiSpark choose the min cost between TiKV table scan, TiKV index scan and TiFlash scan correctly #2568
• Fix the region not find error when reading from TiKV #2575
• Fix the bug that statistics is not collected which may affect the choice of plans #2589
• Compatible with TiDB v6.5.0 #2602