Spark Cassandra Connector Versions Save

DataStax Connector for Apache Spark to Apache Cassandra

v3.5.0

2 months ago

3.5.0

  • Support for Apache Spark 3.5 (SPARKC-704)
  • Fix: Projection of Sub Elements (SPARKC-699)

v3.4.1

8 months ago

Scala 2.13 support (SPARKC-686)

v3.4.0

10 months ago
  • Spark 3.4.x support (SPARKC-702)
  • Fix complex field extractor after join on CassandraDirectJoinStrategy (SPARKC-700)

v3.3.0

1 year ago
  • Spark 3.3.x support - Scala 2.12 (SPARKC-693)
  • Materialized View read support fix (SPARKC-653)
  • Fix Direct Join projection collapse (SPARKC-695)
  • Fix mixed case column names in Direct Join (SPARKC-682)

v3.2.0

2 years ago
  • Spark 3.2.x support (SPARKC-670)
  • Fix: Cassandra Direct Join doesn't quote keyspace and table names (SPARKC-667)
  • Fix: The connector can't find a codec for BLOB <-> java.nio.HeapByteBuffer (SPARKC-673)

v3.1.0

2 years ago
  • Updated Spark to 3.1.1 and commons-lang to 3.10 (SPARKC-626, SPARKC-646)
  • UDTValue performance fix (SPARKC-647)
  • update java driver to 4.12.0 (SPARKC-656)

v3.0.1

3 years ago

Includes all 2.5.2 changes and one additional fix:

  • Fix: repeated metadata refresh with the Spark connector (SPARKC-633)

v2.5.2

3 years ago
  • C* 4.0-beta compatibility (SPARKC-615)
  • Storage Attached Index (SAI) support (SPARKC-621)
  • Java Driver upgraded to 4.10 (SPARKC-637)
  • Asynchronous page fetching (SPARKC-619)
  • Cassandra Direct Join in the Spark SQL (SPARKC-613)
  • Fix: ContinuousPaging settings are ignored (SPARKC-606)
  • Fix: spark.cassandra.input.readsPerSec doesn't work for CassandraJoinRDD (SPARKC-627)
  • Fix: repartitionByCassandraReplica relocates data to the local node only (SPARKC-642)
  • Fix: Custom ConnectionFactory properties are ignored in per-cluster setups (SPARKC-635)

v3.0.0

3 years ago
  • Scala 2.12 release
  • Spark 3.0.x support
  • Data Source v2 support
  • Cassandra 4.0.0-beta support
  • Includes all Datastax Specific Features
  • Includes shaded version of the main artifact

v2.5.1

3 years ago

2.5.1 LTS Release for Spark 2.4

  • Include all DS Specific Features
    • Includes CassandraHiveMetastore
    • Structured Streaming Sink Support
    • DirectJoin Catalyst Optimziation
    • Ttl and Writetime functions for Dataframes
    • Astra and Java Driver 4.0 Support
    • InJoin Optimizations
    • Read Throttle
    • Continuous Paging For DSE Clusters
    • More
  • Introduce shaded version of the main artifact