BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
spark-2.4-bigquery
version won't be released as Spark 2.4 is
well-supported by the spark-bigquery-with-dependencies
connectors.spark-3.5-bigquery
aimed to be used in Spark 3.5. This connector implements new APIs and capabilities provided by the Spark Data Source V2 API.SparkListenerEvent
s for Query and Load jobs running on BigQueryspark-3.4-bigquery
aimed to be used in Spark 3.4 and above. This connector implements new APIs and capabilities provided by the Spark Data Source V2 API.