Skip to content

Releases: exasol/spark-connector-common-java

2.0.0: Added Spark filter converter

01 Aug 11:04
401d500
Compare
Choose a tag to compare

Summary

In this release we added a common class to convert Apache Spark filter expressions into Exasol SQL WHERE clauses. This helps to enrich the user queries and push the predicate conditions down to the Exasol database.

Features

  • #18: Added Spark filter converter implementation

Dependency Updates

Test Dependency Updates

  • Updated com.exasol:exasol-testcontainers:6.6.0 to 6.6.1
  • Updated nl.jqno.equalsverifier:equalsverifier:3.14.3 to 3.15
  • Updated org.junit.jupiter:junit-jupiter-api:5.9.3 to 5.10.0
  • Updated org.junit.jupiter:junit-jupiter:5.9.3 to 5.10.0

Plugin Dependency Updates

  • Updated com.exasol:error-code-crawler-maven-plugin:1.2.3 to 1.3.0
  • Updated com.exasol:project-keeper-maven-plugin:2.9.7 to 2.9.9
  • Updated org.apache.maven.plugins:maven-failsafe-plugin:3.0.0 to 3.1.2
  • Updated org.apache.maven.plugins:maven-gpg-plugin:3.0.1 to 3.1.0
  • Updated org.apache.maven.plugins:maven-surefire-plugin:3.0.0 to 3.1.2
  • Updated org.basepom.maven:duplicate-finder-maven-plugin:1.5.1 to 2.0.1
  • Updated org.codehaus.mojo:flatten-maven-plugin:1.4.1 to 1.5.0
  • Updated org.codehaus.mojo:versions-maven-plugin:2.15.0 to 2.16.0
  • Updated org.jacoco:jacoco-maven-plugin:0.8.9 to 0.8.10

1.1.1: Refactored `ExasolOptions` class to be `Serializable`.

03 Jul 12:45
87a5aae
Compare
Choose a tag to compare

Summary

Update the ExasolOptions to be serializable since Spark 3.3 with Scala 2.12 version requires the class to implement Serializable interface.

Features

  • #16: Refactored ExasolOptions class to be serializable

1.1.0: Added additional user parameters

28 Jun 12:00
3605820
Compare
Choose a tag to compare

Summary

This release supports additional user provided parameters.

Features

  • #14: Added additional user parameters

Dependency Updates

Compile Dependency Updates

  • Added com.exasol:error-reporting-java8:1.0.1
  • Added com.exasol:exasol-jdbc:7.1.20
  • Added com.exasol:sql-statement-builder-java8:4.5.4

Test Dependency Updates

  • Added com.exasol:exasol-testcontainers:6.6.0
  • Added com.exasol:hamcrest-resultset-matcher:1.6.0
  • Added com.exasol:java-util-logging-testing:2.0.3
  • Added com.exasol:test-db-builder-java:3.4.2
  • Added com.fasterxml.jackson.core:jackson-core:2.15.2
  • Added nl.jqno.equalsverifier:equalsverifier:3.14.3
  • Added org.hamcrest:hamcrest:2.2
  • Added org.junit.jupiter:junit-jupiter-api:5.9.3
  • Added org.junit.jupiter:junit-jupiter:5.9.3
  • Added org.mockito:mockito-core:5.4.0
  • Added org.mockito:mockito-junit-jupiter:5.4.0
  • Added org.testcontainers:junit-jupiter:1.18.3

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:1.2.3
  • Added com.exasol:project-keeper-maven-plugin:2.9.7
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.11.0
  • Added org.apache.maven.plugins:maven-deploy-plugin:3.1.1
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.3.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.0.0
  • Added org.apache.maven.plugins:maven-gpg-plugin:3.0.1
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-javadoc-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-source-plugin:3.2.1
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.0.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:1.5.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.4.1
  • Added org.codehaus.mojo:versions-maven-plugin:2.15.0
  • Added org.jacoco:jacoco-maven-plugin:0.8.9
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0
  • Added org.sonatype.plugins:nexus-staging-maven-plugin:1.6.13

1.0.1: Fixed Dependency Scope

28 Jun 12:00
3605820
Compare
Choose a tag to compare

Summary

In this release we changed the scope of Spark dependency from compile to provided. We indented to use provided scope so that users of dependency could use their own version of Spark.

Bugs

  • #12: Fixed Dependency Scope

Dependency Updates

Compile Dependency Updates

  • Added com.exasol:error-reporting-java8:1.0.1
  • Added com.exasol:exasol-jdbc:7.1.20
  • Added com.exasol:sql-statement-builder-java8:4.5.4

Test Dependency Updates

  • Added com.exasol:exasol-testcontainers:6.6.0
  • Added com.exasol:hamcrest-resultset-matcher:1.6.0
  • Added com.exasol:java-util-logging-testing:2.0.3
  • Added com.exasol:test-db-builder-java:3.4.2
  • Added com.fasterxml.jackson.core:jackson-core:2.15.2
  • Added nl.jqno.equalsverifier:equalsverifier:3.14.2
  • Added org.hamcrest:hamcrest:2.2
  • Added org.junit.jupiter:junit-jupiter-api:5.9.3
  • Added org.junit.jupiter:junit-jupiter:5.9.3
  • Added org.mockito:mockito-core:5.3.1
  • Added org.mockito:mockito-junit-jupiter:5.3.1
  • Added org.testcontainers:junit-jupiter:1.18.3

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:1.2.3
  • Added com.exasol:project-keeper-maven-plugin:2.9.7
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.11.0
  • Added org.apache.maven.plugins:maven-deploy-plugin:3.1.1
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.3.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.0.0
  • Added org.apache.maven.plugins:maven-gpg-plugin:3.0.1
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-javadoc-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-source-plugin:3.2.1
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.0.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:1.5.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.4.1
  • Added org.codehaus.mojo:versions-maven-plugin:2.15.0
  • Added org.jacoco:jacoco-maven-plugin:0.8.9
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0
  • Added org.sonatype.plugins:nexus-staging-maven-plugin:1.6.13

1.0.0: Initial Release

28 Jun 12:00
3605820
Compare
Choose a tag to compare

Summary

This is a initial release of the common library that provides helper classes for Exasol Spark based connectors.

Features

  • #1: Added Exasol data types to the Spark schema conversion
  • #2: Added column description helper class
  • #4: Updated developer guide
  • #6: Added import query generator interface
  • #7: Added export query generator interface
  • #9: Moved options class from Spark connector

Dependency Updates

Compile Dependency Updates

  • Added com.exasol:error-reporting-java8:1.0.1
  • Added com.exasol:exasol-jdbc:7.1.20
  • Added com.exasol:sql-statement-builder-java8:4.5.4
  • Added org.apache.spark:spark-sql_2.13:3.4.0
  • Added org.scala-lang:scala-library:2.13.11

Test Dependency Updates

  • Added com.exasol:exasol-testcontainers:6.6.0
  • Added com.exasol:hamcrest-resultset-matcher:1.6.0
  • Added com.exasol:java-util-logging-testing:2.0.3
  • Added com.exasol:test-db-builder-java:3.4.2
  • Added com.fasterxml.jackson.core:jackson-core:2.15.2
  • Added nl.jqno.equalsverifier:equalsverifier:3.14.2
  • Added org.hamcrest:hamcrest:2.2
  • Added org.junit.jupiter:junit-jupiter-api:5.9.3
  • Added org.junit.jupiter:junit-jupiter:5.9.3
  • Added org.mockito:mockito-core:5.3.1
  • Added org.mockito:mockito-junit-jupiter:5.3.1
  • Added org.testcontainers:junit-jupiter:1.18.3

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:1.2.3
  • Added com.exasol:project-keeper-maven-plugin:2.9.7
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.11.0
  • Added org.apache.maven.plugins:maven-deploy-plugin:3.1.1
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.3.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.0.0
  • Added org.apache.maven.plugins:maven-gpg-plugin:3.0.1
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-javadoc-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-source-plugin:3.2.1
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.0.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:1.5.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.4.1
  • Added org.codehaus.mojo:versions-maven-plugin:2.15.0
  • Added org.jacoco:jacoco-maven-plugin:0.8.9
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0
  • Added org.sonatype.plugins:nexus-staging-maven-plugin:1.6.13