Skip to content

Commit

Permalink
Update base to 7.2.2, the connector images to the latest and add Spoo…
Browse files Browse the repository at this point in the history
…ldir connector (banzaicloud#3)
  • Loading branch information
bartam1 authored Oct 15, 2022
1 parent e786c72 commit 1d1a1e6
Show file tree
Hide file tree
Showing 2 changed files with 35 additions and 11 deletions.
25 changes: 14 additions & 11 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,17 +1,20 @@
ARG CP_KAFKA_CONNECT_BASE_VERSION=6.0.1
ARG CP_KAFKA_CONNECT_BASE_VERSION=7.2.2

FROM confluentinc/cp-kafka-connect-base:$CP_KAFKA_CONNECT_BASE_VERSION

ENV COMPONENT=kafka-connect
ENV CONNECT_PLUGIN_PATH=/usr/share/java,/usr/share/confluent-hub-components

ARG CONFLUENTINC_JDBC_CONNECTOR_VERSION=10.0.1
ARG CONFLUENTINC_HDFS_CONNECTOR_VERSION=10.0.0
ARG CONFLUENTINC_ELASTICSEARCH_CONNECTOR_VERSION=11.0.0
ARG CONFLUENTINC_S3_CONNECTOR_VERSION=5.5.3
ARG CONFLUENTINC_AVRO_CONVERTER_CONNECTOR_VERSION=5.5.3
ARG CONFLUENTINC_JDBC_CONNECTOR_VERSION=10.5.4
ARG CONFLUENTINC_HDFS_CONNECTOR_VERSION=10.1.13
ARG CONFLUENTINC_ELASTICSEARCH_CONNECTOR_VERSION=14.0.2
ARG CONFLUENTINC_S3_CONNECTOR_VERSION=10.2.2
ARG CONFLUENTINC_AVRO_CONVERTER_CONNECTOR_VERSION=7.2.2
ARG JCUSTENBORDER_SPOOL_CONNECTOR_VERSION=2.0.64

RUN confluent-hub install --no-prompt confluentinc/kafka-connect-jdbc:$CONFLUENTINC_JDBC_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-hdfs:$CONFLUENTINC_HDFS_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-elasticsearch:$CONFLUENTINC_ELASTICSEARCH_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-s3:$CONFLUENTINC_S3_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-avro-converter:$CONFLUENTINC_AVRO_CONVERTER_CONNECTOR_VERSION
RUN confluent-hub install --no-prompt confluentinc/kafka-connect-hdfs:$CONFLUENTINC_HDFS_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-jdbc:$CONFLUENTINC_JDBC_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt jcustenborder/kafka-connect-spooldir:$JCUSTENBORDER_SPOOL_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-elasticsearch:$CONFLUENTINC_ELASTICSEARCH_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-s3:$CONFLUENTINC_S3_CONNECTOR_VERSION \
&& confluent-hub install --no-prompt confluentinc/kafka-connect-avro-converter:$CONFLUENTINC_AVRO_CONVERTER_CONNECTOR_VERSION
21 changes: 21 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,3 +9,24 @@ The following connectors from [Confluent Hub](https://www.confluent.io/hub/) are
- Kafka Connect Elasticsearch
- Amazon S3 Sink Connector
- Kafka Connect Avro Converter
- Kafka Connect Spooldir (https://docs.confluent.io/kafka-connectors/spooldir/current/overview.html)

Available connector classes in the latest build are:

- io.confluent.connect.elasticsearch.ElasticsearchSinkConnector
- io.confluent.connect.hdfs.HdfsSinkConnector
- io.confluent.connect.jdbc.JdbcSinkConnector
- io.confluent.connect.s3.S3SinkConnector
- com.github.jcustenborder.kafka.connect.spooldir.SpoolDirAvroSourceConnector
- com.github.jcustenborder.kafka.connect.spooldir.SpoolDirBinaryFileSourceConnector
- com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector
- com.github.jcustenborder.kafka.connect.spooldir.SpoolDirJsonSourceConnector
- com.github.jcustenborder.kafka.connect.spooldir.SpoolDirLineDelimitedSourceConnector
- com.github.jcustenborder.kafka.connect.spooldir.SpoolDirSchemaLessJsonSourceConnector
- com.github.jcustenborder.kafka.connect.spooldir.elf.SpoolDirELFSourceConnector
- io.confluent.connect.hdfs.tools.SchemaSourceConnector
- io.confluent.connect.jdbc.JdbcSourceConnector
- io.confluent.connect.storage.tools.SchemaSourceConnector
- org.apache.kafka.connect.mirror.MirrorCheckpointConnector
- org.apache.kafka.connect.mirror.MirrorHeartbeatConnector
- org.apache.kafka.connect.mirror.MirrorSourceConnector

0 comments on commit 1d1a1e6

Please sign in to comment.