Strimzi
KafkaMirrorMaker2 create failed #4237
lanzhiwang
started this conversation in
General
Replies: 3 comments 3 replies
-
|
The log from Mirror Maker does not suggest any error. So I have no clue why it is crash looping. Are you sure this is the complete log? |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I compared the correct log, I think it may be related to these warnings abnormal cluster: normal cluster : |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
I'm not sure what the warnings mean, but I'm not convinced they would be related. They do not seem like any runtime issue to me. |
Beta Was this translation helpful? Give feedback.
-
|
There are some messages about issues with joining the group. But not sure that would stop it since it is INFO only. |
Beta Was this translation helpful? Give feedback.
-
|
Will it be related to the election of control nodes inside the Kafka cluster? |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
If there is no controller it could probably cause problems. If the controller just changes I do not think that should crash loop anything. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
In order to test the function of KafkaMirrorMaker2, I created the simplest kafka and KafkaMirrorMaker2 in the same k8s cluster.
The created pod is always in CrashLoopBackOff state, and the three topics of
heartbeats,mm2-offset-syncs.my-cluster-target.internal, andmy-cluster-source.checkpoints.internalcannot be successfully created automatically.pod log:
$ kubectl -n xxli describe pods my-mm2-cluster-mirrormaker2-7c7b6d5d54-qplsc Name: my-mm2-cluster-mirrormaker2-7c7b6d5d54-qplsc Namespace: xxli Priority: 0 Node: 192.168.34.154/192.168.34.154 Start Time: Wed, 13 Jan 2021 21:17:06 +0800 Labels: app.kubernetes.io/instance=my-mm2-cluster app.kubernetes.io/managed-by=strimzi-cluster-operator app.kubernetes.io/name=kafka-mirror-maker-2 app.kubernetes.io/part-of=strimzi-my-mm2-cluster pod-template-hash=7c7b6d5d54 strimzi.io/cluster=my-mm2-cluster strimzi.io/kind=KafkaMirrorMaker2 strimzi.io/name=my-mm2-cluster-mirrormaker2 Annotations: kubernetes.io/psp: 20-user-restricted ovn.kubernetes.io/allocated: true ovn.kubernetes.io/cidr: 10.3.0.0/16 ovn.kubernetes.io/gateway: 10.3.0.1 ovn.kubernetes.io/ip_address: 10.3.8.175 ovn.kubernetes.io/logical_switch: ovn-default ovn.kubernetes.io/mac_address: 00:00:00:DA:B8:4B ovn.kubernetes.io/network_types: geneve ovn.kubernetes.io/routed: true strimzi.io/logging: # Do not change this generated file. Logging can be configured in the corresponding kubernetes/openshift resource. log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender log4j.appender.CONSOLE.layout=org.apache.log4j.PatternLayout log4j.appender.CONSOLE.layout.ConversionPattern=%d{ISO8601} %p %m (%c) [%t]%n connect.root.logger.level=INFO log4j.rootLogger=${connect.root.logger.level}, CONSOLE log4j.logger.org.apache.zookeeper=ERROR log4j.logger.org.I0Itec.zkclient=ERROR log4j.logger.org.reflections=ERROR Status: Running IP: 10.3.8.175 IPs: IP: 10.3.8.175 Controlled By: ReplicaSet/my-mm2-cluster-mirrormaker2-7c7b6d5d54 Containers: my-mm2-cluster-mirrormaker2: Container ID: docker://2c66493c7d7521fc36c943684180f64b81ac6145cc6b55618f13344215701ebc Image: 192.168.34.233:60080/tdsql/kafka/release/0.18.0/kafka:0.18.0-kafka-2.5.0 Image ID: docker-pullable://192.168.34.233:60080/tdsql/kafka/release/0.18.0/kafka@sha256:58244d8b1922b8630d5fc1079bd0c5ace32dcd37e6004fd8dfff9814b3b96e6f Port: 8083/TCP Host Port: 0/TCP Command: /opt/kafka/kafka_mirror_maker_2_run.sh State: Waiting Reason: CrashLoopBackOff Last State: Terminated Reason: Completed Exit Code: 0 Started: Wed, 13 Jan 2021 21:30:24 +0800 Finished: Wed, 13 Jan 2021 21:31:49 +0800 Ready: False Restart Count: 7 Liveness: http-get http://:rest-api/ delay=60s timeout=5s period=10s #success=1 #failure=3 Readiness: http-get http://:rest-api/ delay=60s timeout=5s period=10s #success=1 #failure=3 Environment: KAFKA_CONNECT_CONFIGURATION: config.storage.topic=mirrormaker2-cluster-configs group.id=mirrormaker2-cluster status.storage.topic=mirrormaker2-cluster-status config.providers.file.class=org.apache.kafka.common.config.provider.FileConfigProvider offset.storage.topic=mirrormaker2-cluster-offsets config.providers=file value.converter=org.apache.kafka.connect.converters.ByteArrayConverter key.converter=org.apache.kafka.connect.converters.ByteArrayConverter config.storage.replication.factor=1 offset.storage.replication.factor=1 status.storage.replication.factor=1 KAFKA_CONNECT_METRICS_ENABLED: false KAFKA_CONNECT_BOOTSTRAP_SERVERS: my-cluster-target-kafka-bootstrap:9092 STRIMZI_KAFKA_GC_LOG_ENABLED: false KAFKA_HEAP_OPTS: -Xms128M KAFKA_MIRRORMAKER_2_CLUSTERS: my-cluster-source;my-cluster-target Mounts: /opt/kafka/custom-config/ from kafka-metrics-and-logging (rw) /var/run/secrets/kubernetes.io/serviceaccount from my-mm2-cluster-mirrormaker2-token-fbr65 (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: kafka-metrics-and-logging: Type: ConfigMap (a volume populated by a ConfigMap) Name: my-mm2-cluster-mirrormaker2-config Optional: false my-mm2-cluster-mirrormaker2-token-fbr65: Type: Secret (a volume populated by a Secret) SecretName: my-mm2-cluster-mirrormaker2-token-fbr65 Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute for 30s node.kubernetes.io/unreachable:NoExecute for 30s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled <unknown> default-scheduler Successfully assigned xxli/my-mm2-cluster-mirrormaker2-7c7b6d5d54-qplsc to 192.168.34.154 Normal Pulled 15m (x3 over 18m) kubelet, 192.168.34.154 Container image "192.168.34.233:60080/tdsql/kafka/release/0.18.0/kafka:0.18.0-kafka-2.5.0" already present on machine Normal Created 15m (x3 over 18m) kubelet, 192.168.34.154 Created container my-mm2-cluster-mirrormaker2 Normal Started 15m (x3 over 18m) kubelet, 192.168.34.154 Started container my-mm2-cluster-mirrormaker2 Normal Killing 15m (x2 over 16m) kubelet, 192.168.34.154 Container my-mm2-cluster-mirrormaker2 failed liveness probe, will be restarted Warning Unhealthy 13m (x6 over 17m) kubelet, 192.168.34.154 Readiness probe failed: Get http://10.3.8.175:8083/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Warning Unhealthy 8m6s (x19 over 17m) kubelet, 192.168.34.154 Liveness probe failed: Get http://10.3.8.175:8083/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Warning BackOff 3m9s (x18 over 7m46s) kubelet, 192.168.34.154 Back-off restarting failed container [root@arm-region-0003 ~]# $ kubectl -n xxli describe KafkaMirrorMaker2 my-mm2-cluster Name: my-mm2-cluster Namespace: xxli Labels: <none> Annotations: <none> API Version: kafka.strimzi.io/v1alpha1 Kind: KafkaMirrorMaker2 Metadata: Creation Timestamp: 2021-01-13T13:17:06Z Generation: 1 Resource Version: 444648 Self Link: /apis/kafka.strimzi.io/v1alpha1/namespaces/xxli/kafkamirrormaker2s/my-mm2-cluster UID: c4acf972-0c5d-4cdb-85d8-dbbc04c84968 Spec: Clusters: Alias: my-cluster-source Bootstrap Servers: my-cluster-source-kafka-bootstrap:9092 Alias: my-cluster-target Bootstrap Servers: my-cluster-target-kafka-bootstrap:9092 Config: config.storage.replication.factor: 1 offset.storage.replication.factor: 1 status.storage.replication.factor: 1 Connect Cluster: my-cluster-target Mirrors: Checkpoint Connector: Config: checkpoints.topic.replication.factor: 1 Groups Pattern: .* Heartbeat Connector: Config: heartbeats.topic.replication.factor: 1 Source Cluster: my-cluster-source Source Connector: Config: offset-syncs.topic.replication.factor: 1 replication.factor: 1 sync.topic.acls.enabled: false Target Cluster: my-cluster-target Topics Pattern: .* Replicas: 1 Version: 2.5.0 Status: Conditions: Last Transition Time: 2021-01-13T13:22:07.584Z Message: Exceeded timeout of 300000ms while waiting for Deployment resource my-mm2-cluster-mirrormaker2 in namespace xxli to be ready Reason: TimeoutException Status: True Type: NotReady Observed Generation: 1 URL: http://my-mm2-cluster-mirrormaker2-api.xxli.svc:8083 Events: <none> $ kubectl -n xxli logs my-mm2-cluster-mirrormaker2-7c7b6d5d54-qplsc Preparing MirrorMaker 2.0 cluster truststores and keystores Preparing MirrorMaker 2.0 truststores and keystores for cluster my-cluster-source with trusted certs with tls auth certs with tls auth keys Preparing MirrorMaker 2.0 truststores and keystores for cluster my-cluster-target with trusted certs with tls auth certs with tls auth keys Preparing MirrorMaker 2.0 cluster truststores is complete Creating connector configuration: Preparing truststore Preparing truststore is complete Starting Kafka Connect with configuration: # Bootstrap servers bootstrap.servers=my-cluster-target-kafka-bootstrap:9092 # REST Listeners rest.port=8083 rest.advertised.host.name=10.3.8.175 rest.advertised.port=8083 # Plugins plugin.path=/opt/kafka/plugins # Provided configuration config.storage.topic=mirrormaker2-cluster-configs group.id=mirrormaker2-cluster status.storage.topic=mirrormaker2-cluster-status config.providers.file.class=org.apache.kafka.common.config.provider.FileConfigProvider offset.storage.topic=mirrormaker2-cluster-offsets config.providers=file value.converter=org.apache.kafka.connect.converters.ByteArrayConverter key.converter=org.apache.kafka.connect.converters.ByteArrayConverter config.storage.replication.factor=1 offset.storage.replication.factor=1 status.storage.replication.factor=1 security.protocol=PLAINTEXT producer.security.protocol=PLAINTEXT consumer.security.protocol=PLAINTEXT admin.security.protocol=PLAINTEXT OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThre ads=N 2021-01-13 13:20:10,941 INFO WorkerInfo values: jvm.args = -Xms128M, -XX:+UseG1GC, -XX:MaxGCPauseMillis=20, -XX:InitiatingHeapOccupancyPercent=35, -XX:+ExplicitGCInvokesConcurrent, -XX:MaxInlineLevel=15, -Djava.awt.headless=true, -Dco m.sun.management.jmxremote, -Dcom.sun.management.jmxremote.authenticate=false, -Dcom.sun.management.jmxremote.ssl=false, -Dkafka.logs.dir=/opt/kafka, -Dlog4j.configuration=file:/opt/kafka/custom -config/log4j.properties jvm.spec = Red Hat, Inc., OpenJDK 64-Bit Server VM, 1.8.0_275, 25.275-b01 jvm.classpath = /opt/kafka/bin/../libs/activation-1.1.1.jar:/opt/kafka/bin/../libs/annotations-13.0.jar:/opt/kafka/bin/../libs/aopalliance-repackaged-2.5.0.jar:/opt/kafka/bin/../libs/arg parse4j-0.7.0.jar:/opt/kafka/bin/../libs/audience-annotations-0.5.0.jar:/opt/kafka/bin/../libs/bcpkix-jdk15on-1.62.jar:/opt/kafka/bin/../libs/bcprov-jdk15on-1.60.jar:/opt/kafka/bin/../libs/commo ns-cli-1.4.jar:/opt/kafka/bin/../libs/commons-lang-2.6.jar:/opt/kafka/bin/../libs/commons-lang3-3.8.1.jar:/opt/kafka/bin/../libs/connect-api-2.5.0.jar:/opt/kafka/bin/../libs/connect-basic-auth-e xtension-2.5.0.jar:/opt/kafka/bin/../libs/connect-file-2.5.0.jar:/opt/kafka/bin/../libs/connect-json-2.5.0.jar:/opt/kafka/bin/../libs/connect-mirror-2.5.0.jar:/opt/kafka/bin/../libs/connect-mirr or-client-2.5.0.jar:/opt/kafka/bin/../libs/connect-runtime-2.5.0.jar:/opt/kafka/bin/../libs/connect-transforms-2.5.0.jar:/opt/kafka/bin/../libs/cruise-control-metrics-reporter-2.0.103.jar:/opt/k afka/bin/../libs/gson-2.8.6.jar:/opt/kafka/bin/../libs/hk2-api-2.5.0.jar:/opt/kafka/bin/../libs/hk2-locator-2.5.0.jar:/opt/kafka/bin/../libs/hk2-utils-2.5.0.jar:/opt/kafka/bin/../libs/jackson-an notations-2.10.2.jar:/opt/kafka/bin/../libs/jackson-core-2.10.2.jar:/opt/kafka/bin/../libs/jackson-databind-2.10.2.jar:/opt/kafka/bin/../libs/jackson-dataformat-csv-2.10.2.jar:/opt/kafka/bin/../ libs/jackson-datatype-jdk8-2.10.2.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.10.2.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.10.2.jar:/opt/kafka/bin/../libs/jackson-module-jax b-annotations-2.10.2.jar:/opt/kafka/bin/../libs/jackson-module-paranamer-2.10.2.jar:/opt/kafka/bin/../libs/jackson-module-scala_2.12-2.10.2.jar:/opt/kafka/bin/../libs/jaeger-client-1.1.0.jar:/op t/kafka/bin/../libs/jaeger-core-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-thrift-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-tracerresolver-1.1.0.jar:/opt/kafka/bin/../libs/jakarta.activation-api-1.2. 1.jar:/opt/kafka/bin/../libs/jakarta.annotation-api-1.3.4.jar:/opt/kafka/bin/../libs/jakarta.inject-2.5.0.jar:/opt/kafka/bin/../libs/jakarta.ws.rs-api-2.1.5.jar:/opt/kafka/bin/../libs/jakarta.xm l.bind-api-2.3.2.jar:/opt/kafka/bin/../libs/javassist-3.22.0-CR2.jar:/opt/kafka/bin/../libs/javassist-3.26.0-GA.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/opt/kafka/bin/../libs/java x.ws.rs-api-2.1.1.jar:/opt/kafka/bin/../libs/jaxb-api-2.3.0.jar:/opt/kafka/bin/../libs/jersey-client-2.28.jar:/opt/kafka/bin/../libs/jersey-common-2.28.jar:/opt/kafka/bin/../libs/jersey-containe r-servlet-2.28.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.28.jar:/opt/kafka/bin/../libs/jersey-hk2-2.28.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.28.jar:/opt/kafka/bin/../li bs/jersey-server-2.28.jar:/opt/kafka/bin/../libs/jetty-client-9.4.24.v20191120.jar:/opt/kafka/bin/../libs/jetty-continuation-9.4.24.v20191120.jar:/opt/kafka/bin/../libs/jetty-http-9.4.24.v201911 20.jar:/opt/kafka/bin/../libs/jetty-io-9.4.24.v20191120.jar:/opt/kafka/bin/../libs/jetty-security-9.4.24.v20191120.jar:/opt/kafka/bin/../libs/jetty-server-9.4.24.v20191120.jar:/opt/kafka/bin/../ libs/jetty-servlet-9.4.24.v20191120.jar:/opt/kafka/bin/../libs/jetty-servlets-9.4.24.v20191120.jar:/opt/kafka/bin/../libs/jetty-util-9.4.24.v20191120.jar:/opt/kafka/bin/../libs/jmx_prometheus_ja vaagent-0.12.0.jar:/opt/kafka/bin/../libs/jopt-simple-5.0.4.jar:/opt/kafka/bin/../libs/json-smart-1.1.1.jar:/opt/kafka/bin/../libs/jsonevent-layout-1.7.jar:/opt/kafka/bin/../libs/kafka-agent.jar :/opt/kafka/bin/../libs/kafka-clients-2.5.0.jar:/opt/kafka/bin/../libs/kafka-log4j-appender-2.5.0.jar:/opt/kafka/bin/../libs/kafka-oauth-client-0.5.0.jar:/opt/kafka/bin/../libs/kafka-oauth-commo n-0.5.0.jar:/opt/kafka/bin/../libs/kafka-oauth-keycloak-authorizer-0.5.0.jar:/opt/kafka/bin/../libs/kafka-oauth-server-0.5.0.jar:/opt/kafka/bin/../libs/kafka-streams-2.5.0.jar:/opt/kafka/bin/../ libs/kafka-streams-examples-2.5.0.jar:/opt/kafka/bin/../libs/kafka-streams-scala_2.12-2.5.0.jar:/opt/kafka/bin/../libs/kafka-streams-test-utils-2.5.0.jar:/opt/kafka/bin/../libs/kafka-tools-2.5.0 .jar:/opt/kafka/bin/../libs/kafka_2.12-2.5.0-sources.jar:/opt/kafka/bin/../libs/kafka_2.12-2.5.0.jar:/opt/kafka/bin/../libs/keycloak-common-10.0.0.jar:/opt/kafka/bin/../libs/keycloak-core-10.0.0 .jar:/opt/kafka/bin/../libs/kotlin-stdlib-1.3.50.jar:/opt/kafka/bin/../libs/kotlin-stdlib-common-1.3.50.jar:/opt/kafka/bin/../libs/libthrift-0.13.0.jar:/opt/kafka/bin/../libs/log4j-1.2.17.jar:/o pt/kafka/bin/../libs/lz4-java-1.7.1.jar:/opt/kafka/bin/../libs/maven-artifact-3.6.3.jar:/opt/kafka/bin/../libs/metrics-core-2.2.0.jar:/opt/kafka/bin/../libs/mirror-maker-agent.jar:/opt/kafka/bin /../libs/netty-buffer-4.1.45.Final.jar:/opt/kafka/bin/../libs/netty-codec-4.1.45.Final.jar:/opt/kafka/bin/../libs/netty-common-4.1.45.Final.jar:/opt/kafka/bin/../libs/netty-handler-4.1.45.Final. jar:/opt/kafka/bin/../libs/netty-resolver-4.1.45.Final.jar:/opt/kafka/bin/../libs/netty-transport-4.1.45.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-epoll-4.1.45.Final.jar:/opt/kafka /bin/../libs/netty-transport-native-unix-common-4.1.45.Final.jar:/opt/kafka/bin/../libs/okhttp-4.2.2.jar:/opt/kafka/bin/../libs/okio-2.2.2.jar:/opt/kafka/bin/../libs/opentracing-api-0.33.0.jar:/ opt/kafka/bin/../libs/opentracing-kafka-client-0.1.12.jar:/opt/kafka/bin/../libs/opentracing-noop-0.33.0.jar:/opt/kafka/bin/../libs/opentracing-tracerresolver-0.1.8.jar:/opt/kafka/bin/../libs/op entracing-util-0.33.0.jar:/opt/kafka/bin/../libs/osgi-resource-locator-1.0.1.jar:/opt/kafka/bin/../libs/paranamer-2.8.jar:/opt/kafka/bin/../libs/plexus-utils-3.2.1.jar:/opt/kafka/bin/../libs/ref lections-0.9.12.jar:/opt/kafka/bin/../libs/rocksdbjni-5.18.3.jar:/opt/kafka/bin/../libs/scala-collection-compat_2.12-2.1.3.jar:/opt/kafka/bin/../libs/scala-java8-compat_2.12-0.9.0.jar:/opt/kafka /bin/../libs/scala-library-2.12.10.jar:/opt/kafka/bin/../libs/scala-logging_2.12-3.9.2.jar:/opt/kafka/bin/../libs/scala-reflect-2.12.10.jar:/opt/kafka/bin/../libs/slf4j-api-1.7.30.jar:/opt/kafka /bin/../libs/slf4j-log4j12-1.7.30.jar:/opt/kafka/bin/../libs/snappy-java-1.1.7.3.jar:/opt/kafka/bin/../libs/tracing-agent.jar:/opt/kafka/bin/../libs/validation-api-2.0.1.Final.jar:/opt/kafka/bin /../libs/zookeeper-3.5.7.jar:/opt/kafka/bin/../libs/zookeeper-jute-3.5.7.jar:/opt/kafka/bin/../libs/zstd-jni-1.4.4-7.jar os.spec = Linux, aarch64, 4.19.36-vhulk1905.1.0.h273.eulerosv2r8.aarch64 os.vcpus = 1 (org.apache.kafka.connect.runtime.WorkerInfo) [main] 2021-01-13 13:20:10,945 INFO Scanning for plugin classes. This might take a moment ... (org.apache.kafka.connect.cli.ConnectDistributed) [main] 2021-01-13 13:20:15,416 INFO Registered loader: sun.misc.Launcher$AppClassLoader@764c12b6 (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,416 INFO Added plugin 'org.apache.kafka.connect.mirror.MirrorSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,416 INFO Added plugin 'org.apache.kafka.connect.file.FileStreamSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,416 INFO Added plugin 'org.apache.kafka.connect.tools.SchemaSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.tools.MockSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.file.FileStreamSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.mirror.MirrorCheckpointConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.tools.VerifiableSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.tools.VerifiableSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.tools.MockSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.mirror.MirrorHeartbeatConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.tools.MockConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,417 INFO Added plugin 'org.apache.kafka.connect.converters.FloatConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.converters.DoubleConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.converters.ByteArrayConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.converters.LongConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.converters.IntegerConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.json.JsonConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.storage.StringConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.converters.ShortConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.storage.SimpleHeaderConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.ReplaceField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.SetSchemaMetadata$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.ReplaceField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.InsertField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.TimestampConverter$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.MaskField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.TimestampRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.RegexRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.HoistField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.ValueToKey' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.MaskField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.Cast$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.Cast$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.ExtractField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.Flatten$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.InsertField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.Flatten$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.SetSchemaMetadata$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.ExtractField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.TimestampConverter$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.transforms.HoistField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.common.config.provider.FileConfigProvider' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,418 INFO Added plugin 'org.apache.kafka.connect.rest.basic.auth.extension.BasicAuthSecurityRestExtension' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [ main] 2021-01-13 13:20:15,419 INFO Added plugin 'org.apache.kafka.connect.connector.policy.AllConnectorClientConfigOverridePolicy' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [m ain] 2021-01-13 13:20:15,419 INFO Added plugin 'org.apache.kafka.connect.connector.policy.PrincipalConnectorClientConfigOverridePolicy' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoad er) [main] 2021-01-13 13:20:15,419 INFO Added plugin 'org.apache.kafka.connect.connector.policy.NoneConnectorClientConfigOverridePolicy' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [ main] 2021-01-13 13:20:15,420 INFO Added aliases 'FileStreamSinkConnector' and 'FileStreamSink' to plugin 'org.apache.kafka.connect.file.FileStreamSinkConnector' (org.apache.kafka.connect.runtime.isol ation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,420 INFO Added aliases 'FileStreamSourceConnector' and 'FileStreamSource' to plugin 'org.apache.kafka.connect.file.FileStreamSourceConnector' (org.apache.kafka.connect.runtim e.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,420 INFO Added aliases 'MirrorCheckpointConnector' and 'MirrorCheckpoint' to plugin 'org.apache.kafka.connect.mirror.MirrorCheckpointConnector' (org.apache.kafka.connect.runt ime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,420 INFO Added aliases 'MirrorHeartbeatConnector' and 'MirrorHeartbeat' to plugin 'org.apache.kafka.connect.mirror.MirrorHeartbeatConnector' (org.apache.kafka.connect.runtime .isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,420 INFO Added aliases 'MirrorSourceConnector' and 'MirrorSource' to plugin 'org.apache.kafka.connect.mirror.MirrorSourceConnector' (org.apache.kafka.connect.runtime.isolatio n.DelegatingClassLoader) [main] 2021-01-13 13:20:15,420 INFO Added aliases 'MockConnector' and 'Mock' to plugin 'org.apache.kafka.connect.tools.MockConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,422 INFO Added aliases 'MockSinkConnector' and 'MockSink' to plugin 'org.apache.kafka.connect.tools.MockSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingC lassLoader) [main] 2021-01-13 13:20:15,422 INFO Added aliases 'MockSourceConnector' and 'MockSource' to plugin 'org.apache.kafka.connect.tools.MockSourceConnector' (org.apache.kafka.connect.runtime.isolation.Deleg atingClassLoader) [main] 2021-01-13 13:20:15,422 INFO Added aliases 'SchemaSourceConnector' and 'SchemaSource' to plugin 'org.apache.kafka.connect.tools.SchemaSourceConnector' (org.apache.kafka.connect.runtime.isolation .DelegatingClassLoader) [main] 2021-01-13 13:20:15,422 INFO Added aliases 'VerifiableSinkConnector' and 'VerifiableSink' to plugin 'org.apache.kafka.connect.tools.VerifiableSinkConnector' (org.apache.kafka.connect.runtime.iso lation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,422 INFO Added aliases 'VerifiableSourceConnector' and 'VerifiableSource' to plugin 'org.apache.kafka.connect.tools.VerifiableSourceConnector' (org.apache.kafka.connect.runti me.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'ByteArrayConverter' and 'ByteArray' to plugin 'org.apache.kafka.connect.converters.ByteArrayConverter' (org.apache.kafka.connect.runtime.isolation.Del egatingClassLoader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'DoubleConverter' and 'Double' to plugin 'org.apache.kafka.connect.converters.DoubleConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingCl assLoader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'FloatConverter' and 'Float' to plugin 'org.apache.kafka.connect.converters.FloatConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClass Loader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'IntegerConverter' and 'Integer' to plugin 'org.apache.kafka.connect.converters.IntegerConverter' (org.apache.kafka.connect.runtime.isolation.Delegatin gClassLoader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'LongConverter' and 'Long' to plugin 'org.apache.kafka.connect.converters.LongConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoa der) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'ShortConverter' and 'Short' to plugin 'org.apache.kafka.connect.converters.ShortConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClass Loader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'JsonConverter' and 'Json' to plugin 'org.apache.kafka.connect.json.JsonConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [ main] 2021-01-13 13:20:15,423 INFO Added aliases 'StringConverter' and 'String' to plugin 'org.apache.kafka.connect.storage.StringConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClass Loader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'ByteArrayConverter' and 'ByteArray' to plugin 'org.apache.kafka.connect.converters.ByteArrayConverter' (org.apache.kafka.connect.runtime.isolation.Del egatingClassLoader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'DoubleConverter' and 'Double' to plugin 'org.apache.kafka.connect.converters.DoubleConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingCl assLoader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'FloatConverter' and 'Float' to plugin 'org.apache.kafka.connect.converters.FloatConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClass Loader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'IntegerConverter' and 'Integer' to plugin 'org.apache.kafka.connect.converters.IntegerConverter' (org.apache.kafka.connect.runtime.isolation.Delegatin gClassLoader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'LongConverter' and 'Long' to plugin 'org.apache.kafka.connect.converters.LongConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoa der) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'ShortConverter' and 'Short' to plugin 'org.apache.kafka.connect.converters.ShortConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClass Loader) [main] 2021-01-13 13:20:15,423 INFO Added aliases 'JsonConverter' and 'Json' to plugin 'org.apache.kafka.connect.json.JsonConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [ main] 2021-01-13 13:20:15,423 INFO Added alias 'SimpleHeaderConverter' to plugin 'org.apache.kafka.connect.storage.SimpleHeaderConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoa der) [main] 2021-01-13 13:20:15,424 INFO Added aliases 'StringConverter' and 'String' to plugin 'org.apache.kafka.connect.storage.StringConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClass Loader) [main] 2021-01-13 13:20:15,424 INFO Added alias 'RegexRouter' to plugin 'org.apache.kafka.connect.transforms.RegexRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,424 INFO Added alias 'TimestampRouter' to plugin 'org.apache.kafka.connect.transforms.TimestampRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [mai n] 2021-01-13 13:20:15,424 INFO Added alias 'ValueToKey' to plugin 'org.apache.kafka.connect.transforms.ValueToKey' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,424 INFO Added alias 'BasicAuthSecurityRestExtension' to plugin 'org.apache.kafka.connect.rest.basic.auth.extension.BasicAuthSecurityRestExtension' (org.apache.kafka.connect. runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,424 INFO Added aliases 'AllConnectorClientConfigOverridePolicy' and 'All' to plugin 'org.apache.kafka.connect.connector.policy.AllConnectorClientConfigOverridePolicy' (org.ap ache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,424 INFO Added aliases 'NoneConnectorClientConfigOverridePolicy' and 'None' to plugin 'org.apache.kafka.connect.connector.policy.NoneConnectorClientConfigOverridePolicy' (org .apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,424 INFO Added aliases 'PrincipalConnectorClientConfigOverridePolicy' and 'Principal' to plugin 'org.apache.kafka.connect.connector.policy.PrincipalConnectorClientConfigOverr idePolicy' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [main] 2021-01-13 13:20:15,505 INFO DistributedConfig values: access.control.allow.methods = access.control.allow.origin = admin.listeners = null bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] client.dns.lookup = default client.id = config.providers = [file] config.storage.replication.factor = 1 config.storage.topic = mirrormaker2-cluster-configs connect.protocol = sessioned connections.max.idle.ms = 540000 connector.client.config.override.policy = None group.id = mirrormaker2-cluster header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter heartbeat.interval.ms = 3000 inter.worker.key.generation.algorithm = HmacSHA256 inter.worker.key.size = null inter.worker.key.ttl.ms = 3600000 inter.worker.signature.algorithm = HmacSHA256 inter.worker.verification.algorithms = [HmacSHA256] internal.key.converter = class org.apache.kafka.connect.json.JsonConverter internal.value.converter = class org.apache.kafka.connect.json.JsonConverter key.converter = class org.apache.kafka.connect.converters.ByteArrayConverter listeners = null metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 offset.flush.interval.ms = 60000 offset.flush.timeout.ms = 5000 offset.storage.partitions = 25 offset.storage.replication.factor = 1 offset.storage.topic = mirrormaker2-cluster-offsets plugin.path = [/opt/kafka/plugins] rebalance.timeout.ms = 60000 receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 40000 rest.advertised.host.name = 10.3.8.175 rest.advertised.listener = null rest.advertised.port = 8083 rest.extension.classes = [] rest.host.name = null rest.port = 8083 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI scheduled.rebalance.max.delay.ms = 300000 security.protocol = PLAINTEXT send.buffer.bytes = 131072 session.timeout.ms = 10000 ssl.cipher.suites = null ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS status.storage.partitions = 5 status.storage.replication.factor = 1 status.storage.topic = mirrormaker2-cluster-status task.shutdown.graceful.timeout.ms = 5000 topic.tracking.allow.reset = true topic.tracking.enable = true value.converter = class org.apache.kafka.connect.converters.ByteArrayConverter worker.sync.timeout.ms = 3000 worker.unsync.backoff.ms = 300000 (org.apache.kafka.connect.runtime.distributed.DistributedConfig) [main] 2021-01-13 13:20:15,507 INFO Creating Kafka admin client (org.apache.kafka.connect.util.ConnectUtils) [main] 2021-01-13 13:20:15,526 INFO AdminClientConfig values: bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] client.dns.lookup = default client.id = connections.max.idle.ms = 300000 default.api.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,597 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [main] 2021-01-13 13:20:15,598 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:15,598 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:15,598 INFO Kafka startTimeMs: 1610544015597 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:15,955 INFO Kafka cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.connect.util.ConnectUtils) [main] 2021-01-13 13:20:15,976 INFO Logging initialized @5542ms to org.eclipse.jetty.util.log.Slf4jLog (org.eclipse.jetty.util.log) [main] 2021-01-13 13:20:16,078 INFO Added connector for http://:8083 (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,078 INFO Initializing REST server (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,096 INFO jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 1.8.0_275-b01 (org.eclipse.jetty.server.Server) [main] 2021-01-13 13:20:16,130 INFO Started http_8083@6fa590ba{HTTP/1.1,[http/1.1]}{0.0.0.0:8083} (org.eclipse.jetty.server.AbstractConnector) [main] 2021-01-13 13:20:16,130 INFO Started @5696ms (org.eclipse.jetty.server.Server) [main] 2021-01-13 13:20:16,155 INFO Advertised URI: http://10.3.8.175:8083/ (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,155 INFO REST server listening at http://10.3.8.175:8083/, advertising URL http://10.3.8.175:8083/ (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,156 INFO Advertised URI: http://10.3.8.175:8083/ (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,156 INFO REST admin endpoints at http://10.3.8.175:8083/ (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,156 INFO Advertised URI: http://10.3.8.175:8083/ (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,162 INFO Setting up None Policy for ConnectorClientConfigOverride. This will disallow any client configuration to be overridden (org.apache.kafka.connect.connector.policy.Non eConnectorClientConfigOverridePolicy) [main] 2021-01-13 13:20:16,179 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:16,179 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:16,179 INFO Kafka startTimeMs: 1610544016179 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:16,335 INFO JsonConverterConfig values: converter.type = key decimal.format = BASE64 schemas.cache.size = 1000 schemas.enable = false (org.apache.kafka.connect.json.JsonConverterConfig) [main] 2021-01-13 13:20:16,337 INFO JsonConverterConfig values: converter.type = value decimal.format = BASE64 schemas.cache.size = 1000 schemas.enable = false (org.apache.kafka.connect.json.JsonConverterConfig) [main] 2021-01-13 13:20:16,388 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:16,388 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:16,388 INFO Kafka startTimeMs: 1610544016388 (org.apache.kafka.common.utils.AppInfoParser) [main] 2021-01-13 13:20:16,391 INFO Kafka Connect distributed worker initialization took 5447ms (org.apache.kafka.connect.cli.ConnectDistributed) [main] 2021-01-13 13:20:16,392 INFO Kafka Connect starting (org.apache.kafka.connect.runtime.Connect) [main] 2021-01-13 13:20:16,394 INFO Initializing REST resources (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,394 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Herder starting (org.apache.kafka.connect.runtime.distributed.DistributedHerder) [DistributedHerder-connect -1-1] 2021-01-13 13:20:16,400 INFO Worker starting (org.apache.kafka.connect.runtime.Worker) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,400 INFO Starting KafkaOffsetBackingStore (org.apache.kafka.connect.storage.KafkaOffsetBackingStore) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,400 INFO Starting KafkaBasedLog with topic mirrormaker2-cluster-offsets (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,401 INFO AdminClientConfig values: bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] client.dns.lookup = default client.id = connections.max.idle.ms = 300000 default.api.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,418 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,418 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,418 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,418 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,418 INFO Kafka startTimeMs: 1610544016418 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,455 INFO Adding admin resources to main listener (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:16,472 INFO ProducerConfig values: acks = -1 batch.size = 16384 bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = producer-1 compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = false interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 1 max.request.size = 1048576 metadata.max.age.ms = 300000 metadata.max.idle.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,510 WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,510 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,511 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,511 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,511 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,511 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,511 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,511 INFO Kafka startTimeMs: 1610544016511 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,521 INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = mirrormaker2-cluster group.instance.id = null heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 10000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,526 INFO [Producer clientId=producer-1] Cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.clients.Metadata) [kafka-producer-network-thread | producer-1] 2021-01-13 13:20:16,552 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,552 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,552 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,552 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,552 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,552 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,552 INFO Kafka startTimeMs: 1610544016552 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,561 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.clients.Metadata) [Distributed Herder-connect-1-1] 2021-01-13 13:20:16,573 INFO DefaultSessionIdManager workerName=node0 (org.eclipse.jetty.server.session) [main] 2021-01-13 13:20:16,573 INFO No SessionScavenger set, using defaults (org.eclipse.jetty.server.session) [main] 2021-01-13 13:20:16,575 INFO node0 Scavenging every 660000ms (org.eclipse.jetty.server.session) [main] 2021-01-13 13:20:16,588 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Subscribed to partition(s): mirrormaker2-cluster-offsets-0, mirrormaker2-cluster-of fsets-5, mirrormaker2-cluster-offsets-10, mirrormaker2-cluster-offsets-20, mirrormaker2-cluster-offsets-15, mirrormaker2-cluster-offsets-9, mirrormaker2-cluster-offsets-11, mirrormaker2-cluster- offsets-4, mirrormaker2-cluster-offsets-16, mirrormaker2-cluster-offsets-17, mirrormaker2-cluster-offsets-3, mirrormaker2-cluster-offsets-24, mirrormaker2-cluster-offsets-23, mirrormaker2-cluste r-offsets-13, mirrormaker2-cluster-offsets-18, mirrormaker2-cluster-offsets-22, mirrormaker2-cluster-offsets-8, mirrormaker2-cluster-offsets-2, mirrormaker2-cluster-offsets-12, mirrormaker2-clus ter-offsets-19, mirrormaker2-cluster-offsets-14, mirrormaker2-cluster-offsets-1, mirrormaker2-cluster-offsets-6, mirrormaker2-cluster-offsets-7, mirrormaker2-cluster-offsets-21 (org.apache.kafka .clients.consumer.KafkaConsumer) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-0 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-5 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-10 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-20 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-15 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-9 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-11 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-4 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-16 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-17 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-3 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,593 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-24 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-23 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-13 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-18 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-22 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-8 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-2 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-12 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-19 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-14 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-1 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-6 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-7 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,594 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-offsets-21 (org.apache .kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,655 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-15 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,656 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-0 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,656 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-18 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,656 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-3 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,656 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-21 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,656 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-6 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,656 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-24 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,657 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-9 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,657 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-12 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-16 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-1 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-19 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-4 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-22 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-7 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-10 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-13 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-17 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-2 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-20 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-5 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-23 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-8 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-11 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,658 INFO [Consumer clientId=consumer-mirrormaker2-cluster-1, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-offsets-14 to offset 0. (org.ap ache.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,659 INFO Finished reading KafkaBasedLog for topic mirrormaker2-cluster-offsets (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,659 INFO Started KafkaBasedLog for topic mirrormaker2-cluster-offsets (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,659 INFO Finished reading offsets topic and starting KafkaOffsetBackingStore (org.apache.kafka.connect.storage.KafkaOffsetBackingStore) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,680 INFO Worker started (org.apache.kafka.connect.runtime.Worker) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,680 INFO Starting KafkaBasedLog with topic mirrormaker2-cluster-status (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,681 INFO AdminClientConfig values: bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] client.dns.lookup = default client.id = connections.max.idle.ms = 300000 default.api.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,686 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,687 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,687 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,687 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,687 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,687 INFO Kafka startTimeMs: 1610544016687 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,716 INFO ProducerConfig values: acks = -1 batch.size = 16384 bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = producer-2 compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 120000 enable.idempotence = false interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 1 max.request.size = 1048576 metadata.max.age.ms = 300000 metadata.max.idle.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 0 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,720 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,720 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,720 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,720 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,720 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,721 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,721 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,721 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,721 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,721 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,721 INFO Kafka startTimeMs: 1610544016721 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,722 INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = mirrormaker2-cluster group.instance.id = null heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 10000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,726 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 INFO [Producer clientId=producer-2] Cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.clients.Metadata) [kafka-producer-network-thread | producer-2] 2021-01-13 13:20:16,726 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,726 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,726 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,727 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,727 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,727 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,727 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,727 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,727 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,727 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,727 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,727 INFO Kafka startTimeMs: 1610544016727 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,731 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.clients.Metadata) [Distributed Herder-connect-1-1] 2021-01-13 13:20:16,737 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Subscribed to partition(s): mirrormaker2-cluster-status-0, mirrormaker2-cluster-sta tus-4, mirrormaker2-cluster-status-1, mirrormaker2-cluster-status-2, mirrormaker2-cluster-status-3 (org.apache.kafka.clients.consumer.KafkaConsumer) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,737 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-status-0 (org.apache.k afka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,737 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-status-4 (org.apache.k afka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,737 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-status-1 (org.apache.k afka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,737 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-status-2 (org.apache.k afka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,737 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-status-3 (org.apache.k afka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,757 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-status-3 to offset 0. (org.apac he.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,757 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-status-0 to offset 0. (org.apac he.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,757 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-status-2 to offset 0. (org.apac he.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,757 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-status-4 to offset 0. (org.apac he.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,757 INFO [Consumer clientId=consumer-mirrormaker2-cluster-2, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-status-1 to offset 0. (org.apac he.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,758 INFO Finished reading KafkaBasedLog for topic mirrormaker2-cluster-status (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,758 INFO Started KafkaBasedLog for topic mirrormaker2-cluster-status (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,759 INFO Starting KafkaConfigBackingStore (org.apache.kafka.connect.storage.KafkaConfigBackingStore) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,759 INFO Starting KafkaBasedLog with topic mirrormaker2-cluster-configs (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,759 INFO AdminClientConfig values: bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] client.dns.lookup = default client.id = connections.max.idle.ms = 300000 default.api.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,762 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,762 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,762 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,762 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,763 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,763 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,763 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,763 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,764 INFO Kafka startTimeMs: 1610544016763 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,807 INFO ProducerConfig values: acks = -1 batch.size = 16384 bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = producer-3 compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = false interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 1 max.request.size = 1048576 metadata.max.age.ms = 300000 metadata.max.idle.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,811 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,811 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,811 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,811 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,811 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,811 INFO Kafka startTimeMs: 1610544016811 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,814 INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9092] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = mirrormaker2-cluster group.instance.id = null heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 10000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,819 WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'config.providers' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'admin.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'config.providers.file.class' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,820 WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'consumer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,820 WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'producer.security.protocol' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1 -1] 2021-01-13 13:20:16,820 WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1- 1] 2021-01-13 13:20:16,820 WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig) [DistributedHerder-co nnect-1-1] 2021-01-13 13:20:16,820 INFO Kafka version: 2.5.0 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 INFO Kafka commitId: 66563e712b0b9f84 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,820 INFO Kafka startTimeMs: 1610544016820 (org.apache.kafka.common.utils.AppInfoParser) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,821 INFO [Producer clientId=producer-3] Cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.clients.Metadata) [kafka-producer-network-thread | producer-3] 2021-01-13 13:20:16,825 INFO [Consumer clientId=consumer-mirrormaker2-cluster-3, groupId=mirrormaker2-cluster] Cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.clients.Metadata) [Distributed Herder-connect-1-1] 2021-01-13 13:20:16,832 INFO [Consumer clientId=consumer-mirrormaker2-cluster-3, groupId=mirrormaker2-cluster] Subscribed to partition(s): mirrormaker2-cluster-configs-0 (org.apache.kafka.client s.consumer.KafkaConsumer) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,832 INFO [Consumer clientId=consumer-mirrormaker2-cluster-3, groupId=mirrormaker2-cluster] Seeking to EARLIEST offset of partition mirrormaker2-cluster-configs-0 (org.apache. kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,844 INFO [Consumer clientId=consumer-mirrormaker2-cluster-3, groupId=mirrormaker2-cluster] Resetting offset for partition mirrormaker2-cluster-configs-0 to offset 0. (org.apa che.kafka.clients.consumer.internals.SubscriptionState) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,906 INFO Finished reading KafkaBasedLog for topic mirrormaker2-cluster-configs (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,906 INFO Started KafkaBasedLog for topic mirrormaker2-cluster-configs (org.apache.kafka.connect.util.KafkaBasedLog) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,906 INFO Started KafkaConfigBackingStore (org.apache.kafka.connect.storage.KafkaConfigBackingStore) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,906 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Herder started (org.apache.kafka.connect.runtime.distributed.DistributedHerder) [DistributedHerder-connect- 1-1] 2021-01-13 13:20:16,935 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Cluster ID: Y3aTMPXhRJ-MIgICvnGJoA (org.apache.kafka.clients.Metadata) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,937 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Discovered group coordinator my-cluster-target-kafka-2.my-cluster-target-kafka-brokers.xxli.svc:9092 (id: 2 147483645 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,939 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Rebalance started (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator) [DistributedHerder-conne ct-1-1] 2021-01-13 13:20:16,939 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] (Re-)joining group (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [DistributedHerder-con nect-1-1] 2021-01-13 13:20:16,950 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Join group failed with org.apache.kafka.common.errors.MemberIdRequiredException: The group member needs to have a valid member id before actually entering a consumer group (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [DistributedHerder-connect-1-1] 2021-01-13 13:20:16,950 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] (Re-)joining group (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [DistributedHerder-con nect-1-1] Jan 13, 2021 1:20:17 PM org.glassfish.jersey.internal.inject.Providers checkProviderRuntime WARNING: A provider org.apache.kafka.connect.runtime.rest.resources.ConnectorPluginsResource registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runt ime. Due to constraint configuration problems the provider org.apache.kafka.connect.runtime.rest.resources.ConnectorPluginsResource will be ignored. Jan 13, 2021 1:20:17 PM org.glassfish.jersey.internal.inject.Providers checkProviderRuntime WARNING: A provider org.apache.kafka.connect.runtime.rest.resources.ConnectorsResource registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. D ue to constraint configuration problems the provider org.apache.kafka.connect.runtime.rest.resources.ConnectorsResource will be ignored. Jan 13, 2021 1:20:17 PM org.glassfish.jersey.internal.inject.Providers checkProviderRuntime WARNING: A provider org.apache.kafka.connect.runtime.rest.resources.RootResource registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configuration problems the provider org.apache.kafka.connect.runtime.rest.resources.RootResource will be ignored. Jan 13, 2021 1:20:17 PM org.glassfish.jersey.internal.inject.Providers checkProviderRuntime WARNING: A provider org.apache.kafka.connect.runtime.rest.resources.LoggingResource registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configuration problems the provider org.apache.kafka.connect.runtime.rest.resources.LoggingResource will be ignored. Jan 13, 2021 1:20:17 PM org.glassfish.jersey.internal.Errors logErrors WARNING: The following warnings have been detected: WARNING: The (sub)resource method listLoggers in org.apache.kafka.connect.runtime.rest.resources.LoggingResource contains empty path annotatio n. WARNING: The (sub)resource method listConnectors in org.apache.kafka.connect.runtime.rest.resources.ConnectorsResource contains empty path annotation. WARNING: The (sub)resource method createConnector in org.apache.kafka.connect.runtime.rest.resources.ConnectorsResource contains empty path annotation. WARNING: The (sub)resource method listConnectorPlugins in org.apache.kafka.connect.runtime.rest.resources.ConnectorPluginsResource contains empty path annotation. WARNING: The (sub)resource method serverInfo in org.apache.kafka.connect.runtime.rest.resources.RootResource contains empty path annotation. 2021-01-13 13:20:17,267 INFO Started o.e.j.s.ServletContextHandler@9f6e406{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler) [main] 2021-01-13 13:20:17,267 INFO REST resources initialized; server is started and ready to handle requests (org.apache.kafka.connect.runtime.rest.RestServer) [main] 2021-01-13 13:20:17,267 INFO Kafka Connect started (org.apache.kafka.connect.runtime.Connect) [main] 2021-01-13 13:20:20,003 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Successfully joined group with generation 5 (org.apache.kafka.clients.consumer.internals.AbstractCoordinato r) [DistributedHerder-connect-1-1] 2021-01-13 13:20:20,004 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Joined group at generation 5 with protocol version 2 and got assignment: Assignment{error=0, leader='connec t-1-90541f37-0a76-408f-886c-73e8229934b2', leaderUrl='http://10.3.8.175:8083/', offset=2, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} with rebalance delay: 0 (org.apache.kafka.connect.runtime.distributed.DistributedHerder) [DistributedHerder-connect-1-1] 2021-01-13 13:20:20,005 WARN [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder) [DistributedHerder-connect-1-1] 2021-01-13 13:20:20,005 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Current config state offset -1 is behind group assignment 2, reading to end of config log (org.apache.kafka .connect.runtime.distributed.DistributedHerder) [DistributedHerder-connect-1-1] 2021-01-13 13:20:20,384 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Finished reading to end of log and updated config snapshot, new config log offset: 2 (org.apache.kafka.conn ect.runtime.distributed.DistributedHerder) [DistributedHerder-connect-1-1] 2021-01-13 13:20:20,385 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Starting connectors and tasks using config offset 2 (org.apache.kafka.connect.runtime.distributed.Distribut edHerder) [DistributedHerder-connect-1-1] 2021-01-13 13:20:20,385 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder) [Di stributedHerder-connect-1-1] 2021-01-13 13:20:20,443 INFO [Worker clientId=connect-1, groupId=mirrormaker2-cluster] Session key updated (org.apache.kafka.connect.runtime.distributed.DistributedHerder) [KafkaBasedLog Work Th read - mirrormaker2-cluster-configs] # operator log $ kubectl -n xxli logs strimzi-cluster-operator-v0.18.0-665744b74d-2cwmg 2021-01-13 13:38:49 ERROR AbstractOperator:175 - Reconciliation #36(timer) KafkaMirrorMaker2(xxli/my-mm2-cluster): createOrUpdate failed io.strimzi.operator.common.operator.resource.TimeoutException: Exceeded timeout of 300000ms while waiting for Deployment resource my-mm2-cluster-mirrormaker2 in namespace xxli to be ready at io.strimzi.operator.common.Util$1.lambda$handle$1(Util.java:115) ~[io.strimzi.operator-common-0.18.0.jar:0.18.0] at io.vertx.core.impl.ContextImpl.lambda$null$0(ContextImpl.java:330) ~[io.vertx.vertx-core-3.8.5.jar:3.8.5] at io.vertx.core.impl.ContextImpl.executeTask(ContextImpl.java:369) ~[io.vertx.vertx-core-3.8.5.jar:3.8.5] at io.vertx.core.impl.EventLoopContext.lambda$executeAsync$0(EventLoopContext.java:38) ~[io.vertx.vertx-core-3.8.5.jar:3.8.5] at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500) [io.netty.netty-transport-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_275] 2021-01-13 13:38:49 WARN AbstractOperator:330 - Reconciliation #36(timer) KafkaMirrorMaker2(xxli/my-mm2-cluster): Failed to reconcile io.strimzi.operator.common.operator.resource.TimeoutException: Exceeded timeout of 300000ms while waiting for Deployment resource my-mm2-cluster-mirrormaker2 in namespace xxli to be ready at io.strimzi.operator.common.Util$1.lambda$handle$1(Util.java:115) ~[io.strimzi.operator-common-0.18.0.jar:0.18.0] at io.vertx.core.impl.ContextImpl.lambda$null$0(ContextImpl.java:330) ~[io.vertx.vertx-core-3.8.5.jar:3.8.5] at io.vertx.core.impl.ContextImpl.executeTask(ContextImpl.java:369) ~[io.vertx.vertx-core-3.8.5.jar:3.8.5] at io.vertx.core.impl.EventLoopContext.lambda$executeAsync$0(EventLoopContext.java:38) ~[io.vertx.vertx-core-3.8.5.jar:3.8.5] at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500) [io.netty.netty-transport-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty.netty-common-4.1.45.Final.jar:4.1.45.Final] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_275]May I ask what is the reason for this and how should I debug
Beta Was this translation helpful? Give feedback.
All reactions