You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
spool-schema-value.txt
I have given the value for this property "schema.generation.value.name": "nz.co.3es.example.customer.Value", and we have given the schema registry info in the worker level. However when I look at the schema, still the namespace is default value as com.github.jcustenborder.kafka.connect.model.Value
Connect worker config
-e CONNECT_VALUE_CONVERTER="io.confluent.connect.avro.AvroConverter"
-e CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL="https://3es.linux:8089" \
spool-schema-value.txt
I have given the value for this property "schema.generation.value.name": "nz.co.3es.example.customer.Value", and we have given the schema registry info in the worker level. However when I look at the schema, still the namespace is default value as com.github.jcustenborder.kafka.connect.model.Value
Connect worker config
-e CONNECT_VALUE_CONVERTER="io.confluent.connect.avro.AvroConverter"
-e CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL="https://3es.linux:8089" \
Connector config:
{
"connector.class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector",
"tasks.max": "1",
"topic": "ingest.spooldir.orders",
"input.path": "/tmp/data/unprocessed",
"finished.path": "/tmp/data/processed",
"error.path": "/tmp/data/error",
"input.file.pattern": ".*\.csv",
"schema.generation.enabled":"true",
"schema.generation.key.name": "nz.co.3es.example.customer.Key",
"schema.generation.value.name": "nz.co.3es.example.customer.Value",
"schema.generation.key.fields":"order_id",
"csv.first.row.as.header":"true",
"transforms":"castTypes",
"transforms.castTypes.type":"org.apache.kafka.connect.transforms.Cast$Value",
"transforms.castTypes.spec":"order_id:int32,customer_id:int32,order_total_usd:float32"
}'
From the logs.
key.schema = {"name":"com.github.jcustenborder.kafka.connect.model.Key","type":"STRUCT","isOptional":false,"fieldSchemas":{"order_id":{"type":"STRING","isOptional":true}}}
parser.timestamp.date.formats = [yyyy-MM-dd'T'HH:mm:ss, yyyy-MM-dd' 'HH:mm:ss]
parser.timestamp.timezone = UTC
processing.file.extension = .PROCESSING
schema.generation.enabled = true
schema.generation.key.fields = [order_id]
schema.generation.key.name = nz.co.3es.example.customer.Key
schema.generation.value.name = nz.co.3es.example.customer.Value
task.count = 1
task.index = 0
task.partitioner = ByName
timestamp.field =
timestamp.mode = PROCESS_TIME
topic = ingest.spooldir.orders
value.schema = {"name":"com.github.jcustenborder.kafka.connect.model.Value","type":"STRUCT","isOptional":false,"fieldSchemas":{"order_id":{"type":"STRING","isOptional":true},"customer_id":{"type":"STRING","isOptional":true},"order_total_usd":{"type":"STRING","isOptional":true},"make":{"type":"STRING","isOptional":true},"model":{"type":"STRING","isOptional":true},"delivery_city":{"type":"STRING","isOptional":true},"delivery_company":{"type":"STRING","isOptional":true},"delivery_address":{"type":"STRING","isOptional":true}}}
Is that mean, the name in the value.schema is used the default value even if we enable the "schema.generation.enabled":"true",
Refer the attached file for the schema from the registry.
The text was updated successfully, but these errors were encountered: