Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka Input Plugin: Deleting Known Topic #39

Open
jzielinski opened this issue May 9, 2019 · 1 comment
Open

Kafka Input Plugin: Deleting Known Topic #39

jzielinski opened this issue May 9, 2019 · 1 comment
Labels
question Further information is requested

Comments

@jzielinski
Copy link

Version: logstash-6.7.0, kafka 2.2.0
Operating System: CentOS Linux 7

When deleting a topic from Kafka that is known to Logstash, the following errors are thrown:

[2019-04-29T14:53:18,886][WARN ][org.apache.kafka.clients.consumer.internals.Fetcher] [Consumer clientId=logstash-0, groupId=logstash] Received unknown topic or partition error in fetch for partition <TOPIC>
[2019-04-29T14:53:18,890][ERROR][org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] [Consumer clientId=logstash-0, groupId=logstash] Offset commit failed on partition <TOPIC> at offset 1475: This server does not host this topic-partition.
@yaauie
Copy link
Contributor

yaauie commented Jun 18, 2020

These error messages seem sensible and descriptive.

If the topic no longer exists after being deleted by an outside action, we cannot commit our offset on a partition from that topic that we were previously assigned, which is an error condition. The error clearly states that the server does not host the topic-partition that we were previously assigned.

What are you hoping to accomplish by reporting this? How could the error message (which is propagated from the Kafka client library) be improved?

@yaauie yaauie transferred this issue from logstash-plugins/logstash-input-kafka Jun 18, 2020
@yaauie yaauie added the question Further information is requested label Jun 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants