Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem when queue is full or incomming #21

Open
aaitsalem opened this issue Jul 15, 2020 · 1 comment
Open

problem when queue is full or incomming #21

aaitsalem opened this issue Jul 15, 2020 · 1 comment

Comments

@aaitsalem
Copy link

Hello,
When the queue is full or the solace queue is configured incomming, the kafka connect sink always sends messages, these messages are unfortunately lost (I use the solace topic to publish "sol.topics")
it's not very resilient
Do you have a solution to offer me so as not to lose messages please?

@a-masse
Copy link

a-masse commented Sep 10, 2020

The solution would be to use queues instead of topics. A PubSub+ queue guarantees order of delivery, provides High Availability and Disaster Recovery (depending on the setup of the PubSub+ brokers) and provides an acknowledgment to the connector when the event is stored in all HA and DR members and flushed to disk.

https://github.com/SolaceProducts/pubsubplus-connector-kafka-sink#performance-and-reliability-considerations

Nephery added a commit that referenced this issue Dec 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants