Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: More Robust Reactive / Async Support for Periodic Offset Commits #340

Open
brianwyka opened this issue Mar 8, 2021 · 0 comments

Comments

@brianwyka
Copy link
Contributor

brianwyka commented Mar 8, 2021

I was reading over an article by Quarkus which discusses async consumers and when to commit offsets:
https://quarkus.io/blog/kafka-commit-strategies/

It seems that it is using SmallRye kafka connector behind the scenes, and recommends the throtttled strategy to achieve highest throughput with reactive consumers, while still guaranteeing that offsets committed periodically aren't accidentally done for records which haven't completed processing.

Currently, the only way to get this working in Micronaut is to use reactive types, but then to manually acknowledge each consumer record, which reduces the throughput and adds load to the broker, OR to use @Blocking on the consumer.

@brianwyka brianwyka changed the title Feature Request: More Robust Reactive / Async Support for Offset Commits Feature Request: More Robust Reactive / Async Support for Periodic Offset Commits Mar 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant