Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can we use consumption limit in kafka-go #910

Closed
lizhifengones opened this issue May 11, 2022 · 4 comments
Closed

Can we use consumption limit in kafka-go #910

lizhifengones opened this issue May 11, 2022 · 4 comments
Assignees
Labels

Comments

@lizhifengones
Copy link

like consumer_byte_rate, I didn't find it. : (

@rhansen2 rhansen2 self-assigned this May 20, 2022
@rhansen2
Copy link
Collaborator

Hi @lizhifengones,

I'm not familiar with consumer_byte_rate. The only reference to it I can find appears to be a broker side quota setting. https://kafka.apache.org/documentation/#quotas If that's the case then I believe this feature should work with kafka-go.

Please let me know if there's something I'm missing.

Thanks!

@achille-roussel
Copy link
Contributor

Is this question related to #919 ?

@lizhifengones
Copy link
Author

lizhifengones commented Jun 3, 2022

Is this question related to #919 ?

Yes, but it seems that batch suffices, it limits the bytes per consumption of kafka.

But unfortunately, the batch seems to have a memory leak caused by goruntine leaks (#922 (comment)) . Each time the batch ends, the memory can only be released a little . I am now excluding the impact of my own code and follow up the test.

@lizhifengones
Copy link
Author

I have no problem for now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants