Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Kafka Consumer Package #342

Merged
merged 71 commits into from Apr 2, 2021
Merged

feat: Kafka Consumer Package #342

merged 71 commits into from Apr 2, 2021

Commits on Feb 10, 2021

  1. feat: add skeleton for kafka raw consumer

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    1f5a823 View commit details
    Browse the repository at this point in the history

  2. feat: options

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    6b4eec6 View commit details
    Browse the repository at this point in the history

  3. feat: consumer component

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    9557e62 View commit details
    Browse the repository at this point in the history

  4. feat: more options and flexibility for Kafka consumer

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    186e421 View commit details
    Browse the repository at this point in the history

  5. feat: add retries on message/batch level

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    ff10865 View commit details
    Browse the repository at this point in the history

  6. fix: compile

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    be97a5f View commit details
    Browse the repository at this point in the history

  7. feat: implement failure strategy

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    5f71522 View commit details
    Browse the repository at this point in the history

  8. fix: stylecheck

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    16ddd45 View commit details
    Browse the repository at this point in the history

  9. feat: add correlation

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    132e284 View commit details
    Browse the repository at this point in the history

  10. docs: add example

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    be363d0 View commit details
    Browse the repository at this point in the history

  11. docs: finalized example

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    b0943b5 View commit details
    Browse the repository at this point in the history

  12. fix: ExitStrategy

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    080ef76 View commit details
    Browse the repository at this point in the history

  13. docs: fix example location

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    4b3c17d View commit details
    Browse the repository at this point in the history

  14. fix: remove unnecessary handling of signals

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    5bc743a View commit details
    Browse the repository at this point in the history

  15. fix: prevent ConsumeClaim from reclaiming messages before cancelling … 

    …context
    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    b183ae6 View commit details
    Browse the repository at this point in the history

  16. docs: more details to context cancellation

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    bb40a01 View commit details
    Browse the repository at this point in the history

  17. test: kafka component initialization

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    f026199 View commit details
    Browse the repository at this point in the history

  18. feat: add more metrics

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    aacfe77 View commit details
    Browse the repository at this point in the history

  19. fix: add default sarama config

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    a510c88 View commit details
    Browse the repository at this point in the history

  20. test: with sarama mock

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    d9b1f2b View commit details
    Browse the repository at this point in the history

  21. test: remove sarama mocks

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    e558d4d View commit details
    Browse the repository at this point in the history

  22. test: integration test

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    88517a6 View commit details
    Browse the repository at this point in the history

  23. test: fix integration test names

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    16c6581 View commit details
    Browse the repository at this point in the history

  24. refactor: better method placement

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    d9a0681 View commit details
    Browse the repository at this point in the history

  25. fix: gauge vector name

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    00b50c0 View commit details
    Browse the repository at this point in the history

  26. test: kafka consumer handler

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    f1beb47 View commit details
    Browse the repository at this point in the history

  27. test: fix string decoder

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    bd8ca59 View commit details
    Browse the repository at this point in the history

  28. test: differentiate loggers for patron instances

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    6e9a64b View commit details
    Browse the repository at this point in the history

  29. test: start from offset oldest to avoid race

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    b416c9b View commit details
    Browse the repository at this point in the history

  30. fix: error when the component could not process a message

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    c43bcfe View commit details
    Browse the repository at this point in the history

  31. test: ticker and batching

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    2aeb582 View commit details
    Browse the repository at this point in the history

  32. chore: tidy

    @oss92
    oss92 committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    ef520bb View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2021

  1. Merge branch 'master' into kafka-raw-consumer

    Sotirios Mantziaris committed Feb 13, 2021
    Configuration menu
    Copy the full SHA
    41d4e70 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2021

  1. Merge branch 'master' into kafka-raw-consumer

    Sotirios Mantziaris committed Feb 16, 2021
    Configuration menu
    Copy the full SHA
    2ff99ce View commit details
    Browse the repository at this point in the history

  2. feat: add Context() for each Kafka message

    @oss92
    oss92 committed Feb 16, 2021
    Configuration menu
    Copy the full SHA
    deafe1f View commit details
    Browse the repository at this point in the history

  3. feat: add kafka.Batch

    @oss92
    oss92 committed Feb 16, 2021
    Configuration menu
    Copy the full SHA
    4ed89b3 View commit details
    Browse the repository at this point in the history

  4. chore: address PR review

    @oss92
    oss92 committed Feb 16, 2021
    Configuration menu
    Copy the full SHA
    87d01c0 View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2021

  1. fix: optimize truncate slice

    @oss92
    oss92 committed Feb 17, 2021
    Configuration menu
    Copy the full SHA
    50f6021 View commit details
    Browse the repository at this point in the history

  2. feat: add Commit and MarkBatchOffset to Batch interface

    @oss92
    oss92 committed Feb 17, 2021
    Configuration menu
    Copy the full SHA
    2f562d7 View commit details
    Browse the repository at this point in the history

  3. refactor: no need to write Batch again

    @oss92
    oss92 committed Feb 17, 2021
    Configuration menu
    Copy the full SHA
    5e67ba2 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2021

  1. Merge branch 'master' of github.com:beatlabs/patron into kafka-raw-co… 

    …nsumer
    @oss92
    oss92 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    cd6fa7e View commit details
    Browse the repository at this point in the history

  2. feat: kafka component OptionFunc instead of builder

    @oss92
    oss92 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    08161e3 View commit details
    Browse the repository at this point in the history

  3. fix: lint

    @oss92
    oss92 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    49d0373 View commit details
    Browse the repository at this point in the history

  4. test: kafka OptionFunc

    @oss92
    oss92 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    7d550b9 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2021

  1. chore: address PR review to simplify Run for kafka component

    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    c2d525b View commit details
    Browse the repository at this point in the history

  2. docs: kafka component

    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    a21521b View commit details
    Browse the repository at this point in the history

  3. fix: kafka example to commit batch in case message could not be decoded

    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    9f28dfb View commit details
    Browse the repository at this point in the history

  4. fix: remove unused channel

    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    37e1572 View commit details
    Browse the repository at this point in the history

  5. fix: example to MarkOffset

    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    12bad5f View commit details
    Browse the repository at this point in the history

  6. feat: add debug line when no correlation header is present in Kafka c… 

    …omponent
    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    174f4d0 View commit details
    Browse the repository at this point in the history

  7. fix: comment

    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    27bd0ef View commit details
    Browse the repository at this point in the history

  8. chore: update sarama to 1.28.0

    @oss92
    oss92 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    0ef2f17 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2021

  1. fix: remove error log

    @oss92
    oss92 committed Mar 3, 2021
    Configuration menu
    Copy the full SHA
    2c177ba View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2021

  1. fix: remove ability to mark offsets and commit from message interface

    @oss92
    oss92 committed Mar 18, 2021
    Configuration menu
    Copy the full SHA
    5c8f877 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2021

  1. refactor: move consumer group implementation to its own package

    @oss92
    oss92 committed Mar 19, 2021
    Configuration menu
    Copy the full SHA
    37be59e View commit details
    Browse the repository at this point in the history

  2. fix: comment

    @oss92
    oss92 committed Mar 19, 2021
    Configuration menu
    Copy the full SHA
    fb3dbc9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of github.com:beatlabs/patron into kafka-raw-co… 

    …nsumer
    @oss92
    oss92 committed Mar 19, 2021
    Configuration menu
    Copy the full SHA
    ece7cac View commit details
    Browse the repository at this point in the history

  4. fix: lint

    @oss92
    oss92 committed Mar 19, 2021
    Configuration menu
    Copy the full SHA
    c84b622 View commit details
    Browse the repository at this point in the history

  5. fix: fail if a nil sarama config is supplied to OptionFunc

    @oss92
    oss92 committed Mar 19, 2021
    Configuration menu
    Copy the full SHA
    48d5ed6 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2021

  1. fix: retries on component level

    @oss92
    oss92 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    f1c2b8b View commit details
    Browse the repository at this point in the history

  2. refactor: cleanup failure strat

    @oss92
    oss92 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    ecedf90 View commit details
    Browse the repository at this point in the history

  3. fix: test, skip never fails

    @oss92
    oss92 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    311f7dd View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2021

  1. test: higher coverage kafka package

    @oss92
    oss92 committed Mar 26, 2021
    Configuration menu
    Copy the full SHA
    9f4c1ae View commit details
    Browse the repository at this point in the history

  2. docs: add more documentation for FailureStrategy and retries

    @oss92
    oss92 committed Mar 26, 2021
    Configuration menu
    Copy the full SHA
    cd6a68f View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2021

  1. fix: unlock even on flush error

    @oss92
    oss92 committed Mar 28, 2021
    Configuration menu
    Copy the full SHA
    f1bc754 View commit details
    Browse the repository at this point in the history

  2. cleanup: remove empty line

    @oss92
    oss92 committed Mar 28, 2021
    Configuration menu
    Copy the full SHA
    53edcf3 View commit details
    Browse the repository at this point in the history

  3. feat: reset retry counter on processing success 

    Signed-off-by: oss92 <mohamed.o.alnagdy@gmail.com>
    @oss92
    oss92 committed Mar 28, 2021
    Configuration menu
    Copy the full SHA
    88523c2 View commit details
    Browse the repository at this point in the history

  4. feat: default retries and wait

    @oss92
    oss92 committed Mar 28, 2021
    Configuration menu
    Copy the full SHA
    c757f14 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2021

  1. chore: add default to executeFailureStrategy

    @oss92
    oss92 committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    37f3d8b View commit details
    Browse the repository at this point in the history

  2. fix: bug with parent context cancelling and handle pr review

    @oss92
    oss92 committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    46882bc View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2021

  1. Merge branch 'master' into kafka-raw-consumer

    @tpaschalis
    tpaschalis committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    6541bb3 View commit details
    Browse the repository at this point in the history