Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add log throttling in files based on group rules #3535

Merged
merged 23 commits into from May 17, 2022
Merged

Add log throttling in files based on group rules #3535

merged 23 commits into from May 17, 2022

Commits on Apr 6, 2022

  1. in_tail_with_throttle: Add ThrottleInput Plugin 

    Signed-off-by: Pranjal Gupta <pranjal.gupta2@ibm.com>
    @Pranjal-Gupta2
    Pranjal-Gupta2 committed Apr 6, 2022
    Copy the full SHA
    e3a4ff6 View commit details
    Browse the repository at this point in the history

  2. in_tail_with_throttle: Add configuration and rate limiting tests 

    Signed-off-by: Pranjal Gupta <pranjal.gupta2@ibm.com>
    @Pranjal-Gupta2
    Pranjal-Gupta2 committed Apr 6, 2022
    Copy the full SHA
    0fed6bd View commit details
    Browse the repository at this point in the history

  3. in_tail_with_throttle: Fix test_io_handler to use Tailwatcher rathe… 

    …r than string

Signed-off-by: Pranjal Gupta <pranjal.gupta2@ibm.com>
    @Pranjal-Gupta2
    Pranjal-Gupta2 committed Apr 6, 2022
    Copy the full SHA
    10603da View commit details
    Browse the repository at this point in the history

  4. in_tail_with_throttle: Remove nested method and modify indentation 

    Signed-off-by: Pranjal Gupta <pranjal.gupta2@ibm.com>
    @Pranjal-Gupta2
    Pranjal-Gupta2 committed Apr 6, 2022
    Copy the full SHA
    87e7426 View commit details
    Browse the repository at this point in the history

  5. in_tail: Add group based log collection from in_tail_with_throttle 

    Signed-off-by: Pranjal Gupta <pranjal.gupta2@ibm.com>
    @Pranjal-Gupta2
    Pranjal-Gupta2 committed Apr 6, 2022
    Copy the full SHA
    c76ffbd View commit details
    Browse the repository at this point in the history

  6. in_tail: Add group.match parameter for specifying generic rules 

    Signed-off-by: Pranjal Gupta <pranjal.gupta2@ibm.com>
    @Pranjal-Gupta2
    Pranjal-Gupta2 committed Apr 6, 2022
    Copy the full SHA
    41d348f View commit details
    Browse the repository at this point in the history

  7. Fix default_group_key typo 

    Signed-off-by: Pranjal Gupta <pranjal.gupta2@ibm.com>
    @Pranjal-Gupta2
    Pranjal-Gupta2 committed Apr 6, 2022
    Copy the full SHA
    8c466a5 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2022

  1. in_tail: Extract group watcher related codes to in_tail/group_watcher.rb 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 6, 2022
    Copy the full SHA
    fe4f915 View commit details
    Browse the repository at this point in the history

  2. in_tail: Remove needless spaces 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 6, 2022
    Copy the full SHA
    aefde97 View commit details
    Browse the repository at this point in the history

  3. in_tail: Rename group_watcher.rb to group_watch.rb 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 6, 2022
    Copy the full SHA
    7b1bbac View commit details
    Browse the repository at this point in the history

  4. in_tail: Add {add,remove}_group_watcher to GroupWatch module 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 6, 2022
    Copy the full SHA
    a2d9526 View commit details
    Browse the repository at this point in the history

  5. in_tail: Remove a needless blank line 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 6, 2022
    Copy the full SHA
    433883b View commit details
    Browse the repository at this point in the history

  6. in_tail: Rename add_group_watcher & remove_group_watcher 

    add_group_watcher ->
add_path_to_group_watcher

remove_group_watcher ->
remove_path_from_group_watcher

And simplify them.

Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 6, 2022
    Copy the full SHA
    46e898f View commit details
    Browse the repository at this point in the history

  7. in_tail: Make sure to return nil early in add_path_to_group_watcher 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 6, 2022
    Copy the full SHA
    e8d893a View commit details
    Browse the repository at this point in the history

Commits on May 8, 2022

  1. in_tai: Simplify detecting group watcher's limit 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 8, 2022
    Copy the full SHA
    d311670 View commit details
    Browse the repository at this point in the history

  2. in_tail: Fix warnings of group watcher tests 

    /home/aho/Projects/Fluentd/fluentd/test/plugin/test_in_tail.rb:183: warning: assigned but unused variable - d
/home/aho/Projects/Fluentd/fluentd/test/plugin/test_in_tail.rb:205: warning: assigned but unused variable - d
/home/aho/Projects/Fluentd/fluentd/test/plugin/test_in_tail.rb:220: warning: assigned but unused variable - d
/home/aho/Projects/Fluentd/fluentd/test/plugin/test_in_tail.rb:385: warning: ambiguous first argument; put parentheses or a space even after `-' operator
/home/aho/Projects/Fluentd/fluentd/lib/fluent/plugin/in_tail/group_watch.rb:123: warning: assigned but unused variable - e

Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 8, 2022
    Copy the full SHA
    e291dae View commit details
    Browse the repository at this point in the history

Commits on May 14, 2022

  1. in_tail: Add throttling_is_enabled? 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 14, 2022
    Copy the full SHA
    0de4e66 View commit details
    Browse the repository at this point in the history

  2. in_tail: Remove a needless default value of throttling_is_enabled? 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 14, 2022
    Copy the full SHA
    dc680be View commit details
    Browse the repository at this point in the history

Commits on May 15, 2022

  1. test_in_tail: Move group config tests to separated sub_test_case 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 15, 2022
    Copy the full SHA
    07ef562 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2022

  1. test_in_tail: Reduce test time of group watch tests 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 16, 2022
    Copy the full SHA
    efa7d2d View commit details
    Browse the repository at this point in the history

  2. Fix coding style 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 16, 2022
    Copy the full SHA
    bd5a704 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2022

  1. test_in_tail: Fix inappropriate variable name 

    safety_mergin ->
safety_ratio

Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 17, 2022
    Copy the full SHA
    c6c5989 View commit details
    Browse the repository at this point in the history

  2. in_tail: Fix wrong lower bound of group watch limit 

    Signed-off-by: Takuro Ashie <ashie@clear-code.com>
    @ashie
    ashie committed May 17, 2022
    Copy the full SHA
    5f54dd0 View commit details
    Browse the repository at this point in the history