Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CHIP] Fetch Stats NRT + Group By Stats #704

Open
cristianfr opened this issue Mar 1, 2024 · 0 comments
Open

[CHIP] Fetch Stats NRT + Group By Stats #704

cristianfr opened this issue Mar 1, 2024 · 0 comments

Comments

@cristianfr
Copy link
Collaborator

Problem Statement

Some of the more relevant stats such as score drift don't require a join to define. They can be defined a streaming aggregation of scores. It's desirable to have existing stats such as null counts and drift for log data to be able to be processed in microbatches into the KV Store with a reasonable cadence (say 5 minutes). This would allow to build near realtime monitoring that computes drift, null counts and other statistics on top of fetched data.

Requirements

  • Fetch statistics from group bys.

Verification

  • Unit tests

Approach

  • TBD, could be an application of the Tiled aggregation or a separate streaming job.

User API (when required)

  • Extension to existing endpoints in Fetcher API

Planning

TBD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant