Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue: Feature-level p-values are not generated by the Spot-the-diff algorithm #821

Open
Gaurav-Sahu-TA opened this issue Jul 3, 2023 · 2 comments

Comments

@Gaurav-Sahu-TA
Copy link

Gaurav-Sahu-TA commented Jul 3, 2023

Description:
Feature-level p-values are not generated by the Spot-the-diff algorithm during drift detection, despite proper implementation.

No specific parameters or options were found to control the generation of feature-level p-values

@arnaudvl
Copy link
Contributor

arnaudvl commented Jul 3, 2023

Hi @Gaurav-Sahu-TA . The Spot-the-diff detector doesn't produce feature-level p-values as it's a multivariate detector over all features. It does however learn the difference between the distributions of the reference and test sets via the kernel coefficients. See e.g. the MNIST and Wine example: https://docs.seldon.io/projects/alibi-detect/en/stable/examples/cd_spot_the_diff_mnist_wine.html.

@Gaurav-Sahu-TA
Copy link
Author

Hi @arnaudvl , Are there any existing drift detection techniques specifically designed to identify changes at the feature level in time series data?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants