Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop more policy around payload_bytes data toxicity #1030

Open
jklukas opened this issue Dec 13, 2019 · 0 comments
Open

Develop more policy around payload_bytes data toxicity #1030

jklukas opened this issue Dec 13, 2019 · 0 comments

Comments

@jklukas
Copy link
Contributor

jklukas commented Dec 13, 2019

We need to more formally consider the implications of "chemspill" type incidents where we ingest data that contains sensitive info we don't intend to handle. We may need to define several levels of toxicity and differing procedures as to how thoroughly we need to clean.

In particular, the payload_bytes_raw, payload_bytes_error, and payload_bytes_decoded tables will all have to be modified if analytics users have access to them. We have been trying to make those tables more accessible to users for debugging, but it may not be worth it if it means we're on the hook for more aggressive purging in the case of incidents.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant