Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate possible metrics to collect from the system #68

Open
jiayihu opened this issue Feb 27, 2021 · 0 comments
Open

Investigate possible metrics to collect from the system #68

jiayihu opened this issue Feb 27, 2021 · 0 comments

Comments

@jiayihu
Copy link
Owner

jiayihu commented Feb 27, 2021

  • System throughput (IoT + cluster)
  • WASM Update time
  • Service provision time
  • WASM ML start-up time, memory usage, inference time vs normal ML image
  • Inference time local vs cloud
  • Probability of packet drop when sending CoAP or receiving the ack
  • Other CoAP metrics like latency or bandwidth. I don't think I can get power consumption
  • WASM performance on embedded (stack, heap usage, exec timing)
  • Synthetic benchmark for the WASM module run in the embedded device
  • WASM module dimension for pro-processing and ML model. OCI image dimension.
  • Krustlet parallel WASM modules vs k3s

Related #30

@jiayihu jiayihu added this to In progress in Agenda Feb 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Agenda
In progress
Development

No branches or pull requests

1 participant