Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] model evaluation + metrics #356

Open
Gregory-Pereira opened this issue Apr 28, 2024 · 0 comments
Open

[Feature] model evaluation + metrics #356

Gregory-Pereira opened this issue Apr 28, 2024 · 0 comments
Labels
AI feature Ask for totally new functionality testing

Comments

@Gregory-Pereira
Copy link
Collaborator

I would like to have some way to compare efficiency of models, especially because we are using this repo to showcase our granite-7b-lab image. This unfortunately will have to be implemented in a recipe-by-recipe way because the model evaluation metrics very per application / problem type.
/cc @MichaelClifford

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
AI feature Ask for totally new functionality testing
Projects
Development

No branches or pull requests

1 participant