keyword extraction model not performing well after quantization using ONNX #5110
Unanswered
amriteshbytesview
asked this question in
Q&A
Replies: 1 comment
-
How did you quantize your model? Are you using your model on CPU, GPU? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have some question regarding the keyword extraction model which I have built using SimpleT5.
When I convert the model to ONNX using fastT5, the model output is affected very badly. As when I predicted from the normal model for a sentence it give me 15 keywords while onnx model give only 2 keywords.
My question are:-
Please help me over this..😶
Thank you...
Beta Was this translation helpful? Give feedback.
All reactions