Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请教下目前 model_zoo 中提供的 fp32 的模型,有提供工具或者方法快速转换为 fp #38

Open
eric-yq opened this issue Nov 21, 2023 · 2 comments

Comments

@eric-yq
Copy link

eric-yq commented Nov 21, 2023

No description provided.

@eric-yq
Copy link
Author

eric-yq commented Nov 21, 2023

请教下目前 model_zoo 中提供的 fp32 的模型,有提供工具或者方法快速转换为 fp16 模型吗?
打算用 ARM CPU 进行推理 Benchmark,想看看 FP16 性能如何。
如果工具集有提供了快速进行转换精度的工具或者方法,麻烦各位指导一下。多谢了。

@eric-yq eric-yq closed this as completed Nov 21, 2023
@eric-yq eric-yq reopened this Nov 21, 2023
@JianzheXiao
Copy link
Collaborator

请教下目前 model_zoo 中提供的 fp32 的模型,有提供工具或者方法快速转换为 fp16 模型吗? 打算用 ARM CPU 进行推理 Benchmark,想看看 FP16 性能如何。 如果工具集有提供了快速进行转换精度的工具或者方法,麻烦各位指导一下。多谢了。

框架本身是没有提供低精度量化功能的,这一块其实是交给各个厂商的Backend去做,如果想要去做ARM CPU FP16的测试的话可以在对应的CPU Backend里面手动添加一下最简单的也可以直接model.half()

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants