Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

f16 native support in Rust #3358

Closed
VariantXYZ opened this issue Dec 24, 2022 · 1 comment
Closed

f16 native support in Rust #3358

VariantXYZ opened this issue Dec 24, 2022 · 1 comment

Comments

@VariantXYZ
Copy link

Sorry in advance if I missed a tracking issue somewhere, the ones I've found seemed to briefly mention but not propose/drive native f16 specifically.

Specifically, I've seen:
#2629
#521
rust-lang/stdarch#344

I think there are plenty of reasons to support f16 as a native arithmetic type in Rust, but my primary use-case is ML inference for hardware that supports fp16 arithmetic (e.g. the Cortex-a55).

I've resorted to writing simple functions (multiply - add, dot products, etc...) to operate on _Float16 values in C and calling them because the half crate's conversion cost is really painful for anything low-latency/high frequency (audio processing). It is... far from efficient.

@VariantXYZ VariantXYZ changed the title f16 and bf16 native support in Rust f16 native support in Rust Dec 24, 2022
@VariantXYZ
Copy link
Author

I should've read #2629 better! I'll just drop my comments in there and close this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant