-
Notifications
You must be signed in to change notification settings - Fork 59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Task overlapped with armnn delegate #15
Comments
I think for non-Android, using a direct delegate is quite a bit simpler to set up than getting NNNAPI and the NN HAL driver service to work. Using the direct delegate will also work on older Android devices where NNAPI is not present, or an old version, so it can have advantages even on Android. Especially for third-party applications which are not in control of which versions of NN HAL drivers have been installed. What advantages do you see NNAPI having over using a direct delegate? |
1.) We don't need to modify the application to use nnapi. e.g. 2.) We don't need a NN HAL driver service on non-Andoird. 3.) I don't think the setup will be harder when using nnapi instead of direct delegate. We nly need to build and install ibneuralnetworks.so to /usr/lib, the tensorflow lite will dlopen it if it is found automatiacally. 4.) There are still unimplemented layers/support in android-nn-driver and direct delegate. 5.) For older Android support , application can call or use armnn directly. |
There is nothing wrong have a direct delegate and an nnapi backend for nnapi deleage. There are something need to be done for android-nn-driver to build for pure linux. |
@MatthewARM FYI Google already have out of Android (chrome os support for nnapi) which should be able to use in pure linux directly. |
While I agree that NNAPI could be made to work on (non-Android) Linux, it doesn't seem to be a supported or promoted option within the NNAPI project, for example I've not seen any official guides on how to set it up. So for the moment the path of least resistance for the Arm NN project is to have an NNAPI driver for Android system integrators, and a TensorFlow Lite delegate for other kinds of deployment. |
We should have a cmake for this project and allow pure linux to run and build a libneutralnetwork.so directly. tensroflow lite nnapi delegate will dlopen libnutralnetwork.so in pure linux environment (non-android)
There is no need for a duplicated and separated delegate for tensorflow lite.
https://github.com/ARM-software/armnn/tree/branches/armnn_20_11/delegate
The text was updated successfully, but these errors were encountered: