Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

custom local connector VTable setup of type OnnxRuntimeGenAIChatCompletionService failed to load #6126

Open
PrestigeDevop opened this issue May 5, 2024 · 0 comments
Labels
bug Something isn't working .NET Issue or Pull requests regarding .NET code

Comments

@PrestigeDevop
Copy link

PrestigeDevop commented May 5, 2024

Describe the bug

A clear and concise description of what the bug is.

in 2.1 standard apps ( that doesn't use .net 8 )
to be exact (Unity engine)

TypeLoadException: VTable setup of type unity.SemanticKernel.Connectors.OnnxRuntimeGenAI.OnnxRuntimeGenAIChatCompletionService failed

however I manged to inference directly using onnxGenAI manged library .
but when using semantic kernel I got this error and no luck with assembly .load dynamically or using assembly definition.

To Reproduce
Steps to reproduce the behavior:

  1. I modify https://github.com/feiyun0112/SemanticKernel.Connectors.OnnxRuntimeGenAI a little bit .
  2. compile the dlls , and put it into unity asset folder .
  3. error occur .

this probably due to the compiler having some issue loading the dll at runtime ?
or perhaps because my edits ...

Additional context

after some adjustment trying and exporting again .. I got this

InvalidOperationException: Build is not permitted on instances returned from AddKernel. Resolve the Kernel from the service provider Microsoft.SemanticKernel.KernelExtensions.Build

I think I couldn't load it natively without any edits and I'm not expert in the scaffold process , so I hope someone have some ideas about this message .

@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code triage labels May 5, 2024
@github-actions github-actions bot changed the title custom local connector VTable setup of type unity.SemanticKernel.Connectors.OnnxRuntimeGenAI.OnnxRuntimeGenAIChatCompletionService failed .Net: custom local connector VTable setup of type unity.SemanticKernel.Connectors.OnnxRuntimeGenAI.OnnxRuntimeGenAIChatCompletionService failed May 5, 2024
@PrestigeDevop PrestigeDevop changed the title .Net: custom local connector VTable setup of type unity.SemanticKernel.Connectors.OnnxRuntimeGenAI.OnnxRuntimeGenAIChatCompletionService failed custom local connector VTable setup of type OnnxRuntimeGenAIChatCompletionService failed to load May 5, 2024
@matthewbolanos matthewbolanos added bug Something isn't working and removed triage labels May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working .NET Issue or Pull requests regarding .NET code
Projects
None yet
Development

No branches or pull requests

3 participants