Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to configure a nginx ingress on seldon-mesh service for grpc request #5179

Open
shuaiyy opened this issue Dec 31, 2023 · 0 comments
Open
Labels

Comments

@shuaiyy
Copy link

shuaiyy commented Dec 31, 2023

my ingress is :

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  labels:
    app: seldon-mesh
    app.kubernetes.io/name: seldon-mesh
  name: seldon-mesh
  namespace: seldon-mesh
spec:
  defaultBackend:
    service:
      name: seldon-mesh
      port:
        number: 80
  rules:
  - host: seldon-mesh.seldon-control-plane.orb.local

when send a grpc request , got: Error: rpc error: code = Unavailable desc = connection closed before server preface received

seldon model infer iris --inference-mode grpc  --inference-host seldon-mesh.seldon-control-plane.orb.local:80 \
  '{"model_name":"iris","inputs":[{"name":"input","contents":{"fp32_contents":[1,2,3,4]},"datatype":"FP32","shape":[1,4]}]}'

use port 443 got the same error.

it's ok to send a rest request:

seldon model infer iris --inference-host seldon-mesh.seldon-control-plane.orb.local \
  '{"inputs": [{"name": "predict", "shape": [1, 4], "datatype": "FP32", "data": [[1, 2, 3, 4]]}]}'
@sakoush sakoush added the v2 label Jan 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants