Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: gRPC advanced guides #3034

Merged
merged 28 commits into from Sep 27, 2022
Merged

docs: gRPC advanced guides #3034

merged 28 commits into from Sep 27, 2022

Conversation

aarnphm
Copy link
Member

@aarnphm aarnphm commented Sep 22, 2022

Advanced guides

Provide snippets to quickly test and run client implementation with bazel.

@aarnphm aarnphm requested a review from a team as a code owner September 22, 2022 12:53
@aarnphm aarnphm requested review from parano and removed request for a team September 22, 2022 12:53
@codecov
Copy link

codecov bot commented Sep 22, 2022

Codecov Report

Merging #3034 (ce567f3) into main (266b131) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##             main    #3034   +/-   ##
=======================================
  Coverage   62.29%   62.29%           
=======================================
  Files         131      131           
  Lines       11321    11321           
  Branches     1873     1873           
=======================================
  Hits         7052     7052           
  Misses       3842     3842           
  Partials      427      427           
Impacted Files Coverage Δ
bentoml/_internal/io_descriptors/numpy.py 68.50% <ø> (ø)
bentoml/_internal/server/grpc/config.py 0.00% <ø> (ø)
bentoml/bentos.py 66.95% <0.00%> (ø)

@aarnphm aarnphm changed the title docs[wip]: gRPC advanced guides docs: gRPC advanced guides Sep 22, 2022
@aarnphm aarnphm requested a review from ssheng September 22, 2022 22:12
@aarnphm aarnphm force-pushed the docs/grpc-server-info branch 10 times, most recently from 047568b to 5ff7793 Compare September 25, 2022 09:39
Comment on lines +41 to +48
width: 50em;
}

.sidebar-drawer {
width: calc(45% - 26em);
}

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes t docs a tad bit bigger.

docs/source/guides/snippets/grpc/README.md Outdated Show resolved Hide resolved
docs/source/guides/snippets/grpc/bentoml Outdated Show resolved Hide resolved
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
docs/source/guides/grpc.rst Show resolved Hide resolved
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
Comment on lines 1055 to 1070
With support for :ref:`multiplexing <guides/grpc:Demystifying the misconception of gRPC vs. REST>`
to eliminate :wiki:`head-of-line blocking <Head-of-line_blocking>`,
gPRC enables us to mount additional custom servicess alongside with BentoService,
and serve them under the same port.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mounting services is independent of multiplexing and head of line blocking. Only that gRPC multiplexing makes it nicer so that one service does not block another service.

Also, there is a typo in "servicess".

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Isn't that the purpose of service multiplexing? is that multiple services can be served under the same port?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can technically do that in http/1 without multiplexing, like uvicorn.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

but i guess it is not support ootb

docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
@aarnphm aarnphm force-pushed the docs/grpc-server-info branch 3 times, most recently from 0393c6b to 0f50e30 Compare September 26, 2022 04:48
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
also just slightly bigger div for contents container

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
make sure to include protobuf in the requirements

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
docs/source/guides/grpc.rst Outdated Show resolved Hide resolved
@ssheng ssheng merged commit 9653402 into bentoml:main Sep 27, 2022
@aarnphm aarnphm deleted the docs/grpc-server-info branch September 27, 2022 09:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants