Python 3.11 support

[fredrikaverpil]

Is your feature request related to a problem? Please describe.

Currently, grpcio does not build from source with Python 3.11.0b4.

Describe the solution you'd like

I'd like to be able to install grpcio in Python 3.11.

Describe alternatives you've considered

Well...

Additional context

Dockerfile and full build log here.

Potentially related: #30272

[phillipuniverse]

Very similar issues on the latest versions at time of writing. Dockerfile:

FROM python:3.11-rc-slim-bullseye

RUN apt-get update && apt-get -y install libpq-dev git
RUN apt-get -y install build-essential

WORKDIR /workdir

# create virtual environment and activate it
RUN python -m venv /opt/venv
ENV VIRTUAL_ENV="/opt/venv" \
    PATH="/opt/venv/bin:$PATH"

RUN pip install wheel
RUN pip install grpcio==1.48.0

[Hnasar]

Just a heads up that Python 3.11 out on 2022-10-03 -- in one month -- but rc builds are already available.

We strongly encourage maintainers of third-party Python projects to prepare their projects for 3.11 compatibilities during this phase

https://www.python.org/downloads/release/python-3110rc1/

I see a few places in this codebase where 3.11 may need to be added:

• https://github.com/grpc/grpc/blob/4f8b3f476b7892457f757259ead876ac085adb01/templates/tools/dockerfile/compile_python_310.include
• https://github.com/grpc/grpc/blob/f5885880a1d9a2292cbb575ca9f9ab58f6348c71/tools/internal_ci/helper_scripts/install_python_interpreters.ps1
• https://github.com/grpc/grpc/blob/4f8b3f476b7892457f757259ead876ac085adb01/tools/dockerfile/test/python_debian11_default_x64/Dockerfile

And when I tried to build on windows 11 it also failed. Maybe I Need pthread, but there's also some other errors 🤔
https://gist.github.com/Hnasar/9651d83785ffa3b05f8a093c1e07b208

Thank you grpc maintainers! Looking forward to the nice 3.11 speedups once we get wheels & builds available!

[gnossen]

I'm working on adding this support at the moment. Sorry for the wait there. We're working on automation to make this process speedier in the future given that Python releases are now once a year.

Oddly, I don't seem to be running into the compilation error referenced:

#12 126.3       src/python/grpcio/grpc/_cython/cygrpc.cpp:126605:23: error: ‘_PyErr_StackItem’ {aka ‘struct _err_stackitem’} has no member named ‘exc_type’
#12 126.3       126605 |     while ((exc_info->exc_type == NULL || exc_info->exc_type == Py_None) &&

I would expect this to be resolved by a fix in Cython, but I have not updated our Cython version pin. I am using rc1 instead of beta4, so that could be the issue. Any idea what the difference might be? If it's not obvious, I'll try to reproduce using the Dockerfile provided by @fredrikaverpil

[toppk]

This is the fix in cython cython/cython#4584 It seems likely to be only fixed in the 3.x version of cython. I am encountering this in python 3.11.0rc1, so I am surprised you are not.

[gnossen]

Well, as long as the artifacts build properly against 3.11, I suppose we're fine. 3.11 will be supported in 1.49.0, which is going out in the next couple of days.