TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers' - Databricks

[richbenmintz]

Using Databricks runtime 12.2 LTS, I am unable to import the latest version of great expectations into a python notebook

Reproduce Steps:

• Install great expectations as a cluster library
• create a python notebook
• run the following code in a cell
• import great_expectations

Expected behavior
The library is expected to import successfully

Environment (please complete the following information):

• Azure Databricks
• Great Expectations Version: 0.16.16
• Azure - Databricks

Additional context
Imports successfully by downgrading databricks to runtime 11.3 LTS

[Kilo59]

What version of pydantic and typing_extensions are in your environment?

See related issues
explosion/spaCy#12034
pydantic/pydantic#4885

[richbenmintz]

Hi @Kilo59,

I have pinned typing-extensions to 4.5.0, but have not explicitly installed pydantic in my virtual env. this package incompatabilty occured about a month ago with great-expectations and it seems like the recent release has introduced the same issue.

[austiezr]

Hey @richbenmintz; we've had some motion in this area over the past month, and believe this should now be resolved on latest versions. If this is still an issue for you, please feel free to re-open!