ERROR-Import Langchain : TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers' #4401

Abonia1 · 2023-05-09T14:25:59Z

In databricks I cant able to import langchain.

TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers'

Thanks in advance.

The text was updated successfully, but these errors were encountered:

samlopezruiz · 2023-05-09T23:14:49Z

same for me

samlopezruiz · 2023-05-10T15:04:52Z

In databricks, the error disappears with version langchain==0.0.125

Abonia1 · 2023-05-11T13:37:39Z

It works with the version 0.0.125.

pip install langchain==0.0.125

Thanks @samlopezruiz for sharing this solution.

I let this issue open as it works with older version.But still issue with new version.

jigsawmetric · 2023-05-11T14:46:53Z

I have the same issue and pip install langchain==0.0.125 did not resolve it

TypeError Traceback (most recent call last)
Cell In[1], line 1
----> 1 from langchain.text_splitter import CharacterTextSplitter

File ~/opt/anaconda3/lib/python3.9/site-packages/langchain/init.py:5
1 """Main entrypoint into package."""
3 from typing import Optional
----> 5 from langchain.agents import MRKLChain, ReActChain, SelfAskWithSearchChain
6 from langchain.cache import BaseCache
7 from langchain.callbacks import (
8 set_default_callback_manager,
9 set_handler,
10 set_tracing_callback_manager,
11 )

File ~/opt/anaconda3/lib/python3.9/site-packages/langchain/agents/init.py:2
1 """Interface for agents."""
----> 2 from langchain.agents.agent import Agent, AgentExecutor
3 from langchain.agents.agent_toolkits import (
4 create_csv_agent,
5 create_json_agent,
(...)
10 create_vectorstore_router_agent,
11 )
12 from langchain.agents.conversational.base import ConversationalAgent

File ~/opt/anaconda3/lib/python3.9/site-packages/langchain/agents/agent.py:11
8 from typing import Any, Dict, List, Optional, Sequence, Tuple, Union
10 import yaml
---> 11 from pydantic import BaseModel, root_validator
13 from langchain.agents.tools import InvalidTool
14 from langchain.callbacks.base import BaseCallbackManager

File ~/opt/anaconda3/lib/python3.9/site-packages/pydantic/init.py:2, in init pydantic.init()

File ~/opt/anaconda3/lib/python3.9/site-packages/pydantic/dataclasses.py:48, in init pydantic.dataclasses()

File ~/opt/anaconda3/lib/python3.9/site-packages/pydantic/main.py:120, in init pydantic.main()

TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers'

zinniz · 2023-05-16T07:35:33Z

I am also facing same issue tried pip install langchain, pip install -q langchain, none of them are working getting TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers'.

pip install langchain==0.0.125 using this I am getting error

liangz1 · 2023-05-18T13:49:17Z

Hi @Abonia1 @zinniz @jigsawmetric Would you mind specifying which Databricks Runtime version are you using? I tested with DBR 12.2 LTS and DBR 13.0 ML with langchain==0.0.125 and 0.0.173, and all work well. I'm happy to take a closer look once you share more info.

WeichenXu123 · 2023-05-19T00:13:38Z

This probably is not langchain issue, but it is issue of typing-extensions incompatible with pydantic

Could you try to install langchain 0.0.173 version, then install typing-extensions>=4.20 ?

liangz1 · 2023-05-19T00:29:13Z

@WeichenXu123 Do you mean typing-extensions>=4.2.0?

%pip install langchain typing_extensions==4.1.0
...
pydantic 1.10.6 requires typing-extensions>=4.2.0, but you have typing-extensions 4.1.0 which is incompatible.

We are able to reproduce the issue with typing_extensions==4.1.0.

WeichenXu123 · 2023-05-19T02:01:41Z

sorry. yes we should install typing-extensions>=4.2.0 to address the issue.

harupy · 2023-05-19T02:16:12Z

As @WeichenXu123 and @liangz1 mentioned, we believe the root cause is typing-extensions<4.2 (see pydantic/pydantic#4885). We can reproduce the exact same error with the following code on DBR 12.2 LTS:

%pip install langchain

%pip install typing_extensions==4.1.0

import langchain

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
File <command-3996646595503935>:1
----> 1 import langchain

File /databricks/python_shell/dbruntime/PythonPackageImportsInstrumentation/__init__.py:171, in _create_import_patch.<locals>.import_patch(name, globals, locals, fromlist, level)
    166 thread_local._nest_level += 1
    168 try:
    169     # Import the desired module. If you’re seeing this while debugging a failed import,
    170     # look at preceding stack frames for relevant error information.
--> 171     original_result = python_builtin_import(name, globals, locals, fromlist, level)
    173     is_root_import = thread_local._nest_level == 1
    174     # `level` represents the number of leading dots in a relative import statement.
    175     # If it's zero, then this is an absolute import.

File /local_disk0/.ephemeral_nfs/envs/pythonEnv-e1378973-d308-48c5-9b29-991a3ab4117c/lib/python3.9/site-packages/langchain/__init__.py:6
      3 from importlib import metadata
      4 from typing import Optional
----> 6 from langchain.agents import MRKLChain, ReActChain, SelfAskWithSearchChain
      7 from langchain.cache import BaseCache
      8 from langchain.chains import (
      9     ConversationChain,
     10     LLMBashChain,
   (...)
     18     VectorDBQAWithSourcesChain,
     19 )

File /databricks/python_shell/dbruntime/PythonPackageImportsInstrumentation/__init__.py:171, in _create_import_patch.<locals>.import_patch(name, globals, locals, fromlist, level)
    166 thread_local._nest_level += 1
    168 try:
    169     # Import the desired module. If you’re seeing this while debugging a failed import,
    170     # look at preceding stack frames for relevant error information.
--> 171     original_result = python_builtin_import(name, globals, locals, fromlist, level)
    173     is_root_import = thread_local._nest_level == 1
    174     # `level` represents the number of leading dots in a relative import statement.
    175     # If it's zero, then this is an absolute import.

File /local_disk0/.ephemeral_nfs/envs/pythonEnv-e1378973-d308-48c5-9b29-991a3ab4117c/lib/python3.9/site-packages/langchain/agents/__init__.py:2
      1 """Interface for agents."""
----> 2 from langchain.agents.agent import (
      3     Agent,
      4     AgentExecutor,
      5     AgentOutputParser,
      6     BaseMultiActionAgent,
      7     BaseSingleActionAgent,
      8     LLMSingleActionAgent,
      9 )
     10 from langchain.agents.agent_toolkits import (
     11     create_csv_agent,
     12     create_json_agent,
   (...)
     20     create_vectorstore_router_agent,
     21 )
     22 from langchain.agents.agent_types import AgentType

File /databricks/python_shell/dbruntime/PythonPackageImportsInstrumentation/__init__.py:171, in _create_import_patch.<locals>.import_patch(name, globals, locals, fromlist, level)
    166 thread_local._nest_level += 1
    168 try:
    169     # Import the desired module. If you’re seeing this while debugging a failed import,
    170     # look at preceding stack frames for relevant error information.
--> 171     original_result = python_builtin_import(name, globals, locals, fromlist, level)
    173     is_root_import = thread_local._nest_level == 1
    174     # `level` represents the number of leading dots in a relative import statement.
    175     # If it's zero, then this is an absolute import.

File /local_disk0/.ephemeral_nfs/envs/pythonEnv-e1378973-d308-48c5-9b29-991a3ab4117c/lib/python3.9/site-packages/langchain/agents/agent.py:13
     10 from typing import Any, Callable, Dict, List, Optional, Sequence, Tuple, Union
     12 import yaml
---> 13 from pydantic import BaseModel, root_validator
     15 from langchain.agents.agent_types import AgentType
     16 from langchain.agents.tools import InvalidTool

File /databricks/python_shell/dbruntime/PythonPackageImportsInstrumentation/__init__.py:171, in _create_import_patch.<locals>.import_patch(name, globals, locals, fromlist, level)
    166 thread_local._nest_level += 1
    168 try:
    169     # Import the desired module. If you’re seeing this while debugging a failed import,
    170     # look at preceding stack frames for relevant error information.
--> 171     original_result = python_builtin_import(name, globals, locals, fromlist, level)
    173     is_root_import = thread_local._nest_level == 1
    174     # `level` represents the number of leading dots in a relative import statement.
    175     # If it's zero, then this is an absolute import.

File /local_disk0/.ephemeral_nfs/envs/pythonEnv-e1378973-d308-48c5-9b29-991a3ab4117c/lib/python3.9/site-packages/pydantic/__init__.py:2, in init pydantic.__init__()

File /local_disk0/.ephemeral_nfs/envs/pythonEnv-e1378973-d308-48c5-9b29-991a3ab4117c/lib/python3.9/site-packages/pydantic/dataclasses.py:48, in init pydantic.dataclasses()

File /local_disk0/.ephemeral_nfs/envs/pythonEnv-e1378973-d308-48c5-9b29-991a3ab4117c/lib/python3.9/site-packages/pydantic/main.py:120, in init pydantic.main()

TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers'

The remaining question is why and how typing-extensions<4.2 is installed.
This can happen when:

pip install typing-extensions<4.2 is executed.
pip install <package> where <package> requires typing-extensions<4.2, is executed.

harupy · 2023-05-19T02:32:56Z

I found typing-extensions==4.1.1 is preinstalled in DBR 12.2 LTS. This may be related.

WeichenXu123 · 2023-05-19T03:50:05Z

Shall we upgrade typing-extensions to >=4.2 on databricks runtime ?

harupy · 2023-05-19T04:02:25Z

@WeichenXu123 We don't need to.

harupy · 2023-05-19T12:27:46Z

@Abonia1 How did you install lanhchain? Did you run %pip install langchain on your notebook?

Abonia1 · 2023-05-19T16:44:18Z

@harupy @WeichenXu123 Finally I can install and import recent version of langchain in databricks with DBR 12.2 LTS runtime.

Just do:
%pip install langchain

Thanks for all the support.

gabrielcassimiro17 · 2023-06-02T18:59:21Z

I still had problems using typing-extensions>=4.2.0. However, pinning to 4.5.0 worked.

typing-extensions==4.5.0

scm1210 · 2023-06-05T01:42:18Z

i'm also getting this error and tried the solutions above to no avail

using python 3.9 and langchain 0.0.189

Error for context:

TypeError                                 Traceback (most recent call last)
Input In [28], in <cell line: 2>()
      1 import openai
----> 2 from langchain.chat_models import ChatOpenAI
      3 from langchain import LLMChain
      4 from langchain.prompts.chat import (
      5     ChatPromptTemplate,
      6     SystemMessagePromptTemplate,
      7     HumanMessagePromptTemplate,
      8 )

File ~/opt/anaconda3/lib/python3.9/site-packages/langchain/__init__.py:6, in <module>
      3 from importlib import metadata
      4 from typing import Optional
----> 6 from langchain.agents import MRKLChain, ReActChain, SelfAskWithSearchChain
      7 from langchain.cache import BaseCache
      8 from langchain.chains import (
      9     ConversationChain,
     10     LLMBashChain,
   (...)
     18     VectorDBQAWithSourcesChain,
     19 )

File ~/opt/anaconda3/lib/python3.9/site-packages/langchain/agents/__init__.py:2, in <module>
      1 """Interface for agents."""
----> 2 from langchain.agents.agent import (
      3     Agent,
      4     AgentExecutor,
      5     AgentOutputParser,
      6     BaseMultiActionAgent,
      7     BaseSingleActionAgent,
      8     LLMSingleActionAgent,
      9 )
     10 from langchain.agents.agent_toolkits import (
     11     create_csv_agent,
     12     create_json_agent,
   (...)
     21     create_vectorstore_router_agent,
     22 )
     23 from langchain.agents.agent_types import AgentType

File ~/opt/anaconda3/lib/python3.9/site-packages/langchain/agents/agent.py:13, in <module>
     10 from typing import Any, Callable, Dict, List, Optional, Sequence, Tuple, Union
     12 import yaml
---> 13 from pydantic import BaseModel, root_validator
     15 from langchain.agents.agent_types import AgentType
     16 from langchain.agents.tools import InvalidTool

File ~/opt/anaconda3/lib/python3.9/site-packages/pydantic/__init__.py:2, in init pydantic.__init__()

File ~/opt/anaconda3/lib/python3.9/site-packages/pydantic/dataclasses.py:48, in init pydantic.dataclasses()

File ~/opt/anaconda3/lib/python3.9/site-packages/pydantic/main.py:120, in init pydantic.main()

TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers'```

resuscitateocean · 2023-06-29T07:05:41Z

langchain== 0.0.219, typing-extensions==4.2.0 works for me

mmervecerit · 2023-07-06T21:01:22Z

when I do typing-extensions==4.2.0, got an error that chromadb requires >4.7.
So currently, I get the same error with langchain == 0.0.219 , chromadb==0.3.26, typing-extensions == 4.7.1 in miniconda python 3.8 environment.

mmervecerit · 2023-07-06T21:13:32Z

Update: Created a new environment with Python version 3.9.12.

then installed langchain(pip install langchain) and chromadb (pip install chromadb), and no errors with the following line (which was the issue before):

from langchain.vectorstores import Chroma

Feya · 2023-07-19T07:10:38Z

Hi @Abonia1 @zinniz @jigsawmetric Would you mind specifying which Databricks Runtime version are you using? I tested with DBR 12.2 LTS and DBR 13.0 ML with langchain==0.0.125 and 0.0.173, and all work well. I'm happy to take a closer look once you share more info.

Hi @liangz1 My Databricks Runtime version is 12.2 LTS (includes Apache Spark 3.3.2, Scala 2.12) with langchain==0.0.125 and 0.0.235 and I have encountered the same error. Could you please take a look? Thank you in advance.

liangz1 · 2023-07-19T15:51:59Z

Hi @Feya , would you mind checking if there is any error from the %pip install langchain command, and resolving the conflicting dependencies (typing-extensions)?

meanirban100 · 2023-08-01T10:15:56Z

Initially facing this issue, upgraded to the Databricks runtime version to 13.2 and it is working.

samlopezruiz · 2023-08-04T16:48:26Z

I still had problems using typing-extensions>=4.2.0. However, pinning to 4.5.0 worked.
typing-extensions==4.5.0

This worked for me with langchain==0.0.248

Shivajee89 · 2023-08-08T12:19:25Z

use databricks runtime version as 13.0 while creating the cluster. Hope it helps.

dosubot · 2023-11-07T16:02:37Z

Hi, @Abonia1. I'm Dosu, and I'm helping the LangChain team manage their backlog. I wanted to let you know that we are marking this issue as stale.

From what I understand, you encountered a TypeError when trying to import langchain in Databricks. It seems that the issue has been resolved by either installing langchain==0.0.125 or upgrading typing-extensions to >=4.2.0 or pinning it to 4.5.0. The maintainers also suggested checking the Databricks Runtime version and resolving any conflicting dependencies.

Before we close this issue, we wanted to check with you if it is still relevant to the latest version of the LangChain repository. If it is, please let us know by commenting on this issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days.

Thank you for your understanding and contribution to the LangChain project. Let us know if you have any further questions or concerns.

Abonia1 mentioned this issue May 15, 2023

mlflow.langchain.log_model : AttributeError: module 'langchain' has no attribute '__version__' mlflow/mlflow#8419

Open

dosubot bot mentioned this issue Jul 11, 2023

Langchain Import Issue #7509

Closed

14 tasks

dosubot bot added the stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed label Nov 7, 2023

dosubot bot closed this as not planned Won't fix, can't repro, duplicate, stale Nov 14, 2023

dosubot bot removed the stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed label Nov 14, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ERROR-Import Langchain : TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers' #4401

ERROR-Import Langchain : TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers' #4401

Abonia1 commented May 9, 2023

samlopezruiz commented May 9, 2023

samlopezruiz commented May 10, 2023

Abonia1 commented May 11, 2023

jigsawmetric commented May 11, 2023

zinniz commented May 16, 2023

liangz1 commented May 18, 2023

WeichenXu123 commented May 19, 2023 •

edited

liangz1 commented May 19, 2023

WeichenXu123 commented May 19, 2023

harupy commented May 19, 2023 •

edited

harupy commented May 19, 2023

WeichenXu123 commented May 19, 2023

harupy commented May 19, 2023

harupy commented May 19, 2023

Abonia1 commented May 19, 2023 •

edited

gabrielcassimiro17 commented Jun 2, 2023

scm1210 commented Jun 5, 2023

resuscitateocean commented Jun 29, 2023

mmervecerit commented Jul 6, 2023

mmervecerit commented Jul 6, 2023

Feya commented Jul 19, 2023

liangz1 commented Jul 19, 2023

meanirban100 commented Aug 1, 2023

samlopezruiz commented Aug 4, 2023

Shivajee89 commented Aug 8, 2023

dosubot bot commented Nov 7, 2023

ERROR-Import Langchain : TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers' #4401

ERROR-Import Langchain : TypeError: dataclass_transform() got an unexpected keyword argument 'field_specifiers' #4401

Comments

Abonia1 commented May 9, 2023

samlopezruiz commented May 9, 2023

samlopezruiz commented May 10, 2023

Abonia1 commented May 11, 2023

jigsawmetric commented May 11, 2023

zinniz commented May 16, 2023

liangz1 commented May 18, 2023

WeichenXu123 commented May 19, 2023 • edited

liangz1 commented May 19, 2023

WeichenXu123 commented May 19, 2023

harupy commented May 19, 2023 • edited

harupy commented May 19, 2023

WeichenXu123 commented May 19, 2023

harupy commented May 19, 2023

harupy commented May 19, 2023

Abonia1 commented May 19, 2023 • edited

gabrielcassimiro17 commented Jun 2, 2023

scm1210 commented Jun 5, 2023

resuscitateocean commented Jun 29, 2023

mmervecerit commented Jul 6, 2023

mmervecerit commented Jul 6, 2023

Feya commented Jul 19, 2023

liangz1 commented Jul 19, 2023

meanirban100 commented Aug 1, 2023

samlopezruiz commented Aug 4, 2023

Shivajee89 commented Aug 8, 2023

dosubot bot commented Nov 7, 2023

WeichenXu123 commented May 19, 2023 •

edited

harupy commented May 19, 2023 •

edited

Abonia1 commented May 19, 2023 •

edited