BUG: get_data_dir support for conda Windows enviroments

[Stophface]

Installation method/steps

I freshley installed PyProj according to the docs

conda config --prepend channels conda-forge
conda config --set channel_priority strict
conda create -n pyproj_env pyproj
conda activate pyproj_env

When I try

from pyproj import CRS

I get

PyProj: pyproj unable to set database path. _pyproj_global_context_initialize()

Whats going on there?

Environment Information

• pyproj version you are attempting to install
• PROJ version: Rel. 8.2.1, January 1st, 2022
• Python version: Python 3.9.7
• Operation System Information: Windows-10-10.0.19042-SP0

[snowman2]

What is the value of the PROJ_LIB environment variable?

[Stophface]

@snowman2 Its: C:\Program Files\PostgreSQL\13\share\contrib\postgis-3.1\proj

I also just got this error:

PROJ: proj_create_from_database: C:\Program Files\PostgreSQL\13\share\contrib\postgis-3.1\proj\proj.db lacks DATABASE.LAYOUT.VERSION.MAJOR / DATABASE.LAYOUT.VERSION.MINOR metadata. It comes from another PROJ installation.

How do handle this situation?

[snowman2]

Sounds like you have conflicting versions of the proj.db. Here are docs for how to look into this: https://pyproj4.github.io/pyproj/stable/gotchas.html#internal-proj-error-sqlite-error-on-select

[Stophface]

@snowman2 Thanks for the link. It seems like this is the problem. However, I am not sure how to fix it.

To get data directory being used: pyproj.datadir.get_data_dir()

import pyproj
pyproj.datadir.get_data_dir()

'C:\Program Files\PostgreSQL\13\share\contrib\postgis-3.1\proj'

The order for searching for the data directory can be found in the docstrings of pyproj.datadir.get_data_dir()

pyproj.datadir.get_data_dir()

'C:\Program Files\PostgreSQL\13\share\contrib\postgis-3.1\proj'

How to know in which folder pyproj should look instead for the database? If I know the path to the folder, I set it via
pyproj.datadir.set_data_dir(), right?

[Stophface]

This is how I found the PATH to PROJ

I looked into this file ...Miniconda3\envs<ENV>\conda-meta\proj--h1cfcee-.json and searched for \pkgs\proj. Once found, I checked the versins of PROJ installed in this folder C:...\Miniconda3\pkgs. There are folder named something like proj--h1cfcee-. Make sure the folder name is the exact same name you found this file links to: ...Miniconda3\envs<ENV>\conda-meta\proj--h1cfcee-.json. Finally I set my environment variable to the version needed ...Miniconda3\pkgs\proj--h1cfcee-<VERSION\Library\share\proj.

[snowman2]

pyproj/pyproj/datadir.py

Line 75 in 8f0e1f7

prefix_datadir = Path(sys.prefix, "share", "proj")

It might not be a bad idea to better support for the Windows prefix search path. Maybe something like:

conda_windows_prefix_datadir = Path(sys.prefix, "Library", "share", "proj")

@Stophface are you able to share the value of sys.prefix after activating your conda environment?

[snowman2]

Looks like adding the windows Library prefix search would be useful here: https://github.com/conda-forge/proj.4-feedstock/blob/9bf81fff5781b937f601a9f1b372f5a819f5bb38/recipe/scripts/activate.sh#L14

[Stophface]

@snowman2 Sure, I am not sure how to get it thoug.
Do you mean this?

>>> import sys
>>> sys.prefix
'C:\\Users\\...\\Miniconda3\\envs\\<MY_ENV>'

[snowman2]

Thanks @Stophface, that was helpful. This is something that I think should be added to the logic in pyproj to find the data directory on Windows conda environments.