Failure to correctly parse `ldconfig` output #5540

RosenGeorgiev · 2021-02-09T09:49:52Z

Description of the issue

Failure to correctly parse ldconfig output. Started happening after latest Arch upgrade. I guess the ldconfig people changed their output a little bit.

Context information (for bug reports)

Output of pyinstaller --version: 4.2
Version of Python: 3.9
Platform: Arch

Stacktrace / full error message

Traceback (most recent call last):
  File "/somewhere_on_my_system/venv/bin/pyinstaller", line 8, in <module>
    sys.exit(run())
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/__main__.py", line 114, in run
    run_build(pyi_config, spec_file, **vars(args))
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/__main__.py", line 65, in run_build
    PyInstaller.building.build_main.main(pyi_config, spec_file, **kwargs)
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/building/build_main.py", line 725, in main
    build(specfile, kw.get('distpath'), kw.get('workpath'), kw.get('clean_build'))
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/building/build_main.py", line 672, in build
    exec(code, spec_namespace)
  File "/somewhere_on_my_system/web_ui.spec", line 11, in <module>
    a = Analysis(
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/building/build_main.py", line 242, in __init__
    self.__postinit__()
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/building/datastruct.py", line 160, in __postinit__
    self.assemble()
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/building/build_main.py", line 438, in assemble
    ctypes_binaries = scan_code_for_ctypes(co)
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/depend/utils.py", line 145, in scan_code_for_ctypes
    binaries = _resolveCtypesImports(binaries)
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/depend/utils.py", line 319, in _resolveCtypesImports
    load_ldconfig_cache()
  File "/somewhere_on_my_system/venv/lib/python3.9/site-packages/PyInstaller/depend/utils.py", line 402, in load_ldconfig_cache
    path = m.groups()[-1]
AttributeError: 'NoneType' object has no attribute 'groups'

It fails on the last line of this:

	ld-linux.so.2 (ELF) => /usr/lib32/ld-linux.so.2
	ld-linux.so.2 (ELF) => /usr/lib/ld-linux.so.2
	ld-linux-x86-64.so.2 (libc6,x86-64) => /usr/lib/ld-linux-x86-64.so.2
Cache generated by: ldconfig (GNU libc) release release version 2.33

In depend/utils.py on line 402 no match check is being performed and the exception above is being thrown:

  399     for line in text:                                                                               
  400         # :fixme: this assumes libary names do not contain whitespace                               
  401         m = pattern.match(line)                                                                                                    
  402         path = m.groups()[-1]

The text was updated successfully, but these errors were encountered:

bwoodsend · 2021-02-09T19:22:36Z

Yes, I guess it just needs a:

if m is None:
    continue

That would however have the effect of silently ignoring lines in unrecognised syntax which could be a very subtle bug in future.

rokm · 2021-02-09T20:44:50Z

Indeed. We could also print a warning for non-matched lines - but only for those that do not start with "Cache generated by: ", to avoid spam on known "problematic" lines.

This change in output seems to come from introduction of an extension mechanism to ld.so.cache, so we'll probably need to expand the ignore list in the future. But this way, we can explicitly ignore the lines we know are harmless, and still catch new ones that could introduce bugs elsewhere...

). ldconfig has started adding additional lines of output such as: Cache generated by: ldconfig (GNU libc) release release version 2.33 which caused regex parse errors. This particular line is now whitelisted as skipable. And any future unrecognised patterns will now issue warnings.

bwoodsend · 2021-02-10T20:15:16Z

Mind testing my patch?

pip install github.com/bwoodsend/pyinstaller/archive/5540.zip

). [skip-ci] ldconfig has started adding additional lines of output such as: Cache generated by: ldconfig (GNU libc) release release version 2.33 which caused regex parse errors. This particular line is now whitelisted as skipable. And any future unrecognised patterns will now issue warnings.

RosenGeorgiev · 2021-02-11T07:13:06Z

I confirm that it works now.

ParaSpl01t · 2021-02-12T14:38:41Z

Mind testing my patch?

pip install github.com/bwoodsend/pyinstaller/archive/5540.zip

I am here from #5552 and can confirm that your patch works but is giving me a 80mb file using -F flag. I'm sure this was around 8mb previously.

rokm · 2021-02-12T15:07:22Z

I am here from #5552 and can confirm that your patch works but is giving me a 80mb file using -F flag. I'm sure this was around 8mb previously.

I doubt a onefile (-F) build of a project using pywebview was previously just 8 MB, as it would need to bundle chromium (or PyQt5/PySide2 QtWebEngine), regardless of this issue and this patch. So either you are comparing two projects with different imports, or two different builds (onefile vs onedir).

…-ci] (#5547) ldconfig has started adding additional lines of output such as: Cache generated by: ldconfig (GNU libc) release release version 2.33 which caused regex parse errors. This particular line is now whitelisted as skipable. And any future unrecognised patterns will now issue warnings.

LefterisJP · 2021-02-18T19:20:20Z

Just run into this in my Arch. Really glad to see it's already handled. Thank you guys.

frostworx · 2021-02-21T21:25:32Z

What @LefterisJP said.
Thanks a lot for the patch!
Maybe a minor version bump would be a good idea, to automatically pull in the patch for package maintainers.

bwoodsend · 2021-02-22T07:11:44Z

Maybe a minor version bump would be a good idea, to automatically pull in the patch for package maintainers.

I'd be for this. This issue seems to be collecting a fair bit of traffic. @htgoebel Could you do this?

simaoafonso-pwt · 2021-03-05T11:21:12Z

Friendly ping to request a minor version bump.

Legorooj · 2021-03-06T05:22:53Z

Hopefully we'll be able to do a version bump soon, however please note that at the moment only Hartmut has the ability to do releases.

blefev · 2021-03-24T02:04:59Z

Just run into this in my Arch. Really glad to see it's already handled. Thank you guys.

Same here and the fix worked fine for me!

Kastakin · 2021-05-30T14:59:40Z

I just stumbled upon this issue while trying to figure out what was going wrong in my system.

I don't know if it can help for clarity but the issue came out of blue on my Arch-linux machine only. For our project we are using PyInstaller via fbs to package the PyQt app we are working on. Due to the limitations fbs imposes we are tied to PyInstaller version 3.4, the patch proposed by @bwoodsend works like a charm but I had to "hack my way in" by changing the version number to be able to use with my other packages.

Is this something that was originated by an Arch update? Is there any way we can help to make this fix "retroactive"?

rokm · 2021-05-30T15:35:24Z

This change in behavior is stemming from this commit to glibc, which was first released with glibc 2.33. So the "fix" is either to use latest PyInstaller, patch older PyInstaller versions, or downgrade glibc to earlier release (or use distribution that uses older version).

). [skip-ci] (pyinstaller#5547) ldconfig has started adding additional lines of output such as: Cache generated by: ldconfig (GNU libc) release release version 2.33 which caused regex parse errors. This particular line is now whitelisted as skipable. And any future unrecognised patterns will now issue warnings.

bicarlsen · 2021-06-24T02:55:21Z

I had a similar issue as @Kastakin while using fbs and can confirm @bwoodsend's 5540 patch fixes the issue.

Hit following errors when build on RHEL8: pyinstaller/pyinstaller#5540 Signed-off-by: Li Xi <pkuelelixi@163.com>

https://build.opensuse.org/request/show/920039 by user mcepl + dimstar_suse - Update to 4.5.1: large number of changes, see packaged CHANGES.rst for the complete list. - Remove glibc233.patch (included upstream) - Automagically skip matplotlib tests because matplotlib dropped python36 - Add glibc233.patch to fix recent test failure (gh#pyinstaller/pyinstaller#5540) - Disable functional tests as it takes ages and basic checks are okay with unittests - Use xdist for test execution as otherwise it takes ages - Requires python-devel, as `pyinstaller` cannot be used without it - Temporary disabled of tests test_egg* and test_nspkg1* - Update to version 3.6 * See changelog at https://github.com/pyinstaller/pyinstaller/blob/v3.6/doc/CHANGES.rst - Add %bcond_with python2 - Format with spec-cleaner, fix license - Delete upstream bootloaders from the source distributio

Leontking · 2022-03-10T08:25:14Z

uhhh btw that link no more works anyone got a other link?

simaoafonso-pwt · 2022-03-10T10:43:09Z

uhhh btw that link no more works anyone got a other link?

The fix was already released, just install a newer PyInstaller version.

Kastakin · 2022-03-11T18:04:33Z

uhhh btw that link no more works anyone got a other link?

If you are using fbs in its GPL licensed version and you are stuck with version 3.4 of Pyinstaller I would suggest you to look at PPG as an alternative

emmanuel-fokamegne · 2022-05-02T23:26:19Z

The fix is not working for me . And i use pyinstaller 5.0.1

bwoodsend · 2022-05-02T23:31:24Z

What does ldconfig -p print on your machine?

rokm added the bug label Feb 9, 2021

bwoodsend self-assigned this Feb 10, 2021

bwoodsend mentioned this issue Feb 10, 2021

Bindepend: Skip/warn unrecognised output from ldconfig (#5540). #5547

Merged

rokm mentioned this issue Feb 12, 2021

getting 'AttributeError' if script is using pywebview module. #5552

Closed

6 tasks

Legorooj closed this as completed in #5547 Feb 13, 2021

maxbechtold mentioned this issue Mar 1, 2021

"build-local.sh dr2" : AttributeError: 'NoneType' object has no attribute 'groups' soong-construction/dirt-rally-time-recorder#58

Closed

illright mentioned this issue Mar 7, 2021

bundling IamMaxim/vigilant-palm-tree#19

Merged

rokm mentioned this issue Mar 22, 2021

Failure on stable when bundling Flask #5661

Closed

brentvollebregt mentioned this issue Mar 23, 2021

Packaging Error - "AttributeError: 'NoneType' object has no attribute 'groups'" in load_ldconfig_cache brentvollebregt/auto-py-to-exe#161

Closed

pawamoy mentioned this issue Apr 8, 2021

Bundling Aria2p Fails pawamoy/aria2p#94

Closed

m-star18 mentioned this issue May 8, 2021

Unable to create exe file m-star18/Spielliste#17

Closed

bicarlsen mentioned this issue Jun 24, 2021

fbs freeze throws AttributeError: 'NoneType' object has no attribute 'groups' mherrmann/fbs#236

Closed

LiXi-storage added a commit to LiXi-storage/barreleye that referenced this issue Jun 30, 2021

build: update pyinstaller to 4.3

b5a84fb

Hit following errors when build on RHEL8: pyinstaller/pyinstaller#5540 Signed-off-by: Li Xi <pkuelelixi@163.com>

jason53415 mentioned this issue Jul 6, 2021

Can this app be compiled on Linux? jason53415/blockly-app#1

Closed

bwoodsend mentioned this issue Jul 10, 2021

m #5993

Closed

github-actions bot locked as resolved and limited conversation to collaborators Nov 16, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Failure to correctly parse `ldconfig` output #5540

Failure to correctly parse `ldconfig` output #5540

RosenGeorgiev commented Feb 9, 2021

bwoodsend commented Feb 9, 2021

rokm commented Feb 9, 2021

bwoodsend commented Feb 10, 2021

RosenGeorgiev commented Feb 11, 2021

ParaSpl01t commented Feb 12, 2021

rokm commented Feb 12, 2021

LefterisJP commented Feb 18, 2021

frostworx commented Feb 21, 2021

bwoodsend commented Feb 22, 2021

simaoafonso-pwt commented Mar 5, 2021

Legorooj commented Mar 6, 2021

blefev commented Mar 24, 2021

Kastakin commented May 30, 2021

rokm commented May 30, 2021

bicarlsen commented Jun 24, 2021

Leontking commented Mar 10, 2022

simaoafonso-pwt commented Mar 10, 2022 •

edited

Kastakin commented Mar 11, 2022

emmanuel-fokamegne commented May 2, 2022 •

edited

bwoodsend commented May 2, 2022

Failure to correctly parse ldconfig output #5540

Failure to correctly parse ldconfig output #5540

Comments

RosenGeorgiev commented Feb 9, 2021

Description of the issue

Context information (for bug reports)

Stacktrace / full error message

bwoodsend commented Feb 9, 2021

rokm commented Feb 9, 2021

bwoodsend commented Feb 10, 2021

RosenGeorgiev commented Feb 11, 2021

ParaSpl01t commented Feb 12, 2021

rokm commented Feb 12, 2021

LefterisJP commented Feb 18, 2021

frostworx commented Feb 21, 2021

bwoodsend commented Feb 22, 2021

simaoafonso-pwt commented Mar 5, 2021

Legorooj commented Mar 6, 2021

blefev commented Mar 24, 2021

Kastakin commented May 30, 2021

rokm commented May 30, 2021

bicarlsen commented Jun 24, 2021

Leontking commented Mar 10, 2022

simaoafonso-pwt commented Mar 10, 2022 • edited

Kastakin commented Mar 11, 2022

emmanuel-fokamegne commented May 2, 2022 • edited

bwoodsend commented May 2, 2022

Failure to correctly parse `ldconfig` output #5540

Failure to correctly parse `ldconfig` output #5540

simaoafonso-pwt commented Mar 10, 2022 •

edited

emmanuel-fokamegne commented May 2, 2022 •

edited