Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OSError: -9 at img.show() with a .CR2 image #5317

Closed
SnorrenEnzo opened this issue Mar 7, 2021 · 15 comments · Fixed by #5452
Closed

OSError: -9 at img.show() with a .CR2 image #5317

SnorrenEnzo opened this issue Mar 7, 2021 · 15 comments · Fixed by #5452
Labels
Anaconda Issues with Anaconda's Pillow TIFF

Comments

@SnorrenEnzo
Copy link

SnorrenEnzo commented Mar 7, 2021

Hi everyone,

Today I wanted to run a script I regularly use for image sorting, however I got an OSError: -9 occurring at the img.show(). A simplified script which can replicate this behaviour is provided at the end of this post. The image I was trying to show is a .CR2, a Canon RAW image. I have used this script extensively for more than a year on .CR2 files and it behaved flawlessly all the time, until now. It occurs with every .CR2 image, even ones that I know I have opened with Pillow before.

The full error log:

 Traceback (most recent call last):
  File "/home/user/Downloads/Pillow_bug/pillow_bug.py", line 8, in <module>
    img.show()
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/Image.py", line 2218, in show
    _show(self, title=title, command=command)
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/Image.py", line 3182, in _show
    _showxv(image, **options)
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/Image.py", line 3196, in _showxv
    ImageShow.show(image, title, **options)
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/ImageShow.py", line 56, in show
    if viewer.show(image, title=title, **options):
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/ImageShow.py", line 81, in show
    return self.show_image(image, **options)
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/ImageShow.py", line 107, in show_image
    return self.show_file(self.save_image(image), **options)
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/ImageShow.py", line 103, in save_image
    return image._dump(format=self.get_format(image), **self.options)
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/Image.py", line 636, in _dump
    self.load()
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/TiffImagePlugin.py", line 1088, in load
    return self._load_libtiff()
  File "/home/user/anaconda3/envs/picturepicker/lib/python3.9/site-packages/PIL/TiffImagePlugin.py", line 1192, in _load_libtiff
    raise OSError(err)
OSError: -9

Installed modules (made a fresh conda env for this report):

# packages in environment at /home/user/anaconda3/envs/envname:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       1_gnu    conda-forge
ca-certificates           2020.12.5            ha878542_0    conda-forge
certifi                   2020.12.5        py39hf3d152e_1    conda-forge
cycler                    0.10.0                     py_2    conda-forge
dbus                      1.13.6               hfdff14a_1    conda-forge
expat                     2.2.10               h9c3ff4c_0    conda-forge
fontconfig                2.13.1            hba837de_1004    conda-forge
freetype                  2.10.4               h0708190_1    conda-forge
gettext                   0.19.8.1          h0b5b191_1005    conda-forge
glib                      2.66.7               h9c3ff4c_1    conda-forge
glib-tools                2.66.7               h9c3ff4c_1    conda-forge
gst-plugins-base          1.18.3               h04508c2_0    conda-forge
gstreamer                 1.18.3               h3560a44_0    conda-forge
icu                       68.1                 h58526e2_0    conda-forge
jpeg                      9d                   h36c2ea0_0    conda-forge
kiwisolver                1.3.1            py39h1a9c180_1    conda-forge
krb5                      1.17.2               h926e7f8_0    conda-forge
lcms2                     2.12                 hddcbb42_0    conda-forge
ld_impl_linux-64          2.35.1               hea4e1c9_2    conda-forge
libblas                   3.9.0                8_openblas    conda-forge
libcblas                  3.9.0                8_openblas    conda-forge
libclang                  11.1.0          default_ha53f305_0    conda-forge
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libevent                  2.1.10               hcdb4288_3    conda-forge
libffi                    3.3                  h58526e2_2    conda-forge
libgcc-ng                 9.3.0               h2828fa1_18    conda-forge
libgfortran-ng            9.3.0               hff62375_18    conda-forge
libgfortran5              9.3.0               hff62375_18    conda-forge
libglib                   2.66.7               h3e27bee_1    conda-forge
libgomp                   9.3.0               h2828fa1_18    conda-forge
libiconv                  1.16                 h516909a_0    conda-forge
liblapack                 3.9.0                8_openblas    conda-forge
libllvm11                 11.1.0               hf817b99_0    conda-forge
libopenblas               0.3.12          pthreads_h4812303_1    conda-forge
libpng                    1.6.37               h21135ba_2    conda-forge
libpq                     13.1                 hfd2b0eb_2    conda-forge
libstdcxx-ng              9.3.0               h6de172a_18    conda-forge
libtiff                   4.2.0                hdc55705_0    conda-forge
libuuid                   2.32.1            h7f98852_1000    conda-forge
libwebp-base              1.2.0                h7f98852_0    conda-forge
libxcb                    1.13              h7f98852_1003    conda-forge
libxkbcommon              1.0.3                he3ba5ed_0    conda-forge
libxml2                   2.9.10               h72842e0_3    conda-forge
lz4-c                     1.9.3                h9c3ff4c_0    conda-forge
matplotlib                3.3.4            py39hf3d152e_0    conda-forge
matplotlib-base           3.3.4            py39h2fa2bec_0    conda-forge
mysql-common              8.0.23               ha770c72_1    conda-forge
mysql-libs                8.0.23               h935591d_1    conda-forge
ncurses                   6.2                  h58526e2_4    conda-forge
nspr                      4.29                 h9c3ff4c_1    conda-forge
nss                       3.62                 hb5efdd6_0    conda-forge
numpy                     1.20.1           py39hdbf815f_0    conda-forge
olefile                   0.46               pyh9f0ad1d_1    conda-forge
openssl                   1.1.1j               h7f98852_0    conda-forge
pcre                      8.44                 he1b5a44_0    conda-forge
pillow                    8.1.1            py39hf95b381_0    conda-forge
pip                       21.0.1             pyhd8ed1ab_0    conda-forge
pthread-stubs             0.4               h36c2ea0_1001    conda-forge
pyparsing                 2.4.7              pyh9f0ad1d_0    conda-forge
pyqt                      5.12.3           py39hf3d152e_7    conda-forge
pyqt-impl                 5.12.3           py39h0fcd23e_7    conda-forge
pyqt5-sip                 4.19.18          py39he80948d_7    conda-forge
pyqtchart                 5.12             py39h0fcd23e_7    conda-forge
pyqtwebengine             5.12.1           py39h0fcd23e_7    conda-forge
python                    3.9.2           hffdb5ce_0_cpython    conda-forge
python-dateutil           2.8.1                      py_0    conda-forge
python_abi                3.9                      1_cp39    conda-forge
qt                        5.12.9               hda022c4_4    conda-forge
readline                  8.0                  he28a2e2_2    conda-forge
setuptools                49.6.0           py39hf3d152e_3    conda-forge
six                       1.15.0             pyh9f0ad1d_0    conda-forge
sqlite                    3.34.0               h74cdb3f_0    conda-forge
tk                        8.6.10               h21135ba_1    conda-forge
tornado                   6.1              py39h3811e60_1    conda-forge
tzdata                    2021a                he74cb21_0    conda-forge
wheel                     0.36.2             pyhd3deb0d_0    conda-forge
xorg-libxau               1.0.9                h7f98852_0    conda-forge
xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
xz                        5.2.5                h516909a_1    conda-forge
zlib                      1.2.11            h516909a_1010    conda-forge
zstd                      1.4.9                ha95c52a_0    conda-forge`

What did you do?

Run the script below.

What did you expect to happen?

To show the image.

What actually happened?

An error occurred and no image was shown.

What are your OS, Python and Pillow versions?

  • OS: Ubuntu 20.10
  • Python: 3.9.2
  • Pillow: 8.1.1

Code:

from PIL import Image

#Canon RAW image format
img = Image.open('img.CR2')

#output: <PIL.TiffImagePlugin.TiffImageFile image mode=RGB size=1936x1288 at 0x7F98F32D8C10>
print(img)

img.show()
@hugovk
Copy link
Member

hugovk commented Mar 7, 2021

Do you have an example file you could attach that reproduces the problem?

You said it worked flawlessly before. Which Pillow version that was with?

@hugovk hugovk added the TIFF label Mar 7, 2021
@SnorrenEnzo
Copy link
Author

The file is larger than 10 MB, so here is a download link: https://mega.nz/file/V9cGkD7C#Bi-M5H4X9tyv4sPmceJ2lc3bELPiSBECrYe8QsKFAI4

I do not recall in what version of Pillow it was working previously.

@hugovk
Copy link
Member

hugovk commented Mar 8, 2021

Thanks, I can repro with Pillow 8.1.0 and with the preceding 8.0.1 get this:

<PIL.TiffImagePlugin.TiffImageFile image mode=RGB size=6000x4000 at 0x10E917DF0>
OJPEGDecodeRaw: Inconsistent number of MCU in codestream.

out

@wiredfool
Copy link
Member

I'm pretty surprised that a CR2 image actually works with Pillow at all, given that it's camera raw and Pillow hasn't ever tried to support it. On the other hand, lots of file formats are actually Tiff under the hood, so it's possible to get metadata from them even if we don't understand the actual pixels.

@hugovk
Copy link
Member

hugovk commented Mar 8, 2021

git bisect says eb8c120 is the first bad commit, from PR #5175 "Fix TIFF OOB Write error".

@hugovk
Copy link
Member

hugovk commented Mar 8, 2021

And opening the image in Mac Preview looks like this:

image

@wiredfool
Copy link
Member

Yeah, CoreImage/Quartz has been able to do raw processing since forever. 10.4 at least IIRC.

@SnorrenEnzo
Copy link
Author

img.show() works with Pillow version 8.0.1 on this test image and several other .CR2 images. This is a good temporary fix for me for now.

@ndjman7
Copy link

ndjman7 commented Mar 9, 2021

It may be a little different, but it's a similar issue.
https://stackoverflow.com/questions/64683811/how-to-debug-oserror-9-saving-a-tiff-via-libtiff-and-pillow

@kmilos
Copy link
Contributor

kmilos commented Mar 9, 2021

CoreImage/Quartz has been able to do raw processing since forever

It might not be actual raw processing. It might be displaying just the embedded JPEG or preview image, which I guess is what Pillow also tries to access.

There are multiple images in this TIFF file, the actual "raw" is in IFD3 (though Canon sRAW is not really raw data and is to be avoided). IFD0 is a 3 color channel (i.e. already processed RGB) 3.5 MB JPEG:

---- ExifTool ----
ExifToolVersion                 : 12.16
Warning                         : [minor] Missing 2 entries in CanonCustom2 group 4 directory
Warning                         : Possibly corrupted CanonCustom2 data
---- System ----
FileName                        : img.CR2
Directory                       : .
FileSize                        : 29 MiB
FileModifyDate                  : 2021:03:09 09:02:56+01:00
FileAccessDate                  : 2021:03:09 09:03:37+01:00
FileCreateDate                  : 2021:03:09 09:02:55+01:00
FilePermissions                 : rw-rw-rw-
---- File ----
FileType                        : CR2
FileTypeExtension               : cr2
MIMEType                        : image/x-canon-cr2
ExifByteOrder                   : Little-endian (Intel, II)
---- IFD0 ----
ImageWidth                      : 6000
ImageHeight                     : 4000
BitsPerSample                   : 8 8 8
Compression                     : JPEG (old-style)
ImageDescription                : 
Make                            : Canon
Model                           : Canon EOS M6
PreviewImageStart               : 26490288
Orientation                     : Horizontal (normal)
PreviewImageLength              : 3654910
XResolution                     : 180
YResolution                     : 180
ResolutionUnit                  : inches
ModifyDate                      : 2021:02:14 17:20:05
Artist                          : Jelle Mes
Copyright                       : Jelle Mes
PreviewImage                    : (Binary data 3654910 bytes, use -b option to extract)
---- ExifIFD ----
ExposureTime                    : 1/250
FNumber                         : 10.0
ExposureProgram                 : Manual
ISO                             : 250
SensitivityType                 : Recommended Exposure Index
RecommendedExposureIndex        : 250
ExifVersion                     : 0230
DateTimeOriginal                : 2021:02:14 17:20:05
CreateDate                      : 2021:02:14 17:20:05
ComponentsConfiguration         : Y, Cb, Cr, -
CompressedBitsPerPixel          : 3
ShutterSpeedValue               : 1/251
ApertureValue                   : 10.0
ExposureCompensation            : 0
MeteringMode                    : Multi-segment
Flash                           : Off, Did not fire
FocalLength                     : 200.0 mm
UserComment                     : 
SubSecTime                      : 92
SubSecTimeOriginal              : 92
SubSecTimeDigitized             : 92
FlashpixVersion                 : 0100
ColorSpace                      : sRGB
ExifImageWidth                  : 6000
ExifImageHeight                 : 4000
FocalPlaneXResolution           : 6825.938567
FocalPlaneYResolution           : 6825.938567
FocalPlaneResolutionUnit        : inches
SensingMethod                   : One-chip color area
FileSource                      : Digital Camera
CustomRendered                  : Normal
ExposureMode                    : Manual
WhiteBalance                    : Auto
DigitalZoomRatio                : 1
SceneCaptureType                : Standard
OwnerName                       : 
SerialNumber                    : 423050000229
LensInfo                        : 55-200mm f/0
LensModel                       : EF-M55-200mm f/4.5-6.3 IS STM
LensSerialNumber                : 000002b9f0
---- Canon ----
MacroMode                       : Normal
SelfTimer                       : Off
Quality                         : RAW
CanonFlashMode                  : Off
ContinuousDrive                 : Single
FocusMode                       : AF + MF
RecordMode                      : CR2
CanonImageSize                  : n/a
EasyMode                        : Manual
DigitalZoom                     : None
Contrast                        : Normal
Saturation                      : Normal
CameraISO                       : 250
MeteringMode                    : Evaluative
FocusRange                      : Auto
AFPoint                         : Face Detect
CanonExposureMode               : Manual
LensType                        : Canon EF-M 55-200mm f/4.5-6.3 IS STM
MaxFocalLength                  : 200 mm
MinFocalLength                  : 55 mm
FocalUnits                      : 1/mm
MaxAperture                     : 6.3
MinAperture                     : 32
FlashActivity                   : 0
FlashBits                       : (none)
FocusContinuous                 : Continuous
ImageStabilization              : On (2)
DisplayAperture                 : 17
ZoomSourceWidth                 : 6000
ZoomTargetWidth                 : 6000
SpotMeteringMode                : Center
ManualFlashOutput               : n/a
ColorTone                       : Normal
SRAWQuality                     : n/a
CanonFlashInfo                  : 0 0 0 0
AutoISO                         : 100
BaseISO                         : 248
MeasuredEV                      : 12.41
TargetAperture                  : 10
TargetExposureTime              : 1/251
ExposureCompensation            : 0
WhiteBalance                    : Auto
SlowShutter                     : Off
SequenceNumber                  : 0
OpticalZoomCode                 : 0
FlashGuideNumber                : 0
FlashExposureComp               : 0
AutoExposureBracketing          : Off
AEBBracketValue                 : 0
ControlMode                     : Camera Local Control
FNumber                         : 10
ExposureTime                    : 1/256
BulbDuration                    : 0
CameraType                      : Compact
AutoRotate                      : None
NDFilter                        : n/a
SelfTimer2                      : 0
CanonImageType                  : IMG:High definition image
CanonFirmwareVersion            : Firmware Version 1.00
FileNumber                      : 116-0146
CameraTemperature               : 212 C
CanonModelID                    : EOS M6
ThumbnailImageValidArea         : 0 159 7 112
Canon_0x0018                    : 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0[...]
Canon_0x0019                    : 1
DateStampMode                   : Off
FirmwareRevision                : 1.00 rev 2.00
Categories                      : (none)
IntelligentContrast             : n/a
ImageUniqueID                   : 041cb08c89853189680b56b9e5e6d06b
Canon_0x002d                    : 0
Canon_0x002e                    : 70 32767 32767 65535 65535 32767 32767 32767 60 65535 4[...]
FacesDetected                   : 65535
Canon_0x0031                    : 12 1 65535 65535 65535 65535
Canon_0x0033                    : 993809222 2301707739 3109423976 1808852709
TimeZone                        : +01:00
TimeZoneCity                    : (not set)
DaylightSavings                 : Off
Canon_0x0036                    : 0 159 7 112 1620 1080
Canon_0x0040                    : 8 0
Canon_0x0038                    : ...½<
AFInfoSize                      : 436
AFAreaMode                      : Unknown (15)
NumAFPoints                     : 49
ValidAFPoints                   : 9
CanonImageWidth                 : 6000
CanonImageHeight                : 4000
AFImageWidth                    : 6000
AFImageHeight                   : 4000
AFAreaWidths                    : 684 684 684 684 684 684 684 684 684 -1 0 -1 0 -28380 -1 -1 -1 0 -1 0 -28380 -1 0 -4558 -4558 1 -4558 -30084 -29828 -4558 0 -29828 4109 0 -29836 0 -24092 0 -29744 536 0 1877 -29744 0 0 0 19124 0 8008
AFAreaHeights                   : 420 420 420 420 420 420 420 420 420 16412 -8641 -28881 103 24832 0 -24288 16412 -8641 -28881 103 24832 0 0 -1 -1 0 -1 4956 -29836 -1 4956 -29836 -31815 4109 -1 -29828 4956 0 4096 536 -30783 243 0 -1 51 -1 7539 5 0
AFAreaXPositions                : -684 0 684 -684 0 684 -684 0 684 536 536 536 536 536 536 536 536 536 536 536 536 536 536 -30080 0 -1 0 -30148 8 -30166 8 -30148 0 0 -30166 -30128 0 -30080 684 684 684 684 684 684 684 684 684 -1 8
AFAreaYPositions                : -420 -420 -420 0 0 0 420 420 420 536 536 536 536 536 536 536 536 536 536 536 536 536 536 4 31171 0 31679 8 -1 -30240 2 -30136 -30128 30297 4 -30240 4 2 420 420 420 420 420 420 420 420 420 8 15013
AFPointsInFocus                 : 6
AFPointsSelected                : (none)
Canon_0x003d                    : 32 1 0 0 0 0 0 0
Canon_0x003f                    : 1
Canon_0x0041                    : 4149 200 99 55 200 3208 51 88 61 61 255 1 136 0 63 4 31 0
BracketMode                     : Off
BracketValue                    : 0
BracketShotNumber               : 0
RawJpgQuality                   : RAW
WBBracketMode                   : Off
WBBracketValueAB                : 0
WBBracketValueGM                : 0
LiveViewShooting                : On
FocusDistanceUpper              : 32.08 m
FocusDistanceLower              : 23.49 m
FlashExposureLock               : Off
InternalSerialNumber            : CJ0010606
AspectRatio                     : 3:2
CroppedImageWidth               : 6000
CroppedImageHeight              : 4000
CroppedImageLeft                : 0
CroppedImageTop                 : 0
ToneCurve                       : Standard
Sharpness                       : 3
SharpnessFrequency              : Unknown (-1)
SensorRedLevel                  : -1
SensorBlueLevel                 : -1
WhiteBalanceRed                 : -1
WhiteBalanceBlue                : -1
ColorTemperature                : 5200
PictureStyle                    : Auto
DigitalGain                     : 0
WBShiftAB                       : 0
WBShiftGM                       : 0
MeasuredRGGB                    : 1798 1024 1024 1229
VRDOffset                       : 0
SensorWidth                     : 6288
SensorHeight                    : 4056
SensorLeftBorder                : 276
SensorTopBorder                 : 48
SensorRightBorder               : 6275
SensorBottomBorder              : 4047
BlackMaskLeftBorder             : 0
BlackMaskTopBorder              : 0
BlackMaskRightBorder            : 0
BlackMaskBottomBorder           : 0
ColorDataVersion                : -4 (M100/M5/M6)
WB_RGGBLevelsAsShot             : 1695 1024 1024 1301
ColorTempAsShot                 : 6172
WB_RGGBLevelsAuto               : 1695 1024 1024 1301
ColorTempAuto                   : 6172
WB_RGGBLevelsMeasured           : 1695 1024 1024 1301
ColorTempMeasured               : 6172
WB_RGGBLevelsUnknown            : 1552 1024 1024 1330
ColorTempUnknown                : 5496
WB_RGGBLevelsDaylight           : 1552 1024 1024 1330
ColorTempDaylight               : 5496
WB_RGGBLevelsShade              : 1818 1024 1024 1151
ColorTempShade                  : 7438
WB_RGGBLevelsCloudy             : 1695 1024 1024 1231
ColorTempCloudy                 : 6559
WB_RGGBLevelsTungsten           : 1074 1024 1024 1954
ColorTempTungsten               : 3137
WB_RGGBLevelsFluorescent        : 1323 1024 1024 1766
ColorTempFluorescent            : 3923
WB_RGGBLevelsKelvin             : 1552 1024 1024 1330
ColorTempKelvin                 : 5499
WB_RGGBLevelsFlash              : 1956 1024 1024 1064
ColorTempFlash                  : 8416
WB_RGGBLevelsUnknown2           : 1595 1024 1024 1364
ColorTempUnknown2               : 5502
WB_RGGBLevelsUnknown3           : 1595 1024 1024 1364
ColorTempUnknown3               : 5502
WB_RGGBLevelsUnknown4           : 1595 1024 1024 1364
ColorTempUnknown4               : 5502
WB_RGGBLevelsUnknown5           : 1595 1024 1024 1364
ColorTempUnknown5               : 5502
WB_RGGBLevelsUnknown6           : 1595 1024 1024 1364
ColorTempUnknown6               : 5502
WB_RGGBLevelsUnknown7           : 1552 1024 1024 1330
ColorTempUnknown7               : 5496
WB_RGGBLevelsUnknown8           : 1552 1024 1024 1330
ColorTempUnknown8               : 5496
WB_RGGBLevelsUnknown9           : 1552 1024 1024 1330
ColorTempUnknown9               : 5496
WB_RGGBLevelsUnknown10          : 1552 1024 1024 1330
ColorTempUnknown10              : 5496
WB_RGGBLevelsUnknown11          : 1552 1024 1024 1330
ColorTempUnknown11              : 5496
WB_RGGBLevelsUnknown12          : 2675 1024 1024 1476
ColorTempUnknown12              : 7825
WB_RGGBLevelsUnknown13          : 3399 1024 1024 1661
ColorTempUnknown13              : 8151
CameraColorCalibration01        :    0    0  518 1051 (10900K)
CameraColorCalibration02        :    0    0  530 1028 (10000K)
CameraColorCalibration03        :    0    0  560  967 (8300K)
CameraColorCalibration04        :    0    0  596  906 (7000K)
CameraColorCalibration05        :    0    0  638  847 (6000K)
CameraColorCalibration06        :    0    0  664  817 (5600K)
CameraColorCalibration07        :    0    0  695  785 (5200K)
CameraColorCalibration08        :    0    0  737  736 (4700K)
CameraColorCalibration09        :    0    0  785  682 (4200K)
CameraColorCalibration10        :    0    0  840  634 (3800K)
CameraColorCalibration11        :    0    0  897  596 (3500K)
CameraColorCalibration12        :    0    0  968  553 (3200K)
CameraColorCalibration13        :    0    0 1027  521 (3000K)
CameraColorCalibration14        :    0    0 1099  486 (2800K)
CameraColorCalibration15        :    0    0 1283  444 (2400K)
PerChannelBlackLevel            : 512 512 512 512
NormalWhiteLevel                : 13035
SpecularWhiteLevel              : 14338
Flavor                          : (Binary data 23980 bytes, use -b option to extract)
PictureStyleUserDef             : Auto; Auto; Auto
PictureStylePC                  : n/a; n/a; n/a
CustomPictureStyleFileName      : 
Canon_0x4012                    : 
VignettingCorrVersion           : 0
PeripheralLighting              : On
DistortionCorrection            : Off
ChromaticAberrationCorr         : On
ChromaticAberrationCorr         : On
PeripheralLightingValue         : 1
DistortionCorrectionValue       : 0
OriginalImageWidth              : 100
OriginalImageHeight             : 1126
PeripheralLightingSetting       : On
ChromaticAberrationSetting      : On
DistortionCorrectionSetting     : Off
PeripheralIlluminationCorr      : Off
AutoLightingOptimizer           : Standard
HighlightTonePriority           : Off
LongExposureNoiseReduction      : Off
HighISONoiseReduction           : Standard
AmbienceSelection               : Standard
Canon_0x4023                    : 16 0 0 0
GrainyBWFilter                  : Off
SoftFocusFilter                 : Off
ToyCameraFilter                 : Off
MiniatureFilter                 : Off
MiniatureFilterOrientation      : Unknown (-1)
MiniatureFilterPosition         : -1
MiniatureFilterParameter        : -1
FisheyeFilter                   : Off
PaintingFilter                  : Off
WatercolorFilter                : Off
Canon_0x402b                    : 24 0 0 0 0 0
Canon_0x402c                    : 8 0
Canon_0x402e                    : ÿÿÿÿüÿïÿŒÿÿ?ÿÿÿÿûÿìÿ?ÿþ?.ðÿ{ÿûüró¢[...]
---- CanonCustom ----
ISOExpansion                    : Off
SafetyShift                     : Disable
DialDirectionTvAv               : Normal
CustomControls                  : 0 0 1 1 0 45 11 0 42 44
---- InteropIFD ----
InteropIndex                    : R98 - DCF basic file (sRGB)
InteropVersion                  : 0100
RelatedImageWidth               : 6000
RelatedImageHeight              : 4000
---- IFD1 ----
ThumbnailOffset                 : 45980
ThumbnailLength                 : 12387
ThumbnailImage                  : (Binary data 12387 bytes, use -b option to extract)
---- IFD2 ----
ImageWidth                      : 600
ImageHeight                     : 400
BitsPerSample                   : 16 16 16
Compression                     : Uncompressed
PhotometricInterpretation       : RGB
StripOffsets                    : 25050288
SamplesPerPixel                 : 3
RowsPerStrip                    : 400
StripByteCounts                 : 1440000
PlanarConfiguration             : Chunky
Exif_0xc5d9                     : 2
SRawType                        : 3
Exif_0xc6dc                     : 0 0 0 0
---- IFD3 ----
Compression                     : JPEG (old-style)
StripOffsets                    : 58368
StripByteCounts                 : 24991920
Exif_0xc5d8                     : 1
CR2CFAPattern                   : [Red,Green][Green,Blue]
RawImageSegmentation            : 0 0 6288
SRawType                        : 1
---- Composite ----
DriveMode                       : Single-frame Shooting
ISO                             : 250
Lens                            : 55.0 - 200.0 mm
ShootingMode                    : Manual
WB_RGGBLevels                   : 1695 1024 1024 1301
Aperture                        : 10.0
BlueBalance                     : 1.270508
ImageSize                       : 6000x4000
LensID                          : Canon EF-M 55-200mm f/4.5-6.3 IS STM
Megapixels                      : 24.0
RedBalance                      : 1.655273
ScaleFactor35efl                : 1.6
ShutterSpeed                    : 1/250
SubSecCreateDate                : 2021:02:14 17:20:05.92
SubSecDateTimeOriginal          : 2021:02:14 17:20:05.92
SubSecModifyDate                : 2021:02:14 17:20:05.92
Lens35efl                       : 55.0 - 200.0 mm (35 mm equivalent: 88.7 - 322.5 mm)
CircleOfConfusion               : 0.019 mm
DOF                             : 7.26 m (24.62 - 31.88 m)
FOV                             : 6.4 deg
FocalLength35efl                : 200.0 mm (35 mm equivalent: 322.5 mm)
HyperfocalDistance              : 214.66 m
LightValue                      : 13.3

@kmilos
Copy link
Contributor

kmilos commented Apr 5, 2021

Another part of the puzzle might be that the mandatory SamplesPerPixel is suspiciously missing in the IFD0 of these CR2 files, maybe there was a change relating to parsing of that tag?

For example, when BitsPerSample has a count of 3 like here, one should check/set SamplesPerPixel to be 3 instead of default 1 when missing?

@kmilos
Copy link
Contributor

kmilos commented Apr 6, 2021

It looks like missing SamplesPerPixel (and PhotometricInterpretation) is common w/ OJPEG compressed images, so that shouldn't be the root cause as the fallbacks seem to have been there for a while.

OTOH, there have been quite a few changes to decoding OJPEG images since libtiff 4.0.10 when the problem started appearing, so this might not be Pillow's fault... But at the same time, it seems it should be possible to make it work with libtiff 4.2.0.

@radarhere
Copy link
Member

radarhere commented Apr 29, 2021

Testing, I find the -9 error was caused by #5175 - that was fixed in #5372.
But #5372 introduced a new error - the image can't be identified, as it has "unknown data organization" - the SAMPLESPERPIXEL tag is missing. #5452 resolves this.

@kmilos
Copy link
Contributor

kmilos commented Apr 29, 2021

I thought the OSError: -9 was coming somewhere later from the C code in this case, i.e. inside decoder.decode()?

@radarhere
Copy link
Member

I've updated my comment - #5372 has C changes that fix the -9.

@aclark4life aclark4life added the Anaconda Issues with Anaconda's Pillow label May 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Anaconda Issues with Anaconda's Pillow TIFF
Projects
None yet
Development

Successfully merging a pull request may close this issue.

7 participants