September 20, 2014, 04:16:58 AM

Author Topic: DPP and Lightroom 5.5 JPG file export problem  (Read 2198 times)

mpeeps

  • Power Shot G16
  • **
  • Posts: 11
  • Lovin' life on the Central Coast
    • View Profile
    • Mike Peeples Photography
DPP and Lightroom 5.5 JPG file export problem
« on: July 03, 2014, 01:31:55 PM »
Hello,
For some reason LR 5.5 exports unreadable jpg files by Digital Photo Professional 3.  The message when trying to open (only recently it seems) exported jpg files is failure to decode.  I had to go reinstall LR 5.4 to get back to that ability.  Anyone else having same issues?
Canon EOS 6D and 7D
EF16-35mmLII, EF24-70mmL, EF50mmf/1.4, EF70-300mm, EF100mmL, EF100-400mmL, TS24mmLII

canon rumors FORUM

DPP and Lightroom 5.5 JPG file export problem
« on: July 03, 2014, 01:31:55 PM »

dgatwood

  • 5D Mark III
  • ******
  • Posts: 715
  • 300D, 400D, 6D
    • View Profile
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #1 on: July 06, 2014, 06:58:34 PM »
Hello,
For some reason LR 5.5 exports unreadable jpg files by Digital Photo Professional 3.  The message when trying to open (only recently it seems) exported jpg files is failure to decode.  I had to go reinstall LR 5.4 to get back to that ability.  Anyone else having same issues?

I'm still on LR4, so I have no idea, but by any chance could you post a JPEG export of the same image from both versions (with the same export settings)?  I'd be curious to compare them and see what the difference is.  It might be something as silly as corrupted EXIF data or something.

mpeeps

  • Power Shot G16
  • **
  • Posts: 11
  • Lovin' life on the Central Coast
    • View Profile
    • Mike Peeples Photography
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #2 on: July 07, 2014, 12:53:26 PM »
Sorry...I already went back to LR 5.4.  No problems now. The issue is only a problem when I want to open a single jpg file from My Pictures that I exported from LR5.5 as jpeg.  If I exported file as Tif, no problem, but who wants thousands of tifs?  I prefer opening individual files, both raw and jpg, with DPP editor module.
Canon EOS 6D and 7D
EF16-35mmLII, EF24-70mmL, EF50mmf/1.4, EF70-300mm, EF100mmL, EF100-400mmL, TS24mmLII

mr_hyde

  • Power Shot G16
  • **
  • Posts: 21
    • View Profile
    • Blog
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #3 on: July 07, 2014, 03:32:15 PM »
The problem does not only exist in DPP. I have for instance a QNAP NAS which generates resized JPEGs for the photo station that is included. This process is not working with JPEGs generated with LR5.5. There is also other reported software that is not working with those JPEGs.

On the Adobe site there are already some bug reports. Just add another one or "+1" one of them.
5D Mark III, 7D, EF 100-400mm L, EF 70-200mm f/2.8 II, EF 24-70mm L f/4, EF 17-40mm L, EF-S 10-22mm, Tamron 17-50mm f/2.8 VC, Tamron 18-270mm PZD, Canon 430EX II, Canon TC 1.4x III

mpeeps

  • Power Shot G16
  • **
  • Posts: 11
  • Lovin' life on the Central Coast
    • View Profile
    • Mike Peeples Photography
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #4 on: July 09, 2014, 12:38:50 PM »
Mr Hyde,
I followed you advice and reported problem to Adobe.  Humorously, they though I was SHOUTING because I used caps on DPP and JPG!!
Canon EOS 6D and 7D
EF16-35mmLII, EF24-70mmL, EF50mmf/1.4, EF70-300mm, EF100mmL, EF100-400mmL, TS24mmLII

Marsu42

  • Canon EF 400mm f/2.8L IS II
  • *******
  • Posts: 4540
  • ML-66d / 100L / 70-300L / 17-40L / 600rts
    • View Profile
    • 6D positive spec list
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #5 on: July 09, 2014, 01:41:53 PM »
Humorously, they though I was SHOUTING because I used caps on DPP and JPG!!

Not without reason, Adobe seems to have gotten somewhat sloppy with their qa on production LR upgrades - back in the good ol' times there always were rc releases which they skipped this time. Producing jpegs that cannot be read by other standard apps is something that simply shouldn't happen. Adobe not releasing detailed changelogs for bugfixes and features also does not inspire confidence.

Having said that, imho downgrading is a bit over the top - if you export max iq jpeg then re-saving them for example with ImageMagick to correct the format won't hurt or maybe just running exiftool over them solves the problem. I've arrived at using IM for post-resizing, watermarking and so on anyway, much more flexible than LR.
« Last Edit: July 09, 2014, 01:52:52 PM by Marsu42 »

mpeeps

  • Power Shot G16
  • **
  • Posts: 11
  • Lovin' life on the Central Coast
    • View Profile
    • Mike Peeples Photography
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #6 on: July 09, 2014, 02:07:26 PM »
Here is Adobe's response:

Do the JPEG files open in Photoshop?
If so, then the problem is most likely another bug in JPEG parsing in Canon's DPP code.

I was able to open the 5.5 exported file in PS.  Not sure what that means.  I've never had trouble with LR before and really do like the 5.X version. 
Canon EOS 6D and 7D
EF16-35mmLII, EF24-70mmL, EF50mmf/1.4, EF70-300mm, EF100mmL, EF100-400mmL, TS24mmLII

canon rumors FORUM

Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #6 on: July 09, 2014, 02:07:26 PM »

Marsu42

  • Canon EF 400mm f/2.8L IS II
  • *******
  • Posts: 4540
  • ML-66d / 100L / 70-300L / 17-40L / 600rts
    • View Profile
    • 6D positive spec list
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #7 on: July 09, 2014, 02:19:24 PM »
Do the JPEG files open in Photoshop?  If so, then the problem is most likely another bug in JPEG parsing in Canon's DPP code.

To get anyhwere with this issue you'll have to export the same shot in both LR5.5 and LR5.4 and then compare the xmp/iptc/exif/maker tags with exiftool - is there a difference? Of course Adobe will try to blame other apps, with "standards" such fuzzy as jpeg or tiff that's always possible until proven otherwise.

You can also simply strip all the tags from a "broken" LR5.5 image by running "exiftool -all= -Adobe:all= image.jpg" and then see if it opens in DPP or whatever.

JEL

  • SX50 HS
  • **
  • Posts: 9
    • View Profile
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #8 on: July 09, 2014, 04:06:36 PM »
To get anyhwere with this issue you'll have to export the same shot in both LR5.5 and LR5.4 and then compare the xmp/iptc/exif/maker tags with exiftool - is there a difference?

Here's an image exported in LR5.3 and LR5.5 for comparison purposes.

Marsu42

  • Canon EF 400mm f/2.8L IS II
  • *******
  • Posts: 4540
  • ML-66d / 100L / 70-300L / 17-40L / 600rts
    • View Profile
    • 6D positive spec list
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #9 on: July 09, 2014, 05:27:00 PM »
Here's an image exported in LR5.3 and LR5.5 for comparison purposes.

Hey, I didn't say *I* want to do this :-p ..  anyway, this is how the tags differ - There is a strange tag difference in the Adobe APP14Flags0 tag, maybe that's the cause.

Also attached is the LR55 jpeg with all tags stripped, check if this opens in non-Adobe apps - if not, the binary data is broken and it's an Adobe bug, if yes they can blame it on DPP.

Code: [Select]
--- LR53.txt 2014-07-09 23:22:40.108754500 +0200
+++ LR55.txt 2014-07-09 23:22:36.812749000 +0200
@@ -1,11 +1,11 @@
 [ExifTool] ExifToolVersion: 9.65
 [System] Directory: .
-[System] FileAccessDate: 2014:07:09 23:15:48+02:00
-[System] FileCreateDate: 2014:07:09 23:15:48+02:00
-[System] FileModifyDate: 2014:07:09 23:15:56+02:00
-[System] FileName: LR53.jpg
+[System] FileAccessDate: 2014:07:09 23:22:16+02:00
+[System] FileCreateDate: 2014:07:09 23:22:16+02:00
+[System] FileModifyDate: 2014:07:09 23:22:18+02:00
+[System] FileName: LR55.jpg
 [System] FilePermissions: 666
-[System] FileSize: 227148
+[System] FileSize: 263092
 [File] BitsPerSample: 8
 [File] ColorComponents: 3
 [File] CurrentIPTCDigest: 491e51fded5c122d01e757c357157923
@@ -20,11 +20,11 @@
 [IFD0] Copyright: JEL
 [IFD0] Make: Canon
 [IFD0] Model: Canon EOS 5D Mark III
-[IFD0] ModifyDate: 2014:01:05 09:12:46
+[IFD0] ModifyDate: 2014:07:07 21:21:31
 [IFD0] ResolutionUnit: 2
-[IFD0] Software: Adobe Photoshop Lightroom 5.3 (Windows)
-[IFD0] XResolution: 240
-[IFD0] YResolution: 240
+[IFD0] Software: Adobe Photoshop Lightroom 5.5 (Windows)
+[IFD0] XResolution: 300
+[IFD0] YResolution: 300
 [ExifIFD] ApertureValue: 1.20000007832525
 [ExifIFD] ColorSpace: 1
 [ExifIFD] CreateDate: 2014:01:01 02:17:34
@@ -58,16 +58,16 @@
 [ExifIFD] WhiteBalance: 0
 [IFD1] Compression: 6
 [IFD1] ResolutionUnit: 2
-[IFD1] ThumbnailLength: 9365
+[IFD1] ThumbnailLength: 9035
 [IFD1] ThumbnailOffset: 986
 [IFD1] XResolution: 72
 [IFD1] YResolution: 72
 [Photoshop] DisplayedUnitsX: 1
 [Photoshop] DisplayedUnitsY: 1
 [Photoshop] IPTCDigest: 491e51fded5c122d01e757c357157923
-[Photoshop] PhotoshopThumbnail: (Binary data 9365 bytes, use -b option to extract)
-[Photoshop] XResolution: 240
-[Photoshop] YResolution: 240
+[Photoshop] PhotoshopThumbnail: (Binary data 9035 bytes, use -b option to extract)
+[Photoshop] XResolution: 300
+[Photoshop] YResolution: 300
 [IPTC] ApplicationRecordVersion: 4
 [IPTC] By-line: jelstudio@hotmail.com.jelstudio.
 [IPTC] CodedCharacterSet: .%G
@@ -117,9 +117,9 @@
 [ICC-meas] MeasurementObserver: 1
 [XMP-x] XMPToolkit: Adobe XMP Core 5.5-c002 1.148022, 2012/07/15-18:06:45
 [XMP-xmp] CreateDate: 2014:01:01 02:17:34.00
-[XMP-xmp] CreatorTool: Adobe Photoshop Lightroom 5.3 (Windows)
-[XMP-xmp] MetadataDate: 2014:01:05 09:12:46+01:00
-[XMP-xmp] ModifyDate: 2014:01:05 09:12:46+01:00
+[XMP-xmp] CreatorTool: Adobe Photoshop Lightroom 5.5 (Windows)
+[XMP-xmp] MetadataDate: 2014:07:07 21:21:31+02:00
+[XMP-xmp] ModifyDate: 2014:07:07 21:21:31+02:00
 [XMP-dc] Creator: jelstudio@hotmail.com.jelstudio.dk.twitter: JEL248
 [XMP-dc] Format: image/jpeg
 [XMP-dc] Rights: JEL
@@ -136,14 +136,14 @@
 [XMP-photoshop] DateCreated: 2014:01:01 02:17:34.00
 [XMP-xmpMM] DerivedFromDocumentID: 185070B51AB83644A38502E862A348A9
 [XMP-xmpMM] DerivedFromOriginalDocumentID: 185070B51AB83644A38502E862A348A9
-[XMP-xmpMM] DocumentID: xmp.did:781592f3-572b-c643-be24-7d1671d63c02
+[XMP-xmpMM] DocumentID: xmp.did:18c1f38b-c9f2-9f4c-baba-1a9ba35c6d82
 [XMP-xmpMM] HistoryAction: derived, saved
 [XMP-xmpMM] HistoryChanged: /
-[XMP-xmpMM] HistoryInstanceID: xmp.iid:781592f3-572b-c643-be24-7d1671d63c02
+[XMP-xmpMM] HistoryInstanceID: xmp.iid:18c1f38b-c9f2-9f4c-baba-1a9ba35c6d82
 [XMP-xmpMM] HistoryParameters: converted from image/x-canon-cr2 to image/jpeg, saved to new location
-[XMP-xmpMM] HistorySoftwareAgent: Adobe Photoshop Lightroom 5.3 (Windows)
-[XMP-xmpMM] HistoryWhen: 2014:01:05 09:12:46+01:00
-[XMP-xmpMM] InstanceID: xmp.iid:781592f3-572b-c643-be24-7d1671d63c02
+[XMP-xmpMM] HistorySoftwareAgent: Adobe Photoshop Lightroom 5.5 (Windows)
+[XMP-xmpMM] HistoryWhen: 2014:07:07 21:21:31+02:00
+[XMP-xmpMM] InstanceID: xmp.iid:18c1f38b-c9f2-9f4c-baba-1a9ba35c6d82
 [XMP-xmpMM] OriginalDocumentID: 185070B51AB83644A38502E862A348A9
 [XMP-crs] AlreadyApplied: True
 [XMP-crs] AutoLateralCA: 0
@@ -182,7 +182,7 @@
 [XMP-crs] HueAdjustmentYellow: 0
 [XMP-crs] LensManualDistortionAmount: 0
 [XMP-crs] LensProfileChromaticAberrationScale: 100
-[XMP-crs] LensProfileDigest: 639283345D6001793A602558C753423F
+[XMP-crs] LensProfileDigest: 1B9204B25A98B63F2DFD385A244207BE
 [XMP-crs] LensProfileDistortionScale: 100
 [XMP-crs] LensProfileEnable: 0
 [XMP-crs] LensProfileFilename: Canon EOS 5D Mark II (Canon EF 85mm f1.2L II USM) - RAW.lcp
@@ -241,17 +241,22 @@
 [XMP-crs] SplitToningShadowHue: 215
 [XMP-crs] SplitToningShadowSaturation: 50
 [XMP-crs] Tint: +12
+[XMP-crs] ToneCurve: 0, 0, 255, 255
+[XMP-crs] ToneCurveBlue: 0, 0, 255, 255
+[XMP-crs] ToneCurveGreen: 0, 0, 255, 255
+[XMP-crs] ToneCurveName: Linear
 [XMP-crs] ToneCurveName2012: Linear
 [XMP-crs] ToneCurvePV2012: 0, 0, 255, 255
 [XMP-crs] ToneCurvePV2012Blue: 0, 0, 255, 255
 [XMP-crs] ToneCurvePV2012Green: 0, 0, 255, 255
 [XMP-crs] ToneCurvePV2012Red: 0, 0, 255, 255
-[XMP-crs] Version: 8.3
+[XMP-crs] ToneCurveRed: 0, 0, 255, 255
+[XMP-crs] Version: 8.5
 [XMP-crs] Vibrance: 0
 [XMP-crs] VignetteAmount: 0
 [XMP-crs] WhiteBalance: As Shot
 [XMP-crs] Whites2012: 0
-[Adobe] APP14Flags0: 16384
+[Adobe] APP14Flags0: 49152
 [Adobe] APP14Flags1: 0
 [Adobe] ColorTransform: 1
 [Adobe] DCTEncodeVersion: 100

JEL

  • SX50 HS
  • **
  • Posts: 9
    • View Profile
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #10 on: July 09, 2014, 08:40:28 PM »
Hey, I didn't say *I* want to do this :-p

Haha sorry  ;D
I just used your quote to direct attention to why I posted the 2 images, but they're really for who-ever wants to do the detective-work :)

They're also talking about it over on the adobe-forum, but it's a bit too advanced tech-stuff for my skill-level :)
https://forums.adobe.com/message/6537585#6537585

mr_hyde

  • Power Shot G16
  • **
  • Posts: 21
    • View Profile
    • Blog
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #11 on: July 10, 2014, 01:17:28 AM »
ok,

i have exported the same image with LR5.4 and 5.5 and did a comparison with "Compare". there seems to be also an x/y-offset if you are using the same settings in 5.4 and 5.5. I have uploaded both images and the diff image to adobe and asked them "friendly" not to blame something immediately to other apps but change the customer service attitude and ask for samples instead. Not sure where this ends, but it is worth a try. I need to see if I also have the exiftool installed  on my NAS, then I will also do the exif comparison of these images and upload it to adobe......

EDIT:
just tried the LR5.5 and stripped LR5.5 on the NAS photostation.... Too bad. both images do show the same result.

and the same is true for DPP3 and DPP4.
« Last Edit: July 10, 2014, 01:25:07 AM by mr_hyde »
5D Mark III, 7D, EF 100-400mm L, EF 70-200mm f/2.8 II, EF 24-70mm L f/4, EF 17-40mm L, EF-S 10-22mm, Tamron 17-50mm f/2.8 VC, Tamron 18-270mm PZD, Canon 430EX II, Canon TC 1.4x III

mr_hyde

  • Power Shot G16
  • **
  • Posts: 21
    • View Profile
    • Blog
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #12 on: July 10, 2014, 10:04:17 AM »
look at this:

https://forums.adobe.com/message/6538313#6538313

The plugin solves the issue. It works at least for my application.
5D Mark III, 7D, EF 100-400mm L, EF 70-200mm f/2.8 II, EF 24-70mm L f/4, EF 17-40mm L, EF-S 10-22mm, Tamron 17-50mm f/2.8 VC, Tamron 18-270mm PZD, Canon 430EX II, Canon TC 1.4x III

canon rumors FORUM

Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #12 on: July 10, 2014, 10:04:17 AM »

dgatwood

  • 5D Mark III
  • ******
  • Posts: 715
  • 300D, 400D, 6D
    • View Profile
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #13 on: July 10, 2014, 06:22:59 PM »

So not an EXIF problem; it's a problem with the JPEG data itself.  The most obvious difference between these two files is that the order of the JPEG markers is very different.  If a JPEG parser made naive assumptions about the order of some of the segments, it could barf.

LR 5.3:

SOI (Start of Image)
Adobe DCT file header
Define quantization table
SOF (Start of frame)
Define restart interval
Define Huffman table
Start of scan


LR 5.5:

SOI
Define quantization table
Define restart interval
Adobe DCT file header
SOF
Define Huffman table
SOS


Many of those changes are Adobe-specific, but their decision to move the restart interval before the start-of-frame marker could very easily break parsers that assume the SOF is part of the frame, not part of the file as a whole.  As an experiment, I reordered the sections of the file with dd, to move the restart interval marker and value below the start of frame marker to match the LR 5.3 ordering.  See if the attached file works.

philmoz

  • Rebel T5i
  • ****
  • Posts: 113
    • View Profile
Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #14 on: July 11, 2014, 05:29:59 AM »

So not an EXIF problem; it's a problem with the JPEG data itself.  The most obvious difference between these two files is that the order of the JPEG markers is very different.  If a JPEG parser made naive assumptions about the order of some of the segments, it could barf.

LR 5.3:

SOI (Start of Image)
Adobe DCT file header
Define quantization table
SOF (Start of frame)
Define restart interval
Define Huffman table
Start of scan


LR 5.5:

SOI
Define quantization table
Define restart interval
Adobe DCT file header
SOF
Define Huffman table
SOS


Many of those changes are Adobe-specific, but their decision to move the restart interval before the start-of-frame marker could very easily break parsers that assume the SOF is part of the frame, not part of the file as a whole.  As an experiment, I reordered the sections of the file with dd, to move the restart interval marker and value below the start of frame marker to match the LR 5.3 ordering.  See if the attached file works.

This file does not load in DPP.

Phil.

canon rumors FORUM

Re: DPP and Lightroom 5.5 JPG file export problem
« Reply #14 on: July 11, 2014, 05:29:59 AM »