RF 14-35mm f/4L IS – Distortion Correction Testing

Jul 21, 2010
31,099
12,863
Mirrorless cameras lack an optical viewfinder, so looking through the lens is always an electronic process. This fact enables lens manufacturers to include consideration of digital optical corrections in their lens designs and make trade-offs accordingly – more optical aberrations can be tolerated because they will be corrected in the EVF and in processed images, so users will often not know they’re there in the first place.

MILC manufacturers other than Canon have leveraged this concept for many years. Canon’s implementation in the RF 24-240mm lens came as a surprise to many when it was initially reported on internet forums, with the lens having very strong barrel distortion at the wide end and forcing the application of correction in-camera and in DPP (i.e., unlike other lenses the correction cannot be disabled). The recently released RF 16mm f/2.8 is similar, and that is probably not surprising in a $300 UWA lens (in fact, most likely the design trade-off of strong distortion is one reason the lens is so relatively inexpensive). Canon seems to have confirmed this with their statement in the press release for the lens, “Long gone are the days of optical corrections…,” presumably because digital corrections are now the norm.

However, Canon also took this approach with the RF 14-35mm f/4L IS, their first time doing so with an L-series lens. Although I had some concerns about this level of correction, I decided to swap my EF 16-35/4L IS for it, in part for the smaller size and in part for the wider FoV when I don’t want to bring the EF 11-24/4L.

Lens in hand, I decided to see how bad the distortion really is, and how well it can be corrected with various RAW converters. I used the classic brick wall test, but rather than standing close I opted for a more distant shot where the ‘wall’ was the side of a 9-story building at a distance that captured most of the height. The reason for that was to avoid the potential issue of focus breathing, where the effective focal length of a lens is shorter with a close subject (one example of this is Canon’s 100L Macro, where at 1:1 it’s giving the framing of ~68mm). Note that in his image testing, Bryan of TDP indicates that framing his ‘enhanced ISO 12233’ chart at 14mm is done at a distance of less than 2’ / 60 cm. I ensured that the camera was level and orthogonal to the building to avoid vertical and horizontal distortions.

The first composite is a set of RAW conversions of the same single image, taken at 14mm f/8 (thumbnail below is a 1000 pixel wide image hosted on CR, full image is HERE).

Full FoV with different RAW converters CR.jpg

The top right image was converted in DxO PhotoLab with all corrections turned off. The uncorrected image shows significant barrel distortion and some mechanical vignetting in the corners. Compared to the straight out of camera JPG (top left), the FoV of the uncorrected image is clearly wider than 14mm (how much wider is discussed below). In DPP, I converted the image with corrections set to 100% and with DLO. The FoV is the same as the SOOC image, but the vignetting correction is improved. Converting the image in Adobe Camera Raw with the lens profile yields a slightly wider FoV than with Canon’s lens profile (e.g., more of the window lintels are visible in the upper left corner, and the left edge of an additional column of windows is visible on the right edge. The standard (default) corrections in DxO deliver a noticeably wider FoV than ACR – another row of windows becomes visible in the top left and an additional full column of windows is visible on the right side. DxO also has an ‘optical corrections only’ option which does not force the corrected image into the original 3:2 aspect ratio, and the result there (bottom right) is an image of the same vertical FoV as standard but a wider horizontal FoV (another half-column of windows on the left). That image output is 305 pixels wider than the EOS R’s native output.

How much wider is the FoV of the corrections with DxO? To assess that, I took a series of images from 14mm down to 11mm on the EF 11-24mm. Shown is the comparison of the RF 14-35mm at 14mm (middle panels) with the EF 11-24mm at 14mm (top) and 13mm (bottom), converted with either DPP or DxO (thumbnail below is a 1000 pixel wide image hosted on CR, full image is HERE).

14-35mm vs 11-24mm FoV CR.jpg

When converted with DPP, the FoV of the 14-35mm at 14mm is very slightly narrower than that of the 11-24mm at 14mm (where distortion is very modest). With DxO, the FoV of the 14-35mm at 14mm is comparable to ~13.5mm on the 11-24mm lens, meaning with optimal corrections the lens is delivering a wider-than-specified FoV. I’ll take it!

For the uncorrected image, based on the ‘corners’ of the strongly distorted image to the series of images taken from 14mm to 11mm on the EF 11-24mm, the FoV of the 14-35mm at 14mm approximates slightly under 13mm.

On this and other forums, there have been ‘tests’ that suggest the image from this and other strongly distorted lenses are cropped and then upscaled (I initially thought this might be the case, but it isn’t). These tests suffer from one or more flaws. A common approach prior to the availability of a lens profile from Adobe has been to drag the distortion slider to 100 then crop the image to the proportions of the in-camera JPG. However, when performing a manual correction for barrel distortion in LR/PS/ACR, dragging the slider to +100 does not equate to correcting 100% of the distortion. Rather, the slider is merely an arbitrary scale of 100 units of correction in the (+) direction for correcting barrel distortion or in the (–) direction for correcting pincushion distortion. In other words, +100 is likely too much correction. In the case of the 14-35mm at 14mm, around +35 to +40 does a reasonable job of correcting the barrel distortion.

Manual distortion correction assumes the characteristic of the distortion is linear (along the image radial), and that's almost never going to be the case. So, if you drag the distortion correction slider to the point where horizontal lines in the corners of the scene appear horizontal in the image, then there is residual barrel distortion of lines in the mid-frame. Conversely, if you drag the distortion correction slider to the point where horizontal lines in the mid-frame of the scene appear horizontal in the image, pincushion distortion of lines in the corners is introduced. Basically, manual distortion correction is applying a linear process to a non-linear aberration.

That's where lens profiles come into play. Applying the lens profile for the 14-35/4 in ACR and other RAW converters results in horizontal lines in both the corners and the mid-frame appearing horizontal in the image, i.e., the profile includes a non-linear correction for distortion. The same can be achieved in Photoshop using a warp transform, for example. In the case of an even more complex distortion (e.g., mustache) a warp-type transformation is really the only way it can be corrected. Doing so does 'stretch' the corners of the image, so in that sense there are 'fake pixels' being created, but it allows geometric correction without the need to crop then upscale the image.

That begs the question of how detail-destructive that warping correction is in practice. Below are 100% crops (1000x667 pixels) from the extreme upper left corner of the corrected 14-35mm images at f/4 and f/8, along with crops from the 11-24mm corners, also corrected but with much less correction required because of the better optical correction in the lens (thumbnail below is a 1000 pixel wide image hosted on CR, full image is HERE).

Corner crops at f4 and f8 CR.jpg

There are differences between the RAW converters but overall, the results in all cases are quite good, with very subtle differences if any between the highly corrected 14-35mm corners and the lightly corrected 11-24mm corners.

Based on the above, I’m more than satisfied with my new RF 14-35mm f/4L IS (and I recommend DxO PhotoLab for those wanting to get the most from it).
 
  • Like
Reactions: 7 users

Jethro

EOS R
CR Pro
Jul 14, 2018
996
1,037
Thanks for the very extensive test Neuro. I find it really surprising that it's delivering a wider than spec FoV:

"For the uncorrected image, based on the ‘corners’ of the strongly distorted image to the series of images taken from 14mm to 11mm on the EF 11-24mm, the FoV of the 14-35mm at 14mm approximates slightly under 13mm."
 
Upvote 0
Jul 21, 2010
31,099
12,863
Thanks for the very extensive test Neuro. I find it really surprising that it's delivering a wider than spec FoV:

"For the uncorrected image, based on the ‘corners’ of the strongly distorted image to the series of images taken from 14mm to 11mm on the EF 11-24mm, the FoV of the 14-35mm at 14mm approximates slightly under 13mm."
Yes, the lens itself is a bit wider than 13mm uncorrected. Canon's corrections, whether in-camera or with DPP, take it to 14mm (albeit very slightly narrower than 14mm on the EF 11-24mm, the difference is really minor). Adobe is a little wider than Canon. It's only with DxO that you get that ~13.5mm FoV.

I think Canon specifies the lens FoV after correction for the distortion, which is consistent with forcing that correction.
 
  • Like
Reactions: 1 user
Upvote 0

tron

CR Pro
Nov 8, 2011
5,222
1,616
Thanks for the detailed analysis. I will have that in mind but upgrading is more expensive than it seems. I use my 16-35 lenses (either 2.8L III or 4L IS) mostly with 5DIV. To get a RF14-35 could mean a second R5 if I am to use my R5 with 100-500 (for birding). But to be frank I also use D850/500PF for birding and when I want to save my back I also get a D200 with 10-18 with me for landscape shots. In that case a R5 with 14-35 would be nice. If only I could send you the bill... :ROFLMAO: :ROFLMAO: :ROFLMAO:
 
  • Like
Reactions: 1 user
Upvote 0
Jul 21, 2010
31,099
12,863
I found it very 'dense', probably because I'm not used to heavy, short lenses. I rented it for a week and after a few days had to be mindful of how I was holding the camera+lens. Great results nonetheless, but the density cured my GAS :)
The EF 85/1.2L II is 400 g lighter but 5 cm shorter, so it’s similarly ‘dense’. In my experience, lenses like that are far more comfortable to hold on a 1-series type body. The 28-70/2 will probably arrive before the R3, and I expect the lens will be unwieldy on my R.
 
Upvote 0
  • Like
Reactions: 1 user
Upvote 0

gruhl28

Canon 70D
Jul 26, 2013
209
92
Great write-up, Neuro. I hope some of the people writing about and freaking out about the 16mm f/2.8 read this also. That's obviously a different class of lens and the results will not be the same, but the same principles are involved.

Your write-up, plus a Youtube review of the 16mm that I watched yesterday showing results of a distant view, made me really think for the first time about the fact that Bryan's lens chart pics at TDP are taken at very close distances for wide angle lenses. I think Bryan does a great job with his reviews, but if a lens isn't that good at close distances the lens chart pics could make a lens look worse than it would really perform at the distances it is usually used.
 
Upvote 0

koenkooi

CR Pro
Feb 25, 2015
3,575
4,111
The Netherlands
[..]Your write-up, plus a Youtube review of the 16mm that I watched yesterday showing results of a distant view, made me really think for the first time about the fact that Bryan's lens chart pics at TDP are taken at very close distances for wide angle lenses. I think Bryan does a great job with his reviews, but if a lens isn't that good at close distances the lens chart pics could make a lens look worse than it would really perform at the distances it is usually used.
I bet you watched this one:

The description has timestamps per subject, so you can skip to the section you want by clicking those.
 
  • Like
Reactions: 1 user
Upvote 0
Jul 21, 2010
31,099
12,863
Your write-up, plus a Youtube review of the 16mm that I watched yesterday showing results of a distant view, made me really think for the first time about the fact that Bryan's lens chart pics at TDP are taken at very close distances for wide angle lenses. I think Bryan does a great job with his reviews, but if a lens isn't that good at close distances the lens chart pics could make a lens look worse than it would really perform at the distances it is usually used.
The enhanced ISO 12233 chart he uses is ~48x32", but at 11mm that fills the frame at half a meter. Actually, I'm not sure how large his checkerboard chart for distortion testing is, but it's probably similar in size (having it be the same size would make his testing easier, IMO, but the source for his enhanced ISO 12233 chart doesn't make a checkerboard chart). I have a somewhat smaller version the same enhanced ISO 12233 chart Bryan uses (~27x18"), but with wide angle lenses I 'cheat' by placing the chart in the corners of the frame in sequential shots (mainly I'm looking for 'good enough' resolution and more importantly, symmetry in all 4 corners, so I don't have to fill the frame to compare across lenses as his tests are intended to allow).

The same issue will apply to other sites (e.g., Optical Limits) that use Imatest for their analyses. Imatest does offer somewhat larger charts than the vendor Bryan uses, but with UWA lenses any printed chart will need to be very close to the camera.
 
  • Like
Reactions: 1 user
Upvote 0
Oct 29, 2012
234
146
Just wanted to add my thanks for the great review.

I’m a LR/CR user, and in comparing the FOV at 14mm between ACR and DPP, the ACR FOV is definitely wider to me. Your results appear to confirm this, which makes me happy.

I bought it to complement my RF 15-35, but now I’m not sure if there is much reason to use the 15-35 unless one needs the F2.8. I’m curious as to how you find the IQ on the 14-35 compared to the 15-35 other than the wider FOV.

Thanks again
 
Upvote 0
Jul 21, 2010
31,099
12,863
I’m curious as to how you find the IQ on the 14-35 compared to the 15-35 other than the wider FOV.
Sorry, I’ve never shot with the RF 15-35/2.8 so I can’t offer an informed opinion on IQ, beyond what we can both read on the internet.

From a usage standpoint, I personally don’t have much use for f/2.8 at UWA focal lengths. I had the EF 16-35/2.8 II and used it so rarely at wider than f/4 that I ended up swapping it for the EF 16-35/4 IS (and that in turn for the RF 14-35).
 
Upvote 0

LogicExtremist

Lux pictor
Sep 26, 2021
501
352
Mirrorless cameras lack an optical viewfinder, so looking through the lens is always an electronic process. This fact enables lens manufacturers to include consideration of digital optical corrections in their lens designs and make trade-offs accordingly – more optical aberrations can be tolerated because they will be corrected in the EVF and in processed images, so users will often not know they’re there in the first place.

MILC manufacturers other than Canon have leveraged this concept for many years. Canon’s implementation in the RF 24-240mm lens came as a surprise to many when it was initially reported on internet forums, with the lens having very strong barrel distortion at the wide end and forcing the application of correction in-camera and in DPP (i.e., unlike other lenses the correction cannot be disabled). The recently released RF 16mm f/2.8 is similar, and that is probably not surprising in a $300 UWA lens (in fact, most likely the design trade-off of strong distortion is one reason the lens is so relatively inexpensive). Canon seems to have confirmed this with their statement in the press release for the lens, “Long gone are the days of optical corrections…,” presumably because digital corrections are now the norm.

However, Canon also took this approach with the RF 14-35mm f/4L IS, their first time doing so with an L-series lens. Although I had some concerns about this level of correction, I decided to swap my EF 16-35/4L IS for it, in part for the smaller size and in part for the wider FoV when I don’t want to bring the EF 11-24/4L.

Lens in hand, I decided to see how bad the distortion really is, and how well it can be corrected with various RAW converters. I used the classic brick wall test, but rather than standing close I opted for a more distant shot where the ‘wall’ was the side of a 9-story building at a distance that captured most of the height. The reason for that was to avoid the potential issue of focus breathing, where the effective focal length of a lens is shorter with a close subject (one example of this is Canon’s 100L Macro, where at 1:1 it’s giving the framing of ~68mm). Note that in his image testing, Bryan of TDP indicates that framing his ‘enhanced ISO 12233’ chart at 14mm is done at a distance of less than 2’ / 60 cm. I ensured that the camera was level and orthogonal to the building to avoid vertical and horizontal distortions.

The first composite is a set of RAW conversions of the same single image, taken at 14mm f/8 (thumbnail below is a 1000 pixel wide image hosted on CR, full image is HERE).

View attachment 201217

The top right image was converted in DxO PhotoLab with all corrections turned off. The uncorrected image shows significant barrel distortion and some mechanical vignetting in the corners. Compared to the straight out of camera JPG (top left), the FoV of the uncorrected image is clearly wider than 14mm (how much wider is discussed below). In DPP, I converted the image with corrections set to 100% and with DLO. The FoV is the same as the SOOC image, but the vignetting correction is improved. Converting the image in Adobe Camera Raw with the lens profile yields a slightly wider FoV than with Canon’s lens profile (e.g., more of the window lintels are visible in the upper left corner, and the left edge of an additional column of windows is visible on the right edge. The standard (default) corrections in DxO deliver a noticeably wider FoV than ACR – another row of windows becomes visible in the top left and an additional full column of windows is visible on the right side. DxO also has an ‘optical corrections only’ option which does not force the corrected image into the original 3:2 aspect ratio, and the result there (bottom right) is an image of the same vertical FoV as standard but a wider horizontal FoV (another half-column of windows on the left). That image output is 305 pixels wider than the EOS R’s native output.

How much wider is the FoV of the corrections with DxO? To assess that, I took a series of images from 14mm down to 11mm on the EF 11-24mm. Shown is the comparison of the RF 14-35mm at 14mm (middle panels) with the EF 11-24mm at 14mm (top) and 13mm (bottom), converted with either DPP or DxO (thumbnail below is a 1000 pixel wide image hosted on CR, full image is HERE).

View attachment 201218

When converted with DPP, the FoV of the 14-35mm at 14mm is very slightly narrower than that of the 11-24mm at 14mm (where distortion is very modest). With DxO, the FoV of the 14-35mm at 14mm is comparable to ~13.5mm on the 11-24mm lens, meaning with optimal corrections the lens is delivering a wider-than-specified FoV. I’ll take it!

For the uncorrected image, based on the ‘corners’ of the strongly distorted image to the series of images taken from 14mm to 11mm on the EF 11-24mm, the FoV of the 14-35mm at 14mm approximates slightly under 13mm.

On this and other forums, there have been ‘tests’ that suggest the image from this and other strongly distorted lenses are cropped and then upscaled (I initially thought this might be the case, but it isn’t). These tests suffer from one or more flaws. A common approach prior to the availability of a lens profile from Adobe has been to drag the distortion slider to 100 then crop the image to the proportions of the in-camera JPG. However, when performing a manual correction for barrel distortion in LR/PS/ACR, dragging the slider to +100 does not equate to correcting 100% of the distortion. Rather, the slider is merely an arbitrary scale of 100 units of correction in the (+) direction for correcting barrel distortion or in the (–) direction for correcting pincushion distortion. In other words, +100 is likely too much correction. In the case of the 14-35mm at 14mm, around +35 to +40 does a reasonable job of correcting the barrel distortion.

Manual distortion correction assumes the characteristic of the distortion is linear (along the image radial), and that's almost never going to be the case. So, if you drag the distortion correction slider to the point where horizontal lines in the corners of the scene appear horizontal in the image, then there is residual barrel distortion of lines in the mid-frame. Conversely, if you drag the distortion correction slider to the point where horizontal lines in the mid-frame of the scene appear horizontal in the image, pincushion distortion of lines in the corners is introduced. Basically, manual distortion correction is applying a linear process to a non-linear aberration.

That's where lens profiles come into play. Applying the lens profile for the 14-35/4 in ACR and other RAW converters results in horizontal lines in both the corners and the mid-frame appearing horizontal in the image, i.e., the profile includes a non-linear correction for distortion. The same can be achieved in Photoshop using a warp transform, for example. In the case of an even more complex distortion (e.g., mustache) a warp-type transformation is really the only way it can be corrected. Doing so does 'stretch' the corners of the image, so in that sense there are 'fake pixels' being created, but it allows geometric correction without the need to crop then upscale the image.

That begs the question of how detail-destructive that warping correction is in practice. Below are 100% crops (1000x667 pixels) from the extreme upper left corner of the corrected 14-35mm images at f/4 and f/8, along with crops from the 11-24mm corners, also corrected but with much less correction required because of the better optical correction in the lens (thumbnail below is a 1000 pixel wide image hosted on CR, full image is HERE).

View attachment 201219

There are differences between the RAW converters but overall, the results in all cases are quite good, with very subtle differences if any between the highly corrected 14-35mm corners and the lightly corrected 11-24mm corners.

Based on the above, I’m more than satisfied with my new RF 14-35mm f/4L IS (and I recommend DxO PhotoLab for those wanting to get the most from it).
Excellent and really thorough testing! Very informative results!

What I still don't quite understand is that if there's mechanical vignetting, and the 13mm image across the full sensor visible in the RAW file is cropped down to 14mm, how is the image not being upscaled like you first theorised if the final corrected image is still the full sensor size? Or is that not the case?

Thanks for the comparison of the various RAW converters, I'm really impressed with DxO PhotoLab, glad it's the one I chose to purchase a month ago!

Incidentally, it's obvious why the EF 11-24mm costs what it does, the corners look quite a bit better than the Rf 14-35mm, but it's a far more expensive lens after all! :)
 
Upvote 0