Auto-focus performance/panning test: RF100-500 vs EF 300/2.8 II vs EF200-400

First off, this isn't a fully objective test (and I'm not sure you can create one without a very sizeable budget), but I found the data interesting enough to share and to hear if others had tested the lenses.

I shoot a lot of motorcycle racing, and with picking up the RF100-500 about a month ago, I was keen to practice using it on the R3 and seeing how it measures up against the EF 300/2.8 II and the EF200-400 as the two EF are in the 'Big (& Heavy) White' league, whereas the RF is in the 'Little White' league ;) The much smaller size and lower weight makes the RF100-500 potential choice. But how good is the auto-focus, compared to the Big Whites?

Two weekends ago, there the organization I ride with was organizing a 6-hour motorcycle Endurance Race, so instead of riding, I photo-geared up, headed to the track, got a 'tog vest and out I went shooting.

The main points for me in this "test" is to practice my panning game (yes, I still suck at it), get to learn the R3/RF100-500 combo, and see how good the lens+body AF system is at to locking onto the motorcyle (or helmet).

Background data:
R3 body, using FW v1.4.0. Shutter set to electronic, with either H+ or H mode. Auto-AF mode, BBF.
Vehicle detection enabled, eye-focus disabled. Panning assist disabled. Shooting RAW only (that was a mistake: shoot RAW+JPG-L).
Conditions was bright sunlight from a spotless sky - almost too much light. I used a C-POL filter (77mm or 52-m drop-in) to cut out 1-1.5 stop of light to keep the aperture to sensible levels (I have now purchased a 77mm 3-stop ND filter).

LensShotsRating 4Rating 5Keeper rate (4)Keeper rate (5)
Canon EF 200-400mm f/4L IS USM164252915.2%17.7%
Canon EF 200-400mm f/4L IS USM + 1.4x312392712.5%8.7%
Canon EF 300mm f/2,8L IS II USM148202613.5%17.6%
Canon EF200-400mm f/4L IS USM +1.4x III196313515.8%17.9%
Canon EF200-400mm f/4L IS USM EXT +1.4x III45204.4%0.0%
Canon RF 100-500mm F4.5-7.1L IS USM200821116510.5%8.2%
Canon RF 24-105mm F4L IS USM68958228.4%3.2%

A bit of extra information showing the distribution over focal length, shutter speed, and f-number.
Shutter speed [sec]ShotsPercentage
1/160220.6%
1/200319089.9%
1/2503389.5%

F-numberShotsPercentage
5.681723.0%
6.3310.9%
7.13209.0%
8185952.4%
92747.7%
112497.0%

Focal length [mm]Shots
100-105640
20074
280237
3001070
400267
420-428200
500662
560157
78445

My own notes and comments:
1) Rating 5 was used for images that were tack-sharp in 100% - both for the bike and the riders' helmet. If either the helmet or bike (but not both) was sharp, I gave the image a Rating 4.
2) The poor data for the RF24-105 should be ignored in this case. I only used the RF-24-105 on the inside of a corner where the bikes were going significantly faster than the other corners, and due to the closeness, the angular velocity (ie: panning speed) was much higher, making it really hard to get a bike is tack-sharp focus. In that corner I was using ~100mm focal length, as the bikes were so close.
3) I shot mostly at two other corners, from the same position (outside to both corners). I could simply pivot and shoot bikes in either corner as I pleased. In one corner a 300mm FL was a good choice (distance: 25-30meters), and in the other I was using 400-500-560mm (distance 50 meters).
4) I tried using the 1.4x + 1.4x internal + external TC for the EF 200-400 for bikes coming over a crest some ~300 meters away and shooting at that distance is not worthwhile. The vehicle should be taking up a sizeable part of the image.

My own conclusions:
A) So if I just look at the keeper rate of the 'Rating 5' images, the two Big Whites get ~18% keepers, whereas the RF100-500 is at 8%. That's a much bigger difference than I had expected.
B) If you are using DPP (as I do), and need to sort through a lot of images quickly, my recommendation is to shoot in RAW+JPG(L). The reason is that DPP is dog slow at rendering a CR3 image - approx 6 seconds/image on my computer, whereas a JPG render is virtually instantaneous. So decouple the RAW+JPG in the menu, use the JPGs to rate and cull, and then go back to the CR3 for actual editing work. I used the exiftool to batch-copy the Rating field from the JPGs to the RAWs. Also, do not use DPP for deleting images (it's slow). Writing RAW+JPG in the camera is infinitely faster than asking DPP to create JPG's after-the-fact (15sec/image, in fact).

Hope this is useful for others. Anything missing? (exiftool can dig out impressive amounts of information from the EXIF data).
 
  • Like
Reactions: 1 users
Since you mention panning, which IS mode were the lenses set to?
When I just got it, the results with mode 1 were very poor when moving the lens horizontally while shooting.
From a quick look at the lenses, IS mode 1 (will check the exif later).

Which mode do you recommend?
 
Upvote 0
Mode 1 is for non moving subjects, 2 for panning, 3 for both.
3 is the lazy option I choosed because I forget about the mode I use.
In Your case 2 is the best choice.
Thanks. But this is odd, because the lens switch is set to position 1, but the EXIF reports Image Stabilization to be "On (2)".

Either the body overrides the lens setting, or exiftool is not reporting this correctly. I just tested all three Stabilizer Mode settings (1, 2, 3) and there are no other reported EXIF tag that is even remotely related to image stabilization.
 
Upvote 0

koenkooi

CR Pro
Feb 25, 2015
3,657
4,237
The Netherlands
Thanks. But this is odd, because the lens switch is set to position 1, but the EXIF reports Image Stabilization to be "On (2)".

Either the body overrides the lens setting, or exiftool is not reporting this correctly. I just tested all three Stabilizer Mode settings (1, 2, 3) and there are no other reported EXIF tag that is even remotely related to image stabilization.
Not all EXIF fields start at 0, so it could be using 1 for off and 2 for on.

Also, not all EXIF should be trusted, my RF100L f/2.8 says in the Canon Makernotes section of the EXIF data that it’s zoom lens
 
Upvote 0
Thanks for your hard work - much appreciated. It would be interesting to know the comparisons for the same focal lengths: eg, all whites at 300mm, both zooms at 400mm and 500mm, each comparison from the same viewing spot, to see if field of view comes into it.
I am not able to divide the image into per-corner, without major work (I would have to walk through all the images and categorize them based on the corner), but here's the QnD answer:

Lens
~200​
~280​
300​
~400​
500​
560​
Canon EF 200-400mm f/4L IS USM
1​
0​
16​
12​
N/A​
N/A​
Canon EF 200-400mm f/4L IS USM + 1.4x
0​
20​
0​
2​
0​
5​
Canon EF 300mm f/2,8L IS II USM
N/A​
N/A​
26​
N/A​
N/A​
N/A​
Canon EF200-400mm f/4L IS USM +1.4x III
0​
11​
0​
0​
0​
2​
Canon RF 100-500mm F4.5-7.1L IS USM
2​
1​
89​
28​
29​
N/A​
Canon EF 200-400mm f/4L IS USM
2,1%​
0,0%​
28,1%
22,6%
N/A​
N/A​
Canon EF 200-400mm f/4L IS USM + 1.4x
N/A​
12,2%
N/A​
10,5%
N/A​
3,9%​
Canon EF 300mm f/2,8L IS II USM
N/A​
N/A​
17,6%
N/A​
N/A​
N/A​
Canon EF200-400mm f/4L IS USM +1.4x III
N/A​
15,1%
N/A​
N/A​
N/A​
7,1%​
Canon RF 100-500mm F4.5-7.1L IS USM
5,6%​
20,0%*​
10,3%
13,1%
4,4%​
N/A​

"N/A" means that either the lens doesn't support the focal length or there were no shots with that focal length.

So 300-400mm is the sweet spot.

*) Not valid result, as only 5 shots at this focal length with this lens.
 
  • Like
Reactions: 1 user
Upvote 0
Not all EXIF fields start at 0, so it could be using 1 for off and 2 for on.

Also, not all EXIF should be trusted, my RF100L f/2.8 says in the Canon Makernotes section of the EXIF data that it’s zoom lens
I'm leaning towards the later. The 1Dx does't store the ImageStabilization tag at all.
 
Upvote 0