Days since DXO sensor score of 5DS = 112. Number of lenses re-tested = 0.

ahsanford

Particular Member
Aug 16, 2012
8,656
1,664
57,701
Many were wondering how much of a retraction/backpeddling effort DXO would have to make once lenses they have cudgeled for lack of Perceptual MPix would fare when a 50 MP sensor was now sitting behind them.

This, of course, depended on what form of accountability DXO took in this endeavor:

Option 1) Use the same scoring algorithms, retest existing lenses on a 5DS/5DS R and watch Canon catapult over Nikon and Sony glass in their rankings.

Option 2) Pull a classic DXO move and declare it 'time to make a change' and either abolish aggregate lens scores or normalize those scores to the resolution of the sensor it was tested on.

Option 3) Turtle and hide until a7R II models arrive.

See subject. Looks like Option 3 is well underway.

- A
 
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.


How our terrible, horrible, no good, very bad Canon lenses rank today...
 

Attachments

  • Canon Standard Zooms are Terrible.jpg
    Canon Standard Zooms are Terrible.jpg
    232.4 KB · Views: 245
  • Canon Telephoto Zooms are Terrible-er.jpg
    Canon Telephoto Zooms are Terrible-er.jpg
    229.5 KB · Views: 260
Upvote 0
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.

It will be interesting to see how quickly a7r II scores for sensor and lenses appear. Maybe there will be a similar drought. Maybe not. Particularly for Canon lenses mounted on the Sony body ;)

Not that I really care...
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.

Lens profiles are already available for the 5ds/r within dxo optics pro so they have data, I'd agree with your option 3 conclusion

http://www.dxo.com/us/photography/photo-software/dxo-opticspro/supported-cameras
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.

There testing methods are seriously flawed anyway reading their scores will only make you angry so dont bother.

If we tested the way they do we would never maximise the "system" performance and anyone worth their salt would know that. Were testing for billboard size stills and event screen size projection and below so any imperfection will be noticed.
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.

GREAT NEWS EVERYONE!

DXO finally got around to testing Canon lenses again.

http://www.dxomark.com/Reviews/Canon-EF-50mm-F1.8-STM-lens-review-Thrifty-fifty/Measurements-Very-good-optical-performance

...but they are still using the 5D3. [cue laugh track, cue Price is Right contestant fail music]

- A
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.

ahsanford said:
GREAT NEWS EVERYONE!

DXO finally got around to testing Canon lenses again.

http://www.dxomark.com/Reviews/Canon-EF-50mm-F1.8-STM-lens-review-Thrifty-fifty/Measurements-Very-good-optical-performance

...but they are still using the 5D3. [cue laugh track, cue Price is Right contestant fail music]

- A

Odd. Transmission and chromatic abberation have improved over the old lens, presumably because of the new coatings. Distortion is fractionally better, yet vignetting much worse. Except..........

Photozone have the vignetting on the old lens fully open at 3 stops - worse than the STM lens and over a third more than dxo managed to record for the old lens. I can't believe that vignetting varies much from copy to copy, and my experience with the 1.8II lens is that photozone got it right.

So that is another very strange dxo measurement, and it leads the new, much improved STM lens to have a lower 'score' than the old one.
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.

We all wait impatiently for these new tests because we all know that sensor's resolution has nothing to do with sensor's evaluation: sensor resolution is relevant only when evaluating lenses' performance, right?
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 35. Number of lenses re-tested = 0.

JohanCruyff said:
We all wait impatiently for these new tests because we all know that sensor's resolution has nothing to do with sensor's evaluation: sensor resolution is relevant only when evaluating lenses' performance, right?

That, sir, is the delicious paradox of DXO. The DXO works in mysterious ways.

It's like drinking that older crazy dangerous version of absinthe or watching Fox News as anything other than a source of entertainment -- folks know they shouldn't do it, but they do anyway.

- A
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 56. Number of lenses re-tested = 0.

Just some speculation on my part...

I think they need to re-baseline their entire database, which currently is using 36MP as a maximum P-Mpix value. I get the impression that they use weighted percentages in their combined scores so they need a maximum in order to assign a performance in %. So all scores will need to be adjusted to presumably 50MP.

I think they are waiting for an official announcement from Nikon as to whether they will launch something higher than the 5Ds/R or whether they will just adopt the Sony 42MP sensor.

If Nikon remains below 50MP then I guess they'll publish all the data with 50MP being the new baseline. This should be stable for the next few years. If they do need to go higher than 50MP then it makes sense to do it all at once rather than publish now then have to redo in 6months time again. I'm not gonna mention any names, but some companies have product release cycles which are much shorter than Canon's.

As I said this is just my speculation, I might be way off.
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 70. Number of lenses re-tested = 0.

70 days since the 5DS was reviewed by DXO.

DXO remains a tight ship on how lenses actually perform on that rig. Zero lens tests on that rig have been reported.

- A
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 70. Number of lenses re-tested = 0.

DXO reminds me of two people in real life who really enjoy the attention and controversy: our dearest Mr. Trump and Mr. Rockwell. How boring life is while they're not in the world.
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 70. Number of lenses re-tested = 0.

Phenix205 said:
DXO reminds me of two people in real life who really enjoy the attention and controversy: our dearest Mr. Trump and Mr. Rockwell. How boring life is while they're not in the world.

The silence from them is pretty deafening. I just want to see one lens ranked in the cellar in their rating system skyrocket up to the top just because more pixels are sitting behind it now.

- A
 
Upvote 0
Re: Days since DXO sensor score of 5DS = 70. Number of lenses re-tested = 0.

A lens test is a lens test. If changing the camera body affects the score, then you are doing it wrong.

This is what happens when you dumb things down..... you get stupidity.....
 
Upvote 0
Re: DXO replies regarding Metamerism score difference to prove

ritholtz said:
Some one on dpr followed up DPR about their numbers. DXO has a trademark for generating worthless numbers.

http://www.dpreview.com/forums/post/56459976

Of course. I certainly do not take them seriously, but their ranking system is outright inflammatory and I'd like them to simply follow their procedure, re-test one 'wretched' Canon lens in front of a 50 MP sensor and watch it rocket up their charts.

Please don't mistake this for fanboyism, I don't need to see that my 70-200 f/2.8L IS II isn't the 732nd best lens any longer. I just want to see a broken rating system deliver a wildly different result on the same lens.

- A
 
Upvote 0