DxOMark scores for 5DMkIII out - total score 81, 5DMkII had 79

[DavidRiesenberg]

I think the biggest gripe people have with DXO is how they translate the results to numerical scores. And the comparisons between the D800, 5D3 and even the MF cameras suggest that there is a certain flaw in that translation. Just looking at the graphs, the D800 and 5D3 seem neck in neck in most comparisons but the difference overall comes to 14 points? And anyone who has seen even a single image of the IQ180 can honestly say that the D800s sensor is better?

 

[Kingw]

Re: DxO results out for 5D3

A lot of people say canon 5d mark iii is selling very well. I'm wondering where are the sales data?

 

[Bosman]

Re: DxO results out for 5D3

I'm glad Fred got the stuff posted, saves me some time. ;D

NOW will some of you have a little more confidence in some of the numbers published and those silly-looking tests shots with the lens caps on and pushed in post or other methods we may use?..

These simple tests can demonstrate a lot of what goes on at the dark end of the DR range so very easily.

It's been interested to watch the progression of this thread.

Congrats to LTRLI for hitting the DR nail on the head so early and not losing patience in defending his position.

Congrats to those of you who now see and understand what some of us have been going on about for so long. Canon's engineering is not keeping up with its marketing when a $600 consumer grade Nikon can even kick the low ISO pants off a midrange Canon costing nearly 6x as much.

5D3's a much improved, low-light kind of machine.
But it don't do stink for what I need.

The next scrap's gonna be that 24MP, 12-bit little nugget they just announced yesterday. D3200.
I'm REALLY looking forward to how it will perform as it's likely foreshadowing (ooh, good pun) the abilities of a D7100 or D400.

BTW; I now have about 10 Nikon/Nikkor lenses.

Again the D800 is a great camera, the 5dm3 is a great camera. I don't lift shadows like this or do extreme edits to images. I suppose for those who don't get exposures right it will be a helping hand to be able to retrieve the data. the test and data havent affected my output that I am very pleased with and have no Nikon envy, just happy that the Nikon peeps are happy. Maybe those who got some of the findings would be more suited for Nikonians if all your comments seem to be about D800 stuff. Last i checked this was a Canon Forum but apparently it is now also a Nikon Forum.

 

[LetTheRightLensIn]

I think the biggest gripe people have with DXO is how they translate the results to numerical scores. And the comparisons between the D800, 5D3 and even the MF cameras suggest that there is a certain flaw in that translation. Just looking at the graphs, the D800 and 5D3 seem neck in neck in most comparisons but the difference overall comes to 14 points? And anyone who has seen even a single image of the IQ180 can honestly say that the D800s sensor is better?

http://www.fredmiranda.com/5DIII-D800/index_controlled-tests.html

 

[Former Nikonian]

Hi Fishnose
You still dodge the point. Now skip the D800 v/s Mkiii as far as Mkii v/s Mkiii story; focus on Nikon only.
The question is: Does it make sense when DxO gives total score of D800 higher than that of D4? Yes or No?
Actually, this was pointed out to me by my brother, an IT engineer, who is not stranger with Lab Testing job. He gave it a big laugh.
He said either DxO is biasing so it's not reliable or playing a Black Humor game.
Have fun with the game.

 

[seta666]

The question is: Does it make sense when DxO gives total score of D800 higher than that of D4? Yes or No?

The D4 scores higher at ISO performance, has higher frame rate and pro like body/features; Sports, actions, etc

The D800 higher DR, resolution and color depth thanks to high efficient smallpixels (amaizing actually, but not surprissing if you think of pentax K5 or nikon d7000). Studio photography perfect camera

The 5D mkIII would have been a great camera , 3 years ago; Canon technology is starting to look ancient. Regarding sensors Fuji and Sony are well ahead

As DXOmark explains a score difference of 5 represents a 1/3 stop difference; so D800 has a full stop better performance than the 5D mkIII (which is a lot) and 1/3 stop over D4 (which is not big deal)
The difference is the same as D7000 vs 60D, one full stop

DXOmark results show sensor performance; and the results they have published reagrding ISO are the ones I anticipated when saw Dpreview ISo samples, less than 1/2 stop improvement over 5D mkII. These Dpreview smaples had lots and lots of Noise reduction on them, still many people was thinking that those were amaizing results (is people blind or what?)

What really suprises me is the low dinamic range performance of this new sensor, in my opoinion this puts canon to same. If this is best canon can do regarding sensor technology they should start thinking partership with sony, fuji or anyone fit for the job; they clearly are not.

If you do not need the new AF system or the weather sealing (always talking about photography, I do not know anything about video) I do not see any reason to update to this new camera over the 5D mkII

As a macro photographer I do not need those new features, I may get a second 5D mkII as back up if it goes down to 1000€ like last 5D classic units did

If it does not I will get a NEX 5-n or Nex-7 as second body, as I would like to have a high DR body and now NEX cameras can use EF lenses thanks to this new 400$ adapter (MP-E 65 included)

Regards

 

[davidpeter]

My conspiracy theory:
I wonder if DxO is purposely picking the 8MP downsize option to boost Nikon scores. ... Notice the random Pentax K5 extremely awesome DR rating also contains a 16MP sensor. I also find it interesting that the $800 16MP Nikon D5100 has an equal DR to the Phase One...hmmmmmm. The Sony NEX-7 with its 24MP sensor (multiple of 8) and the 24MP D3x and 24MP Sony A580 also have top spots to both $40,000 medium format cameras known their dynamic range and all Canon bodies.

Remarkably, that 'all Canon bodies' includes the 16 MP 1D IV. Another conspiracy theory shattered against the cold, hard rocks of reality.

Well said.

Please guys, if you would like to argue with the results of DxO, first post the Fourier series of a square wave, just to let know, you have a clue about the topic. I believe, that half of the Captain Obviouses here don't know, what is SNR, but they are seriously protesting about the ISO results. This is nonsense...

 

[NormanBates]

I trust the dxomark sensor numbers: if all you care about is image quality, the 5D3 is a small step up from the 5D2, but the D800 is a huge step up from the 5D3

if you're going to accuse dxomark of lying or purposedly skewing their results, please back that up with some proof, not just speculation

otherwise I'll think you're a fanboy, or upset that you're heavily invested on a camera system that's fallen far from the leading edge, and looking for excuses to avoid feeling bad about it

now, the score that's more troublesome for me is the DR score, and, if you're right, it should be extremely easy to provide proof of it

just bring your shiny new camera outside, put it on a tripod, and take two pictures that are exactly the same except for shutter speed: one is at 1/4000, the other is at 2" (not 1/2, but 2"); if both pictures show discernible detail in a given area (the same for both pictures), then the camera has 13 stops of DR or more; if you can't get that detail on both (i.e. either the 1/4000 is clipped to black, or the 2" is clipped to white, no matter how hard you fight with the RAW files), it has less than 13 stops of DR

of course, it would be great if you could do the same with the 5D2 (to see if there's an actual DR improvement with the 5D3, or just minimal as dxomark says) and with a camera that uses a modern Sony sensor (D800, D7000, nex-5n, nex-7, etc) (to see if those actually have the DR that dxomark claims they have) (I should point out that I already asked some D800 owners to run these tests from me, and playing with the RAW files I can confirm that it has well over 13 stops of DR)

I'm genuinely interested in your results, but I won't be following this thread any longer, so please PM me if you actually go out and test your camera, instead of ranting and speculating

Also, I have a theory to explain the dxomark DR results: Canon's ADC converters are not good enough for what the rest of the sensor can do, that's why the high-ISO DR is great but from a certain point no DR gains are appearing as you lower the ISO

(and no, I don't work for dxomark, or know anybody that does)
(and just 3 months ago I was accused of being a canon fanboy by my nikonian friends; luckily, I know the important investment is lenses, and have built a great Leica-R collection that will work on basically anything, including Canon, Nikon, Sony and Pentax)

 

[jrista]

Re: DxO results out for 5D3

I'm glad Fred got the stuff posted, saves me some time. ;D

NOW will some of you have a little more confidence in some of the numbers published and those silly-looking tests shots with the lens caps on and pushed in post or other methods we may use?..

These simple tests can demonstrate a lot of what goes on at the dark end of the DR range so very easily.

It's been interested to watch the progression of this thread.

Congrats to LTRLI for hitting the DR nail on the head so early and not losing patience in defending his position.

Congrats to those of you who now see and understand what some of us have been going on about for so long. Canon's engineering is not keeping up with its marketing when a $600 consumer grade Nikon can even kick the low ISO pants off a midrange Canon costing nearly 6x as much.

5D3's a much improved, low-light kind of machine.
But it don't do stink for what I need.

The next scrap's gonna be that 24MP, 12-bit little nugget they just announced yesterday. D3200.
I'm REALLY looking forward to how it will perform as it's likely foreshadowing (ooh, good pun) the abilities of a D7100 or D400.

BTW; I now have about 10 Nikon/Nikkor lenses.

Again the D800 is a great camera, the 5dm3 is a great camera. I don't lift shadows like this or do extreme edits to images. I suppose for those who don't get exposures right it will be a helping hand to be able to retrieve the data. the test and data havent affected my output that I am very pleased with and have no Nikon envy, just happy that the Nikon peeps are happy. Maybe those who got some of the findings would be more suited for Nikonians if all your comments seem to be about D800 stuff. Last i checked this was a Canon Forum but apparently it is now also a Nikon Forum.

Lifting shadows is not just for those who don't know how to expose right. There are plenty of situations where you CAN'T expose right. Landscapes are the most obvious scenarios where the DR of the scene can be much greater than the DR of the camera. With something like the D800, you can lift shadows to replicate what you can see with your eyes...which are capable of around 20 stops of DR. No, not everyone actually needs that, which is indeed an argument for the 5D III, which is definitely an excellent camera.

That doesn't change the fact that it really does not appear that Canon did a whole lot to improve their sensor technology this round (despite the fact that its been 5 years since they created a new sensor design). They somewhat cheated their way to higher SNR, and took a step backwards with low-ISO read noise, which is not doing a proper service to their customers. (Especially when they are asking so much money for their new gear...$3500 with the only real sensor improvement being gapless microlenses? Seriously...)

 

[DavidRiesenberg]

if you're going to accuse dxomark of lying or purposedly skewing their results, please back that up with some proof, not just speculation

How about this review? http://www.techradar.com/reviews/cameras-and-camcorders/cameras/digital-slrs-hybrids/canon-eos-5d-mark-iii-1074186/review/page:5#articleContent

Seems very different than DXOs results while actually using their testing suite.

 

[briansquibb]

if you're going to accuse dxomark of lying or purposedly skewing their results, please back that up with some proof, not just speculation

How about this review? http://www.techradar.com/reviews/cameras-and-camcorders/cameras/digital-slrs-hybrids/canon-eos-5d-mark-iii-1074186/review/page:5#articleContent

Seems very different than DXOs results while actually using their testing suite.

The comparisons between the RAW for the Canons coincide with my eyeball test, so it gains credance from me.

 

[Bosman]

Re: DxO results out for 5D3

Lifting shadows is not just for those who don't know how to expose right. There are plenty of situations where you CAN'T expose right. Landscapes are the most obvious scenarios where the DR of the scene can be much greater than the DR of the camera. With something like the D800, you can lift shadows to replicate what you can see with your eyes...which are capable of around 20 stops of DR. No, not everyone actually needs that, which is indeed an argument for the 5D III, which is definitely an excellent camera.

That doesn't change the fact that it really does not appear that Canon did a whole lot to improve their sensor technology this round (despite the fact that its been 5 years since they created a new sensor design). They somewhat cheated their way to higher SNR, and took a step backwards with low-ISO read noise, which is not doing a proper service to their customers. (Especially when they are asking so much money for their new gear...$3500 with the only real sensor improvement being gapless microlenses? Seriously...)

So you say. I prefer to not bitch. Do you have a 5dm3?

 

[smithy]

It's fascinating to watch these conversations. Generally, those who do not think the 5D is worth the money will NOT buy one.

I am undecided.

I do not have rental access to a Mark III, so my choice has to be based entirely on reviews, anecdotal information (forums, etc), price, and the 2 minutes I get to hold one in my local camera shop. So far the reviews have been okay, DxO results 'disappointing', price very high ($4200 where I live), opinion in this forum absolutely polarised, and my 2 minutes of holding one in the shop: pleasant.

 

[takoman46]

It's fascinating to watch these conversations. Generally, those who do not think the 5D is worth the money will NOT buy one.

I am undecided.

I do not have rental access to a Mark III, so my choice has to be based entirely on reviews, anecdotal information (forums, etc), price, and the 2 minutes I get to hold one in my local camera shop. So far the reviews have been okay, DxO results 'disappointing', price very high ($4200 where I live), opinion in this forum absolutely polarised, and my 2 minutes of holding one in the shop: pleasant.

You could rent one at a local camera rental shop and experience it first hand. If it's not for you then you'll know it, and if it is for you then you'll know it.

 

[Tcapp]

How come when people compare the 5d3 to the 5d2 the 1 stop improvement is not a big deal. 1 stop = 100% better.

Then people compare the 5d3 to the D800 and maybe the d800 is 25% better than the 5d3 (not that it really is, just for arguments sake) people get all bent out of shape bashing the 5d3!

100% is no big deal, but 25% is some huge thing??

 

[jrista]

How come when people compare the 5d3 to the 5d2 the 1 stop improvement is not a big deal. 1 stop = 100% better.

Then people compare the 5d3 to the D800 and maybe the d800 is 25% better than the 5d3 (not that it really is, just for arguments sake) people get all bent out of shape bashing the 5d3!

100% is no big deal, but 25% is some huge thing??

Well, I don't think people are comparing "whole cameras". Its more the comparison of the D800 DR. Since I don't care much for the Print DR measurements (I think they are overly skewed and blow the differences in the cameras well out of proportion), I use the Screen DR measurements (which just measure the RAW data as-is, and represent a better indication of what the actual hardware is capable of without any software scaling or other algorithmic enhancement skewing the results. Given that, the 5D III gets 10.95 stops of DR, while the D800 gets 13.23. That is a difference of 2.28 stops, or 100% then 100% again then another 28% on top of that. That is an unbelievable difference that has considerable significance.

It really does have to be taken in context, though. That difference ONLY exists AT ISO 100. At ISO 200 the difference drops to 1.69 stops, and at ISO 400 it drops to 1.05 stops. After that the differences are fairly negligible if they exist at all, and beyond ISO 1600 the 5D III does a bit better than the D800. The 5D III is a hell of a lot more than just a sensor as well, and a significant part of benefiting from the IQ the sensor has to offer is being able to get the shots you want. In that respect, the 5D III has more to offer than the D800 in a lot of respects, particularly for photographers who are already familiar with Canon's button layout and menu system.

Despite the DR difference (which really is something impressive on the D800, for sure), that is really only a factor for a few niche applications where the use of ISO 100 in high DR situations is necessary and possible. I'd say Landscape photographers who don't care what brand they use and are willing to switch and learn new firmware, button layouts, and ergonomics would benefit tremendously from the D800. Outside of that, I think most Canon photographers should be more than satisfied with the 5D III, it should feel great in their hands (if its anything like the 7D ergonomics...which are fantastic), especially if they shoot at ISO's other than 100 most of the time. Even Landscape photographers should feel comfortable getting a 5D III, as bit of ETTR should improve DR a bit and make shadow recovery more viable.

 

[smithy]

It's fascinating to watch these conversations. Generally, those who do not think the 5D is worth the money will NOT buy one.

I am undecided.

I do not have rental access to a Mark III, so my choice has to be based entirely on reviews, anecdotal information (forums, etc), price, and the 2 minutes I get to hold one in my local camera shop. So far the reviews have been okay, DxO results 'disappointing', price very high ($4200 where I live), opinion in this forum absolutely polarised, and my 2 minutes of holding one in the shop: pleasant.

You could rent one at a local camera rental shop and experience it first hand. If it's not for you then you'll know it, and if it is for you then you'll know it.

 

[LetTheRightLensIn]

if you're going to accuse dxomark of lying or purposedly skewing their results, please back that up with some proof, not just speculation

How about this review? http://www.techradar.com/reviews/cameras-and-camcorders/cameras/digital-slrs-hybrids/canon-eos-5d-mark-iii-1074186/review/page:5#articleContent

Seems very different than DXOs results while actually using their testing suite.

techradar doesnt know what they are doing

the results they get match only their own

 

[sarangiman]

if you're going to accuse dxomark of lying or purposedly skewing their results, please back that up with some proof, not just speculation

+100.

I just performed Stouffer Transmission Wedge tests with my 5D Mark III & a D7000. My numbers for DR match DXO's 'screen' numbers within a very small margin of error (~0.3EV).

I will try & post these results, with images & quantitation, soon on a blog.

But it would appear to me that DXO is legit. That doesn't change the fact that they should really explicitly enumerate their testing methodologies...

>2 stops DR between the 5D Mark III & D7000... no joke.

jrista & LTRLI-- I must say: thanks for getting me interested enough in all this to actually ascertain on my own, empirically, if DXO numbers make sense. I would conclude that they absolutely do.

But don't take my word for it-- I'd be happy to provide the RAW files from the 5DIII & D7000 of the wedge tests for you to evaluate for yourself.

 

[Fishnose]

Re: DxO results out for 5D3

Also for those who claim all the DxO charts and graphs are nonsense as all technical charts are since charts and numbers never have anything to do with reality see here, some rather clear demonstrations of reality by an excellent professional photographer (brace yourself though since Canon really has be totally dusted for low ISO image quality, and this guy is not a troll, he an established pro and a long time Canon shooter):
http://www.fredmiranda.com/5DIII-D800/index_controlled-tests.html

(to be fair if you shoot something where you don't need lots of MP and the scene doesn't have a wide difference between the bright and dark, then the difference won't matter at all)

Good grief! Fred's comparison is a total shocker for Canon. D800 is a generation ahead here.
Canon has a lot of work to do!!!! I hope they're working overtime in a big way.