September 23, 2014, 06:31:38 AM

Author Topic: DxOMark vs. Reality  (Read 79343 times)

neuroanatomist

  • CR GEEK
  • ********
  • Posts: 14466
    • View Profile
DxOMark vs. Reality
« on: October 09, 2012, 09:13:17 AM »
There are lots of posts about DxOMark, lots of support, lots of bashing, some of it fact-based, much of it hearsay and knee-jerk reaction.  There are many posts about sales figures, generally fewer than about DxOMark, and generally with even less of them with real facts.

So...let's do a little reality check, about the past 5 years in DxOMark-land and the past 5 years in the real world.

The year is 2007.  Nikon has the D3 as a flagship and the D300 as the prosumer APS-C body.  Canon has the 1DsIII and D40, respectively.  DxOMark scores the D3 as 81, the 1DsIII as 80 - a meaningless difference, by their standards.  The D300 scores a 67, while the 40D scores a 64 - that is starting to look like a real difference. 

2008 saw Nikon enter the 'affordable' FF market with the D700, which DxOMark scores an insignificant 1 point higher than Canon's 5DII at 80 vs. 79.  2009 had updates to the high-end prosumer APS-C segment, and Nikon's D300S scores a 70, while Canon's 7D scores a 66.  2010 brought us mid-range APS-C updates, and while the 60D with the 7D's sensor scores a 66, the D7000 scores an 80, beating Canon's then-current FF sensors.

This year, the somewhat-less-affordable FF battle continues, with the 5DIII scoring 81, barely better than it's predecessor, while the D800/E scores a very impressive 95/96, soundly beating all Canon cameras as well as every other sensor DxOMark has ever tested, including medium format bodies with sensors with 2.5-times larger sensors.

So, it seems quite clear that over the past 5 years in DxOMark-land, Nikon has been dramatically improving, Canon has been stagnating, and Nikon is way ahead.  But that's DxOMark-land.  What about the real world?

Canon and Nikon are publicly traded companies, and as such, they publish their annual and quarterly reports (in the Investor Relations sections of their corporate websites).  IDC (a market analysis firm) also publishes annual summaries of the market as a whole.

In 2007, Canon had 43% of the dSLR market, Nikon had 40%.  In 2010, Canon had 44.5% of the dSLR market, Nikon had 29.8%.  So, over years while Nikon was bringing us better sensors than Canon, Nikon was losing market share while Canon was gaining it.  Ok, fine, but that's 2010.  What about this year?

In 2Q2012 (by calendar year, they report it as 1QFY2013), Nikon had an 18% y/y growth of unit sales of dSLRs and lenses.  In 2Q2012, (they report by CY, not FY), Canon had a 47% y/y growth of unit sales of dSLRs and lenses.

So, DxOMark has said Nikon has had better sensors for years, and the sales data show that Canon has sold more dSLRs and lenses for those same years, and continues to do so, as of the most recent data available.  The straightforward conclusion from the above is that while DxOMark's Scores have a huge impact on the number of inflammatory posts on Internet discussion boards, they have no meaningful impact on the real world aggregate buying decisions of consumers.
EOS 1D X, EOS M, and lots of lenses
______________________________
Flickr | TDP Profile/Gear List

canon rumors FORUM

DxOMark vs. Reality
« on: October 09, 2012, 09:13:17 AM »

Mt Spokane Photography

  • Canon EF 600mm f/4L IS II
  • ********
  • Posts: 8691
    • View Profile
Re: DxOMark vs. Reality
« Reply #1 on: October 09, 2012, 12:59:19 PM »
Part of this is because lenses play a very important role in photography, and Nikon has lagged behind with FF lenses.  They have very few really good lenses, their 14-24 being the best example followed by their new 85mm f/1.4.  Their 24-70mm has horible CA, their 70-200mm is very good.  There are a ton of "D" lenses that are good, but no one seems to want them, and they do not have coatings that are well suited to digital.

Then, Nikon nothing that matches Canons 24-105mm L, 135mmL, or 100-400mmL much less the Canon 400mm f/5.6. 

Nikon has been cranking out new low cost DX lenses as though the lens side does not believe FF is the way to go. I get the feeliing that they do not have a coordinated plan.  If they are bring excellent new FF bodies to the market while developing DX lenses, customers like me who went out and bought a D800 and 24-70 f/2.8, 80-200mm f/2.8, 200-400mm f/4 and discovered that I'd have to buy a Sigma lens if I wanted a decent low cost 400mm lens that could not match the older Canon designs, and found nothing to match my favorite Canon lenses.  I finally sold the body and the lenses, and bought another new Canon body.
The Nikon lens prices are generally too high for what you get.
Its a shame, but Nikon does seem to be struggling, and I'd credit their being behind in good lens availability at low prices for a big part of it.

With Sigma agressively churning out ever new and improved lens designs, I'd think this helps Nikon but buyers generally prefer to stick with OEM lenses.
« Last Edit: October 09, 2012, 01:17:40 PM by Mt Spokane Photography »

PackLight

  • Guest
Re: DxOMark vs. Reality
« Reply #2 on: October 09, 2012, 01:11:13 PM »
Neuro your post could have been sumed up in just a few words.

"Canon Glass Rules"

We can debate the sensors of the day and in a few months the conversation will change, but in 8 years we will still be debating the same glass. Maybe in those 8 years Nikon will come up with some glass worthy of a debate.

bornshooter

  • 5D Mark III
  • ******
  • Posts: 703
  • Love L series glass
    • View Profile
    • my flickr
Re: DxOMark vs. Reality
« Reply #3 on: October 09, 2012, 01:20:00 PM »
DXO mark means nothing to me... i will say glass is what matters and canon's ef range of lenses are untouchable they just make my mouth water i want them all but i will need to sell my girlfriend lol

Mt Spokane Photography

  • Canon EF 600mm f/4L IS II
  • ********
  • Posts: 8691
    • View Profile
Re: DxOMark vs. Reality
« Reply #4 on: October 09, 2012, 01:28:35 PM »
DXO mark means nothing to me... i will say glass is what matters and canon's ef range of lenses are untouchable they just make my mouth water i want them all but i will need to sell my girlfriend lol
Could you post a photo (of her) :)

well_dunno

  • 7D
  • *****
  • Posts: 356
    • View Profile
Re: DxOMark vs. Reality
« Reply #5 on: October 09, 2012, 01:34:40 PM »
Regarding the glass, DxO is probably the only source that suggests 70-200 f/2.8 IS mkII is less sharp than mark I (suggesting mkII is better in the center but overall mkI is better, if my memory is not failing me). I do not think that affected the 70-200 f/2.8 mkII sales either, rather the effect was on the credibility of the DxO...

Cheers!

willis

  • Rebel T5i
  • ****
  • Posts: 108
    • View Profile
Re: DxOMark vs. Reality
« Reply #6 on: October 09, 2012, 01:40:49 PM »
Regarding the glass, DxO is probably the only source that suggests 70-200 f/2.8 IS mkII is less sharp than mark I (suggesting mkII is better in the center but overall mkI is better, if my memory is not failing me). I do not think that affected the 70-200 f/2.8 mkII sales either, rather the effect was on the credibility of the DxO...

Cheers!
And I've always heard that MK2 is superb sharp even sharper than MK1.
EOS 7D

canon rumors FORUM

Re: DxOMark vs. Reality
« Reply #6 on: October 09, 2012, 01:40:49 PM »

lfg530

  • Guest
Re: DxOMark vs. Reality
« Reply #7 on: October 09, 2012, 01:57:43 PM »
Neuro your post could have been sumed up in just a few words.

"Canon Glass Rules"

We can debate the sensors of the day and in a few months the conversation will change, but in 8 years we will still be debating the same glass. Maybe in those 8 years Nikon will come up with some glass worthy of a debate.


Seriously? Their 24-70 is really great, way better than the mk1 was. Their 1.4 primes are about as good as the canons are (the canon 24 is excellent tough). Both 70-200 are great. Nikon recently came out with 3 new 1.8g lenses that are awesome and affordable... We're still not talking about the 14-24 or the ridiculous amount of old F mount lenses (e.g the 135 DC or the 55 micro) that are still awesome pieces of glass. Yes Canon also has great glass and some lenses that don't have good nikon counteparts, but nikon is not out of the game in that regard.

I'm really having a problem seeing where the nikon glass is unworthy outside of a fanboy perspective.

PackLight

  • Guest
Re: DxOMark vs. Reality
« Reply #8 on: October 09, 2012, 02:10:52 PM »
Neuro your post could have been sumed up in just a few words.

"Canon Glass Rules"

We can debate the sensors of the day and in a few months the conversation will change, but in 8 years we will still be debating the same glass. Maybe in those 8 years Nikon will come up with some glass worthy of a debate.


Seriously? Their 24-70 is really great, way better than the mk1 was. Their 1.4 primes are about as good as the canons are (the canon 24 is excellent tough). Both 70-200 are great. Nikon recently came out with 3 new 1.8g lenses that are awesome and affordable... We're still not talking about the 14-24 or the ridiculous amount of old F mount lenses (e.g the 135 DC or the 55 micro) that are still awesome pieces of glass. Yes Canon also has great glass and some lenses that don't have good nikon counteparts, but nikon is not out of the game in that regard.

I'm really having a problem seeing where the nikon glass is unworthy outside of a fanboy perspective.

Thats funny, lets go back to talking about sensors. That way the Nikonians can particapate in the conversation.

Gothmoth

  • Guest
Re: DxOMark vs. Reality
« Reply #9 on: October 09, 2012, 02:12:15 PM »
why should i, as photographer, care about how well nikon or canon sells?

even as a shop owner i don´t care about THEIR numbers.. i care about MY numbers.

as a customer i care what the camera offers me for my money... nothing more nothing less.

canon can outsell nikon 10x times.. that will still not make their current lineup better.

PackLight

  • Guest
Re: DxOMark vs. Reality
« Reply #10 on: October 09, 2012, 02:17:09 PM »
why should i, as photographer, care about how well nikon or canon sells?

even as a shop owner i don´t care about THEIR numbers.. i care about MY numbers.

as a customer i care what the camera offers me for my money... nothing more nothing less.

canon can outsell nikon 10x times.. that will still not make their current lineup better.

The shop owner point is an interesting one.

The local shop pushes Nikon. I asked why, what the owner told me is that Canon controls what he can sell his lenses and cameras for. He gets a bigger margin out of selling Nikon's.

After the purchase they push the off brand lenses even harder because the margin is greater. There is one color that Nikon processes better than Canon, and keeps them in the game. It is green.

Chewy734

  • EOS M2
  • ****
  • Posts: 238
    • View Profile
Re: DxOMark vs. Reality
« Reply #11 on: October 09, 2012, 02:45:40 PM »
That is interesting...  my local AD has lots of banners and large signs outside their storefront...  all are Nikon, none are Canon.  Inside the two biggest display shelves are Nikon and Canon.  Every time I have gone in (probably a couple times a week, to once a month), I've never seen anyone actually buy anything Nikon.  But, I've seen a lot of people buy Canon gear.  I'm not saying that they aren't selling a lot of Nikon gear, because I'm sure they are, but those are just my observations.

I once asked the rental section of the store a similar question...  what do you rent out more often?  The answer was Canon equipment 3x as often.  Actually, Nikon was only rented slightly more often than Mamiya, Leaf, and the Hassys.  In fact Zeiss lenses were more often rented than Nikon lenses.

What's interesting is that when I went to the Browns game last month, there were only two photographers shooting Nikon.  The other dozen were shooting Canon.  Why?

But then, last year I went to Belize for vacation.  While walking around, going on excursions, etc, I did not see one other Canon...  not one...  not even a tiny PowerShot.  All I saw were Nikon dSLRs, compacts, etc.  I was the only one I saw shooting with my Canon (5D2 at the time).

So, what's this all mean?  Who knows.

lfg530

  • Guest
Re: DxOMark vs. Reality
« Reply #12 on: October 09, 2012, 02:46:46 PM »
Neuro your post could have been sumed up in just a few words.

"Canon Glass Rules"

We can debate the sensors of the day and in a few months the conversation will change, but in 8 years we will still be debating the same glass. Maybe in those 8 years Nikon will come up with some glass worthy of a debate.


Seriously? Their 24-70 is really great, way better than the mk1 was. Their 1.4 primes are about as good as the canons are (the canon 24 is excellent tough). Both 70-200 are great. Nikon recently came out with 3 new 1.8g lenses that are awesome and affordable... We're still not talking about the 14-24 or the ridiculous amount of old F mount lenses (e.g the 135 DC or the 55 micro) that are still awesome pieces of glass. Yes Canon also has great glass and some lenses that don't have good nikon counteparts, but nikon is not out of the game in that regard.

I'm really having a problem seeing where the nikon glass is unworthy outside of a fanboy perspective.

Thats funny, lets go back to talking about sensors. That way the Nikonians can particapate in the conversation.

Nice to see you're open minded and bringing proof to the conversation; you don't seem to be a mindless Canonian at all.

Just sayin': I'm the proud owner of a 7d and macro 100L wich I loove, I tried several canon primes and L zooms and most of them were great, but I also compared to equivalents in nikon and their glass has nothing to be ashamed of. It's really cute to see some of you guys acting like canon glass is like an affordable leica kind of thing, but it's not and nikon is serious competition in that matter (at least for what I tested MYSELF and any review site you'll find that compare both).

canon rumors FORUM

Re: DxOMark vs. Reality
« Reply #12 on: October 09, 2012, 02:46:46 PM »

bvukich

  • Spam Assassin
  • Administrator
  • 5D Mark III
  • *****
  • Posts: 731
    • View Profile
    • My (sparse) ZenFolio Site
Re: DxOMark vs. Reality
« Reply #13 on: October 09, 2012, 03:04:58 PM »
But then, last year I went to Belize for vacation.  While walking around, going on excursions, etc, I did not see one other Canon...  not one...  not even a tiny PowerShot.  All I saw were Nikon dSLRs, compacts, etc.  I was the only one I saw shooting with my Canon (5D2 at the time).

So, what's this all mean?  Who knows.

It's Ashton Kutcher... he's so dreamy...

 :P

PackLight

  • Guest
Re: DxOMark vs. Reality
« Reply #14 on: October 09, 2012, 03:10:05 PM »
Neuro your post could have been sumed up in just a few words.

"Canon Glass Rules"

We can debate the sensors of the day and in a few months the conversation will change, but in 8 years we will still be debating the same glass. Maybe in those 8 years Nikon will come up with some glass worthy of a debate.


Seriously? Their 24-70 is really great, way better than the mk1 was. Their 1.4 primes are about as good as the canons are (the canon 24 is excellent tough). Both 70-200 are great. Nikon recently came out with 3 new 1.8g lenses that are awesome and affordable... We're still not talking about the 14-24 or the ridiculous amount of old F mount lenses (e.g the 135 DC or the 55 micro) that are still awesome pieces of glass. Yes Canon also has great glass and some lenses that don't have good nikon counteparts, but nikon is not out of the game in that regard.

I'm really having a problem seeing where the nikon glass is unworthy outside of a fanboy perspective.

Thats funny, lets go back to talking about sensors. That way the Nikonians can particapate in the conversation.

Nice to see you're open minded and bringing proof to the conversation; you don't seem to be a mindless Canonian at all.

Just sayin': I'm the proud owner of a 7d and macro 100L wich I loove, I tried several canon primes and L zooms and most of them were great, but I also compared to equivalents in nikon and their glass has nothing to be ashamed of. It's really cute to see some of you guys acting like canon glass is like an affordable leica kind of thing, but it's not and nikon is serious competition in that matter (at least for what I tested MYSELF and any review site you'll find that compare both).

It doesn't take long to see where Nikon is lacking. Just consult the ISO charts. There are sites that give you the side by side. No Lecia comparison, just side by side Nikon vs Canon.
Case in point, 6D vs the D600. Comparable offerings right?
Compare the kit lenses that will be offered with both cameras. Nikon gives you a better sensor, Canon does it with better glass. In three years the bodies are old news, obsolete by gear head standards. At that point who is ahead, Canon or Nikon? It seems the sensor race goes back and forth. Good Glass is Good Glass no matter which sensor is better.

canon rumors FORUM

Re: DxOMark vs. Reality
« Reply #14 on: October 09, 2012, 03:10:05 PM »