« on: March 23, 2013, 01:13:12 PM »
Yes "Lenses are a different matter" but lenses are an important part of a DSLR, no lens, no photo! -- no one is disputing DxO being a leading tester of sensors, however real world photography requires lenses, but when a "leading tester" like DxO easily screws up on testing lenses, I too wouldn't necessarily trust "the leading tester's opinion, especially when what I need is a Camera and a lens to take real world photos
On this we agree -- I don't give much weight to their opinions, but thankfully they do a good job at publishing their measurements which I can read and understand.
Your point that the sensor is merely part of the camera which is merely part of the camera system is understood and well taken. That is why we don't just have sensor benchmarks -- lens reviews (measurements and qualitative/subjective reviews) as well as reviews of the bodies themselves (both the dpreview approach and more subjective testing) all factor into appraising gear.
So I'm not trying to say that the sensor is everything, but I am pointing out that DxO do a pretty good job at benchmarking sensor performance. I also find hard cold numbers to be a refreshing alternative to exaggerated claims from manufacturers, fans, or new users trying to justify their purchase after the fact (instead of doing due diligence before the fact).
However, I do engage in arguments with people who keep insisting that everyone must accept the DxO test results as the absolute fact
Well, their measurements (unlike exaggerated claims from fans) are at least objective. You can argue about what the measurements mean (but even that requires some understanding, um, of what the measurements mean)
As I said before, a good image requires a camera and lensthis we agree on
when companies like DxO or any other company gives out highly questionable test results, I do not necessarily refer to them as "objective".
I don't see how this is related to the first point. Regarding questionable test results, it's not at all clear that DxO's all-over-the-map lens numbers point to any bias (lots of variance but not much bias! but it does shed some light on why their lens tests don't have the same stature as their sensor benchmarks). It's like seeing a leading quarterback play a bad golf game and then wonder if they really are a good quarterback. DxO's sensor benchmarks and methods have been studied and analyzed ad-nasueum and have stood up to scrutiny pretty well.