dtaylor said:
qwerty said:
I do not think there is much disagreement that their sensor tests, methods, and results are accurate and meaningful (at least for some uses).
Yes there is. The biggest debate I've seen in other forums is over their DR scores which do not match the results from other testers (dpreview; IR) and do not seem to match real world experience. IMHO a simple Stouffer transmission step wedge test is far more accurate and reliable then DxO's methodology.
DxO also "interprets" DR based on output/viewing size, which is absurd to me.
Sorry, too long of a day for a fully coherent post, but:
If I am not mistaken, DPreview reports the dynamic range of processed jpegs, not of the raw files themselves. Basing the measurement on processed files means that the DR reported depends on the processing applied during conversion (which is why they have several different dynamic ranges reported for each camera at each ISO). (Also, the files they post for "raw" comparisons are obviously not really the raw files; I believe they are ACR conversions to jpeg from the raw files).
DxO's real business is making raw converters; they analyze the sensor outputs to optimizer their converters (which is why they look at the actual raw data, not processed images). They would tell you that the DxOmarks are just a side effect of their core business...
With regard to DxO's normalization, I think it would be absurd to compare non-normalized results. Normalization tells you how things will perform for a fixed print size (which is what most of us care about, as opposed to per-pixel values).
I checked their math a few years ago and they do it right (see
http://www.dxomark.com/index.php/Reviews/Detailed-computation-of-DxOMark-Sensor-normalization and check for yourself if you do not believe me).
Comparing non-resolution-normalized results for cameras with different sizes is akin of comparing prints of different sizes. It would be like comparing a 4x5 print from a 4 MP 1D with 8x10 from a 18 MP 1DX (from the same viewing distance)...
... ... ...
But, all that aside, if you just click the "screen" button when viewing the DxO results, they will happily give you the non-normalized values you want.