Flake said:
I'm sorry Motorhead but that test isn't going to show real world results.
I agree, for more than one reason. First off, altering the exposure as suggeted in that article is not the best approach - the real question is the DR that can be captured in a single exposure. Motorhead, if you really went from +8 to -8 stops, bravo - you pretty much spanned the full range of shutter speeds (you'd have to have had a metered exposure of 1/15 or 1/30 s, and your longest exposure would have been 15 or 30 seconds).
It's true that even looking at a RAW file, you're getting 'mixed' data, or rather unmixed, in the sense that it's demosaiced and the different transmissivities of the windows in the Bayer array are already baked into the image (unless you're using more sophisticated software, e.g. Rawnalyze).
I do think that DR is usually measured badly by many testers. DxOMark does quite thorough tests, but their measurement of ~11-12 stops of DR for most Canon bodies is overstated, and real-world DR is less than that (at the dark end, they're quantifying noise as signal).
In practice, I see about 8.5 stops of useable DR with the 5DII, and about 8 stops with the 7D (at ISO 100, and DR drops a bit at high ISOs). That's less than DxO's claimed DRs, but more than motorhead's claimed 6ish stops. My data are based on testing with a backlit transmission step wedge, right side of the image frame bounded by the magenta line in this test setup:
I ran a set of exposures where the clear part of the step wedge (a
Stouffer 21-step wedge, where each step is 0.5 stops) was just shy of clipping, and the bare backlight was clipped. The DR tests were done with the goosenecks off, so the only light was the backlight for the wedge. 'Analysis' was qualitative, looking pixel values under the dropper in ACR, seeing where the steps could no longer be distinguished.
Overall, though, I think the key points are that DR could definitely be improved, and for starters it would be nice to see Canon getting somewhere near to utilizing the full 14-bit depth of their ADCs (DxOMark's optimistic measurements fall 2 stops short of that for Canon, whereas Nikon and Pentax 14-bit cameras deliver a full 14 stops of DR in DxOMark's tests).