Here we go again: 5DIII vs. D800 raw files head-to-head

Status
Not open for further replies.
yunusoglu said:
The thing I don't get is; what exactly does the 5D3 have that the D800 doesn't? Apart from the $3500 price tag of course...

I've taken a good look at ISO3200 images and the D800 is clearly superior at all noise reduction settings. At base ISO there's no competition of course... So, what exactly are we talking about?

This is no situation that Canon and Nikon have focused on different stuff and these are two different cameras aiming at different types of photographers. The situation is; the cheaper camera is better than the more expensive one except for the differences of 2fps bust speed and number of AF points.

If the 5D3 was priced around $2500, I could go with that. I'd say the D800 was a bit better but the 5D3 was a bit cheaper but there's nothing and absolutely nothing with the 5D3 that I can justify Canon's move.

I had a good look from 3200 and up to 25k... The nikon starts to fall apart in the shadow detail before canon... At 3200 its very close, which I will give you... the 6400 is actually more telling, but when you upsize the 5d3 or downsize the D800 to match, it may be pretty close. Beyond 6400 canon has a clear advantage and I would say, with the raws, canon appears not to have a 2 stop advantage, but maybe a 1.3 stop advantage where nikons 25k looks worse than canons 51k but better than canon's 104k, but that's in part thanks to the sensor size.

If your looking purely on image quality, it may or may not be worth your upgrade, but as the overall camera goes, it's almost in a different class compared to the 5d2, which I'm intrigued with.
 
Upvote 0
PhilDrinkwater said:
jrista said:
unkbob said:
I have a 5D2 and a 5D3 on order, and I'm not about to switch to Nikon. But damn, those ISO 100 images from the D800 make the 5D3 look like a toy. They look more like medium format quality. The colours are just night and day, looking at them on a wide gamut monitor. Ok, I only checked out the jpegs but the 5D files are over sharpened and subtle as a brick in comparison. Even the high ISO files are decent on the D800 and more honest than the heavily NR Canon images. I'm annoyed that Canon is adding noise reduction to the RAWs (I downloaded some RAWs yesterday, before the D800 files were up), because it stops us from squeezing every last drop of detail out of them in post.

The 5D3 is more than good enough for my purposes - mostly weddings (stills + video). And the features / usability are great. But well done Nikon!

Sorry, but Canon has NEVER added NR to their RAWs.
From a recent interview with Chuck W:

AH: The EOS 5D Mark II was considered the benchmark of overall image quality in the Canon lineup. Apart from improvements in noise reduction by DIGIC5+ processor, what improvements has Canon made to the CMOS image sensor itself relative to the 5D Mark II?

CW: Three main areas of image quality-related improvement on the EOS 5D Mark III image sensor compared to the EOS 5D Mark II are:

· Gapless Microlenses: This feature increases the amount of light received by each photodiode compared to the gapped microlenses used on the 5D Mark II’s image sensor.

· New Photodiode Structure: The photoelectric conversion rate of each photodiode has been improved.

· On-Chip Noise Reduction: Canon’s proprietary technology in this area, which was first shown on the EOS D30 Digital SLR in the year 2000, has steadily improved over the years.

http://www.arihazeghiphotography.com/AH_CW_interview/

While I would generally agree and hope he's right, dont ever forget he is trying to sell the camera... He's not going to say... eh... yeah... we dropped the ball and it isn't as good as the 5d2... He's going to promote the heck out of the camera, which he is. BUT, I do agree the camera is a very impressive tool and I cant wait till they start shipping so I can get mine.
 
Upvote 0
PhilDrinkwater said:
jrista said:
unkbob said:
I have a 5D2 and a 5D3 on order, and I'm not about to switch to Nikon. But damn, those ISO 100 images from the D800 make the 5D3 look like a toy. They look more like medium format quality. The colours are just night and day, looking at them on a wide gamut monitor. Ok, I only checked out the jpegs but the 5D files are over sharpened and subtle as a brick in comparison. Even the high ISO files are decent on the D800 and more honest than the heavily NR Canon images. I'm annoyed that Canon is adding noise reduction to the RAWs (I downloaded some RAWs yesterday, before the D800 files were up), because it stops us from squeezing every last drop of detail out of them in post.

The 5D3 is more than good enough for my purposes - mostly weddings (stills + video). And the features / usability are great. But well done Nikon!

Sorry, but Canon has NEVER added NR to their RAWs.
From a recent interview with Chuck W:

AH: The EOS 5D Mark II was considered the benchmark of overall image quality in the Canon lineup. Apart from improvements in noise reduction by DIGIC5+ processor, what improvements has Canon made to the CMOS image sensor itself relative to the 5D Mark II?

CW: Three main areas of image quality-related improvement on the EOS 5D Mark III image sensor compared to the EOS 5D Mark II are:

· Gapless Microlenses: This feature increases the amount of light received by each photodiode compared to the gapped microlenses used on the 5D Mark II’s image sensor.

· New Photodiode Structure: The photoelectric conversion rate of each photodiode has been improved.

· On-Chip Noise Reduction: Canon’s proprietary technology in this area, which was first shown on the EOS D30 Digital SLR in the year 2000, has steadily improved over the years.

http://www.arihazeghiphotography.com/AH_CW_interview/

On-chip noise reduction is a different thing, and as far as I know, all CMOS image sensors for the last 10 years or so have at least used something like correlated double samping to reduce noise at the pixel level when reading. That is NOT the same thing as normal "noise reduction" that muddies detail, which is performed after digital sampling and uses some form of wavelet deconvolution which, when its cranked high enough, DOES diminish detail.

Hardware level noise reduction features are exactly what we WANT. Its far cleaner, as it works at the pixel and row/column level to remove dark current noise, horizontal and vertical FPN, and variance in transistor efficiency, etc. such that when a pixel is read, the purest form of that pixel propagates along the hardware pixel processing pipeline to the ADC. Its because of those types of Noise Mitigation that Sony sensors (who has patents on several forms, where as Canon only seems to use a variant of CDS) perform better than Canon sensors in low ISO DR...its not the reason either camera loses detail at high ISO/long exposure.
 
Upvote 0
awinphoto said:
If your looking purely on image quality, it may or may not be worth your upgrade, but as the overall camera goes, it's almost in a different class compared to the 5d2, which I'm intrigued with.

Very true. IQ aside, the dual card slots, weather sealing, and vastly improved AF and FPS make is a much more versatile tool, and much better suited for professional use. IMHO, the 5D line has been an experiment in progress for Canon. If you think back to 2005 when the 5DC was announced, it was a game changer. Full-frame bodies were the holy grail of DSLRs back then, and the only option up until that point were $7-$8K 1-series bodies. Full-frame bodies were big bucks, bulky and simply inaccessible for most photogs. No one dreamed the day would ever come when you could buy a small-form, full-frame body for $3,300. It was a stunning move to say the least.

That said, I think Canon has always viewed the 5D line as a consumer grade product even up until the MKII, and the build quality and feature set has reflected this sentiment. Perhaps Canon underestimated how popular the 5D line would prove to be, but I think the number of 5Ds used professionally far exceeded its expectations. As such, Canon has integrated many pro-grade features into the 5DIII that people have been demanding for a long time.

Sure, Nikon has developed an amazing camera in the D800 for $500 less - and I'm very grateful that competition like this puts pressure on Canon to up its game - but that doesn't change the fact that the 5DIII has many improved features over it's predecessor that I'll put to great use on every single shoot.
 
Upvote 0
This goes in the face of peoples argument that Canon or nikon or sony or whatever doesn't listen to their customers... What did people complain about the 5d2? AF, build, high ISO, enough MP, dual cards, etc... what did canon do? Pro AF, better weathersealing than the 7D if you go by their word, ISO up to 104k, 22MP, 2 cards, electronic level, etc... same with the 7d... it built upon the xxd series, just like customers wanted, and stood up against the D300 series and for the most part, took control of that class. They do listen, you just need to know who to complain/talk to...

FYI, it's not by posting on Canon Rumors :D :D :D :D
 
Upvote 0
jrista thanks for clarifying the noise reduction in RAWs confusion.

My point about the one brand's glass being better than the other was that one brand's set of lenses may suit one individual better, and vice versa.

Re: the comment about shooting the 24/1.4 II at f/8 or f/11 in order to avoid vignetting... why would you buy a $1600 prime to shoot it at f/11? 3-stops of vignetting in the corners is like the difference between ISO 800 & ISO 6400... so sure I take care of it in post... but hello banding/noise in the corners then (at least when shot with a 5D)!

The point that you can still make images work with these limitations is well taken. But there's nothing wrong with attempting to optimize your system so you can spend more time thinking about the pictures, not the tech.
 
Upvote 0
There seem to be a lot of people claiming that while the D800 has higher resolution & DR, the 5DIII holds up better at higher ISOs.

I have to wonder if that's some sort of desire to at least give the 5DIII some advantage in terms of image quality. And honestly I would've expected better ISO performance for the 5DIII given the higher inherent SNR of each pixel, which should decrease shot noise. But maybe read noise (higher for Canon?) has that much of an effect...

Because if you look here:
http://cl.ly/F1ud/5DIII_vs_D800-ISO25600.png

And here:
http://cl.ly/F2Ui/5DIII_vs_D800-ISO25600-2.png

... I don't see any difference between the two cameras at ISO 25,600. Note both RAWs were opened in ACR 6.7, identical settings, then D800 was downsized to 5760px horizontal (same as 5DIII) using 'Bicubic' (not sharper, not smoother).

Please view images at 100%. They're 100% crops.

If anything, the D800 looks a little cleaner to me but, really, it's a wash.

Minus the fact that D800 has better resolution & DR.

P.S. I find downsizing the D800 image to be the most relevant for ISO comparisons, b/c the 5DIII has the advantage of larger pixels, so the D800 should be given the advantage of 'software binning' of pixels to determine ISO performance vs. the 5DIII for the same size image.
 
Upvote 0
sarangiman said:
jrista thanks for clarifying the noise reduction in RAWs confusion.

Welcome. :)

[/quote]
Re: the comment about shooting the 24/1.4 II at f/8 or f/11 in order to avoid vignetting... why would you buy a $1600 prime to shoot it at f/11? 3-stops of vignetting in the corners is like the difference between ISO 800 & ISO 6400... so sure I take care of it in post... but hello banding/noise in the corners then (at least when shot with a 5D)!
[/quote]

So, yes, thats true...under certain circumstances. Remember, there are a total of 12 stops of harware-level DR capability we have to work with (assuming zero improvement over 5D II). Lets say you expose at a good level...without ETTR, such that your center lens is at around 10 stops of exposure from a DR perspective, and your corners are at about 7 stops of exposure. Dynamic range in Canon cameras is weighted towards the highlights, rather than the shadows...so even at "only" 7 stops of exposure in the corners, your SNR is WAY above the level where banding would occur.

For even four stops of vignetting (which is what you get in the extreme corners of the 24/1.4 II @ f/1.4 (very minimal area of the frame) you would have to expose the center to only about 5-6 stops of DR (less than half maximum saturation) such that pulling up the corners would exhibit banding noise. Even then...it would really only exhibit in the marginal corners...the rest of the frame would be fine.

But here is the rub...if thats the BEST exposure you could take with a 24mm f/1.4 lens wide open, then your using the wrong ISO. You probably need to crank ISO up by a few stops to get your center-lens exposure "correct" for the scene (fyi, I'm kind of assuming at least a well-lit scene with artificial lighting, which is somewhat dim in the grand scheme of things, and obviously a scene lit with sunlight would be even better...but then you wouldn't actually need f/1.4.) The moment you get past ISO 400, banding noise stops being an issue since you lose DR on both ends of the scale (although more in the highlights), and your minimum black level is above the Canon noise floor to start with. At that point, you should be able to recover the corners, albeit with increased random noise, but with little to no concern that you'll be extracting FPN or banding noise from the deep shadows.

As I've mentioned before (btw, this is not directed specifically at you, sarangiman), even if the 5D III exhibits FPN and banding noise as bad as the 5D II (which I highly doubt...it looks like some vertical banding is still an issue, although Canon claims its been mitigated considerably), the chances of you actually running into problems with it are rather slim unless you are one of the unique types that purposely only shoot at ISO 100 even when its inappropriate due to some misguided idea that its the only way to get more DR. (Realistically, if you can't fully saturate at ISO100, your always better off using a higher ISO, otherwise your wasting highlight DR and therefor not actually gaining the benefit of better maximum possible DR at ISO 100.) Unless you are exposing incorrectly more often than not, it should be the far rarer case that you actually need to extract immeasurable amounts of detail from deep shadows...even if 4-stops of vignetting are in play. When the occasion strikes that you really DO have to use ISO 100 to capture maximum DR...remember that Canon tends to favor more DR in the highlights rather than shadows...and you can push exposure to the right pretty far before you actually clip (assuming other exposure setting requirements don't limit you..and if they do, a higher ISO is again the better option.) That improves your shadow recovery...sometimes considerably, and the difference between Nikon (which would certainly require less effort for the same gain) and Canon shrinks.
 
Upvote 0
sarangiman said:
There seem to be a lot of people claiming that while the D800 has higher resolution & DR, the 5DIII holds up better at higher ISOs.

I have to wonder if that's some sort of desire to at least give the 5DIII some advantage in terms of image quality. And honestly I would've expected better ISO performance for the 5DIII given the higher inherent SNR of each pixel, which should decrease shot noise. But maybe read noise (higher for Canon?) has that much of an effect...

Because if you look here:
http://cl.ly/F1ud/5DIII_vs_D800-ISO25600.png

And here:
http://cl.ly/F2Ui/5DIII_vs_D800-ISO25600-2.png

... I don't see any difference between the two cameras at ISO 25,600. Note both RAWs were opened in ACR 6.7, identical settings, then D800 was downsized to 5760px horizontal (same as 5DIII) using 'Bicubic' (not sharper, not smoother).

Please view images at 100%. They're 100% crops.

If anything, the D800 looks a little cleaner to me but, really, it's a wash.

Minus the fact that D800 has better resolution & DR.

P.S. I find downsizing the D800 image to be the most relevant for ISO comparisons, b/c the 5DIII has the advantage of larger pixels, so the D800 should be given the advantage of 'software binning' of pixels to determine ISO performance vs. the 5DIII for the same size image.

On my screen, which is calibrated, the D800 image seems to have brighter noise, and its a bit more tightly packed. The thing that stands out about the D800 vs. the 5D III image, though, is the bit of banding in the D800. Its most visible in the darkest parts of the image, such as the lower left area of the beer bottle, and the black mug. In the 5D III, the only "artificial" noise artifacts I could find were two fairly obvious diagonal lines of noise in the black mug. I am not sure if that is some kind of funky FPN noise or what...never seen anything like that before. I was inclined to say the 5D III color noise, which tends to be rather blotchy, was worse...but it seems the D800 has the same stuff, its just that it exhibits more in the blues on Nikon than in the red. Outside of that, the 5D III noise is more pleasingly random than the D800 noise at this ISO setting.


BTW, is there any chance you could overlay those suckers with "difference" blending in Photoshop? Additionally, I'd be curious to see the same image for each camera, but one stop lower (12800), overlaid with "difference" blending on top of the correlated brands 25600 image. I'm curious to see if that demonstrates any "unnatural" noise types like fpn/banding better.
 
Upvote 0
jrista: Fair points, but that's a lot of thinking to be doing when shooting people or events :) For example, here's a 24/1.4 II shot of mine at f/1.8:

SunsetWarrior.jpg


ISO 400, 1/6400s, on a 5DC.

Any more exposure and I may have blown some highlights (this already has a lot of highlight recovery done for the area where the sunset was brightest). What might you have done differently?

Regardless of what you may have done differently, in this sort of (faster paced) shooting scenario it's a little harder to calculate how to get the best DR and room for error is extremely appreciated.

Granted, in this particular shot, the corners aren't too noisy, but in other shots from this set (particularly at f/1.4), noise is definitely visible after vignetting correction.

Good points about maximizing DR by ETTR with Canon. I do that often. But for example last week I was shooting moonrise behind some peaks around Mt. St. Helens at 200mm focal length, where grad ND filters are practically useless (even hard edged ones). B/c of clouds obscuring the moon a bit, I was so close to nailing the shot without HDR. But banding was too evident when raising the shadows, and I was exposed as far to the right as I could go without blowing stuff out (Highlight recovery really helped recover detail of the clouds right in front of the moon, which looked blown out upon importing).

Granted, one should just use HDR in this scenario, but, often that's hard w/ the moon b/c the exposure difference is so huge that when you blend with a proper shadow exposure, the falloff of light around the moon is just too much, necessitating cloning a whole bunch of sky around the moon to not have a huge halo. Yes it's possible, but man it'd be much easier with more DR.
 
Upvote 0
sarangiman said:
jrista: Fair points, but that's a lot of thinking to be doing when shooting people or events :) For example, here's a 24/1.4 II shot of mine at f/1.8:

... image clipped ...

ISO 400, 1/6400s, on a 5DC.

Any more exposure and I may have blown some highlights (this already has a lot of highlight recovery done for the area where the sunset was brightest). What might you have done differently?

Regardless of what you may have done differently, in this sort of (faster paced) shooting scenario it's a little harder to calculate how to get the best DR and room for error is extremely appreciated.

Granted, in this particular shot, the corners aren't too noisy, but in other shots from this set (particularly at f/1.4), noise is definitely visible after vignetting correction.

Great shot! :) Love the colors. I wouldn't have done anything different, honestly. ETTR is something you do when you can, not all the time. Also, there is certainly going to be noise...nothing you can do about that. There are LOTS of things that cause noise, but the mere presence of it was not what I was referring to. Its specifically banding and fixed pattern noise that should be rare. Even with Canon's "high" read noise, were still talking at most around 25 electrons (assuming zero improvement over the 5D II, which I believe is unlikely...we'll probably see 16 at worst and around 8 if Canon did well.) The well capacity of a 5D III photosite is in the tens of thousands of electrons...so even 25 electrons of read noise would mean you have to pull EXTREME shadows to get any real problems with non-random noise forms given Canon's higher black point (2048 rather than 1024 as it was with the 5D II.)

sarangiman said:
Good points about maximizing DR by ETTR with Canon. I do that often. But for example last week I was shooting moonrise behind some peaks around Mt. St. Helens at 200mm focal length, where grad ND filters are practically useless (even hard edged ones). B/c of clouds obscuring the moon a bit, I was so close to nailing the shot without HDR. But banding was too evident when raising the shadows, and I was exposed as far to the right as I could go without blowing stuff out (Highlight recovery really helped recover detail of the clouds right in front of the moon, which looked blown out upon importing).

Granted, one should just use HDR in this scenario, but, often that's hard w/ the moon b/c the exposure difference is so huge that when you blend with a proper shadow exposure, the falloff of light around the moon is just too much, necessitating cloning a whole bunch of sky around the moon to not have a huge halo. Yes it's possible, but man it'd be much easier with more DR.

The scenario you outlined wouldn't be much different, even with two extra stops of DR. Compared to the nighttime landscape, the moon is well more than two stops brighter than maximum DR. Even if you did have 14 stops rather than 12, if you expose for the moon, the vast bulk of the landscape is going to be very near the noise floor of either Canon or Nikon cameras. I would actually prefer less noisy electronics even if I did not gain any DR for that particular scenario. At least with Nikon, you have the ability to recover something...however useless it may be...where as with Canon all you could really recover is blotches of landscape scattered around amongst undesirable noise patterns. That could very well even be the case with a Canon sensor WITH 14 stops of DR, still limiting your recoverability (Given the option, I'd take a Canon 12 stop sensor with no noisy electronics over a Canon 14 stop sensor with noisy electronics.) Either way, 14 stops of clean DR or not, you can never really get that shot with one exposure. You would likely have to do "lighter" layer blending in with a bit of masking to get both the landscape and the moon (or Exposure Fusion...and if that didn't work, maybe some more complicated manual blending...and only as an absolute LAST resort would I personally use HDR. HDR is just too much of a pain and produces its own artifacts like halos to really be of use there.)
 
Upvote 0
If we are discussing the high-ISO performances of these two cameras, then it's already over for the 5D3...
Mr. Chuck Westfall, I'm sorry but, where exactly is the advantage of having 22MP over the 36MP if the high-ISO performances will be almost the same? Hmm?

I'm going to pay $500 more and I'm going to get less DR, less resolution (14MP!!!) and arguable same high-ISO performance, eh? And for what? A difference of 2fps and some AF points.... Yeah, right...
 
Upvote 0
so even 25 electrons of read noise would mean you have to pull EXTREME shadows to get any real problems with non-random noise forms given Canon's higher black point (2048 rather than 1024 as it was with the 5D II.)

jrista: Yeah about that -- do you understand the black points of 1024 & 2048 vs. Nikon's 0? I just don't get it. BTW the Canon S100 has a black point of 128. Seems like it's always some power of 2.

Also, while we're on this subject (I know we talked about this before in a different forum, but no conclusion was drawn): I find it highly suspicious that when I use the method of LetTheRightLensIn & 'bronxbombers' (on dpreview's fora), i.e.:

DR = log[base 2] (max pixel value/stdev in black frame)

I get the same numbers as DXOMark... so often it's just uncanny & suspicious. It makes me wonder: is DXOMark using the same methodology, or are they actually measuring DR by also metering the objects in the scene? I get 11.2, 11.6, 14 for the 5D2, S100, D7000, respectively, using the simple equation above & black/white frames from those respective cameras. Which is almost exactly what DXO gets. Don't you find that suspicious?

Given the option, I'd take a Canon 12 stop sensor with no noisy electronics over a Canon 14 stop sensor with noisy electronics.

Well, wouldn't the 14 stop sensor have to have relatively lower read noise in order to achieve the higher DR, according to the above equation?

I know what you're saying about the moon -- it's a huge exposure differential. But in this case b/c I had a fighting chance (b/c of the clouds dimming the moon), I really was so close to nailing it in one shot after raising the shadows.

Here, let me demonstrate:

Here's an acceptable shot in terms of noise:
IMG_7909.jpg


Here's the same scene (sort of) a little later, with the moon emerging from the clouds. So I underexposed, compared to the previous shot, by 2 1/3 stops (note I went from ISO 100 to ISO 200, & I accounted for this in terms of the # of stops I underexposed this shot compared to the other shot):
IMG_7932.jpg


Granted the 2nd shot was 11min later, but this was already more than an hour after sunset so I'm not sure the ambient light changed that much. This shot has that crosshatch pattern + blotchy noise (much more visible in the full-resolution image, of course)

So, IMHO, 2 stops extra DR would've really helped here. Do you disagree?
 
Upvote 0
yunusoglu said:
If we are discussing the high-ISO performances of these two cameras, then it's already over for the 5D3...
Mr. Chuck Westfall, I'm sorry but, where exactly is the advantage of having 22MP over the 36MP if the high-ISO performances will be almost the same? Hmm?

I'm going to pay $500 more and I'm going to get less DR, less resolution (14MP!!!) and arguable same high-ISO performance, eh? And for what? A difference of 2fps and some AF points.... Yeah, right...

That would be 6fps frame rate and clean 3x sampling for video on the 5D III...both valuable. In fact, the 5D III is the fastest frame-rate full-frame body at 20mp+ resolution on the market. When you need FPS, FF, and can't afford to drop $7000, thats a VERY valuable thing. The 3x sampling should make 5D III video nice and clean...although sadly it still doesn't have the ability to do 4:2:2 sampling, which would be ideal (the D800 doesn't have that ability either, though, so level playing field there.)

Also, as far as I can tell, beyond 6400 (and maybe even as low as 6400), the D800 exhibits some FPN that the 5D III does not. The 5D III has NATIVE ISO up to 25600, where as the D800 has to digitally push exposure (same thing you might do in Lightroom with RAW) to get ISO's beyond 6400, which means its going to exhibit more non-random noise at those ISO's. @Sarangiman's samples above seem to demonstrate that, and while its subtle, non-random noise is present in the D800 image to a greater degree than the 5D III (there is a very slight and very small sample of what might be horizontal noise, and a couple cases of some odd diagonal noise...although that may just be noise and highlight edges lining up...can't really tell.) Under more extreme lighting circumstances, I would expect the effects to be more pronounced...DESPITE normalizing resolution between the two images.
 
Upvote 0
Just looking at a straight up JPG comparo at 1600, I don't think the d800 comes close to the 5D3. Look at the white wall, top left corner.

d800 - pink splotchy chroma noise

5d3 - buttery smooth

Granted, these are NR'd jpegs, but if chroma noise is popping up at 1600 on the d800, how's it gonna handle at 3200 or 6400, where the 5D3 looks very usable? I don't think Canon people have much to worry about - the 5D3 is going to be a phenomenal event/concert/low-light camera body.
 
Upvote 0
Funny how we can see different things from the same files, although when we're nitpicking this much, I'm not surprised. Honestly the D800 image looks slightly cleaner to me (5DIII also has some magenta blotchy noise), but it may depend on what part of the image we're looking at.

So for kicks I quantitated the bottom of the black bottle between the two files & calculated a mean & standard deviation.

Here are lines through the regions I quantitated for the 5DIII (top) & D800 (bottom):
QuantitatedAreas.jpg


Here are the results plotted in Excel (quantified in IRIS):
DarkBottleQuantitated.jpg


Make of it what you will... but in these two quantitated areas, the pixel variation is lower for the D800 (19 for 5DIII, 16 for D800). Albeit by a very small number (3 on a 255 scale).

I quantitated another area within this same region of the bottom of the bottle & the means came out to 16 for both 5DIII & D800, but a STDEV of 18 for the 5DIII & 15 for the D800, again giving credence to the slightly lower noise of the D800.

Again, we're splitting hairs here. ISO performance looks virtually equivalent in this scenario.

P.S. Remember these are RAW comparisons, where the D800 has been downsized (bicubic sampling) to match the 5DIII size.
 
Upvote 0
stve said:
The 5D III has longer exposure times because the lighting is different. Look at the reflections of the lights in the bottles; you can see that one of the lights is much dimmer in the 5D shots than it is in the D800 shots. The shadows bear this out, too.

You cannot make any judgment about the relative ISO sensitivity of the two cameras based on these photographs.
yunusoglu said:
Please help me understand this.
So what you're saying is; 5D3 would outperform the D800 big time if the lighting conditions were the same, right? Well I mean, it has to be 'big time' to justify the 22MP sensor vs. the 36MP, right?

That is not what I said. Reread what I wrote. I only said that you cannot make that kind of judgment based on the IR pictures.
 
Upvote 0
sarangiman said:
so even 25 electrons of read noise would mean you have to pull EXTREME shadows to get any real problems with non-random noise forms given Canon's higher black point (2048 rather than 1024 as it was with the 5D II.)

jrista: Yeah about that -- do you understand the black points of 1024 & 2048 vs. Nikon's 0? I just don't get it. BTW the Canon S100 has a black point of 128. Seems like it's always some power of 2.

Also, while we're on this subject (I know we talked about this before in a different forum, but no conclusion was drawn): I find it highly suspicious that when I use the method of LetTheRightLensIn & 'bronxbombers' (on dpreview's fora), i.e.:

DR = log[base 2] (max pixel value/stdev in black frame)

I get the same numbers as DXOMark... so often it's just uncanny & suspicious. It makes me wonder: is DXOMark using the same methodology, or are they actually measuring DR by also metering the objects in the scene? I get 11.2, 11.6, 14 for the 5D2, S100, D7000, respectively, using the simple equation above & black/white frames from those respective cameras. Which is almost exactly what DXO gets. Don't you find that suspicious?

Well, we have actual black-frame samples from the 5D III now, so I'm more trusting of the results of those tests at this point. My problem with those tests originally is it was exclusively using noise reads from the masked off border pixels of CR2 files. There was no way to know for sure what, exactly, those masked pixels might contain, especially given that the vast majority of the sample images available on the net were from pre-production 5D III samples. That made all the claims...which were stated as though they were undeniable fact...highly speculative at best. With a proper black frame from a production body, the results are certainly more realistic and verifiable, although they are still somewhat speculative (and counter Canon's claims about improved DR...regardless of how much improvement there may actually be.)

DXO does pretty much the same raw-file analysis, however they do it with images taken of a very specific and finely calibrated device that is supposed to ensure that DR, SNR, and ISO measurements are accurate. They sample light at many levels, not just between maximum saturation and standard deviation of black. I'm not sure about the DR calculation you specified though. That looks similar to DXO's SNR formula (which lacks the logarithm). DXO explicitly states their approach to determining DR as follows:

Given the option, I'd take a Canon 12 stop sensor with no noisy electronics over a Canon 14 stop sensor with noisy electronics.

Well, wouldn't the 14 stop sensor have to have relatively lower read noise in order to achieve the higher DR, according to the above equation?

I guess it depends on the characteristics of the noise. Fixed pattern noise is pretty fine in definition and usually forms boxes around less noisy areas (rather than entirely covering the whole image), and it could easily intrude into useful detail, without actually raising the lowest useful black level in every pixel. Thats kind of the problem Canon has had in the recent past...you could still extract some useful detail from very deep shadows, its just that it was frequently intruded upon by sharp, very unnatural fixed pattern noise. Canon also has "rough" dark current noise that obliterates other detail in even deeper shadows, so between the two, you certainly don't have as much recovery power as with Sony sensors. However you still DO have some recovery power. Hypothetically, it should be entirely possible that dark current noise could be reduced to bare minimums...taking care of the "bitchiness", leaving fixed pattern noise behind. You could probably reach deeper into shadows at that point, but they would still be useless because you have this very unnatural crosshatch intruding into your picture.

From what I've read from Canon about the improvements to their sensor, it sounds like they worked to remove as much fixed pattern noise as they could, but don't appear to have improved dark current noise much. Even 5D III images appear fairly blotchy in deep shadows and very high ISO. However I'd take bitchiness over FPN any day, even if it interfered with the last stop out of 14 stops of DR. Far better noise characteristics.

sarangiman said:
I know what you're saying about the moon -- it's a huge exposure differential. But in this case b/c I had a fighting chance (b/c of the clouds dimming the moon), I really was so close to nailing it in one shot after raising the shadows.

... images clipped ...

It does look like there was a measurable change in ambient there, the landscape contour in the first shot is much more defined, and not just because of the difference in noise. There is actually a window between "sunset"...the moment the sun passes the horizon, and the end of "astronomical twilight"...the point where no more light from the sun has any effect. During mid summer, that can be as wide a timeperiod as two hours (i.e. 8:30pm sunset, 10:30pm astrotwilight ends.) During the heart of winter, it might be as short as an hour and 15 minutes. Even under the last few minutes of astronomical twilight, the difference can be fairly significant on landscape exposures.

Back a few years ago, when I first started photography, I was hiking around some 14ers here in Colorado. I stayed up above 13,000 feet (where your angle of view to the sun is better than if you were at a lower altitude) loong after sunset, and kept taking photos. Over an hour and a half after sunset, the upper parts of the peaks were still exposing brighter than the rest of the mountains...and a hard shadow edge separated the bright peaks from the rest (only really visible with longer exposures, if you are ever inclined to experiment.) It was kind of like aplenglow, only with the gray light of astronomical twilight rather than the brilliant red of the first/last rays of sunrise/sunset.

So, IMHO, 2 stops extra DR would've really helped here. Do you disagree?

Certainly, more DR is always useful, however how you get that extra DR and where it comes from matters. When it comes to shadow range, its most useful when coupled with very low-noise electronics. Keep in mind, dynamic range in a digital sensor is allocated exponentially, such that it favors the highlights (more a consequence of base 2 math than anything, really.) Additionally, Canon's sensors are technically 14-bit sensors...its just that they are losing the least significant stops to noise. Gaining two additional usable stops of DR on the bottom end isn't really going to help the picture. If we break down the 14 bits of information a modern digital sensor has available, you get the following levels per stop (highlights at the top):

Stop 14: 8192
Stop 13: 4096
Stop 12: 2048
Stop 11: 1024
Stop 10: 512
Stop 09: 256
Stop 08: 128
Stop 07: 64
Stop 06: 32
Stop 05: 16
Stop 04: 8
Stop 03: 4
Stop 02: 2
Stop 01: 2

A sensor with very low read noise might consume Stop 1 and interfere with stop 2. Canon cameras probably consume the first couple stops with noise, and interfere with Stop 3 and to a small degree Stop 4. Lets say the moon exposure utilizes Stops 7-14, and the landscape exposure utilizes stops 1-4. Assuming you improve noise characteristics on a Canon such that it stops interfering with Stop 3 and 4...well, you haven't really changed anything. You aren't adding highlight room...so you can't push your exposure farther without blowing out highlights. You are making a few extra levels of shadow information useful...but there really wasn't much headroom there to start with. You may reduce non-random noise characteristics...but those shadows are still going to be noisy due to photon-shot noise. Instead of having maybe 11 levels to work with for the landscape...you now have approximately 14 levels. You can certainly bump the exposure of those levels now without much worry that you'll see unsightly noise patterns emerge...but your not gaining as much as you might think. Your simply gaining access to what was already there.

Now, the story would be different if you only had 12-bits to start with, and actually increased the sensors capabilities to 14-bits. At that point, your highlight headroom increases by 12288 levels! You can push your exposure a lot farther, and as a consequence of being able to push the moon exposure to a higher range of levels, you DO gain more room in the shadows (or rather, you don't have to underexpose the shadows as much, and therefor shadow SNR improves.) That would have a far greater impact on DR than simply making the least-significant levels of already-existing bit depth "usable". The same would go for a move from 14-bit to 16-bit sensors and ADC's. You would gain an additional 49152 levels with those two extra bits (a full three times the grand total you had to work with before)! (Might also explain why 16-bit electronics capable of processing 6-14 high resolution photographic frames per second are currently beyond the reach of reasonably priced DSLR's now. ;))

Obviously, this is a bit of a contrived example, but that is indeed the reality of the DR story with Canon sensors. Were not lacking highlight range...were unable to fully utilize existing shadow range. Exact distribution of levels may not be as "neat" as my example, and there are numerous levels of indirection between the signal on the sensor and the data in a CR2 file. We know that Canon's black point (at least as measured by the masked pixel border) is fairly high...however how that plays into real pixel data in non-masked areas when a CR2 file is properly processed is something I can't speak to. It does seem like Canon is only capable of achieving about 15760 levels in a fully saturated pixel (if previous numbers floating around are indeed accurate), so the exponential breakdown of levels is going to differ, and the bottom two stops are largely (or maybe entirely) inaccessible (regardless of how many levels they may support.)
 
Upvote 0
sarangiman said:
Funny how we can see different things from the same files, although when we're nitpicking this much, I'm not surprised. Honestly the D800 image looks slightly cleaner to me (5DIII also has some magenta blotchy noise), but it may depend on what part of the image we're looking at.

So for kicks I quantitated the bottom of the black bottle between the two files & calculated a mean & standard deviation.

Here are lines through the regions I quantitated for the 5DIII (top) & D800 (bottom):
QuantitatedAreas.jpg


Here are the results plotted in Excel (quantified in IRIS):
DarkBottleQuantitated.jpg


Make of it what you will... but in these two quantitated areas, the pixel variation is lower for the D800 (19 for 5DIII, 16 for D800). Albeit by a very small number (3 on a 255 scale).

I quantitated another area within this same region of the bottom of the bottle & the means came out to 16 for both 5DIII & D800, but a STDEV of 18 for the 5DIII & 15 for the D800, again giving credence to the slightly lower noise of the D800.

Again, we're splitting hairs here. ISO performance looks virtually equivalent in this scenario.

P.S. Remember these are RAW comparisons, where the D800 has been downsized (bicubic sampling) to match the 5DIII size.

Sarangiman,

Interesting - but the point of the d800 is to have more info without reducing the size of the image. Can you run another comparo on the same area of the images, but at their native resolutions? This is a more valuable comparison - at least in my mind - as reducing a d800 file to 22MP negates the value of having a 36MP camera in the first place.
 
Upvote 0
sarangiman said:
Funny how we can see different things from the same files, although when we're nitpicking this much, I'm not surprised. Honestly the D800 image looks slightly cleaner to me (5DIII also has some magenta blotchy noise), but it may depend on what part of the image we're looking at.

Aye, peoples eyes notice different things. Here is an animated GIF that I hope better demonstrates the fixed pattern noise I see in the D800, and what may (??) be some slight vertical banding in the 5D III. For both samples, I adjusted levels to: Black 40, Gray 1.4, White 180. Hopefully that makes the noise characteristics a bit easier to see as there should be higher contrast:

cmMig.gif


Personally, I like the vertical banding in the 5D III better than the horizontal FPN in the D800. There is actually quite a lot of FPN in the D800 shots in the dimmer areas...namely the dark parts of the bottles, the black mug, etc. The D800 images have been downsampled, and that is likely to mitigate the impact of non-random noise. I'm curious what its like at full resolution.
 
Upvote 0
Status
Not open for further replies.