rfdesigner said:
jrista said:
rfdesigner said:
First up, you've got plenty of calibration frames. The amount you need is debatable, but you don't need 100s. I use equivelent of about 16 (I use double length darks, but let's not go there right now)
I would say 16x is the minimum. With 16 subs you reduce random noise by a factor of 4x. That is ok, however you have to keep in mind that subtracting the master dark from each light is going to increase the random noise in the lights. I recommend no less than 25 darks for those who really don't want to stack a lot, and I usually recommend 49, which gives you a more reasonable 7x reduction in noise. That has a much smaller impact on the noise in each light, so small that it is swamped by all the other noise terms.
Everyone I come across has a different view on this, but I do take issue with "7x reduction in noise". that's really quite an unhelpful way of putting it. (regardless of the undeniably correct underlying truth)
Here's the maths which I think makes it easier to see:
16 dark frames => 1/sqrt(16) noise = 1/4 in the master dark.
Light noise + master dark frame noise = sqrt(1^2 + (1/4)^2) = 1.03077...
That's 0.03 magnitudes... so long as there's dithering between lights (i.e. you have to use image alignment to stack images)
make it 100 dark frames and you get 0.0054 magnitude degradation; 84 shutter actuations for .0246 magnitudes!
For someone starting out 16 darks mean they're not generating hundreds of shutter actuations chasing 0.03 magnitudes when they could pick up far more from getting other aspects right, like flats.
Once someone's producing work as good as yours with a setpoint cooled camera, then more darks can make some sense.
I don't use a setpoint cooled camera. ;P I use an uncooled, unmodified 5D III. That camera is a pretty noisy camera in the grand scheme of things. Especially when imaging with sensor temps over 20C. Especially when it approaches 30C, dark current becomes the most significant source of noise (it can top 5e-/s/px, and if I get into the mid 30's C, it can get up to 8-10e-/s/px, and I don't even bother imaging at that point.)
I also take great care to maximize the potential of my calibration. I used to be "sloppy" with my calibration, and that sloppiness showed in my results. Since I've started paying attention to every detail, it has improved my work considerably. I also chase every faint detail I can, so I guess extracting every last ounce out of my data and keeping the noise as low as possible does matter to me, where it might not for others.
Personally, I agree about the actuation count, however I take a slightly different approach to minimizing noise. I use PixInsight to do all my pre-processing. I DO dither, however again, there is an efficiency factor there. I don't dither every frame, because dithering overhead can be high. I also dither less aggressively than some, because the higher the aggression, the longer the settle time, and the less actual open-shutter exposure time on target you get each night. I dither every 2-3 subs, depending on exactly how long they are.
So, I tend to use 10-20 dark frames. However my dark frames are usually ~2x as long as the lights. PixInsight supports very accurate dark scaling, where by use of noise evaluation of each and every light frame, an optimized scale factor is used to match the master dark to the light. So with 20 frames that are 20 minutes long, scaled to 10 minute lights, it is more like having 40 frames, which is close enough to that 49 number I generally recommend. Also thanks to dark scaling, I do not need to have my darks 100% perfectly matched to the temperature of my lights. Some variation, I allow +/- 3C, is acceptable. Most of my lights fall into a couple of ranges of temperature, depending on the season, and I reuse darks for a while before recreating them. So, one need not expend a massive amount of shutter actuations needlessly creating 49 dark frames every time they image...not with the proper software.
I also agree that getting biases right is important. My previous bias frame was made from 100 biases, which are super easy to get, and the bias signal does not change much, I used my last master bias for about a year. This last time, while doing various testing on my calibration frames, I ended up creating a 512-frame master bias, which was actually quite a bit less noisy than my previous 100-frame master bias, and revealed the PRNU of the sensor much better. It was also much better than using a superbias, which tends to obliterate fine column to column variations in PRNU that I am finding can and do show up in the deeper parts of the signal once the LP is offset. If your a signal hunter like me, this can matter (although 256 frames would probably be good enough...I only have 512 as I was using that data for an entirely different purpose.)
Flats are probably the area where most of the issues come from. Creating proper flats can actually be quite a challenge. Flats correct a lot of things, but because they are divided out they can also interfere with a lot of things. Dust motes can move, which can result in improper correction. Vignetting can change, which can result in improper correction. Gradients can change, which at the very least can require different kinds of pre-processing and integration (i.e. in PI, you can use flux equalization and percentile clipping to deal with flat gradients to a degree). Getting the right ADU count in a flat matters for proper correction. Etc.
So for a beginner, I would agree, focusing their efforts on flats would be more valuable. That said, acquiring darks is easy. And if you use a dark scaling algorithm, you do not actually need the darks to be ideally matched, and can usually reuse master darks for a good while before having to recreate them.