How do you store and archive your images?

Status
Not open for further replies.

FTb-n

Canonet QL17 GIII
Sep 22, 2012
532
8
St. Paul, MN
With my XT and various PowerShots, my backup strategy involved a 500 GB external drive and burning DVD's. With a 60D and 7D, I've had to up the capacity quite a bit. Now it's two 1.5 TB external drives and burning BluRays (25 GB per disc).

On the external drives, which I manually mirror, I keep straight-out-of-the camera images in one directory tree and post processed images in another. I can shoot anywhere from 500-2,000 images per event. Admittedly, when lighting is reliably even (particularly in color), I shoot JPG. But, as things get moe challenging light-wise, more likely to need post work, or more important, I'll shoot RAW. 25 MB RAW images add up in a hurry. Those 1.5 TB drives have nearly 1 TB of photos.

So, as I contemplate another set of 1-2 TB drives, how do you store and archive your images?
 
since 2003 went digital storing all archives on DVD
by 2008 we hit DVD archive 849... and called it quits to archiving to DVD...
shoots are labeled by date then job/event... within folders contain raw proofs selected raws duplicated and final folder containing 16bit TIFF and then duplicated sized jpegs after post.
with amount of files per job/event all work is now saved on 1TB removable HD...
as the jobs/events are completed/delivered they are placed into year/months archive folders...
screen capture the files and placed in archive file for reff in admin computer..
as the archive folder fills to 85% full its pulled and set aside as archive only... we use wiebe RTX drive housing and their drive storage boxes... sata drives are now like video cassettes that are stored in water proof case stored in steel storage cabinet.
Ive kept to 1TB just for thinking that thats enough stuff on one drive... so far all is good.
for DVDs we NEVER placed stickers and only used archival pen to mark clear center area with DVDs number... all stored in tyvek in archival DVD storage boxes... the best DVDs were used and still used... preferring the printable type with heavy white printable surface... in the past ive bought cheap DVD and regretted scratching not the bottom but the top of the DVD on insertion... the thin layer which contains the data on the metallic layer rips and flakes off... scarry.. never again.
good luck hope my example leads you to your own system.
Brad
 
Upvote 0
oops I failed to mention...
system drive contains OS and software...
all image folders are on second internal drive or outboard RTF drive...

if you are using Imac or laptop duplicate all image folders to portable or storage drives...
I consider any files being saved on the system drive have more potential for loss error or corruption.
work and store all image on other drives...

if need be get it off system asap and archive on your method
 
Upvote 0
I had all my pictures burned to DVD's but recently I put them all back on my 1,5 TB HD. (That's my OS drive right now, though I'll need to get an SSD for OS soon..). I have the folder "Photo" synched with another 1,5 TB drive. That one used to be an external usb drive but I built it into my PC for a faster synching speed through the SATA connection.
 
Upvote 0
On an internal 1TB HDD that I mirror to a 3TB HDD in a HTPC on a regular basis. The HTPC is backup and a great way to view the photos on a 40" flatscreen TV.

I have a legacy external 1TB HDD but its interface is USB 2.0 - I may convert that to E-sata (internals is sata) to get a second backup solution. USB 2 is too slow IMHO.
 
Upvote 0
Fairly straightforward, everything goes into aperture on my computer HD and then I do regular backups of my whole HD [via time machine] on to a 1TB external. I keep thinking of backing up to a 3rd device but to have 2 HD failures would be very rare. Also if they do fail, its usually a mechanical part that goes, so the actual data is still safe.
 
Upvote 0

gferdinandsen

was mich nicht umbringt, macht mich stärker
I use several redundant methonds.

First, primary storage where I do all my editing from, 2x 512GB Solid State Hard Drive
Second a 2TB NAS in RAID 1+0 configuration
Third a 1TB external HDD
Fourth, M-Disc's (archival quality DVD storage) (http://www.mdisc.com/what-is-mdisc/)

Finally a use a simple script that runs as a scheduled batch job that utilises RoboCopy to copy the Change Delta's to the alternate media (except to the M-Disc's, only to the HDD's)
 
Upvote 0
Here's how it goes for me, first insert a CF card
  • LR4 imports to a working copy disk converting to DNG. Backup is made to a different disk
  • To eject card I run a script which does a rsync to a 15TB (5x3TB) on a Synology 1511+ NAS with 2 disk redundancy (up to two disks can crash and recover)
  • Then it asks whether to erase and eject card (3 copies of photos at this point) which I say yes
  • Once a night everything is backed up to a Synology 'side car' with 1 disk redundancy 12TB (4x3TB)
  • Once a week everything is rsync backed up to a Drobo FS 5x2TB with 1 disk redundancy
  • Once a month everything is rsync backed up to a briefcase of disks which reside offsite at my workplace
  • An extra backup set exists on portable hard drive (3x1TB) which I take with me when traveling
  • When traveling all shots are copies to a dual disk redudancy mini RAID enclosure

Cloud storage would be nice but its too expensive, and I have about 1.5TB of pictures at this point and growing. This also stores all of my other data, most of my life is on those disks.
 
Upvote 0

gferdinandsen

was mich nicht umbringt, macht mich stärker
FunPhotons said:
Here's how it goes for me, first insert a CF card
  • LR4 imports to a working copy disk converting to DNG. Backup is made to a different disk
  • To eject card I run a script which does a rsync to a 15TB (5x3TB) on a Synology 1511+ NAS with 2 disk redundancy (up to two disks can crash and recover)
  • Then it asks whether to erase and eject card (3 copies of photos at this point) which I say yes
  • Once a night everything is backed up to a Synology 'side car' with 1 disk redundancy 12TB (4x3TB)
  • Once a week everything is rsync backed up to a Drobo FS 5x2TB with 1 disk redundancy
  • Once a month everything is rsync backed up to a briefcase of disks which reside offsite at my workplace
  • An extra backup set exists on portable hard drive (3x1TB) which I take with me when traveling
  • When traveling all shots are copies to a dual disk redudancy mini RAID enclosure

Cloud storage would be nice but its too expensive, and I have about 1.5TB of pictures at this point and growing. This also stores all of my other data, most of my life is on those disks.



Cloud storage has gotten a lot cheaper, ASUS now offers 500GB for just $50.00/yr
 
Upvote 0
gferdinandsen said:
FunPhotons said:
Here's how it goes for me, first insert a CF card
  • LR4 imports to a working copy disk converting to DNG. Backup is made to a different disk
  • To eject card I run a script which does a rsync to a 15TB (5x3TB) on a Synology 1511+ NAS with 2 disk redundancy (up to two disks can crash and recover)
  • Then it asks whether to erase and eject card (3 copies of photos at this point) which I say yes
  • Once a night everything is backed up to a Synology 'side car' with 1 disk redundancy 12TB (4x3TB)
  • Once a week everything is rsync backed up to a Drobo FS 5x2TB with 1 disk redundancy
  • Once a month everything is rsync backed up to a briefcase of disks which reside offsite at my workplace
  • An extra backup set exists on portable hard drive (3x1TB) which I take with me when traveling
  • When traveling all shots are copies to a dual disk redudancy mini RAID enclosure

Cloud storage would be nice but its too expensive, and I have about 1.5TB of pictures at this point and growing. This also stores all of my other data, most of my life is on those disks.



Cloud storage has gotten a lot cheaper, ASUS now offers 500GB for just $50.00/yr

great... i have 11TB of data to store on cloud and that will cost 1100.00 per year... wow. with data growing X 1.75 per year... yikes... not for me

but I think original poster you are getting alot of good ideas...
 
Upvote 0
Look up amazon S3 cloud storage. Glacier storage is super cheap to upload to, like super cheap, and then you only pay when you download the stuff back.


There is a point where one can have successfully backup.
For me it would be:
RAID 5+0 with 2 spare disks in computer
NAS RAID 0
Offsite NAS RAID 0
Glacier cloud storage


I currently only use in computer RAID, an external hard drive and a NAS drive but if my business was a big serious thing then the above list would be sufficient though perhaps with scalability included too.
 
Upvote 0
Uh, guys, Cloud storage isn't an option for many of us. I'm well familiar with Glacier/ASUS etc etc. Price out 4TB of data, growing at at least 1TB/Year, factor in how you'll get it to them (Cable modem isn't going to work), data availability (you still need local copies), plus redundancy and it gets expensive. Plus Cloud doesn't mean safe.

Ultimately nobody cares about your data as much as you do. There's no way a professional photographer (certainly not videographer) could make do with Cloud storage. At best it would work for a light shooting amateur.

My attitude is that data storage costs drop exponentially like all other information technologies, so I store everything and then some. In a few years I'll laugh about the day I fretted about a few TB.

Speaking of which I laugh at the folks who call high mega pixel cameras "mega pickles" (as if that's funny), and then go on to say it will never happen because "oh my god all those pixels will kill your computer and hard drive". Yeah, sure grandpa ... :)
 
Upvote 0
Mar 25, 2011
16,847
1,835
I have a 6 disk QNAP NAS which backs up my PC's and images. Its a few years old now, but has 12 TB of drives in it. Since it runs Raid, it actually has about 9.2 TB usable. I'm down to less than 2 TB free, so its time to clean up.
The drives can be upgraded to larger disks (12 TB Max if one actually existed), but by the time I need them, I'll likely upgrade to a new model NAS maybe with SSD.
 
Upvote 0
My photography machine has an SSD and a hard drive inside it. For day-to-day use, my Lightroom Catalog lives on the SSD for fast load speeds, and the RAW files live on the 1TB hard drive.

All of this gets backed up to an external 3TB drive for redundancy.

All of *that* gets backed up to an online provider. Being in the Land Of Fast Internet (Sweden), my upload speed makes this a breeze. I'm using a Mac application called Arq to back up to Amazon Glacier - the pricing is pretty great and Amazon's services are incredibly reliable.

People seem to dislike online storage - "just because it's online doesn't mean it's any safer". That's true, but that's not the point. The point of data redundancy is to reduce the chance of all of your copies failing at once to an acceptable level. Having a local backup to an external drive saves me from a drive failing. Having an online backup as well saves me from all of my local drives failing at the same time (very unlikely) and my house catching fire (statistically, probably less unlikely). And, let's face it — if something so catastrophic happens that causes all of my drives *and* Amazon's services to fail beyond recovery, my data will probably be the least of my worries!
 
Upvote 0
I currently use RAID 1 (mirroring) on 2x2TB Drives in my primary computer just for image storage. I have SSD's for my OS and primary Apps and non-redundant HDD's for non-critical files.

I keep an active 3 TB External connected for nightly scripted backup of the RAID 1 files.

I keep another 3 TB External at work that I bring home once a month to backup and store as my off-site.

I replace all my drives every 2-3 years to reduce the risk of aging drive failures.

In the event I have any failure in either drive in the RAID 1 array, the other is still fully functional. I perform an immediate backup to the external, grab a spare 2TB spare, and swap the problem drive out and allow it to automatically rebuild the mirror image on the new drive.

Perhaps at some point I may consider cloud storage but have found that my current system has served me well and survived a hard drive failure once already. If I am able to increase client level work (more paid work), then I will probably make the move to cloud storage as my off-site method.
 
Upvote 0

mws

Nov 9, 2010
180
0
I have 1 TB in my laptop, that is only about half full, I back everything up to a 3 TB NAS in RAID 1 with Carbon Copy cloner. I also have a 2nd 3 TB NAS in RAID 1 in my detached garage that serves as offsite incase the house burns down. The NAS in my basement replicates itself to the one in the garage twice a week. I thought about adding another layer of backup with Amazon S3, but decided against it due to cost. I figured the two NAS was good.

My real concern is when my laptop fills up, I really don't want to keep something attached to it to use Lightroom, since LR doesn't play well with network volumes.
 
Upvote 0
Status
Not open for further replies.