December 21, 2014, 03:59:36 PM

Author Topic: How do you store and archive your images?  (Read 5590 times)

FTb-n

  • Canon 70D
  • ****
  • Posts: 277
    • View Profile
How do you store and archive your images?
« on: February 16, 2013, 02:55:29 AM »
With my XT and various PowerShots, my backup strategy involved a 500 GB external drive and burning DVD's.  With a 60D and 7D, I've had to up the capacity quite a bit.  Now it's two 1.5 TB external drives and burning BluRays (25 GB per disc). 

On the external drives, which I manually mirror, I keep straight-out-of-the camera images in one directory tree and post processed images in another.  I can shoot anywhere from 500-2,000 images per event.  Admittedly, when lighting is reliably even (particularly in color), I shoot JPG.  But, as things get moe challenging light-wise, more likely to need post work, or more important, I'll shoot RAW.  25 MB RAW images add up in a hurry.  Those 1.5 TB drives have nearly 1 TB of photos.

So, as I contemplate another set of 1-2 TB drives, how do you store and archive your images?
5D3, 7D | 70-200 f2.8L IS II, 24-70 f2.8L II, 24-105 f4L IS, 35 f2 IS, 17-55 f2.8 IS, 40 f2.8...  |  PowerShot G16, S100

canon rumors FORUM

How do you store and archive your images?
« on: February 16, 2013, 02:55:29 AM »

brad goda

  • Rebel T5i
  • ****
  • Posts: 129
    • View Profile
Re: How do you store and archive your images?
« Reply #1 on: February 16, 2013, 03:30:58 AM »
since 2003 went digital storing all archives on DVD
by 2008 we hit DVD archive 849... and called it quits to archiving to DVD...
shoots are labeled by date then job/event... within folders contain raw proofs selected raws duplicated and final folder containing 16bit TIFF and then duplicated sized jpegs after post.
with amount of files per job/event all work is now saved on 1TB removable HD...
as the jobs/events are completed/delivered they are placed into year/months archive folders...
screen capture the files and placed in archive file for reff in admin computer..
as the archive folder fills to 85% full its pulled and set aside as archive only... we use wiebe RTX drive housing and their drive storage boxes... sata drives are now like video cassettes that are stored in water proof case stored in steel storage cabinet.
Ive kept to 1TB just for thinking that thats enough stuff on one drive... so far all is good.
for DVDs we NEVER placed stickers and only used archival pen to mark clear center area with DVDs number... all stored in tyvek in archival DVD storage boxes... the best DVDs were used and still used... preferring the printable type with heavy white printable surface... in the past ive bought cheap DVD and regretted scratching not the bottom but the top of the DVD on insertion... the thin layer which contains the data on the metallic layer rips and flakes off... scarry.. never again.
good luck hope my example leads you to your own system.
Brad

florianbieler.de

  • EOS M2
  • ****
  • Posts: 192
    • View Profile
    • florianbieler.de photography
Re: How do you store and archive your images?
« Reply #2 on: February 16, 2013, 04:03:35 AM »
On my hard drive and backed up on an external drive. Maybe I should also sync them with my laptop for a third instance just in case everything goes south.
EOS 5D Mark III · EF 16-35 4.0L IS · EF 24-70 4.0L IS · EF 70-200 4.0L IS · Σ 35 1.4A · Σ 50 1.4A · Σ 85 1.4
EOS M · EF-M 22 2.0
florianbieler.de

brad goda

  • Rebel T5i
  • ****
  • Posts: 129
    • View Profile
Re: How do you store and archive your images?
« Reply #3 on: February 16, 2013, 04:22:46 AM »
oops I failed to mention...
system drive contains OS and software...
all image folders are on second internal drive or outboard RTF drive...

if you are using Imac or laptop duplicate all image folders to portable or storage drives...
I consider any files being saved on the system drive have more potential for loss error or corruption.
work and store all image on other drives...

if need be get it off system asap and archive on your method

bakker

  • Power Shot G7X
  • **
  • Posts: 21
    • View Profile
Re: How do you store and archive your images?
« Reply #4 on: February 16, 2013, 04:43:42 AM »
I had all my pictures burned to DVD's but recently I put them all back on my 1,5 TB HD. (That's my OS drive right now, though I'll need to get an SSD for OS soon..). I have the folder "Photo" synched with another 1,5 TB drive. That one used to be an external usb drive but I built it into my PC for a faster synching speed through the SATA connection.

candyman

  • 1D X
  • *******
  • Posts: 1461
    • View Profile
Re: How do you store and archive your images?
« Reply #5 on: February 16, 2013, 04:55:57 AM »
I have two external Harddiks with each 3TB diskspace. They are USB 3.0 and it's a double backup system on weekly basis of my laptop.
I am currently working on a NAS system with raid.


mrsfotografie

  • 1D X
  • *******
  • Posts: 1445
  • www.mrsfotografie.nl
    • View Profile
    • MRS fotografie
Re: How do you store and archive your images?
« Reply #6 on: February 16, 2013, 05:11:57 AM »
On an internal 1TB HDD that I mirror to a 3TB HDD in a HTPC on a regular basis. The HTPC is backup and a great way to view the photos on a 40" flatscreen TV.

I have a legacy external 1TB HDD but its interface is USB 2.0 - I may convert that to E-sata (internals is sata) to get a second backup solution. USB 2 is too slow IMHO.
5D3, 5D2, Sony α6000, G16 | SY14 f/2.8, Ʃ20 f/1.8, 24 f/2.8, 35 f/2, Ʃ35 f/1.4A, 50 f/1.8 I, Ʃ50 f/1.4 EX, 100L Macro, 17-40L, 24-105L, 70-200 f/2.8L IS II, 1.4x II, 70-300L, 100-400L | E-mount: SY12 f/2, Ʃ19 & 30 f/2.8 EX DN, 16-70 ZA OSS, 55-210 OSS, Metabones SB | FT-QL, AE-1P | FD(n) & FL lenses

canon rumors FORUM

Re: How do you store and archive your images?
« Reply #6 on: February 16, 2013, 05:11:57 AM »

Sith Zombie

  • Rebel T5i
  • ****
  • Posts: 141
    • View Profile
    • Lightroom Images
Re: How do you store and archive your images?
« Reply #7 on: February 16, 2013, 05:43:12 AM »
Fairly straightforward, everything goes into aperture on my computer HD and then I do regular backups of my whole HD [via time machine] on to a 1TB external. I keep thinking of backing up to a 3rd device but to have 2 HD failures would be very rare. Also if they do fail, its usually a mechanical part that goes, so the actual data is still safe.

gferdinandsen

  • EOS M2
  • ****
  • Posts: 191
  • was mich nicht umbringt, macht mich stärker
    • View Profile
    • Home
Re: How do you store and archive your images?
« Reply #8 on: February 16, 2013, 06:48:42 AM »
I use several redundant methonds.

First, primary storage where I do all my editing from, 2x 512GB Solid State Hard Drive
Second a 2TB NAS in RAID 1+0 configuration
Third a 1TB external HDD
Fourth, M-Disc's (archival quality DVD storage) (http://www.mdisc.com/what-is-mdisc/)

Finally a use a simple script that runs as a scheduled batch job that utilises RoboCopy to copy the Change Delta's to the alternate media (except to the M-Disc's, only to the HDD's)
1v HS, 5D3, 60 Da, 40D (IR), G1-X, 17-40L, 24-70L (Mk II), 24-105L, 70-200L (2.8 Mk 1), 24 TS-E L (Mk 1), 45 TS-E, 50 1.2L, 100 L Macro -- CPS Gold Membership

FunPhotons

  • Canon 6D
  • *****
  • Posts: 405
    • View Profile
Re: How do you store and archive your images?
« Reply #9 on: February 16, 2013, 07:06:29 AM »
Here's how it goes for me, first insert a CF card
  • LR4 imports to a working copy disk converting to DNG. Backup is made to a different disk
  • To eject card I run a script which does a rsync to a 15TB (5x3TB) on a Synology 1511+ NAS with 2 disk redundancy (up to two disks can crash and recover)
  • Then it asks whether to erase and eject card (3 copies of photos at this point) which I say yes
  • Once a night everything is backed up to a Synology 'side car' with 1 disk redundancy  12TB (4x3TB)
  • Once a week everything is rsync backed up to a Drobo FS 5x2TB with 1 disk redundancy
  • Once a month everything is rsync backed up to a briefcase of disks which reside offsite at my workplace
  • An extra backup set exists on portable hard drive (3x1TB) which I take with me when traveling
  • When traveling all shots are copies to a dual disk redudancy mini RAID enclosure
 

Cloud storage would be nice but its too expensive, and I have about 1.5TB of pictures at this point and growing. This also stores all of my other data, most of my life is on those disks.

gferdinandsen

  • EOS M2
  • ****
  • Posts: 191
  • was mich nicht umbringt, macht mich stärker
    • View Profile
    • Home
Re: How do you store and archive your images?
« Reply #10 on: February 16, 2013, 07:19:46 AM »
Here's how it goes for me, first insert a CF card
  • LR4 imports to a working copy disk converting to DNG. Backup is made to a different disk
  • To eject card I run a script which does a rsync to a 15TB (5x3TB) on a Synology 1511+ NAS with 2 disk redundancy (up to two disks can crash and recover)
  • Then it asks whether to erase and eject card (3 copies of photos at this point) which I say yes
  • Once a night everything is backed up to a Synology 'side car' with 1 disk redundancy  12TB (4x3TB)
  • Once a week everything is rsync backed up to a Drobo FS 5x2TB with 1 disk redundancy
  • Once a month everything is rsync backed up to a briefcase of disks which reside offsite at my workplace
  • An extra backup set exists on portable hard drive (3x1TB) which I take with me when traveling
  • When traveling all shots are copies to a dual disk redudancy mini RAID enclosure
 

Cloud storage would be nice but its too expensive, and I have about 1.5TB of pictures at this point and growing. This also stores all of my other data, most of my life is on those disks.



Cloud storage has gotten a lot cheaper, ASUS now offers 500GB for just $50.00/yr
« Last Edit: February 16, 2013, 07:36:50 AM by gferdinandsen »
1v HS, 5D3, 60 Da, 40D (IR), G1-X, 17-40L, 24-70L (Mk II), 24-105L, 70-200L (2.8 Mk 1), 24 TS-E L (Mk 1), 45 TS-E, 50 1.2L, 100 L Macro -- CPS Gold Membership

brad goda

  • Rebel T5i
  • ****
  • Posts: 129
    • View Profile
Re: How do you store and archive your images?
« Reply #11 on: February 16, 2013, 07:57:32 AM »
Here's how it goes for me, first insert a CF card
  • LR4 imports to a working copy disk converting to DNG. Backup is made to a different disk
  • To eject card I run a script which does a rsync to a 15TB (5x3TB) on a Synology 1511+ NAS with 2 disk redundancy (up to two disks can crash and recover)
  • Then it asks whether to erase and eject card (3 copies of photos at this point) which I say yes
  • Once a night everything is backed up to a Synology 'side car' with 1 disk redundancy  12TB (4x3TB)
  • Once a week everything is rsync backed up to a Drobo FS 5x2TB with 1 disk redundancy
  • Once a month everything is rsync backed up to a briefcase of disks which reside offsite at my workplace
  • An extra backup set exists on portable hard drive (3x1TB) which I take with me when traveling
  • When traveling all shots are copies to a dual disk redudancy mini RAID enclosure
 

Cloud storage would be nice but its too expensive, and I have about 1.5TB of pictures at this point and growing. This also stores all of my other data, most of my life is on those disks.



Cloud storage has gotten a lot cheaper, ASUS now offers 500GB for just $50.00/yr

great... i have 11TB of data to store on cloud and that will cost 1100.00 per year... wow. with data growing X 1.75 per year... yikes... not for me

but I think original poster you are getting alot of good ideas...

Chewngum

  • PowerShot G1 X II
  • ***
  • Posts: 61
  • F1.6 is the best.
    • View Profile
    • Peter Kingsley Photography
Re: How do you store and archive your images?
« Reply #12 on: February 16, 2013, 08:14:22 AM »
Look up amazon S3 cloud storage. Glacier storage is super cheap to upload to, like super cheap, and then you only pay when you download the stuff back.


There is a point where one can have successfully backup.
For me it would be:
RAID 5+0 with 2 spare disks in computer
NAS RAID 0
Offsite NAS RAID 0
Glacier cloud storage


I currently only use in computer RAID, an external hard drive and a NAS drive but if my business was a big serious thing then the above list would be sufficient though perhaps with scalability included too.
Cameras: 5d2, 5d3
Lenses: 17-40L 24-105L 50L 100L s35A s85 70-200L IS II + lots of flashes. About 100 previous bodies/lenses

canon rumors FORUM

Re: How do you store and archive your images?
« Reply #12 on: February 16, 2013, 08:14:22 AM »

FunPhotons

  • Canon 6D
  • *****
  • Posts: 405
    • View Profile
Re: How do you store and archive your images?
« Reply #13 on: February 16, 2013, 08:24:50 AM »
Uh, guys, Cloud storage isn't an option for many of us. I'm well familiar with Glacier/ASUS etc etc. Price out 4TB of data, growing at at least 1TB/Year, factor in how you'll get it to them (Cable modem isn't going to work), data availability (you still need local copies), plus redundancy and it gets expensive. Plus Cloud doesn't mean safe.

Ultimately nobody cares about your data as much as you do. There's no way a professional photographer (certainly not videographer) could make do with Cloud storage. At best it would work for a light shooting amateur.

My attitude is that data storage costs drop exponentially like all other information technologies, so I store everything and then some. In a few years I'll laugh about the day I fretted about a few TB.

Speaking of which I laugh at the folks who call high mega pixel cameras "mega pickles" (as if that's funny), and then go on to say it will never happen because "oh my god all those pixels will kill your computer and hard drive". Yeah, sure grandpa ... :)

Mt Spokane Photography

  • EF 50mm F 0.7 IS
  • ***********
  • Posts: 9402
    • View Profile
Re: How do you store and archive your images?
« Reply #14 on: February 16, 2013, 02:23:26 PM »
I have a 6 disk QNAP NAS which backs up my PC's and images.  Its a few years old now, but has 12 TB of drives in it.  Since it runs Raid, it actually has about 9.2 TB usable.  I'm down to less than 2 TB free, so its time to clean up.
The drives can be upgraded to larger disks (12 TB Max if one actually existed), but by the time I need them, I'll likely upgrade to a new model NAS maybe with SSD.

canon rumors FORUM

Re: How do you store and archive your images?
« Reply #14 on: February 16, 2013, 02:23:26 PM »