Magic Lantern... CONTINUOUS raw recording @ 24fps on 5D3

[LOALTD]

USB 2.0 maxes out at 40-45MB/s

At 1920x1080, I'm getting 60-90MB/s

Don't think it will happen unfortunately.

The most frustrating part of shooting this video right now is that raw2dng app. It will not recognize clips bigger than 2GB in the OSX version, which really limits what you can do!

Or maybe it just means I'm a sloppy shooter

 

[cayenne]

USB 2.0 maxes out at 40-45MB/s

At 1920x1080, I'm getting 60-90MB/s

Don't think it will happen unfortunately.

The most frustrating part of shooting this video right now is that raw2dng app. It will not recognize clips bigger than 2GB in the OSX version, which really limits what you can do!

Or maybe it just means I'm a sloppy shooter

Have you tried running Win7 in a VM with VMWare or Parallels, and doing the raw2dmg that way?

That might help...?

C

 

[LetTheRightLensIn]

I was just thinking that you could probably batch the .DNG files not just in AE/ACR but in PS/ACR with with full PS power and various other plug-ins and have video frames processed with full on stills photography quality tools and all sorts of fancy, fancy processing and super advanced sharperning, NR, coloring tools.

 

[LOALTD]

USB 2.0 maxes out at 40-45MB/s

At 1920x1080, I'm getting 60-90MB/s

Don't think it will happen unfortunately.

The most frustrating part of shooting this video right now is that raw2dng app. It will not recognize clips bigger than 2GB in the OSX version, which really limits what you can do!

Or maybe it just means I'm a sloppy shooter

Have you tried running Win7 in a VM with VMWare or Parallels, and doing the raw2dmg that way?

That might help...?

C

I thought about that...but, alas, I am too lazy. It should be fixed shortly...hopefully!

 

[LOALTD]

I was just thinking that you could probably batch the .DNG files not just in AE/ACR but in PS/ACR with with full PS power and various other plug-ins and have video frames processed with full on stills photography quality tools and all sorts of fancy, fancy processing and super advanced sharperning, NR, coloring tools.

Ding, ding, ding!

I'm mainly a stills photographer but I’ve been starting to get into timelapse and video over the past year.

You are EXACTLY right. This is HUGE for people that are mainly stills photographers. Just as you describe, you can process this raw video EXACTLY like you can stils. Exactly. This is driving the video people nuts, but it’s huge for me. The workflow is a bit complex but not as hard and time consuming as you’d expect. I’ve made one crappy comparison video (will post later). Here is my workflow:

1) Shoot video, staying under 2GB (it tells you in real-time how much space it’s hogging)

2) Convert .RAW file into .dng files using raw2dng. TIME: about a minute

3) Import .dng files into Lightroom (this is where my workflow is a bit different than most…) TIME: about a minute

4) Process .dng files just like you would a raw from a camera…because that is exactly what they are. (I convert my Canon .CR2 files into .dng files anyway) TIME: how many images have you edited in LR?

5) Export .dng files as full-res jpegs TIME: a couple minutes (I guess if you were really anal about quality but not about HDD space you could convert to .tif's)

6) Import full-res jpegs into Quicktime 7 Pro as an image sequence (exact same way you make a time-lapse) TIME: one second

7) Export image sequence as Apple ProRes HQ 422 .mov’s (if you don’t’ want to do any video editing you can just export these as h264-compressed .mov’s or .mp4’s instead) TIME: a couple seconds for ProRes, a couple minutes for h264

8) Import Apple ProRes 422 .mov’s into Final Cut Pro X TIME: instant

9) Edit… TIME: see LR comment, I suck at video editing

10 Export to whatever format you want TIME: a couple minutes

 

[LetTheRightLensIn]

Warning: Komputerbay 128GB cards are too slow. They won't work for this. I hear their smaller sized cards are faster though.

 

[LetTheRightLensIn]

4) Process .dng files just like you would a raw from a camera…because that is exactly what they are. (I convert my Canon .CR2 files into .dng files anyway) TIME: how many images have you edited in LR?

How long does it take for LR to apply the edit done to the initial .dng to the rest of the batch?

AE seems to be pretty slow at this (like 45 minutes for 49 second long clip or in that ballparl).

 

[deleteme]

How long does it take for LR to apply the edit done to the initial .dng to the rest of the batch?

AE seems to be pretty slow at this (like 45 minutes for 49 second long clip or in that ballparl).

In LR the edits are applied super fast... it's the export of the edited RAWs to JPG that takes the time.
In my experience the more local adjustments one does (burning, dodging, gradients etc.) the longer the rendering of JPGs. As long as you have a reasonably powerful machine with adequate RAM and fast HDs it doesn't take too long per image.

 

[cayenne]

Warning: Komputerbay 128GB cards are too slow. They won't work for this. I hear their smaller sized cards are faster though.

I'd kind of think any CF card that was "cheap" would be suspect for any real high speed recording like this.

I'm thinking going with 64GB quality cards, and having 2-3 three of them on hand..one in the computer unloading while the other two are in rotation.

I don't think you'd need a full 128GB at a time with this...how often for video do you record more than a few mintues at a time?

C

 

[Drizzt321]

I was just thinking that you could probably batch the .DNG files not just in AE/ACR but in PS/ACR with with full PS power and various other plug-ins and have video frames processed with full on stills photography quality tools and all sorts of fancy, fancy processing and super advanced sharperning, NR, coloring tools.

Ding, ding, ding!

I'm mainly a stills photographer but I’ve been starting to get into timelapse and video over the past year.

You are EXACTLY right. This is HUGE for people that are mainly stills photographers. Just as you describe, you can process this raw video EXACTLY like you can stils. Exactly. This is driving the video people nuts, but it’s huge for me. The workflow is a bit complex but not as hard and time consuming as you’d expect. I’ve made one crappy comparison video (will post later). Here is my workflow:

1) Shoot video, staying under 2GB (it tells you in real-time how much space it’s hogging)

2) Convert .RAW file into .dng files using raw2dng. TIME: about a minute

3) Import .dng files into Lightroom (this is where my workflow is a bit different than most…) TIME: about a minute

4) Process .dng files just like you would a raw from a camera…because that is exactly what they are. (I convert my Canon .CR2 files into .dng files anyway) TIME: how many images have you edited in LR?

5) Export .dng files as full-res jpegs TIME: a couple minutes (I guess if you were really anal about quality but not about HDD space you could convert to .tif's)

6) Import full-res jpegs into Quicktime 7 Pro as an image sequence (exact same way you make a time-lapse) TIME: one second

7) Export image sequence as Apple ProRes HQ 422 .mov’s (if you don’t’ want to do any video editing you can just export these as h264-compressed .mov’s or .mp4’s instead) TIME: a couple seconds for ProRes, a couple minutes for h264

8) Import Apple ProRes 422 .mov’s into Final Cut Pro X TIME: instant

9) Edit… TIME: see LR comment, I suck at video editing

10 Export to whatever format you want TIME: a couple minutes

Canyon do this with PNG or TIFF? In theory You can get better quality if you output the final movie at full resolution. Although...if you're outputting in a lossy format anyway, it might not make a difference.

 

[peederj]

Yes do it in TIFF. Cinema5D published a workflow that way.

http://www.cinema5d.com/?p=18065

 

[cayenne]

I was just thinking that you could probably batch the .DNG files not just in AE/ACR but in PS/ACR with with full PS power and various other plug-ins and have video frames processed with full on stills photography quality tools and all sorts of fancy, fancy processing and super advanced sharperning, NR, coloring tools.

Ding, ding, ding!

I'm mainly a stills photographer but I’ve been starting to get into timelapse and video over the past year.

You are EXACTLY right. This is HUGE for people that are mainly stills photographers. Just as you describe, you can process this raw video EXACTLY like you can stils. Exactly. This is driving the video people nuts, but it’s huge for me. The workflow is a bit complex but not as hard and time consuming as you’d expect. I’ve made one crappy comparison video (will post later). Here is my workflow:

1) Shoot video, staying under 2GB (it tells you in real-time how much space it’s hogging)

2) Convert .RAW file into .dng files using raw2dng. TIME: about a minute

3) Import .dng files into Lightroom (this is where my workflow is a bit different than most…) TIME: about a minute

4) Process .dng files just like you would a raw from a camera…because that is exactly what they are. (I convert my Canon .CR2 files into .dng files anyway) TIME: how many images have you edited in LR?

5) Export .dng files as full-res jpegs TIME: a couple minutes (I guess if you were really anal about quality but not about HDD space you could convert to .tif's)

6) Import full-res jpegs into Quicktime 7 Pro as an image sequence (exact same way you make a time-lapse) TIME: one second

7) Export image sequence as Apple ProRes HQ 422 .mov’s (if you don’t’ want to do any video editing you can just export these as h264-compressed .mov’s or .mp4’s instead) TIME: a couple seconds for ProRes, a couple minutes for h264

8) Import Apple ProRes 422 .mov’s into Final Cut Pro X TIME: instant

9) Edit… TIME: see LR comment, I suck at video editing

10 Export to whatever format you want TIME: a couple minutes

A question about #1.

Why stay under 2GB?

Thanks,

cayenne

 

[LOALTD]

I was just thinking that you could probably batch the .DNG files not just in AE/ACR but in PS/ACR with with full PS power and various other plug-ins and have video frames processed with full on stills photography quality tools and all sorts of fancy, fancy processing and super advanced sharperning, NR, coloring tools.

Ding, ding, ding!

I'm mainly a stills photographer but I’ve been starting to get into timelapse and video over the past year.

You are EXACTLY right. This is HUGE for people that are mainly stills photographers. Just as you describe, you can process this raw video EXACTLY like you can stils. Exactly. This is driving the video people nuts, but it’s huge for me. The workflow is a bit complex but not as hard and time consuming as you’d expect. I’ve made one crappy comparison video (will post later). Here is my workflow:

1) Shoot video, staying under 2GB (it tells you in real-time how much space it’s hogging)

2) Convert .RAW file into .dng files using raw2dng. TIME: about a minute

3) Import .dng files into Lightroom (this is where my workflow is a bit different than most…) TIME: about a minute

4) Process .dng files just like you would a raw from a camera…because that is exactly what they are. (I convert my Canon .CR2 files into .dng files anyway) TIME: how many images have you edited in LR?

5) Export .dng files as full-res jpegs TIME: a couple minutes (I guess if you were really anal about quality but not about HDD space you could convert to .tif's)

6) Import full-res jpegs into Quicktime 7 Pro as an image sequence (exact same way you make a time-lapse) TIME: one second

7) Export image sequence as Apple ProRes HQ 422 .mov’s (if you don’t’ want to do any video editing you can just export these as h264-compressed .mov’s or .mp4’s instead) TIME: a couple seconds for ProRes, a couple minutes for h264

8) Import Apple ProRes 422 .mov’s into Final Cut Pro X TIME: instant

9) Edit… TIME: see LR comment, I suck at video editing

10 Export to whatever format you want TIME: a couple minutes

A question about #1.

Why stay under 2GB?

Thanks,

cayenne

Good question!

This issue is caused by the mac version of raw2dng not being able to convert files over 2GB in size. On a PC you can go up to 4.28GB. It's frustrating, but is an issue in the post-processing, not in the ML firmware.

 

[LOALTD]

I was just thinking that you could probably batch the .DNG files not just in AE/ACR but in PS/ACR with with full PS power and various other plug-ins and have video frames processed with full on stills photography quality tools and all sorts of fancy, fancy processing and super advanced sharperning, NR, coloring tools.

Ding, ding, ding!

I'm mainly a stills photographer but I’ve been starting to get into timelapse and video over the past year.

You are EXACTLY right. This is HUGE for people that are mainly stills photographers. Just as you describe, you can process this raw video EXACTLY like you can stils. Exactly. This is driving the video people nuts, but it’s huge for me. The workflow is a bit complex but not as hard and time consuming as you’d expect. I’ve made one crappy comparison video (will post later). Here is my workflow:

1) Shoot video, staying under 2GB (it tells you in real-time how much space it’s hogging)

2) Convert .RAW file into .dng files using raw2dng. TIME: about a minute

3) Import .dng files into Lightroom (this is where my workflow is a bit different than most…) TIME: about a minute

4) Process .dng files just like you would a raw from a camera…because that is exactly what they are. (I convert my Canon .CR2 files into .dng files anyway) TIME: how many images have you edited in LR?

5) Export .dng files as full-res jpegs TIME: a couple minutes (I guess if you were really anal about quality but not about HDD space you could convert to .tif's)

6) Import full-res jpegs into Quicktime 7 Pro as an image sequence (exact same way you make a time-lapse) TIME: one second

7) Export image sequence as Apple ProRes HQ 422 .mov’s (if you don’t’ want to do any video editing you can just export these as h264-compressed .mov’s or .mp4’s instead) TIME: a couple seconds for ProRes, a couple minutes for h264

8) Import Apple ProRes 422 .mov’s into Final Cut Pro X TIME: instant

9) Edit… TIME: see LR comment, I suck at video editing

10 Export to whatever format you want TIME: a couple minutes

Canyon do this with PNG or TIFF? In theory You can get better quality if you output the final movie at full resolution. Although...if you're outputting in a lossy format anyway, it might not make a difference.

Of course you can! See step #5! I chose to edit/grade the video in LR, not in my video editing software, so jpg is just as good as .tif in my case. If you want to grade it in your video-editing software, you should DEFINITELY export as .tif instead of .jpg.

For my workflow I doubt there would be much difference since I use LR to grade the .dng's and then I don't really touch them in FCPX...I also am quickly burning through HDD space ;D

 

[LOALTD]

Warning: Komputerbay 128GB cards are too slow. They won't work for this. I hear their smaller sized cards are faster though.

Yeah, read the FINE PRINT about the WRITE speeds of the cards. You need at least 90MB/s WRITE for 1920x1080 24p raw video. Not all 1000X cards are created equal unfortunately. Seems like you can just have a fast read speed and call your card 1000X...

My Komputerbay 64GB is working great so far, I was definitely a skeptic...

 

[Drizzt321]

Warning: Komputerbay 128GB cards are too slow. They won't work for this. I hear their smaller sized cards are faster though.

Yeah, read the FINE PRINT about the WRITE speeds of the cards. You need at least 90MB/s WRITE for 1920x1080 24p raw video. Not all 1000X cards are created equal unfortunately. Seems like you can just have a fast read speed and call your card 1000X...

My Komputerbay 64GB is working great so far, I was definitely a skeptic...

Yea, the write speeds have to do with how many NAND devices and the type and the controller. More devices, SLC instead of MLC, good garbage collection algorithms. Those all contribute to faater write speeds. And higher costs.

 

[LOALTD]

They have fixed the Mac GUI version of raw2dng, no more 2GB recording limit! That was very fast and very un-Canon!

 

[Drizzt321]

They have fixed the Mac GUI version of raw2dng, no more 2GB recording limit! That was very fast and very un-Canon!

That's because it's not Canon, it's the MagicLantern team

 

[rpt]

Has anyone used the latest ML release (alpha 3 or nightly build) with the 1.2.1 firmware? Also how do I get the nightly build? Do I need to build it?

Thanks in advance.

 

[LetTheRightLensIn]

Has anyone used the latest ML release (alpha 3 or nightly build) with the 1.2.1 firmware? Also how do I get the nightly build? Do I need to build it?

Thanks in advance.

1. You MUST remove 1.2.1 and re-install the previous firmware.
2. check this thread for builds: http://www.magiclantern.fm/forum/index.php?topic=5413.125