Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670

Warning: preg_match_all(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 665

Warning: Invalid argument supplied for foreach() in /home/treetwik/public_html/includes/MagicWord.php on line 666

Warning: preg_replace(): Compilation failed: group name must start with a non-digit at offset 4 in /home/treetwik/public_html/includes/MagicWord.php on line 670
Compressor local cluster setup - TreetWiki

Compressor local cluster setup

From TreetWiki

Jump to: navigation, search
(Job Segmenting)
 
[http://www.devia.be/news/article/setting-up-a-virtual-cluster-to-speed-up-compressor/ Here] is an article about how to set up a virtual cluster on your Mac Pro to expedite Compressor.
[http://www.devia.be/news/article/setting-up-a-virtual-cluster-to-speed-up-compressor/ Here] is an article about how to set up a virtual cluster on your Mac Pro to expedite Compressor.
-
=== Job Segmenting ===
+
=== Job Segmenting: Yes for H.264, No for ProRes?===
Note that there is a special setting in Compressor (along with the video format and per-file compressor settings) called "Job Segmenting".  You must turn this on to have Compressor work at its fastest. It's described [http://documentation.apple.com/en/compressor/usermanual/index.html#chapter=8&section=6&tasks=true here]. However, it's not always the best thing to do.
Note that there is a special setting in Compressor (along with the video format and per-file compressor settings) called "Job Segmenting".  You must turn this on to have Compressor work at its fastest. It's described [http://documentation.apple.com/en/compressor/usermanual/index.html#chapter=8&section=6&tasks=true here]. However, it's not always the best thing to do.
-
Segmentation requires splitting the actual source file into multiple pieces, then encoding each, then seaming it back together. If you're not careful, segmentation can cause significant I/O time to be spent, especially if files are large and encoding is non-CPU intensive.  Since ProRes is a very non-CPU-intensive codec (in contrast to H.264), then segmentation can negatively impact your I/O speed as huge files are split, encoded, then re-combined.  
+
Segmentation requires splitting the actual source file into multiple pieces, then encoding each, then seaming it back together. If you're not careful, segmentation can cause significant I/O time to be spent, especially if files are large and encoding is non-CPU-intensive.  Since ProRes is a very non-CPU-intensive codec (in contrast to H.264), then segmentation can negatively impact your I/O speed as huge files are split, encoded, then re-combined.  
Treet runs a fibre internal network so they get 10Gb/s transfer rates between their main Mac Pro and two clustered rendering machines. It turned out, simply through experimentation, that non-segmented ProRes encoding was faster, and since Treet are often encoding several at once, they are using all the processors effectively.  H.264 however is so CPU-intensive, that the I/O overhead of segmentation is well worth it.
Treet runs a fibre internal network so they get 10Gb/s transfer rates between their main Mac Pro and two clustered rendering machines. It turned out, simply through experimentation, that non-segmented ProRes encoding was faster, and since Treet are often encoding several at once, they are using all the processors effectively.  H.264 however is so CPU-intensive, that the I/O overhead of segmentation is well worth it.
Just try it each way and monitor your experience.
Just try it each way and monitor your experience.

Current revision as of 10:13, 29 July 2011

Personal tools