YouTube: 35 Hours of Video Are Uploaded Every Minute - Tackling the YouTube Video Processing Challenge

YouTube blog has posted review of the progress in improving the processing and publishing speed for videos. "35 hours of video are uploaded to YouTube every minute. Over time, the average file size is going up, the average resolution is going up, as people switch to HD cameras and the average duration of the videos […]

YouTube blog has posted review of the progress in improving the processing and publishing speed for videos.

"35 hours of video are uploaded to YouTube every minute. Over time, the average file size is going up, the average resolution is going up, as people switch to HD cameras and the average duration of the videos is going up. Moreover, an increase in resolution results in a quadratic increase in the number of pixels to be processed - a 1080p HD video has 2M pixels compared to 300k pixels in a 480p (DVD quality) video.

In the last few years the YouTube infrastructure team has tackled this challenge in a variety of different ways," stated Google.

Here're the two main highlight:

  • First is to overlap uploads and video processing without waiting for the upload to finish. This results in a base quality version of your video going live very quickly after the upload completes, making the link to your video active and shareable.
  • Second technique, internally codenamed Hydra tackles this problem by leveraging Google's massive cloud computing capabilities. Google split a single video into small chunks and process each chunk simultaneously on different machines. Hydra then reassembles all the processed chunks so that you see a seamless video, processed and published in a fraction of the time it would have taken to do it previously.

As you can see from the chart, Google's making big strides when it comes to get videos processed and live faster.

YouTube performance char

Here're some additional stats:

    We now process videos seven times faster than we did in 2008.
  • We've gotten four times faster in the last six months
  • 60% of all YouTube videos go live in under a minute as compared to none last year.

[Source]