{"id":665,"date":"2018-06-14T18:43:28","date_gmt":"2018-06-14T18:43:28","guid":{"rendered":"http:\/\/blogs.gentoo.org\/lu_zero\/?p=665"},"modified":"2018-06-14T18:43:28","modified_gmt":"2018-06-14T18:43:28","slug":"video-compression-bounty-hunters","status":"publish","type":"post","link":"https:\/\/blogs.gentoo.org\/lu_zero\/2018\/06\/14\/video-compression-bounty-hunters\/","title":{"rendered":"Video Compression Bounty Hunters"},"content":{"rendered":"

In this post, we (Luca Barbato and Luc Trudeau<\/a>) joined forces to talk about the awesome work we\u2019ve been doing on Altivec\/VSX<\/a> optimizations for the libvpx<\/a> library, you can read it here or on Luc’s medium<\/a>.<\/p>\n

Both of us where in Brussels for FOSDEM 2018<\/a>, Luca presented his work on rust-av<\/a> and Luc was there to hack on rav1e<\/a> \u2013 an experimental AV1 video encoder in Rust<\/a>.<\/p>\n

Luca joined the rav1e team and helped give hints about how to effectively leverage rust. Together, we worked on AV1 intra prediction code<\/a>, among the other things.<\/p>\n

Luc Trudeau<\/b>: I was finishing up my work on Chroma from Luma in AV1<\/a>, and wanted to stay involved in royalty free open source video codecs. When Luca talked to me about libvpx bounties on Bountysource<\/a>, I was immediately intrigued.<\/p>\n

Luca Barbato<\/b>: Luc just finished implementing the Neon version of his CfL<\/a> work and I wondered how that code could work using VSX. I prepared some of the machinery that was missing in libaom and Luc tried his hand on Altivec<\/a>. We still had some pending libvpx work sponsored by IBM and I asked him if he wanted to join in.<\/p>\n

What\u2019s libvpx?<\/h1>\n

For those less familiar, libvpx is the official Google implementation of the VP9<\/a> video format. VP9 is most notably used in YouTube<\/a> and Netflix<\/a>. VP9 playback is available on some browsers including Chrome, Edge and Firefox<\/a> and also on Android devices, covering the 75.31% of the global user base.<\/p>\n

\"\"<\/a><\/p>\n

Ref: caniuse.com VP9 support in browsers.<\/a><\/p>\n

Why use VP9, when the de facto video format is H.264\/AVC?<\/h1>\n

Because VP9 is royalty free<\/a> and the bandwidth savings are substantial when compared to H.264<\/a> when playback is available (an estimated 3.3B devices support VP9<\/a>). In other words, having VP9 as a secondary codec can pay for itself in bandwidth savings by not having to send H.264 to most users.<\/p>\n

\"\"<\/a><\/p>\n

Ref: Netflix VP9 compression analysis.<\/a><\/p>\n

Why care about libvpx on Power?<\/h1>\n

Dynamic adaptive streaming formats like HLS<\/a> and MPEG DASH<\/a> have completely changed the game of streaming video over the internet. Streaming hardware and custom multimedia servers are being replaced by web servers.<\/p>\n

From the servers\u2019 perspective streaming video is akin to serving small videos files; lots of small video files! To cover all clients and most network conditions a considerable amount of video files must be encoded, stored and distributed.<\/p>\n

Things are changing fast and while the total cost of ownership of video content for previous generation video formats, like H.264, was mostly made up of bandwidth and hosting, encoding costs are growing with more complex video formats like HEVC<\/a> and VP9.<\/p>\n

This complexity is reported to have grown exponentially with the upcoming AV1 video format<\/a>. A video format, built on the libVPX code base, by the Alliance for Open Media<\/a>, of which IBM is a founding member<\/a>.<\/p>\n

\"\"<\/a><\/p>\n

Ref: Facebook\u2019s AV1 complexity analysis<\/a><\/i><\/p>\n

At the same time, IBM and its partners in the OpenPower Foundation<\/a> are releasing some very impressive hardware with the new Power9<\/a> processor line up. Big Iron Power9 systems, like the Talos II<\/a> from Raptor Computing Systems<\/a> and the collaboration between Google<\/a> and Rackspace<\/a> on Zaius\/Barreleye servers, are ideal solutions to the tackle the growing complexity of video format encoding.<\/p>\n

However, these awesome machines are currently at a disadvantage when encoding video. Without the platform specific optimizations, that their competitors enjoy, the Power9 architecture can\u2019t be fully utilized. This is clearly illustrated in the x264 benchmark released in a recent Phoronix article<\/a>.<\/p>\n

<\/a><\/p>\n

Ref: Phoronix x264 server benchmark.<\/a><\/p>\n

Thanks to the optimization bounties sponsored by IBM, we are hard at work bridging the gap in libvpx.<\/p>\n

Optimization bounties?<\/h1>\n

Just like bug bounty programs<\/a>, optimization make for great bounties. Companies that see benefit in platform specific optimizations for video codecs can sponsor our bounties on the Bountysource platform<\/a>.<\/p>\n

Multiple companies can sponsor the same bounty, thus sharing cost of more important bounties. Furthermore, bounties are a minimal risk investment for sponsors, as they are only paid out when the work is completed (and peer reviewed by libvpx maintainers)<\/p>\n

Not only is the Bountysource platform a win for companies that directly benefit from the bounties they are sponsoring, it\u2019s also a win for developers (like us) who can get paid to work on free and open source projects that we are passionate about. Optimization bounties are a source of sustainability in the free and open source software ecosystem.<\/p>\n

How do you choose bounties?<\/h1>\n

Since we\u2019re a small team of bounty hunters (Luca Barbato<\/a>, Alexandra H\u00e1jkov\u00e1<\/a>, Rafael de Lucena Valle<\/a> and Luc Trudeau<\/a>), we need to play it smart and maximize the impact of our work. We\u2019ve identified two common use cases related to streaming on the Power architecture: YouTube-like encodes and real time (a.k.a. low latency) encodes.<\/p>\n

By profiling libvpx under these conditions, we can determine the key functions to optimize. The following charts show the percentage of time spent the in top 20 functions of the libvpx encoder (without Altivec\/VSX optimisations) on a Power8 system, for both YouTube-like and real time settings.<\/p>\n

\"\"<\/a><\/p>\n

\"\"<\/a><\/p>\n

It\u2019s interesting to see that the top 20 functions make up about 80% of the encoding time. That\u2019s similar in spirit to the Pareto principle<\/a>, in that we don\u2019t have to optimize the whole encoder to make the Power architecture competitive for video encoding.<\/p>\n

We see a similar distribution between YouTube-like encoding settings and real time video encoding. In other words, optimization bounties for libvpx benefit both Video on Demand (VOD) and live broadcast services.<\/p>\n

We add bounties on the Bountysource platform<\/a> around common themed functions like: convolution, sum of absolute differences (SAD), variance, etc. Companies interested in libvpx optimization can go and fund these bounties.<\/p>\n

What\u2019s the impact of this project so far?<\/h1>\n

So far, we delivered multiple libvpx bounties including:<\/p>\n